Apr 13 16:16:00 user nova-compute[71731]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code.
Apr 13 16:16:02 user nova-compute[71731]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=71731) initialize /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:44}}
Apr 13 16:16:02 user nova-compute[71731]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=71731) initialize /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:44}}
Apr 13 16:16:02 user nova-compute[71731]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=71731) initialize /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:44}}
Apr 13 16:16:02 user nova-compute[71731]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Apr 13 16:16:02 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.020s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:16:03 user nova-compute[71731]: INFO nova.virt.driver [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] Loading compute driver 'libvirt.LibvirtDriver'
Apr 13 16:16:03 user nova-compute[71731]: INFO nova.compute.provider_config [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] Acquiring lock "singleton_lock" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] Acquired lock "singleton_lock" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] Releasing lock "singleton_lock" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] Full set of CONF: {{(pid=71731) _wait_for_exit_or_signal /usr/local/lib/python3.10/dist-packages/oslo_service/service.py:362}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] ******************************************************************************** {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] Configuration options gathered from: {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] ================================================================================ {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] allow_resize_to_same_host      = True {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] arq_binding_timeout            = 300 {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] backdoor_port                  = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] backdoor_socket                = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] block_device_allocate_retries  = 300 {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] block_device_allocate_retries_interval = 5 {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] cert                           = self.pem {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] compute_monitors               = [] {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] config_dir                     = [] {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] config_drive_format            = iso9660 {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] config_source                  = [] {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] console_host                   = user {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] control_exchange               = nova {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] cpu_allocation_ratio           = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] daemon                         = False {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] debug                          = True {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] default_access_ip_network_name = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] default_availability_zone      = nova {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] default_ephemeral_format       = ext4 {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] default_schedule_zone          = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] disk_allocation_ratio          = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] enable_new_services            = True {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] enabled_apis                   = ['osapi_compute'] {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] enabled_ssl_apis               = [] {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] flat_injected                  = False {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] force_config_drive             = False {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] force_raw_images               = True {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] graceful_shutdown_timeout      = 5 {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] heal_instance_info_cache_interval = 60 {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] host                           = user {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] initial_disk_allocation_ratio  = 1.0 {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] initial_ram_allocation_ratio   = 1.0 {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] instance_build_timeout         = 0 {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] instance_delete_interval       = 300 {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] instance_format                = [instance: %(uuid)s]  {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] instance_name_template         = instance-%08x {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] instance_usage_audit           = False {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] instance_usage_audit_period    = month {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] internal_service_availability_zone = internal {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] key                            = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] live_migration_retry_count     = 30 {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] log_config_append              = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] log_dir                        = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] log_file                       = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] log_options                    = True {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] log_rotate_interval            = 1 {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] log_rotate_interval_type       = days {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] log_rotation_type              = none {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] long_rpc_timeout               = 1800 {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] max_concurrent_builds          = 10 {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] max_concurrent_live_migrations = 1 {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] max_concurrent_snapshots       = 5 {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] max_local_block_devices        = 3 {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] max_logfile_count              = 30 {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] max_logfile_size_mb            = 200 {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] maximum_instance_delete_attempts = 5 {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] metadata_listen                = 0.0.0.0 {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] metadata_listen_port           = 8775 {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] metadata_workers               = 3 {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] migrate_max_retries            = -1 {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] mkisofs_cmd                    = genisoimage {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] my_block_storage_ip            = 10.0.0.210 {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] my_ip                          = 10.0.0.210 {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] network_allocate_retries       = 0 {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] osapi_compute_listen           = 0.0.0.0 {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] osapi_compute_listen_port      = 8774 {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] osapi_compute_unique_server_name_scope =  {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] osapi_compute_workers          = 3 {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] password_length                = 12 {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] periodic_enable                = True {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] periodic_fuzzy_delay           = 60 {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] pointer_model                  = ps2mouse {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] preallocate_images             = none {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] publish_errors                 = False {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] pybasedir                      = /opt/stack/nova {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] ram_allocation_ratio           = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] rate_limit_burst               = 0 {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] rate_limit_except_level        = CRITICAL {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] rate_limit_interval            = 0 {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] reboot_timeout                 = 0 {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] reclaim_instance_interval      = 0 {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] record                         = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] reimage_timeout_per_gb         = 20 {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] report_interval                = 10 {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] rescue_timeout                 = 0 {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] reserved_host_cpus             = 0 {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] reserved_host_disk_mb          = 0 {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] reserved_host_memory_mb        = 512 {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] reserved_huge_pages            = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] resize_confirm_window          = 0 {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] resize_fs_using_block_device   = False {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] resume_guests_state_on_host_boot = False {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] rpc_response_timeout           = 60 {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] run_external_periodic_tasks    = True {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] running_deleted_instance_action = reap {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] running_deleted_instance_poll_interval = 1800 {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] running_deleted_instance_timeout = 0 {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] scheduler_instance_sync_interval = 120 {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] service_down_time              = 60 {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] servicegroup_driver            = db {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] shelved_offload_time           = 0 {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] shelved_poll_interval          = 3600 {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] shutdown_timeout               = 0 {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] source_is_ipv6                 = False {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] ssl_only                       = False {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] state_path                     = /opt/stack/data/nova {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] sync_power_state_interval      = 600 {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] sync_power_state_pool_size     = 1000 {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] syslog_log_facility            = LOG_USER {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] tempdir                        = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] timeout_nbd                    = 10 {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] transport_url                  = **** {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] update_resources_interval      = 0 {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] use_cow_images                 = True {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] use_eventlog                   = False {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] use_journal                    = False {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] use_json                       = False {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] use_rootwrap_daemon            = False {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] use_stderr                     = False {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] use_syslog                     = False {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] vcpu_pin_set                   = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] vif_plugging_is_fatal          = False {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] vif_plugging_timeout           = 0 {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] virt_mkfs                      = [] {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] volume_usage_poll_interval     = 0 {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] watch_log_file                 = False {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] web                            = /usr/share/spice-html5 {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] oslo_concurrency.disable_process_locking = False {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] api.auth_strategy              = keystone {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] api.compute_link_prefix        = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] api.dhcp_domain                = novalocal {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] api.enable_instance_password   = True {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] api.glance_link_prefix         = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] api.instance_list_cells_batch_strategy = distributed {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] api.instance_list_per_project_cells = False {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] api.list_records_by_skipping_down_cells = True {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] api.local_metadata_per_cell    = False {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] api.max_limit                  = 1000 {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] api.metadata_cache_expiration  = 15 {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] api.neutron_default_tenant_id  = default {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] api.use_forwarded_for          = False {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] api.use_neutron_default_nets   = False {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] api.vendordata_dynamic_failure_fatal = False {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] api.vendordata_dynamic_targets = [] {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] api.vendordata_jsonfile_path   = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] cache.backend                  = dogpile.cache.memcached {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] cache.backend_argument         = **** {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] cache.config_prefix            = cache.oslo {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] cache.dead_timeout             = 60.0 {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] cache.debug_cache_backend      = False {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] cache.enable_retry_client      = False {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] cache.enable_socket_keepalive  = False {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] cache.enabled                  = True {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] cache.expiration_time          = 600 {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] cache.hashclient_retry_attempts = 2 {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] cache.hashclient_retry_delay   = 1.0 {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] cache.memcache_dead_retry      = 300 {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] cache.memcache_password        =  {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] cache.memcache_pool_maxsize    = 10 {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] cache.memcache_sasl_enabled    = False {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] cache.memcache_socket_timeout  = 1.0 {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] cache.memcache_username        =  {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] cache.proxies                  = [] {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] cache.retry_attempts           = 2 {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] cache.retry_delay              = 0.0 {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] cache.socket_keepalive_count   = 1 {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] cache.socket_keepalive_idle    = 1 {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] cache.socket_keepalive_interval = 1 {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] cache.tls_allowed_ciphers      = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] cache.tls_cafile               = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] cache.tls_certfile             = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] cache.tls_enabled              = False {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] cache.tls_keyfile              = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] cinder.auth_section            = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] cinder.auth_type               = password {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] cinder.cafile                  = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] cinder.catalog_info            = volumev3::publicURL {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] cinder.certfile                = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] cinder.collect_timing          = False {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] cinder.cross_az_attach         = True {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] cinder.debug                   = False {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] cinder.endpoint_template       = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] cinder.http_retries            = 3 {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] cinder.insecure                = False {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] cinder.keyfile                 = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] cinder.os_region_name          = RegionOne {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] cinder.split_loggers           = False {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] cinder.timeout                 = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] compute.cpu_dedicated_set      = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] compute.cpu_shared_set         = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] compute.image_type_exclude_list = [] {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] compute.live_migration_wait_for_vif_plug = True {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] compute.max_concurrent_disk_ops = 0 {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] compute.max_disk_devices_to_attach = -1 {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] compute.resource_provider_association_refresh = 300 {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] compute.shutdown_retry_interval = 10 {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] conductor.workers              = 3 {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] console.allowed_origins        = [] {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] console.ssl_ciphers            = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] console.ssl_minimum_version    = default {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] consoleauth.token_ttl          = 600 {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] cyborg.cafile                  = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] cyborg.certfile                = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] cyborg.collect_timing          = False {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] cyborg.connect_retries         = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] cyborg.connect_retry_delay     = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] cyborg.endpoint_override       = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] cyborg.insecure                = False {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] cyborg.keyfile                 = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] cyborg.max_version             = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] cyborg.min_version             = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] cyborg.region_name             = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] cyborg.service_name            = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] cyborg.service_type            = accelerator {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] cyborg.split_loggers           = False {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] cyborg.status_code_retries     = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] cyborg.status_code_retry_delay = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] cyborg.timeout                 = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] cyborg.version                 = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] database.backend               = sqlalchemy {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] database.connection            = **** {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] database.connection_debug      = 0 {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] database.connection_parameters =  {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] database.connection_recycle_time = 3600 {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] database.connection_trace      = False {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] database.db_inc_retry_interval = True {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] database.db_max_retries        = 20 {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] database.db_max_retry_interval = 10 {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] database.db_retry_interval     = 1 {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] database.max_overflow          = 50 {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] database.max_pool_size         = 5 {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] database.max_retries           = 10 {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] database.mysql_enable_ndb      = False {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] database.mysql_wsrep_sync_wait = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] database.pool_timeout          = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] database.retry_interval        = 10 {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] database.slave_connection      = **** {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] database.sqlite_synchronous    = True {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] api_database.backend           = sqlalchemy {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] api_database.connection        = **** {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] api_database.connection_debug  = 0 {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] api_database.connection_parameters =  {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] api_database.connection_recycle_time = 3600 {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] api_database.connection_trace  = False {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] api_database.db_inc_retry_interval = True {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] api_database.db_max_retries    = 20 {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] api_database.db_max_retry_interval = 10 {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] api_database.db_retry_interval = 1 {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] api_database.max_overflow      = 50 {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] api_database.max_pool_size     = 5 {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] api_database.max_retries       = 10 {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] api_database.mysql_enable_ndb  = False {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] api_database.mysql_wsrep_sync_wait = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] api_database.pool_timeout      = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] api_database.retry_interval    = 10 {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] api_database.slave_connection  = **** {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] api_database.sqlite_synchronous = True {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] devices.enabled_mdev_types     = [] {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] ephemeral_storage_encryption.enabled = False {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] ephemeral_storage_encryption.key_size = 512 {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] glance.api_servers             = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] glance.cafile                  = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] glance.certfile                = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] glance.collect_timing          = False {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] glance.connect_retries         = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] glance.connect_retry_delay     = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] glance.debug                   = False {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] glance.default_trusted_certificate_ids = [] {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] glance.enable_certificate_validation = False {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] glance.enable_rbd_download     = False {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] glance.endpoint_override       = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] glance.insecure                = False {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] glance.keyfile                 = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] glance.max_version             = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] glance.min_version             = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] glance.num_retries             = 3 {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] glance.rbd_ceph_conf           =  {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] glance.rbd_connect_timeout     = 5 {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] glance.rbd_pool                =  {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] glance.rbd_user                =  {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] glance.region_name             = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] glance.service_name            = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] glance.service_type            = image {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] glance.split_loggers           = False {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] glance.status_code_retries     = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] glance.status_code_retry_delay = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] glance.timeout                 = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] glance.verify_glance_signatures = False {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] glance.version                 = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] guestfs.debug                  = False {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] hyperv.config_drive_cdrom      = False {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] hyperv.config_drive_inject_password = False {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] hyperv.enable_instance_metrics_collection = False {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] hyperv.enable_remotefx         = False {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] hyperv.instances_path_share    =  {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] hyperv.iscsi_initiator_list    = [] {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] hyperv.limit_cpu_features      = False {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] hyperv.power_state_check_timeframe = 60 {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] hyperv.power_state_event_polling_interval = 2 {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] hyperv.use_multipath_io        = False {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] hyperv.volume_attach_retry_count = 10 {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] hyperv.volume_attach_retry_interval = 5 {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] hyperv.vswitch_name            = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] mks.enabled                    = False {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] image_cache.manager_interval   = 2400 {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] image_cache.precache_concurrency = 1 {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] image_cache.remove_unused_base_images = True {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] image_cache.subdirectory_name  = _base {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] ironic.api_max_retries         = 60 {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] ironic.api_retry_interval      = 2 {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] ironic.auth_section            = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] ironic.auth_type               = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] ironic.cafile                  = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] ironic.certfile                = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] ironic.collect_timing          = False {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] ironic.connect_retries         = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] ironic.connect_retry_delay     = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] ironic.endpoint_override       = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] ironic.insecure                = False {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] ironic.keyfile                 = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] ironic.max_version             = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] ironic.min_version             = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] ironic.partition_key           = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] ironic.peer_list               = [] {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] ironic.region_name             = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] ironic.serial_console_state_timeout = 10 {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] ironic.service_name            = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] ironic.service_type            = baremetal {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] ironic.split_loggers           = False {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] ironic.status_code_retries     = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] ironic.status_code_retry_delay = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] ironic.timeout                 = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] ironic.version                 = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] key_manager.fixed_key          = **** {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] barbican.barbican_api_version  = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] barbican.barbican_endpoint     = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] barbican.barbican_endpoint_type = public {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] barbican.barbican_region_name  = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] barbican.cafile                = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] barbican.certfile              = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] barbican.collect_timing        = False {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] barbican.insecure              = False {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] barbican.keyfile               = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] barbican.number_of_retries     = 60 {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] barbican.retry_delay           = 1 {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] barbican.send_service_user_token = False {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] barbican.split_loggers         = False {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] barbican.timeout               = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] barbican.verify_ssl            = True {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] barbican.verify_ssl_path       = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] barbican_service_user.auth_section = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] barbican_service_user.auth_type = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] barbican_service_user.cafile   = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] barbican_service_user.certfile = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] barbican_service_user.collect_timing = False {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] barbican_service_user.insecure = False {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] barbican_service_user.keyfile  = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] barbican_service_user.split_loggers = False {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] barbican_service_user.timeout  = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] vault.approle_role_id          = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] vault.approle_secret_id        = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] vault.cafile                   = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] vault.certfile                 = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] vault.collect_timing           = False {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] vault.insecure                 = False {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] vault.keyfile                  = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] vault.kv_mountpoint            = secret {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] vault.kv_version               = 2 {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] vault.namespace                = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] vault.root_token_id            = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] vault.split_loggers            = False {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] vault.ssl_ca_crt_file          = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] vault.timeout                  = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] vault.use_ssl                  = False {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] keystone.cafile                = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] keystone.certfile              = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] keystone.collect_timing        = False {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] keystone.connect_retries       = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] keystone.connect_retry_delay   = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] keystone.endpoint_override     = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] keystone.insecure              = False {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] keystone.keyfile               = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] keystone.max_version           = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] keystone.min_version           = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] keystone.region_name           = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] keystone.service_name          = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] keystone.service_type          = identity {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] keystone.split_loggers         = False {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] keystone.status_code_retries   = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] keystone.status_code_retry_delay = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] keystone.timeout               = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] keystone.version               = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] libvirt.connection_uri         =  {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] libvirt.cpu_mode               = custom {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] libvirt.cpu_model_extra_flags  = [] {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: WARNING oslo_config.cfg [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] libvirt.cpu_power_governor_high = performance {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] libvirt.cpu_power_governor_low = powersave {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] libvirt.cpu_power_management   = False {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] libvirt.device_detach_attempts = 8 {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] libvirt.device_detach_timeout  = 20 {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] libvirt.disk_cachemodes        = [] {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] libvirt.disk_prefix            = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] libvirt.enabled_perf_events    = [] {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] libvirt.file_backed_memory     = 0 {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] libvirt.gid_maps               = [] {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] libvirt.hw_disk_discard        = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] libvirt.hw_machine_type        = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] libvirt.images_rbd_ceph_conf   =  {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] libvirt.images_rbd_glance_store_name =  {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] libvirt.images_rbd_pool        = rbd {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] libvirt.images_type            = default {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] libvirt.images_volume_group    = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] libvirt.inject_key             = False {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] libvirt.inject_partition       = -2 {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] libvirt.inject_password        = False {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] libvirt.iscsi_iface            = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] libvirt.iser_use_multipath     = False {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] libvirt.live_migration_bandwidth = 0 {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] libvirt.live_migration_completion_timeout = 800 {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] libvirt.live_migration_downtime = 500 {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] libvirt.live_migration_downtime_delay = 75 {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] libvirt.live_migration_downtime_steps = 10 {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] libvirt.live_migration_inbound_addr = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] libvirt.live_migration_permit_auto_converge = False {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] libvirt.live_migration_permit_post_copy = False {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] libvirt.live_migration_scheme  = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] libvirt.live_migration_timeout_action = abort {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] libvirt.live_migration_tunnelled = False {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: WARNING oslo_config.cfg [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Apr 13 16:16:03 user nova-compute[71731]: live_migration_uri is deprecated for removal in favor of two other options that
Apr 13 16:16:03 user nova-compute[71731]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Apr 13 16:16:03 user nova-compute[71731]: and ``live_migration_inbound_addr`` respectively.
Apr 13 16:16:03 user nova-compute[71731]: ).  Its value may be silently ignored in the future.
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] libvirt.live_migration_with_native_tls = False {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] libvirt.max_queues             = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] libvirt.mem_stats_period_seconds = 10 {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] libvirt.nfs_mount_options      = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] libvirt.num_aoe_discover_tries = 3 {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] libvirt.num_iser_scan_tries    = 5 {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] libvirt.num_memory_encrypted_guests = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] libvirt.num_nvme_discover_tries = 5 {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] libvirt.num_pcie_ports         = 0 {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] libvirt.num_volume_scan_tries  = 5 {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] libvirt.pmem_namespaces        = [] {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] libvirt.quobyte_client_cfg     = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] libvirt.rbd_connect_timeout    = 5 {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] libvirt.rbd_secret_uuid        = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] libvirt.rbd_user               = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] libvirt.realtime_scheduler_priority = 1 {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] libvirt.remote_filesystem_transport = ssh {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] libvirt.rescue_image_id        = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] libvirt.rescue_kernel_id       = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] libvirt.rescue_ramdisk_id      = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] libvirt.rx_queue_size          = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] libvirt.smbfs_mount_options    =  {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] libvirt.snapshot_compression   = False {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] libvirt.snapshot_image_format  = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] libvirt.sparse_logical_volumes = False {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] libvirt.swtpm_enabled          = False {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] libvirt.swtpm_group            = tss {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] libvirt.swtpm_user             = tss {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] libvirt.sysinfo_serial         = unique {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] libvirt.tx_queue_size          = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] libvirt.uid_maps               = [] {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] libvirt.use_virtio_for_bridges = True {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] libvirt.virt_type              = kvm {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] libvirt.volume_clear           = zero {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] libvirt.volume_clear_size      = 0 {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] libvirt.volume_use_multipath   = False {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] libvirt.vzstorage_cache_path   = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] libvirt.vzstorage_mount_group  = qemu {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] libvirt.vzstorage_mount_opts   = [] {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] libvirt.vzstorage_mount_user   = stack {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] neutron.auth_section           = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] neutron.auth_type              = password {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] neutron.cafile                 = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] neutron.certfile               = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] neutron.collect_timing         = False {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] neutron.connect_retries        = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] neutron.connect_retry_delay    = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] neutron.default_floating_pool  = public {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] neutron.endpoint_override      = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] neutron.extension_sync_interval = 600 {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] neutron.http_retries           = 3 {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] neutron.insecure               = False {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] neutron.keyfile                = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] neutron.max_version            = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] neutron.metadata_proxy_shared_secret = **** {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] neutron.min_version            = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] neutron.ovs_bridge             = br-int {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] neutron.physnets               = [] {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] neutron.region_name            = RegionOne {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] neutron.service_metadata_proxy = True {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] neutron.service_name           = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] neutron.service_type           = network {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] neutron.split_loggers          = False {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] neutron.status_code_retries    = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] neutron.status_code_retry_delay = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] neutron.timeout                = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] neutron.version                = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] notifications.bdms_in_notifications = False {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] notifications.default_level    = INFO {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] notifications.notification_format = unversioned {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] notifications.notify_on_state_change = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] pci.alias                      = [] {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] pci.device_spec                = [] {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] pci.report_in_placement        = False {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] placement.auth_section         = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] placement.auth_type            = password {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] placement.cafile               = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] placement.certfile             = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] placement.collect_timing       = False {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] placement.connect_retries      = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] placement.connect_retry_delay  = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] placement.default_domain_id    = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] placement.default_domain_name  = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] placement.domain_id            = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] placement.domain_name          = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] placement.endpoint_override    = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] placement.insecure             = False {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] placement.keyfile              = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] placement.max_version          = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] placement.min_version          = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] placement.password             = **** {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] placement.project_domain_id    = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] placement.project_domain_name  = Default {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] placement.project_id           = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] placement.project_name         = service {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] placement.region_name          = RegionOne {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] placement.service_name         = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] placement.service_type         = placement {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] placement.split_loggers        = False {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] placement.status_code_retries  = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] placement.status_code_retry_delay = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] placement.system_scope         = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] placement.timeout              = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] placement.trust_id             = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] placement.user_domain_id       = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] placement.user_domain_name     = Default {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] placement.user_id              = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] placement.username             = placement {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] placement.version              = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] quota.cores                    = 20 {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] quota.count_usage_from_placement = False {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] quota.injected_file_content_bytes = 10240 {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] quota.injected_file_path_length = 255 {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] quota.injected_files           = 5 {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] quota.instances                = 10 {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] quota.key_pairs                = 100 {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] quota.metadata_items           = 128 {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] quota.ram                      = 51200 {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] quota.recheck_quota            = True {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] quota.server_group_members     = 10 {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] quota.server_groups            = 10 {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] rdp.enabled                    = False {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] scheduler.image_metadata_prefilter = False {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] scheduler.max_attempts         = 3 {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] scheduler.max_placement_results = 1000 {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] scheduler.query_placement_for_availability_zone = True {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] scheduler.query_placement_for_image_type_support = False {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] scheduler.workers              = 3 {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] filter_scheduler.host_subset_size = 1 {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] filter_scheduler.image_properties_default_architecture = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] filter_scheduler.isolated_hosts = [] {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] filter_scheduler.isolated_images = [] {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] filter_scheduler.max_instances_per_host = 50 {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] filter_scheduler.pci_in_placement = False {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] filter_scheduler.track_instance_changes = False {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] metrics.required               = True {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] metrics.weight_multiplier      = 1.0 {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] metrics.weight_setting         = [] {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] serial_console.enabled         = False {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] serial_console.port_range      = 10000:20000 {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] serial_console.serialproxy_port = 6083 {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] service_user.auth_section      = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] service_user.auth_type         = password {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] service_user.cafile            = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] service_user.certfile          = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] service_user.collect_timing    = False {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] service_user.insecure          = False {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] service_user.keyfile           = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] service_user.send_service_user_token = True {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] service_user.split_loggers     = False {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] service_user.timeout           = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] spice.agent_enabled            = True {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] spice.enabled                  = False {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] spice.html5proxy_port          = 6082 {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] spice.image_compression        = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] spice.jpeg_compression         = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] spice.playback_compression     = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] spice.server_listen            = 127.0.0.1 {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] spice.streaming_mode           = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] spice.zlib_compression         = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] upgrade_levels.baseapi         = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] upgrade_levels.cert            = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] upgrade_levels.compute         = auto {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] upgrade_levels.conductor       = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] upgrade_levels.scheduler       = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] vendordata_dynamic_auth.auth_section = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] vendordata_dynamic_auth.auth_type = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] vendordata_dynamic_auth.cafile = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] vendordata_dynamic_auth.certfile = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] vendordata_dynamic_auth.collect_timing = False {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] vendordata_dynamic_auth.insecure = False {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] vendordata_dynamic_auth.keyfile = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] vendordata_dynamic_auth.split_loggers = False {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] vendordata_dynamic_auth.timeout = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] vmware.api_retry_count         = 10 {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] vmware.ca_file                 = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] vmware.cache_prefix            = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] vmware.cluster_name            = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] vmware.connection_pool_size    = 10 {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] vmware.console_delay_seconds   = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] vmware.datastore_regex         = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] vmware.host_ip                 = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] vmware.host_password           = **** {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] vmware.host_port               = 443 {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] vmware.host_username           = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] vmware.insecure                = False {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] vmware.integration_bridge      = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] vmware.maximum_objects         = 100 {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] vmware.pbm_default_policy      = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] vmware.pbm_enabled             = False {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] vmware.pbm_wsdl_location       = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] vmware.serial_port_proxy_uri   = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] vmware.serial_port_service_uri = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] vmware.task_poll_interval      = 0.5 {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] vmware.use_linked_clone        = True {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] vmware.vnc_keymap              = en-us {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] vmware.vnc_port                = 5900 {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] vmware.vnc_port_total          = 10000 {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] vnc.auth_schemes               = ['none'] {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] vnc.enabled                    = True {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] vnc.novncproxy_port            = 6080 {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] vnc.server_listen              = 0.0.0.0 {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] vnc.vencrypt_ca_certs          = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] vnc.vencrypt_client_cert       = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] vnc.vencrypt_client_key        = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] workarounds.disable_fallback_pcpu_query = False {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] workarounds.disable_group_policy_check_upcall = True {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] workarounds.disable_rootwrap   = False {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] workarounds.enable_numa_live_migration = False {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] workarounds.handle_virt_lifecycle_events = True {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] workarounds.libvirt_disable_apic = False {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] workarounds.never_download_image_if_on_rbd = False {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] wsgi.client_socket_timeout     = 900 {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] wsgi.default_pool_size         = 1000 {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] wsgi.keep_alive                = True {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] wsgi.max_header_line           = 16384 {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] wsgi.secure_proxy_ssl_header   = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] wsgi.ssl_ca_file               = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] wsgi.ssl_cert_file             = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] wsgi.ssl_key_file              = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] wsgi.tcp_keepidle              = 600 {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] zvm.ca_file                    = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] zvm.cloud_connector_url        = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] zvm.reachable_timeout          = 300 {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] oslo_policy.enforce_new_defaults = False {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] oslo_policy.enforce_scope      = False {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] oslo_policy.policy_default_rule = default {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] oslo_policy.policy_file        = policy.yaml {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] profiler.connection_string     = messaging:// {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] profiler.enabled               = False {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] profiler.es_doc_type           = notification {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] profiler.es_scroll_size        = 10000 {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] profiler.es_scroll_time        = 2m {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] profiler.filter_error_trace    = False {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] profiler.hmac_keys             = SECRET_KEY {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] profiler.sentinel_service_name = mymaster {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] profiler.socket_timeout        = 0.1 {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] profiler.trace_sqlalchemy      = False {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] remote_debug.host              = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] remote_debug.port              = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] oslo_messaging_rabbit.ssl      = False {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] oslo_messaging_notifications.retry = -1 {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] oslo_messaging_notifications.transport_url = **** {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] oslo_limit.auth_section        = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] oslo_limit.auth_type           = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] oslo_limit.cafile              = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] oslo_limit.certfile            = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] oslo_limit.collect_timing      = False {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] oslo_limit.connect_retries     = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] oslo_limit.connect_retry_delay = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] oslo_limit.endpoint_id         = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] oslo_limit.endpoint_override   = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] oslo_limit.insecure            = False {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] oslo_limit.keyfile             = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] oslo_limit.max_version         = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] oslo_limit.min_version         = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] oslo_limit.region_name         = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] oslo_limit.service_name        = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] oslo_limit.service_type        = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] oslo_limit.split_loggers       = False {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] oslo_limit.status_code_retries = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] oslo_limit.status_code_retry_delay = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] oslo_limit.timeout             = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] oslo_limit.valid_interfaces    = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] oslo_limit.version             = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] oslo_reports.file_event_handler = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] oslo_reports.log_dir           = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] vif_plug_linux_bridge_privileged.group = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] vif_plug_linux_bridge_privileged.user = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] vif_plug_ovs_privileged.group  = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] vif_plug_ovs_privileged.helper_command = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] vif_plug_ovs_privileged.user   = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] os_vif_linux_bridge.flat_interface = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] os_vif_linux_bridge.vlan_interface = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] os_vif_ovs.isolate_vif         = False {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] os_vif_ovs.ovsdb_interface     = native {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] os_vif_ovs.per_port_bridge     = False {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] os_brick.lock_path             = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] privsep_osbrick.capabilities   = [21] {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] privsep_osbrick.group          = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] privsep_osbrick.helper_command = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] privsep_osbrick.thread_pool_size = 12 {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] privsep_osbrick.user           = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] nova_sys_admin.group           = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] nova_sys_admin.helper_command  = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] nova_sys_admin.thread_pool_size = 12 {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] nova_sys_admin.user            = None {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG oslo_service.service [None req-1258bc28-1a6b-45a2-a9f8-411820e43ee7 None None] ******************************************************************************** {{(pid=71731) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}}
Apr 13 16:16:03 user nova-compute[71731]: INFO nova.service [-] Starting compute node (version 0.0.0)
Apr 13 16:16:03 user nova-compute[71731]: DEBUG nova.virt.libvirt.host [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Starting native event thread {{(pid=71731) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG nova.virt.libvirt.host [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Starting green dispatch thread {{(pid=71731) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG nova.virt.libvirt.host [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Starting connection event dispatch thread {{(pid=71731) initialize /opt/stack/nova/nova/virt/libvirt/host.py:620}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG nova.virt.libvirt.host [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Connecting to libvirt: qemu:///system {{(pid=71731) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:503}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG nova.virt.libvirt.host [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7f8cf71ae650> {{(pid=71731) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:509}}
Apr 13 16:16:03 user nova-compute[71731]: DEBUG nova.virt.libvirt.host [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7f8cf71ae650> {{(pid=71731) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:530}}
Apr 13 16:16:03 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Connection event '1' reason 'None'
Apr 13 16:16:03 user nova-compute[71731]: WARNING nova.virt.libvirt.driver [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Apr 13 16:16:03 user nova-compute[71731]: DEBUG nova.virt.libvirt.volume.mount [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Initialising _HostMountState generation 0 {{(pid=71731) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Apr 13 16:16:10 user nova-compute[71731]: INFO nova.virt.libvirt.host [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Libvirt host capabilities <capabilities>
Apr 13 16:16:10 user nova-compute[71731]:   <host>
Apr 13 16:16:10 user nova-compute[71731]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Apr 13 16:16:10 user nova-compute[71731]:     <cpu>
Apr 13 16:16:10 user nova-compute[71731]:       <arch>x86_64</arch>
Apr 13 16:16:10 user nova-compute[71731]:       <model>IvyBridge-IBRS</model>
Apr 13 16:16:10 user nova-compute[71731]:       <vendor>Intel</vendor>
Apr 13 16:16:10 user nova-compute[71731]:       <microcode version='1070'/>
Apr 13 16:16:10 user nova-compute[71731]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Apr 13 16:16:10 user nova-compute[71731]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Apr 13 16:16:10 user nova-compute[71731]:       <feature name='ss'/>
Apr 13 16:16:10 user nova-compute[71731]:       <feature name='vmx'/>
Apr 13 16:16:10 user nova-compute[71731]:       <feature name='pcid'/>
Apr 13 16:16:10 user nova-compute[71731]:       <feature name='osxsave'/>
Apr 13 16:16:10 user nova-compute[71731]:       <feature name='hypervisor'/>
Apr 13 16:16:10 user nova-compute[71731]:       <feature name='arat'/>
Apr 13 16:16:10 user nova-compute[71731]:       <feature name='tsc_adjust'/>
Apr 13 16:16:10 user nova-compute[71731]:       <feature name='md-clear'/>
Apr 13 16:16:10 user nova-compute[71731]:       <feature name='stibp'/>
Apr 13 16:16:10 user nova-compute[71731]:       <feature name='arch-capabilities'/>
Apr 13 16:16:10 user nova-compute[71731]:       <feature name='ssbd'/>
Apr 13 16:16:10 user nova-compute[71731]:       <feature name='invtsc'/>
Apr 13 16:16:10 user nova-compute[71731]:       <feature name='rsba'/>
Apr 13 16:16:10 user nova-compute[71731]:       <feature name='skip-l1dfl-vmentry'/>
Apr 13 16:16:10 user nova-compute[71731]:       <pages unit='KiB' size='4'/>
Apr 13 16:16:10 user nova-compute[71731]:       <pages unit='KiB' size='2048'/>
Apr 13 16:16:10 user nova-compute[71731]:     </cpu>
Apr 13 16:16:10 user nova-compute[71731]:     <power_management>
Apr 13 16:16:10 user nova-compute[71731]:       <suspend_mem/>
Apr 13 16:16:10 user nova-compute[71731]:       <suspend_disk/>
Apr 13 16:16:10 user nova-compute[71731]:       <suspend_hybrid/>
Apr 13 16:16:10 user nova-compute[71731]:     </power_management>
Apr 13 16:16:10 user nova-compute[71731]:     <iommu support='no'/>
Apr 13 16:16:10 user nova-compute[71731]:     <migration_features>
Apr 13 16:16:10 user nova-compute[71731]:       <live/>
Apr 13 16:16:10 user nova-compute[71731]:       <uri_transports>
Apr 13 16:16:10 user nova-compute[71731]:         <uri_transport>tcp</uri_transport>
Apr 13 16:16:10 user nova-compute[71731]:         <uri_transport>rdma</uri_transport>
Apr 13 16:16:10 user nova-compute[71731]:       </uri_transports>
Apr 13 16:16:10 user nova-compute[71731]:     </migration_features>
Apr 13 16:16:10 user nova-compute[71731]:     <topology>
Apr 13 16:16:10 user nova-compute[71731]:       <cells num='2'>
Apr 13 16:16:10 user nova-compute[71731]:         <cell id='0'>
Apr 13 16:16:10 user nova-compute[71731]:           <memory unit='KiB'>8189224</memory>
Apr 13 16:16:10 user nova-compute[71731]:           <pages unit='KiB' size='4'>2047306</pages>
Apr 13 16:16:10 user nova-compute[71731]:           <pages unit='KiB' size='2048'>0</pages>
Apr 13 16:16:10 user nova-compute[71731]:           <distances>
Apr 13 16:16:10 user nova-compute[71731]:             <sibling id='0' value='10'/>
Apr 13 16:16:10 user nova-compute[71731]:             <sibling id='1' value='20'/>
Apr 13 16:16:10 user nova-compute[71731]:           </distances>
Apr 13 16:16:10 user nova-compute[71731]:           <cpus num='6'>
Apr 13 16:16:10 user nova-compute[71731]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Apr 13 16:16:10 user nova-compute[71731]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Apr 13 16:16:10 user nova-compute[71731]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Apr 13 16:16:10 user nova-compute[71731]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Apr 13 16:16:10 user nova-compute[71731]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Apr 13 16:16:10 user nova-compute[71731]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Apr 13 16:16:10 user nova-compute[71731]:           </cpus>
Apr 13 16:16:10 user nova-compute[71731]:         </cell>
Apr 13 16:16:10 user nova-compute[71731]:         <cell id='1'>
Apr 13 16:16:10 user nova-compute[71731]:           <memory unit='KiB'>8218764</memory>
Apr 13 16:16:10 user nova-compute[71731]:           <pages unit='KiB' size='4'>2054691</pages>
Apr 13 16:16:10 user nova-compute[71731]:           <pages unit='KiB' size='2048'>0</pages>
Apr 13 16:16:10 user nova-compute[71731]:           <distances>
Apr 13 16:16:10 user nova-compute[71731]:             <sibling id='0' value='20'/>
Apr 13 16:16:10 user nova-compute[71731]:             <sibling id='1' value='10'/>
Apr 13 16:16:10 user nova-compute[71731]:           </distances>
Apr 13 16:16:10 user nova-compute[71731]:           <cpus num='6'>
Apr 13 16:16:10 user nova-compute[71731]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Apr 13 16:16:10 user nova-compute[71731]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Apr 13 16:16:10 user nova-compute[71731]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Apr 13 16:16:10 user nova-compute[71731]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Apr 13 16:16:10 user nova-compute[71731]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Apr 13 16:16:10 user nova-compute[71731]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Apr 13 16:16:10 user nova-compute[71731]:           </cpus>
Apr 13 16:16:10 user nova-compute[71731]:         </cell>
Apr 13 16:16:10 user nova-compute[71731]:       </cells>
Apr 13 16:16:10 user nova-compute[71731]:     </topology>
Apr 13 16:16:10 user nova-compute[71731]:     <cache>
Apr 13 16:16:10 user nova-compute[71731]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Apr 13 16:16:10 user nova-compute[71731]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Apr 13 16:16:10 user nova-compute[71731]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Apr 13 16:16:10 user nova-compute[71731]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Apr 13 16:16:10 user nova-compute[71731]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Apr 13 16:16:10 user nova-compute[71731]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Apr 13 16:16:10 user nova-compute[71731]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Apr 13 16:16:10 user nova-compute[71731]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Apr 13 16:16:10 user nova-compute[71731]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Apr 13 16:16:10 user nova-compute[71731]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Apr 13 16:16:10 user nova-compute[71731]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Apr 13 16:16:10 user nova-compute[71731]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Apr 13 16:16:10 user nova-compute[71731]:     </cache>
Apr 13 16:16:10 user nova-compute[71731]:     <secmodel>
Apr 13 16:16:10 user nova-compute[71731]:       <model>apparmor</model>
Apr 13 16:16:10 user nova-compute[71731]:       <doi>0</doi>
Apr 13 16:16:10 user nova-compute[71731]:     </secmodel>
Apr 13 16:16:10 user nova-compute[71731]:     <secmodel>
Apr 13 16:16:10 user nova-compute[71731]:       <model>dac</model>
Apr 13 16:16:10 user nova-compute[71731]:       <doi>0</doi>
Apr 13 16:16:10 user nova-compute[71731]:       <baselabel type='kvm'>+64055:+108</baselabel>
Apr 13 16:16:10 user nova-compute[71731]:       <baselabel type='qemu'>+64055:+108</baselabel>
Apr 13 16:16:10 user nova-compute[71731]:     </secmodel>
Apr 13 16:16:10 user nova-compute[71731]:   </host>
Apr 13 16:16:10 user nova-compute[71731]:   <guest>
Apr 13 16:16:10 user nova-compute[71731]:     <os_type>hvm</os_type>
Apr 13 16:16:10 user nova-compute[71731]:     <arch name='alpha'>
Apr 13 16:16:10 user nova-compute[71731]:       <wordsize>64</wordsize>
Apr 13 16:16:10 user nova-compute[71731]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Apr 13 16:16:10 user nova-compute[71731]:       <machine maxCpus='4'>clipper</machine>
Apr 13 16:16:10 user nova-compute[71731]:       <domain type='qemu'/>
Apr 13 16:16:10 user nova-compute[71731]:     </arch>
Apr 13 16:16:10 user nova-compute[71731]:     <features>
Apr 13 16:16:10 user nova-compute[71731]:       <cpuselection/>
Apr 13 16:16:10 user nova-compute[71731]:       <deviceboot/>
Apr 13 16:16:10 user nova-compute[71731]:       <disksnapshot default='on' toggle='no'/>
Apr 13 16:16:10 user nova-compute[71731]:     </features>
Apr 13 16:16:10 user nova-compute[71731]:   </guest>
Apr 13 16:16:10 user nova-compute[71731]:   <guest>
Apr 13 16:16:10 user nova-compute[71731]:     <os_type>hvm</os_type>
Apr 13 16:16:10 user nova-compute[71731]:     <arch name='armv6l'>
Apr 13 16:16:10 user nova-compute[71731]:       <wordsize>32</wordsize>
Apr 13 16:16:10 user nova-compute[71731]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Apr 13 16:16:10 user nova-compute[71731]:       <machine maxCpus='1'>integratorcp</machine>
Apr 13 16:16:10 user nova-compute[71731]:       <machine maxCpus='2'>ast2600-evb</machine>
Apr 13 16:16:10 user nova-compute[71731]:       <machine maxCpus='1'>borzoi</machine>
Apr 13 16:16:10 user nova-compute[71731]:       <machine maxCpus='1'>spitz</machine>
Apr 13 16:16:10 user nova-compute[71731]:       <machine maxCpus='255'>virt-2.7</machine>
Apr 13 16:16:10 user nova-compute[71731]:       <machine maxCpus='2'>nuri</machine>
Apr 13 16:16:10 user nova-compute[71731]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Apr 13 16:16:10 user nova-compute[71731]:       <machine maxCpus='1'>romulus-bmc</machine>
Apr 13 16:16:10 user nova-compute[71731]:       <machine maxCpus='512'>virt-3.0</machine>
Apr 13 16:16:10 user nova-compute[71731]:       <machine maxCpus='512'>virt-5.0</machine>
Apr 13 16:16:10 user nova-compute[71731]:       <machine maxCpus='2'>npcm750-evb</machine>
Apr 13 16:16:10 user nova-compute[71731]:       <machine maxCpus='255'>virt-2.10</machine>
Apr 13 16:16:10 user nova-compute[71731]:       <machine maxCpus='2'>rainier-bmc</machine>
Apr 13 16:16:10 user nova-compute[71731]:       <machine maxCpus='1'>mps3-an547</machine>
Apr 13 16:16:10 user nova-compute[71731]:       <machine maxCpus='2'>musca-b1</machine>
Apr 13 16:16:10 user nova-compute[71731]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Apr 13 16:16:10 user nova-compute[71731]:       <machine maxCpus='1'>versatileab</machine>
Apr 13 16:16:10 user nova-compute[71731]:       <machine maxCpus='1'>kzm</machine>
Apr 13 16:16:10 user nova-compute[71731]:       <machine maxCpus='255'>virt-2.8</machine>
Apr 13 16:16:10 user nova-compute[71731]:       <machine maxCpus='2'>musca-a</machine>
Apr 13 16:16:10 user nova-compute[71731]:       <machine maxCpus='512'>virt-3.1</machine>
Apr 13 16:16:10 user nova-compute[71731]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Apr 13 16:16:10 user nova-compute[71731]:       <machine maxCpus='512'>virt-5.1</machine>
Apr 13 16:16:10 user nova-compute[71731]:       <machine maxCpus='2'>smdkc210</machine>
Apr 13 16:16:10 user nova-compute[71731]:       <machine maxCpus='1'>sx1</machine>
Apr 13 16:16:10 user nova-compute[71731]:       <machine maxCpus='255'>virt-2.11</machine>
Apr 13 16:16:10 user nova-compute[71731]:       <machine maxCpus='1'>imx25-pdk</machine>
Apr 13 16:16:10 user nova-compute[71731]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Apr 13 16:16:10 user nova-compute[71731]:       <machine maxCpus='255'>virt-2.9</machine>
Apr 13 16:16:10 user nova-compute[71731]:       <machine maxCpus='4'>orangepi-pc</machine>
Apr 13 16:16:10 user nova-compute[71731]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Apr 13 16:16:10 user nova-compute[71731]:       <machine maxCpus='1'>z2</machine>
Apr 13 16:16:10 user nova-compute[71731]:       <machine maxCpus='512'>virt-5.2</machine>
Apr 13 16:16:10 user nova-compute[71731]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Apr 13 16:16:10 user nova-compute[71731]:       <machine maxCpus='1'>tosa</machine>
Apr 13 16:16:10 user nova-compute[71731]:       <machine maxCpus='1'>mps2-an500</machine>
Apr 13 16:16:10 user nova-compute[71731]:       <machine maxCpus='255'>virt-2.12</machine>
Apr 13 16:16:10 user nova-compute[71731]:       <machine maxCpus='2'>mps2-an521</machine>
Apr 13 16:16:10 user nova-compute[71731]:       <machine maxCpus='4'>sabrelite</machine>
Apr 13 16:16:10 user nova-compute[71731]:       <machine maxCpus='1'>mps2-an511</machine>
Apr 13 16:16:10 user nova-compute[71731]:       <machine maxCpus='1'>canon-a1100</machine>
Apr 13 16:16:10 user nova-compute[71731]:       <machine maxCpus='1'>realview-eb</machine>
Apr 13 16:16:10 user nova-compute[71731]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Apr 13 16:16:10 user nova-compute[71731]:       <machine maxCpus='1'>emcraft-sf2</machine>
Apr 13 16:16:10 user nova-compute[71731]:       <machine maxCpus='1'>realview-pb-a8</machine>
Apr 13 16:16:10 user nova-compute[71731]:       <machine maxCpus='512'>virt-4.0</machine>
Apr 13 16:16:10 user nova-compute[71731]:       <machine maxCpus='1'>raspi1ap</machine>
Apr 13 16:16:10 user nova-compute[71731]:       <machine maxCpus='1'>palmetto-bmc</machine>
Apr 13 16:16:10 user nova-compute[71731]:       <machine maxCpus='1'>sx1-v1</machine>
Apr 13 16:16:10 user nova-compute[71731]:       <machine maxCpus='1'>n810</machine>
Apr 13 16:16:10 user nova-compute[71731]:       <machine maxCpus='1'>g220a-bmc</machine>
Apr 13 16:16:10 user nova-compute[71731]:       <machine maxCpus='1'>n800</machine>
Apr 13 16:16:10 user nova-compute[71731]:       <machine maxCpus='2'>tacoma-bmc</machine>
Apr 13 16:16:10 user nova-compute[71731]:       <machine maxCpus='512'>virt-4.1</machine>
Apr 13 16:16:10 user nova-compute[71731]:       <machine maxCpus='2'>quanta-gsj</machine>
Apr 13 16:16:10 user nova-compute[71731]:       <machine maxCpus='1'>versatilepb</machine>
Apr 13 16:16:10 user nova-compute[71731]:       <machine maxCpus='1'>terrier</machine>
Apr 13 16:16:10 user nova-compute[71731]:       <machine maxCpus='1'>mainstone</machine>
Apr 13 16:16:10 user nova-compute[71731]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Apr 13 16:16:10 user nova-compute[71731]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Apr 13 16:16:10 user nova-compute[71731]:       <machine maxCpus='512'>virt-4.2</machine>
Apr 13 16:16:10 user nova-compute[71731]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Apr 13 16:16:10 user nova-compute[71731]:       <machine maxCpus='2'>mps3-an524</machine>
Apr 13 16:16:10 user nova-compute[71731]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Apr 13 16:16:10 user nova-compute[71731]:       <machine maxCpus='2'>kudo-bmc</machine>
Apr 13 16:16:10 user nova-compute[71731]:       <machine maxCpus='4'>vexpress-a9</machine>
Apr 13 16:16:10 user nova-compute[71731]:       <machine maxCpus='4'>midway</machine>
Apr 13 16:16:10 user nova-compute[71731]:       <machine maxCpus='1'>musicpal</machine>
Apr 13 16:16:10 user nova-compute[71731]:       <machine maxCpus='1'>lm3s811evb</machine>
Apr 13 16:16:10 user nova-compute[71731]:       <machine maxCpus='1'>lm3s6965evb</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='1'>microbit</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='1'>mps2-an505</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='1'>mps2-an385</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='512'>virt-6.0</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='1'>cubieboard</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='1'>verdex</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='1'>netduino2</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='1'>mps2-an386</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='512'>virt-6.1</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='4'>raspi2b</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='4'>vexpress-a15</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='2'>fuji-bmc</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='512'>virt-6.2</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='1'>cheetah</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='255'>virt-2.6</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='1'>ast2500-evb</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='4'>highbank</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='1'>akita</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='1'>connex</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='1'>netduinoplus2</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='1'>collie</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='1'>raspi0</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <domain type='qemu'/>
Apr 13 16:16:11 user nova-compute[71731]:     </arch>
Apr 13 16:16:11 user nova-compute[71731]:     <features>
Apr 13 16:16:11 user nova-compute[71731]:       <cpuselection/>
Apr 13 16:16:11 user nova-compute[71731]:       <deviceboot/>
Apr 13 16:16:11 user nova-compute[71731]:       <disksnapshot default='on' toggle='no'/>
Apr 13 16:16:11 user nova-compute[71731]:     </features>
Apr 13 16:16:11 user nova-compute[71731]:   </guest>
Apr 13 16:16:11 user nova-compute[71731]:   <guest>
Apr 13 16:16:11 user nova-compute[71731]:     <os_type>hvm</os_type>
Apr 13 16:16:11 user nova-compute[71731]:     <arch name='armv7l'>
Apr 13 16:16:11 user nova-compute[71731]:       <wordsize>32</wordsize>
Apr 13 16:16:11 user nova-compute[71731]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='1'>integratorcp</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='2'>ast2600-evb</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='1'>borzoi</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='1'>spitz</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='255'>virt-2.7</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='2'>nuri</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='1'>romulus-bmc</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='512'>virt-3.0</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='512'>virt-5.0</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='2'>npcm750-evb</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='255'>virt-2.10</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='2'>rainier-bmc</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='1'>mps3-an547</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='2'>musca-b1</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='1'>versatileab</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='1'>kzm</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='255'>virt-2.8</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='2'>musca-a</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='512'>virt-3.1</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='512'>virt-5.1</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='2'>smdkc210</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='1'>sx1</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='255'>virt-2.11</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='1'>imx25-pdk</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='255'>virt-2.9</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='4'>orangepi-pc</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='1'>z2</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='512'>virt-5.2</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='1'>tosa</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='1'>mps2-an500</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='255'>virt-2.12</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='2'>mps2-an521</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='4'>sabrelite</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='1'>mps2-an511</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='1'>canon-a1100</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='1'>realview-eb</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='1'>emcraft-sf2</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='1'>realview-pb-a8</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='512'>virt-4.0</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='1'>raspi1ap</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='1'>palmetto-bmc</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='1'>sx1-v1</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='1'>n810</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='1'>g220a-bmc</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='1'>n800</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='2'>tacoma-bmc</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='512'>virt-4.1</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='2'>quanta-gsj</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='1'>versatilepb</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='1'>terrier</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='1'>mainstone</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='512'>virt-4.2</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='2'>mps3-an524</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='2'>kudo-bmc</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='4'>vexpress-a9</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='4'>midway</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='1'>musicpal</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='1'>lm3s811evb</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='1'>lm3s6965evb</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='1'>microbit</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='1'>mps2-an505</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='1'>mps2-an385</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='512'>virt-6.0</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='1'>cubieboard</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='1'>verdex</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='1'>netduino2</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='1'>mps2-an386</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='512'>virt-6.1</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='4'>raspi2b</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='4'>vexpress-a15</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='2'>fuji-bmc</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='512'>virt-6.2</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='1'>cheetah</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='255'>virt-2.6</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='1'>ast2500-evb</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='4'>highbank</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='1'>akita</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='1'>connex</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='1'>netduinoplus2</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='1'>collie</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='1'>raspi0</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <domain type='qemu'/>
Apr 13 16:16:11 user nova-compute[71731]:     </arch>
Apr 13 16:16:11 user nova-compute[71731]:     <features>
Apr 13 16:16:11 user nova-compute[71731]:       <cpuselection/>
Apr 13 16:16:11 user nova-compute[71731]:       <deviceboot/>
Apr 13 16:16:11 user nova-compute[71731]:       <disksnapshot default='on' toggle='no'/>
Apr 13 16:16:11 user nova-compute[71731]:     </features>
Apr 13 16:16:11 user nova-compute[71731]:   </guest>
Apr 13 16:16:11 user nova-compute[71731]:   <guest>
Apr 13 16:16:11 user nova-compute[71731]:     <os_type>hvm</os_type>
Apr 13 16:16:11 user nova-compute[71731]:     <arch name='aarch64'>
Apr 13 16:16:11 user nova-compute[71731]:       <wordsize>64</wordsize>
Apr 13 16:16:11 user nova-compute[71731]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='1'>integratorcp</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='2'>ast2600-evb</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='1'>borzoi</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='1'>spitz</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='255'>virt-2.7</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='2'>nuri</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='1'>romulus-bmc</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='512'>virt-3.0</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='512'>virt-5.0</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='2'>npcm750-evb</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='255'>virt-2.10</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='2'>rainier-bmc</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='1'>mps3-an547</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='255'>virt-2.8</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='2'>musca-b1</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='1'>versatileab</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='1'>kzm</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='2'>musca-a</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='512'>virt-3.1</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='512'>virt-5.1</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='2'>smdkc210</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='1'>sx1</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='255'>virt-2.11</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='1'>imx25-pdk</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='255'>virt-2.9</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='4'>orangepi-pc</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='1'>z2</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='512'>virt-5.2</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='1'>tosa</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='1'>mps2-an500</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='255'>virt-2.12</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='2'>mps2-an521</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='4'>sabrelite</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='1'>mps2-an511</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='1'>canon-a1100</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='1'>realview-eb</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='1'>emcraft-sf2</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='1'>realview-pb-a8</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='512'>sbsa-ref</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='512'>virt-4.0</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='1'>raspi1ap</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='1'>palmetto-bmc</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='1'>sx1-v1</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='1'>n810</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='1'>g220a-bmc</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='1'>n800</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='2'>tacoma-bmc</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='512'>virt-4.1</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='2'>quanta-gsj</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='1'>versatilepb</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='1'>terrier</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='1'>mainstone</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='512'>virt-4.2</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='2'>mps3-an524</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='2'>kudo-bmc</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='4'>vexpress-a9</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='4'>midway</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='1'>musicpal</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='1'>lm3s811evb</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='1'>lm3s6965evb</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='1'>microbit</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='1'>mps2-an505</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='1'>mps2-an385</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='512'>virt-6.0</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='4'>raspi3ap</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='1'>cubieboard</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='1'>verdex</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='1'>netduino2</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='1'>mps2-an386</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='512'>virt-6.1</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='4'>raspi3b</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='4'>raspi2b</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='4'>vexpress-a15</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='2'>fuji-bmc</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='512'>virt-6.2</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='1'>cheetah</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='255'>virt-2.6</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='1'>ast2500-evb</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='4'>highbank</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='1'>akita</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='1'>connex</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='1'>netduinoplus2</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='1'>collie</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='1'>raspi0</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <domain type='qemu'/>
Apr 13 16:16:11 user nova-compute[71731]:     </arch>
Apr 13 16:16:11 user nova-compute[71731]:     <features>
Apr 13 16:16:11 user nova-compute[71731]:       <acpi default='on' toggle='yes'/>
Apr 13 16:16:11 user nova-compute[71731]:       <cpuselection/>
Apr 13 16:16:11 user nova-compute[71731]:       <deviceboot/>
Apr 13 16:16:11 user nova-compute[71731]:       <disksnapshot default='on' toggle='no'/>
Apr 13 16:16:11 user nova-compute[71731]:     </features>
Apr 13 16:16:11 user nova-compute[71731]:   </guest>
Apr 13 16:16:11 user nova-compute[71731]:   <guest>
Apr 13 16:16:11 user nova-compute[71731]:     <os_type>hvm</os_type>
Apr 13 16:16:11 user nova-compute[71731]:     <arch name='cris'>
Apr 13 16:16:11 user nova-compute[71731]:       <wordsize>32</wordsize>
Apr 13 16:16:11 user nova-compute[71731]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='1'>axis-dev88</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <domain type='qemu'/>
Apr 13 16:16:11 user nova-compute[71731]:     </arch>
Apr 13 16:16:11 user nova-compute[71731]:     <features>
Apr 13 16:16:11 user nova-compute[71731]:       <cpuselection/>
Apr 13 16:16:11 user nova-compute[71731]:       <deviceboot/>
Apr 13 16:16:11 user nova-compute[71731]:       <disksnapshot default='on' toggle='no'/>
Apr 13 16:16:11 user nova-compute[71731]:     </features>
Apr 13 16:16:11 user nova-compute[71731]:   </guest>
Apr 13 16:16:11 user nova-compute[71731]:   <guest>
Apr 13 16:16:11 user nova-compute[71731]:     <os_type>hvm</os_type>
Apr 13 16:16:11 user nova-compute[71731]:     <arch name='i686'>
Apr 13 16:16:11 user nova-compute[71731]:       <wordsize>32</wordsize>
Apr 13 16:16:11 user nova-compute[71731]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='288'>pc-q35-artful</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='1'>x-remote</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='1'>isapc</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='288'>pc-q35-disco</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='288'>pc-q35-impish</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='288'>pc-q35-focal</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='288'>microvm</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <domain type='qemu'/>
Apr 13 16:16:11 user nova-compute[71731]:       <domain type='kvm'/>
Apr 13 16:16:11 user nova-compute[71731]:     </arch>
Apr 13 16:16:11 user nova-compute[71731]:     <features>
Apr 13 16:16:11 user nova-compute[71731]:       <pae/>
Apr 13 16:16:11 user nova-compute[71731]:       <nonpae/>
Apr 13 16:16:11 user nova-compute[71731]:       <acpi default='on' toggle='yes'/>
Apr 13 16:16:11 user nova-compute[71731]:       <apic default='on' toggle='no'/>
Apr 13 16:16:11 user nova-compute[71731]:       <cpuselection/>
Apr 13 16:16:11 user nova-compute[71731]:       <deviceboot/>
Apr 13 16:16:11 user nova-compute[71731]:       <disksnapshot default='on' toggle='no'/>
Apr 13 16:16:11 user nova-compute[71731]:     </features>
Apr 13 16:16:11 user nova-compute[71731]:   </guest>
Apr 13 16:16:11 user nova-compute[71731]:   <guest>
Apr 13 16:16:11 user nova-compute[71731]:     <os_type>hvm</os_type>
Apr 13 16:16:11 user nova-compute[71731]:     <arch name='m68k'>
Apr 13 16:16:11 user nova-compute[71731]:       <wordsize>32</wordsize>
Apr 13 16:16:11 user nova-compute[71731]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='1'>mcf5208evb</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='1'>an5206</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='1'>virt-6.0</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='1'>q800</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='1'>virt-6.2</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='1'>next-cube</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='1'>virt-6.1</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <domain type='qemu'/>
Apr 13 16:16:11 user nova-compute[71731]:     </arch>
Apr 13 16:16:11 user nova-compute[71731]:     <features>
Apr 13 16:16:11 user nova-compute[71731]:       <cpuselection/>
Apr 13 16:16:11 user nova-compute[71731]:       <deviceboot/>
Apr 13 16:16:11 user nova-compute[71731]:       <disksnapshot default='on' toggle='no'/>
Apr 13 16:16:11 user nova-compute[71731]:     </features>
Apr 13 16:16:11 user nova-compute[71731]:   </guest>
Apr 13 16:16:11 user nova-compute[71731]:   <guest>
Apr 13 16:16:11 user nova-compute[71731]:     <os_type>hvm</os_type>
Apr 13 16:16:11 user nova-compute[71731]:     <arch name='microblaze'>
Apr 13 16:16:11 user nova-compute[71731]:       <wordsize>32</wordsize>
Apr 13 16:16:11 user nova-compute[71731]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='1'>petalogix-ml605</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <domain type='qemu'/>
Apr 13 16:16:11 user nova-compute[71731]:     </arch>
Apr 13 16:16:11 user nova-compute[71731]:     <features>
Apr 13 16:16:11 user nova-compute[71731]:       <cpuselection/>
Apr 13 16:16:11 user nova-compute[71731]:       <deviceboot/>
Apr 13 16:16:11 user nova-compute[71731]:       <disksnapshot default='on' toggle='no'/>
Apr 13 16:16:11 user nova-compute[71731]:     </features>
Apr 13 16:16:11 user nova-compute[71731]:   </guest>
Apr 13 16:16:11 user nova-compute[71731]:   <guest>
Apr 13 16:16:11 user nova-compute[71731]:     <os_type>hvm</os_type>
Apr 13 16:16:11 user nova-compute[71731]:     <arch name='microblazeel'>
Apr 13 16:16:11 user nova-compute[71731]:       <wordsize>32</wordsize>
Apr 13 16:16:11 user nova-compute[71731]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='1'>petalogix-ml605</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <domain type='qemu'/>
Apr 13 16:16:11 user nova-compute[71731]:     </arch>
Apr 13 16:16:11 user nova-compute[71731]:     <features>
Apr 13 16:16:11 user nova-compute[71731]:       <cpuselection/>
Apr 13 16:16:11 user nova-compute[71731]:       <deviceboot/>
Apr 13 16:16:11 user nova-compute[71731]:       <disksnapshot default='on' toggle='no'/>
Apr 13 16:16:11 user nova-compute[71731]:     </features>
Apr 13 16:16:11 user nova-compute[71731]:   </guest>
Apr 13 16:16:11 user nova-compute[71731]:   <guest>
Apr 13 16:16:11 user nova-compute[71731]:     <os_type>hvm</os_type>
Apr 13 16:16:11 user nova-compute[71731]:     <arch name='mips'>
Apr 13 16:16:11 user nova-compute[71731]:       <wordsize>32</wordsize>
Apr 13 16:16:11 user nova-compute[71731]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='16'>malta</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='1'>mipssim</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <domain type='qemu'/>
Apr 13 16:16:11 user nova-compute[71731]:     </arch>
Apr 13 16:16:11 user nova-compute[71731]:     <features>
Apr 13 16:16:11 user nova-compute[71731]:       <cpuselection/>
Apr 13 16:16:11 user nova-compute[71731]:       <deviceboot/>
Apr 13 16:16:11 user nova-compute[71731]:       <disksnapshot default='on' toggle='no'/>
Apr 13 16:16:11 user nova-compute[71731]:     </features>
Apr 13 16:16:11 user nova-compute[71731]:   </guest>
Apr 13 16:16:11 user nova-compute[71731]:   <guest>
Apr 13 16:16:11 user nova-compute[71731]:     <os_type>hvm</os_type>
Apr 13 16:16:11 user nova-compute[71731]:     <arch name='mipsel'>
Apr 13 16:16:11 user nova-compute[71731]:       <wordsize>32</wordsize>
Apr 13 16:16:11 user nova-compute[71731]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='16'>malta</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='1'>mipssim</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <domain type='qemu'/>
Apr 13 16:16:11 user nova-compute[71731]:     </arch>
Apr 13 16:16:11 user nova-compute[71731]:     <features>
Apr 13 16:16:11 user nova-compute[71731]:       <cpuselection/>
Apr 13 16:16:11 user nova-compute[71731]:       <deviceboot/>
Apr 13 16:16:11 user nova-compute[71731]:       <disksnapshot default='on' toggle='no'/>
Apr 13 16:16:11 user nova-compute[71731]:     </features>
Apr 13 16:16:11 user nova-compute[71731]:   </guest>
Apr 13 16:16:11 user nova-compute[71731]:   <guest>
Apr 13 16:16:11 user nova-compute[71731]:     <os_type>hvm</os_type>
Apr 13 16:16:11 user nova-compute[71731]:     <arch name='mips64'>
Apr 13 16:16:11 user nova-compute[71731]:       <wordsize>64</wordsize>
Apr 13 16:16:11 user nova-compute[71731]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='16'>malta</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='1'>mipssim</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='1'>pica61</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='1'>magnum</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <domain type='qemu'/>
Apr 13 16:16:11 user nova-compute[71731]:     </arch>
Apr 13 16:16:11 user nova-compute[71731]:     <features>
Apr 13 16:16:11 user nova-compute[71731]:       <cpuselection/>
Apr 13 16:16:11 user nova-compute[71731]:       <deviceboot/>
Apr 13 16:16:11 user nova-compute[71731]:       <disksnapshot default='on' toggle='no'/>
Apr 13 16:16:11 user nova-compute[71731]:     </features>
Apr 13 16:16:11 user nova-compute[71731]:   </guest>
Apr 13 16:16:11 user nova-compute[71731]:   <guest>
Apr 13 16:16:11 user nova-compute[71731]:     <os_type>hvm</os_type>
Apr 13 16:16:11 user nova-compute[71731]:     <arch name='mips64el'>
Apr 13 16:16:11 user nova-compute[71731]:       <wordsize>64</wordsize>
Apr 13 16:16:11 user nova-compute[71731]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='16'>malta</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='16'>loongson3-virt</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='1'>mipssim</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='1'>pica61</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='1'>magnum</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='16'>boston</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='1'>fuloong2e</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <domain type='qemu'/>
Apr 13 16:16:11 user nova-compute[71731]:     </arch>
Apr 13 16:16:11 user nova-compute[71731]:     <features>
Apr 13 16:16:11 user nova-compute[71731]:       <cpuselection/>
Apr 13 16:16:11 user nova-compute[71731]:       <deviceboot/>
Apr 13 16:16:11 user nova-compute[71731]:       <disksnapshot default='on' toggle='no'/>
Apr 13 16:16:11 user nova-compute[71731]:     </features>
Apr 13 16:16:11 user nova-compute[71731]:   </guest>
Apr 13 16:16:11 user nova-compute[71731]:   <guest>
Apr 13 16:16:11 user nova-compute[71731]:     <os_type>hvm</os_type>
Apr 13 16:16:11 user nova-compute[71731]:     <arch name='ppc'>
Apr 13 16:16:11 user nova-compute[71731]:       <wordsize>32</wordsize>
Apr 13 16:16:11 user nova-compute[71731]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='1'>g3beige</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='1'>virtex-ml507</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='1'>mac99</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='32'>ppce500</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='1'>pegasos2</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='1'>sam460ex</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='1'>bamboo</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='1'>40p</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='1'>ref405ep</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='15'>mpc8544ds</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='1'>taihu</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <domain type='qemu'/>
Apr 13 16:16:11 user nova-compute[71731]:     </arch>
Apr 13 16:16:11 user nova-compute[71731]:     <features>
Apr 13 16:16:11 user nova-compute[71731]:       <cpuselection/>
Apr 13 16:16:11 user nova-compute[71731]:       <deviceboot/>
Apr 13 16:16:11 user nova-compute[71731]:       <disksnapshot default='on' toggle='no'/>
Apr 13 16:16:11 user nova-compute[71731]:     </features>
Apr 13 16:16:11 user nova-compute[71731]:   </guest>
Apr 13 16:16:11 user nova-compute[71731]:   <guest>
Apr 13 16:16:11 user nova-compute[71731]:     <os_type>hvm</os_type>
Apr 13 16:16:11 user nova-compute[71731]:     <arch name='ppc64'>
Apr 13 16:16:11 user nova-compute[71731]:       <wordsize>64</wordsize>
Apr 13 16:16:11 user nova-compute[71731]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='2048'>powernv9</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='1'>taihu</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='15'>mpc8544ds</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='2048'>powernv10</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='32'>ppce500</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='1'>40p</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='1'>pegasos2</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='1'>bamboo</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='1'>g3beige</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='1'>virtex-ml507</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='1'>mac99</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='1'>sam460ex</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='1'>ref405ep</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='2048'>powernv8</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <domain type='qemu'/>
Apr 13 16:16:11 user nova-compute[71731]:     </arch>
Apr 13 16:16:11 user nova-compute[71731]:     <features>
Apr 13 16:16:11 user nova-compute[71731]:       <cpuselection/>
Apr 13 16:16:11 user nova-compute[71731]:       <deviceboot/>
Apr 13 16:16:11 user nova-compute[71731]:       <disksnapshot default='on' toggle='no'/>
Apr 13 16:16:11 user nova-compute[71731]:     </features>
Apr 13 16:16:11 user nova-compute[71731]:   </guest>
Apr 13 16:16:11 user nova-compute[71731]:   <guest>
Apr 13 16:16:11 user nova-compute[71731]:     <os_type>hvm</os_type>
Apr 13 16:16:11 user nova-compute[71731]:     <arch name='ppc64le'>
Apr 13 16:16:11 user nova-compute[71731]:       <wordsize>64</wordsize>
Apr 13 16:16:11 user nova-compute[71731]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='2048'>powernv9</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='1'>taihu</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='15'>mpc8544ds</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='2048'>powernv10</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='32'>ppce500</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='1'>40p</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='1'>pegasos2</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='1'>bamboo</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='1'>g3beige</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='1'>virtex-ml507</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='1'>mac99</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='1'>sam460ex</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='1'>ref405ep</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='2048'>powernv8</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <domain type='qemu'/>
Apr 13 16:16:11 user nova-compute[71731]:     </arch>
Apr 13 16:16:11 user nova-compute[71731]:     <features>
Apr 13 16:16:11 user nova-compute[71731]:       <cpuselection/>
Apr 13 16:16:11 user nova-compute[71731]:       <deviceboot/>
Apr 13 16:16:11 user nova-compute[71731]:       <disksnapshot default='on' toggle='no'/>
Apr 13 16:16:11 user nova-compute[71731]:     </features>
Apr 13 16:16:11 user nova-compute[71731]:   </guest>
Apr 13 16:16:11 user nova-compute[71731]:   <guest>
Apr 13 16:16:11 user nova-compute[71731]:     <os_type>hvm</os_type>
Apr 13 16:16:11 user nova-compute[71731]:     <arch name='riscv32'>
Apr 13 16:16:11 user nova-compute[71731]:       <wordsize>32</wordsize>
Apr 13 16:16:11 user nova-compute[71731]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='8'>spike</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='1'>opentitan</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='5'>sifive_u</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='1'>sifive_e</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='8'>virt</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <domain type='qemu'/>
Apr 13 16:16:11 user nova-compute[71731]:     </arch>
Apr 13 16:16:11 user nova-compute[71731]:     <features>
Apr 13 16:16:11 user nova-compute[71731]:       <cpuselection/>
Apr 13 16:16:11 user nova-compute[71731]:       <deviceboot/>
Apr 13 16:16:11 user nova-compute[71731]:       <disksnapshot default='on' toggle='no'/>
Apr 13 16:16:11 user nova-compute[71731]:     </features>
Apr 13 16:16:11 user nova-compute[71731]:   </guest>
Apr 13 16:16:11 user nova-compute[71731]:   <guest>
Apr 13 16:16:11 user nova-compute[71731]:     <os_type>hvm</os_type>
Apr 13 16:16:11 user nova-compute[71731]:     <arch name='riscv64'>
Apr 13 16:16:11 user nova-compute[71731]:       <wordsize>64</wordsize>
Apr 13 16:16:11 user nova-compute[71731]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='8'>spike</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='5'>sifive_u</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='1'>shakti_c</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='1'>sifive_e</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='8'>virt</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <domain type='qemu'/>
Apr 13 16:16:11 user nova-compute[71731]:     </arch>
Apr 13 16:16:11 user nova-compute[71731]:     <features>
Apr 13 16:16:11 user nova-compute[71731]:       <cpuselection/>
Apr 13 16:16:11 user nova-compute[71731]:       <deviceboot/>
Apr 13 16:16:11 user nova-compute[71731]:       <disksnapshot default='on' toggle='no'/>
Apr 13 16:16:11 user nova-compute[71731]:     </features>
Apr 13 16:16:11 user nova-compute[71731]:   </guest>
Apr 13 16:16:11 user nova-compute[71731]:   <guest>
Apr 13 16:16:11 user nova-compute[71731]:     <os_type>hvm</os_type>
Apr 13 16:16:11 user nova-compute[71731]:     <arch name='s390x'>
Apr 13 16:16:11 user nova-compute[71731]:       <wordsize>64</wordsize>
Apr 13 16:16:11 user nova-compute[71731]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <domain type='qemu'/>
Apr 13 16:16:11 user nova-compute[71731]:     </arch>
Apr 13 16:16:11 user nova-compute[71731]:     <features>
Apr 13 16:16:11 user nova-compute[71731]:       <cpuselection/>
Apr 13 16:16:11 user nova-compute[71731]:       <deviceboot/>
Apr 13 16:16:11 user nova-compute[71731]:       <disksnapshot default='on' toggle='no'/>
Apr 13 16:16:11 user nova-compute[71731]:     </features>
Apr 13 16:16:11 user nova-compute[71731]:   </guest>
Apr 13 16:16:11 user nova-compute[71731]:   <guest>
Apr 13 16:16:11 user nova-compute[71731]:     <os_type>hvm</os_type>
Apr 13 16:16:11 user nova-compute[71731]:     <arch name='sh4'>
Apr 13 16:16:11 user nova-compute[71731]:       <wordsize>32</wordsize>
Apr 13 16:16:11 user nova-compute[71731]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='1'>shix</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='1'>r2d</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <domain type='qemu'/>
Apr 13 16:16:11 user nova-compute[71731]:     </arch>
Apr 13 16:16:11 user nova-compute[71731]:     <features>
Apr 13 16:16:11 user nova-compute[71731]:       <cpuselection/>
Apr 13 16:16:11 user nova-compute[71731]:       <deviceboot/>
Apr 13 16:16:11 user nova-compute[71731]:       <disksnapshot default='on' toggle='no'/>
Apr 13 16:16:11 user nova-compute[71731]:     </features>
Apr 13 16:16:11 user nova-compute[71731]:   </guest>
Apr 13 16:16:11 user nova-compute[71731]:   <guest>
Apr 13 16:16:11 user nova-compute[71731]:     <os_type>hvm</os_type>
Apr 13 16:16:11 user nova-compute[71731]:     <arch name='sh4eb'>
Apr 13 16:16:11 user nova-compute[71731]:       <wordsize>64</wordsize>
Apr 13 16:16:11 user nova-compute[71731]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='1'>shix</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='1'>r2d</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <domain type='qemu'/>
Apr 13 16:16:11 user nova-compute[71731]:     </arch>
Apr 13 16:16:11 user nova-compute[71731]:     <features>
Apr 13 16:16:11 user nova-compute[71731]:       <cpuselection/>
Apr 13 16:16:11 user nova-compute[71731]:       <deviceboot/>
Apr 13 16:16:11 user nova-compute[71731]:       <disksnapshot default='on' toggle='no'/>
Apr 13 16:16:11 user nova-compute[71731]:     </features>
Apr 13 16:16:11 user nova-compute[71731]:   </guest>
Apr 13 16:16:11 user nova-compute[71731]:   <guest>
Apr 13 16:16:11 user nova-compute[71731]:     <os_type>hvm</os_type>
Apr 13 16:16:11 user nova-compute[71731]:     <arch name='sparc'>
Apr 13 16:16:11 user nova-compute[71731]:       <wordsize>32</wordsize>
Apr 13 16:16:11 user nova-compute[71731]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='1'>SS-5</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='4'>SS-20</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='1'>LX</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='1'>SPARCClassic</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='1'>leon3_generic</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='1'>SPARCbook</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='1'>SS-4</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='4'>SS-600MP</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='4'>SS-10</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='1'>Voyager</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <domain type='qemu'/>
Apr 13 16:16:11 user nova-compute[71731]:     </arch>
Apr 13 16:16:11 user nova-compute[71731]:     <features>
Apr 13 16:16:11 user nova-compute[71731]:       <cpuselection/>
Apr 13 16:16:11 user nova-compute[71731]:       <deviceboot/>
Apr 13 16:16:11 user nova-compute[71731]:       <disksnapshot default='on' toggle='no'/>
Apr 13 16:16:11 user nova-compute[71731]:     </features>
Apr 13 16:16:11 user nova-compute[71731]:   </guest>
Apr 13 16:16:11 user nova-compute[71731]:   <guest>
Apr 13 16:16:11 user nova-compute[71731]:     <os_type>hvm</os_type>
Apr 13 16:16:11 user nova-compute[71731]:     <arch name='sparc64'>
Apr 13 16:16:11 user nova-compute[71731]:       <wordsize>64</wordsize>
Apr 13 16:16:11 user nova-compute[71731]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='1'>sun4u</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='1'>niagara</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='1'>sun4v</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <domain type='qemu'/>
Apr 13 16:16:11 user nova-compute[71731]:     </arch>
Apr 13 16:16:11 user nova-compute[71731]:     <features>
Apr 13 16:16:11 user nova-compute[71731]:       <cpuselection/>
Apr 13 16:16:11 user nova-compute[71731]:       <deviceboot/>
Apr 13 16:16:11 user nova-compute[71731]:       <disksnapshot default='on' toggle='no'/>
Apr 13 16:16:11 user nova-compute[71731]:     </features>
Apr 13 16:16:11 user nova-compute[71731]:   </guest>
Apr 13 16:16:11 user nova-compute[71731]:   <guest>
Apr 13 16:16:11 user nova-compute[71731]:     <os_type>hvm</os_type>
Apr 13 16:16:11 user nova-compute[71731]:     <arch name='x86_64'>
Apr 13 16:16:11 user nova-compute[71731]:       <wordsize>64</wordsize>
Apr 13 16:16:11 user nova-compute[71731]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='288'>pc-q35-artful</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='1'>x-remote</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='1'>isapc</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='288'>pc-q35-disco</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='288'>pc-q35-impish</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='288'>pc-q35-focal</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='288'>microvm</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <domain type='qemu'/>
Apr 13 16:16:11 user nova-compute[71731]:       <domain type='kvm'/>
Apr 13 16:16:11 user nova-compute[71731]:     </arch>
Apr 13 16:16:11 user nova-compute[71731]:     <features>
Apr 13 16:16:11 user nova-compute[71731]:       <acpi default='on' toggle='yes'/>
Apr 13 16:16:11 user nova-compute[71731]:       <apic default='on' toggle='no'/>
Apr 13 16:16:11 user nova-compute[71731]:       <cpuselection/>
Apr 13 16:16:11 user nova-compute[71731]:       <deviceboot/>
Apr 13 16:16:11 user nova-compute[71731]:       <disksnapshot default='on' toggle='no'/>
Apr 13 16:16:11 user nova-compute[71731]:     </features>
Apr 13 16:16:11 user nova-compute[71731]:   </guest>
Apr 13 16:16:11 user nova-compute[71731]:   <guest>
Apr 13 16:16:11 user nova-compute[71731]:     <os_type>hvm</os_type>
Apr 13 16:16:11 user nova-compute[71731]:     <arch name='xtensa'>
Apr 13 16:16:11 user nova-compute[71731]:       <wordsize>32</wordsize>
Apr 13 16:16:11 user nova-compute[71731]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='4'>sim</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='32'>kc705</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='32'>ml605</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='32'>ml605-nommu</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='32'>virt</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='32'>lx60-nommu</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='32'>lx200</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='32'>lx200-nommu</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='32'>lx60</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='32'>kc705-nommu</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <domain type='qemu'/>
Apr 13 16:16:11 user nova-compute[71731]:     </arch>
Apr 13 16:16:11 user nova-compute[71731]:     <features>
Apr 13 16:16:11 user nova-compute[71731]:       <cpuselection/>
Apr 13 16:16:11 user nova-compute[71731]:       <deviceboot/>
Apr 13 16:16:11 user nova-compute[71731]:       <disksnapshot default='on' toggle='no'/>
Apr 13 16:16:11 user nova-compute[71731]:     </features>
Apr 13 16:16:11 user nova-compute[71731]:   </guest>
Apr 13 16:16:11 user nova-compute[71731]:   <guest>
Apr 13 16:16:11 user nova-compute[71731]:     <os_type>hvm</os_type>
Apr 13 16:16:11 user nova-compute[71731]:     <arch name='xtensaeb'>
Apr 13 16:16:11 user nova-compute[71731]:       <wordsize>32</wordsize>
Apr 13 16:16:11 user nova-compute[71731]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='4'>sim</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='32'>kc705</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='32'>ml605</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='32'>ml605-nommu</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='32'>virt</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='32'>lx60-nommu</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='32'>lx200</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='32'>lx200-nommu</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='32'>lx60</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <machine maxCpus='32'>kc705-nommu</machine>
Apr 13 16:16:11 user nova-compute[71731]:       <domain type='qemu'/>
Apr 13 16:16:11 user nova-compute[71731]:     </arch>
Apr 13 16:16:11 user nova-compute[71731]:     <features>
Apr 13 16:16:11 user nova-compute[71731]:       <cpuselection/>
Apr 13 16:16:11 user nova-compute[71731]:       <deviceboot/>
Apr 13 16:16:11 user nova-compute[71731]:       <disksnapshot default='on' toggle='no'/>
Apr 13 16:16:11 user nova-compute[71731]:     </features>
Apr 13 16:16:11 user nova-compute[71731]:   </guest>
Apr 13 16:16:11 user nova-compute[71731]: </capabilities>
Apr 13 16:16:11 user nova-compute[71731]: 
Apr 13 16:16:11 user nova-compute[71731]: DEBUG nova.virt.libvirt.host [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=71731) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 13 16:16:11 user nova-compute[71731]: DEBUG nova.virt.libvirt.host [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=71731) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 13 16:16:11 user nova-compute[71731]: DEBUG nova.virt.libvirt.host [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=71731) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 13 16:16:11 user nova-compute[71731]: DEBUG nova.virt.libvirt.host [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=71731) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 13 16:16:11 user nova-compute[71731]: DEBUG nova.virt.libvirt.host [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=71731) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 13 16:16:11 user nova-compute[71731]: DEBUG nova.virt.libvirt.host [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=71731) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 13 16:16:11 user nova-compute[71731]: DEBUG nova.virt.libvirt.host [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=71731) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 13 16:16:11 user nova-compute[71731]: DEBUG nova.virt.libvirt.host [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=71731) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 13 16:16:11 user nova-compute[71731]: DEBUG nova.virt.libvirt.host [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=71731) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 13 16:16:11 user nova-compute[71731]: DEBUG nova.virt.libvirt.host [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Getting domain capabilities for cris via machine types: {None} {{(pid=71731) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 13 16:16:11 user nova-compute[71731]: DEBUG nova.virt.libvirt.host [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=71731) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 13 16:16:11 user nova-compute[71731]: DEBUG nova.virt.libvirt.host [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Getting domain capabilities for i686 via machine types: {'ubuntu', 'ubuntu-q35', 'q35', 'pc'} {{(pid=71731) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 13 16:16:11 user nova-compute[71731]: DEBUG nova.virt.libvirt.host [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Apr 13 16:16:11 user nova-compute[71731]: <domainCapabilities>
Apr 13 16:16:11 user nova-compute[71731]:   <path>/usr/bin/qemu-system-i386</path>
Apr 13 16:16:11 user nova-compute[71731]:   <domain>kvm</domain>
Apr 13 16:16:11 user nova-compute[71731]:   <machine>pc-i440fx-jammy</machine>
Apr 13 16:16:11 user nova-compute[71731]:   <arch>i686</arch>
Apr 13 16:16:11 user nova-compute[71731]:   <vcpu max='255'/>
Apr 13 16:16:11 user nova-compute[71731]:   <iothreads supported='yes'/>
Apr 13 16:16:11 user nova-compute[71731]:   <os supported='yes'>
Apr 13 16:16:11 user nova-compute[71731]:     <enum name='firmware'/>
Apr 13 16:16:11 user nova-compute[71731]:     <loader supported='yes'>
Apr 13 16:16:11 user nova-compute[71731]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Apr 13 16:16:11 user nova-compute[71731]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Apr 13 16:16:11 user nova-compute[71731]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Apr 13 16:16:11 user nova-compute[71731]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Apr 13 16:16:11 user nova-compute[71731]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Apr 13 16:16:11 user nova-compute[71731]:       <enum name='type'>
Apr 13 16:16:11 user nova-compute[71731]:         <value>rom</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>pflash</value>
Apr 13 16:16:11 user nova-compute[71731]:       </enum>
Apr 13 16:16:11 user nova-compute[71731]:       <enum name='readonly'>
Apr 13 16:16:11 user nova-compute[71731]:         <value>yes</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>no</value>
Apr 13 16:16:11 user nova-compute[71731]:       </enum>
Apr 13 16:16:11 user nova-compute[71731]:       <enum name='secure'>
Apr 13 16:16:11 user nova-compute[71731]:         <value>no</value>
Apr 13 16:16:11 user nova-compute[71731]:       </enum>
Apr 13 16:16:11 user nova-compute[71731]:     </loader>
Apr 13 16:16:11 user nova-compute[71731]:   </os>
Apr 13 16:16:11 user nova-compute[71731]:   <cpu>
Apr 13 16:16:11 user nova-compute[71731]:     <mode name='host-passthrough' supported='yes'>
Apr 13 16:16:11 user nova-compute[71731]:       <enum name='hostPassthroughMigratable'>
Apr 13 16:16:11 user nova-compute[71731]:         <value>off</value>
Apr 13 16:16:11 user nova-compute[71731]:       </enum>
Apr 13 16:16:11 user nova-compute[71731]:     </mode>
Apr 13 16:16:11 user nova-compute[71731]:     <mode name='maximum' supported='yes'>
Apr 13 16:16:11 user nova-compute[71731]:       <enum name='maximumMigratable'>
Apr 13 16:16:11 user nova-compute[71731]:         <value>on</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>off</value>
Apr 13 16:16:11 user nova-compute[71731]:       </enum>
Apr 13 16:16:11 user nova-compute[71731]:     </mode>
Apr 13 16:16:11 user nova-compute[71731]:     <mode name='host-model' supported='yes'>
Apr 13 16:16:11 user nova-compute[71731]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 13 16:16:11 user nova-compute[71731]:       <vendor>Intel</vendor>
Apr 13 16:16:11 user nova-compute[71731]:       <feature policy='require' name='ss'/>
Apr 13 16:16:11 user nova-compute[71731]:       <feature policy='require' name='vmx'/>
Apr 13 16:16:11 user nova-compute[71731]:       <feature policy='require' name='pcid'/>
Apr 13 16:16:11 user nova-compute[71731]:       <feature policy='require' name='hypervisor'/>
Apr 13 16:16:11 user nova-compute[71731]:       <feature policy='require' name='arat'/>
Apr 13 16:16:11 user nova-compute[71731]:       <feature policy='require' name='tsc_adjust'/>
Apr 13 16:16:11 user nova-compute[71731]:       <feature policy='require' name='umip'/>
Apr 13 16:16:11 user nova-compute[71731]:       <feature policy='require' name='md-clear'/>
Apr 13 16:16:11 user nova-compute[71731]:       <feature policy='require' name='stibp'/>
Apr 13 16:16:11 user nova-compute[71731]:       <feature policy='require' name='arch-capabilities'/>
Apr 13 16:16:11 user nova-compute[71731]:       <feature policy='require' name='ssbd'/>
Apr 13 16:16:11 user nova-compute[71731]:       <feature policy='require' name='ibpb'/>
Apr 13 16:16:11 user nova-compute[71731]:       <feature policy='require' name='ibrs'/>
Apr 13 16:16:11 user nova-compute[71731]:       <feature policy='require' name='amd-stibp'/>
Apr 13 16:16:11 user nova-compute[71731]:       <feature policy='require' name='amd-ssbd'/>
Apr 13 16:16:11 user nova-compute[71731]:       <feature policy='disable' name='erms'/>
Apr 13 16:16:11 user nova-compute[71731]:       <feature policy='disable' name='xsaveopt'/>
Apr 13 16:16:11 user nova-compute[71731]:       <feature policy='disable' name='lm'/>
Apr 13 16:16:11 user nova-compute[71731]:     </mode>
Apr 13 16:16:11 user nova-compute[71731]:     <mode name='custom' supported='yes'>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>qemu64</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='yes'>qemu32</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>phenom</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='yes'>pentium3</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='yes'>pentium2</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='yes'>pentium</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>n270</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>kvm64</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='yes'>kvm32</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='yes'>coreduo</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>core2duo</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>athlon</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>Westmere-IBRS</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>Westmere</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>Snowridge</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>Skylake-Server</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>Skylake-Client</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>SandyBridge</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>Penryn</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>Opteron_G5</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>Opteron_G4</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>Opteron_G3</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>Opteron_G2</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>Opteron_G1</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>Nehalem-IBRS</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>Nehalem</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>IvyBridge</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>Icelake-Server</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>Haswell-noTSX</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>Haswell-IBRS</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>Haswell</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>EPYC-Rome</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>EPYC-Milan</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>EPYC-IBPB</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>EPYC</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>Dhyana</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>Cooperlake</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>Conroe</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>Cascadelake-Server</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>Broadwell-noTSX</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>Broadwell-IBRS</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>Broadwell</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='yes'>486</model>
Apr 13 16:16:11 user nova-compute[71731]:     </mode>
Apr 13 16:16:11 user nova-compute[71731]:   </cpu>
Apr 13 16:16:11 user nova-compute[71731]:   <memoryBacking supported='yes'>
Apr 13 16:16:11 user nova-compute[71731]:     <enum name='sourceType'>
Apr 13 16:16:11 user nova-compute[71731]:       <value>file</value>
Apr 13 16:16:11 user nova-compute[71731]:       <value>anonymous</value>
Apr 13 16:16:11 user nova-compute[71731]:       <value>memfd</value>
Apr 13 16:16:11 user nova-compute[71731]:     </enum>
Apr 13 16:16:11 user nova-compute[71731]:   </memoryBacking>
Apr 13 16:16:11 user nova-compute[71731]:   <devices>
Apr 13 16:16:11 user nova-compute[71731]:     <disk supported='yes'>
Apr 13 16:16:11 user nova-compute[71731]:       <enum name='diskDevice'>
Apr 13 16:16:11 user nova-compute[71731]:         <value>disk</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>cdrom</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>floppy</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>lun</value>
Apr 13 16:16:11 user nova-compute[71731]:       </enum>
Apr 13 16:16:11 user nova-compute[71731]:       <enum name='bus'>
Apr 13 16:16:11 user nova-compute[71731]:         <value>ide</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>fdc</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>scsi</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>virtio</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>usb</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>sata</value>
Apr 13 16:16:11 user nova-compute[71731]:       </enum>
Apr 13 16:16:11 user nova-compute[71731]:       <enum name='model'>
Apr 13 16:16:11 user nova-compute[71731]:         <value>virtio</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>virtio-transitional</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>virtio-non-transitional</value>
Apr 13 16:16:11 user nova-compute[71731]:       </enum>
Apr 13 16:16:11 user nova-compute[71731]:     </disk>
Apr 13 16:16:11 user nova-compute[71731]:     <graphics supported='yes'>
Apr 13 16:16:11 user nova-compute[71731]:       <enum name='type'>
Apr 13 16:16:11 user nova-compute[71731]:         <value>sdl</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>vnc</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>spice</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>egl-headless</value>
Apr 13 16:16:11 user nova-compute[71731]:       </enum>
Apr 13 16:16:11 user nova-compute[71731]:     </graphics>
Apr 13 16:16:11 user nova-compute[71731]:     <video supported='yes'>
Apr 13 16:16:11 user nova-compute[71731]:       <enum name='modelType'>
Apr 13 16:16:11 user nova-compute[71731]:         <value>vga</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>cirrus</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>vmvga</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>qxl</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>virtio</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>none</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>bochs</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>ramfb</value>
Apr 13 16:16:11 user nova-compute[71731]:       </enum>
Apr 13 16:16:11 user nova-compute[71731]:     </video>
Apr 13 16:16:11 user nova-compute[71731]:     <hostdev supported='yes'>
Apr 13 16:16:11 user nova-compute[71731]:       <enum name='mode'>
Apr 13 16:16:11 user nova-compute[71731]:         <value>subsystem</value>
Apr 13 16:16:11 user nova-compute[71731]:       </enum>
Apr 13 16:16:11 user nova-compute[71731]:       <enum name='startupPolicy'>
Apr 13 16:16:11 user nova-compute[71731]:         <value>default</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>mandatory</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>requisite</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>optional</value>
Apr 13 16:16:11 user nova-compute[71731]:       </enum>
Apr 13 16:16:11 user nova-compute[71731]:       <enum name='subsysType'>
Apr 13 16:16:11 user nova-compute[71731]:         <value>usb</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>pci</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>scsi</value>
Apr 13 16:16:11 user nova-compute[71731]:       </enum>
Apr 13 16:16:11 user nova-compute[71731]:       <enum name='capsType'/>
Apr 13 16:16:11 user nova-compute[71731]:       <enum name='pciBackend'/>
Apr 13 16:16:11 user nova-compute[71731]:     </hostdev>
Apr 13 16:16:11 user nova-compute[71731]:     <rng supported='yes'>
Apr 13 16:16:11 user nova-compute[71731]:       <enum name='model'>
Apr 13 16:16:11 user nova-compute[71731]:         <value>virtio</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>virtio-transitional</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>virtio-non-transitional</value>
Apr 13 16:16:11 user nova-compute[71731]:       </enum>
Apr 13 16:16:11 user nova-compute[71731]:       <enum name='backendModel'>
Apr 13 16:16:11 user nova-compute[71731]:         <value>random</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>egd</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>builtin</value>
Apr 13 16:16:11 user nova-compute[71731]:       </enum>
Apr 13 16:16:11 user nova-compute[71731]:     </rng>
Apr 13 16:16:11 user nova-compute[71731]:     <filesystem supported='yes'>
Apr 13 16:16:11 user nova-compute[71731]:       <enum name='driverType'>
Apr 13 16:16:11 user nova-compute[71731]:         <value>path</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>handle</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>virtiofs</value>
Apr 13 16:16:11 user nova-compute[71731]:       </enum>
Apr 13 16:16:11 user nova-compute[71731]:     </filesystem>
Apr 13 16:16:11 user nova-compute[71731]:     <tpm supported='yes'>
Apr 13 16:16:11 user nova-compute[71731]:       <enum name='model'>
Apr 13 16:16:11 user nova-compute[71731]:         <value>tpm-tis</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>tpm-crb</value>
Apr 13 16:16:11 user nova-compute[71731]:       </enum>
Apr 13 16:16:11 user nova-compute[71731]:       <enum name='backendModel'>
Apr 13 16:16:11 user nova-compute[71731]:         <value>passthrough</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>emulator</value>
Apr 13 16:16:11 user nova-compute[71731]:       </enum>
Apr 13 16:16:11 user nova-compute[71731]:     </tpm>
Apr 13 16:16:11 user nova-compute[71731]:   </devices>
Apr 13 16:16:11 user nova-compute[71731]:   <features>
Apr 13 16:16:11 user nova-compute[71731]:     <gic supported='no'/>
Apr 13 16:16:11 user nova-compute[71731]:     <vmcoreinfo supported='yes'/>
Apr 13 16:16:11 user nova-compute[71731]:     <genid supported='yes'/>
Apr 13 16:16:11 user nova-compute[71731]:     <backingStoreInput supported='yes'/>
Apr 13 16:16:11 user nova-compute[71731]:     <backup supported='yes'/>
Apr 13 16:16:11 user nova-compute[71731]:     <sev supported='no'/>
Apr 13 16:16:11 user nova-compute[71731]:   </features>
Apr 13 16:16:11 user nova-compute[71731]: </domainCapabilities>
Apr 13 16:16:11 user nova-compute[71731]:  {{(pid=71731) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 13 16:16:11 user nova-compute[71731]: DEBUG nova.virt.libvirt.host [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Apr 13 16:16:11 user nova-compute[71731]: <domainCapabilities>
Apr 13 16:16:11 user nova-compute[71731]:   <path>/usr/bin/qemu-system-i386</path>
Apr 13 16:16:11 user nova-compute[71731]:   <domain>kvm</domain>
Apr 13 16:16:11 user nova-compute[71731]:   <machine>pc-q35-jammy</machine>
Apr 13 16:16:11 user nova-compute[71731]:   <arch>i686</arch>
Apr 13 16:16:11 user nova-compute[71731]:   <vcpu max='288'/>
Apr 13 16:16:11 user nova-compute[71731]:   <iothreads supported='yes'/>
Apr 13 16:16:11 user nova-compute[71731]:   <os supported='yes'>
Apr 13 16:16:11 user nova-compute[71731]:     <enum name='firmware'/>
Apr 13 16:16:11 user nova-compute[71731]:     <loader supported='yes'>
Apr 13 16:16:11 user nova-compute[71731]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Apr 13 16:16:11 user nova-compute[71731]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Apr 13 16:16:11 user nova-compute[71731]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Apr 13 16:16:11 user nova-compute[71731]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Apr 13 16:16:11 user nova-compute[71731]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Apr 13 16:16:11 user nova-compute[71731]:       <enum name='type'>
Apr 13 16:16:11 user nova-compute[71731]:         <value>rom</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>pflash</value>
Apr 13 16:16:11 user nova-compute[71731]:       </enum>
Apr 13 16:16:11 user nova-compute[71731]:       <enum name='readonly'>
Apr 13 16:16:11 user nova-compute[71731]:         <value>yes</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>no</value>
Apr 13 16:16:11 user nova-compute[71731]:       </enum>
Apr 13 16:16:11 user nova-compute[71731]:       <enum name='secure'>
Apr 13 16:16:11 user nova-compute[71731]:         <value>no</value>
Apr 13 16:16:11 user nova-compute[71731]:       </enum>
Apr 13 16:16:11 user nova-compute[71731]:     </loader>
Apr 13 16:16:11 user nova-compute[71731]:   </os>
Apr 13 16:16:11 user nova-compute[71731]:   <cpu>
Apr 13 16:16:11 user nova-compute[71731]:     <mode name='host-passthrough' supported='yes'>
Apr 13 16:16:11 user nova-compute[71731]:       <enum name='hostPassthroughMigratable'>
Apr 13 16:16:11 user nova-compute[71731]:         <value>off</value>
Apr 13 16:16:11 user nova-compute[71731]:       </enum>
Apr 13 16:16:11 user nova-compute[71731]:     </mode>
Apr 13 16:16:11 user nova-compute[71731]:     <mode name='maximum' supported='yes'>
Apr 13 16:16:11 user nova-compute[71731]:       <enum name='maximumMigratable'>
Apr 13 16:16:11 user nova-compute[71731]:         <value>on</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>off</value>
Apr 13 16:16:11 user nova-compute[71731]:       </enum>
Apr 13 16:16:11 user nova-compute[71731]:     </mode>
Apr 13 16:16:11 user nova-compute[71731]:     <mode name='host-model' supported='yes'>
Apr 13 16:16:11 user nova-compute[71731]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 13 16:16:11 user nova-compute[71731]:       <vendor>Intel</vendor>
Apr 13 16:16:11 user nova-compute[71731]:       <feature policy='require' name='ss'/>
Apr 13 16:16:11 user nova-compute[71731]:       <feature policy='require' name='vmx'/>
Apr 13 16:16:11 user nova-compute[71731]:       <feature policy='require' name='pcid'/>
Apr 13 16:16:11 user nova-compute[71731]:       <feature policy='require' name='hypervisor'/>
Apr 13 16:16:11 user nova-compute[71731]:       <feature policy='require' name='arat'/>
Apr 13 16:16:11 user nova-compute[71731]:       <feature policy='require' name='tsc_adjust'/>
Apr 13 16:16:11 user nova-compute[71731]:       <feature policy='require' name='umip'/>
Apr 13 16:16:11 user nova-compute[71731]:       <feature policy='require' name='md-clear'/>
Apr 13 16:16:11 user nova-compute[71731]:       <feature policy='require' name='stibp'/>
Apr 13 16:16:11 user nova-compute[71731]:       <feature policy='require' name='arch-capabilities'/>
Apr 13 16:16:11 user nova-compute[71731]:       <feature policy='require' name='ssbd'/>
Apr 13 16:16:11 user nova-compute[71731]:       <feature policy='require' name='ibpb'/>
Apr 13 16:16:11 user nova-compute[71731]:       <feature policy='require' name='ibrs'/>
Apr 13 16:16:11 user nova-compute[71731]:       <feature policy='require' name='amd-stibp'/>
Apr 13 16:16:11 user nova-compute[71731]:       <feature policy='require' name='amd-ssbd'/>
Apr 13 16:16:11 user nova-compute[71731]:       <feature policy='disable' name='erms'/>
Apr 13 16:16:11 user nova-compute[71731]:       <feature policy='disable' name='xsaveopt'/>
Apr 13 16:16:11 user nova-compute[71731]:       <feature policy='disable' name='lm'/>
Apr 13 16:16:11 user nova-compute[71731]:     </mode>
Apr 13 16:16:11 user nova-compute[71731]:     <mode name='custom' supported='yes'>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>qemu64</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='yes'>qemu32</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>phenom</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='yes'>pentium3</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='yes'>pentium2</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='yes'>pentium</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>n270</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>kvm64</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='yes'>kvm32</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='yes'>coreduo</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>core2duo</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>athlon</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>Westmere-IBRS</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>Westmere</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>Snowridge</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>Skylake-Server</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>Skylake-Client</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>SandyBridge</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>Penryn</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>Opteron_G5</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>Opteron_G4</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>Opteron_G3</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>Opteron_G2</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>Opteron_G1</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>Nehalem-IBRS</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>Nehalem</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>IvyBridge</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>Icelake-Server</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>Haswell-noTSX</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>Haswell-IBRS</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>Haswell</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>EPYC-Rome</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>EPYC-Milan</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>EPYC-IBPB</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>EPYC</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>Dhyana</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>Cooperlake</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>Conroe</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>Cascadelake-Server</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>Broadwell-noTSX</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>Broadwell-IBRS</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>Broadwell</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='yes'>486</model>
Apr 13 16:16:11 user nova-compute[71731]:     </mode>
Apr 13 16:16:11 user nova-compute[71731]:   </cpu>
Apr 13 16:16:11 user nova-compute[71731]:   <memoryBacking supported='yes'>
Apr 13 16:16:11 user nova-compute[71731]:     <enum name='sourceType'>
Apr 13 16:16:11 user nova-compute[71731]:       <value>file</value>
Apr 13 16:16:11 user nova-compute[71731]:       <value>anonymous</value>
Apr 13 16:16:11 user nova-compute[71731]:       <value>memfd</value>
Apr 13 16:16:11 user nova-compute[71731]:     </enum>
Apr 13 16:16:11 user nova-compute[71731]:   </memoryBacking>
Apr 13 16:16:11 user nova-compute[71731]:   <devices>
Apr 13 16:16:11 user nova-compute[71731]:     <disk supported='yes'>
Apr 13 16:16:11 user nova-compute[71731]:       <enum name='diskDevice'>
Apr 13 16:16:11 user nova-compute[71731]:         <value>disk</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>cdrom</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>floppy</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>lun</value>
Apr 13 16:16:11 user nova-compute[71731]:       </enum>
Apr 13 16:16:11 user nova-compute[71731]:       <enum name='bus'>
Apr 13 16:16:11 user nova-compute[71731]:         <value>fdc</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>scsi</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>virtio</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>usb</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>sata</value>
Apr 13 16:16:11 user nova-compute[71731]:       </enum>
Apr 13 16:16:11 user nova-compute[71731]:       <enum name='model'>
Apr 13 16:16:11 user nova-compute[71731]:         <value>virtio</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>virtio-transitional</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>virtio-non-transitional</value>
Apr 13 16:16:11 user nova-compute[71731]:       </enum>
Apr 13 16:16:11 user nova-compute[71731]:     </disk>
Apr 13 16:16:11 user nova-compute[71731]:     <graphics supported='yes'>
Apr 13 16:16:11 user nova-compute[71731]:       <enum name='type'>
Apr 13 16:16:11 user nova-compute[71731]:         <value>sdl</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>vnc</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>spice</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>egl-headless</value>
Apr 13 16:16:11 user nova-compute[71731]:       </enum>
Apr 13 16:16:11 user nova-compute[71731]:     </graphics>
Apr 13 16:16:11 user nova-compute[71731]:     <video supported='yes'>
Apr 13 16:16:11 user nova-compute[71731]:       <enum name='modelType'>
Apr 13 16:16:11 user nova-compute[71731]:         <value>vga</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>cirrus</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>vmvga</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>qxl</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>virtio</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>none</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>bochs</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>ramfb</value>
Apr 13 16:16:11 user nova-compute[71731]:       </enum>
Apr 13 16:16:11 user nova-compute[71731]:     </video>
Apr 13 16:16:11 user nova-compute[71731]:     <hostdev supported='yes'>
Apr 13 16:16:11 user nova-compute[71731]:       <enum name='mode'>
Apr 13 16:16:11 user nova-compute[71731]:         <value>subsystem</value>
Apr 13 16:16:11 user nova-compute[71731]:       </enum>
Apr 13 16:16:11 user nova-compute[71731]:       <enum name='startupPolicy'>
Apr 13 16:16:11 user nova-compute[71731]:         <value>default</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>mandatory</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>requisite</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>optional</value>
Apr 13 16:16:11 user nova-compute[71731]:       </enum>
Apr 13 16:16:11 user nova-compute[71731]:       <enum name='subsysType'>
Apr 13 16:16:11 user nova-compute[71731]:         <value>usb</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>pci</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>scsi</value>
Apr 13 16:16:11 user nova-compute[71731]:       </enum>
Apr 13 16:16:11 user nova-compute[71731]:       <enum name='capsType'/>
Apr 13 16:16:11 user nova-compute[71731]:       <enum name='pciBackend'/>
Apr 13 16:16:11 user nova-compute[71731]:     </hostdev>
Apr 13 16:16:11 user nova-compute[71731]:     <rng supported='yes'>
Apr 13 16:16:11 user nova-compute[71731]:       <enum name='model'>
Apr 13 16:16:11 user nova-compute[71731]:         <value>virtio</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>virtio-transitional</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>virtio-non-transitional</value>
Apr 13 16:16:11 user nova-compute[71731]:       </enum>
Apr 13 16:16:11 user nova-compute[71731]:       <enum name='backendModel'>
Apr 13 16:16:11 user nova-compute[71731]:         <value>random</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>egd</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>builtin</value>
Apr 13 16:16:11 user nova-compute[71731]:       </enum>
Apr 13 16:16:11 user nova-compute[71731]:     </rng>
Apr 13 16:16:11 user nova-compute[71731]:     <filesystem supported='yes'>
Apr 13 16:16:11 user nova-compute[71731]:       <enum name='driverType'>
Apr 13 16:16:11 user nova-compute[71731]:         <value>path</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>handle</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>virtiofs</value>
Apr 13 16:16:11 user nova-compute[71731]:       </enum>
Apr 13 16:16:11 user nova-compute[71731]:     </filesystem>
Apr 13 16:16:11 user nova-compute[71731]:     <tpm supported='yes'>
Apr 13 16:16:11 user nova-compute[71731]:       <enum name='model'>
Apr 13 16:16:11 user nova-compute[71731]:         <value>tpm-tis</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>tpm-crb</value>
Apr 13 16:16:11 user nova-compute[71731]:       </enum>
Apr 13 16:16:11 user nova-compute[71731]:       <enum name='backendModel'>
Apr 13 16:16:11 user nova-compute[71731]:         <value>passthrough</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>emulator</value>
Apr 13 16:16:11 user nova-compute[71731]:       </enum>
Apr 13 16:16:11 user nova-compute[71731]:     </tpm>
Apr 13 16:16:11 user nova-compute[71731]:   </devices>
Apr 13 16:16:11 user nova-compute[71731]:   <features>
Apr 13 16:16:11 user nova-compute[71731]:     <gic supported='no'/>
Apr 13 16:16:11 user nova-compute[71731]:     <vmcoreinfo supported='yes'/>
Apr 13 16:16:11 user nova-compute[71731]:     <genid supported='yes'/>
Apr 13 16:16:11 user nova-compute[71731]:     <backingStoreInput supported='yes'/>
Apr 13 16:16:11 user nova-compute[71731]:     <backup supported='yes'/>
Apr 13 16:16:11 user nova-compute[71731]:     <sev supported='no'/>
Apr 13 16:16:11 user nova-compute[71731]:   </features>
Apr 13 16:16:11 user nova-compute[71731]: </domainCapabilities>
Apr 13 16:16:11 user nova-compute[71731]:  {{(pid=71731) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 13 16:16:11 user nova-compute[71731]: DEBUG nova.virt.libvirt.host [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Apr 13 16:16:11 user nova-compute[71731]: <domainCapabilities>
Apr 13 16:16:11 user nova-compute[71731]:   <path>/usr/bin/qemu-system-i386</path>
Apr 13 16:16:11 user nova-compute[71731]:   <domain>kvm</domain>
Apr 13 16:16:11 user nova-compute[71731]:   <machine>pc-q35-6.2</machine>
Apr 13 16:16:11 user nova-compute[71731]:   <arch>i686</arch>
Apr 13 16:16:11 user nova-compute[71731]:   <vcpu max='288'/>
Apr 13 16:16:11 user nova-compute[71731]:   <iothreads supported='yes'/>
Apr 13 16:16:11 user nova-compute[71731]:   <os supported='yes'>
Apr 13 16:16:11 user nova-compute[71731]:     <enum name='firmware'/>
Apr 13 16:16:11 user nova-compute[71731]:     <loader supported='yes'>
Apr 13 16:16:11 user nova-compute[71731]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Apr 13 16:16:11 user nova-compute[71731]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Apr 13 16:16:11 user nova-compute[71731]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Apr 13 16:16:11 user nova-compute[71731]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Apr 13 16:16:11 user nova-compute[71731]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Apr 13 16:16:11 user nova-compute[71731]:       <enum name='type'>
Apr 13 16:16:11 user nova-compute[71731]:         <value>rom</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>pflash</value>
Apr 13 16:16:11 user nova-compute[71731]:       </enum>
Apr 13 16:16:11 user nova-compute[71731]:       <enum name='readonly'>
Apr 13 16:16:11 user nova-compute[71731]:         <value>yes</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>no</value>
Apr 13 16:16:11 user nova-compute[71731]:       </enum>
Apr 13 16:16:11 user nova-compute[71731]:       <enum name='secure'>
Apr 13 16:16:11 user nova-compute[71731]:         <value>no</value>
Apr 13 16:16:11 user nova-compute[71731]:       </enum>
Apr 13 16:16:11 user nova-compute[71731]:     </loader>
Apr 13 16:16:11 user nova-compute[71731]:   </os>
Apr 13 16:16:11 user nova-compute[71731]:   <cpu>
Apr 13 16:16:11 user nova-compute[71731]:     <mode name='host-passthrough' supported='yes'>
Apr 13 16:16:11 user nova-compute[71731]:       <enum name='hostPassthroughMigratable'>
Apr 13 16:16:11 user nova-compute[71731]:         <value>off</value>
Apr 13 16:16:11 user nova-compute[71731]:       </enum>
Apr 13 16:16:11 user nova-compute[71731]:     </mode>
Apr 13 16:16:11 user nova-compute[71731]:     <mode name='maximum' supported='yes'>
Apr 13 16:16:11 user nova-compute[71731]:       <enum name='maximumMigratable'>
Apr 13 16:16:11 user nova-compute[71731]:         <value>on</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>off</value>
Apr 13 16:16:11 user nova-compute[71731]:       </enum>
Apr 13 16:16:11 user nova-compute[71731]:     </mode>
Apr 13 16:16:11 user nova-compute[71731]:     <mode name='host-model' supported='yes'>
Apr 13 16:16:11 user nova-compute[71731]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 13 16:16:11 user nova-compute[71731]:       <vendor>Intel</vendor>
Apr 13 16:16:11 user nova-compute[71731]:       <feature policy='require' name='ss'/>
Apr 13 16:16:11 user nova-compute[71731]:       <feature policy='require' name='vmx'/>
Apr 13 16:16:11 user nova-compute[71731]:       <feature policy='require' name='pcid'/>
Apr 13 16:16:11 user nova-compute[71731]:       <feature policy='require' name='hypervisor'/>
Apr 13 16:16:11 user nova-compute[71731]:       <feature policy='require' name='arat'/>
Apr 13 16:16:11 user nova-compute[71731]:       <feature policy='require' name='tsc_adjust'/>
Apr 13 16:16:11 user nova-compute[71731]:       <feature policy='require' name='umip'/>
Apr 13 16:16:11 user nova-compute[71731]:       <feature policy='require' name='md-clear'/>
Apr 13 16:16:11 user nova-compute[71731]:       <feature policy='require' name='stibp'/>
Apr 13 16:16:11 user nova-compute[71731]:       <feature policy='require' name='arch-capabilities'/>
Apr 13 16:16:11 user nova-compute[71731]:       <feature policy='require' name='ssbd'/>
Apr 13 16:16:11 user nova-compute[71731]:       <feature policy='require' name='ibpb'/>
Apr 13 16:16:11 user nova-compute[71731]:       <feature policy='require' name='ibrs'/>
Apr 13 16:16:11 user nova-compute[71731]:       <feature policy='require' name='amd-stibp'/>
Apr 13 16:16:11 user nova-compute[71731]:       <feature policy='require' name='amd-ssbd'/>
Apr 13 16:16:11 user nova-compute[71731]:       <feature policy='disable' name='erms'/>
Apr 13 16:16:11 user nova-compute[71731]:       <feature policy='disable' name='xsaveopt'/>
Apr 13 16:16:11 user nova-compute[71731]:       <feature policy='disable' name='lm'/>
Apr 13 16:16:11 user nova-compute[71731]:     </mode>
Apr 13 16:16:11 user nova-compute[71731]:     <mode name='custom' supported='yes'>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>qemu64</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='yes'>qemu32</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>phenom</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='yes'>pentium3</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='yes'>pentium2</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='yes'>pentium</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>n270</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>kvm64</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='yes'>kvm32</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='yes'>coreduo</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>core2duo</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>athlon</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>Westmere-IBRS</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>Westmere</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>Snowridge</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>Skylake-Server</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>Skylake-Client</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>SandyBridge</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>Penryn</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>Opteron_G5</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>Opteron_G4</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>Opteron_G3</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>Opteron_G2</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>Opteron_G1</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>Nehalem-IBRS</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>Nehalem</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>IvyBridge</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>Icelake-Server</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>Haswell-noTSX</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>Haswell-IBRS</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>Haswell</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>EPYC-Rome</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>EPYC-Milan</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>EPYC-IBPB</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>EPYC</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>Dhyana</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>Cooperlake</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>Conroe</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>Cascadelake-Server</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>Broadwell-noTSX</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>Broadwell-IBRS</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>Broadwell</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='yes'>486</model>
Apr 13 16:16:11 user nova-compute[71731]:     </mode>
Apr 13 16:16:11 user nova-compute[71731]:   </cpu>
Apr 13 16:16:11 user nova-compute[71731]:   <memoryBacking supported='yes'>
Apr 13 16:16:11 user nova-compute[71731]:     <enum name='sourceType'>
Apr 13 16:16:11 user nova-compute[71731]:       <value>file</value>
Apr 13 16:16:11 user nova-compute[71731]:       <value>anonymous</value>
Apr 13 16:16:11 user nova-compute[71731]:       <value>memfd</value>
Apr 13 16:16:11 user nova-compute[71731]:     </enum>
Apr 13 16:16:11 user nova-compute[71731]:   </memoryBacking>
Apr 13 16:16:11 user nova-compute[71731]:   <devices>
Apr 13 16:16:11 user nova-compute[71731]:     <disk supported='yes'>
Apr 13 16:16:11 user nova-compute[71731]:       <enum name='diskDevice'>
Apr 13 16:16:11 user nova-compute[71731]:         <value>disk</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>cdrom</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>floppy</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>lun</value>
Apr 13 16:16:11 user nova-compute[71731]:       </enum>
Apr 13 16:16:11 user nova-compute[71731]:       <enum name='bus'>
Apr 13 16:16:11 user nova-compute[71731]:         <value>fdc</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>scsi</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>virtio</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>usb</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>sata</value>
Apr 13 16:16:11 user nova-compute[71731]:       </enum>
Apr 13 16:16:11 user nova-compute[71731]:       <enum name='model'>
Apr 13 16:16:11 user nova-compute[71731]:         <value>virtio</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>virtio-transitional</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>virtio-non-transitional</value>
Apr 13 16:16:11 user nova-compute[71731]:       </enum>
Apr 13 16:16:11 user nova-compute[71731]:     </disk>
Apr 13 16:16:11 user nova-compute[71731]:     <graphics supported='yes'>
Apr 13 16:16:11 user nova-compute[71731]:       <enum name='type'>
Apr 13 16:16:11 user nova-compute[71731]:         <value>sdl</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>vnc</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>spice</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>egl-headless</value>
Apr 13 16:16:11 user nova-compute[71731]:       </enum>
Apr 13 16:16:11 user nova-compute[71731]:     </graphics>
Apr 13 16:16:11 user nova-compute[71731]:     <video supported='yes'>
Apr 13 16:16:11 user nova-compute[71731]:       <enum name='modelType'>
Apr 13 16:16:11 user nova-compute[71731]:         <value>vga</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>cirrus</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>vmvga</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>qxl</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>virtio</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>none</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>bochs</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>ramfb</value>
Apr 13 16:16:11 user nova-compute[71731]:       </enum>
Apr 13 16:16:11 user nova-compute[71731]:     </video>
Apr 13 16:16:11 user nova-compute[71731]:     <hostdev supported='yes'>
Apr 13 16:16:11 user nova-compute[71731]:       <enum name='mode'>
Apr 13 16:16:11 user nova-compute[71731]:         <value>subsystem</value>
Apr 13 16:16:11 user nova-compute[71731]:       </enum>
Apr 13 16:16:11 user nova-compute[71731]:       <enum name='startupPolicy'>
Apr 13 16:16:11 user nova-compute[71731]:         <value>default</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>mandatory</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>requisite</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>optional</value>
Apr 13 16:16:11 user nova-compute[71731]:       </enum>
Apr 13 16:16:11 user nova-compute[71731]:       <enum name='subsysType'>
Apr 13 16:16:11 user nova-compute[71731]:         <value>usb</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>pci</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>scsi</value>
Apr 13 16:16:11 user nova-compute[71731]:       </enum>
Apr 13 16:16:11 user nova-compute[71731]:       <enum name='capsType'/>
Apr 13 16:16:11 user nova-compute[71731]:       <enum name='pciBackend'/>
Apr 13 16:16:11 user nova-compute[71731]:     </hostdev>
Apr 13 16:16:11 user nova-compute[71731]:     <rng supported='yes'>
Apr 13 16:16:11 user nova-compute[71731]:       <enum name='model'>
Apr 13 16:16:11 user nova-compute[71731]:         <value>virtio</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>virtio-transitional</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>virtio-non-transitional</value>
Apr 13 16:16:11 user nova-compute[71731]:       </enum>
Apr 13 16:16:11 user nova-compute[71731]:       <enum name='backendModel'>
Apr 13 16:16:11 user nova-compute[71731]:         <value>random</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>egd</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>builtin</value>
Apr 13 16:16:11 user nova-compute[71731]:       </enum>
Apr 13 16:16:11 user nova-compute[71731]:     </rng>
Apr 13 16:16:11 user nova-compute[71731]:     <filesystem supported='yes'>
Apr 13 16:16:11 user nova-compute[71731]:       <enum name='driverType'>
Apr 13 16:16:11 user nova-compute[71731]:         <value>path</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>handle</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>virtiofs</value>
Apr 13 16:16:11 user nova-compute[71731]:       </enum>
Apr 13 16:16:11 user nova-compute[71731]:     </filesystem>
Apr 13 16:16:11 user nova-compute[71731]:     <tpm supported='yes'>
Apr 13 16:16:11 user nova-compute[71731]:       <enum name='model'>
Apr 13 16:16:11 user nova-compute[71731]:         <value>tpm-tis</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>tpm-crb</value>
Apr 13 16:16:11 user nova-compute[71731]:       </enum>
Apr 13 16:16:11 user nova-compute[71731]:       <enum name='backendModel'>
Apr 13 16:16:11 user nova-compute[71731]:         <value>passthrough</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>emulator</value>
Apr 13 16:16:11 user nova-compute[71731]:       </enum>
Apr 13 16:16:11 user nova-compute[71731]:     </tpm>
Apr 13 16:16:11 user nova-compute[71731]:   </devices>
Apr 13 16:16:11 user nova-compute[71731]:   <features>
Apr 13 16:16:11 user nova-compute[71731]:     <gic supported='no'/>
Apr 13 16:16:11 user nova-compute[71731]:     <vmcoreinfo supported='yes'/>
Apr 13 16:16:11 user nova-compute[71731]:     <genid supported='yes'/>
Apr 13 16:16:11 user nova-compute[71731]:     <backingStoreInput supported='yes'/>
Apr 13 16:16:11 user nova-compute[71731]:     <backup supported='yes'/>
Apr 13 16:16:11 user nova-compute[71731]:     <sev supported='no'/>
Apr 13 16:16:11 user nova-compute[71731]:   </features>
Apr 13 16:16:11 user nova-compute[71731]: </domainCapabilities>
Apr 13 16:16:11 user nova-compute[71731]:  {{(pid=71731) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 13 16:16:11 user nova-compute[71731]: DEBUG nova.virt.libvirt.host [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Apr 13 16:16:11 user nova-compute[71731]: <domainCapabilities>
Apr 13 16:16:11 user nova-compute[71731]:   <path>/usr/bin/qemu-system-i386</path>
Apr 13 16:16:11 user nova-compute[71731]:   <domain>kvm</domain>
Apr 13 16:16:11 user nova-compute[71731]:   <machine>pc-i440fx-6.2</machine>
Apr 13 16:16:11 user nova-compute[71731]:   <arch>i686</arch>
Apr 13 16:16:11 user nova-compute[71731]:   <vcpu max='255'/>
Apr 13 16:16:11 user nova-compute[71731]:   <iothreads supported='yes'/>
Apr 13 16:16:11 user nova-compute[71731]:   <os supported='yes'>
Apr 13 16:16:11 user nova-compute[71731]:     <enum name='firmware'/>
Apr 13 16:16:11 user nova-compute[71731]:     <loader supported='yes'>
Apr 13 16:16:11 user nova-compute[71731]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Apr 13 16:16:11 user nova-compute[71731]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Apr 13 16:16:11 user nova-compute[71731]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Apr 13 16:16:11 user nova-compute[71731]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Apr 13 16:16:11 user nova-compute[71731]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Apr 13 16:16:11 user nova-compute[71731]:       <enum name='type'>
Apr 13 16:16:11 user nova-compute[71731]:         <value>rom</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>pflash</value>
Apr 13 16:16:11 user nova-compute[71731]:       </enum>
Apr 13 16:16:11 user nova-compute[71731]:       <enum name='readonly'>
Apr 13 16:16:11 user nova-compute[71731]:         <value>yes</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>no</value>
Apr 13 16:16:11 user nova-compute[71731]:       </enum>
Apr 13 16:16:11 user nova-compute[71731]:       <enum name='secure'>
Apr 13 16:16:11 user nova-compute[71731]:         <value>no</value>
Apr 13 16:16:11 user nova-compute[71731]:       </enum>
Apr 13 16:16:11 user nova-compute[71731]:     </loader>
Apr 13 16:16:11 user nova-compute[71731]:   </os>
Apr 13 16:16:11 user nova-compute[71731]:   <cpu>
Apr 13 16:16:11 user nova-compute[71731]:     <mode name='host-passthrough' supported='yes'>
Apr 13 16:16:11 user nova-compute[71731]:       <enum name='hostPassthroughMigratable'>
Apr 13 16:16:11 user nova-compute[71731]:         <value>off</value>
Apr 13 16:16:11 user nova-compute[71731]:       </enum>
Apr 13 16:16:11 user nova-compute[71731]:     </mode>
Apr 13 16:16:11 user nova-compute[71731]:     <mode name='maximum' supported='yes'>
Apr 13 16:16:11 user nova-compute[71731]:       <enum name='maximumMigratable'>
Apr 13 16:16:11 user nova-compute[71731]:         <value>on</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>off</value>
Apr 13 16:16:11 user nova-compute[71731]:       </enum>
Apr 13 16:16:11 user nova-compute[71731]:     </mode>
Apr 13 16:16:11 user nova-compute[71731]:     <mode name='host-model' supported='yes'>
Apr 13 16:16:11 user nova-compute[71731]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 13 16:16:11 user nova-compute[71731]:       <vendor>Intel</vendor>
Apr 13 16:16:11 user nova-compute[71731]:       <feature policy='require' name='ss'/>
Apr 13 16:16:11 user nova-compute[71731]:       <feature policy='require' name='vmx'/>
Apr 13 16:16:11 user nova-compute[71731]:       <feature policy='require' name='pcid'/>
Apr 13 16:16:11 user nova-compute[71731]:       <feature policy='require' name='hypervisor'/>
Apr 13 16:16:11 user nova-compute[71731]:       <feature policy='require' name='arat'/>
Apr 13 16:16:11 user nova-compute[71731]:       <feature policy='require' name='tsc_adjust'/>
Apr 13 16:16:11 user nova-compute[71731]:       <feature policy='require' name='umip'/>
Apr 13 16:16:11 user nova-compute[71731]:       <feature policy='require' name='md-clear'/>
Apr 13 16:16:11 user nova-compute[71731]:       <feature policy='require' name='stibp'/>
Apr 13 16:16:11 user nova-compute[71731]:       <feature policy='require' name='arch-capabilities'/>
Apr 13 16:16:11 user nova-compute[71731]:       <feature policy='require' name='ssbd'/>
Apr 13 16:16:11 user nova-compute[71731]:       <feature policy='require' name='ibpb'/>
Apr 13 16:16:11 user nova-compute[71731]:       <feature policy='require' name='ibrs'/>
Apr 13 16:16:11 user nova-compute[71731]:       <feature policy='require' name='amd-stibp'/>
Apr 13 16:16:11 user nova-compute[71731]:       <feature policy='require' name='amd-ssbd'/>
Apr 13 16:16:11 user nova-compute[71731]:       <feature policy='disable' name='erms'/>
Apr 13 16:16:11 user nova-compute[71731]:       <feature policy='disable' name='xsaveopt'/>
Apr 13 16:16:11 user nova-compute[71731]:       <feature policy='disable' name='lm'/>
Apr 13 16:16:11 user nova-compute[71731]:     </mode>
Apr 13 16:16:11 user nova-compute[71731]:     <mode name='custom' supported='yes'>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>qemu64</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='yes'>qemu32</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>phenom</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='yes'>pentium3</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='yes'>pentium2</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='yes'>pentium</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>n270</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>kvm64</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='yes'>kvm32</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='yes'>coreduo</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>core2duo</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>athlon</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>Westmere-IBRS</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>Westmere</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>Snowridge</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>Skylake-Server</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>Skylake-Client</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>SandyBridge</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>Penryn</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>Opteron_G5</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>Opteron_G4</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>Opteron_G3</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>Opteron_G2</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>Opteron_G1</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>Nehalem-IBRS</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>Nehalem</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>IvyBridge</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>Icelake-Server</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>Haswell-noTSX</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>Haswell-IBRS</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>Haswell</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>EPYC-Rome</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>EPYC-Milan</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>EPYC-IBPB</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>EPYC</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>Dhyana</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>Cooperlake</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>Conroe</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>Cascadelake-Server</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>Broadwell-noTSX</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>Broadwell-IBRS</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>Broadwell</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='yes'>486</model>
Apr 13 16:16:11 user nova-compute[71731]:     </mode>
Apr 13 16:16:11 user nova-compute[71731]:   </cpu>
Apr 13 16:16:11 user nova-compute[71731]:   <memoryBacking supported='yes'>
Apr 13 16:16:11 user nova-compute[71731]:     <enum name='sourceType'>
Apr 13 16:16:11 user nova-compute[71731]:       <value>file</value>
Apr 13 16:16:11 user nova-compute[71731]:       <value>anonymous</value>
Apr 13 16:16:11 user nova-compute[71731]:       <value>memfd</value>
Apr 13 16:16:11 user nova-compute[71731]:     </enum>
Apr 13 16:16:11 user nova-compute[71731]:   </memoryBacking>
Apr 13 16:16:11 user nova-compute[71731]:   <devices>
Apr 13 16:16:11 user nova-compute[71731]:     <disk supported='yes'>
Apr 13 16:16:11 user nova-compute[71731]:       <enum name='diskDevice'>
Apr 13 16:16:11 user nova-compute[71731]:         <value>disk</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>cdrom</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>floppy</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>lun</value>
Apr 13 16:16:11 user nova-compute[71731]:       </enum>
Apr 13 16:16:11 user nova-compute[71731]:       <enum name='bus'>
Apr 13 16:16:11 user nova-compute[71731]:         <value>ide</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>fdc</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>scsi</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>virtio</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>usb</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>sata</value>
Apr 13 16:16:11 user nova-compute[71731]:       </enum>
Apr 13 16:16:11 user nova-compute[71731]:       <enum name='model'>
Apr 13 16:16:11 user nova-compute[71731]:         <value>virtio</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>virtio-transitional</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>virtio-non-transitional</value>
Apr 13 16:16:11 user nova-compute[71731]:       </enum>
Apr 13 16:16:11 user nova-compute[71731]:     </disk>
Apr 13 16:16:11 user nova-compute[71731]:     <graphics supported='yes'>
Apr 13 16:16:11 user nova-compute[71731]:       <enum name='type'>
Apr 13 16:16:11 user nova-compute[71731]:         <value>sdl</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>vnc</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>spice</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>egl-headless</value>
Apr 13 16:16:11 user nova-compute[71731]:       </enum>
Apr 13 16:16:11 user nova-compute[71731]:     </graphics>
Apr 13 16:16:11 user nova-compute[71731]:     <video supported='yes'>
Apr 13 16:16:11 user nova-compute[71731]:       <enum name='modelType'>
Apr 13 16:16:11 user nova-compute[71731]:         <value>vga</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>cirrus</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>vmvga</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>qxl</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>virtio</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>none</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>bochs</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>ramfb</value>
Apr 13 16:16:11 user nova-compute[71731]:       </enum>
Apr 13 16:16:11 user nova-compute[71731]:     </video>
Apr 13 16:16:11 user nova-compute[71731]:     <hostdev supported='yes'>
Apr 13 16:16:11 user nova-compute[71731]:       <enum name='mode'>
Apr 13 16:16:11 user nova-compute[71731]:         <value>subsystem</value>
Apr 13 16:16:11 user nova-compute[71731]:       </enum>
Apr 13 16:16:11 user nova-compute[71731]:       <enum name='startupPolicy'>
Apr 13 16:16:11 user nova-compute[71731]:         <value>default</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>mandatory</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>requisite</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>optional</value>
Apr 13 16:16:11 user nova-compute[71731]:       </enum>
Apr 13 16:16:11 user nova-compute[71731]:       <enum name='subsysType'>
Apr 13 16:16:11 user nova-compute[71731]:         <value>usb</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>pci</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>scsi</value>
Apr 13 16:16:11 user nova-compute[71731]:       </enum>
Apr 13 16:16:11 user nova-compute[71731]:       <enum name='capsType'/>
Apr 13 16:16:11 user nova-compute[71731]:       <enum name='pciBackend'/>
Apr 13 16:16:11 user nova-compute[71731]:     </hostdev>
Apr 13 16:16:11 user nova-compute[71731]:     <rng supported='yes'>
Apr 13 16:16:11 user nova-compute[71731]:       <enum name='model'>
Apr 13 16:16:11 user nova-compute[71731]:         <value>virtio</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>virtio-transitional</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>virtio-non-transitional</value>
Apr 13 16:16:11 user nova-compute[71731]:       </enum>
Apr 13 16:16:11 user nova-compute[71731]:       <enum name='backendModel'>
Apr 13 16:16:11 user nova-compute[71731]:         <value>random</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>egd</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>builtin</value>
Apr 13 16:16:11 user nova-compute[71731]:       </enum>
Apr 13 16:16:11 user nova-compute[71731]:     </rng>
Apr 13 16:16:11 user nova-compute[71731]:     <filesystem supported='yes'>
Apr 13 16:16:11 user nova-compute[71731]:       <enum name='driverType'>
Apr 13 16:16:11 user nova-compute[71731]:         <value>path</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>handle</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>virtiofs</value>
Apr 13 16:16:11 user nova-compute[71731]:       </enum>
Apr 13 16:16:11 user nova-compute[71731]:     </filesystem>
Apr 13 16:16:11 user nova-compute[71731]:     <tpm supported='yes'>
Apr 13 16:16:11 user nova-compute[71731]:       <enum name='model'>
Apr 13 16:16:11 user nova-compute[71731]:         <value>tpm-tis</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>tpm-crb</value>
Apr 13 16:16:11 user nova-compute[71731]:       </enum>
Apr 13 16:16:11 user nova-compute[71731]:       <enum name='backendModel'>
Apr 13 16:16:11 user nova-compute[71731]:         <value>passthrough</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>emulator</value>
Apr 13 16:16:11 user nova-compute[71731]:       </enum>
Apr 13 16:16:11 user nova-compute[71731]:     </tpm>
Apr 13 16:16:11 user nova-compute[71731]:   </devices>
Apr 13 16:16:11 user nova-compute[71731]:   <features>
Apr 13 16:16:11 user nova-compute[71731]:     <gic supported='no'/>
Apr 13 16:16:11 user nova-compute[71731]:     <vmcoreinfo supported='yes'/>
Apr 13 16:16:11 user nova-compute[71731]:     <genid supported='yes'/>
Apr 13 16:16:11 user nova-compute[71731]:     <backingStoreInput supported='yes'/>
Apr 13 16:16:11 user nova-compute[71731]:     <backup supported='yes'/>
Apr 13 16:16:11 user nova-compute[71731]:     <sev supported='no'/>
Apr 13 16:16:11 user nova-compute[71731]:   </features>
Apr 13 16:16:11 user nova-compute[71731]: </domainCapabilities>
Apr 13 16:16:11 user nova-compute[71731]:  {{(pid=71731) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 13 16:16:11 user nova-compute[71731]: DEBUG nova.virt.libvirt.host [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=71731) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 13 16:16:11 user nova-compute[71731]: DEBUG nova.virt.libvirt.host [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=71731) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 13 16:16:11 user nova-compute[71731]: DEBUG nova.virt.libvirt.host [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=71731) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 13 16:16:11 user nova-compute[71731]: DEBUG nova.virt.libvirt.host [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=71731) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 13 16:16:11 user nova-compute[71731]: DEBUG nova.virt.libvirt.host [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=71731) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 13 16:16:11 user nova-compute[71731]: DEBUG nova.virt.libvirt.host [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=71731) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 13 16:16:11 user nova-compute[71731]: DEBUG nova.virt.libvirt.host [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=71731) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 13 16:16:11 user nova-compute[71731]: DEBUG nova.virt.libvirt.host [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Getting domain capabilities for mips via machine types: {None} {{(pid=71731) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 13 16:16:11 user nova-compute[71731]: DEBUG nova.virt.libvirt.host [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=71731) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 13 16:16:11 user nova-compute[71731]: DEBUG nova.virt.libvirt.host [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=71731) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 13 16:16:11 user nova-compute[71731]: DEBUG nova.virt.libvirt.host [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=71731) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 13 16:16:11 user nova-compute[71731]: DEBUG nova.virt.libvirt.host [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=71731) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 13 16:16:11 user nova-compute[71731]: DEBUG nova.virt.libvirt.host [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=71731) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 13 16:16:11 user nova-compute[71731]: DEBUG nova.virt.libvirt.host [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=71731) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 13 16:16:11 user nova-compute[71731]: DEBUG nova.virt.libvirt.host [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=71731) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 13 16:16:11 user nova-compute[71731]: DEBUG nova.virt.libvirt.host [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=71731) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 13 16:16:11 user nova-compute[71731]: DEBUG nova.virt.libvirt.host [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=71731) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 13 16:16:11 user nova-compute[71731]: DEBUG nova.virt.libvirt.host [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Getting domain capabilities for ppc64 via machine types: {'pseries', 'powernv', None} {{(pid=71731) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 13 16:16:11 user nova-compute[71731]: DEBUG nova.virt.libvirt.host [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=71731) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 13 16:16:11 user nova-compute[71731]: DEBUG nova.virt.libvirt.host [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=71731) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 13 16:16:11 user nova-compute[71731]: DEBUG nova.virt.libvirt.host [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=71731) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 13 16:16:11 user nova-compute[71731]: DEBUG nova.virt.libvirt.host [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Getting domain capabilities for ppc64le via machine types: {'pseries', 'powernv'} {{(pid=71731) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 13 16:16:11 user nova-compute[71731]: DEBUG nova.virt.libvirt.host [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=71731) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 13 16:16:11 user nova-compute[71731]: DEBUG nova.virt.libvirt.host [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=71731) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 13 16:16:11 user nova-compute[71731]: DEBUG nova.virt.libvirt.host [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=71731) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 13 16:16:11 user nova-compute[71731]: DEBUG nova.virt.libvirt.host [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=71731) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 13 16:16:11 user nova-compute[71731]: DEBUG nova.virt.libvirt.host [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=71731) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 13 16:16:11 user nova-compute[71731]: DEBUG nova.virt.libvirt.host [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=71731) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 13 16:16:11 user nova-compute[71731]: DEBUG nova.virt.libvirt.host [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=71731) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 13 16:16:11 user nova-compute[71731]: DEBUG nova.virt.libvirt.host [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=71731) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 13 16:16:11 user nova-compute[71731]: DEBUG nova.virt.libvirt.host [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=71731) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 13 16:16:11 user nova-compute[71731]: DEBUG nova.virt.libvirt.host [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=71731) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 13 16:16:11 user nova-compute[71731]: DEBUG nova.virt.libvirt.host [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=71731) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 13 16:16:11 user nova-compute[71731]: DEBUG nova.virt.libvirt.host [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=71731) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 13 16:16:11 user nova-compute[71731]: DEBUG nova.virt.libvirt.host [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=71731) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 13 16:16:11 user nova-compute[71731]: DEBUG nova.virt.libvirt.host [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=71731) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 13 16:16:11 user nova-compute[71731]: DEBUG nova.virt.libvirt.host [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=71731) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 13 16:16:11 user nova-compute[71731]: DEBUG nova.virt.libvirt.host [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=71731) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 13 16:16:11 user nova-compute[71731]: DEBUG nova.virt.libvirt.host [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Getting domain capabilities for x86_64 via machine types: {'ubuntu', 'ubuntu-q35', 'q35', 'pc'} {{(pid=71731) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 13 16:16:11 user nova-compute[71731]: DEBUG nova.virt.libvirt.host [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Apr 13 16:16:11 user nova-compute[71731]: <domainCapabilities>
Apr 13 16:16:11 user nova-compute[71731]:   <path>/usr/bin/qemu-system-x86_64</path>
Apr 13 16:16:11 user nova-compute[71731]:   <domain>kvm</domain>
Apr 13 16:16:11 user nova-compute[71731]:   <machine>pc-i440fx-jammy</machine>
Apr 13 16:16:11 user nova-compute[71731]:   <arch>x86_64</arch>
Apr 13 16:16:11 user nova-compute[71731]:   <vcpu max='255'/>
Apr 13 16:16:11 user nova-compute[71731]:   <iothreads supported='yes'/>
Apr 13 16:16:11 user nova-compute[71731]:   <os supported='yes'>
Apr 13 16:16:11 user nova-compute[71731]:     <enum name='firmware'>
Apr 13 16:16:11 user nova-compute[71731]:       <value>efi</value>
Apr 13 16:16:11 user nova-compute[71731]:     </enum>
Apr 13 16:16:11 user nova-compute[71731]:     <loader supported='yes'>
Apr 13 16:16:11 user nova-compute[71731]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Apr 13 16:16:11 user nova-compute[71731]:       <enum name='type'>
Apr 13 16:16:11 user nova-compute[71731]:         <value>rom</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>pflash</value>
Apr 13 16:16:11 user nova-compute[71731]:       </enum>
Apr 13 16:16:11 user nova-compute[71731]:       <enum name='readonly'>
Apr 13 16:16:11 user nova-compute[71731]:         <value>yes</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>no</value>
Apr 13 16:16:11 user nova-compute[71731]:       </enum>
Apr 13 16:16:11 user nova-compute[71731]:       <enum name='secure'>
Apr 13 16:16:11 user nova-compute[71731]:         <value>no</value>
Apr 13 16:16:11 user nova-compute[71731]:       </enum>
Apr 13 16:16:11 user nova-compute[71731]:     </loader>
Apr 13 16:16:11 user nova-compute[71731]:   </os>
Apr 13 16:16:11 user nova-compute[71731]:   <cpu>
Apr 13 16:16:11 user nova-compute[71731]:     <mode name='host-passthrough' supported='yes'>
Apr 13 16:16:11 user nova-compute[71731]:       <enum name='hostPassthroughMigratable'>
Apr 13 16:16:11 user nova-compute[71731]:         <value>on</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>off</value>
Apr 13 16:16:11 user nova-compute[71731]:       </enum>
Apr 13 16:16:11 user nova-compute[71731]:     </mode>
Apr 13 16:16:11 user nova-compute[71731]:     <mode name='maximum' supported='yes'>
Apr 13 16:16:11 user nova-compute[71731]:       <enum name='maximumMigratable'>
Apr 13 16:16:11 user nova-compute[71731]:         <value>on</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>off</value>
Apr 13 16:16:11 user nova-compute[71731]:       </enum>
Apr 13 16:16:11 user nova-compute[71731]:     </mode>
Apr 13 16:16:11 user nova-compute[71731]:     <mode name='host-model' supported='yes'>
Apr 13 16:16:11 user nova-compute[71731]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 13 16:16:11 user nova-compute[71731]:       <vendor>Intel</vendor>
Apr 13 16:16:11 user nova-compute[71731]:       <feature policy='require' name='ss'/>
Apr 13 16:16:11 user nova-compute[71731]:       <feature policy='require' name='vmx'/>
Apr 13 16:16:11 user nova-compute[71731]:       <feature policy='require' name='pcid'/>
Apr 13 16:16:11 user nova-compute[71731]:       <feature policy='require' name='hypervisor'/>
Apr 13 16:16:11 user nova-compute[71731]:       <feature policy='require' name='arat'/>
Apr 13 16:16:11 user nova-compute[71731]:       <feature policy='require' name='tsc_adjust'/>
Apr 13 16:16:11 user nova-compute[71731]:       <feature policy='require' name='umip'/>
Apr 13 16:16:11 user nova-compute[71731]:       <feature policy='require' name='md-clear'/>
Apr 13 16:16:11 user nova-compute[71731]:       <feature policy='require' name='stibp'/>
Apr 13 16:16:11 user nova-compute[71731]:       <feature policy='require' name='arch-capabilities'/>
Apr 13 16:16:11 user nova-compute[71731]:       <feature policy='require' name='ssbd'/>
Apr 13 16:16:11 user nova-compute[71731]:       <feature policy='require' name='invtsc'/>
Apr 13 16:16:11 user nova-compute[71731]:       <feature policy='require' name='ibpb'/>
Apr 13 16:16:11 user nova-compute[71731]:       <feature policy='require' name='ibrs'/>
Apr 13 16:16:11 user nova-compute[71731]:       <feature policy='require' name='amd-stibp'/>
Apr 13 16:16:11 user nova-compute[71731]:       <feature policy='require' name='amd-ssbd'/>
Apr 13 16:16:11 user nova-compute[71731]:       <feature policy='require' name='rsba'/>
Apr 13 16:16:11 user nova-compute[71731]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Apr 13 16:16:11 user nova-compute[71731]:       <feature policy='require' name='pschange-mc-no'/>
Apr 13 16:16:11 user nova-compute[71731]:       <feature policy='disable' name='erms'/>
Apr 13 16:16:11 user nova-compute[71731]:       <feature policy='disable' name='xsaveopt'/>
Apr 13 16:16:11 user nova-compute[71731]:     </mode>
Apr 13 16:16:11 user nova-compute[71731]:     <mode name='custom' supported='yes'>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>qemu64</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='yes'>qemu32</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>phenom</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='yes'>pentium3</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='yes'>pentium2</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='yes'>pentium</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>n270</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='yes'>kvm64</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='yes'>kvm32</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='yes'>coreduo</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='yes'>core2duo</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>athlon</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='yes'>Westmere-IBRS</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='yes'>Westmere</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>Snowridge</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>Skylake-Server</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>Skylake-Client</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>SandyBridge</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='yes'>Penryn</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>Opteron_G5</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>Opteron_G4</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>Opteron_G3</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>Opteron_G2</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='yes'>Opteron_G1</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='yes'>Nehalem-IBRS</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='yes'>Nehalem</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>IvyBridge</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>Icelake-Server</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>Haswell-noTSX</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>Haswell-IBRS</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>Haswell</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>EPYC-Rome</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>EPYC-Milan</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>EPYC-IBPB</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>EPYC</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>Dhyana</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>Cooperlake</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='yes'>Conroe</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>Cascadelake-Server</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>Broadwell-noTSX</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>Broadwell-IBRS</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>Broadwell</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='yes'>486</model>
Apr 13 16:16:11 user nova-compute[71731]:     </mode>
Apr 13 16:16:11 user nova-compute[71731]:   </cpu>
Apr 13 16:16:11 user nova-compute[71731]:   <memoryBacking supported='yes'>
Apr 13 16:16:11 user nova-compute[71731]:     <enum name='sourceType'>
Apr 13 16:16:11 user nova-compute[71731]:       <value>file</value>
Apr 13 16:16:11 user nova-compute[71731]:       <value>anonymous</value>
Apr 13 16:16:11 user nova-compute[71731]:       <value>memfd</value>
Apr 13 16:16:11 user nova-compute[71731]:     </enum>
Apr 13 16:16:11 user nova-compute[71731]:   </memoryBacking>
Apr 13 16:16:11 user nova-compute[71731]:   <devices>
Apr 13 16:16:11 user nova-compute[71731]:     <disk supported='yes'>
Apr 13 16:16:11 user nova-compute[71731]:       <enum name='diskDevice'>
Apr 13 16:16:11 user nova-compute[71731]:         <value>disk</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>cdrom</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>floppy</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>lun</value>
Apr 13 16:16:11 user nova-compute[71731]:       </enum>
Apr 13 16:16:11 user nova-compute[71731]:       <enum name='bus'>
Apr 13 16:16:11 user nova-compute[71731]:         <value>ide</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>fdc</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>scsi</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>virtio</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>usb</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>sata</value>
Apr 13 16:16:11 user nova-compute[71731]:       </enum>
Apr 13 16:16:11 user nova-compute[71731]:       <enum name='model'>
Apr 13 16:16:11 user nova-compute[71731]:         <value>virtio</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>virtio-transitional</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>virtio-non-transitional</value>
Apr 13 16:16:11 user nova-compute[71731]:       </enum>
Apr 13 16:16:11 user nova-compute[71731]:     </disk>
Apr 13 16:16:11 user nova-compute[71731]:     <graphics supported='yes'>
Apr 13 16:16:11 user nova-compute[71731]:       <enum name='type'>
Apr 13 16:16:11 user nova-compute[71731]:         <value>sdl</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>vnc</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>spice</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>egl-headless</value>
Apr 13 16:16:11 user nova-compute[71731]:       </enum>
Apr 13 16:16:11 user nova-compute[71731]:     </graphics>
Apr 13 16:16:11 user nova-compute[71731]:     <video supported='yes'>
Apr 13 16:16:11 user nova-compute[71731]:       <enum name='modelType'>
Apr 13 16:16:11 user nova-compute[71731]:         <value>vga</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>cirrus</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>vmvga</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>qxl</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>virtio</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>none</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>bochs</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>ramfb</value>
Apr 13 16:16:11 user nova-compute[71731]:       </enum>
Apr 13 16:16:11 user nova-compute[71731]:     </video>
Apr 13 16:16:11 user nova-compute[71731]:     <hostdev supported='yes'>
Apr 13 16:16:11 user nova-compute[71731]:       <enum name='mode'>
Apr 13 16:16:11 user nova-compute[71731]:         <value>subsystem</value>
Apr 13 16:16:11 user nova-compute[71731]:       </enum>
Apr 13 16:16:11 user nova-compute[71731]:       <enum name='startupPolicy'>
Apr 13 16:16:11 user nova-compute[71731]:         <value>default</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>mandatory</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>requisite</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>optional</value>
Apr 13 16:16:11 user nova-compute[71731]:       </enum>
Apr 13 16:16:11 user nova-compute[71731]:       <enum name='subsysType'>
Apr 13 16:16:11 user nova-compute[71731]:         <value>usb</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>pci</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>scsi</value>
Apr 13 16:16:11 user nova-compute[71731]:       </enum>
Apr 13 16:16:11 user nova-compute[71731]:       <enum name='capsType'/>
Apr 13 16:16:11 user nova-compute[71731]:       <enum name='pciBackend'/>
Apr 13 16:16:11 user nova-compute[71731]:     </hostdev>
Apr 13 16:16:11 user nova-compute[71731]:     <rng supported='yes'>
Apr 13 16:16:11 user nova-compute[71731]:       <enum name='model'>
Apr 13 16:16:11 user nova-compute[71731]:         <value>virtio</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>virtio-transitional</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>virtio-non-transitional</value>
Apr 13 16:16:11 user nova-compute[71731]:       </enum>
Apr 13 16:16:11 user nova-compute[71731]:       <enum name='backendModel'>
Apr 13 16:16:11 user nova-compute[71731]:         <value>random</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>egd</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>builtin</value>
Apr 13 16:16:11 user nova-compute[71731]:       </enum>
Apr 13 16:16:11 user nova-compute[71731]:     </rng>
Apr 13 16:16:11 user nova-compute[71731]:     <filesystem supported='yes'>
Apr 13 16:16:11 user nova-compute[71731]:       <enum name='driverType'>
Apr 13 16:16:11 user nova-compute[71731]:         <value>path</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>handle</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>virtiofs</value>
Apr 13 16:16:11 user nova-compute[71731]:       </enum>
Apr 13 16:16:11 user nova-compute[71731]:     </filesystem>
Apr 13 16:16:11 user nova-compute[71731]:     <tpm supported='yes'>
Apr 13 16:16:11 user nova-compute[71731]:       <enum name='model'>
Apr 13 16:16:11 user nova-compute[71731]:         <value>tpm-tis</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>tpm-crb</value>
Apr 13 16:16:11 user nova-compute[71731]:       </enum>
Apr 13 16:16:11 user nova-compute[71731]:       <enum name='backendModel'>
Apr 13 16:16:11 user nova-compute[71731]:         <value>passthrough</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>emulator</value>
Apr 13 16:16:11 user nova-compute[71731]:       </enum>
Apr 13 16:16:11 user nova-compute[71731]:     </tpm>
Apr 13 16:16:11 user nova-compute[71731]:   </devices>
Apr 13 16:16:11 user nova-compute[71731]:   <features>
Apr 13 16:16:11 user nova-compute[71731]:     <gic supported='no'/>
Apr 13 16:16:11 user nova-compute[71731]:     <vmcoreinfo supported='yes'/>
Apr 13 16:16:11 user nova-compute[71731]:     <genid supported='yes'/>
Apr 13 16:16:11 user nova-compute[71731]:     <backingStoreInput supported='yes'/>
Apr 13 16:16:11 user nova-compute[71731]:     <backup supported='yes'/>
Apr 13 16:16:11 user nova-compute[71731]:     <sev supported='no'/>
Apr 13 16:16:11 user nova-compute[71731]:   </features>
Apr 13 16:16:11 user nova-compute[71731]: </domainCapabilities>
Apr 13 16:16:11 user nova-compute[71731]:  {{(pid=71731) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 13 16:16:11 user nova-compute[71731]: DEBUG nova.virt.libvirt.host [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Apr 13 16:16:11 user nova-compute[71731]: <domainCapabilities>
Apr 13 16:16:11 user nova-compute[71731]:   <path>/usr/bin/qemu-system-x86_64</path>
Apr 13 16:16:11 user nova-compute[71731]:   <domain>kvm</domain>
Apr 13 16:16:11 user nova-compute[71731]:   <machine>pc-q35-jammy</machine>
Apr 13 16:16:11 user nova-compute[71731]:   <arch>x86_64</arch>
Apr 13 16:16:11 user nova-compute[71731]:   <vcpu max='288'/>
Apr 13 16:16:11 user nova-compute[71731]:   <iothreads supported='yes'/>
Apr 13 16:16:11 user nova-compute[71731]:   <os supported='yes'>
Apr 13 16:16:11 user nova-compute[71731]:     <enum name='firmware'>
Apr 13 16:16:11 user nova-compute[71731]:       <value>efi</value>
Apr 13 16:16:11 user nova-compute[71731]:     </enum>
Apr 13 16:16:11 user nova-compute[71731]:     <loader supported='yes'>
Apr 13 16:16:11 user nova-compute[71731]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Apr 13 16:16:11 user nova-compute[71731]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Apr 13 16:16:11 user nova-compute[71731]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Apr 13 16:16:11 user nova-compute[71731]:       <enum name='type'>
Apr 13 16:16:11 user nova-compute[71731]:         <value>rom</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>pflash</value>
Apr 13 16:16:11 user nova-compute[71731]:       </enum>
Apr 13 16:16:11 user nova-compute[71731]:       <enum name='readonly'>
Apr 13 16:16:11 user nova-compute[71731]:         <value>yes</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>no</value>
Apr 13 16:16:11 user nova-compute[71731]:       </enum>
Apr 13 16:16:11 user nova-compute[71731]:       <enum name='secure'>
Apr 13 16:16:11 user nova-compute[71731]:         <value>yes</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>no</value>
Apr 13 16:16:11 user nova-compute[71731]:       </enum>
Apr 13 16:16:11 user nova-compute[71731]:     </loader>
Apr 13 16:16:11 user nova-compute[71731]:   </os>
Apr 13 16:16:11 user nova-compute[71731]:   <cpu>
Apr 13 16:16:11 user nova-compute[71731]:     <mode name='host-passthrough' supported='yes'>
Apr 13 16:16:11 user nova-compute[71731]:       <enum name='hostPassthroughMigratable'>
Apr 13 16:16:11 user nova-compute[71731]:         <value>on</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>off</value>
Apr 13 16:16:11 user nova-compute[71731]:       </enum>
Apr 13 16:16:11 user nova-compute[71731]:     </mode>
Apr 13 16:16:11 user nova-compute[71731]:     <mode name='maximum' supported='yes'>
Apr 13 16:16:11 user nova-compute[71731]:       <enum name='maximumMigratable'>
Apr 13 16:16:11 user nova-compute[71731]:         <value>on</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>off</value>
Apr 13 16:16:11 user nova-compute[71731]:       </enum>
Apr 13 16:16:11 user nova-compute[71731]:     </mode>
Apr 13 16:16:11 user nova-compute[71731]:     <mode name='host-model' supported='yes'>
Apr 13 16:16:11 user nova-compute[71731]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 13 16:16:11 user nova-compute[71731]:       <vendor>Intel</vendor>
Apr 13 16:16:11 user nova-compute[71731]:       <feature policy='require' name='ss'/>
Apr 13 16:16:11 user nova-compute[71731]:       <feature policy='require' name='vmx'/>
Apr 13 16:16:11 user nova-compute[71731]:       <feature policy='require' name='pcid'/>
Apr 13 16:16:11 user nova-compute[71731]:       <feature policy='require' name='hypervisor'/>
Apr 13 16:16:11 user nova-compute[71731]:       <feature policy='require' name='arat'/>
Apr 13 16:16:11 user nova-compute[71731]:       <feature policy='require' name='tsc_adjust'/>
Apr 13 16:16:11 user nova-compute[71731]:       <feature policy='require' name='umip'/>
Apr 13 16:16:11 user nova-compute[71731]:       <feature policy='require' name='md-clear'/>
Apr 13 16:16:11 user nova-compute[71731]:       <feature policy='require' name='stibp'/>
Apr 13 16:16:11 user nova-compute[71731]:       <feature policy='require' name='arch-capabilities'/>
Apr 13 16:16:11 user nova-compute[71731]:       <feature policy='require' name='ssbd'/>
Apr 13 16:16:11 user nova-compute[71731]:       <feature policy='require' name='invtsc'/>
Apr 13 16:16:11 user nova-compute[71731]:       <feature policy='require' name='ibpb'/>
Apr 13 16:16:11 user nova-compute[71731]:       <feature policy='require' name='ibrs'/>
Apr 13 16:16:11 user nova-compute[71731]:       <feature policy='require' name='amd-stibp'/>
Apr 13 16:16:11 user nova-compute[71731]:       <feature policy='require' name='amd-ssbd'/>
Apr 13 16:16:11 user nova-compute[71731]:       <feature policy='require' name='rsba'/>
Apr 13 16:16:11 user nova-compute[71731]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Apr 13 16:16:11 user nova-compute[71731]:       <feature policy='require' name='pschange-mc-no'/>
Apr 13 16:16:11 user nova-compute[71731]:       <feature policy='disable' name='erms'/>
Apr 13 16:16:11 user nova-compute[71731]:       <feature policy='disable' name='xsaveopt'/>
Apr 13 16:16:11 user nova-compute[71731]:     </mode>
Apr 13 16:16:11 user nova-compute[71731]:     <mode name='custom' supported='yes'>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>qemu64</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='yes'>qemu32</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>phenom</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='yes'>pentium3</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='yes'>pentium2</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='yes'>pentium</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>n270</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='yes'>kvm64</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='yes'>kvm32</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='yes'>coreduo</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='yes'>core2duo</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>athlon</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='yes'>Westmere-IBRS</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='yes'>Westmere</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>Snowridge</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>Skylake-Server</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>Skylake-Client</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>SandyBridge</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='yes'>Penryn</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>Opteron_G5</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>Opteron_G4</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>Opteron_G3</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>Opteron_G2</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='yes'>Opteron_G1</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='yes'>Nehalem-IBRS</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='yes'>Nehalem</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>IvyBridge</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>Icelake-Server</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>Haswell-noTSX</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>Haswell-IBRS</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>Haswell</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>EPYC-Rome</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>EPYC-Milan</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>EPYC-IBPB</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>EPYC</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>Dhyana</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>Cooperlake</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='yes'>Conroe</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>Cascadelake-Server</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>Broadwell-noTSX</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>Broadwell-IBRS</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>Broadwell</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='yes'>486</model>
Apr 13 16:16:11 user nova-compute[71731]:     </mode>
Apr 13 16:16:11 user nova-compute[71731]:   </cpu>
Apr 13 16:16:11 user nova-compute[71731]:   <memoryBacking supported='yes'>
Apr 13 16:16:11 user nova-compute[71731]:     <enum name='sourceType'>
Apr 13 16:16:11 user nova-compute[71731]:       <value>file</value>
Apr 13 16:16:11 user nova-compute[71731]:       <value>anonymous</value>
Apr 13 16:16:11 user nova-compute[71731]:       <value>memfd</value>
Apr 13 16:16:11 user nova-compute[71731]:     </enum>
Apr 13 16:16:11 user nova-compute[71731]:   </memoryBacking>
Apr 13 16:16:11 user nova-compute[71731]:   <devices>
Apr 13 16:16:11 user nova-compute[71731]:     <disk supported='yes'>
Apr 13 16:16:11 user nova-compute[71731]:       <enum name='diskDevice'>
Apr 13 16:16:11 user nova-compute[71731]:         <value>disk</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>cdrom</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>floppy</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>lun</value>
Apr 13 16:16:11 user nova-compute[71731]:       </enum>
Apr 13 16:16:11 user nova-compute[71731]:       <enum name='bus'>
Apr 13 16:16:11 user nova-compute[71731]:         <value>fdc</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>scsi</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>virtio</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>usb</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>sata</value>
Apr 13 16:16:11 user nova-compute[71731]:       </enum>
Apr 13 16:16:11 user nova-compute[71731]:       <enum name='model'>
Apr 13 16:16:11 user nova-compute[71731]:         <value>virtio</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>virtio-transitional</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>virtio-non-transitional</value>
Apr 13 16:16:11 user nova-compute[71731]:       </enum>
Apr 13 16:16:11 user nova-compute[71731]:     </disk>
Apr 13 16:16:11 user nova-compute[71731]:     <graphics supported='yes'>
Apr 13 16:16:11 user nova-compute[71731]:       <enum name='type'>
Apr 13 16:16:11 user nova-compute[71731]:         <value>sdl</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>vnc</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>spice</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>egl-headless</value>
Apr 13 16:16:11 user nova-compute[71731]:       </enum>
Apr 13 16:16:11 user nova-compute[71731]:     </graphics>
Apr 13 16:16:11 user nova-compute[71731]:     <video supported='yes'>
Apr 13 16:16:11 user nova-compute[71731]:       <enum name='modelType'>
Apr 13 16:16:11 user nova-compute[71731]:         <value>vga</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>cirrus</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>vmvga</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>qxl</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>virtio</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>none</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>bochs</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>ramfb</value>
Apr 13 16:16:11 user nova-compute[71731]:       </enum>
Apr 13 16:16:11 user nova-compute[71731]:     </video>
Apr 13 16:16:11 user nova-compute[71731]:     <hostdev supported='yes'>
Apr 13 16:16:11 user nova-compute[71731]:       <enum name='mode'>
Apr 13 16:16:11 user nova-compute[71731]:         <value>subsystem</value>
Apr 13 16:16:11 user nova-compute[71731]:       </enum>
Apr 13 16:16:11 user nova-compute[71731]:       <enum name='startupPolicy'>
Apr 13 16:16:11 user nova-compute[71731]:         <value>default</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>mandatory</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>requisite</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>optional</value>
Apr 13 16:16:11 user nova-compute[71731]:       </enum>
Apr 13 16:16:11 user nova-compute[71731]:       <enum name='subsysType'>
Apr 13 16:16:11 user nova-compute[71731]:         <value>usb</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>pci</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>scsi</value>
Apr 13 16:16:11 user nova-compute[71731]:       </enum>
Apr 13 16:16:11 user nova-compute[71731]:       <enum name='capsType'/>
Apr 13 16:16:11 user nova-compute[71731]:       <enum name='pciBackend'/>
Apr 13 16:16:11 user nova-compute[71731]:     </hostdev>
Apr 13 16:16:11 user nova-compute[71731]:     <rng supported='yes'>
Apr 13 16:16:11 user nova-compute[71731]:       <enum name='model'>
Apr 13 16:16:11 user nova-compute[71731]:         <value>virtio</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>virtio-transitional</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>virtio-non-transitional</value>
Apr 13 16:16:11 user nova-compute[71731]:       </enum>
Apr 13 16:16:11 user nova-compute[71731]:       <enum name='backendModel'>
Apr 13 16:16:11 user nova-compute[71731]:         <value>random</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>egd</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>builtin</value>
Apr 13 16:16:11 user nova-compute[71731]:       </enum>
Apr 13 16:16:11 user nova-compute[71731]:     </rng>
Apr 13 16:16:11 user nova-compute[71731]:     <filesystem supported='yes'>
Apr 13 16:16:11 user nova-compute[71731]:       <enum name='driverType'>
Apr 13 16:16:11 user nova-compute[71731]:         <value>path</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>handle</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>virtiofs</value>
Apr 13 16:16:11 user nova-compute[71731]:       </enum>
Apr 13 16:16:11 user nova-compute[71731]:     </filesystem>
Apr 13 16:16:11 user nova-compute[71731]:     <tpm supported='yes'>
Apr 13 16:16:11 user nova-compute[71731]:       <enum name='model'>
Apr 13 16:16:11 user nova-compute[71731]:         <value>tpm-tis</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>tpm-crb</value>
Apr 13 16:16:11 user nova-compute[71731]:       </enum>
Apr 13 16:16:11 user nova-compute[71731]:       <enum name='backendModel'>
Apr 13 16:16:11 user nova-compute[71731]:         <value>passthrough</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>emulator</value>
Apr 13 16:16:11 user nova-compute[71731]:       </enum>
Apr 13 16:16:11 user nova-compute[71731]:     </tpm>
Apr 13 16:16:11 user nova-compute[71731]:   </devices>
Apr 13 16:16:11 user nova-compute[71731]:   <features>
Apr 13 16:16:11 user nova-compute[71731]:     <gic supported='no'/>
Apr 13 16:16:11 user nova-compute[71731]:     <vmcoreinfo supported='yes'/>
Apr 13 16:16:11 user nova-compute[71731]:     <genid supported='yes'/>
Apr 13 16:16:11 user nova-compute[71731]:     <backingStoreInput supported='yes'/>
Apr 13 16:16:11 user nova-compute[71731]:     <backup supported='yes'/>
Apr 13 16:16:11 user nova-compute[71731]:     <sev supported='no'/>
Apr 13 16:16:11 user nova-compute[71731]:   </features>
Apr 13 16:16:11 user nova-compute[71731]: </domainCapabilities>
Apr 13 16:16:11 user nova-compute[71731]:  {{(pid=71731) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 13 16:16:11 user nova-compute[71731]: DEBUG nova.virt.libvirt.host [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Apr 13 16:16:11 user nova-compute[71731]: <domainCapabilities>
Apr 13 16:16:11 user nova-compute[71731]:   <path>/usr/bin/qemu-system-x86_64</path>
Apr 13 16:16:11 user nova-compute[71731]:   <domain>kvm</domain>
Apr 13 16:16:11 user nova-compute[71731]:   <machine>pc-q35-6.2</machine>
Apr 13 16:16:11 user nova-compute[71731]:   <arch>x86_64</arch>
Apr 13 16:16:11 user nova-compute[71731]:   <vcpu max='288'/>
Apr 13 16:16:11 user nova-compute[71731]:   <iothreads supported='yes'/>
Apr 13 16:16:11 user nova-compute[71731]:   <os supported='yes'>
Apr 13 16:16:11 user nova-compute[71731]:     <enum name='firmware'>
Apr 13 16:16:11 user nova-compute[71731]:       <value>efi</value>
Apr 13 16:16:11 user nova-compute[71731]:     </enum>
Apr 13 16:16:11 user nova-compute[71731]:     <loader supported='yes'>
Apr 13 16:16:11 user nova-compute[71731]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Apr 13 16:16:11 user nova-compute[71731]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Apr 13 16:16:11 user nova-compute[71731]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Apr 13 16:16:11 user nova-compute[71731]:       <enum name='type'>
Apr 13 16:16:11 user nova-compute[71731]:         <value>rom</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>pflash</value>
Apr 13 16:16:11 user nova-compute[71731]:       </enum>
Apr 13 16:16:11 user nova-compute[71731]:       <enum name='readonly'>
Apr 13 16:16:11 user nova-compute[71731]:         <value>yes</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>no</value>
Apr 13 16:16:11 user nova-compute[71731]:       </enum>
Apr 13 16:16:11 user nova-compute[71731]:       <enum name='secure'>
Apr 13 16:16:11 user nova-compute[71731]:         <value>yes</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>no</value>
Apr 13 16:16:11 user nova-compute[71731]:       </enum>
Apr 13 16:16:11 user nova-compute[71731]:     </loader>
Apr 13 16:16:11 user nova-compute[71731]:   </os>
Apr 13 16:16:11 user nova-compute[71731]:   <cpu>
Apr 13 16:16:11 user nova-compute[71731]:     <mode name='host-passthrough' supported='yes'>
Apr 13 16:16:11 user nova-compute[71731]:       <enum name='hostPassthroughMigratable'>
Apr 13 16:16:11 user nova-compute[71731]:         <value>on</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>off</value>
Apr 13 16:16:11 user nova-compute[71731]:       </enum>
Apr 13 16:16:11 user nova-compute[71731]:     </mode>
Apr 13 16:16:11 user nova-compute[71731]:     <mode name='maximum' supported='yes'>
Apr 13 16:16:11 user nova-compute[71731]:       <enum name='maximumMigratable'>
Apr 13 16:16:11 user nova-compute[71731]:         <value>on</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>off</value>
Apr 13 16:16:11 user nova-compute[71731]:       </enum>
Apr 13 16:16:11 user nova-compute[71731]:     </mode>
Apr 13 16:16:11 user nova-compute[71731]:     <mode name='host-model' supported='yes'>
Apr 13 16:16:11 user nova-compute[71731]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 13 16:16:11 user nova-compute[71731]:       <vendor>Intel</vendor>
Apr 13 16:16:11 user nova-compute[71731]:       <feature policy='require' name='ss'/>
Apr 13 16:16:11 user nova-compute[71731]:       <feature policy='require' name='vmx'/>
Apr 13 16:16:11 user nova-compute[71731]:       <feature policy='require' name='pcid'/>
Apr 13 16:16:11 user nova-compute[71731]:       <feature policy='require' name='hypervisor'/>
Apr 13 16:16:11 user nova-compute[71731]:       <feature policy='require' name='arat'/>
Apr 13 16:16:11 user nova-compute[71731]:       <feature policy='require' name='tsc_adjust'/>
Apr 13 16:16:11 user nova-compute[71731]:       <feature policy='require' name='umip'/>
Apr 13 16:16:11 user nova-compute[71731]:       <feature policy='require' name='md-clear'/>
Apr 13 16:16:11 user nova-compute[71731]:       <feature policy='require' name='stibp'/>
Apr 13 16:16:11 user nova-compute[71731]:       <feature policy='require' name='arch-capabilities'/>
Apr 13 16:16:11 user nova-compute[71731]:       <feature policy='require' name='ssbd'/>
Apr 13 16:16:11 user nova-compute[71731]:       <feature policy='require' name='invtsc'/>
Apr 13 16:16:11 user nova-compute[71731]:       <feature policy='require' name='ibpb'/>
Apr 13 16:16:11 user nova-compute[71731]:       <feature policy='require' name='ibrs'/>
Apr 13 16:16:11 user nova-compute[71731]:       <feature policy='require' name='amd-stibp'/>
Apr 13 16:16:11 user nova-compute[71731]:       <feature policy='require' name='amd-ssbd'/>
Apr 13 16:16:11 user nova-compute[71731]:       <feature policy='require' name='rsba'/>
Apr 13 16:16:11 user nova-compute[71731]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Apr 13 16:16:11 user nova-compute[71731]:       <feature policy='require' name='pschange-mc-no'/>
Apr 13 16:16:11 user nova-compute[71731]:       <feature policy='disable' name='erms'/>
Apr 13 16:16:11 user nova-compute[71731]:       <feature policy='disable' name='xsaveopt'/>
Apr 13 16:16:11 user nova-compute[71731]:     </mode>
Apr 13 16:16:11 user nova-compute[71731]:     <mode name='custom' supported='yes'>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>qemu64</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='yes'>qemu32</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>phenom</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='yes'>pentium3</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='yes'>pentium2</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='yes'>pentium</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>n270</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='yes'>kvm64</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='yes'>kvm32</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='yes'>coreduo</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='yes'>core2duo</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>athlon</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='yes'>Westmere-IBRS</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='yes'>Westmere</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>Snowridge</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>Skylake-Server</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>Skylake-Client</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>SandyBridge</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='yes'>Penryn</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>Opteron_G5</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>Opteron_G4</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>Opteron_G3</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>Opteron_G2</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='yes'>Opteron_G1</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='yes'>Nehalem-IBRS</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='yes'>Nehalem</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>IvyBridge</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>Icelake-Server</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>Haswell-noTSX</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>Haswell-IBRS</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>Haswell</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>EPYC-Rome</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>EPYC-Milan</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>EPYC-IBPB</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>EPYC</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>Dhyana</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>Cooperlake</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='yes'>Conroe</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>Cascadelake-Server</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>Broadwell-noTSX</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>Broadwell-IBRS</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>Broadwell</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='yes'>486</model>
Apr 13 16:16:11 user nova-compute[71731]:     </mode>
Apr 13 16:16:11 user nova-compute[71731]:   </cpu>
Apr 13 16:16:11 user nova-compute[71731]:   <memoryBacking supported='yes'>
Apr 13 16:16:11 user nova-compute[71731]:     <enum name='sourceType'>
Apr 13 16:16:11 user nova-compute[71731]:       <value>file</value>
Apr 13 16:16:11 user nova-compute[71731]:       <value>anonymous</value>
Apr 13 16:16:11 user nova-compute[71731]:       <value>memfd</value>
Apr 13 16:16:11 user nova-compute[71731]:     </enum>
Apr 13 16:16:11 user nova-compute[71731]:   </memoryBacking>
Apr 13 16:16:11 user nova-compute[71731]:   <devices>
Apr 13 16:16:11 user nova-compute[71731]:     <disk supported='yes'>
Apr 13 16:16:11 user nova-compute[71731]:       <enum name='diskDevice'>
Apr 13 16:16:11 user nova-compute[71731]:         <value>disk</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>cdrom</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>floppy</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>lun</value>
Apr 13 16:16:11 user nova-compute[71731]:       </enum>
Apr 13 16:16:11 user nova-compute[71731]:       <enum name='bus'>
Apr 13 16:16:11 user nova-compute[71731]:         <value>fdc</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>scsi</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>virtio</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>usb</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>sata</value>
Apr 13 16:16:11 user nova-compute[71731]:       </enum>
Apr 13 16:16:11 user nova-compute[71731]:       <enum name='model'>
Apr 13 16:16:11 user nova-compute[71731]:         <value>virtio</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>virtio-transitional</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>virtio-non-transitional</value>
Apr 13 16:16:11 user nova-compute[71731]:       </enum>
Apr 13 16:16:11 user nova-compute[71731]:     </disk>
Apr 13 16:16:11 user nova-compute[71731]:     <graphics supported='yes'>
Apr 13 16:16:11 user nova-compute[71731]:       <enum name='type'>
Apr 13 16:16:11 user nova-compute[71731]:         <value>sdl</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>vnc</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>spice</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>egl-headless</value>
Apr 13 16:16:11 user nova-compute[71731]:       </enum>
Apr 13 16:16:11 user nova-compute[71731]:     </graphics>
Apr 13 16:16:11 user nova-compute[71731]:     <video supported='yes'>
Apr 13 16:16:11 user nova-compute[71731]:       <enum name='modelType'>
Apr 13 16:16:11 user nova-compute[71731]:         <value>vga</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>cirrus</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>vmvga</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>qxl</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>virtio</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>none</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>bochs</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>ramfb</value>
Apr 13 16:16:11 user nova-compute[71731]:       </enum>
Apr 13 16:16:11 user nova-compute[71731]:     </video>
Apr 13 16:16:11 user nova-compute[71731]:     <hostdev supported='yes'>
Apr 13 16:16:11 user nova-compute[71731]:       <enum name='mode'>
Apr 13 16:16:11 user nova-compute[71731]:         <value>subsystem</value>
Apr 13 16:16:11 user nova-compute[71731]:       </enum>
Apr 13 16:16:11 user nova-compute[71731]:       <enum name='startupPolicy'>
Apr 13 16:16:11 user nova-compute[71731]:         <value>default</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>mandatory</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>requisite</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>optional</value>
Apr 13 16:16:11 user nova-compute[71731]:       </enum>
Apr 13 16:16:11 user nova-compute[71731]:       <enum name='subsysType'>
Apr 13 16:16:11 user nova-compute[71731]:         <value>usb</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>pci</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>scsi</value>
Apr 13 16:16:11 user nova-compute[71731]:       </enum>
Apr 13 16:16:11 user nova-compute[71731]:       <enum name='capsType'/>
Apr 13 16:16:11 user nova-compute[71731]:       <enum name='pciBackend'/>
Apr 13 16:16:11 user nova-compute[71731]:     </hostdev>
Apr 13 16:16:11 user nova-compute[71731]:     <rng supported='yes'>
Apr 13 16:16:11 user nova-compute[71731]:       <enum name='model'>
Apr 13 16:16:11 user nova-compute[71731]:         <value>virtio</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>virtio-transitional</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>virtio-non-transitional</value>
Apr 13 16:16:11 user nova-compute[71731]:       </enum>
Apr 13 16:16:11 user nova-compute[71731]:       <enum name='backendModel'>
Apr 13 16:16:11 user nova-compute[71731]:         <value>random</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>egd</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>builtin</value>
Apr 13 16:16:11 user nova-compute[71731]:       </enum>
Apr 13 16:16:11 user nova-compute[71731]:     </rng>
Apr 13 16:16:11 user nova-compute[71731]:     <filesystem supported='yes'>
Apr 13 16:16:11 user nova-compute[71731]:       <enum name='driverType'>
Apr 13 16:16:11 user nova-compute[71731]:         <value>path</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>handle</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>virtiofs</value>
Apr 13 16:16:11 user nova-compute[71731]:       </enum>
Apr 13 16:16:11 user nova-compute[71731]:     </filesystem>
Apr 13 16:16:11 user nova-compute[71731]:     <tpm supported='yes'>
Apr 13 16:16:11 user nova-compute[71731]:       <enum name='model'>
Apr 13 16:16:11 user nova-compute[71731]:         <value>tpm-tis</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>tpm-crb</value>
Apr 13 16:16:11 user nova-compute[71731]:       </enum>
Apr 13 16:16:11 user nova-compute[71731]:       <enum name='backendModel'>
Apr 13 16:16:11 user nova-compute[71731]:         <value>passthrough</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>emulator</value>
Apr 13 16:16:11 user nova-compute[71731]:       </enum>
Apr 13 16:16:11 user nova-compute[71731]:     </tpm>
Apr 13 16:16:11 user nova-compute[71731]:   </devices>
Apr 13 16:16:11 user nova-compute[71731]:   <features>
Apr 13 16:16:11 user nova-compute[71731]:     <gic supported='no'/>
Apr 13 16:16:11 user nova-compute[71731]:     <vmcoreinfo supported='yes'/>
Apr 13 16:16:11 user nova-compute[71731]:     <genid supported='yes'/>
Apr 13 16:16:11 user nova-compute[71731]:     <backingStoreInput supported='yes'/>
Apr 13 16:16:11 user nova-compute[71731]:     <backup supported='yes'/>
Apr 13 16:16:11 user nova-compute[71731]:     <sev supported='no'/>
Apr 13 16:16:11 user nova-compute[71731]:   </features>
Apr 13 16:16:11 user nova-compute[71731]: </domainCapabilities>
Apr 13 16:16:11 user nova-compute[71731]:  {{(pid=71731) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 13 16:16:11 user nova-compute[71731]: DEBUG nova.virt.libvirt.host [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Apr 13 16:16:11 user nova-compute[71731]: <domainCapabilities>
Apr 13 16:16:11 user nova-compute[71731]:   <path>/usr/bin/qemu-system-x86_64</path>
Apr 13 16:16:11 user nova-compute[71731]:   <domain>kvm</domain>
Apr 13 16:16:11 user nova-compute[71731]:   <machine>pc-i440fx-6.2</machine>
Apr 13 16:16:11 user nova-compute[71731]:   <arch>x86_64</arch>
Apr 13 16:16:11 user nova-compute[71731]:   <vcpu max='255'/>
Apr 13 16:16:11 user nova-compute[71731]:   <iothreads supported='yes'/>
Apr 13 16:16:11 user nova-compute[71731]:   <os supported='yes'>
Apr 13 16:16:11 user nova-compute[71731]:     <enum name='firmware'>
Apr 13 16:16:11 user nova-compute[71731]:       <value>efi</value>
Apr 13 16:16:11 user nova-compute[71731]:     </enum>
Apr 13 16:16:11 user nova-compute[71731]:     <loader supported='yes'>
Apr 13 16:16:11 user nova-compute[71731]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Apr 13 16:16:11 user nova-compute[71731]:       <enum name='type'>
Apr 13 16:16:11 user nova-compute[71731]:         <value>rom</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>pflash</value>
Apr 13 16:16:11 user nova-compute[71731]:       </enum>
Apr 13 16:16:11 user nova-compute[71731]:       <enum name='readonly'>
Apr 13 16:16:11 user nova-compute[71731]:         <value>yes</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>no</value>
Apr 13 16:16:11 user nova-compute[71731]:       </enum>
Apr 13 16:16:11 user nova-compute[71731]:       <enum name='secure'>
Apr 13 16:16:11 user nova-compute[71731]:         <value>no</value>
Apr 13 16:16:11 user nova-compute[71731]:       </enum>
Apr 13 16:16:11 user nova-compute[71731]:     </loader>
Apr 13 16:16:11 user nova-compute[71731]:   </os>
Apr 13 16:16:11 user nova-compute[71731]:   <cpu>
Apr 13 16:16:11 user nova-compute[71731]:     <mode name='host-passthrough' supported='yes'>
Apr 13 16:16:11 user nova-compute[71731]:       <enum name='hostPassthroughMigratable'>
Apr 13 16:16:11 user nova-compute[71731]:         <value>on</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>off</value>
Apr 13 16:16:11 user nova-compute[71731]:       </enum>
Apr 13 16:16:11 user nova-compute[71731]:     </mode>
Apr 13 16:16:11 user nova-compute[71731]:     <mode name='maximum' supported='yes'>
Apr 13 16:16:11 user nova-compute[71731]:       <enum name='maximumMigratable'>
Apr 13 16:16:11 user nova-compute[71731]:         <value>on</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>off</value>
Apr 13 16:16:11 user nova-compute[71731]:       </enum>
Apr 13 16:16:11 user nova-compute[71731]:     </mode>
Apr 13 16:16:11 user nova-compute[71731]:     <mode name='host-model' supported='yes'>
Apr 13 16:16:11 user nova-compute[71731]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 13 16:16:11 user nova-compute[71731]:       <vendor>Intel</vendor>
Apr 13 16:16:11 user nova-compute[71731]:       <feature policy='require' name='ss'/>
Apr 13 16:16:11 user nova-compute[71731]:       <feature policy='require' name='vmx'/>
Apr 13 16:16:11 user nova-compute[71731]:       <feature policy='require' name='pcid'/>
Apr 13 16:16:11 user nova-compute[71731]:       <feature policy='require' name='hypervisor'/>
Apr 13 16:16:11 user nova-compute[71731]:       <feature policy='require' name='arat'/>
Apr 13 16:16:11 user nova-compute[71731]:       <feature policy='require' name='tsc_adjust'/>
Apr 13 16:16:11 user nova-compute[71731]:       <feature policy='require' name='umip'/>
Apr 13 16:16:11 user nova-compute[71731]:       <feature policy='require' name='md-clear'/>
Apr 13 16:16:11 user nova-compute[71731]:       <feature policy='require' name='stibp'/>
Apr 13 16:16:11 user nova-compute[71731]:       <feature policy='require' name='arch-capabilities'/>
Apr 13 16:16:11 user nova-compute[71731]:       <feature policy='require' name='ssbd'/>
Apr 13 16:16:11 user nova-compute[71731]:       <feature policy='require' name='invtsc'/>
Apr 13 16:16:11 user nova-compute[71731]:       <feature policy='require' name='ibpb'/>
Apr 13 16:16:11 user nova-compute[71731]:       <feature policy='require' name='ibrs'/>
Apr 13 16:16:11 user nova-compute[71731]:       <feature policy='require' name='amd-stibp'/>
Apr 13 16:16:11 user nova-compute[71731]:       <feature policy='require' name='amd-ssbd'/>
Apr 13 16:16:11 user nova-compute[71731]:       <feature policy='require' name='rsba'/>
Apr 13 16:16:11 user nova-compute[71731]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Apr 13 16:16:11 user nova-compute[71731]:       <feature policy='require' name='pschange-mc-no'/>
Apr 13 16:16:11 user nova-compute[71731]:       <feature policy='disable' name='erms'/>
Apr 13 16:16:11 user nova-compute[71731]:       <feature policy='disable' name='xsaveopt'/>
Apr 13 16:16:11 user nova-compute[71731]:     </mode>
Apr 13 16:16:11 user nova-compute[71731]:     <mode name='custom' supported='yes'>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>qemu64</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='yes'>qemu32</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>phenom</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='yes'>pentium3</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='yes'>pentium2</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='yes'>pentium</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>n270</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='yes'>kvm64</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='yes'>kvm32</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='yes'>coreduo</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='yes'>core2duo</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>athlon</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='yes'>Westmere-IBRS</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='yes'>Westmere</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>Snowridge</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>Skylake-Server</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>Skylake-Client</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>SandyBridge</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='yes'>Penryn</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>Opteron_G5</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>Opteron_G4</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>Opteron_G3</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>Opteron_G2</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='yes'>Opteron_G1</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='yes'>Nehalem-IBRS</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='yes'>Nehalem</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>IvyBridge</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>Icelake-Server</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>Haswell-noTSX</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>Haswell-IBRS</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>Haswell</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>EPYC-Rome</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>EPYC-Milan</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>EPYC-IBPB</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>EPYC</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>Dhyana</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>Cooperlake</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='yes'>Conroe</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>Cascadelake-Server</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>Broadwell-noTSX</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>Broadwell-IBRS</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='no'>Broadwell</model>
Apr 13 16:16:11 user nova-compute[71731]:       <model usable='yes'>486</model>
Apr 13 16:16:11 user nova-compute[71731]:     </mode>
Apr 13 16:16:11 user nova-compute[71731]:   </cpu>
Apr 13 16:16:11 user nova-compute[71731]:   <memoryBacking supported='yes'>
Apr 13 16:16:11 user nova-compute[71731]:     <enum name='sourceType'>
Apr 13 16:16:11 user nova-compute[71731]:       <value>file</value>
Apr 13 16:16:11 user nova-compute[71731]:       <value>anonymous</value>
Apr 13 16:16:11 user nova-compute[71731]:       <value>memfd</value>
Apr 13 16:16:11 user nova-compute[71731]:     </enum>
Apr 13 16:16:11 user nova-compute[71731]:   </memoryBacking>
Apr 13 16:16:11 user nova-compute[71731]:   <devices>
Apr 13 16:16:11 user nova-compute[71731]:     <disk supported='yes'>
Apr 13 16:16:11 user nova-compute[71731]:       <enum name='diskDevice'>
Apr 13 16:16:11 user nova-compute[71731]:         <value>disk</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>cdrom</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>floppy</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>lun</value>
Apr 13 16:16:11 user nova-compute[71731]:       </enum>
Apr 13 16:16:11 user nova-compute[71731]:       <enum name='bus'>
Apr 13 16:16:11 user nova-compute[71731]:         <value>ide</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>fdc</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>scsi</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>virtio</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>usb</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>sata</value>
Apr 13 16:16:11 user nova-compute[71731]:       </enum>
Apr 13 16:16:11 user nova-compute[71731]:       <enum name='model'>
Apr 13 16:16:11 user nova-compute[71731]:         <value>virtio</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>virtio-transitional</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>virtio-non-transitional</value>
Apr 13 16:16:11 user nova-compute[71731]:       </enum>
Apr 13 16:16:11 user nova-compute[71731]:     </disk>
Apr 13 16:16:11 user nova-compute[71731]:     <graphics supported='yes'>
Apr 13 16:16:11 user nova-compute[71731]:       <enum name='type'>
Apr 13 16:16:11 user nova-compute[71731]:         <value>sdl</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>vnc</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>spice</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>egl-headless</value>
Apr 13 16:16:11 user nova-compute[71731]:       </enum>
Apr 13 16:16:11 user nova-compute[71731]:     </graphics>
Apr 13 16:16:11 user nova-compute[71731]:     <video supported='yes'>
Apr 13 16:16:11 user nova-compute[71731]:       <enum name='modelType'>
Apr 13 16:16:11 user nova-compute[71731]:         <value>vga</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>cirrus</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>vmvga</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>qxl</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>virtio</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>none</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>bochs</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>ramfb</value>
Apr 13 16:16:11 user nova-compute[71731]:       </enum>
Apr 13 16:16:11 user nova-compute[71731]:     </video>
Apr 13 16:16:11 user nova-compute[71731]:     <hostdev supported='yes'>
Apr 13 16:16:11 user nova-compute[71731]:       <enum name='mode'>
Apr 13 16:16:11 user nova-compute[71731]:         <value>subsystem</value>
Apr 13 16:16:11 user nova-compute[71731]:       </enum>
Apr 13 16:16:11 user nova-compute[71731]:       <enum name='startupPolicy'>
Apr 13 16:16:11 user nova-compute[71731]:         <value>default</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>mandatory</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>requisite</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>optional</value>
Apr 13 16:16:11 user nova-compute[71731]:       </enum>
Apr 13 16:16:11 user nova-compute[71731]:       <enum name='subsysType'>
Apr 13 16:16:11 user nova-compute[71731]:         <value>usb</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>pci</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>scsi</value>
Apr 13 16:16:11 user nova-compute[71731]:       </enum>
Apr 13 16:16:11 user nova-compute[71731]:       <enum name='capsType'/>
Apr 13 16:16:11 user nova-compute[71731]:       <enum name='pciBackend'/>
Apr 13 16:16:11 user nova-compute[71731]:     </hostdev>
Apr 13 16:16:11 user nova-compute[71731]:     <rng supported='yes'>
Apr 13 16:16:11 user nova-compute[71731]:       <enum name='model'>
Apr 13 16:16:11 user nova-compute[71731]:         <value>virtio</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>virtio-transitional</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>virtio-non-transitional</value>
Apr 13 16:16:11 user nova-compute[71731]:       </enum>
Apr 13 16:16:11 user nova-compute[71731]:       <enum name='backendModel'>
Apr 13 16:16:11 user nova-compute[71731]:         <value>random</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>egd</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>builtin</value>
Apr 13 16:16:11 user nova-compute[71731]:       </enum>
Apr 13 16:16:11 user nova-compute[71731]:     </rng>
Apr 13 16:16:11 user nova-compute[71731]:     <filesystem supported='yes'>
Apr 13 16:16:11 user nova-compute[71731]:       <enum name='driverType'>
Apr 13 16:16:11 user nova-compute[71731]:         <value>path</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>handle</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>virtiofs</value>
Apr 13 16:16:11 user nova-compute[71731]:       </enum>
Apr 13 16:16:11 user nova-compute[71731]:     </filesystem>
Apr 13 16:16:11 user nova-compute[71731]:     <tpm supported='yes'>
Apr 13 16:16:11 user nova-compute[71731]:       <enum name='model'>
Apr 13 16:16:11 user nova-compute[71731]:         <value>tpm-tis</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>tpm-crb</value>
Apr 13 16:16:11 user nova-compute[71731]:       </enum>
Apr 13 16:16:11 user nova-compute[71731]:       <enum name='backendModel'>
Apr 13 16:16:11 user nova-compute[71731]:         <value>passthrough</value>
Apr 13 16:16:11 user nova-compute[71731]:         <value>emulator</value>
Apr 13 16:16:11 user nova-compute[71731]:       </enum>
Apr 13 16:16:11 user nova-compute[71731]:     </tpm>
Apr 13 16:16:11 user nova-compute[71731]:   </devices>
Apr 13 16:16:11 user nova-compute[71731]:   <features>
Apr 13 16:16:11 user nova-compute[71731]:     <gic supported='no'/>
Apr 13 16:16:11 user nova-compute[71731]:     <vmcoreinfo supported='yes'/>
Apr 13 16:16:11 user nova-compute[71731]:     <genid supported='yes'/>
Apr 13 16:16:11 user nova-compute[71731]:     <backingStoreInput supported='yes'/>
Apr 13 16:16:11 user nova-compute[71731]:     <backup supported='yes'/>
Apr 13 16:16:11 user nova-compute[71731]:     <sev supported='no'/>
Apr 13 16:16:11 user nova-compute[71731]:   </features>
Apr 13 16:16:11 user nova-compute[71731]: </domainCapabilities>
Apr 13 16:16:11 user nova-compute[71731]:  {{(pid=71731) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 13 16:16:11 user nova-compute[71731]: DEBUG nova.virt.libvirt.host [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=71731) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 13 16:16:11 user nova-compute[71731]: DEBUG nova.virt.libvirt.host [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=71731) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 13 16:16:11 user nova-compute[71731]: DEBUG nova.virt.libvirt.host [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=71731) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 13 16:16:11 user nova-compute[71731]: DEBUG nova.virt.libvirt.host [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=71731) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 13 16:16:11 user nova-compute[71731]: DEBUG nova.virt.libvirt.host [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Checking secure boot support for host arch (x86_64) {{(pid=71731) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1750}}
Apr 13 16:16:11 user nova-compute[71731]: DEBUG nova.virt.libvirt.host [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Checking secure boot support for host arch (x86_64) {{(pid=71731) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1750}}
Apr 13 16:16:11 user nova-compute[71731]: DEBUG nova.virt.libvirt.host [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Checking secure boot support for host arch (x86_64) {{(pid=71731) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1750}}
Apr 13 16:16:11 user nova-compute[71731]: INFO nova.virt.libvirt.host [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Secure Boot support detected
Apr 13 16:16:11 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] cpu compare xml: <cpu match="exact">
Apr 13 16:16:11 user nova-compute[71731]:   <model>Nehalem</model>
Apr 13 16:16:11 user nova-compute[71731]: </cpu>
Apr 13 16:16:11 user nova-compute[71731]:  {{(pid=71731) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:9996}}
Apr 13 16:16:11 user nova-compute[71731]: INFO nova.virt.node [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Generated node identity cb6b1a64-0c24-4e2d-af1e-16576ca9165c
Apr 13 16:16:11 user nova-compute[71731]: INFO nova.virt.node [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Wrote node identity cb6b1a64-0c24-4e2d-af1e-16576ca9165c to /opt/stack/data/nova/compute_id
Apr 13 16:16:11 user nova-compute[71731]: WARNING nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Compute nodes ['cb6b1a64-0c24-4e2d-af1e-16576ca9165c'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Apr 13 16:16:11 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Apr 13 16:16:11 user nova-compute[71731]: WARNING nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Apr 13 16:16:11 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:16:11 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:16:11 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:16:11 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Auditing locally available compute resources for user (node: user) {{(pid=71731) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 16:16:11 user nova-compute[71731]: WARNING nova.virt.libvirt.driver [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 16:16:11 user nova-compute[71731]: WARNING nova.virt.libvirt.driver [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 16:16:11 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Hypervisor/Node resource view: name=user free_ram=10809MB free_disk=27.000797271728516GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=71731) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 16:16:11 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:16:11 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:16:11 user nova-compute[71731]: WARNING nova.compute.resource_tracker [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] No compute node record for user:cb6b1a64-0c24-4e2d-af1e-16576ca9165c: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host cb6b1a64-0c24-4e2d-af1e-16576ca9165c could not be found.
Apr 13 16:16:11 user nova-compute[71731]: INFO nova.compute.resource_tracker [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Compute node record created for user:user with uuid: cb6b1a64-0c24-4e2d-af1e-16576ca9165c
Apr 13 16:16:11 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=71731) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 16:16:11 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=71731) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 16:16:12 user nova-compute[71731]: INFO nova.scheduler.client.report [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [req-d06c009d-3718-476c-9506-9b9d8a9f8234] Created resource provider record via placement API for resource provider with UUID cb6b1a64-0c24-4e2d-af1e-16576ca9165c and name user.
Apr 13 16:16:12 user nova-compute[71731]: DEBUG nova.virt.libvirt.host [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=71731) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1766}}
Apr 13 16:16:12 user nova-compute[71731]: INFO nova.virt.libvirt.host [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] kernel doesn't support AMD SEV
Apr 13 16:16:12 user nova-compute[71731]: DEBUG nova.compute.provider_tree [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Updating inventory in ProviderTree for provider cb6b1a64-0c24-4e2d-af1e-16576ca9165c with inventory: {'MEMORY_MB': {'total': 16023, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=71731) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 13 16:16:12 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71731) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 16:16:12 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Libvirt baseline CPU <cpu>
Apr 13 16:16:12 user nova-compute[71731]:   <arch>x86_64</arch>
Apr 13 16:16:12 user nova-compute[71731]:   <model>Nehalem</model>
Apr 13 16:16:12 user nova-compute[71731]:   <vendor>Intel</vendor>
Apr 13 16:16:12 user nova-compute[71731]:   <topology sockets="6" cores="1" threads="1"/>
Apr 13 16:16:12 user nova-compute[71731]: </cpu>
Apr 13 16:16:12 user nova-compute[71731]:  {{(pid=71731) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12486}}
Apr 13 16:16:12 user nova-compute[71731]: DEBUG nova.scheduler.client.report [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Updated inventory for provider cb6b1a64-0c24-4e2d-af1e-16576ca9165c with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16023, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=71731) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Apr 13 16:16:12 user nova-compute[71731]: DEBUG nova.compute.provider_tree [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Updating resource provider cb6b1a64-0c24-4e2d-af1e-16576ca9165c generation from 0 to 1 during operation: update_inventory {{(pid=71731) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Apr 13 16:16:12 user nova-compute[71731]: DEBUG nova.compute.provider_tree [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Updating inventory in ProviderTree for provider cb6b1a64-0c24-4e2d-af1e-16576ca9165c with inventory: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71731) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 13 16:16:12 user nova-compute[71731]: DEBUG nova.compute.provider_tree [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Updating resource provider cb6b1a64-0c24-4e2d-af1e-16576ca9165c generation from 1 to 2 during operation: update_traits {{(pid=71731) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Apr 13 16:16:12 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Compute_service record updated for user:user {{(pid=71731) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 16:16:12 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.756s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:16:12 user nova-compute[71731]: DEBUG nova.service [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Creating RPC server for service compute {{(pid=71731) start /opt/stack/nova/nova/service.py:182}}
Apr 13 16:16:12 user nova-compute[71731]: DEBUG nova.service [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Join ServiceGroup membership for this service compute {{(pid=71731) start /opt/stack/nova/nova/service.py:199}}
Apr 13 16:16:12 user nova-compute[71731]: DEBUG nova.servicegroup.drivers.db [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=71731) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Apr 13 16:16:57 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._sync_power_states {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:16:57 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:17:03 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:17:03 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:17:03 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Starting heal instance info cache {{(pid=71731) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 16:17:03 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Rebuilding the list of instances to heal {{(pid=71731) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 13 16:17:03 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Didn't find any instances for network info cache update. {{(pid=71731) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 13 16:17:03 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:17:03 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:17:03 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:17:03 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:17:03 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:17:03 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:17:03 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71731) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 16:17:03 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager.update_available_resource {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:17:03 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:17:03 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:17:03 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:17:03 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Auditing locally available compute resources for user (node: user) {{(pid=71731) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 16:17:03 user nova-compute[71731]: WARNING nova.virt.libvirt.driver [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 16:17:03 user nova-compute[71731]: WARNING nova.virt.libvirt.driver [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 16:17:03 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Hypervisor/Node resource view: name=user free_ram=10173MB free_disk=26.91458511352539GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=71731) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 16:17:03 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:17:03 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:17:03 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=71731) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 16:17:03 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=71731) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 16:17:03 user nova-compute[71731]: DEBUG nova.compute.provider_tree [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Inventory has not changed in ProviderTree for provider: cb6b1a64-0c24-4e2d-af1e-16576ca9165c {{(pid=71731) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 16:17:03 user nova-compute[71731]: DEBUG nova.scheduler.client.report [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Inventory has not changed for provider cb6b1a64-0c24-4e2d-af1e-16576ca9165c based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71731) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 16:17:03 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Compute_service record updated for user:user {{(pid=71731) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 16:17:03 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.134s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:18:03 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:18:03 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:18:03 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager.update_available_resource {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:18:03 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:18:03 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:18:03 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:18:03 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Auditing locally available compute resources for user (node: user) {{(pid=71731) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 16:18:04 user nova-compute[71731]: WARNING nova.virt.libvirt.driver [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 16:18:04 user nova-compute[71731]: WARNING nova.virt.libvirt.driver [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 16:18:04 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Hypervisor/Node resource view: name=user free_ram=10171MB free_disk=26.962188720703125GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=71731) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 16:18:04 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:18:04 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:18:04 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=71731) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 16:18:04 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=71731) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 16:18:04 user nova-compute[71731]: DEBUG nova.compute.provider_tree [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Inventory has not changed in ProviderTree for provider: cb6b1a64-0c24-4e2d-af1e-16576ca9165c {{(pid=71731) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 16:18:04 user nova-compute[71731]: DEBUG nova.scheduler.client.report [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Inventory has not changed for provider cb6b1a64-0c24-4e2d-af1e-16576ca9165c based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71731) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 16:18:04 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Compute_service record updated for user:user {{(pid=71731) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 16:18:04 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.154s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:18:04 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:18:04 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Starting heal instance info cache {{(pid=71731) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 16:18:04 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Rebuilding the list of instances to heal {{(pid=71731) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 13 16:18:04 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Didn't find any instances for network info cache update. {{(pid=71731) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 13 16:18:04 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:18:04 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:18:04 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71731) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 16:18:05 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:18:05 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:18:05 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:18:05 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:19:03 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager.update_available_resource {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:19:03 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:19:03 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:19:03 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:19:03 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Auditing locally available compute resources for user (node: user) {{(pid=71731) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 16:19:03 user nova-compute[71731]: WARNING nova.virt.libvirt.driver [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 16:19:03 user nova-compute[71731]: WARNING nova.virt.libvirt.driver [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 16:19:03 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Hypervisor/Node resource view: name=user free_ram=10141MB free_disk=26.739093780517578GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=71731) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 16:19:03 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:19:03 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:19:03 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=71731) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 16:19:03 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=71731) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 16:19:03 user nova-compute[71731]: DEBUG nova.compute.provider_tree [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Inventory has not changed in ProviderTree for provider: cb6b1a64-0c24-4e2d-af1e-16576ca9165c {{(pid=71731) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 16:19:03 user nova-compute[71731]: DEBUG nova.scheduler.client.report [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Inventory has not changed for provider cb6b1a64-0c24-4e2d-af1e-16576ca9165c based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71731) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 16:19:03 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Compute_service record updated for user:user {{(pid=71731) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 16:19:03 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.141s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:19:04 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:19:04 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Starting heal instance info cache {{(pid=71731) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 16:19:04 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Rebuilding the list of instances to heal {{(pid=71731) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 13 16:19:04 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Didn't find any instances for network info cache update. {{(pid=71731) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 13 16:19:05 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:19:05 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:19:05 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:19:05 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:19:06 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:19:06 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:19:06 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71731) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 16:19:07 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:20:05 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:20:05 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:20:05 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager.update_available_resource {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:20:05 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:20:05 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:20:05 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:20:05 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Auditing locally available compute resources for user (node: user) {{(pid=71731) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 16:20:05 user nova-compute[71731]: WARNING nova.virt.libvirt.driver [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 16:20:05 user nova-compute[71731]: WARNING nova.virt.libvirt.driver [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 16:20:05 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Hypervisor/Node resource view: name=user free_ram=9430MB free_disk=26.760135650634766GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=71731) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 16:20:05 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:20:05 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:20:05 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=71731) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 16:20:05 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=71731) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 16:20:05 user nova-compute[71731]: DEBUG nova.compute.provider_tree [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Inventory has not changed in ProviderTree for provider: cb6b1a64-0c24-4e2d-af1e-16576ca9165c {{(pid=71731) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 16:20:05 user nova-compute[71731]: DEBUG nova.scheduler.client.report [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Inventory has not changed for provider cb6b1a64-0c24-4e2d-af1e-16576ca9165c based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71731) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 16:20:05 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Compute_service record updated for user:user {{(pid=71731) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 16:20:05 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.158s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:20:06 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:20:06 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Starting heal instance info cache {{(pid=71731) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 16:20:06 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Rebuilding the list of instances to heal {{(pid=71731) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 13 16:20:06 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Didn't find any instances for network info cache update. {{(pid=71731) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 13 16:20:06 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:20:06 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:20:06 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71731) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 16:20:07 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:20:07 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:20:07 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:20:07 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:20:14 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-427fe007-2b18-4173-a9ac-7524b5682f0e tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Acquiring lock "7973e93b-6311-44ed-91ff-e861c32d0277" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:20:14 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-427fe007-2b18-4173-a9ac-7524b5682f0e tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Lock "7973e93b-6311-44ed-91ff-e861c32d0277" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:20:15 user nova-compute[71731]: DEBUG nova.compute.manager [None req-427fe007-2b18-4173-a9ac-7524b5682f0e tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] [instance: 7973e93b-6311-44ed-91ff-e861c32d0277] Starting instance... {{(pid=71731) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 16:20:15 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-97f2490e-fcb8-4270-90fa-ab115dfe706d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Acquiring lock "f66553f5-5e1b-4f1d-8c5a-63bc340f7586" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:20:15 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-97f2490e-fcb8-4270-90fa-ab115dfe706d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lock "f66553f5-5e1b-4f1d-8c5a-63bc340f7586" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:20:15 user nova-compute[71731]: DEBUG nova.compute.manager [None req-97f2490e-fcb8-4270-90fa-ab115dfe706d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: f66553f5-5e1b-4f1d-8c5a-63bc340f7586] Starting instance... {{(pid=71731) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 16:20:15 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-427fe007-2b18-4173-a9ac-7524b5682f0e tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:20:15 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-427fe007-2b18-4173-a9ac-7524b5682f0e tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.005s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:20:15 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-427fe007-2b18-4173-a9ac-7524b5682f0e tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71731) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 16:20:15 user nova-compute[71731]: INFO nova.compute.claims [None req-427fe007-2b18-4173-a9ac-7524b5682f0e tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] [instance: 7973e93b-6311-44ed-91ff-e861c32d0277] Claim successful on node user
Apr 13 16:20:15 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-97f2490e-fcb8-4270-90fa-ab115dfe706d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:20:15 user nova-compute[71731]: DEBUG nova.compute.provider_tree [None req-427fe007-2b18-4173-a9ac-7524b5682f0e tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Inventory has not changed in ProviderTree for provider: cb6b1a64-0c24-4e2d-af1e-16576ca9165c {{(pid=71731) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 16:20:15 user nova-compute[71731]: DEBUG nova.scheduler.client.report [None req-427fe007-2b18-4173-a9ac-7524b5682f0e tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Inventory has not changed for provider cb6b1a64-0c24-4e2d-af1e-16576ca9165c based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71731) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 16:20:15 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-427fe007-2b18-4173-a9ac-7524b5682f0e tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.375s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:20:15 user nova-compute[71731]: DEBUG nova.compute.manager [None req-427fe007-2b18-4173-a9ac-7524b5682f0e tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] [instance: 7973e93b-6311-44ed-91ff-e861c32d0277] Start building networks asynchronously for instance. {{(pid=71731) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 16:20:15 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-97f2490e-fcb8-4270-90fa-ab115dfe706d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.332s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:20:15 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-97f2490e-fcb8-4270-90fa-ab115dfe706d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71731) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 16:20:15 user nova-compute[71731]: INFO nova.compute.claims [None req-97f2490e-fcb8-4270-90fa-ab115dfe706d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: f66553f5-5e1b-4f1d-8c5a-63bc340f7586] Claim successful on node user
Apr 13 16:20:15 user nova-compute[71731]: DEBUG nova.compute.manager [None req-427fe007-2b18-4173-a9ac-7524b5682f0e tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] [instance: 7973e93b-6311-44ed-91ff-e861c32d0277] Allocating IP information in the background. {{(pid=71731) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 16:20:15 user nova-compute[71731]: DEBUG nova.network.neutron [None req-427fe007-2b18-4173-a9ac-7524b5682f0e tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] [instance: 7973e93b-6311-44ed-91ff-e861c32d0277] allocate_for_instance() {{(pid=71731) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 16:20:15 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-427fe007-2b18-4173-a9ac-7524b5682f0e tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] [instance: 7973e93b-6311-44ed-91ff-e861c32d0277] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 16:20:15 user nova-compute[71731]: DEBUG nova.compute.provider_tree [None req-97f2490e-fcb8-4270-90fa-ab115dfe706d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Inventory has not changed in ProviderTree for provider: cb6b1a64-0c24-4e2d-af1e-16576ca9165c {{(pid=71731) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 16:20:15 user nova-compute[71731]: DEBUG nova.compute.manager [None req-427fe007-2b18-4173-a9ac-7524b5682f0e tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] [instance: 7973e93b-6311-44ed-91ff-e861c32d0277] Start building block device mappings for instance. {{(pid=71731) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 16:20:15 user nova-compute[71731]: DEBUG nova.scheduler.client.report [None req-97f2490e-fcb8-4270-90fa-ab115dfe706d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Inventory has not changed for provider cb6b1a64-0c24-4e2d-af1e-16576ca9165c based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71731) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 16:20:16 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-97f2490e-fcb8-4270-90fa-ab115dfe706d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.326s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:20:16 user nova-compute[71731]: DEBUG nova.compute.manager [None req-97f2490e-fcb8-4270-90fa-ab115dfe706d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: f66553f5-5e1b-4f1d-8c5a-63bc340f7586] Start building networks asynchronously for instance. {{(pid=71731) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 16:20:16 user nova-compute[71731]: DEBUG nova.compute.manager [None req-427fe007-2b18-4173-a9ac-7524b5682f0e tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] [instance: 7973e93b-6311-44ed-91ff-e861c32d0277] Start spawning the instance on the hypervisor. {{(pid=71731) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 16:20:16 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-427fe007-2b18-4173-a9ac-7524b5682f0e tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] [instance: 7973e93b-6311-44ed-91ff-e861c32d0277] Creating instance directory {{(pid=71731) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 16:20:16 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-427fe007-2b18-4173-a9ac-7524b5682f0e tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] [instance: 7973e93b-6311-44ed-91ff-e861c32d0277] Creating image(s)
Apr 13 16:20:16 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-427fe007-2b18-4173-a9ac-7524b5682f0e tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Acquiring lock "/opt/stack/data/nova/instances/7973e93b-6311-44ed-91ff-e861c32d0277/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:20:16 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-427fe007-2b18-4173-a9ac-7524b5682f0e tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Lock "/opt/stack/data/nova/instances/7973e93b-6311-44ed-91ff-e861c32d0277/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:20:16 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-427fe007-2b18-4173-a9ac-7524b5682f0e tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Lock "/opt/stack/data/nova/instances/7973e93b-6311-44ed-91ff-e861c32d0277/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:20:16 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-427fe007-2b18-4173-a9ac-7524b5682f0e tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Acquiring lock "9524227dd898575c3099d3976f096cd935414279" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:20:16 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-427fe007-2b18-4173-a9ac-7524b5682f0e tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Lock "9524227dd898575c3099d3976f096cd935414279" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:20:16 user nova-compute[71731]: DEBUG nova.compute.manager [None req-97f2490e-fcb8-4270-90fa-ab115dfe706d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: f66553f5-5e1b-4f1d-8c5a-63bc340f7586] Allocating IP information in the background. {{(pid=71731) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 16:20:16 user nova-compute[71731]: DEBUG nova.network.neutron [None req-97f2490e-fcb8-4270-90fa-ab115dfe706d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: f66553f5-5e1b-4f1d-8c5a-63bc340f7586] allocate_for_instance() {{(pid=71731) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 16:20:16 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-97f2490e-fcb8-4270-90fa-ab115dfe706d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: f66553f5-5e1b-4f1d-8c5a-63bc340f7586] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 16:20:16 user nova-compute[71731]: DEBUG nova.compute.manager [None req-97f2490e-fcb8-4270-90fa-ab115dfe706d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: f66553f5-5e1b-4f1d-8c5a-63bc340f7586] Start building block device mappings for instance. {{(pid=71731) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 16:20:16 user nova-compute[71731]: DEBUG nova.compute.manager [None req-97f2490e-fcb8-4270-90fa-ab115dfe706d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: f66553f5-5e1b-4f1d-8c5a-63bc340f7586] Start spawning the instance on the hypervisor. {{(pid=71731) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 16:20:16 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-97f2490e-fcb8-4270-90fa-ab115dfe706d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: f66553f5-5e1b-4f1d-8c5a-63bc340f7586] Creating instance directory {{(pid=71731) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 16:20:16 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-97f2490e-fcb8-4270-90fa-ab115dfe706d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: f66553f5-5e1b-4f1d-8c5a-63bc340f7586] Creating image(s)
Apr 13 16:20:16 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-97f2490e-fcb8-4270-90fa-ab115dfe706d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Acquiring lock "/opt/stack/data/nova/instances/f66553f5-5e1b-4f1d-8c5a-63bc340f7586/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:20:16 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-97f2490e-fcb8-4270-90fa-ab115dfe706d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lock "/opt/stack/data/nova/instances/f66553f5-5e1b-4f1d-8c5a-63bc340f7586/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:20:16 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-97f2490e-fcb8-4270-90fa-ab115dfe706d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lock "/opt/stack/data/nova/instances/f66553f5-5e1b-4f1d-8c5a-63bc340f7586/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:20:16 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-97f2490e-fcb8-4270-90fa-ab115dfe706d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Acquiring lock "9524227dd898575c3099d3976f096cd935414279" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:20:16 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-427fe007-2b18-4173-a9ac-7524b5682f0e tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279.part --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:20:16 user nova-compute[71731]: DEBUG nova.policy [None req-97f2490e-fcb8-4270-90fa-ab115dfe706d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e45a882dbafb4ea4976e4f45289eb2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2d09a74bf684a9fb1dd1e95d6c23f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71731) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 16:20:16 user nova-compute[71731]: DEBUG nova.policy [None req-427fe007-2b18-4173-a9ac-7524b5682f0e tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4ddd547d240b43ccb213e9d459082309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5554aa7f1b4d471b8807a845ab1ea33f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71731) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 16:20:16 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-427fe007-2b18-4173-a9ac-7524b5682f0e tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279.part --force-share --output=json" returned: 0 in 0.214s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:20:16 user nova-compute[71731]: DEBUG nova.virt.images [None req-427fe007-2b18-4173-a9ac-7524b5682f0e tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] 708622a9-7465-4492-ade8-b827198f7e30 was qcow2, converting to raw {{(pid=71731) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 13 16:20:16 user nova-compute[71731]: DEBUG nova.privsep.utils [None req-427fe007-2b18-4173-a9ac-7524b5682f0e tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71731) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 13 16:20:16 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-427fe007-2b18-4173-a9ac-7524b5682f0e tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279.part /opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279.converted {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:20:17 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-427fe007-2b18-4173-a9ac-7524b5682f0e tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279.part /opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279.converted" returned: 0 in 0.151s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:20:17 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-427fe007-2b18-4173-a9ac-7524b5682f0e tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279.converted --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:20:17 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-427fe007-2b18-4173-a9ac-7524b5682f0e tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279.converted --force-share --output=json" returned: 0 in 0.127s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:20:17 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-427fe007-2b18-4173-a9ac-7524b5682f0e tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Lock "9524227dd898575c3099d3976f096cd935414279" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.035s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:20:17 user nova-compute[71731]: INFO oslo.privsep.daemon [None req-427fe007-2b18-4173-a9ac-7524b5682f0e tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp4n8nad4h/privsep.sock']
Apr 13 16:20:17 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-97f2490e-fcb8-4270-90fa-ab115dfe706d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lock "9524227dd898575c3099d3976f096cd935414279" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.844s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:20:17 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-97f2490e-fcb8-4270-90fa-ab115dfe706d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lock "9524227dd898575c3099d3976f096cd935414279" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:20:17 user sudo[80460]:    stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp4n8nad4h/privsep.sock
Apr 13 16:20:17 user sudo[80460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Apr 13 16:20:19 user sudo[80460]: pam_unix(sudo:session): session closed for user root
Apr 13 16:20:19 user nova-compute[71731]: INFO oslo.privsep.daemon [None req-427fe007-2b18-4173-a9ac-7524b5682f0e tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Spawned new privsep daemon via rootwrap
Apr 13 16:20:19 user nova-compute[71731]: INFO oslo.privsep.daemon [-] privsep daemon starting
Apr 13 16:20:19 user nova-compute[71731]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Apr 13 16:20:19 user nova-compute[71731]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Apr 13 16:20:19 user nova-compute[71731]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 80463
Apr 13 16:20:19 user nova-compute[71731]: WARNING oslo_privsep.priv_context [None req-97f2490e-fcb8-4270-90fa-ab115dfe706d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] privsep daemon already running
Apr 13 16:20:19 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-97f2490e-fcb8-4270-90fa-ab115dfe706d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279 --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:20:19 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-427fe007-2b18-4173-a9ac-7524b5682f0e tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279 --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:20:19 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-97f2490e-fcb8-4270-90fa-ab115dfe706d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279 --force-share --output=json" returned: 0 in 0.130s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:20:19 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-97f2490e-fcb8-4270-90fa-ab115dfe706d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Acquiring lock "9524227dd898575c3099d3976f096cd935414279" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:20:19 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-97f2490e-fcb8-4270-90fa-ab115dfe706d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lock "9524227dd898575c3099d3976f096cd935414279" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:20:19 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-97f2490e-fcb8-4270-90fa-ab115dfe706d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279 --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:20:19 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-427fe007-2b18-4173-a9ac-7524b5682f0e tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279 --force-share --output=json" returned: 0 in 0.146s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:20:19 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-427fe007-2b18-4173-a9ac-7524b5682f0e tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Acquiring lock "9524227dd898575c3099d3976f096cd935414279" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:20:19 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-97f2490e-fcb8-4270-90fa-ab115dfe706d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279 --force-share --output=json" returned: 0 in 0.152s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:20:19 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-97f2490e-fcb8-4270-90fa-ab115dfe706d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279,backing_fmt=raw /opt/stack/data/nova/instances/f66553f5-5e1b-4f1d-8c5a-63bc340f7586/disk 1073741824 {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:20:19 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-97f2490e-fcb8-4270-90fa-ab115dfe706d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279,backing_fmt=raw /opt/stack/data/nova/instances/f66553f5-5e1b-4f1d-8c5a-63bc340f7586/disk 1073741824" returned: 0 in 0.054s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:20:19 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-97f2490e-fcb8-4270-90fa-ab115dfe706d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lock "9524227dd898575c3099d3976f096cd935414279" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.210s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:20:19 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-97f2490e-fcb8-4270-90fa-ab115dfe706d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279 --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:20:19 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-427fe007-2b18-4173-a9ac-7524b5682f0e tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Lock "9524227dd898575c3099d3976f096cd935414279" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.198s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:20:19 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-427fe007-2b18-4173-a9ac-7524b5682f0e tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279 --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:20:19 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-97f2490e-fcb8-4270-90fa-ab115dfe706d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279 --force-share --output=json" returned: 0 in 0.165s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:20:19 user nova-compute[71731]: DEBUG nova.virt.disk.api [None req-97f2490e-fcb8-4270-90fa-ab115dfe706d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f66553f5-5e1b-4f1d-8c5a-63bc340f7586/disk. size=1073741824 {{(pid=71731) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 16:20:19 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-97f2490e-fcb8-4270-90fa-ab115dfe706d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66553f5-5e1b-4f1d-8c5a-63bc340f7586/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:20:19 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-427fe007-2b18-4173-a9ac-7524b5682f0e tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279 --force-share --output=json" returned: 0 in 0.167s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:20:19 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-427fe007-2b18-4173-a9ac-7524b5682f0e tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279,backing_fmt=raw /opt/stack/data/nova/instances/7973e93b-6311-44ed-91ff-e861c32d0277/disk 1073741824 {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:20:19 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-427fe007-2b18-4173-a9ac-7524b5682f0e tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279,backing_fmt=raw /opt/stack/data/nova/instances/7973e93b-6311-44ed-91ff-e861c32d0277/disk 1073741824" returned: 0 in 0.066s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:20:19 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-427fe007-2b18-4173-a9ac-7524b5682f0e tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Lock "9524227dd898575c3099d3976f096cd935414279" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.241s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:20:19 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-427fe007-2b18-4173-a9ac-7524b5682f0e tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279 --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:20:19 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-97f2490e-fcb8-4270-90fa-ab115dfe706d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66553f5-5e1b-4f1d-8c5a-63bc340f7586/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:20:19 user nova-compute[71731]: DEBUG nova.virt.disk.api [None req-97f2490e-fcb8-4270-90fa-ab115dfe706d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Cannot resize image /opt/stack/data/nova/instances/f66553f5-5e1b-4f1d-8c5a-63bc340f7586/disk to a smaller size. {{(pid=71731) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 16:20:19 user nova-compute[71731]: DEBUG nova.objects.instance [None req-97f2490e-fcb8-4270-90fa-ab115dfe706d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lazy-loading 'migration_context' on Instance uuid f66553f5-5e1b-4f1d-8c5a-63bc340f7586 {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:20:19 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-97f2490e-fcb8-4270-90fa-ab115dfe706d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: f66553f5-5e1b-4f1d-8c5a-63bc340f7586] Created local disks {{(pid=71731) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 16:20:19 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-97f2490e-fcb8-4270-90fa-ab115dfe706d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: f66553f5-5e1b-4f1d-8c5a-63bc340f7586] Ensure instance console log exists: /opt/stack/data/nova/instances/f66553f5-5e1b-4f1d-8c5a-63bc340f7586/console.log {{(pid=71731) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 16:20:19 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-97f2490e-fcb8-4270-90fa-ab115dfe706d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:20:19 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-97f2490e-fcb8-4270-90fa-ab115dfe706d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:20:19 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-97f2490e-fcb8-4270-90fa-ab115dfe706d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:20:19 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-427fe007-2b18-4173-a9ac-7524b5682f0e tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279 --force-share --output=json" returned: 0 in 0.152s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:20:19 user nova-compute[71731]: DEBUG nova.virt.disk.api [None req-427fe007-2b18-4173-a9ac-7524b5682f0e tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7973e93b-6311-44ed-91ff-e861c32d0277/disk. size=1073741824 {{(pid=71731) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 16:20:19 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-427fe007-2b18-4173-a9ac-7524b5682f0e tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7973e93b-6311-44ed-91ff-e861c32d0277/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:20:20 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-427fe007-2b18-4173-a9ac-7524b5682f0e tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7973e93b-6311-44ed-91ff-e861c32d0277/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:20:20 user nova-compute[71731]: DEBUG nova.virt.disk.api [None req-427fe007-2b18-4173-a9ac-7524b5682f0e tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Cannot resize image /opt/stack/data/nova/instances/7973e93b-6311-44ed-91ff-e861c32d0277/disk to a smaller size. {{(pid=71731) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 16:20:20 user nova-compute[71731]: DEBUG nova.objects.instance [None req-427fe007-2b18-4173-a9ac-7524b5682f0e tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Lazy-loading 'migration_context' on Instance uuid 7973e93b-6311-44ed-91ff-e861c32d0277 {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:20:20 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-427fe007-2b18-4173-a9ac-7524b5682f0e tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] [instance: 7973e93b-6311-44ed-91ff-e861c32d0277] Created local disks {{(pid=71731) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 16:20:20 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-427fe007-2b18-4173-a9ac-7524b5682f0e tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] [instance: 7973e93b-6311-44ed-91ff-e861c32d0277] Ensure instance console log exists: /opt/stack/data/nova/instances/7973e93b-6311-44ed-91ff-e861c32d0277/console.log {{(pid=71731) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 16:20:20 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-427fe007-2b18-4173-a9ac-7524b5682f0e tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:20:20 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-427fe007-2b18-4173-a9ac-7524b5682f0e tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:20:20 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-427fe007-2b18-4173-a9ac-7524b5682f0e tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:20:20 user nova-compute[71731]: DEBUG nova.network.neutron [None req-427fe007-2b18-4173-a9ac-7524b5682f0e tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] [instance: 7973e93b-6311-44ed-91ff-e861c32d0277] Successfully created port: 8ae83a6c-4fc7-4e2c-8f83-7aece5c239cd {{(pid=71731) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 16:20:20 user nova-compute[71731]: DEBUG nova.network.neutron [None req-97f2490e-fcb8-4270-90fa-ab115dfe706d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: f66553f5-5e1b-4f1d-8c5a-63bc340f7586] Successfully created port: 27d05b76-8556-4365-9050-6bf871e85502 {{(pid=71731) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 16:20:23 user nova-compute[71731]: DEBUG nova.network.neutron [None req-427fe007-2b18-4173-a9ac-7524b5682f0e tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] [instance: 7973e93b-6311-44ed-91ff-e861c32d0277] Successfully updated port: 8ae83a6c-4fc7-4e2c-8f83-7aece5c239cd {{(pid=71731) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 16:20:23 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-427fe007-2b18-4173-a9ac-7524b5682f0e tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Acquiring lock "refresh_cache-7973e93b-6311-44ed-91ff-e861c32d0277" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 16:20:23 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-427fe007-2b18-4173-a9ac-7524b5682f0e tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Acquired lock "refresh_cache-7973e93b-6311-44ed-91ff-e861c32d0277" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 16:20:23 user nova-compute[71731]: DEBUG nova.network.neutron [None req-427fe007-2b18-4173-a9ac-7524b5682f0e tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] [instance: 7973e93b-6311-44ed-91ff-e861c32d0277] Building network info cache for instance {{(pid=71731) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 16:20:23 user nova-compute[71731]: DEBUG nova.network.neutron [None req-427fe007-2b18-4173-a9ac-7524b5682f0e tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] [instance: 7973e93b-6311-44ed-91ff-e861c32d0277] Instance cache missing network info. {{(pid=71731) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 16:20:23 user nova-compute[71731]: DEBUG nova.compute.manager [req-211e1e8d-0be3-444a-81a4-a9dfb086e524 req-cabe0da4-679e-4f40-8875-fbb78d074488 service nova] [instance: 7973e93b-6311-44ed-91ff-e861c32d0277] Received event network-changed-8ae83a6c-4fc7-4e2c-8f83-7aece5c239cd {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:20:23 user nova-compute[71731]: DEBUG nova.compute.manager [req-211e1e8d-0be3-444a-81a4-a9dfb086e524 req-cabe0da4-679e-4f40-8875-fbb78d074488 service nova] [instance: 7973e93b-6311-44ed-91ff-e861c32d0277] Refreshing instance network info cache due to event network-changed-8ae83a6c-4fc7-4e2c-8f83-7aece5c239cd. {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 16:20:23 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-211e1e8d-0be3-444a-81a4-a9dfb086e524 req-cabe0da4-679e-4f40-8875-fbb78d074488 service nova] Acquiring lock "refresh_cache-7973e93b-6311-44ed-91ff-e861c32d0277" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 16:20:23 user nova-compute[71731]: DEBUG nova.network.neutron [None req-97f2490e-fcb8-4270-90fa-ab115dfe706d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: f66553f5-5e1b-4f1d-8c5a-63bc340f7586] Successfully updated port: 27d05b76-8556-4365-9050-6bf871e85502 {{(pid=71731) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 16:20:23 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-97f2490e-fcb8-4270-90fa-ab115dfe706d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Acquiring lock "refresh_cache-f66553f5-5e1b-4f1d-8c5a-63bc340f7586" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 16:20:23 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-97f2490e-fcb8-4270-90fa-ab115dfe706d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Acquired lock "refresh_cache-f66553f5-5e1b-4f1d-8c5a-63bc340f7586" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 16:20:23 user nova-compute[71731]: DEBUG nova.network.neutron [None req-97f2490e-fcb8-4270-90fa-ab115dfe706d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: f66553f5-5e1b-4f1d-8c5a-63bc340f7586] Building network info cache for instance {{(pid=71731) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 16:20:23 user nova-compute[71731]: DEBUG nova.network.neutron [None req-97f2490e-fcb8-4270-90fa-ab115dfe706d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: f66553f5-5e1b-4f1d-8c5a-63bc340f7586] Instance cache missing network info. {{(pid=71731) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 16:20:24 user nova-compute[71731]: DEBUG nova.network.neutron [None req-427fe007-2b18-4173-a9ac-7524b5682f0e tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] [instance: 7973e93b-6311-44ed-91ff-e861c32d0277] Updating instance_info_cache with network_info: [{"id": "8ae83a6c-4fc7-4e2c-8f83-7aece5c239cd", "address": "fa:16:3e:db:b9:e8", "network": {"id": "ae7f770e-a460-4297-91b5-ed0b908a895a", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1175970469-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5554aa7f1b4d471b8807a845ab1ea33f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ae83a6c-4f", "ovs_interfaceid": "8ae83a6c-4fc7-4e2c-8f83-7aece5c239cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:20:24 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-427fe007-2b18-4173-a9ac-7524b5682f0e tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Releasing lock "refresh_cache-7973e93b-6311-44ed-91ff-e861c32d0277" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 16:20:24 user nova-compute[71731]: DEBUG nova.compute.manager [None req-427fe007-2b18-4173-a9ac-7524b5682f0e tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] [instance: 7973e93b-6311-44ed-91ff-e861c32d0277] Instance network_info: |[{"id": "8ae83a6c-4fc7-4e2c-8f83-7aece5c239cd", "address": "fa:16:3e:db:b9:e8", "network": {"id": "ae7f770e-a460-4297-91b5-ed0b908a895a", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1175970469-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5554aa7f1b4d471b8807a845ab1ea33f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ae83a6c-4f", "ovs_interfaceid": "8ae83a6c-4fc7-4e2c-8f83-7aece5c239cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71731) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 16:20:24 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-211e1e8d-0be3-444a-81a4-a9dfb086e524 req-cabe0da4-679e-4f40-8875-fbb78d074488 service nova] Acquired lock "refresh_cache-7973e93b-6311-44ed-91ff-e861c32d0277" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 16:20:24 user nova-compute[71731]: DEBUG nova.network.neutron [req-211e1e8d-0be3-444a-81a4-a9dfb086e524 req-cabe0da4-679e-4f40-8875-fbb78d074488 service nova] [instance: 7973e93b-6311-44ed-91ff-e861c32d0277] Refreshing network info cache for port 8ae83a6c-4fc7-4e2c-8f83-7aece5c239cd {{(pid=71731) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 16:20:24 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-427fe007-2b18-4173-a9ac-7524b5682f0e tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] [instance: 7973e93b-6311-44ed-91ff-e861c32d0277] Start _get_guest_xml network_info=[{"id": "8ae83a6c-4fc7-4e2c-8f83-7aece5c239cd", "address": "fa:16:3e:db:b9:e8", "network": {"id": "ae7f770e-a460-4297-91b5-ed0b908a895a", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1175970469-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5554aa7f1b4d471b8807a845ab1ea33f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ae83a6c-4f", "ovs_interfaceid": "8ae83a6c-4fc7-4e2c-8f83-7aece5c239cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T16:16:31Z,direct_url=<?>,disk_format='qcow2',id=708622a9-7465-4492-ade8-b827198f7e30,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='0b29a975c552465aba0ac7d6288434bd',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T16:16:33Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'device_type': 'disk', 'encrypted': False, 'disk_bus': 'virtio', 'guest_format': None, 'encryption_options': None, 'image_id': '708622a9-7465-4492-ade8-b827198f7e30'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71731) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 16:20:24 user nova-compute[71731]: WARNING nova.virt.libvirt.driver [None req-427fe007-2b18-4173-a9ac-7524b5682f0e tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 16:20:24 user nova-compute[71731]: WARNING nova.virt.libvirt.driver [None req-427fe007-2b18-4173-a9ac-7524b5682f0e tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 16:20:24 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-427fe007-2b18-4173-a9ac-7524b5682f0e tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71731) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 16:20:24 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-427fe007-2b18-4173-a9ac-7524b5682f0e tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T16:17:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T16:16:31Z,direct_url=<?>,disk_format='qcow2',id=708622a9-7465-4492-ade8-b827198f7e30,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='0b29a975c552465aba0ac7d6288434bd',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T16:16:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 16:20:24 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-427fe007-2b18-4173-a9ac-7524b5682f0e tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Flavor limits 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 16:20:24 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-427fe007-2b18-4173-a9ac-7524b5682f0e tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Image limits 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 16:20:24 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-427fe007-2b18-4173-a9ac-7524b5682f0e tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Flavor pref 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 16:20:24 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-427fe007-2b18-4173-a9ac-7524b5682f0e tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Image pref 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 16:20:24 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-427fe007-2b18-4173-a9ac-7524b5682f0e tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 16:20:24 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-427fe007-2b18-4173-a9ac-7524b5682f0e tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 16:20:24 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-427fe007-2b18-4173-a9ac-7524b5682f0e tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71731) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 16:20:24 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-427fe007-2b18-4173-a9ac-7524b5682f0e tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Got 1 possible topologies {{(pid=71731) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 16:20:24 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-427fe007-2b18-4173-a9ac-7524b5682f0e tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 16:20:24 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-427fe007-2b18-4173-a9ac-7524b5682f0e tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 16:20:24 user nova-compute[71731]: DEBUG nova.privsep.utils [None req-427fe007-2b18-4173-a9ac-7524b5682f0e tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71731) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 13 16:20:24 user nova-compute[71731]: DEBUG nova.virt.libvirt.vif [None req-427fe007-2b18-4173-a9ac-7524b5682f0e tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T16:20:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-700639075',display_name='tempest-ServersNegativeTestJSON-server-700639075',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-700639075',id=1,image_ref='708622a9-7465-4492-ade8-b827198f7e30',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5554aa7f1b4d471b8807a845ab1ea33f',ramdisk_id='',reservation_id='r-0io0hj0a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='708622a9-7465-4492-ade8-b827198f7e30',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1820659348',owner_user_name='tempest-ServersNegativeTestJSON-1820659348-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T16:20:16Z,user_data=None,user_id='4ddd547d240b43ccb213e9d459082309',uuid=7973e93b-6311-44ed-91ff-e861c32d0277,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8ae83a6c-4fc7-4e2c-8f83-7aece5c239cd", "address": "fa:16:3e:db:b9:e8", "network": {"id": "ae7f770e-a460-4297-91b5-ed0b908a895a", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1175970469-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5554aa7f1b4d471b8807a845ab1ea33f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ae83a6c-4f", "ovs_interfaceid": "8ae83a6c-4fc7-4e2c-8f83-7aece5c239cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71731) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 16:20:24 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-427fe007-2b18-4173-a9ac-7524b5682f0e tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Converting VIF {"id": "8ae83a6c-4fc7-4e2c-8f83-7aece5c239cd", "address": "fa:16:3e:db:b9:e8", "network": {"id": "ae7f770e-a460-4297-91b5-ed0b908a895a", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1175970469-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5554aa7f1b4d471b8807a845ab1ea33f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ae83a6c-4f", "ovs_interfaceid": "8ae83a6c-4fc7-4e2c-8f83-7aece5c239cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 16:20:24 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-427fe007-2b18-4173-a9ac-7524b5682f0e tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:db:b9:e8,bridge_name='br-int',has_traffic_filtering=True,id=8ae83a6c-4fc7-4e2c-8f83-7aece5c239cd,network=Network(ae7f770e-a460-4297-91b5-ed0b908a895a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ae83a6c-4f') {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 16:20:24 user nova-compute[71731]: DEBUG nova.objects.instance [None req-427fe007-2b18-4173-a9ac-7524b5682f0e tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Lazy-loading 'pci_devices' on Instance uuid 7973e93b-6311-44ed-91ff-e861c32d0277 {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:20:24 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-427fe007-2b18-4173-a9ac-7524b5682f0e tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] [instance: 7973e93b-6311-44ed-91ff-e861c32d0277] End _get_guest_xml xml=<domain type="kvm">
Apr 13 16:20:24 user nova-compute[71731]:   <uuid>7973e93b-6311-44ed-91ff-e861c32d0277</uuid>
Apr 13 16:20:24 user nova-compute[71731]:   <name>instance-00000001</name>
Apr 13 16:20:24 user nova-compute[71731]:   <memory>131072</memory>
Apr 13 16:20:24 user nova-compute[71731]:   <vcpu>1</vcpu>
Apr 13 16:20:24 user nova-compute[71731]:   <metadata>
Apr 13 16:20:24 user nova-compute[71731]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 16:20:24 user nova-compute[71731]:       <nova:package version="0.0.0"/>
Apr 13 16:20:24 user nova-compute[71731]:       <nova:name>tempest-ServersNegativeTestJSON-server-700639075</nova:name>
Apr 13 16:20:24 user nova-compute[71731]:       <nova:creationTime>2023-04-13 16:20:24</nova:creationTime>
Apr 13 16:20:24 user nova-compute[71731]:       <nova:flavor name="m1.nano">
Apr 13 16:20:24 user nova-compute[71731]:         <nova:memory>128</nova:memory>
Apr 13 16:20:24 user nova-compute[71731]:         <nova:disk>1</nova:disk>
Apr 13 16:20:24 user nova-compute[71731]:         <nova:swap>0</nova:swap>
Apr 13 16:20:24 user nova-compute[71731]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 16:20:24 user nova-compute[71731]:         <nova:vcpus>1</nova:vcpus>
Apr 13 16:20:24 user nova-compute[71731]:       </nova:flavor>
Apr 13 16:20:24 user nova-compute[71731]:       <nova:owner>
Apr 13 16:20:24 user nova-compute[71731]:         <nova:user uuid="4ddd547d240b43ccb213e9d459082309">tempest-ServersNegativeTestJSON-1820659348-project-member</nova:user>
Apr 13 16:20:24 user nova-compute[71731]:         <nova:project uuid="5554aa7f1b4d471b8807a845ab1ea33f">tempest-ServersNegativeTestJSON-1820659348</nova:project>
Apr 13 16:20:24 user nova-compute[71731]:       </nova:owner>
Apr 13 16:20:24 user nova-compute[71731]:       <nova:root type="image" uuid="708622a9-7465-4492-ade8-b827198f7e30"/>
Apr 13 16:20:24 user nova-compute[71731]:       <nova:ports>
Apr 13 16:20:24 user nova-compute[71731]:         <nova:port uuid="8ae83a6c-4fc7-4e2c-8f83-7aece5c239cd">
Apr 13 16:20:24 user nova-compute[71731]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Apr 13 16:20:24 user nova-compute[71731]:         </nova:port>
Apr 13 16:20:24 user nova-compute[71731]:       </nova:ports>
Apr 13 16:20:24 user nova-compute[71731]:     </nova:instance>
Apr 13 16:20:24 user nova-compute[71731]:   </metadata>
Apr 13 16:20:24 user nova-compute[71731]:   <sysinfo type="smbios">
Apr 13 16:20:24 user nova-compute[71731]:     <system>
Apr 13 16:20:24 user nova-compute[71731]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 16:20:24 user nova-compute[71731]:       <entry name="product">OpenStack Nova</entry>
Apr 13 16:20:24 user nova-compute[71731]:       <entry name="version">0.0.0</entry>
Apr 13 16:20:24 user nova-compute[71731]:       <entry name="serial">7973e93b-6311-44ed-91ff-e861c32d0277</entry>
Apr 13 16:20:24 user nova-compute[71731]:       <entry name="uuid">7973e93b-6311-44ed-91ff-e861c32d0277</entry>
Apr 13 16:20:24 user nova-compute[71731]:       <entry name="family">Virtual Machine</entry>
Apr 13 16:20:24 user nova-compute[71731]:     </system>
Apr 13 16:20:24 user nova-compute[71731]:   </sysinfo>
Apr 13 16:20:24 user nova-compute[71731]:   <os>
Apr 13 16:20:24 user nova-compute[71731]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 16:20:24 user nova-compute[71731]:     <boot dev="hd"/>
Apr 13 16:20:24 user nova-compute[71731]:     <smbios mode="sysinfo"/>
Apr 13 16:20:24 user nova-compute[71731]:   </os>
Apr 13 16:20:24 user nova-compute[71731]:   <features>
Apr 13 16:20:24 user nova-compute[71731]:     <acpi/>
Apr 13 16:20:24 user nova-compute[71731]:     <apic/>
Apr 13 16:20:24 user nova-compute[71731]:     <vmcoreinfo/>
Apr 13 16:20:24 user nova-compute[71731]:   </features>
Apr 13 16:20:24 user nova-compute[71731]:   <clock offset="utc">
Apr 13 16:20:24 user nova-compute[71731]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 16:20:24 user nova-compute[71731]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 16:20:24 user nova-compute[71731]:     <timer name="hpet" present="no"/>
Apr 13 16:20:24 user nova-compute[71731]:   </clock>
Apr 13 16:20:24 user nova-compute[71731]:   <cpu mode="custom" match="exact">
Apr 13 16:20:24 user nova-compute[71731]:     <model>Nehalem</model>
Apr 13 16:20:24 user nova-compute[71731]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 16:20:24 user nova-compute[71731]:   </cpu>
Apr 13 16:20:24 user nova-compute[71731]:   <devices>
Apr 13 16:20:24 user nova-compute[71731]:     <disk type="file" device="disk">
Apr 13 16:20:24 user nova-compute[71731]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 16:20:24 user nova-compute[71731]:       <source file="/opt/stack/data/nova/instances/7973e93b-6311-44ed-91ff-e861c32d0277/disk"/>
Apr 13 16:20:24 user nova-compute[71731]:       <target dev="vda" bus="virtio"/>
Apr 13 16:20:24 user nova-compute[71731]:     </disk>
Apr 13 16:20:24 user nova-compute[71731]:     <interface type="ethernet">
Apr 13 16:20:24 user nova-compute[71731]:       <mac address="fa:16:3e:db:b9:e8"/>
Apr 13 16:20:24 user nova-compute[71731]:       <model type="virtio"/>
Apr 13 16:20:24 user nova-compute[71731]:       <mtu size="1442"/>
Apr 13 16:20:24 user nova-compute[71731]:       <target dev="tap8ae83a6c-4f"/>
Apr 13 16:20:24 user nova-compute[71731]:     </interface>
Apr 13 16:20:24 user nova-compute[71731]:     <serial type="pty">
Apr 13 16:20:24 user nova-compute[71731]:       <log file="/opt/stack/data/nova/instances/7973e93b-6311-44ed-91ff-e861c32d0277/console.log" append="off"/>
Apr 13 16:20:24 user nova-compute[71731]:     </serial>
Apr 13 16:20:24 user nova-compute[71731]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 16:20:24 user nova-compute[71731]:     <video>
Apr 13 16:20:24 user nova-compute[71731]:       <model type="virtio"/>
Apr 13 16:20:24 user nova-compute[71731]:     </video>
Apr 13 16:20:24 user nova-compute[71731]:     <rng model="virtio">
Apr 13 16:20:24 user nova-compute[71731]:       <backend model="random">/dev/urandom</backend>
Apr 13 16:20:24 user nova-compute[71731]:     </rng>
Apr 13 16:20:24 user nova-compute[71731]:     <controller type="usb" index="0" model="none"/>
Apr 13 16:20:24 user nova-compute[71731]:     <memballoon model="virtio">
Apr 13 16:20:24 user nova-compute[71731]:       <stats period="10"/>
Apr 13 16:20:24 user nova-compute[71731]:     </memballoon>
Apr 13 16:20:24 user nova-compute[71731]:   </devices>
Apr 13 16:20:24 user nova-compute[71731]: </domain>
Apr 13 16:20:24 user nova-compute[71731]:  {{(pid=71731) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 16:20:24 user nova-compute[71731]: DEBUG nova.virt.libvirt.vif [None req-427fe007-2b18-4173-a9ac-7524b5682f0e tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T16:20:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-700639075',display_name='tempest-ServersNegativeTestJSON-server-700639075',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-700639075',id=1,image_ref='708622a9-7465-4492-ade8-b827198f7e30',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5554aa7f1b4d471b8807a845ab1ea33f',ramdisk_id='',reservation_id='r-0io0hj0a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='708622a9-7465-4492-ade8-b827198f7e30',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1820659348',owner_user_name='tempest-ServersNegativeTestJSON-1820659348-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T16:20:16Z,user_data=None,user_id='4ddd547d240b43ccb213e9d459082309',uuid=7973e93b-6311-44ed-91ff-e861c32d0277,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8ae83a6c-4fc7-4e2c-8f83-7aece5c239cd", "address": "fa:16:3e:db:b9:e8", "network": {"id": "ae7f770e-a460-4297-91b5-ed0b908a895a", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1175970469-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5554aa7f1b4d471b8807a845ab1ea33f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ae83a6c-4f", "ovs_interfaceid": "8ae83a6c-4fc7-4e2c-8f83-7aece5c239cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 16:20:24 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-427fe007-2b18-4173-a9ac-7524b5682f0e tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Converting VIF {"id": "8ae83a6c-4fc7-4e2c-8f83-7aece5c239cd", "address": "fa:16:3e:db:b9:e8", "network": {"id": "ae7f770e-a460-4297-91b5-ed0b908a895a", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1175970469-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5554aa7f1b4d471b8807a845ab1ea33f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ae83a6c-4f", "ovs_interfaceid": "8ae83a6c-4fc7-4e2c-8f83-7aece5c239cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 16:20:24 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-427fe007-2b18-4173-a9ac-7524b5682f0e tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:db:b9:e8,bridge_name='br-int',has_traffic_filtering=True,id=8ae83a6c-4fc7-4e2c-8f83-7aece5c239cd,network=Network(ae7f770e-a460-4297-91b5-ed0b908a895a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ae83a6c-4f') {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 16:20:24 user nova-compute[71731]: DEBUG os_vif [None req-427fe007-2b18-4173-a9ac-7524b5682f0e tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:b9:e8,bridge_name='br-int',has_traffic_filtering=True,id=8ae83a6c-4fc7-4e2c-8f83-7aece5c239cd,network=Network(ae7f770e-a460-4297-91b5-ed0b908a895a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ae83a6c-4f') {{(pid=71731) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 16:20:24 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl [None req-427fe007-2b18-4173-a9ac-7524b5682f0e tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Created schema index Interface.name {{(pid=71731) autocreate_indices /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Apr 13 16:20:24 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl [None req-427fe007-2b18-4173-a9ac-7524b5682f0e tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Created schema index Port.name {{(pid=71731) autocreate_indices /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Apr 13 16:20:24 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl [None req-427fe007-2b18-4173-a9ac-7524b5682f0e tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Created schema index Bridge.name {{(pid=71731) autocreate_indices /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Apr 13 16:20:24 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-427fe007-2b18-4173-a9ac-7524b5682f0e tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=71731) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 16:20:24 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-427fe007-2b18-4173-a9ac-7524b5682f0e tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] [POLLOUT] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:20:24 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-427fe007-2b18-4173-a9ac-7524b5682f0e tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71731) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 16:20:24 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-427fe007-2b18-4173-a9ac-7524b5682f0e tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:20:24 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:20:24 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:20:24 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 16:20:24 user nova-compute[71731]: INFO oslo.privsep.daemon [None req-427fe007-2b18-4173-a9ac-7524b5682f0e tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmpjfhgymlw/privsep.sock']
Apr 13 16:20:24 user sudo[80504]:    stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmpjfhgymlw/privsep.sock
Apr 13 16:20:24 user sudo[80504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Apr 13 16:20:24 user nova-compute[71731]: DEBUG nova.network.neutron [None req-97f2490e-fcb8-4270-90fa-ab115dfe706d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: f66553f5-5e1b-4f1d-8c5a-63bc340f7586] Updating instance_info_cache with network_info: [{"id": "27d05b76-8556-4365-9050-6bf871e85502", "address": "fa:16:3e:0d:13:8a", "network": {"id": "5a7877ff-8230-470b-90b5-e5dcfc8f0cee", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-779403873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2d09a74bf684a9fb1dd1e95d6c23f3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27d05b76-85", "ovs_interfaceid": "27d05b76-8556-4365-9050-6bf871e85502", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:20:24 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-97f2490e-fcb8-4270-90fa-ab115dfe706d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Releasing lock "refresh_cache-f66553f5-5e1b-4f1d-8c5a-63bc340f7586" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 16:20:24 user nova-compute[71731]: DEBUG nova.compute.manager [None req-97f2490e-fcb8-4270-90fa-ab115dfe706d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: f66553f5-5e1b-4f1d-8c5a-63bc340f7586] Instance network_info: |[{"id": "27d05b76-8556-4365-9050-6bf871e85502", "address": "fa:16:3e:0d:13:8a", "network": {"id": "5a7877ff-8230-470b-90b5-e5dcfc8f0cee", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-779403873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2d09a74bf684a9fb1dd1e95d6c23f3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27d05b76-85", "ovs_interfaceid": "27d05b76-8556-4365-9050-6bf871e85502", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71731) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 16:20:24 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-97f2490e-fcb8-4270-90fa-ab115dfe706d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: f66553f5-5e1b-4f1d-8c5a-63bc340f7586] Start _get_guest_xml network_info=[{"id": "27d05b76-8556-4365-9050-6bf871e85502", "address": "fa:16:3e:0d:13:8a", "network": {"id": "5a7877ff-8230-470b-90b5-e5dcfc8f0cee", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-779403873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2d09a74bf684a9fb1dd1e95d6c23f3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27d05b76-85", "ovs_interfaceid": "27d05b76-8556-4365-9050-6bf871e85502", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T16:16:31Z,direct_url=<?>,disk_format='qcow2',id=708622a9-7465-4492-ade8-b827198f7e30,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='0b29a975c552465aba0ac7d6288434bd',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T16:16:33Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'device_type': 'disk', 'encrypted': False, 'disk_bus': 'virtio', 'guest_format': None, 'encryption_options': None, 'image_id': '708622a9-7465-4492-ade8-b827198f7e30'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71731) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 16:20:24 user nova-compute[71731]: WARNING nova.virt.libvirt.driver [None req-97f2490e-fcb8-4270-90fa-ab115dfe706d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 16:20:24 user nova-compute[71731]: WARNING nova.virt.libvirt.driver [None req-97f2490e-fcb8-4270-90fa-ab115dfe706d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 16:20:24 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-97f2490e-fcb8-4270-90fa-ab115dfe706d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71731) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 16:20:24 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-97f2490e-fcb8-4270-90fa-ab115dfe706d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T16:17:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T16:16:31Z,direct_url=<?>,disk_format='qcow2',id=708622a9-7465-4492-ade8-b827198f7e30,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='0b29a975c552465aba0ac7d6288434bd',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T16:16:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 16:20:24 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-97f2490e-fcb8-4270-90fa-ab115dfe706d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Flavor limits 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 16:20:24 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-97f2490e-fcb8-4270-90fa-ab115dfe706d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Image limits 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 16:20:24 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-97f2490e-fcb8-4270-90fa-ab115dfe706d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Flavor pref 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 16:20:24 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-97f2490e-fcb8-4270-90fa-ab115dfe706d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Image pref 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 16:20:24 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-97f2490e-fcb8-4270-90fa-ab115dfe706d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 16:20:24 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-97f2490e-fcb8-4270-90fa-ab115dfe706d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 16:20:24 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-97f2490e-fcb8-4270-90fa-ab115dfe706d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71731) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 16:20:24 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-97f2490e-fcb8-4270-90fa-ab115dfe706d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Got 1 possible topologies {{(pid=71731) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 16:20:24 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-97f2490e-fcb8-4270-90fa-ab115dfe706d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 16:20:24 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-97f2490e-fcb8-4270-90fa-ab115dfe706d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 16:20:24 user nova-compute[71731]: DEBUG nova.virt.libvirt.vif [None req-97f2490e-fcb8-4270-90fa-ab115dfe706d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T16:20:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1790980626',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1790980626',id=2,image_ref='708622a9-7465-4492-ade8-b827198f7e30',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b2d09a74bf684a9fb1dd1e95d6c23f3c',ramdisk_id='',reservation_id='r-z7buh83w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='708622a9-7465-4492-ade8-b827198f7e30',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1960261099',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T16:20:16Z,user_data=None,user_id='e45a882dbafb4ea4976e4f45289eb2b8',uuid=f66553f5-5e1b-4f1d-8c5a-63bc340f7586,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "27d05b76-8556-4365-9050-6bf871e85502", "address": "fa:16:3e:0d:13:8a", "network": {"id": "5a7877ff-8230-470b-90b5-e5dcfc8f0cee", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-779403873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2d09a74bf684a9fb1dd1e95d6c23f3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27d05b76-85", "ovs_interfaceid": "27d05b76-8556-4365-9050-6bf871e85502", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71731) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 16:20:24 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-97f2490e-fcb8-4270-90fa-ab115dfe706d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Converting VIF {"id": "27d05b76-8556-4365-9050-6bf871e85502", "address": "fa:16:3e:0d:13:8a", "network": {"id": "5a7877ff-8230-470b-90b5-e5dcfc8f0cee", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-779403873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2d09a74bf684a9fb1dd1e95d6c23f3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27d05b76-85", "ovs_interfaceid": "27d05b76-8556-4365-9050-6bf871e85502", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 16:20:24 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-97f2490e-fcb8-4270-90fa-ab115dfe706d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0d:13:8a,bridge_name='br-int',has_traffic_filtering=True,id=27d05b76-8556-4365-9050-6bf871e85502,network=Network(5a7877ff-8230-470b-90b5-e5dcfc8f0cee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27d05b76-85') {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 16:20:24 user nova-compute[71731]: DEBUG nova.objects.instance [None req-97f2490e-fcb8-4270-90fa-ab115dfe706d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lazy-loading 'pci_devices' on Instance uuid f66553f5-5e1b-4f1d-8c5a-63bc340f7586 {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:20:24 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-97f2490e-fcb8-4270-90fa-ab115dfe706d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: f66553f5-5e1b-4f1d-8c5a-63bc340f7586] End _get_guest_xml xml=<domain type="kvm">
Apr 13 16:20:24 user nova-compute[71731]:   <uuid>f66553f5-5e1b-4f1d-8c5a-63bc340f7586</uuid>
Apr 13 16:20:24 user nova-compute[71731]:   <name>instance-00000002</name>
Apr 13 16:20:24 user nova-compute[71731]:   <memory>131072</memory>
Apr 13 16:20:24 user nova-compute[71731]:   <vcpu>1</vcpu>
Apr 13 16:20:24 user nova-compute[71731]:   <metadata>
Apr 13 16:20:24 user nova-compute[71731]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 16:20:24 user nova-compute[71731]:       <nova:package version="0.0.0"/>
Apr 13 16:20:24 user nova-compute[71731]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1790980626</nova:name>
Apr 13 16:20:24 user nova-compute[71731]:       <nova:creationTime>2023-04-13 16:20:24</nova:creationTime>
Apr 13 16:20:24 user nova-compute[71731]:       <nova:flavor name="m1.nano">
Apr 13 16:20:24 user nova-compute[71731]:         <nova:memory>128</nova:memory>
Apr 13 16:20:24 user nova-compute[71731]:         <nova:disk>1</nova:disk>
Apr 13 16:20:24 user nova-compute[71731]:         <nova:swap>0</nova:swap>
Apr 13 16:20:24 user nova-compute[71731]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 16:20:24 user nova-compute[71731]:         <nova:vcpus>1</nova:vcpus>
Apr 13 16:20:24 user nova-compute[71731]:       </nova:flavor>
Apr 13 16:20:24 user nova-compute[71731]:       <nova:owner>
Apr 13 16:20:24 user nova-compute[71731]:         <nova:user uuid="e45a882dbafb4ea4976e4f45289eb2b8">tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member</nova:user>
Apr 13 16:20:24 user nova-compute[71731]:         <nova:project uuid="b2d09a74bf684a9fb1dd1e95d6c23f3c">tempest-ServerBootFromVolumeStableRescueTest-1960261099</nova:project>
Apr 13 16:20:24 user nova-compute[71731]:       </nova:owner>
Apr 13 16:20:24 user nova-compute[71731]:       <nova:root type="image" uuid="708622a9-7465-4492-ade8-b827198f7e30"/>
Apr 13 16:20:24 user nova-compute[71731]:       <nova:ports>
Apr 13 16:20:24 user nova-compute[71731]:         <nova:port uuid="27d05b76-8556-4365-9050-6bf871e85502">
Apr 13 16:20:24 user nova-compute[71731]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Apr 13 16:20:24 user nova-compute[71731]:         </nova:port>
Apr 13 16:20:24 user nova-compute[71731]:       </nova:ports>
Apr 13 16:20:24 user nova-compute[71731]:     </nova:instance>
Apr 13 16:20:24 user nova-compute[71731]:   </metadata>
Apr 13 16:20:24 user nova-compute[71731]:   <sysinfo type="smbios">
Apr 13 16:20:24 user nova-compute[71731]:     <system>
Apr 13 16:20:24 user nova-compute[71731]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 16:20:24 user nova-compute[71731]:       <entry name="product">OpenStack Nova</entry>
Apr 13 16:20:24 user nova-compute[71731]:       <entry name="version">0.0.0</entry>
Apr 13 16:20:24 user nova-compute[71731]:       <entry name="serial">f66553f5-5e1b-4f1d-8c5a-63bc340f7586</entry>
Apr 13 16:20:24 user nova-compute[71731]:       <entry name="uuid">f66553f5-5e1b-4f1d-8c5a-63bc340f7586</entry>
Apr 13 16:20:24 user nova-compute[71731]:       <entry name="family">Virtual Machine</entry>
Apr 13 16:20:24 user nova-compute[71731]:     </system>
Apr 13 16:20:24 user nova-compute[71731]:   </sysinfo>
Apr 13 16:20:24 user nova-compute[71731]:   <os>
Apr 13 16:20:24 user nova-compute[71731]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 16:20:24 user nova-compute[71731]:     <boot dev="hd"/>
Apr 13 16:20:24 user nova-compute[71731]:     <smbios mode="sysinfo"/>
Apr 13 16:20:24 user nova-compute[71731]:   </os>
Apr 13 16:20:24 user nova-compute[71731]:   <features>
Apr 13 16:20:24 user nova-compute[71731]:     <acpi/>
Apr 13 16:20:24 user nova-compute[71731]:     <apic/>
Apr 13 16:20:24 user nova-compute[71731]:     <vmcoreinfo/>
Apr 13 16:20:24 user nova-compute[71731]:   </features>
Apr 13 16:20:24 user nova-compute[71731]:   <clock offset="utc">
Apr 13 16:20:24 user nova-compute[71731]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 16:20:24 user nova-compute[71731]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 16:20:24 user nova-compute[71731]:     <timer name="hpet" present="no"/>
Apr 13 16:20:24 user nova-compute[71731]:   </clock>
Apr 13 16:20:24 user nova-compute[71731]:   <cpu mode="custom" match="exact">
Apr 13 16:20:24 user nova-compute[71731]:     <model>Nehalem</model>
Apr 13 16:20:24 user nova-compute[71731]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 16:20:24 user nova-compute[71731]:   </cpu>
Apr 13 16:20:24 user nova-compute[71731]:   <devices>
Apr 13 16:20:24 user nova-compute[71731]:     <disk type="file" device="disk">
Apr 13 16:20:24 user nova-compute[71731]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 16:20:24 user nova-compute[71731]:       <source file="/opt/stack/data/nova/instances/f66553f5-5e1b-4f1d-8c5a-63bc340f7586/disk"/>
Apr 13 16:20:24 user nova-compute[71731]:       <target dev="vda" bus="virtio"/>
Apr 13 16:20:24 user nova-compute[71731]:     </disk>
Apr 13 16:20:24 user nova-compute[71731]:     <interface type="ethernet">
Apr 13 16:20:24 user nova-compute[71731]:       <mac address="fa:16:3e:0d:13:8a"/>
Apr 13 16:20:24 user nova-compute[71731]:       <model type="virtio"/>
Apr 13 16:20:24 user nova-compute[71731]:       <mtu size="1442"/>
Apr 13 16:20:24 user nova-compute[71731]:       <target dev="tap27d05b76-85"/>
Apr 13 16:20:24 user nova-compute[71731]:     </interface>
Apr 13 16:20:24 user nova-compute[71731]:     <serial type="pty">
Apr 13 16:20:24 user nova-compute[71731]:       <log file="/opt/stack/data/nova/instances/f66553f5-5e1b-4f1d-8c5a-63bc340f7586/console.log" append="off"/>
Apr 13 16:20:24 user nova-compute[71731]:     </serial>
Apr 13 16:20:24 user nova-compute[71731]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 16:20:24 user nova-compute[71731]:     <video>
Apr 13 16:20:24 user nova-compute[71731]:       <model type="virtio"/>
Apr 13 16:20:24 user nova-compute[71731]:     </video>
Apr 13 16:20:24 user nova-compute[71731]:     <rng model="virtio">
Apr 13 16:20:24 user nova-compute[71731]:       <backend model="random">/dev/urandom</backend>
Apr 13 16:20:24 user nova-compute[71731]:     </rng>
Apr 13 16:20:24 user nova-compute[71731]:     <controller type="usb" index="0" model="none"/>
Apr 13 16:20:24 user nova-compute[71731]:     <memballoon model="virtio">
Apr 13 16:20:24 user nova-compute[71731]:       <stats period="10"/>
Apr 13 16:20:24 user nova-compute[71731]:     </memballoon>
Apr 13 16:20:24 user nova-compute[71731]:   </devices>
Apr 13 16:20:24 user nova-compute[71731]: </domain>
Apr 13 16:20:24 user nova-compute[71731]:  {{(pid=71731) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 16:20:24 user nova-compute[71731]: DEBUG nova.virt.libvirt.vif [None req-97f2490e-fcb8-4270-90fa-ab115dfe706d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T16:20:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1790980626',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1790980626',id=2,image_ref='708622a9-7465-4492-ade8-b827198f7e30',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b2d09a74bf684a9fb1dd1e95d6c23f3c',ramdisk_id='',reservation_id='r-z7buh83w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='708622a9-7465-4492-ade8-b827198f7e30',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1960261099',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T16:20:16Z,user_data=None,user_id='e45a882dbafb4ea4976e4f45289eb2b8',uuid=f66553f5-5e1b-4f1d-8c5a-63bc340f7586,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "27d05b76-8556-4365-9050-6bf871e85502", "address": "fa:16:3e:0d:13:8a", "network": {"id": "5a7877ff-8230-470b-90b5-e5dcfc8f0cee", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-779403873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2d09a74bf684a9fb1dd1e95d6c23f3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27d05b76-85", "ovs_interfaceid": "27d05b76-8556-4365-9050-6bf871e85502", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 16:20:24 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-97f2490e-fcb8-4270-90fa-ab115dfe706d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Converting VIF {"id": "27d05b76-8556-4365-9050-6bf871e85502", "address": "fa:16:3e:0d:13:8a", "network": {"id": "5a7877ff-8230-470b-90b5-e5dcfc8f0cee", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-779403873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2d09a74bf684a9fb1dd1e95d6c23f3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27d05b76-85", "ovs_interfaceid": "27d05b76-8556-4365-9050-6bf871e85502", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 16:20:24 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-97f2490e-fcb8-4270-90fa-ab115dfe706d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0d:13:8a,bridge_name='br-int',has_traffic_filtering=True,id=27d05b76-8556-4365-9050-6bf871e85502,network=Network(5a7877ff-8230-470b-90b5-e5dcfc8f0cee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27d05b76-85') {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 16:20:24 user nova-compute[71731]: DEBUG os_vif [None req-97f2490e-fcb8-4270-90fa-ab115dfe706d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:13:8a,bridge_name='br-int',has_traffic_filtering=True,id=27d05b76-8556-4365-9050-6bf871e85502,network=Network(5a7877ff-8230-470b-90b5-e5dcfc8f0cee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27d05b76-85') {{(pid=71731) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 16:20:24 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:20:24 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:20:24 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 16:20:25 user nova-compute[71731]: DEBUG nova.compute.manager [req-d0cd9bd7-ebce-4ed3-924c-f4ac3d565045 req-e2ca1072-ee78-4a69-b9ab-f35530f29f57 service nova] [instance: f66553f5-5e1b-4f1d-8c5a-63bc340f7586] Received event network-changed-27d05b76-8556-4365-9050-6bf871e85502 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:20:25 user nova-compute[71731]: DEBUG nova.compute.manager [req-d0cd9bd7-ebce-4ed3-924c-f4ac3d565045 req-e2ca1072-ee78-4a69-b9ab-f35530f29f57 service nova] [instance: f66553f5-5e1b-4f1d-8c5a-63bc340f7586] Refreshing instance network info cache due to event network-changed-27d05b76-8556-4365-9050-6bf871e85502. {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 16:20:25 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-d0cd9bd7-ebce-4ed3-924c-f4ac3d565045 req-e2ca1072-ee78-4a69-b9ab-f35530f29f57 service nova] Acquiring lock "refresh_cache-f66553f5-5e1b-4f1d-8c5a-63bc340f7586" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 16:20:25 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-d0cd9bd7-ebce-4ed3-924c-f4ac3d565045 req-e2ca1072-ee78-4a69-b9ab-f35530f29f57 service nova] Acquired lock "refresh_cache-f66553f5-5e1b-4f1d-8c5a-63bc340f7586" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 16:20:25 user nova-compute[71731]: DEBUG nova.network.neutron [req-d0cd9bd7-ebce-4ed3-924c-f4ac3d565045 req-e2ca1072-ee78-4a69-b9ab-f35530f29f57 service nova] [instance: f66553f5-5e1b-4f1d-8c5a-63bc340f7586] Refreshing network info cache for port 27d05b76-8556-4365-9050-6bf871e85502 {{(pid=71731) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 16:20:25 user nova-compute[71731]: DEBUG nova.network.neutron [req-211e1e8d-0be3-444a-81a4-a9dfb086e524 req-cabe0da4-679e-4f40-8875-fbb78d074488 service nova] [instance: 7973e93b-6311-44ed-91ff-e861c32d0277] Updated VIF entry in instance network info cache for port 8ae83a6c-4fc7-4e2c-8f83-7aece5c239cd. {{(pid=71731) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 16:20:25 user nova-compute[71731]: DEBUG nova.network.neutron [req-211e1e8d-0be3-444a-81a4-a9dfb086e524 req-cabe0da4-679e-4f40-8875-fbb78d074488 service nova] [instance: 7973e93b-6311-44ed-91ff-e861c32d0277] Updating instance_info_cache with network_info: [{"id": "8ae83a6c-4fc7-4e2c-8f83-7aece5c239cd", "address": "fa:16:3e:db:b9:e8", "network": {"id": "ae7f770e-a460-4297-91b5-ed0b908a895a", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1175970469-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5554aa7f1b4d471b8807a845ab1ea33f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ae83a6c-4f", "ovs_interfaceid": "8ae83a6c-4fc7-4e2c-8f83-7aece5c239cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:20:25 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-211e1e8d-0be3-444a-81a4-a9dfb086e524 req-cabe0da4-679e-4f40-8875-fbb78d074488 service nova] Releasing lock "refresh_cache-7973e93b-6311-44ed-91ff-e861c32d0277" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 16:20:25 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-82991644-6a62-4c17-9e63-e90e77888680 tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] Acquiring lock "823749e1-56ca-44f9-be83-a36b4851c28f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:20:25 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-82991644-6a62-4c17-9e63-e90e77888680 tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] Lock "823749e1-56ca-44f9-be83-a36b4851c28f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:20:25 user nova-compute[71731]: DEBUG nova.compute.manager [None req-82991644-6a62-4c17-9e63-e90e77888680 tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] [instance: 823749e1-56ca-44f9-be83-a36b4851c28f] Starting instance... {{(pid=71731) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 16:20:25 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-82991644-6a62-4c17-9e63-e90e77888680 tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:20:25 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-82991644-6a62-4c17-9e63-e90e77888680 tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:20:25 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-82991644-6a62-4c17-9e63-e90e77888680 tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71731) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 16:20:25 user nova-compute[71731]: INFO nova.compute.claims [None req-82991644-6a62-4c17-9e63-e90e77888680 tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] [instance: 823749e1-56ca-44f9-be83-a36b4851c28f] Claim successful on node user
Apr 13 16:20:25 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:20:25 user nova-compute[71731]: DEBUG nova.compute.provider_tree [None req-82991644-6a62-4c17-9e63-e90e77888680 tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] Inventory has not changed in ProviderTree for provider: cb6b1a64-0c24-4e2d-af1e-16576ca9165c {{(pid=71731) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 16:20:25 user nova-compute[71731]: DEBUG nova.scheduler.client.report [None req-82991644-6a62-4c17-9e63-e90e77888680 tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] Inventory has not changed for provider cb6b1a64-0c24-4e2d-af1e-16576ca9165c based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71731) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 16:20:26 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-82991644-6a62-4c17-9e63-e90e77888680 tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.313s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:20:26 user nova-compute[71731]: DEBUG nova.compute.manager [None req-82991644-6a62-4c17-9e63-e90e77888680 tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] [instance: 823749e1-56ca-44f9-be83-a36b4851c28f] Start building networks asynchronously for instance. {{(pid=71731) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 16:20:26 user nova-compute[71731]: DEBUG nova.compute.manager [None req-82991644-6a62-4c17-9e63-e90e77888680 tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] [instance: 823749e1-56ca-44f9-be83-a36b4851c28f] Allocating IP information in the background. {{(pid=71731) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 16:20:26 user nova-compute[71731]: DEBUG nova.network.neutron [None req-82991644-6a62-4c17-9e63-e90e77888680 tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] [instance: 823749e1-56ca-44f9-be83-a36b4851c28f] allocate_for_instance() {{(pid=71731) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 16:20:26 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-82991644-6a62-4c17-9e63-e90e77888680 tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] [instance: 823749e1-56ca-44f9-be83-a36b4851c28f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 16:20:26 user nova-compute[71731]: DEBUG nova.compute.manager [None req-82991644-6a62-4c17-9e63-e90e77888680 tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] [instance: 823749e1-56ca-44f9-be83-a36b4851c28f] Start building block device mappings for instance. {{(pid=71731) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 16:20:26 user sudo[80504]: pam_unix(sudo:session): session closed for user root
Apr 13 16:20:26 user nova-compute[71731]: INFO oslo.privsep.daemon [None req-427fe007-2b18-4173-a9ac-7524b5682f0e tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Spawned new privsep daemon via rootwrap
Apr 13 16:20:26 user nova-compute[71731]: INFO oslo.privsep.daemon [-] privsep daemon starting
Apr 13 16:20:26 user nova-compute[71731]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Apr 13 16:20:26 user nova-compute[71731]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Apr 13 16:20:26 user nova-compute[71731]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 80519
Apr 13 16:20:26 user nova-compute[71731]: WARNING oslo_privsep.priv_context [None req-97f2490e-fcb8-4270-90fa-ab115dfe706d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] privsep daemon already running
Apr 13 16:20:26 user nova-compute[71731]: DEBUG nova.compute.manager [None req-82991644-6a62-4c17-9e63-e90e77888680 tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] [instance: 823749e1-56ca-44f9-be83-a36b4851c28f] Start spawning the instance on the hypervisor. {{(pid=71731) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 16:20:26 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-82991644-6a62-4c17-9e63-e90e77888680 tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] [instance: 823749e1-56ca-44f9-be83-a36b4851c28f] Creating instance directory {{(pid=71731) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 16:20:26 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-82991644-6a62-4c17-9e63-e90e77888680 tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] [instance: 823749e1-56ca-44f9-be83-a36b4851c28f] Creating image(s)
Apr 13 16:20:26 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-82991644-6a62-4c17-9e63-e90e77888680 tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] Acquiring lock "/opt/stack/data/nova/instances/823749e1-56ca-44f9-be83-a36b4851c28f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:20:26 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-82991644-6a62-4c17-9e63-e90e77888680 tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] Lock "/opt/stack/data/nova/instances/823749e1-56ca-44f9-be83-a36b4851c28f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:20:26 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-82991644-6a62-4c17-9e63-e90e77888680 tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] Lock "/opt/stack/data/nova/instances/823749e1-56ca-44f9-be83-a36b4851c28f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:20:26 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-82991644-6a62-4c17-9e63-e90e77888680 tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279 --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:20:26 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-82991644-6a62-4c17-9e63-e90e77888680 tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279 --force-share --output=json" returned: 0 in 0.155s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:20:26 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-82991644-6a62-4c17-9e63-e90e77888680 tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] Acquiring lock "9524227dd898575c3099d3976f096cd935414279" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:20:26 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-82991644-6a62-4c17-9e63-e90e77888680 tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] Lock "9524227dd898575c3099d3976f096cd935414279" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:20:26 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-82991644-6a62-4c17-9e63-e90e77888680 tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279 --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:20:26 user nova-compute[71731]: DEBUG nova.network.neutron [req-d0cd9bd7-ebce-4ed3-924c-f4ac3d565045 req-e2ca1072-ee78-4a69-b9ab-f35530f29f57 service nova] [instance: f66553f5-5e1b-4f1d-8c5a-63bc340f7586] Updated VIF entry in instance network info cache for port 27d05b76-8556-4365-9050-6bf871e85502. {{(pid=71731) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 16:20:26 user nova-compute[71731]: DEBUG nova.network.neutron [req-d0cd9bd7-ebce-4ed3-924c-f4ac3d565045 req-e2ca1072-ee78-4a69-b9ab-f35530f29f57 service nova] [instance: f66553f5-5e1b-4f1d-8c5a-63bc340f7586] Updating instance_info_cache with network_info: [{"id": "27d05b76-8556-4365-9050-6bf871e85502", "address": "fa:16:3e:0d:13:8a", "network": {"id": "5a7877ff-8230-470b-90b5-e5dcfc8f0cee", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-779403873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2d09a74bf684a9fb1dd1e95d6c23f3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27d05b76-85", "ovs_interfaceid": "27d05b76-8556-4365-9050-6bf871e85502", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:20:26 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-d0cd9bd7-ebce-4ed3-924c-f4ac3d565045 req-e2ca1072-ee78-4a69-b9ab-f35530f29f57 service nova] Releasing lock "refresh_cache-f66553f5-5e1b-4f1d-8c5a-63bc340f7586" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 16:20:26 user nova-compute[71731]: DEBUG nova.policy [None req-82991644-6a62-4c17-9e63-e90e77888680 tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '55d232911f5742aa83146f19f13dd198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '608ff87aadc7408e9010212fd5f482b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71731) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 16:20:26 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-82991644-6a62-4c17-9e63-e90e77888680 tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279 --force-share --output=json" returned: 0 in 0.171s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:20:26 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-82991644-6a62-4c17-9e63-e90e77888680 tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279,backing_fmt=raw /opt/stack/data/nova/instances/823749e1-56ca-44f9-be83-a36b4851c28f/disk 1073741824 {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:20:26 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-82991644-6a62-4c17-9e63-e90e77888680 tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279,backing_fmt=raw /opt/stack/data/nova/instances/823749e1-56ca-44f9-be83-a36b4851c28f/disk 1073741824" returned: 0 in 0.049s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:20:26 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-82991644-6a62-4c17-9e63-e90e77888680 tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] Lock "9524227dd898575c3099d3976f096cd935414279" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.223s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:20:26 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-82991644-6a62-4c17-9e63-e90e77888680 tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279 --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:20:26 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:20:26 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap27d05b76-85, may_exist=True) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:20:26 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap27d05b76-85, col_values=(('external_ids', {'iface-id': '27d05b76-8556-4365-9050-6bf871e85502', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0d:13:8a', 'vm-uuid': 'f66553f5-5e1b-4f1d-8c5a-63bc340f7586'}),)) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:20:26 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:20:26 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 16:20:26 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:20:26 user nova-compute[71731]: INFO os_vif [None req-97f2490e-fcb8-4270-90fa-ab115dfe706d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:13:8a,bridge_name='br-int',has_traffic_filtering=True,id=27d05b76-8556-4365-9050-6bf871e85502,network=Network(5a7877ff-8230-470b-90b5-e5dcfc8f0cee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27d05b76-85')
Apr 13 16:20:26 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:20:26 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8ae83a6c-4f, may_exist=True) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:20:26 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8ae83a6c-4f, col_values=(('external_ids', {'iface-id': '8ae83a6c-4fc7-4e2c-8f83-7aece5c239cd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:db:b9:e8', 'vm-uuid': '7973e93b-6311-44ed-91ff-e861c32d0277'}),)) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:20:26 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:20:26 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 16:20:26 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:20:26 user nova-compute[71731]: INFO os_vif [None req-427fe007-2b18-4173-a9ac-7524b5682f0e tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:b9:e8,bridge_name='br-int',has_traffic_filtering=True,id=8ae83a6c-4fc7-4e2c-8f83-7aece5c239cd,network=Network(ae7f770e-a460-4297-91b5-ed0b908a895a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ae83a6c-4f')
Apr 13 16:20:26 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-82991644-6a62-4c17-9e63-e90e77888680 tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279 --force-share --output=json" returned: 0 in 0.135s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:20:26 user nova-compute[71731]: DEBUG nova.virt.disk.api [None req-82991644-6a62-4c17-9e63-e90e77888680 tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] Checking if we can resize image /opt/stack/data/nova/instances/823749e1-56ca-44f9-be83-a36b4851c28f/disk. size=1073741824 {{(pid=71731) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 16:20:26 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-82991644-6a62-4c17-9e63-e90e77888680 tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/823749e1-56ca-44f9-be83-a36b4851c28f/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:20:26 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-97f2490e-fcb8-4270-90fa-ab115dfe706d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] No BDM found with device name vda, not building metadata. {{(pid=71731) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 16:20:26 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-97f2490e-fcb8-4270-90fa-ab115dfe706d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] No VIF found with MAC fa:16:3e:0d:13:8a, not building metadata {{(pid=71731) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 16:20:26 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-427fe007-2b18-4173-a9ac-7524b5682f0e tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] No BDM found with device name vda, not building metadata. {{(pid=71731) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 16:20:26 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-427fe007-2b18-4173-a9ac-7524b5682f0e tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] No VIF found with MAC fa:16:3e:db:b9:e8, not building metadata {{(pid=71731) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 16:20:27 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-82991644-6a62-4c17-9e63-e90e77888680 tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/823749e1-56ca-44f9-be83-a36b4851c28f/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:20:27 user nova-compute[71731]: DEBUG nova.virt.disk.api [None req-82991644-6a62-4c17-9e63-e90e77888680 tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] Cannot resize image /opt/stack/data/nova/instances/823749e1-56ca-44f9-be83-a36b4851c28f/disk to a smaller size. {{(pid=71731) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 16:20:27 user nova-compute[71731]: DEBUG nova.objects.instance [None req-82991644-6a62-4c17-9e63-e90e77888680 tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] Lazy-loading 'migration_context' on Instance uuid 823749e1-56ca-44f9-be83-a36b4851c28f {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:20:27 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-82991644-6a62-4c17-9e63-e90e77888680 tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] [instance: 823749e1-56ca-44f9-be83-a36b4851c28f] Created local disks {{(pid=71731) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 16:20:27 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-82991644-6a62-4c17-9e63-e90e77888680 tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] [instance: 823749e1-56ca-44f9-be83-a36b4851c28f] Ensure instance console log exists: /opt/stack/data/nova/instances/823749e1-56ca-44f9-be83-a36b4851c28f/console.log {{(pid=71731) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 16:20:27 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-82991644-6a62-4c17-9e63-e90e77888680 tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:20:27 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-82991644-6a62-4c17-9e63-e90e77888680 tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:20:27 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-82991644-6a62-4c17-9e63-e90e77888680 tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:20:28 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-f0db01f4-bdd2-4695-a17b-6cc5c1b51736 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Acquiring lock "bbcccf4b-e861-4254-9be3-a491776214e9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:20:28 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-f0db01f4-bdd2-4695-a17b-6cc5c1b51736 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Lock "bbcccf4b-e861-4254-9be3-a491776214e9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:20:28 user nova-compute[71731]: DEBUG nova.compute.manager [None req-f0db01f4-bdd2-4695-a17b-6cc5c1b51736 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] [instance: bbcccf4b-e861-4254-9be3-a491776214e9] Starting instance... {{(pid=71731) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 16:20:28 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-f0db01f4-bdd2-4695-a17b-6cc5c1b51736 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:20:28 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-f0db01f4-bdd2-4695-a17b-6cc5c1b51736 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:20:28 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-f0db01f4-bdd2-4695-a17b-6cc5c1b51736 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71731) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 16:20:28 user nova-compute[71731]: INFO nova.compute.claims [None req-f0db01f4-bdd2-4695-a17b-6cc5c1b51736 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] [instance: bbcccf4b-e861-4254-9be3-a491776214e9] Claim successful on node user
Apr 13 16:20:28 user nova-compute[71731]: DEBUG nova.compute.provider_tree [None req-f0db01f4-bdd2-4695-a17b-6cc5c1b51736 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Inventory has not changed in ProviderTree for provider: cb6b1a64-0c24-4e2d-af1e-16576ca9165c {{(pid=71731) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 16:20:28 user nova-compute[71731]: DEBUG nova.scheduler.client.report [None req-f0db01f4-bdd2-4695-a17b-6cc5c1b51736 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Inventory has not changed for provider cb6b1a64-0c24-4e2d-af1e-16576ca9165c based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71731) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 16:20:28 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-f0db01f4-bdd2-4695-a17b-6cc5c1b51736 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.333s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:20:28 user nova-compute[71731]: DEBUG nova.compute.manager [None req-f0db01f4-bdd2-4695-a17b-6cc5c1b51736 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] [instance: bbcccf4b-e861-4254-9be3-a491776214e9] Start building networks asynchronously for instance. {{(pid=71731) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 16:20:28 user nova-compute[71731]: DEBUG nova.network.neutron [None req-82991644-6a62-4c17-9e63-e90e77888680 tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] [instance: 823749e1-56ca-44f9-be83-a36b4851c28f] Successfully created port: f4e8f99d-1c8f-44b8-84f1-0f43a156e8b0 {{(pid=71731) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 16:20:28 user nova-compute[71731]: DEBUG nova.compute.manager [None req-f0db01f4-bdd2-4695-a17b-6cc5c1b51736 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] [instance: bbcccf4b-e861-4254-9be3-a491776214e9] Allocating IP information in the background. {{(pid=71731) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 16:20:28 user nova-compute[71731]: DEBUG nova.network.neutron [None req-f0db01f4-bdd2-4695-a17b-6cc5c1b51736 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] [instance: bbcccf4b-e861-4254-9be3-a491776214e9] allocate_for_instance() {{(pid=71731) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 16:20:28 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-f0db01f4-bdd2-4695-a17b-6cc5c1b51736 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] [instance: bbcccf4b-e861-4254-9be3-a491776214e9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 16:20:28 user nova-compute[71731]: DEBUG nova.compute.manager [None req-f0db01f4-bdd2-4695-a17b-6cc5c1b51736 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] [instance: bbcccf4b-e861-4254-9be3-a491776214e9] Start building block device mappings for instance. {{(pid=71731) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 16:20:28 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:20:29 user nova-compute[71731]: DEBUG nova.compute.manager [None req-f0db01f4-bdd2-4695-a17b-6cc5c1b51736 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] [instance: bbcccf4b-e861-4254-9be3-a491776214e9] Start spawning the instance on the hypervisor. {{(pid=71731) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 16:20:29 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-f0db01f4-bdd2-4695-a17b-6cc5c1b51736 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] [instance: bbcccf4b-e861-4254-9be3-a491776214e9] Creating instance directory {{(pid=71731) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 16:20:29 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-f0db01f4-bdd2-4695-a17b-6cc5c1b51736 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] [instance: bbcccf4b-e861-4254-9be3-a491776214e9] Creating image(s)
Apr 13 16:20:29 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-f0db01f4-bdd2-4695-a17b-6cc5c1b51736 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Acquiring lock "/opt/stack/data/nova/instances/bbcccf4b-e861-4254-9be3-a491776214e9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:20:29 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-f0db01f4-bdd2-4695-a17b-6cc5c1b51736 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Lock "/opt/stack/data/nova/instances/bbcccf4b-e861-4254-9be3-a491776214e9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:20:29 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-f0db01f4-bdd2-4695-a17b-6cc5c1b51736 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Lock "/opt/stack/data/nova/instances/bbcccf4b-e861-4254-9be3-a491776214e9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:20:29 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-f0db01f4-bdd2-4695-a17b-6cc5c1b51736 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279 --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:20:29 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-f0db01f4-bdd2-4695-a17b-6cc5c1b51736 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279 --force-share --output=json" returned: 0 in 0.148s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:20:29 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-f0db01f4-bdd2-4695-a17b-6cc5c1b51736 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Acquiring lock "9524227dd898575c3099d3976f096cd935414279" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:20:29 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-f0db01f4-bdd2-4695-a17b-6cc5c1b51736 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Lock "9524227dd898575c3099d3976f096cd935414279" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:20:29 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-f0db01f4-bdd2-4695-a17b-6cc5c1b51736 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279 --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:20:29 user nova-compute[71731]: DEBUG nova.policy [None req-f0db01f4-bdd2-4695-a17b-6cc5c1b51736 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9bf19848229f45baad45c490cf539508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7061f2f041954ffe90b0c87b422890e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71731) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 16:20:29 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:20:29 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:20:29 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:20:29 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:20:29 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-f0db01f4-bdd2-4695-a17b-6cc5c1b51736 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279 --force-share --output=json" returned: 0 in 0.145s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:20:29 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-f0db01f4-bdd2-4695-a17b-6cc5c1b51736 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279,backing_fmt=raw /opt/stack/data/nova/instances/bbcccf4b-e861-4254-9be3-a491776214e9/disk 1073741824 {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:20:29 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:20:29 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-f0db01f4-bdd2-4695-a17b-6cc5c1b51736 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279,backing_fmt=raw /opt/stack/data/nova/instances/bbcccf4b-e861-4254-9be3-a491776214e9/disk 1073741824" returned: 0 in 0.059s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:20:29 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-f0db01f4-bdd2-4695-a17b-6cc5c1b51736 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Lock "9524227dd898575c3099d3976f096cd935414279" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.215s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:20:29 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-f0db01f4-bdd2-4695-a17b-6cc5c1b51736 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279 --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:20:29 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:20:29 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-f0db01f4-bdd2-4695-a17b-6cc5c1b51736 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279 --force-share --output=json" returned: 0 in 0.139s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:20:29 user nova-compute[71731]: DEBUG nova.virt.disk.api [None req-f0db01f4-bdd2-4695-a17b-6cc5c1b51736 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bbcccf4b-e861-4254-9be3-a491776214e9/disk. size=1073741824 {{(pid=71731) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 16:20:29 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-f0db01f4-bdd2-4695-a17b-6cc5c1b51736 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbcccf4b-e861-4254-9be3-a491776214e9/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:20:29 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:20:29 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:20:29 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-f0db01f4-bdd2-4695-a17b-6cc5c1b51736 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbcccf4b-e861-4254-9be3-a491776214e9/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:20:29 user nova-compute[71731]: DEBUG nova.virt.disk.api [None req-f0db01f4-bdd2-4695-a17b-6cc5c1b51736 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Cannot resize image /opt/stack/data/nova/instances/bbcccf4b-e861-4254-9be3-a491776214e9/disk to a smaller size. {{(pid=71731) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 16:20:29 user nova-compute[71731]: DEBUG nova.objects.instance [None req-f0db01f4-bdd2-4695-a17b-6cc5c1b51736 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Lazy-loading 'migration_context' on Instance uuid bbcccf4b-e861-4254-9be3-a491776214e9 {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:20:29 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-f0db01f4-bdd2-4695-a17b-6cc5c1b51736 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] [instance: bbcccf4b-e861-4254-9be3-a491776214e9] Created local disks {{(pid=71731) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 16:20:29 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-f0db01f4-bdd2-4695-a17b-6cc5c1b51736 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] [instance: bbcccf4b-e861-4254-9be3-a491776214e9] Ensure instance console log exists: /opt/stack/data/nova/instances/bbcccf4b-e861-4254-9be3-a491776214e9/console.log {{(pid=71731) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 16:20:29 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-f0db01f4-bdd2-4695-a17b-6cc5c1b51736 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:20:29 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-f0db01f4-bdd2-4695-a17b-6cc5c1b51736 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:20:29 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-f0db01f4-bdd2-4695-a17b-6cc5c1b51736 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:20:30 user nova-compute[71731]: DEBUG nova.compute.manager [req-3b19d7fe-bb20-4ab7-b958-7f085d2db9cc req-5e5b866f-ac2e-42ec-bb87-7acde48d6605 service nova] [instance: f66553f5-5e1b-4f1d-8c5a-63bc340f7586] Received event network-vif-plugged-27d05b76-8556-4365-9050-6bf871e85502 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:20:30 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-3b19d7fe-bb20-4ab7-b958-7f085d2db9cc req-5e5b866f-ac2e-42ec-bb87-7acde48d6605 service nova] Acquiring lock "f66553f5-5e1b-4f1d-8c5a-63bc340f7586-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:20:30 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-3b19d7fe-bb20-4ab7-b958-7f085d2db9cc req-5e5b866f-ac2e-42ec-bb87-7acde48d6605 service nova] Lock "f66553f5-5e1b-4f1d-8c5a-63bc340f7586-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:20:30 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-3b19d7fe-bb20-4ab7-b958-7f085d2db9cc req-5e5b866f-ac2e-42ec-bb87-7acde48d6605 service nova] Lock "f66553f5-5e1b-4f1d-8c5a-63bc340f7586-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:20:30 user nova-compute[71731]: DEBUG nova.compute.manager [req-3b19d7fe-bb20-4ab7-b958-7f085d2db9cc req-5e5b866f-ac2e-42ec-bb87-7acde48d6605 service nova] [instance: f66553f5-5e1b-4f1d-8c5a-63bc340f7586] No waiting events found dispatching network-vif-plugged-27d05b76-8556-4365-9050-6bf871e85502 {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:20:30 user nova-compute[71731]: WARNING nova.compute.manager [req-3b19d7fe-bb20-4ab7-b958-7f085d2db9cc req-5e5b866f-ac2e-42ec-bb87-7acde48d6605 service nova] [instance: f66553f5-5e1b-4f1d-8c5a-63bc340f7586] Received unexpected event network-vif-plugged-27d05b76-8556-4365-9050-6bf871e85502 for instance with vm_state building and task_state spawning.
Apr 13 16:20:30 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:20:30 user nova-compute[71731]: DEBUG nova.compute.manager [req-f47f5fbd-0c1a-4835-b1fa-cede67930a1b req-4506befa-ff1f-4362-999c-bb2ef31c0bb1 service nova] [instance: 7973e93b-6311-44ed-91ff-e861c32d0277] Received event network-vif-plugged-8ae83a6c-4fc7-4e2c-8f83-7aece5c239cd {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:20:30 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-f47f5fbd-0c1a-4835-b1fa-cede67930a1b req-4506befa-ff1f-4362-999c-bb2ef31c0bb1 service nova] Acquiring lock "7973e93b-6311-44ed-91ff-e861c32d0277-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:20:30 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-f47f5fbd-0c1a-4835-b1fa-cede67930a1b req-4506befa-ff1f-4362-999c-bb2ef31c0bb1 service nova] Lock "7973e93b-6311-44ed-91ff-e861c32d0277-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:20:30 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-f47f5fbd-0c1a-4835-b1fa-cede67930a1b req-4506befa-ff1f-4362-999c-bb2ef31c0bb1 service nova] Lock "7973e93b-6311-44ed-91ff-e861c32d0277-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:20:30 user nova-compute[71731]: DEBUG nova.compute.manager [req-f47f5fbd-0c1a-4835-b1fa-cede67930a1b req-4506befa-ff1f-4362-999c-bb2ef31c0bb1 service nova] [instance: 7973e93b-6311-44ed-91ff-e861c32d0277] No waiting events found dispatching network-vif-plugged-8ae83a6c-4fc7-4e2c-8f83-7aece5c239cd {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:20:30 user nova-compute[71731]: WARNING nova.compute.manager [req-f47f5fbd-0c1a-4835-b1fa-cede67930a1b req-4506befa-ff1f-4362-999c-bb2ef31c0bb1 service nova] [instance: 7973e93b-6311-44ed-91ff-e861c32d0277] Received unexpected event network-vif-plugged-8ae83a6c-4fc7-4e2c-8f83-7aece5c239cd for instance with vm_state building and task_state spawning.
Apr 13 16:20:30 user nova-compute[71731]: DEBUG nova.network.neutron [None req-82991644-6a62-4c17-9e63-e90e77888680 tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] [instance: 823749e1-56ca-44f9-be83-a36b4851c28f] Successfully updated port: f4e8f99d-1c8f-44b8-84f1-0f43a156e8b0 {{(pid=71731) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 16:20:30 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-82991644-6a62-4c17-9e63-e90e77888680 tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] Acquiring lock "refresh_cache-823749e1-56ca-44f9-be83-a36b4851c28f" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 16:20:30 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-82991644-6a62-4c17-9e63-e90e77888680 tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] Acquired lock "refresh_cache-823749e1-56ca-44f9-be83-a36b4851c28f" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 16:20:30 user nova-compute[71731]: DEBUG nova.network.neutron [None req-82991644-6a62-4c17-9e63-e90e77888680 tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] [instance: 823749e1-56ca-44f9-be83-a36b4851c28f] Building network info cache for instance {{(pid=71731) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 16:20:31 user nova-compute[71731]: DEBUG nova.compute.manager [req-c2d6dff8-7759-4339-bc73-f5188ac40187 req-9876ec92-ca52-434f-936b-d24d2257b97d service nova] [instance: 823749e1-56ca-44f9-be83-a36b4851c28f] Received event network-changed-f4e8f99d-1c8f-44b8-84f1-0f43a156e8b0 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:20:31 user nova-compute[71731]: DEBUG nova.compute.manager [req-c2d6dff8-7759-4339-bc73-f5188ac40187 req-9876ec92-ca52-434f-936b-d24d2257b97d service nova] [instance: 823749e1-56ca-44f9-be83-a36b4851c28f] Refreshing instance network info cache due to event network-changed-f4e8f99d-1c8f-44b8-84f1-0f43a156e8b0. {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 16:20:31 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-c2d6dff8-7759-4339-bc73-f5188ac40187 req-9876ec92-ca52-434f-936b-d24d2257b97d service nova] Acquiring lock "refresh_cache-823749e1-56ca-44f9-be83-a36b4851c28f" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 16:20:31 user nova-compute[71731]: DEBUG nova.network.neutron [None req-82991644-6a62-4c17-9e63-e90e77888680 tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] [instance: 823749e1-56ca-44f9-be83-a36b4851c28f] Instance cache missing network info. {{(pid=71731) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 16:20:31 user nova-compute[71731]: DEBUG nova.network.neutron [None req-f0db01f4-bdd2-4695-a17b-6cc5c1b51736 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] [instance: bbcccf4b-e861-4254-9be3-a491776214e9] Successfully created port: dbb2bf27-5de3-499c-ba4d-87867912a143 {{(pid=71731) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 16:20:31 user nova-compute[71731]: DEBUG nova.compute.manager [None req-97f2490e-fcb8-4270-90fa-ab115dfe706d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: f66553f5-5e1b-4f1d-8c5a-63bc340f7586] Instance event wait completed in 0 seconds for  {{(pid=71731) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 16:20:31 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-97f2490e-fcb8-4270-90fa-ab115dfe706d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: f66553f5-5e1b-4f1d-8c5a-63bc340f7586] Guest created on hypervisor {{(pid=71731) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 16:20:31 user nova-compute[71731]: DEBUG nova.virt.driver [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Emitting event <LifecycleEvent: 1681402831.793633, f66553f5-5e1b-4f1d-8c5a-63bc340f7586 => Resumed> {{(pid=71731) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 16:20:31 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: f66553f5-5e1b-4f1d-8c5a-63bc340f7586] VM Resumed (Lifecycle Event)
Apr 13 16:20:31 user nova-compute[71731]: DEBUG nova.compute.manager [None req-427fe007-2b18-4173-a9ac-7524b5682f0e tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] [instance: 7973e93b-6311-44ed-91ff-e861c32d0277] Instance event wait completed in 0 seconds for  {{(pid=71731) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 16:20:31 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-427fe007-2b18-4173-a9ac-7524b5682f0e tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] [instance: 7973e93b-6311-44ed-91ff-e861c32d0277] Guest created on hypervisor {{(pid=71731) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 16:20:31 user nova-compute[71731]: INFO nova.virt.libvirt.driver [-] [instance: f66553f5-5e1b-4f1d-8c5a-63bc340f7586] Instance spawned successfully.
Apr 13 16:20:31 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-97f2490e-fcb8-4270-90fa-ab115dfe706d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: f66553f5-5e1b-4f1d-8c5a-63bc340f7586] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 16:20:31 user nova-compute[71731]: INFO nova.virt.libvirt.driver [-] [instance: 7973e93b-6311-44ed-91ff-e861c32d0277] Instance spawned successfully.
Apr 13 16:20:31 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-427fe007-2b18-4173-a9ac-7524b5682f0e tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] [instance: 7973e93b-6311-44ed-91ff-e861c32d0277] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 16:20:31 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:20:31 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: f66553f5-5e1b-4f1d-8c5a-63bc340f7586] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:20:31 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-427fe007-2b18-4173-a9ac-7524b5682f0e tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] [instance: 7973e93b-6311-44ed-91ff-e861c32d0277] Found default for hw_cdrom_bus of ide {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:20:31 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-427fe007-2b18-4173-a9ac-7524b5682f0e tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] [instance: 7973e93b-6311-44ed-91ff-e861c32d0277] Found default for hw_disk_bus of virtio {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:20:31 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-427fe007-2b18-4173-a9ac-7524b5682f0e tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] [instance: 7973e93b-6311-44ed-91ff-e861c32d0277] Found default for hw_input_bus of None {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:20:31 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-427fe007-2b18-4173-a9ac-7524b5682f0e tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] [instance: 7973e93b-6311-44ed-91ff-e861c32d0277] Found default for hw_pointer_model of None {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:20:31 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-427fe007-2b18-4173-a9ac-7524b5682f0e tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] [instance: 7973e93b-6311-44ed-91ff-e861c32d0277] Found default for hw_video_model of virtio {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:20:31 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-427fe007-2b18-4173-a9ac-7524b5682f0e tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] [instance: 7973e93b-6311-44ed-91ff-e861c32d0277] Found default for hw_vif_model of virtio {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:20:31 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-97f2490e-fcb8-4270-90fa-ab115dfe706d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: f66553f5-5e1b-4f1d-8c5a-63bc340f7586] Found default for hw_cdrom_bus of ide {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:20:31 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-97f2490e-fcb8-4270-90fa-ab115dfe706d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: f66553f5-5e1b-4f1d-8c5a-63bc340f7586] Found default for hw_disk_bus of virtio {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:20:31 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-97f2490e-fcb8-4270-90fa-ab115dfe706d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: f66553f5-5e1b-4f1d-8c5a-63bc340f7586] Found default for hw_input_bus of None {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:20:31 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-97f2490e-fcb8-4270-90fa-ab115dfe706d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: f66553f5-5e1b-4f1d-8c5a-63bc340f7586] Found default for hw_pointer_model of None {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:20:31 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-97f2490e-fcb8-4270-90fa-ab115dfe706d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: f66553f5-5e1b-4f1d-8c5a-63bc340f7586] Found default for hw_video_model of virtio {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:20:31 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-97f2490e-fcb8-4270-90fa-ab115dfe706d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: f66553f5-5e1b-4f1d-8c5a-63bc340f7586] Found default for hw_vif_model of virtio {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:20:31 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: f66553f5-5e1b-4f1d-8c5a-63bc340f7586] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71731) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 16:20:32 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: f66553f5-5e1b-4f1d-8c5a-63bc340f7586] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 16:20:32 user nova-compute[71731]: DEBUG nova.virt.driver [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Emitting event <LifecycleEvent: 1681402831.7938757, f66553f5-5e1b-4f1d-8c5a-63bc340f7586 => Started> {{(pid=71731) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 16:20:32 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: f66553f5-5e1b-4f1d-8c5a-63bc340f7586] VM Started (Lifecycle Event)
Apr 13 16:20:32 user nova-compute[71731]: INFO nova.compute.manager [None req-427fe007-2b18-4173-a9ac-7524b5682f0e tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] [instance: 7973e93b-6311-44ed-91ff-e861c32d0277] Took 15.89 seconds to spawn the instance on the hypervisor.
Apr 13 16:20:32 user nova-compute[71731]: DEBUG nova.compute.manager [None req-427fe007-2b18-4173-a9ac-7524b5682f0e tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] [instance: 7973e93b-6311-44ed-91ff-e861c32d0277] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:20:32 user nova-compute[71731]: INFO nova.compute.manager [None req-97f2490e-fcb8-4270-90fa-ab115dfe706d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: f66553f5-5e1b-4f1d-8c5a-63bc340f7586] Took 15.74 seconds to spawn the instance on the hypervisor.
Apr 13 16:20:32 user nova-compute[71731]: DEBUG nova.compute.manager [None req-97f2490e-fcb8-4270-90fa-ab115dfe706d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: f66553f5-5e1b-4f1d-8c5a-63bc340f7586] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:20:32 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: f66553f5-5e1b-4f1d-8c5a-63bc340f7586] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:20:32 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: f66553f5-5e1b-4f1d-8c5a-63bc340f7586] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71731) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 16:20:32 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: f66553f5-5e1b-4f1d-8c5a-63bc340f7586] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 16:20:32 user nova-compute[71731]: DEBUG nova.virt.driver [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Emitting event <LifecycleEvent: 1681402831.794101, 7973e93b-6311-44ed-91ff-e861c32d0277 => Resumed> {{(pid=71731) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 16:20:32 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 7973e93b-6311-44ed-91ff-e861c32d0277] VM Resumed (Lifecycle Event)
Apr 13 16:20:32 user nova-compute[71731]: INFO nova.compute.manager [None req-97f2490e-fcb8-4270-90fa-ab115dfe706d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: f66553f5-5e1b-4f1d-8c5a-63bc340f7586] Took 16.97 seconds to build instance.
Apr 13 16:20:32 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 7973e93b-6311-44ed-91ff-e861c32d0277] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:20:32 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 7973e93b-6311-44ed-91ff-e861c32d0277] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71731) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 16:20:32 user nova-compute[71731]: INFO nova.compute.manager [None req-427fe007-2b18-4173-a9ac-7524b5682f0e tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] [instance: 7973e93b-6311-44ed-91ff-e861c32d0277] Took 17.09 seconds to build instance.
Apr 13 16:20:32 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-97f2490e-fcb8-4270-90fa-ab115dfe706d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lock "f66553f5-5e1b-4f1d-8c5a-63bc340f7586" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.270s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:20:32 user nova-compute[71731]: DEBUG nova.virt.driver [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Emitting event <LifecycleEvent: 1681402831.794181, 7973e93b-6311-44ed-91ff-e861c32d0277 => Started> {{(pid=71731) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 16:20:32 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 7973e93b-6311-44ed-91ff-e861c32d0277] VM Started (Lifecycle Event)
Apr 13 16:20:32 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-427fe007-2b18-4173-a9ac-7524b5682f0e tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Lock "7973e93b-6311-44ed-91ff-e861c32d0277" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.363s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:20:32 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 7973e93b-6311-44ed-91ff-e861c32d0277] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:20:32 user nova-compute[71731]: DEBUG nova.compute.manager [req-f5c08ff1-2494-4318-ae31-4279812f3d6a req-bc85f41e-3bf4-48d9-aedf-1b6f1bc8b5b1 service nova] [instance: f66553f5-5e1b-4f1d-8c5a-63bc340f7586] Received event network-vif-plugged-27d05b76-8556-4365-9050-6bf871e85502 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:20:32 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-f5c08ff1-2494-4318-ae31-4279812f3d6a req-bc85f41e-3bf4-48d9-aedf-1b6f1bc8b5b1 service nova] Acquiring lock "f66553f5-5e1b-4f1d-8c5a-63bc340f7586-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:20:32 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-f5c08ff1-2494-4318-ae31-4279812f3d6a req-bc85f41e-3bf4-48d9-aedf-1b6f1bc8b5b1 service nova] Lock "f66553f5-5e1b-4f1d-8c5a-63bc340f7586-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:20:32 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-f5c08ff1-2494-4318-ae31-4279812f3d6a req-bc85f41e-3bf4-48d9-aedf-1b6f1bc8b5b1 service nova] Lock "f66553f5-5e1b-4f1d-8c5a-63bc340f7586-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:20:32 user nova-compute[71731]: DEBUG nova.compute.manager [req-f5c08ff1-2494-4318-ae31-4279812f3d6a req-bc85f41e-3bf4-48d9-aedf-1b6f1bc8b5b1 service nova] [instance: f66553f5-5e1b-4f1d-8c5a-63bc340f7586] No waiting events found dispatching network-vif-plugged-27d05b76-8556-4365-9050-6bf871e85502 {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:20:32 user nova-compute[71731]: WARNING nova.compute.manager [req-f5c08ff1-2494-4318-ae31-4279812f3d6a req-bc85f41e-3bf4-48d9-aedf-1b6f1bc8b5b1 service nova] [instance: f66553f5-5e1b-4f1d-8c5a-63bc340f7586] Received unexpected event network-vif-plugged-27d05b76-8556-4365-9050-6bf871e85502 for instance with vm_state active and task_state None.
Apr 13 16:20:32 user nova-compute[71731]: DEBUG nova.network.neutron [None req-82991644-6a62-4c17-9e63-e90e77888680 tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] [instance: 823749e1-56ca-44f9-be83-a36b4851c28f] Updating instance_info_cache with network_info: [{"id": "f4e8f99d-1c8f-44b8-84f1-0f43a156e8b0", "address": "fa:16:3e:58:82:03", "network": {"id": "39832acb-f932-4804-a559-967d9d0ae0ad", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-174129869-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "608ff87aadc7408e9010212fd5f482b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4e8f99d-1c", "ovs_interfaceid": "f4e8f99d-1c8f-44b8-84f1-0f43a156e8b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:20:32 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 7973e93b-6311-44ed-91ff-e861c32d0277] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=71731) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 16:20:32 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-82991644-6a62-4c17-9e63-e90e77888680 tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] Releasing lock "refresh_cache-823749e1-56ca-44f9-be83-a36b4851c28f" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 16:20:32 user nova-compute[71731]: DEBUG nova.compute.manager [None req-82991644-6a62-4c17-9e63-e90e77888680 tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] [instance: 823749e1-56ca-44f9-be83-a36b4851c28f] Instance network_info: |[{"id": "f4e8f99d-1c8f-44b8-84f1-0f43a156e8b0", "address": "fa:16:3e:58:82:03", "network": {"id": "39832acb-f932-4804-a559-967d9d0ae0ad", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-174129869-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "608ff87aadc7408e9010212fd5f482b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4e8f99d-1c", "ovs_interfaceid": "f4e8f99d-1c8f-44b8-84f1-0f43a156e8b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71731) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 16:20:32 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-c2d6dff8-7759-4339-bc73-f5188ac40187 req-9876ec92-ca52-434f-936b-d24d2257b97d service nova] Acquired lock "refresh_cache-823749e1-56ca-44f9-be83-a36b4851c28f" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 16:20:32 user nova-compute[71731]: DEBUG nova.network.neutron [req-c2d6dff8-7759-4339-bc73-f5188ac40187 req-9876ec92-ca52-434f-936b-d24d2257b97d service nova] [instance: 823749e1-56ca-44f9-be83-a36b4851c28f] Refreshing network info cache for port f4e8f99d-1c8f-44b8-84f1-0f43a156e8b0 {{(pid=71731) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 16:20:32 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-82991644-6a62-4c17-9e63-e90e77888680 tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] [instance: 823749e1-56ca-44f9-be83-a36b4851c28f] Start _get_guest_xml network_info=[{"id": "f4e8f99d-1c8f-44b8-84f1-0f43a156e8b0", "address": "fa:16:3e:58:82:03", "network": {"id": "39832acb-f932-4804-a559-967d9d0ae0ad", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-174129869-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "608ff87aadc7408e9010212fd5f482b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4e8f99d-1c", "ovs_interfaceid": "f4e8f99d-1c8f-44b8-84f1-0f43a156e8b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T16:16:31Z,direct_url=<?>,disk_format='qcow2',id=708622a9-7465-4492-ade8-b827198f7e30,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='0b29a975c552465aba0ac7d6288434bd',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T16:16:33Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'device_type': 'disk', 'encrypted': False, 'disk_bus': 'virtio', 'guest_format': None, 'encryption_options': None, 'image_id': '708622a9-7465-4492-ade8-b827198f7e30'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71731) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 16:20:32 user nova-compute[71731]: WARNING nova.virt.libvirt.driver [None req-82991644-6a62-4c17-9e63-e90e77888680 tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 16:20:32 user nova-compute[71731]: WARNING nova.virt.libvirt.driver [None req-82991644-6a62-4c17-9e63-e90e77888680 tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 16:20:32 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-82991644-6a62-4c17-9e63-e90e77888680 tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71731) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 16:20:32 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-82991644-6a62-4c17-9e63-e90e77888680 tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T16:17:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T16:16:31Z,direct_url=<?>,disk_format='qcow2',id=708622a9-7465-4492-ade8-b827198f7e30,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='0b29a975c552465aba0ac7d6288434bd',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T16:16:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 16:20:32 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-82991644-6a62-4c17-9e63-e90e77888680 tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] Flavor limits 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 16:20:32 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-82991644-6a62-4c17-9e63-e90e77888680 tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] Image limits 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 16:20:32 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-82991644-6a62-4c17-9e63-e90e77888680 tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] Flavor pref 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 16:20:32 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-82991644-6a62-4c17-9e63-e90e77888680 tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] Image pref 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 16:20:32 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-82991644-6a62-4c17-9e63-e90e77888680 tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 16:20:32 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-82991644-6a62-4c17-9e63-e90e77888680 tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 16:20:32 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-82991644-6a62-4c17-9e63-e90e77888680 tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71731) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 16:20:32 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-82991644-6a62-4c17-9e63-e90e77888680 tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] Got 1 possible topologies {{(pid=71731) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 16:20:32 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-82991644-6a62-4c17-9e63-e90e77888680 tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 16:20:32 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-82991644-6a62-4c17-9e63-e90e77888680 tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 16:20:32 user nova-compute[71731]: DEBUG nova.virt.libvirt.vif [None req-82991644-6a62-4c17-9e63-e90e77888680 tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T16:20:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-865124722',display_name='tempest-DeleteServersTestJSON-server-865124722',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-865124722',id=3,image_ref='708622a9-7465-4492-ade8-b827198f7e30',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='608ff87aadc7408e9010212fd5f482b7',ramdisk_id='',reservation_id='r-30o8gy1d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='708622a9-7465-4492-ade8-b827198f7e30',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1138024295',owner_user_name='tempest-DeleteServersTestJSON-1138024295-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T16:20:26Z,user_data=None,user_id='55d232911f5742aa83146f19f13dd198',uuid=823749e1-56ca-44f9-be83-a36b4851c28f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f4e8f99d-1c8f-44b8-84f1-0f43a156e8b0", "address": "fa:16:3e:58:82:03", "network": {"id": "39832acb-f932-4804-a559-967d9d0ae0ad", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-174129869-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "608ff87aadc7408e9010212fd5f482b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4e8f99d-1c", "ovs_interfaceid": "f4e8f99d-1c8f-44b8-84f1-0f43a156e8b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71731) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 16:20:32 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-82991644-6a62-4c17-9e63-e90e77888680 tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] Converting VIF {"id": "f4e8f99d-1c8f-44b8-84f1-0f43a156e8b0", "address": "fa:16:3e:58:82:03", "network": {"id": "39832acb-f932-4804-a559-967d9d0ae0ad", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-174129869-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "608ff87aadc7408e9010212fd5f482b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4e8f99d-1c", "ovs_interfaceid": "f4e8f99d-1c8f-44b8-84f1-0f43a156e8b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 16:20:32 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-82991644-6a62-4c17-9e63-e90e77888680 tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:58:82:03,bridge_name='br-int',has_traffic_filtering=True,id=f4e8f99d-1c8f-44b8-84f1-0f43a156e8b0,network=Network(39832acb-f932-4804-a559-967d9d0ae0ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4e8f99d-1c') {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 16:20:32 user nova-compute[71731]: DEBUG nova.objects.instance [None req-82991644-6a62-4c17-9e63-e90e77888680 tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] Lazy-loading 'pci_devices' on Instance uuid 823749e1-56ca-44f9-be83-a36b4851c28f {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:20:32 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-82991644-6a62-4c17-9e63-e90e77888680 tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] [instance: 823749e1-56ca-44f9-be83-a36b4851c28f] End _get_guest_xml xml=<domain type="kvm">
Apr 13 16:20:32 user nova-compute[71731]:   <uuid>823749e1-56ca-44f9-be83-a36b4851c28f</uuid>
Apr 13 16:20:32 user nova-compute[71731]:   <name>instance-00000003</name>
Apr 13 16:20:32 user nova-compute[71731]:   <memory>131072</memory>
Apr 13 16:20:32 user nova-compute[71731]:   <vcpu>1</vcpu>
Apr 13 16:20:32 user nova-compute[71731]:   <metadata>
Apr 13 16:20:32 user nova-compute[71731]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 16:20:32 user nova-compute[71731]:       <nova:package version="0.0.0"/>
Apr 13 16:20:32 user nova-compute[71731]:       <nova:name>tempest-DeleteServersTestJSON-server-865124722</nova:name>
Apr 13 16:20:32 user nova-compute[71731]:       <nova:creationTime>2023-04-13 16:20:32</nova:creationTime>
Apr 13 16:20:32 user nova-compute[71731]:       <nova:flavor name="m1.nano">
Apr 13 16:20:32 user nova-compute[71731]:         <nova:memory>128</nova:memory>
Apr 13 16:20:32 user nova-compute[71731]:         <nova:disk>1</nova:disk>
Apr 13 16:20:32 user nova-compute[71731]:         <nova:swap>0</nova:swap>
Apr 13 16:20:32 user nova-compute[71731]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 16:20:32 user nova-compute[71731]:         <nova:vcpus>1</nova:vcpus>
Apr 13 16:20:32 user nova-compute[71731]:       </nova:flavor>
Apr 13 16:20:32 user nova-compute[71731]:       <nova:owner>
Apr 13 16:20:32 user nova-compute[71731]:         <nova:user uuid="55d232911f5742aa83146f19f13dd198">tempest-DeleteServersTestJSON-1138024295-project-member</nova:user>
Apr 13 16:20:32 user nova-compute[71731]:         <nova:project uuid="608ff87aadc7408e9010212fd5f482b7">tempest-DeleteServersTestJSON-1138024295</nova:project>
Apr 13 16:20:32 user nova-compute[71731]:       </nova:owner>
Apr 13 16:20:32 user nova-compute[71731]:       <nova:root type="image" uuid="708622a9-7465-4492-ade8-b827198f7e30"/>
Apr 13 16:20:32 user nova-compute[71731]:       <nova:ports>
Apr 13 16:20:32 user nova-compute[71731]:         <nova:port uuid="f4e8f99d-1c8f-44b8-84f1-0f43a156e8b0">
Apr 13 16:20:32 user nova-compute[71731]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Apr 13 16:20:32 user nova-compute[71731]:         </nova:port>
Apr 13 16:20:32 user nova-compute[71731]:       </nova:ports>
Apr 13 16:20:32 user nova-compute[71731]:     </nova:instance>
Apr 13 16:20:32 user nova-compute[71731]:   </metadata>
Apr 13 16:20:32 user nova-compute[71731]:   <sysinfo type="smbios">
Apr 13 16:20:32 user nova-compute[71731]:     <system>
Apr 13 16:20:32 user nova-compute[71731]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 16:20:32 user nova-compute[71731]:       <entry name="product">OpenStack Nova</entry>
Apr 13 16:20:32 user nova-compute[71731]:       <entry name="version">0.0.0</entry>
Apr 13 16:20:32 user nova-compute[71731]:       <entry name="serial">823749e1-56ca-44f9-be83-a36b4851c28f</entry>
Apr 13 16:20:32 user nova-compute[71731]:       <entry name="uuid">823749e1-56ca-44f9-be83-a36b4851c28f</entry>
Apr 13 16:20:32 user nova-compute[71731]:       <entry name="family">Virtual Machine</entry>
Apr 13 16:20:32 user nova-compute[71731]:     </system>
Apr 13 16:20:32 user nova-compute[71731]:   </sysinfo>
Apr 13 16:20:32 user nova-compute[71731]:   <os>
Apr 13 16:20:32 user nova-compute[71731]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 16:20:32 user nova-compute[71731]:     <boot dev="hd"/>
Apr 13 16:20:32 user nova-compute[71731]:     <smbios mode="sysinfo"/>
Apr 13 16:20:32 user nova-compute[71731]:   </os>
Apr 13 16:20:32 user nova-compute[71731]:   <features>
Apr 13 16:20:32 user nova-compute[71731]:     <acpi/>
Apr 13 16:20:32 user nova-compute[71731]:     <apic/>
Apr 13 16:20:32 user nova-compute[71731]:     <vmcoreinfo/>
Apr 13 16:20:32 user nova-compute[71731]:   </features>
Apr 13 16:20:32 user nova-compute[71731]:   <clock offset="utc">
Apr 13 16:20:32 user nova-compute[71731]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 16:20:32 user nova-compute[71731]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 16:20:32 user nova-compute[71731]:     <timer name="hpet" present="no"/>
Apr 13 16:20:32 user nova-compute[71731]:   </clock>
Apr 13 16:20:32 user nova-compute[71731]:   <cpu mode="custom" match="exact">
Apr 13 16:20:32 user nova-compute[71731]:     <model>Nehalem</model>
Apr 13 16:20:32 user nova-compute[71731]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 16:20:32 user nova-compute[71731]:   </cpu>
Apr 13 16:20:32 user nova-compute[71731]:   <devices>
Apr 13 16:20:32 user nova-compute[71731]:     <disk type="file" device="disk">
Apr 13 16:20:32 user nova-compute[71731]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 16:20:32 user nova-compute[71731]:       <source file="/opt/stack/data/nova/instances/823749e1-56ca-44f9-be83-a36b4851c28f/disk"/>
Apr 13 16:20:32 user nova-compute[71731]:       <target dev="vda" bus="virtio"/>
Apr 13 16:20:32 user nova-compute[71731]:     </disk>
Apr 13 16:20:32 user nova-compute[71731]:     <interface type="ethernet">
Apr 13 16:20:32 user nova-compute[71731]:       <mac address="fa:16:3e:58:82:03"/>
Apr 13 16:20:32 user nova-compute[71731]:       <model type="virtio"/>
Apr 13 16:20:32 user nova-compute[71731]:       <mtu size="1442"/>
Apr 13 16:20:32 user nova-compute[71731]:       <target dev="tapf4e8f99d-1c"/>
Apr 13 16:20:32 user nova-compute[71731]:     </interface>
Apr 13 16:20:32 user nova-compute[71731]:     <serial type="pty">
Apr 13 16:20:32 user nova-compute[71731]:       <log file="/opt/stack/data/nova/instances/823749e1-56ca-44f9-be83-a36b4851c28f/console.log" append="off"/>
Apr 13 16:20:32 user nova-compute[71731]:     </serial>
Apr 13 16:20:32 user nova-compute[71731]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 16:20:32 user nova-compute[71731]:     <video>
Apr 13 16:20:32 user nova-compute[71731]:       <model type="virtio"/>
Apr 13 16:20:32 user nova-compute[71731]:     </video>
Apr 13 16:20:32 user nova-compute[71731]:     <rng model="virtio">
Apr 13 16:20:32 user nova-compute[71731]:       <backend model="random">/dev/urandom</backend>
Apr 13 16:20:32 user nova-compute[71731]:     </rng>
Apr 13 16:20:32 user nova-compute[71731]:     <controller type="usb" index="0" model="none"/>
Apr 13 16:20:32 user nova-compute[71731]:     <memballoon model="virtio">
Apr 13 16:20:32 user nova-compute[71731]:       <stats period="10"/>
Apr 13 16:20:32 user nova-compute[71731]:     </memballoon>
Apr 13 16:20:32 user nova-compute[71731]:   </devices>
Apr 13 16:20:32 user nova-compute[71731]: </domain>
Apr 13 16:20:32 user nova-compute[71731]:  {{(pid=71731) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 16:20:32 user nova-compute[71731]: DEBUG nova.virt.libvirt.vif [None req-82991644-6a62-4c17-9e63-e90e77888680 tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T16:20:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-865124722',display_name='tempest-DeleteServersTestJSON-server-865124722',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-865124722',id=3,image_ref='708622a9-7465-4492-ade8-b827198f7e30',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='608ff87aadc7408e9010212fd5f482b7',ramdisk_id='',reservation_id='r-30o8gy1d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='708622a9-7465-4492-ade8-b827198f7e30',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1138024295',owner_user_name='tempest-DeleteServersTestJSON-1138024295-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T16:20:26Z,user_data=None,user_id='55d232911f5742aa83146f19f13dd198',uuid=823749e1-56ca-44f9-be83-a36b4851c28f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f4e8f99d-1c8f-44b8-84f1-0f43a156e8b0", "address": "fa:16:3e:58:82:03", "network": {"id": "39832acb-f932-4804-a559-967d9d0ae0ad", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-174129869-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "608ff87aadc7408e9010212fd5f482b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4e8f99d-1c", "ovs_interfaceid": "f4e8f99d-1c8f-44b8-84f1-0f43a156e8b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 16:20:32 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-82991644-6a62-4c17-9e63-e90e77888680 tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] Converting VIF {"id": "f4e8f99d-1c8f-44b8-84f1-0f43a156e8b0", "address": "fa:16:3e:58:82:03", "network": {"id": "39832acb-f932-4804-a559-967d9d0ae0ad", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-174129869-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "608ff87aadc7408e9010212fd5f482b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4e8f99d-1c", "ovs_interfaceid": "f4e8f99d-1c8f-44b8-84f1-0f43a156e8b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 16:20:32 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-82991644-6a62-4c17-9e63-e90e77888680 tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:58:82:03,bridge_name='br-int',has_traffic_filtering=True,id=f4e8f99d-1c8f-44b8-84f1-0f43a156e8b0,network=Network(39832acb-f932-4804-a559-967d9d0ae0ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4e8f99d-1c') {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 16:20:32 user nova-compute[71731]: DEBUG os_vif [None req-82991644-6a62-4c17-9e63-e90e77888680 tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:82:03,bridge_name='br-int',has_traffic_filtering=True,id=f4e8f99d-1c8f-44b8-84f1-0f43a156e8b0,network=Network(39832acb-f932-4804-a559-967d9d0ae0ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4e8f99d-1c') {{(pid=71731) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 16:20:32 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:20:32 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:20:32 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 16:20:32 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:20:32 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf4e8f99d-1c, may_exist=True) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:20:32 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf4e8f99d-1c, col_values=(('external_ids', {'iface-id': 'f4e8f99d-1c8f-44b8-84f1-0f43a156e8b0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:58:82:03', 'vm-uuid': '823749e1-56ca-44f9-be83-a36b4851c28f'}),)) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:20:32 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 16:20:32 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:20:32 user nova-compute[71731]: INFO os_vif [None req-82991644-6a62-4c17-9e63-e90e77888680 tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:82:03,bridge_name='br-int',has_traffic_filtering=True,id=f4e8f99d-1c8f-44b8-84f1-0f43a156e8b0,network=Network(39832acb-f932-4804-a559-967d9d0ae0ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4e8f99d-1c')
Apr 13 16:20:32 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-82991644-6a62-4c17-9e63-e90e77888680 tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] No BDM found with device name vda, not building metadata. {{(pid=71731) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 16:20:32 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-82991644-6a62-4c17-9e63-e90e77888680 tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] No VIF found with MAC fa:16:3e:58:82:03, not building metadata {{(pid=71731) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 16:20:33 user nova-compute[71731]: DEBUG nova.compute.manager [req-31a8b9d9-ee3a-43f1-8468-37bf1b5f6d03 req-7d3fa54c-1543-414a-84ec-e183fd87e46a service nova] [instance: 7973e93b-6311-44ed-91ff-e861c32d0277] Received event network-vif-plugged-8ae83a6c-4fc7-4e2c-8f83-7aece5c239cd {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:20:33 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-31a8b9d9-ee3a-43f1-8468-37bf1b5f6d03 req-7d3fa54c-1543-414a-84ec-e183fd87e46a service nova] Acquiring lock "7973e93b-6311-44ed-91ff-e861c32d0277-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:20:33 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-31a8b9d9-ee3a-43f1-8468-37bf1b5f6d03 req-7d3fa54c-1543-414a-84ec-e183fd87e46a service nova] Lock "7973e93b-6311-44ed-91ff-e861c32d0277-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:20:33 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-31a8b9d9-ee3a-43f1-8468-37bf1b5f6d03 req-7d3fa54c-1543-414a-84ec-e183fd87e46a service nova] Lock "7973e93b-6311-44ed-91ff-e861c32d0277-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:20:33 user nova-compute[71731]: DEBUG nova.compute.manager [req-31a8b9d9-ee3a-43f1-8468-37bf1b5f6d03 req-7d3fa54c-1543-414a-84ec-e183fd87e46a service nova] [instance: 7973e93b-6311-44ed-91ff-e861c32d0277] No waiting events found dispatching network-vif-plugged-8ae83a6c-4fc7-4e2c-8f83-7aece5c239cd {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:20:33 user nova-compute[71731]: WARNING nova.compute.manager [req-31a8b9d9-ee3a-43f1-8468-37bf1b5f6d03 req-7d3fa54c-1543-414a-84ec-e183fd87e46a service nova] [instance: 7973e93b-6311-44ed-91ff-e861c32d0277] Received unexpected event network-vif-plugged-8ae83a6c-4fc7-4e2c-8f83-7aece5c239cd for instance with vm_state active and task_state None.
Apr 13 16:20:34 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:20:34 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:20:34 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:20:34 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:20:34 user nova-compute[71731]: DEBUG nova.network.neutron [req-c2d6dff8-7759-4339-bc73-f5188ac40187 req-9876ec92-ca52-434f-936b-d24d2257b97d service nova] [instance: 823749e1-56ca-44f9-be83-a36b4851c28f] Updated VIF entry in instance network info cache for port f4e8f99d-1c8f-44b8-84f1-0f43a156e8b0. {{(pid=71731) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 16:20:34 user nova-compute[71731]: DEBUG nova.network.neutron [req-c2d6dff8-7759-4339-bc73-f5188ac40187 req-9876ec92-ca52-434f-936b-d24d2257b97d service nova] [instance: 823749e1-56ca-44f9-be83-a36b4851c28f] Updating instance_info_cache with network_info: [{"id": "f4e8f99d-1c8f-44b8-84f1-0f43a156e8b0", "address": "fa:16:3e:58:82:03", "network": {"id": "39832acb-f932-4804-a559-967d9d0ae0ad", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-174129869-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "608ff87aadc7408e9010212fd5f482b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4e8f99d-1c", "ovs_interfaceid": "f4e8f99d-1c8f-44b8-84f1-0f43a156e8b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:20:34 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-c2d6dff8-7759-4339-bc73-f5188ac40187 req-9876ec92-ca52-434f-936b-d24d2257b97d service nova] Releasing lock "refresh_cache-823749e1-56ca-44f9-be83-a36b4851c28f" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 16:20:34 user nova-compute[71731]: DEBUG nova.network.neutron [None req-f0db01f4-bdd2-4695-a17b-6cc5c1b51736 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] [instance: bbcccf4b-e861-4254-9be3-a491776214e9] Successfully updated port: dbb2bf27-5de3-499c-ba4d-87867912a143 {{(pid=71731) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 16:20:34 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-f0db01f4-bdd2-4695-a17b-6cc5c1b51736 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Acquiring lock "refresh_cache-bbcccf4b-e861-4254-9be3-a491776214e9" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 16:20:34 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-f0db01f4-bdd2-4695-a17b-6cc5c1b51736 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Acquired lock "refresh_cache-bbcccf4b-e861-4254-9be3-a491776214e9" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 16:20:34 user nova-compute[71731]: DEBUG nova.network.neutron [None req-f0db01f4-bdd2-4695-a17b-6cc5c1b51736 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] [instance: bbcccf4b-e861-4254-9be3-a491776214e9] Building network info cache for instance {{(pid=71731) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 16:20:34 user nova-compute[71731]: DEBUG nova.compute.manager [req-e7b701b2-040f-41df-9627-9c3e5c458ce6 req-18997b35-edd8-43fd-9a66-8f9600e80d89 service nova] [instance: bbcccf4b-e861-4254-9be3-a491776214e9] Received event network-changed-dbb2bf27-5de3-499c-ba4d-87867912a143 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:20:34 user nova-compute[71731]: DEBUG nova.compute.manager [req-e7b701b2-040f-41df-9627-9c3e5c458ce6 req-18997b35-edd8-43fd-9a66-8f9600e80d89 service nova] [instance: bbcccf4b-e861-4254-9be3-a491776214e9] Refreshing instance network info cache due to event network-changed-dbb2bf27-5de3-499c-ba4d-87867912a143. {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 16:20:34 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-e7b701b2-040f-41df-9627-9c3e5c458ce6 req-18997b35-edd8-43fd-9a66-8f9600e80d89 service nova] Acquiring lock "refresh_cache-bbcccf4b-e861-4254-9be3-a491776214e9" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 16:20:34 user nova-compute[71731]: DEBUG nova.network.neutron [None req-f0db01f4-bdd2-4695-a17b-6cc5c1b51736 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] [instance: bbcccf4b-e861-4254-9be3-a491776214e9] Instance cache missing network info. {{(pid=71731) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 16:20:35 user nova-compute[71731]: DEBUG nova.compute.manager [req-735b8e94-2cb8-46b8-8c9a-a396cf0c7c89 req-613521ab-f80c-4fc6-92d8-39f03a7995ce service nova] [instance: 823749e1-56ca-44f9-be83-a36b4851c28f] Received event network-vif-plugged-f4e8f99d-1c8f-44b8-84f1-0f43a156e8b0 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:20:35 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-735b8e94-2cb8-46b8-8c9a-a396cf0c7c89 req-613521ab-f80c-4fc6-92d8-39f03a7995ce service nova] Acquiring lock "823749e1-56ca-44f9-be83-a36b4851c28f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:20:35 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-735b8e94-2cb8-46b8-8c9a-a396cf0c7c89 req-613521ab-f80c-4fc6-92d8-39f03a7995ce service nova] Lock "823749e1-56ca-44f9-be83-a36b4851c28f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:20:35 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-735b8e94-2cb8-46b8-8c9a-a396cf0c7c89 req-613521ab-f80c-4fc6-92d8-39f03a7995ce service nova] Lock "823749e1-56ca-44f9-be83-a36b4851c28f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:20:35 user nova-compute[71731]: DEBUG nova.compute.manager [req-735b8e94-2cb8-46b8-8c9a-a396cf0c7c89 req-613521ab-f80c-4fc6-92d8-39f03a7995ce service nova] [instance: 823749e1-56ca-44f9-be83-a36b4851c28f] No waiting events found dispatching network-vif-plugged-f4e8f99d-1c8f-44b8-84f1-0f43a156e8b0 {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:20:35 user nova-compute[71731]: WARNING nova.compute.manager [req-735b8e94-2cb8-46b8-8c9a-a396cf0c7c89 req-613521ab-f80c-4fc6-92d8-39f03a7995ce service nova] [instance: 823749e1-56ca-44f9-be83-a36b4851c28f] Received unexpected event network-vif-plugged-f4e8f99d-1c8f-44b8-84f1-0f43a156e8b0 for instance with vm_state building and task_state spawning.
Apr 13 16:20:35 user nova-compute[71731]: DEBUG nova.network.neutron [None req-f0db01f4-bdd2-4695-a17b-6cc5c1b51736 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] [instance: bbcccf4b-e861-4254-9be3-a491776214e9] Updating instance_info_cache with network_info: [{"id": "dbb2bf27-5de3-499c-ba4d-87867912a143", "address": "fa:16:3e:a3:40:f4", "network": {"id": "5a4fe0b3-5f2f-4125-a17d-e2ff424bf01a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1835633180-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7061f2f041954ffe90b0c87b422890e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbb2bf27-5d", "ovs_interfaceid": "dbb2bf27-5de3-499c-ba4d-87867912a143", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:20:35 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-f0db01f4-bdd2-4695-a17b-6cc5c1b51736 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Releasing lock "refresh_cache-bbcccf4b-e861-4254-9be3-a491776214e9" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 16:20:35 user nova-compute[71731]: DEBUG nova.compute.manager [None req-f0db01f4-bdd2-4695-a17b-6cc5c1b51736 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] [instance: bbcccf4b-e861-4254-9be3-a491776214e9] Instance network_info: |[{"id": "dbb2bf27-5de3-499c-ba4d-87867912a143", "address": "fa:16:3e:a3:40:f4", "network": {"id": "5a4fe0b3-5f2f-4125-a17d-e2ff424bf01a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1835633180-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7061f2f041954ffe90b0c87b422890e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbb2bf27-5d", "ovs_interfaceid": "dbb2bf27-5de3-499c-ba4d-87867912a143", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71731) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 16:20:35 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-e7b701b2-040f-41df-9627-9c3e5c458ce6 req-18997b35-edd8-43fd-9a66-8f9600e80d89 service nova] Acquired lock "refresh_cache-bbcccf4b-e861-4254-9be3-a491776214e9" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 16:20:35 user nova-compute[71731]: DEBUG nova.network.neutron [req-e7b701b2-040f-41df-9627-9c3e5c458ce6 req-18997b35-edd8-43fd-9a66-8f9600e80d89 service nova] [instance: bbcccf4b-e861-4254-9be3-a491776214e9] Refreshing network info cache for port dbb2bf27-5de3-499c-ba4d-87867912a143 {{(pid=71731) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 16:20:35 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-f0db01f4-bdd2-4695-a17b-6cc5c1b51736 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] [instance: bbcccf4b-e861-4254-9be3-a491776214e9] Start _get_guest_xml network_info=[{"id": "dbb2bf27-5de3-499c-ba4d-87867912a143", "address": "fa:16:3e:a3:40:f4", "network": {"id": "5a4fe0b3-5f2f-4125-a17d-e2ff424bf01a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1835633180-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7061f2f041954ffe90b0c87b422890e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbb2bf27-5d", "ovs_interfaceid": "dbb2bf27-5de3-499c-ba4d-87867912a143", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T16:16:31Z,direct_url=<?>,disk_format='qcow2',id=708622a9-7465-4492-ade8-b827198f7e30,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='0b29a975c552465aba0ac7d6288434bd',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T16:16:33Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'device_type': 'disk', 'encrypted': False, 'disk_bus': 'virtio', 'guest_format': None, 'encryption_options': None, 'image_id': '708622a9-7465-4492-ade8-b827198f7e30'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71731) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 16:20:35 user nova-compute[71731]: WARNING nova.virt.libvirt.driver [None req-f0db01f4-bdd2-4695-a17b-6cc5c1b51736 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 16:20:35 user nova-compute[71731]: WARNING nova.virt.libvirt.driver [None req-f0db01f4-bdd2-4695-a17b-6cc5c1b51736 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 16:20:35 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-f0db01f4-bdd2-4695-a17b-6cc5c1b51736 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71731) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 16:20:35 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-f0db01f4-bdd2-4695-a17b-6cc5c1b51736 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T16:17:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T16:16:31Z,direct_url=<?>,disk_format='qcow2',id=708622a9-7465-4492-ade8-b827198f7e30,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='0b29a975c552465aba0ac7d6288434bd',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T16:16:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 16:20:35 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-f0db01f4-bdd2-4695-a17b-6cc5c1b51736 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Flavor limits 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 16:20:35 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-f0db01f4-bdd2-4695-a17b-6cc5c1b51736 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Image limits 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 16:20:35 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-f0db01f4-bdd2-4695-a17b-6cc5c1b51736 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Flavor pref 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 16:20:35 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-f0db01f4-bdd2-4695-a17b-6cc5c1b51736 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Image pref 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 16:20:35 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-f0db01f4-bdd2-4695-a17b-6cc5c1b51736 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 16:20:35 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-f0db01f4-bdd2-4695-a17b-6cc5c1b51736 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 16:20:35 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-f0db01f4-bdd2-4695-a17b-6cc5c1b51736 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71731) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 16:20:35 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-f0db01f4-bdd2-4695-a17b-6cc5c1b51736 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Got 1 possible topologies {{(pid=71731) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 16:20:35 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-f0db01f4-bdd2-4695-a17b-6cc5c1b51736 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 16:20:35 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-f0db01f4-bdd2-4695-a17b-6cc5c1b51736 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 16:20:35 user nova-compute[71731]: DEBUG nova.virt.libvirt.vif [None req-f0db01f4-bdd2-4695-a17b-6cc5c1b51736 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T16:20:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1807441960',display_name='tempest-ServerStableDeviceRescueTest-server-1807441960',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1807441960',id=4,image_ref='708622a9-7465-4492-ade8-b827198f7e30',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBssL1q8UrRqcNBzubLNJC8k8DaqQcRK2ysRGrjAyXNJmaI+jOCwcCVXwOavhCNGPOMX3O9mQsDrY3mOGMrByAQWchmBUsGQlz9ppSMT6HadSQb/fuBY4fFJZdDXCx7D8g==',key_name='tempest-keypair-900897003',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7061f2f041954ffe90b0c87b422890e4',ramdisk_id='',reservation_id='r-zcqb1d1h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='708622a9-7465-4492-ade8-b827198f7e30',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1182397334',owner_user_name='tempest-ServerStableDeviceRescueTest-1182397334-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T16:20:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9bf19848229f45baad45c490cf539508',uuid=bbcccf4b-e861-4254-9be3-a491776214e9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dbb2bf27-5de3-499c-ba4d-87867912a143", "address": "fa:16:3e:a3:40:f4", "network": {"id": "5a4fe0b3-5f2f-4125-a17d-e2ff424bf01a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1835633180-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7061f2f041954ffe90b0c87b422890e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbb2bf27-5d", "ovs_interfaceid": "dbb2bf27-5de3-499c-ba4d-87867912a143", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71731) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 16:20:35 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-f0db01f4-bdd2-4695-a17b-6cc5c1b51736 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Converting VIF {"id": "dbb2bf27-5de3-499c-ba4d-87867912a143", "address": "fa:16:3e:a3:40:f4", "network": {"id": "5a4fe0b3-5f2f-4125-a17d-e2ff424bf01a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1835633180-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7061f2f041954ffe90b0c87b422890e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbb2bf27-5d", "ovs_interfaceid": "dbb2bf27-5de3-499c-ba4d-87867912a143", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 16:20:35 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-f0db01f4-bdd2-4695-a17b-6cc5c1b51736 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a3:40:f4,bridge_name='br-int',has_traffic_filtering=True,id=dbb2bf27-5de3-499c-ba4d-87867912a143,network=Network(5a4fe0b3-5f2f-4125-a17d-e2ff424bf01a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbb2bf27-5d') {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 16:20:35 user nova-compute[71731]: DEBUG nova.objects.instance [None req-f0db01f4-bdd2-4695-a17b-6cc5c1b51736 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Lazy-loading 'pci_devices' on Instance uuid bbcccf4b-e861-4254-9be3-a491776214e9 {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:20:35 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-f0db01f4-bdd2-4695-a17b-6cc5c1b51736 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] [instance: bbcccf4b-e861-4254-9be3-a491776214e9] End _get_guest_xml xml=<domain type="kvm">
Apr 13 16:20:35 user nova-compute[71731]:   <uuid>bbcccf4b-e861-4254-9be3-a491776214e9</uuid>
Apr 13 16:20:35 user nova-compute[71731]:   <name>instance-00000004</name>
Apr 13 16:20:35 user nova-compute[71731]:   <memory>131072</memory>
Apr 13 16:20:35 user nova-compute[71731]:   <vcpu>1</vcpu>
Apr 13 16:20:35 user nova-compute[71731]:   <metadata>
Apr 13 16:20:35 user nova-compute[71731]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 16:20:35 user nova-compute[71731]:       <nova:package version="0.0.0"/>
Apr 13 16:20:35 user nova-compute[71731]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1807441960</nova:name>
Apr 13 16:20:35 user nova-compute[71731]:       <nova:creationTime>2023-04-13 16:20:35</nova:creationTime>
Apr 13 16:20:35 user nova-compute[71731]:       <nova:flavor name="m1.nano">
Apr 13 16:20:35 user nova-compute[71731]:         <nova:memory>128</nova:memory>
Apr 13 16:20:35 user nova-compute[71731]:         <nova:disk>1</nova:disk>
Apr 13 16:20:35 user nova-compute[71731]:         <nova:swap>0</nova:swap>
Apr 13 16:20:35 user nova-compute[71731]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 16:20:35 user nova-compute[71731]:         <nova:vcpus>1</nova:vcpus>
Apr 13 16:20:35 user nova-compute[71731]:       </nova:flavor>
Apr 13 16:20:35 user nova-compute[71731]:       <nova:owner>
Apr 13 16:20:35 user nova-compute[71731]:         <nova:user uuid="9bf19848229f45baad45c490cf539508">tempest-ServerStableDeviceRescueTest-1182397334-project-member</nova:user>
Apr 13 16:20:35 user nova-compute[71731]:         <nova:project uuid="7061f2f041954ffe90b0c87b422890e4">tempest-ServerStableDeviceRescueTest-1182397334</nova:project>
Apr 13 16:20:35 user nova-compute[71731]:       </nova:owner>
Apr 13 16:20:35 user nova-compute[71731]:       <nova:root type="image" uuid="708622a9-7465-4492-ade8-b827198f7e30"/>
Apr 13 16:20:35 user nova-compute[71731]:       <nova:ports>
Apr 13 16:20:35 user nova-compute[71731]:         <nova:port uuid="dbb2bf27-5de3-499c-ba4d-87867912a143">
Apr 13 16:20:35 user nova-compute[71731]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Apr 13 16:20:35 user nova-compute[71731]:         </nova:port>
Apr 13 16:20:35 user nova-compute[71731]:       </nova:ports>
Apr 13 16:20:35 user nova-compute[71731]:     </nova:instance>
Apr 13 16:20:35 user nova-compute[71731]:   </metadata>
Apr 13 16:20:35 user nova-compute[71731]:   <sysinfo type="smbios">
Apr 13 16:20:35 user nova-compute[71731]:     <system>
Apr 13 16:20:35 user nova-compute[71731]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 16:20:35 user nova-compute[71731]:       <entry name="product">OpenStack Nova</entry>
Apr 13 16:20:35 user nova-compute[71731]:       <entry name="version">0.0.0</entry>
Apr 13 16:20:35 user nova-compute[71731]:       <entry name="serial">bbcccf4b-e861-4254-9be3-a491776214e9</entry>
Apr 13 16:20:35 user nova-compute[71731]:       <entry name="uuid">bbcccf4b-e861-4254-9be3-a491776214e9</entry>
Apr 13 16:20:35 user nova-compute[71731]:       <entry name="family">Virtual Machine</entry>
Apr 13 16:20:35 user nova-compute[71731]:     </system>
Apr 13 16:20:35 user nova-compute[71731]:   </sysinfo>
Apr 13 16:20:35 user nova-compute[71731]:   <os>
Apr 13 16:20:35 user nova-compute[71731]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 16:20:35 user nova-compute[71731]:     <boot dev="hd"/>
Apr 13 16:20:35 user nova-compute[71731]:     <smbios mode="sysinfo"/>
Apr 13 16:20:35 user nova-compute[71731]:   </os>
Apr 13 16:20:35 user nova-compute[71731]:   <features>
Apr 13 16:20:35 user nova-compute[71731]:     <acpi/>
Apr 13 16:20:35 user nova-compute[71731]:     <apic/>
Apr 13 16:20:35 user nova-compute[71731]:     <vmcoreinfo/>
Apr 13 16:20:35 user nova-compute[71731]:   </features>
Apr 13 16:20:35 user nova-compute[71731]:   <clock offset="utc">
Apr 13 16:20:35 user nova-compute[71731]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 16:20:35 user nova-compute[71731]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 16:20:35 user nova-compute[71731]:     <timer name="hpet" present="no"/>
Apr 13 16:20:35 user nova-compute[71731]:   </clock>
Apr 13 16:20:35 user nova-compute[71731]:   <cpu mode="custom" match="exact">
Apr 13 16:20:35 user nova-compute[71731]:     <model>Nehalem</model>
Apr 13 16:20:35 user nova-compute[71731]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 16:20:35 user nova-compute[71731]:   </cpu>
Apr 13 16:20:35 user nova-compute[71731]:   <devices>
Apr 13 16:20:35 user nova-compute[71731]:     <disk type="file" device="disk">
Apr 13 16:20:35 user nova-compute[71731]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 16:20:35 user nova-compute[71731]:       <source file="/opt/stack/data/nova/instances/bbcccf4b-e861-4254-9be3-a491776214e9/disk"/>
Apr 13 16:20:35 user nova-compute[71731]:       <target dev="vda" bus="virtio"/>
Apr 13 16:20:35 user nova-compute[71731]:     </disk>
Apr 13 16:20:35 user nova-compute[71731]:     <interface type="ethernet">
Apr 13 16:20:35 user nova-compute[71731]:       <mac address="fa:16:3e:a3:40:f4"/>
Apr 13 16:20:35 user nova-compute[71731]:       <model type="virtio"/>
Apr 13 16:20:35 user nova-compute[71731]:       <mtu size="1442"/>
Apr 13 16:20:35 user nova-compute[71731]:       <target dev="tapdbb2bf27-5d"/>
Apr 13 16:20:35 user nova-compute[71731]:     </interface>
Apr 13 16:20:35 user nova-compute[71731]:     <serial type="pty">
Apr 13 16:20:35 user nova-compute[71731]:       <log file="/opt/stack/data/nova/instances/bbcccf4b-e861-4254-9be3-a491776214e9/console.log" append="off"/>
Apr 13 16:20:35 user nova-compute[71731]:     </serial>
Apr 13 16:20:35 user nova-compute[71731]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 16:20:35 user nova-compute[71731]:     <video>
Apr 13 16:20:35 user nova-compute[71731]:       <model type="virtio"/>
Apr 13 16:20:35 user nova-compute[71731]:     </video>
Apr 13 16:20:35 user nova-compute[71731]:     <rng model="virtio">
Apr 13 16:20:35 user nova-compute[71731]:       <backend model="random">/dev/urandom</backend>
Apr 13 16:20:35 user nova-compute[71731]:     </rng>
Apr 13 16:20:35 user nova-compute[71731]:     <controller type="usb" index="0" model="none"/>
Apr 13 16:20:35 user nova-compute[71731]:     <memballoon model="virtio">
Apr 13 16:20:35 user nova-compute[71731]:       <stats period="10"/>
Apr 13 16:20:35 user nova-compute[71731]:     </memballoon>
Apr 13 16:20:35 user nova-compute[71731]:   </devices>
Apr 13 16:20:35 user nova-compute[71731]: </domain>
Apr 13 16:20:35 user nova-compute[71731]:  {{(pid=71731) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 16:20:35 user nova-compute[71731]: DEBUG nova.virt.libvirt.vif [None req-f0db01f4-bdd2-4695-a17b-6cc5c1b51736 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T16:20:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1807441960',display_name='tempest-ServerStableDeviceRescueTest-server-1807441960',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1807441960',id=4,image_ref='708622a9-7465-4492-ade8-b827198f7e30',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBssL1q8UrRqcNBzubLNJC8k8DaqQcRK2ysRGrjAyXNJmaI+jOCwcCVXwOavhCNGPOMX3O9mQsDrY3mOGMrByAQWchmBUsGQlz9ppSMT6HadSQb/fuBY4fFJZdDXCx7D8g==',key_name='tempest-keypair-900897003',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7061f2f041954ffe90b0c87b422890e4',ramdisk_id='',reservation_id='r-zcqb1d1h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='708622a9-7465-4492-ade8-b827198f7e30',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1182397334',owner_user_name='tempest-ServerStableDeviceRescueTest-1182397334-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T16:20:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9bf19848229f45baad45c490cf539508',uuid=bbcccf4b-e861-4254-9be3-a491776214e9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dbb2bf27-5de3-499c-ba4d-87867912a143", "address": "fa:16:3e:a3:40:f4", "network": {"id": "5a4fe0b3-5f2f-4125-a17d-e2ff424bf01a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1835633180-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7061f2f041954ffe90b0c87b422890e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbb2bf27-5d", "ovs_interfaceid": "dbb2bf27-5de3-499c-ba4d-87867912a143", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 16:20:35 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-f0db01f4-bdd2-4695-a17b-6cc5c1b51736 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Converting VIF {"id": "dbb2bf27-5de3-499c-ba4d-87867912a143", "address": "fa:16:3e:a3:40:f4", "network": {"id": "5a4fe0b3-5f2f-4125-a17d-e2ff424bf01a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1835633180-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7061f2f041954ffe90b0c87b422890e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbb2bf27-5d", "ovs_interfaceid": "dbb2bf27-5de3-499c-ba4d-87867912a143", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 16:20:35 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-f0db01f4-bdd2-4695-a17b-6cc5c1b51736 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a3:40:f4,bridge_name='br-int',has_traffic_filtering=True,id=dbb2bf27-5de3-499c-ba4d-87867912a143,network=Network(5a4fe0b3-5f2f-4125-a17d-e2ff424bf01a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbb2bf27-5d') {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 16:20:35 user nova-compute[71731]: DEBUG os_vif [None req-f0db01f4-bdd2-4695-a17b-6cc5c1b51736 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a3:40:f4,bridge_name='br-int',has_traffic_filtering=True,id=dbb2bf27-5de3-499c-ba4d-87867912a143,network=Network(5a4fe0b3-5f2f-4125-a17d-e2ff424bf01a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbb2bf27-5d') {{(pid=71731) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 16:20:35 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:20:35 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:20:35 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 16:20:35 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:20:35 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdbb2bf27-5d, may_exist=True) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:20:35 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapdbb2bf27-5d, col_values=(('external_ids', {'iface-id': 'dbb2bf27-5de3-499c-ba4d-87867912a143', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a3:40:f4', 'vm-uuid': 'bbcccf4b-e861-4254-9be3-a491776214e9'}),)) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:20:35 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:20:35 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 16:20:35 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:20:35 user nova-compute[71731]: INFO os_vif [None req-f0db01f4-bdd2-4695-a17b-6cc5c1b51736 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a3:40:f4,bridge_name='br-int',has_traffic_filtering=True,id=dbb2bf27-5de3-499c-ba4d-87867912a143,network=Network(5a4fe0b3-5f2f-4125-a17d-e2ff424bf01a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbb2bf27-5d')
Apr 13 16:20:35 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-f0db01f4-bdd2-4695-a17b-6cc5c1b51736 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] No BDM found with device name vda, not building metadata. {{(pid=71731) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 16:20:35 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-f0db01f4-bdd2-4695-a17b-6cc5c1b51736 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] No VIF found with MAC fa:16:3e:a3:40:f4, not building metadata {{(pid=71731) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 16:20:35 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:20:36 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:20:36 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:20:36 user nova-compute[71731]: DEBUG nova.network.neutron [req-e7b701b2-040f-41df-9627-9c3e5c458ce6 req-18997b35-edd8-43fd-9a66-8f9600e80d89 service nova] [instance: bbcccf4b-e861-4254-9be3-a491776214e9] Updated VIF entry in instance network info cache for port dbb2bf27-5de3-499c-ba4d-87867912a143. {{(pid=71731) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 16:20:36 user nova-compute[71731]: DEBUG nova.network.neutron [req-e7b701b2-040f-41df-9627-9c3e5c458ce6 req-18997b35-edd8-43fd-9a66-8f9600e80d89 service nova] [instance: bbcccf4b-e861-4254-9be3-a491776214e9] Updating instance_info_cache with network_info: [{"id": "dbb2bf27-5de3-499c-ba4d-87867912a143", "address": "fa:16:3e:a3:40:f4", "network": {"id": "5a4fe0b3-5f2f-4125-a17d-e2ff424bf01a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1835633180-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7061f2f041954ffe90b0c87b422890e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbb2bf27-5d", "ovs_interfaceid": "dbb2bf27-5de3-499c-ba4d-87867912a143", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:20:36 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:20:36 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-e7b701b2-040f-41df-9627-9c3e5c458ce6 req-18997b35-edd8-43fd-9a66-8f9600e80d89 service nova] Releasing lock "refresh_cache-bbcccf4b-e861-4254-9be3-a491776214e9" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 16:20:36 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:20:36 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:20:37 user nova-compute[71731]: DEBUG nova.virt.driver [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Emitting event <LifecycleEvent: 1681402837.1220057, 823749e1-56ca-44f9-be83-a36b4851c28f => Resumed> {{(pid=71731) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 16:20:37 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 823749e1-56ca-44f9-be83-a36b4851c28f] VM Resumed (Lifecycle Event)
Apr 13 16:20:37 user nova-compute[71731]: DEBUG nova.compute.manager [None req-82991644-6a62-4c17-9e63-e90e77888680 tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] [instance: 823749e1-56ca-44f9-be83-a36b4851c28f] Instance event wait completed in 0 seconds for  {{(pid=71731) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 16:20:37 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-82991644-6a62-4c17-9e63-e90e77888680 tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] [instance: 823749e1-56ca-44f9-be83-a36b4851c28f] Guest created on hypervisor {{(pid=71731) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 16:20:37 user nova-compute[71731]: INFO nova.virt.libvirt.driver [-] [instance: 823749e1-56ca-44f9-be83-a36b4851c28f] Instance spawned successfully.
Apr 13 16:20:37 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-82991644-6a62-4c17-9e63-e90e77888680 tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] [instance: 823749e1-56ca-44f9-be83-a36b4851c28f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 16:20:37 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 823749e1-56ca-44f9-be83-a36b4851c28f] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:20:37 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 823749e1-56ca-44f9-be83-a36b4851c28f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71731) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 16:20:37 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-82991644-6a62-4c17-9e63-e90e77888680 tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] [instance: 823749e1-56ca-44f9-be83-a36b4851c28f] Found default for hw_cdrom_bus of ide {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:20:37 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-82991644-6a62-4c17-9e63-e90e77888680 tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] [instance: 823749e1-56ca-44f9-be83-a36b4851c28f] Found default for hw_disk_bus of virtio {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:20:37 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-82991644-6a62-4c17-9e63-e90e77888680 tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] [instance: 823749e1-56ca-44f9-be83-a36b4851c28f] Found default for hw_input_bus of None {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:20:37 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-82991644-6a62-4c17-9e63-e90e77888680 tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] [instance: 823749e1-56ca-44f9-be83-a36b4851c28f] Found default for hw_pointer_model of None {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:20:37 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-82991644-6a62-4c17-9e63-e90e77888680 tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] [instance: 823749e1-56ca-44f9-be83-a36b4851c28f] Found default for hw_video_model of virtio {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:20:37 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-82991644-6a62-4c17-9e63-e90e77888680 tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] [instance: 823749e1-56ca-44f9-be83-a36b4851c28f] Found default for hw_vif_model of virtio {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:20:37 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 823749e1-56ca-44f9-be83-a36b4851c28f] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 16:20:37 user nova-compute[71731]: DEBUG nova.virt.driver [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Emitting event <LifecycleEvent: 1681402837.124033, 823749e1-56ca-44f9-be83-a36b4851c28f => Started> {{(pid=71731) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 16:20:37 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 823749e1-56ca-44f9-be83-a36b4851c28f] VM Started (Lifecycle Event)
Apr 13 16:20:37 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 823749e1-56ca-44f9-be83-a36b4851c28f] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:20:37 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 823749e1-56ca-44f9-be83-a36b4851c28f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71731) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 16:20:37 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 823749e1-56ca-44f9-be83-a36b4851c28f] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 16:20:37 user nova-compute[71731]: INFO nova.compute.manager [None req-82991644-6a62-4c17-9e63-e90e77888680 tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] [instance: 823749e1-56ca-44f9-be83-a36b4851c28f] Took 11.01 seconds to spawn the instance on the hypervisor.
Apr 13 16:20:37 user nova-compute[71731]: DEBUG nova.compute.manager [None req-82991644-6a62-4c17-9e63-e90e77888680 tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] [instance: 823749e1-56ca-44f9-be83-a36b4851c28f] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:20:37 user nova-compute[71731]: DEBUG nova.compute.manager [req-49e43534-e76c-42e4-a04e-5665a0461b68 req-605ca1da-eb20-4031-977b-53ebaeedef5f service nova] [instance: 823749e1-56ca-44f9-be83-a36b4851c28f] Received event network-vif-plugged-f4e8f99d-1c8f-44b8-84f1-0f43a156e8b0 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:20:37 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-49e43534-e76c-42e4-a04e-5665a0461b68 req-605ca1da-eb20-4031-977b-53ebaeedef5f service nova] Acquiring lock "823749e1-56ca-44f9-be83-a36b4851c28f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:20:37 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-49e43534-e76c-42e4-a04e-5665a0461b68 req-605ca1da-eb20-4031-977b-53ebaeedef5f service nova] Lock "823749e1-56ca-44f9-be83-a36b4851c28f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:20:37 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-49e43534-e76c-42e4-a04e-5665a0461b68 req-605ca1da-eb20-4031-977b-53ebaeedef5f service nova] Lock "823749e1-56ca-44f9-be83-a36b4851c28f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:20:37 user nova-compute[71731]: DEBUG nova.compute.manager [req-49e43534-e76c-42e4-a04e-5665a0461b68 req-605ca1da-eb20-4031-977b-53ebaeedef5f service nova] [instance: 823749e1-56ca-44f9-be83-a36b4851c28f] No waiting events found dispatching network-vif-plugged-f4e8f99d-1c8f-44b8-84f1-0f43a156e8b0 {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:20:37 user nova-compute[71731]: WARNING nova.compute.manager [req-49e43534-e76c-42e4-a04e-5665a0461b68 req-605ca1da-eb20-4031-977b-53ebaeedef5f service nova] [instance: 823749e1-56ca-44f9-be83-a36b4851c28f] Received unexpected event network-vif-plugged-f4e8f99d-1c8f-44b8-84f1-0f43a156e8b0 for instance with vm_state building and task_state spawning.
Apr 13 16:20:37 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:20:37 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:20:37 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:20:37 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:20:37 user nova-compute[71731]: INFO nova.compute.manager [None req-82991644-6a62-4c17-9e63-e90e77888680 tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] [instance: 823749e1-56ca-44f9-be83-a36b4851c28f] Took 11.99 seconds to build instance.
Apr 13 16:20:37 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-82991644-6a62-4c17-9e63-e90e77888680 tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] Lock "823749e1-56ca-44f9-be83-a36b4851c28f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.107s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:20:38 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:20:38 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:20:39 user nova-compute[71731]: DEBUG nova.compute.manager [req-096486f4-dc82-47a3-979f-055e6b278f7e req-1aa40b41-0c19-4730-8bdd-045d617a883c service nova] [instance: bbcccf4b-e861-4254-9be3-a491776214e9] Received event network-vif-plugged-dbb2bf27-5de3-499c-ba4d-87867912a143 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:20:39 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-096486f4-dc82-47a3-979f-055e6b278f7e req-1aa40b41-0c19-4730-8bdd-045d617a883c service nova] Acquiring lock "bbcccf4b-e861-4254-9be3-a491776214e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:20:39 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-096486f4-dc82-47a3-979f-055e6b278f7e req-1aa40b41-0c19-4730-8bdd-045d617a883c service nova] Lock "bbcccf4b-e861-4254-9be3-a491776214e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:20:39 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-096486f4-dc82-47a3-979f-055e6b278f7e req-1aa40b41-0c19-4730-8bdd-045d617a883c service nova] Lock "bbcccf4b-e861-4254-9be3-a491776214e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:20:39 user nova-compute[71731]: DEBUG nova.compute.manager [req-096486f4-dc82-47a3-979f-055e6b278f7e req-1aa40b41-0c19-4730-8bdd-045d617a883c service nova] [instance: bbcccf4b-e861-4254-9be3-a491776214e9] No waiting events found dispatching network-vif-plugged-dbb2bf27-5de3-499c-ba4d-87867912a143 {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:20:39 user nova-compute[71731]: WARNING nova.compute.manager [req-096486f4-dc82-47a3-979f-055e6b278f7e req-1aa40b41-0c19-4730-8bdd-045d617a883c service nova] [instance: bbcccf4b-e861-4254-9be3-a491776214e9] Received unexpected event network-vif-plugged-dbb2bf27-5de3-499c-ba4d-87867912a143 for instance with vm_state building and task_state spawning.
Apr 13 16:20:39 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:20:39 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:20:40 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:20:40 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:20:40 user nova-compute[71731]: DEBUG nova.compute.manager [None req-f0db01f4-bdd2-4695-a17b-6cc5c1b51736 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] [instance: bbcccf4b-e861-4254-9be3-a491776214e9] Instance event wait completed in 0 seconds for  {{(pid=71731) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 16:20:40 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-f0db01f4-bdd2-4695-a17b-6cc5c1b51736 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] [instance: bbcccf4b-e861-4254-9be3-a491776214e9] Guest created on hypervisor {{(pid=71731) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 16:20:40 user nova-compute[71731]: DEBUG nova.virt.driver [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Emitting event <LifecycleEvent: 1681402840.515236, bbcccf4b-e861-4254-9be3-a491776214e9 => Resumed> {{(pid=71731) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 16:20:40 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: bbcccf4b-e861-4254-9be3-a491776214e9] VM Resumed (Lifecycle Event)
Apr 13 16:20:40 user nova-compute[71731]: INFO nova.virt.libvirt.driver [-] [instance: bbcccf4b-e861-4254-9be3-a491776214e9] Instance spawned successfully.
Apr 13 16:20:40 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-f0db01f4-bdd2-4695-a17b-6cc5c1b51736 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] [instance: bbcccf4b-e861-4254-9be3-a491776214e9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 16:20:40 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: bbcccf4b-e861-4254-9be3-a491776214e9] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:20:40 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: bbcccf4b-e861-4254-9be3-a491776214e9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71731) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 16:20:40 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-f0db01f4-bdd2-4695-a17b-6cc5c1b51736 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] [instance: bbcccf4b-e861-4254-9be3-a491776214e9] Found default for hw_cdrom_bus of ide {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:20:40 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-f0db01f4-bdd2-4695-a17b-6cc5c1b51736 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] [instance: bbcccf4b-e861-4254-9be3-a491776214e9] Found default for hw_disk_bus of virtio {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:20:40 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-f0db01f4-bdd2-4695-a17b-6cc5c1b51736 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] [instance: bbcccf4b-e861-4254-9be3-a491776214e9] Found default for hw_input_bus of None {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:20:40 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-f0db01f4-bdd2-4695-a17b-6cc5c1b51736 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] [instance: bbcccf4b-e861-4254-9be3-a491776214e9] Found default for hw_pointer_model of None {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:20:40 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-f0db01f4-bdd2-4695-a17b-6cc5c1b51736 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] [instance: bbcccf4b-e861-4254-9be3-a491776214e9] Found default for hw_video_model of virtio {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:20:40 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-f0db01f4-bdd2-4695-a17b-6cc5c1b51736 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] [instance: bbcccf4b-e861-4254-9be3-a491776214e9] Found default for hw_vif_model of virtio {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:20:40 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: bbcccf4b-e861-4254-9be3-a491776214e9] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 16:20:40 user nova-compute[71731]: DEBUG nova.virt.driver [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Emitting event <LifecycleEvent: 1681402840.5155575, bbcccf4b-e861-4254-9be3-a491776214e9 => Started> {{(pid=71731) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 16:20:40 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: bbcccf4b-e861-4254-9be3-a491776214e9] VM Started (Lifecycle Event)
Apr 13 16:20:40 user nova-compute[71731]: INFO nova.compute.manager [None req-f0db01f4-bdd2-4695-a17b-6cc5c1b51736 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] [instance: bbcccf4b-e861-4254-9be3-a491776214e9] Took 11.69 seconds to spawn the instance on the hypervisor.
Apr 13 16:20:40 user nova-compute[71731]: DEBUG nova.compute.manager [None req-f0db01f4-bdd2-4695-a17b-6cc5c1b51736 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] [instance: bbcccf4b-e861-4254-9be3-a491776214e9] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:20:40 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: bbcccf4b-e861-4254-9be3-a491776214e9] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:20:40 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:20:40 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: bbcccf4b-e861-4254-9be3-a491776214e9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71731) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 16:20:40 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-59e8e03a-366d-482d-b5c3-cb26296981c9 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Acquiring lock "5db1cb51-2e5a-46c9-8914-cba759a96a65" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:20:40 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-59e8e03a-366d-482d-b5c3-cb26296981c9 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Lock "5db1cb51-2e5a-46c9-8914-cba759a96a65" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:20:40 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: bbcccf4b-e861-4254-9be3-a491776214e9] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 16:20:40 user nova-compute[71731]: DEBUG nova.compute.manager [None req-59e8e03a-366d-482d-b5c3-cb26296981c9 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] [instance: 5db1cb51-2e5a-46c9-8914-cba759a96a65] Starting instance... {{(pid=71731) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 16:20:40 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:20:40 user nova-compute[71731]: INFO nova.compute.manager [None req-f0db01f4-bdd2-4695-a17b-6cc5c1b51736 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] [instance: bbcccf4b-e861-4254-9be3-a491776214e9] Took 12.53 seconds to build instance.
Apr 13 16:20:40 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-f0db01f4-bdd2-4695-a17b-6cc5c1b51736 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Lock "bbcccf4b-e861-4254-9be3-a491776214e9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.671s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:20:40 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:20:40 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:20:40 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:20:41 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:20:41 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-59e8e03a-366d-482d-b5c3-cb26296981c9 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:20:41 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-59e8e03a-366d-482d-b5c3-cb26296981c9 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:20:41 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-59e8e03a-366d-482d-b5c3-cb26296981c9 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71731) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 16:20:41 user nova-compute[71731]: INFO nova.compute.claims [None req-59e8e03a-366d-482d-b5c3-cb26296981c9 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] [instance: 5db1cb51-2e5a-46c9-8914-cba759a96a65] Claim successful on node user
Apr 13 16:20:41 user nova-compute[71731]: DEBUG nova.compute.provider_tree [None req-59e8e03a-366d-482d-b5c3-cb26296981c9 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Inventory has not changed in ProviderTree for provider: cb6b1a64-0c24-4e2d-af1e-16576ca9165c {{(pid=71731) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 16:20:41 user nova-compute[71731]: DEBUG nova.compute.manager [req-e96b62c7-4452-4a14-83c0-0f2544e0be1d req-ffbe72d9-b7bd-4b40-90a8-857a73edeb26 service nova] [instance: bbcccf4b-e861-4254-9be3-a491776214e9] Received event network-vif-plugged-dbb2bf27-5de3-499c-ba4d-87867912a143 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:20:41 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-e96b62c7-4452-4a14-83c0-0f2544e0be1d req-ffbe72d9-b7bd-4b40-90a8-857a73edeb26 service nova] Acquiring lock "bbcccf4b-e861-4254-9be3-a491776214e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:20:41 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-e96b62c7-4452-4a14-83c0-0f2544e0be1d req-ffbe72d9-b7bd-4b40-90a8-857a73edeb26 service nova] Lock "bbcccf4b-e861-4254-9be3-a491776214e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:20:41 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-e96b62c7-4452-4a14-83c0-0f2544e0be1d req-ffbe72d9-b7bd-4b40-90a8-857a73edeb26 service nova] Lock "bbcccf4b-e861-4254-9be3-a491776214e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:20:41 user nova-compute[71731]: DEBUG nova.compute.manager [req-e96b62c7-4452-4a14-83c0-0f2544e0be1d req-ffbe72d9-b7bd-4b40-90a8-857a73edeb26 service nova] [instance: bbcccf4b-e861-4254-9be3-a491776214e9] No waiting events found dispatching network-vif-plugged-dbb2bf27-5de3-499c-ba4d-87867912a143 {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:20:41 user nova-compute[71731]: WARNING nova.compute.manager [req-e96b62c7-4452-4a14-83c0-0f2544e0be1d req-ffbe72d9-b7bd-4b40-90a8-857a73edeb26 service nova] [instance: bbcccf4b-e861-4254-9be3-a491776214e9] Received unexpected event network-vif-plugged-dbb2bf27-5de3-499c-ba4d-87867912a143 for instance with vm_state active and task_state None.
Apr 13 16:20:41 user nova-compute[71731]: DEBUG nova.scheduler.client.report [None req-59e8e03a-366d-482d-b5c3-cb26296981c9 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Inventory has not changed for provider cb6b1a64-0c24-4e2d-af1e-16576ca9165c based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71731) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 16:20:41 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-59e8e03a-366d-482d-b5c3-cb26296981c9 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.647s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:20:41 user nova-compute[71731]: DEBUG nova.compute.manager [None req-59e8e03a-366d-482d-b5c3-cb26296981c9 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] [instance: 5db1cb51-2e5a-46c9-8914-cba759a96a65] Start building networks asynchronously for instance. {{(pid=71731) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 16:20:41 user nova-compute[71731]: DEBUG nova.compute.manager [None req-59e8e03a-366d-482d-b5c3-cb26296981c9 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] [instance: 5db1cb51-2e5a-46c9-8914-cba759a96a65] Allocating IP information in the background. {{(pid=71731) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 16:20:41 user nova-compute[71731]: DEBUG nova.network.neutron [None req-59e8e03a-366d-482d-b5c3-cb26296981c9 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] [instance: 5db1cb51-2e5a-46c9-8914-cba759a96a65] allocate_for_instance() {{(pid=71731) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 16:20:41 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-59e8e03a-366d-482d-b5c3-cb26296981c9 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] [instance: 5db1cb51-2e5a-46c9-8914-cba759a96a65] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 16:20:41 user nova-compute[71731]: DEBUG nova.compute.manager [None req-59e8e03a-366d-482d-b5c3-cb26296981c9 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] [instance: 5db1cb51-2e5a-46c9-8914-cba759a96a65] Start building block device mappings for instance. {{(pid=71731) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 16:20:42 user nova-compute[71731]: DEBUG nova.policy [None req-59e8e03a-366d-482d-b5c3-cb26296981c9 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '62cf399757f544649fed18ee5a31d50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ded8a69b7e941f9bcdc502cfeed79db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71731) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 16:20:42 user nova-compute[71731]: DEBUG nova.compute.manager [None req-59e8e03a-366d-482d-b5c3-cb26296981c9 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] [instance: 5db1cb51-2e5a-46c9-8914-cba759a96a65] Start spawning the instance on the hypervisor. {{(pid=71731) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 16:20:42 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-59e8e03a-366d-482d-b5c3-cb26296981c9 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] [instance: 5db1cb51-2e5a-46c9-8914-cba759a96a65] Creating instance directory {{(pid=71731) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 16:20:42 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-59e8e03a-366d-482d-b5c3-cb26296981c9 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] [instance: 5db1cb51-2e5a-46c9-8914-cba759a96a65] Creating image(s)
Apr 13 16:20:42 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-59e8e03a-366d-482d-b5c3-cb26296981c9 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Acquiring lock "/opt/stack/data/nova/instances/5db1cb51-2e5a-46c9-8914-cba759a96a65/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:20:42 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-59e8e03a-366d-482d-b5c3-cb26296981c9 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Lock "/opt/stack/data/nova/instances/5db1cb51-2e5a-46c9-8914-cba759a96a65/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:20:42 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-59e8e03a-366d-482d-b5c3-cb26296981c9 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Lock "/opt/stack/data/nova/instances/5db1cb51-2e5a-46c9-8914-cba759a96a65/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:20:42 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-59e8e03a-366d-482d-b5c3-cb26296981c9 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279 --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:20:42 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-59e8e03a-366d-482d-b5c3-cb26296981c9 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279 --force-share --output=json" returned: 0 in 0.208s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:20:42 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-59e8e03a-366d-482d-b5c3-cb26296981c9 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Acquiring lock "9524227dd898575c3099d3976f096cd935414279" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:20:42 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-59e8e03a-366d-482d-b5c3-cb26296981c9 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Lock "9524227dd898575c3099d3976f096cd935414279" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:20:42 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-59e8e03a-366d-482d-b5c3-cb26296981c9 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279 --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:20:42 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-59e8e03a-366d-482d-b5c3-cb26296981c9 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279 --force-share --output=json" returned: 0 in 0.291s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:20:42 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-59e8e03a-366d-482d-b5c3-cb26296981c9 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279,backing_fmt=raw /opt/stack/data/nova/instances/5db1cb51-2e5a-46c9-8914-cba759a96a65/disk 1073741824 {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:20:42 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-59e8e03a-366d-482d-b5c3-cb26296981c9 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279,backing_fmt=raw /opt/stack/data/nova/instances/5db1cb51-2e5a-46c9-8914-cba759a96a65/disk 1073741824" returned: 0 in 0.062s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:20:42 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-59e8e03a-366d-482d-b5c3-cb26296981c9 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Lock "9524227dd898575c3099d3976f096cd935414279" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.364s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:20:42 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-59e8e03a-366d-482d-b5c3-cb26296981c9 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279 --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:20:42 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-59e8e03a-366d-482d-b5c3-cb26296981c9 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279 --force-share --output=json" returned: 0 in 0.184s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:20:42 user nova-compute[71731]: DEBUG nova.virt.disk.api [None req-59e8e03a-366d-482d-b5c3-cb26296981c9 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5db1cb51-2e5a-46c9-8914-cba759a96a65/disk. size=1073741824 {{(pid=71731) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 16:20:42 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-59e8e03a-366d-482d-b5c3-cb26296981c9 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5db1cb51-2e5a-46c9-8914-cba759a96a65/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:20:43 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-59e8e03a-366d-482d-b5c3-cb26296981c9 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5db1cb51-2e5a-46c9-8914-cba759a96a65/disk --force-share --output=json" returned: 0 in 0.256s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:20:43 user nova-compute[71731]: DEBUG nova.virt.disk.api [None req-59e8e03a-366d-482d-b5c3-cb26296981c9 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Cannot resize image /opt/stack/data/nova/instances/5db1cb51-2e5a-46c9-8914-cba759a96a65/disk to a smaller size. {{(pid=71731) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 16:20:43 user nova-compute[71731]: DEBUG nova.objects.instance [None req-59e8e03a-366d-482d-b5c3-cb26296981c9 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Lazy-loading 'migration_context' on Instance uuid 5db1cb51-2e5a-46c9-8914-cba759a96a65 {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:20:43 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-59e8e03a-366d-482d-b5c3-cb26296981c9 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] [instance: 5db1cb51-2e5a-46c9-8914-cba759a96a65] Created local disks {{(pid=71731) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 16:20:43 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-59e8e03a-366d-482d-b5c3-cb26296981c9 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] [instance: 5db1cb51-2e5a-46c9-8914-cba759a96a65] Ensure instance console log exists: /opt/stack/data/nova/instances/5db1cb51-2e5a-46c9-8914-cba759a96a65/console.log {{(pid=71731) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 16:20:43 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-59e8e03a-366d-482d-b5c3-cb26296981c9 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:20:43 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-59e8e03a-366d-482d-b5c3-cb26296981c9 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:20:43 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-59e8e03a-366d-482d-b5c3-cb26296981c9 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:20:43 user nova-compute[71731]: DEBUG nova.network.neutron [None req-59e8e03a-366d-482d-b5c3-cb26296981c9 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] [instance: 5db1cb51-2e5a-46c9-8914-cba759a96a65] Successfully created port: 628a1eb7-e3f1-4158-9f9e-1ae752c91c0b {{(pid=71731) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 16:20:44 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:20:44 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:20:44 user nova-compute[71731]: DEBUG nova.network.neutron [None req-59e8e03a-366d-482d-b5c3-cb26296981c9 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] [instance: 5db1cb51-2e5a-46c9-8914-cba759a96a65] Successfully updated port: 628a1eb7-e3f1-4158-9f9e-1ae752c91c0b {{(pid=71731) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 16:20:44 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-59e8e03a-366d-482d-b5c3-cb26296981c9 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Acquiring lock "refresh_cache-5db1cb51-2e5a-46c9-8914-cba759a96a65" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 16:20:44 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-59e8e03a-366d-482d-b5c3-cb26296981c9 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Acquired lock "refresh_cache-5db1cb51-2e5a-46c9-8914-cba759a96a65" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 16:20:44 user nova-compute[71731]: DEBUG nova.network.neutron [None req-59e8e03a-366d-482d-b5c3-cb26296981c9 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] [instance: 5db1cb51-2e5a-46c9-8914-cba759a96a65] Building network info cache for instance {{(pid=71731) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 16:20:44 user nova-compute[71731]: DEBUG nova.compute.manager [req-7ddbeb00-d0cc-4602-899d-d459732c299d req-d1ca2e59-da9e-4729-9d2b-88be883294c0 service nova] [instance: 5db1cb51-2e5a-46c9-8914-cba759a96a65] Received event network-changed-628a1eb7-e3f1-4158-9f9e-1ae752c91c0b {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:20:44 user nova-compute[71731]: DEBUG nova.compute.manager [req-7ddbeb00-d0cc-4602-899d-d459732c299d req-d1ca2e59-da9e-4729-9d2b-88be883294c0 service nova] [instance: 5db1cb51-2e5a-46c9-8914-cba759a96a65] Refreshing instance network info cache due to event network-changed-628a1eb7-e3f1-4158-9f9e-1ae752c91c0b. {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 16:20:44 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-7ddbeb00-d0cc-4602-899d-d459732c299d req-d1ca2e59-da9e-4729-9d2b-88be883294c0 service nova] Acquiring lock "refresh_cache-5db1cb51-2e5a-46c9-8914-cba759a96a65" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 16:20:44 user nova-compute[71731]: DEBUG nova.network.neutron [None req-59e8e03a-366d-482d-b5c3-cb26296981c9 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] [instance: 5db1cb51-2e5a-46c9-8914-cba759a96a65] Instance cache missing network info. {{(pid=71731) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 16:20:45 user nova-compute[71731]: DEBUG nova.network.neutron [None req-59e8e03a-366d-482d-b5c3-cb26296981c9 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] [instance: 5db1cb51-2e5a-46c9-8914-cba759a96a65] Updating instance_info_cache with network_info: [{"id": "628a1eb7-e3f1-4158-9f9e-1ae752c91c0b", "address": "fa:16:3e:fa:44:3c", "network": {"id": "fc7f5f86-d676-4a45-b0f4-c93f3eae043e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1421861184-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ded8a69b7e941f9bcdc502cfeed79db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap628a1eb7-e3", "ovs_interfaceid": "628a1eb7-e3f1-4158-9f9e-1ae752c91c0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:20:45 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-59e8e03a-366d-482d-b5c3-cb26296981c9 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Releasing lock "refresh_cache-5db1cb51-2e5a-46c9-8914-cba759a96a65" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 16:20:45 user nova-compute[71731]: DEBUG nova.compute.manager [None req-59e8e03a-366d-482d-b5c3-cb26296981c9 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] [instance: 5db1cb51-2e5a-46c9-8914-cba759a96a65] Instance network_info: |[{"id": "628a1eb7-e3f1-4158-9f9e-1ae752c91c0b", "address": "fa:16:3e:fa:44:3c", "network": {"id": "fc7f5f86-d676-4a45-b0f4-c93f3eae043e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1421861184-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ded8a69b7e941f9bcdc502cfeed79db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap628a1eb7-e3", "ovs_interfaceid": "628a1eb7-e3f1-4158-9f9e-1ae752c91c0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71731) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 16:20:45 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-7ddbeb00-d0cc-4602-899d-d459732c299d req-d1ca2e59-da9e-4729-9d2b-88be883294c0 service nova] Acquired lock "refresh_cache-5db1cb51-2e5a-46c9-8914-cba759a96a65" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 16:20:45 user nova-compute[71731]: DEBUG nova.network.neutron [req-7ddbeb00-d0cc-4602-899d-d459732c299d req-d1ca2e59-da9e-4729-9d2b-88be883294c0 service nova] [instance: 5db1cb51-2e5a-46c9-8914-cba759a96a65] Refreshing network info cache for port 628a1eb7-e3f1-4158-9f9e-1ae752c91c0b {{(pid=71731) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 16:20:45 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-59e8e03a-366d-482d-b5c3-cb26296981c9 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] [instance: 5db1cb51-2e5a-46c9-8914-cba759a96a65] Start _get_guest_xml network_info=[{"id": "628a1eb7-e3f1-4158-9f9e-1ae752c91c0b", "address": "fa:16:3e:fa:44:3c", "network": {"id": "fc7f5f86-d676-4a45-b0f4-c93f3eae043e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1421861184-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ded8a69b7e941f9bcdc502cfeed79db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap628a1eb7-e3", "ovs_interfaceid": "628a1eb7-e3f1-4158-9f9e-1ae752c91c0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T16:16:31Z,direct_url=<?>,disk_format='qcow2',id=708622a9-7465-4492-ade8-b827198f7e30,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='0b29a975c552465aba0ac7d6288434bd',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T16:16:33Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'device_type': 'disk', 'encrypted': False, 'disk_bus': 'virtio', 'guest_format': None, 'encryption_options': None, 'image_id': '708622a9-7465-4492-ade8-b827198f7e30'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71731) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 16:20:45 user nova-compute[71731]: WARNING nova.virt.libvirt.driver [None req-59e8e03a-366d-482d-b5c3-cb26296981c9 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 16:20:45 user nova-compute[71731]: WARNING nova.virt.libvirt.driver [None req-59e8e03a-366d-482d-b5c3-cb26296981c9 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 16:20:45 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-59e8e03a-366d-482d-b5c3-cb26296981c9 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71731) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 16:20:45 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-59e8e03a-366d-482d-b5c3-cb26296981c9 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T16:17:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T16:16:31Z,direct_url=<?>,disk_format='qcow2',id=708622a9-7465-4492-ade8-b827198f7e30,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='0b29a975c552465aba0ac7d6288434bd',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T16:16:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 16:20:45 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-59e8e03a-366d-482d-b5c3-cb26296981c9 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Flavor limits 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 16:20:45 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-59e8e03a-366d-482d-b5c3-cb26296981c9 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Image limits 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 16:20:45 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-59e8e03a-366d-482d-b5c3-cb26296981c9 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Flavor pref 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 16:20:45 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-59e8e03a-366d-482d-b5c3-cb26296981c9 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Image pref 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 16:20:45 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-59e8e03a-366d-482d-b5c3-cb26296981c9 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 16:20:45 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-59e8e03a-366d-482d-b5c3-cb26296981c9 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 16:20:45 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-59e8e03a-366d-482d-b5c3-cb26296981c9 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71731) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 16:20:45 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-59e8e03a-366d-482d-b5c3-cb26296981c9 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Got 1 possible topologies {{(pid=71731) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 16:20:45 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-59e8e03a-366d-482d-b5c3-cb26296981c9 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 16:20:45 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-59e8e03a-366d-482d-b5c3-cb26296981c9 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 16:20:45 user nova-compute[71731]: DEBUG nova.virt.libvirt.vif [None req-59e8e03a-366d-482d-b5c3-cb26296981c9 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T16:20:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1388049835',display_name='tempest-VolumesAdminNegativeTest-server-1388049835',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1388049835',id=5,image_ref='708622a9-7465-4492-ade8-b827198f7e30',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAcOvpOD5XjPPEJeFEcW6dxrI654P1ODhBXDII4jBiB5VjoxGbdzMtmJtJGe2JCrSo8EqpecX3xdXT+1+dP2nisICumUhzMVEIQe7hihwBIVzLzKia+yvR9Rz6xcYWfvCw==',key_name='tempest-keypair-16668737',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5ded8a69b7e941f9bcdc502cfeed79db',ramdisk_id='',reservation_id='r-83vneq2g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='708622a9-7465-4492-ade8-b827198f7e30',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-694044578',owner_user_name='tempest-VolumesAdminNegativeTest-694044578-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T16:20:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='62cf399757f544649fed18ee5a31d50c',uuid=5db1cb51-2e5a-46c9-8914-cba759a96a65,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "628a1eb7-e3f1-4158-9f9e-1ae752c91c0b", "address": "fa:16:3e:fa:44:3c", "network": {"id": "fc7f5f86-d676-4a45-b0f4-c93f3eae043e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1421861184-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ded8a69b7e941f9bcdc502cfeed79db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap628a1eb7-e3", "ovs_interfaceid": "628a1eb7-e3f1-4158-9f9e-1ae752c91c0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71731) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 16:20:45 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-59e8e03a-366d-482d-b5c3-cb26296981c9 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Converting VIF {"id": "628a1eb7-e3f1-4158-9f9e-1ae752c91c0b", "address": "fa:16:3e:fa:44:3c", "network": {"id": "fc7f5f86-d676-4a45-b0f4-c93f3eae043e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1421861184-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ded8a69b7e941f9bcdc502cfeed79db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap628a1eb7-e3", "ovs_interfaceid": "628a1eb7-e3f1-4158-9f9e-1ae752c91c0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 16:20:45 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-59e8e03a-366d-482d-b5c3-cb26296981c9 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fa:44:3c,bridge_name='br-int',has_traffic_filtering=True,id=628a1eb7-e3f1-4158-9f9e-1ae752c91c0b,network=Network(fc7f5f86-d676-4a45-b0f4-c93f3eae043e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap628a1eb7-e3') {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 16:20:45 user nova-compute[71731]: DEBUG nova.objects.instance [None req-59e8e03a-366d-482d-b5c3-cb26296981c9 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Lazy-loading 'pci_devices' on Instance uuid 5db1cb51-2e5a-46c9-8914-cba759a96a65 {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:20:45 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:20:45 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-59e8e03a-366d-482d-b5c3-cb26296981c9 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] [instance: 5db1cb51-2e5a-46c9-8914-cba759a96a65] End _get_guest_xml xml=<domain type="kvm">
Apr 13 16:20:45 user nova-compute[71731]:   <uuid>5db1cb51-2e5a-46c9-8914-cba759a96a65</uuid>
Apr 13 16:20:45 user nova-compute[71731]:   <name>instance-00000005</name>
Apr 13 16:20:45 user nova-compute[71731]:   <memory>131072</memory>
Apr 13 16:20:45 user nova-compute[71731]:   <vcpu>1</vcpu>
Apr 13 16:20:45 user nova-compute[71731]:   <metadata>
Apr 13 16:20:45 user nova-compute[71731]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 16:20:45 user nova-compute[71731]:       <nova:package version="0.0.0"/>
Apr 13 16:20:45 user nova-compute[71731]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1388049835</nova:name>
Apr 13 16:20:45 user nova-compute[71731]:       <nova:creationTime>2023-04-13 16:20:45</nova:creationTime>
Apr 13 16:20:45 user nova-compute[71731]:       <nova:flavor name="m1.nano">
Apr 13 16:20:45 user nova-compute[71731]:         <nova:memory>128</nova:memory>
Apr 13 16:20:45 user nova-compute[71731]:         <nova:disk>1</nova:disk>
Apr 13 16:20:45 user nova-compute[71731]:         <nova:swap>0</nova:swap>
Apr 13 16:20:45 user nova-compute[71731]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 16:20:45 user nova-compute[71731]:         <nova:vcpus>1</nova:vcpus>
Apr 13 16:20:45 user nova-compute[71731]:       </nova:flavor>
Apr 13 16:20:45 user nova-compute[71731]:       <nova:owner>
Apr 13 16:20:45 user nova-compute[71731]:         <nova:user uuid="62cf399757f544649fed18ee5a31d50c">tempest-VolumesAdminNegativeTest-694044578-project-member</nova:user>
Apr 13 16:20:45 user nova-compute[71731]:         <nova:project uuid="5ded8a69b7e941f9bcdc502cfeed79db">tempest-VolumesAdminNegativeTest-694044578</nova:project>
Apr 13 16:20:45 user nova-compute[71731]:       </nova:owner>
Apr 13 16:20:45 user nova-compute[71731]:       <nova:root type="image" uuid="708622a9-7465-4492-ade8-b827198f7e30"/>
Apr 13 16:20:45 user nova-compute[71731]:       <nova:ports>
Apr 13 16:20:45 user nova-compute[71731]:         <nova:port uuid="628a1eb7-e3f1-4158-9f9e-1ae752c91c0b">
Apr 13 16:20:45 user nova-compute[71731]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Apr 13 16:20:45 user nova-compute[71731]:         </nova:port>
Apr 13 16:20:45 user nova-compute[71731]:       </nova:ports>
Apr 13 16:20:45 user nova-compute[71731]:     </nova:instance>
Apr 13 16:20:45 user nova-compute[71731]:   </metadata>
Apr 13 16:20:45 user nova-compute[71731]:   <sysinfo type="smbios">
Apr 13 16:20:45 user nova-compute[71731]:     <system>
Apr 13 16:20:45 user nova-compute[71731]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 16:20:45 user nova-compute[71731]:       <entry name="product">OpenStack Nova</entry>
Apr 13 16:20:45 user nova-compute[71731]:       <entry name="version">0.0.0</entry>
Apr 13 16:20:45 user nova-compute[71731]:       <entry name="serial">5db1cb51-2e5a-46c9-8914-cba759a96a65</entry>
Apr 13 16:20:45 user nova-compute[71731]:       <entry name="uuid">5db1cb51-2e5a-46c9-8914-cba759a96a65</entry>
Apr 13 16:20:45 user nova-compute[71731]:       <entry name="family">Virtual Machine</entry>
Apr 13 16:20:45 user nova-compute[71731]:     </system>
Apr 13 16:20:45 user nova-compute[71731]:   </sysinfo>
Apr 13 16:20:45 user nova-compute[71731]:   <os>
Apr 13 16:20:45 user nova-compute[71731]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 16:20:45 user nova-compute[71731]:     <boot dev="hd"/>
Apr 13 16:20:45 user nova-compute[71731]:     <smbios mode="sysinfo"/>
Apr 13 16:20:45 user nova-compute[71731]:   </os>
Apr 13 16:20:45 user nova-compute[71731]:   <features>
Apr 13 16:20:45 user nova-compute[71731]:     <acpi/>
Apr 13 16:20:45 user nova-compute[71731]:     <apic/>
Apr 13 16:20:45 user nova-compute[71731]:     <vmcoreinfo/>
Apr 13 16:20:45 user nova-compute[71731]:   </features>
Apr 13 16:20:45 user nova-compute[71731]:   <clock offset="utc">
Apr 13 16:20:45 user nova-compute[71731]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 16:20:45 user nova-compute[71731]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 16:20:45 user nova-compute[71731]:     <timer name="hpet" present="no"/>
Apr 13 16:20:45 user nova-compute[71731]:   </clock>
Apr 13 16:20:45 user nova-compute[71731]:   <cpu mode="custom" match="exact">
Apr 13 16:20:45 user nova-compute[71731]:     <model>Nehalem</model>
Apr 13 16:20:45 user nova-compute[71731]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 16:20:45 user nova-compute[71731]:   </cpu>
Apr 13 16:20:45 user nova-compute[71731]:   <devices>
Apr 13 16:20:45 user nova-compute[71731]:     <disk type="file" device="disk">
Apr 13 16:20:45 user nova-compute[71731]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 16:20:45 user nova-compute[71731]:       <source file="/opt/stack/data/nova/instances/5db1cb51-2e5a-46c9-8914-cba759a96a65/disk"/>
Apr 13 16:20:45 user nova-compute[71731]:       <target dev="vda" bus="virtio"/>
Apr 13 16:20:45 user nova-compute[71731]:     </disk>
Apr 13 16:20:45 user nova-compute[71731]:     <interface type="ethernet">
Apr 13 16:20:45 user nova-compute[71731]:       <mac address="fa:16:3e:fa:44:3c"/>
Apr 13 16:20:45 user nova-compute[71731]:       <model type="virtio"/>
Apr 13 16:20:45 user nova-compute[71731]:       <mtu size="1442"/>
Apr 13 16:20:45 user nova-compute[71731]:       <target dev="tap628a1eb7-e3"/>
Apr 13 16:20:45 user nova-compute[71731]:     </interface>
Apr 13 16:20:45 user nova-compute[71731]:     <serial type="pty">
Apr 13 16:20:45 user nova-compute[71731]:       <log file="/opt/stack/data/nova/instances/5db1cb51-2e5a-46c9-8914-cba759a96a65/console.log" append="off"/>
Apr 13 16:20:45 user nova-compute[71731]:     </serial>
Apr 13 16:20:45 user nova-compute[71731]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 16:20:45 user nova-compute[71731]:     <video>
Apr 13 16:20:45 user nova-compute[71731]:       <model type="virtio"/>
Apr 13 16:20:45 user nova-compute[71731]:     </video>
Apr 13 16:20:45 user nova-compute[71731]:     <rng model="virtio">
Apr 13 16:20:45 user nova-compute[71731]:       <backend model="random">/dev/urandom</backend>
Apr 13 16:20:45 user nova-compute[71731]:     </rng>
Apr 13 16:20:45 user nova-compute[71731]:     <controller type="usb" index="0" model="none"/>
Apr 13 16:20:45 user nova-compute[71731]:     <memballoon model="virtio">
Apr 13 16:20:45 user nova-compute[71731]:       <stats period="10"/>
Apr 13 16:20:45 user nova-compute[71731]:     </memballoon>
Apr 13 16:20:45 user nova-compute[71731]:   </devices>
Apr 13 16:20:45 user nova-compute[71731]: </domain>
Apr 13 16:20:45 user nova-compute[71731]:  {{(pid=71731) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 16:20:45 user nova-compute[71731]: DEBUG nova.virt.libvirt.vif [None req-59e8e03a-366d-482d-b5c3-cb26296981c9 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T16:20:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1388049835',display_name='tempest-VolumesAdminNegativeTest-server-1388049835',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1388049835',id=5,image_ref='708622a9-7465-4492-ade8-b827198f7e30',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAcOvpOD5XjPPEJeFEcW6dxrI654P1ODhBXDII4jBiB5VjoxGbdzMtmJtJGe2JCrSo8EqpecX3xdXT+1+dP2nisICumUhzMVEIQe7hihwBIVzLzKia+yvR9Rz6xcYWfvCw==',key_name='tempest-keypair-16668737',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5ded8a69b7e941f9bcdc502cfeed79db',ramdisk_id='',reservation_id='r-83vneq2g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='708622a9-7465-4492-ade8-b827198f7e30',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-694044578',owner_user_name='tempest-VolumesAdminNegativeTest-694044578-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T16:20:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='62cf399757f544649fed18ee5a31d50c',uuid=5db1cb51-2e5a-46c9-8914-cba759a96a65,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "628a1eb7-e3f1-4158-9f9e-1ae752c91c0b", "address": "fa:16:3e:fa:44:3c", "network": {"id": "fc7f5f86-d676-4a45-b0f4-c93f3eae043e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1421861184-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ded8a69b7e941f9bcdc502cfeed79db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap628a1eb7-e3", "ovs_interfaceid": "628a1eb7-e3f1-4158-9f9e-1ae752c91c0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 16:20:45 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-59e8e03a-366d-482d-b5c3-cb26296981c9 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Converting VIF {"id": "628a1eb7-e3f1-4158-9f9e-1ae752c91c0b", "address": "fa:16:3e:fa:44:3c", "network": {"id": "fc7f5f86-d676-4a45-b0f4-c93f3eae043e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1421861184-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ded8a69b7e941f9bcdc502cfeed79db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap628a1eb7-e3", "ovs_interfaceid": "628a1eb7-e3f1-4158-9f9e-1ae752c91c0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 16:20:45 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-59e8e03a-366d-482d-b5c3-cb26296981c9 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fa:44:3c,bridge_name='br-int',has_traffic_filtering=True,id=628a1eb7-e3f1-4158-9f9e-1ae752c91c0b,network=Network(fc7f5f86-d676-4a45-b0f4-c93f3eae043e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap628a1eb7-e3') {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 16:20:45 user nova-compute[71731]: DEBUG os_vif [None req-59e8e03a-366d-482d-b5c3-cb26296981c9 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fa:44:3c,bridge_name='br-int',has_traffic_filtering=True,id=628a1eb7-e3f1-4158-9f9e-1ae752c91c0b,network=Network(fc7f5f86-d676-4a45-b0f4-c93f3eae043e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap628a1eb7-e3') {{(pid=71731) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 16:20:45 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:20:45 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:20:45 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 16:20:45 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:20:45 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:20:45 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap628a1eb7-e3, may_exist=True) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:20:45 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap628a1eb7-e3, col_values=(('external_ids', {'iface-id': '628a1eb7-e3f1-4158-9f9e-1ae752c91c0b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fa:44:3c', 'vm-uuid': '5db1cb51-2e5a-46c9-8914-cba759a96a65'}),)) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:20:45 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:20:45 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 16:20:45 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:20:45 user nova-compute[71731]: INFO os_vif [None req-59e8e03a-366d-482d-b5c3-cb26296981c9 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fa:44:3c,bridge_name='br-int',has_traffic_filtering=True,id=628a1eb7-e3f1-4158-9f9e-1ae752c91c0b,network=Network(fc7f5f86-d676-4a45-b0f4-c93f3eae043e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap628a1eb7-e3')
Apr 13 16:20:46 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-59e8e03a-366d-482d-b5c3-cb26296981c9 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] No BDM found with device name vda, not building metadata. {{(pid=71731) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 16:20:46 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-59e8e03a-366d-482d-b5c3-cb26296981c9 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] No VIF found with MAC fa:16:3e:fa:44:3c, not building metadata {{(pid=71731) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 16:20:46 user nova-compute[71731]: DEBUG nova.network.neutron [req-7ddbeb00-d0cc-4602-899d-d459732c299d req-d1ca2e59-da9e-4729-9d2b-88be883294c0 service nova] [instance: 5db1cb51-2e5a-46c9-8914-cba759a96a65] Updated VIF entry in instance network info cache for port 628a1eb7-e3f1-4158-9f9e-1ae752c91c0b. {{(pid=71731) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 16:20:46 user nova-compute[71731]: DEBUG nova.network.neutron [req-7ddbeb00-d0cc-4602-899d-d459732c299d req-d1ca2e59-da9e-4729-9d2b-88be883294c0 service nova] [instance: 5db1cb51-2e5a-46c9-8914-cba759a96a65] Updating instance_info_cache with network_info: [{"id": "628a1eb7-e3f1-4158-9f9e-1ae752c91c0b", "address": "fa:16:3e:fa:44:3c", "network": {"id": "fc7f5f86-d676-4a45-b0f4-c93f3eae043e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1421861184-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ded8a69b7e941f9bcdc502cfeed79db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap628a1eb7-e3", "ovs_interfaceid": "628a1eb7-e3f1-4158-9f9e-1ae752c91c0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:20:46 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-7ddbeb00-d0cc-4602-899d-d459732c299d req-d1ca2e59-da9e-4729-9d2b-88be883294c0 service nova] Releasing lock "refresh_cache-5db1cb51-2e5a-46c9-8914-cba759a96a65" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 16:20:47 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:20:47 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:20:47 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:20:47 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:20:48 user nova-compute[71731]: DEBUG nova.compute.manager [req-d355a0d2-c005-41b8-9bff-8147c86a5436 req-584ad706-ca05-4fae-a759-4e7f0d517176 service nova] [instance: 5db1cb51-2e5a-46c9-8914-cba759a96a65] Received event network-vif-plugged-628a1eb7-e3f1-4158-9f9e-1ae752c91c0b {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:20:48 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-d355a0d2-c005-41b8-9bff-8147c86a5436 req-584ad706-ca05-4fae-a759-4e7f0d517176 service nova] Acquiring lock "5db1cb51-2e5a-46c9-8914-cba759a96a65-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:20:48 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-d355a0d2-c005-41b8-9bff-8147c86a5436 req-584ad706-ca05-4fae-a759-4e7f0d517176 service nova] Lock "5db1cb51-2e5a-46c9-8914-cba759a96a65-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:20:48 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-d355a0d2-c005-41b8-9bff-8147c86a5436 req-584ad706-ca05-4fae-a759-4e7f0d517176 service nova] Lock "5db1cb51-2e5a-46c9-8914-cba759a96a65-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:20:48 user nova-compute[71731]: DEBUG nova.compute.manager [req-d355a0d2-c005-41b8-9bff-8147c86a5436 req-584ad706-ca05-4fae-a759-4e7f0d517176 service nova] [instance: 5db1cb51-2e5a-46c9-8914-cba759a96a65] No waiting events found dispatching network-vif-plugged-628a1eb7-e3f1-4158-9f9e-1ae752c91c0b {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:20:48 user nova-compute[71731]: WARNING nova.compute.manager [req-d355a0d2-c005-41b8-9bff-8147c86a5436 req-584ad706-ca05-4fae-a759-4e7f0d517176 service nova] [instance: 5db1cb51-2e5a-46c9-8914-cba759a96a65] Received unexpected event network-vif-plugged-628a1eb7-e3f1-4158-9f9e-1ae752c91c0b for instance with vm_state building and task_state spawning.
Apr 13 16:20:48 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:20:48 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:20:50 user nova-compute[71731]: DEBUG nova.compute.manager [None req-59e8e03a-366d-482d-b5c3-cb26296981c9 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] [instance: 5db1cb51-2e5a-46c9-8914-cba759a96a65] Instance event wait completed in 0 seconds for  {{(pid=71731) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 16:20:50 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-59e8e03a-366d-482d-b5c3-cb26296981c9 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] [instance: 5db1cb51-2e5a-46c9-8914-cba759a96a65] Guest created on hypervisor {{(pid=71731) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 16:20:50 user nova-compute[71731]: DEBUG nova.virt.driver [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Emitting event <LifecycleEvent: 1681402850.3461943, 5db1cb51-2e5a-46c9-8914-cba759a96a65 => Resumed> {{(pid=71731) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 16:20:50 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 5db1cb51-2e5a-46c9-8914-cba759a96a65] VM Resumed (Lifecycle Event)
Apr 13 16:20:50 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 5db1cb51-2e5a-46c9-8914-cba759a96a65] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:20:50 user nova-compute[71731]: INFO nova.virt.libvirt.driver [-] [instance: 5db1cb51-2e5a-46c9-8914-cba759a96a65] Instance spawned successfully.
Apr 13 16:20:50 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-59e8e03a-366d-482d-b5c3-cb26296981c9 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] [instance: 5db1cb51-2e5a-46c9-8914-cba759a96a65] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 16:20:50 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 5db1cb51-2e5a-46c9-8914-cba759a96a65] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71731) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 16:20:50 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 5db1cb51-2e5a-46c9-8914-cba759a96a65] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 16:20:50 user nova-compute[71731]: DEBUG nova.virt.driver [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Emitting event <LifecycleEvent: 1681402850.3462992, 5db1cb51-2e5a-46c9-8914-cba759a96a65 => Started> {{(pid=71731) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 16:20:50 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 5db1cb51-2e5a-46c9-8914-cba759a96a65] VM Started (Lifecycle Event)
Apr 13 16:20:50 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-59e8e03a-366d-482d-b5c3-cb26296981c9 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] [instance: 5db1cb51-2e5a-46c9-8914-cba759a96a65] Found default for hw_cdrom_bus of ide {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:20:50 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-59e8e03a-366d-482d-b5c3-cb26296981c9 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] [instance: 5db1cb51-2e5a-46c9-8914-cba759a96a65] Found default for hw_disk_bus of virtio {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:20:50 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-59e8e03a-366d-482d-b5c3-cb26296981c9 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] [instance: 5db1cb51-2e5a-46c9-8914-cba759a96a65] Found default for hw_input_bus of None {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:20:50 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-59e8e03a-366d-482d-b5c3-cb26296981c9 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] [instance: 5db1cb51-2e5a-46c9-8914-cba759a96a65] Found default for hw_pointer_model of None {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:20:50 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-59e8e03a-366d-482d-b5c3-cb26296981c9 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] [instance: 5db1cb51-2e5a-46c9-8914-cba759a96a65] Found default for hw_video_model of virtio {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:20:50 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-59e8e03a-366d-482d-b5c3-cb26296981c9 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] [instance: 5db1cb51-2e5a-46c9-8914-cba759a96a65] Found default for hw_vif_model of virtio {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:20:50 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 5db1cb51-2e5a-46c9-8914-cba759a96a65] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:20:50 user nova-compute[71731]: DEBUG nova.compute.manager [req-71336ca3-b3f5-4fa9-b2c9-396034986d35 req-95004ee8-ed2f-454b-92bd-004d71612e54 service nova] [instance: 5db1cb51-2e5a-46c9-8914-cba759a96a65] Received event network-vif-plugged-628a1eb7-e3f1-4158-9f9e-1ae752c91c0b {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:20:50 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-71336ca3-b3f5-4fa9-b2c9-396034986d35 req-95004ee8-ed2f-454b-92bd-004d71612e54 service nova] Acquiring lock "5db1cb51-2e5a-46c9-8914-cba759a96a65-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:20:50 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-71336ca3-b3f5-4fa9-b2c9-396034986d35 req-95004ee8-ed2f-454b-92bd-004d71612e54 service nova] Lock "5db1cb51-2e5a-46c9-8914-cba759a96a65-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:20:50 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-71336ca3-b3f5-4fa9-b2c9-396034986d35 req-95004ee8-ed2f-454b-92bd-004d71612e54 service nova] Lock "5db1cb51-2e5a-46c9-8914-cba759a96a65-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:20:50 user nova-compute[71731]: DEBUG nova.compute.manager [req-71336ca3-b3f5-4fa9-b2c9-396034986d35 req-95004ee8-ed2f-454b-92bd-004d71612e54 service nova] [instance: 5db1cb51-2e5a-46c9-8914-cba759a96a65] No waiting events found dispatching network-vif-plugged-628a1eb7-e3f1-4158-9f9e-1ae752c91c0b {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:20:50 user nova-compute[71731]: WARNING nova.compute.manager [req-71336ca3-b3f5-4fa9-b2c9-396034986d35 req-95004ee8-ed2f-454b-92bd-004d71612e54 service nova] [instance: 5db1cb51-2e5a-46c9-8914-cba759a96a65] Received unexpected event network-vif-plugged-628a1eb7-e3f1-4158-9f9e-1ae752c91c0b for instance with vm_state building and task_state spawning.
Apr 13 16:20:50 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 5db1cb51-2e5a-46c9-8914-cba759a96a65] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71731) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 16:20:50 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 5db1cb51-2e5a-46c9-8914-cba759a96a65] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 16:20:50 user nova-compute[71731]: INFO nova.compute.manager [None req-59e8e03a-366d-482d-b5c3-cb26296981c9 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] [instance: 5db1cb51-2e5a-46c9-8914-cba759a96a65] Took 8.46 seconds to spawn the instance on the hypervisor.
Apr 13 16:20:50 user nova-compute[71731]: DEBUG nova.compute.manager [None req-59e8e03a-366d-482d-b5c3-cb26296981c9 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] [instance: 5db1cb51-2e5a-46c9-8914-cba759a96a65] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:20:50 user nova-compute[71731]: INFO nova.compute.manager [None req-59e8e03a-366d-482d-b5c3-cb26296981c9 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] [instance: 5db1cb51-2e5a-46c9-8914-cba759a96a65] Took 9.71 seconds to build instance.
Apr 13 16:20:50 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-59e8e03a-366d-482d-b5c3-cb26296981c9 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Lock "5db1cb51-2e5a-46c9-8914-cba759a96a65" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.900s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:20:50 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:20:50 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:20:54 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-7c6f31e7-806d-4b11-9302-4bddd57294b7 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] Acquiring lock "cf54be22-2a5d-40c4-8a1a-0060c77f83f6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:20:54 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-7c6f31e7-806d-4b11-9302-4bddd57294b7 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] Lock "cf54be22-2a5d-40c4-8a1a-0060c77f83f6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:20:54 user nova-compute[71731]: DEBUG nova.compute.manager [None req-7c6f31e7-806d-4b11-9302-4bddd57294b7 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] [instance: cf54be22-2a5d-40c4-8a1a-0060c77f83f6] Starting instance... {{(pid=71731) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 16:20:54 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-7c6f31e7-806d-4b11-9302-4bddd57294b7 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:20:54 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-7c6f31e7-806d-4b11-9302-4bddd57294b7 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:20:54 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-7c6f31e7-806d-4b11-9302-4bddd57294b7 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71731) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 16:20:54 user nova-compute[71731]: INFO nova.compute.claims [None req-7c6f31e7-806d-4b11-9302-4bddd57294b7 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] [instance: cf54be22-2a5d-40c4-8a1a-0060c77f83f6] Claim successful on node user
Apr 13 16:20:54 user nova-compute[71731]: DEBUG nova.compute.provider_tree [None req-7c6f31e7-806d-4b11-9302-4bddd57294b7 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] Inventory has not changed in ProviderTree for provider: cb6b1a64-0c24-4e2d-af1e-16576ca9165c {{(pid=71731) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 16:20:54 user nova-compute[71731]: DEBUG nova.scheduler.client.report [None req-7c6f31e7-806d-4b11-9302-4bddd57294b7 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] Inventory has not changed for provider cb6b1a64-0c24-4e2d-af1e-16576ca9165c based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71731) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 16:20:54 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-7c6f31e7-806d-4b11-9302-4bddd57294b7 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.632s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:20:54 user nova-compute[71731]: DEBUG nova.compute.manager [None req-7c6f31e7-806d-4b11-9302-4bddd57294b7 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] [instance: cf54be22-2a5d-40c4-8a1a-0060c77f83f6] Start building networks asynchronously for instance. {{(pid=71731) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 16:20:54 user nova-compute[71731]: DEBUG nova.compute.manager [None req-7c6f31e7-806d-4b11-9302-4bddd57294b7 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] [instance: cf54be22-2a5d-40c4-8a1a-0060c77f83f6] Allocating IP information in the background. {{(pid=71731) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 16:20:54 user nova-compute[71731]: DEBUG nova.network.neutron [None req-7c6f31e7-806d-4b11-9302-4bddd57294b7 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] [instance: cf54be22-2a5d-40c4-8a1a-0060c77f83f6] allocate_for_instance() {{(pid=71731) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 16:20:54 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-7c6f31e7-806d-4b11-9302-4bddd57294b7 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] [instance: cf54be22-2a5d-40c4-8a1a-0060c77f83f6] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Apr 13 16:20:55 user nova-compute[71731]: DEBUG nova.compute.manager [None req-7c6f31e7-806d-4b11-9302-4bddd57294b7 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] [instance: cf54be22-2a5d-40c4-8a1a-0060c77f83f6] Start building block device mappings for instance. {{(pid=71731) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 16:20:55 user nova-compute[71731]: DEBUG nova.policy [None req-7c6f31e7-806d-4b11-9302-4bddd57294b7 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0b143a8db8a3410eb09b21ced7bd883e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6365a1e8d6c48499d4b8921244d92a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71731) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 16:20:55 user nova-compute[71731]: DEBUG nova.compute.manager [None req-7c6f31e7-806d-4b11-9302-4bddd57294b7 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] [instance: cf54be22-2a5d-40c4-8a1a-0060c77f83f6] Start spawning the instance on the hypervisor. {{(pid=71731) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 16:20:55 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-7c6f31e7-806d-4b11-9302-4bddd57294b7 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] [instance: cf54be22-2a5d-40c4-8a1a-0060c77f83f6] Creating instance directory {{(pid=71731) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 16:20:55 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-7c6f31e7-806d-4b11-9302-4bddd57294b7 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] [instance: cf54be22-2a5d-40c4-8a1a-0060c77f83f6] Creating image(s)
Apr 13 16:20:55 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-7c6f31e7-806d-4b11-9302-4bddd57294b7 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] Acquiring lock "/opt/stack/data/nova/instances/cf54be22-2a5d-40c4-8a1a-0060c77f83f6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:20:55 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-7c6f31e7-806d-4b11-9302-4bddd57294b7 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] Lock "/opt/stack/data/nova/instances/cf54be22-2a5d-40c4-8a1a-0060c77f83f6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:20:55 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-7c6f31e7-806d-4b11-9302-4bddd57294b7 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] Lock "/opt/stack/data/nova/instances/cf54be22-2a5d-40c4-8a1a-0060c77f83f6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:20:55 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-7c6f31e7-806d-4b11-9302-4bddd57294b7 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] Acquiring lock "57f83a61f4e1bf2db199b6b8e2d06ee1017f7214" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:20:55 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-7c6f31e7-806d-4b11-9302-4bddd57294b7 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] Lock "57f83a61f4e1bf2db199b6b8e2d06ee1017f7214" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:20:55 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-c288f58e-9ce6-4120-b7ca-12a8bbdd7b2e tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] Acquiring lock "8c6d8096-853b-4091-ad82-6faf8ffc85fa" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:20:55 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-c288f58e-9ce6-4120-b7ca-12a8bbdd7b2e tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] Lock "8c6d8096-853b-4091-ad82-6faf8ffc85fa" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:20:55 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-7c6f31e7-806d-4b11-9302-4bddd57294b7 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/57f83a61f4e1bf2db199b6b8e2d06ee1017f7214.part --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:20:55 user nova-compute[71731]: DEBUG nova.compute.manager [None req-c288f58e-9ce6-4120-b7ca-12a8bbdd7b2e tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] [instance: 8c6d8096-853b-4091-ad82-6faf8ffc85fa] Starting instance... {{(pid=71731) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 16:20:55 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:20:55 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-c288f58e-9ce6-4120-b7ca-12a8bbdd7b2e tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:20:55 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-c288f58e-9ce6-4120-b7ca-12a8bbdd7b2e tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:20:55 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-c288f58e-9ce6-4120-b7ca-12a8bbdd7b2e tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71731) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 16:20:55 user nova-compute[71731]: INFO nova.compute.claims [None req-c288f58e-9ce6-4120-b7ca-12a8bbdd7b2e tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] [instance: 8c6d8096-853b-4091-ad82-6faf8ffc85fa] Claim successful on node user
Apr 13 16:20:55 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:20:55 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-7c6f31e7-806d-4b11-9302-4bddd57294b7 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/57f83a61f4e1bf2db199b6b8e2d06ee1017f7214.part --force-share --output=json" returned: 0 in 0.293s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:20:55 user nova-compute[71731]: DEBUG nova.virt.images [None req-7c6f31e7-806d-4b11-9302-4bddd57294b7 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] 01cb01f7-9c27-41ff-9feb-78a78b8b56e5 was qcow2, converting to raw {{(pid=71731) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 13 16:20:55 user nova-compute[71731]: DEBUG nova.privsep.utils [None req-7c6f31e7-806d-4b11-9302-4bddd57294b7 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71731) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 13 16:20:55 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-7c6f31e7-806d-4b11-9302-4bddd57294b7 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/57f83a61f4e1bf2db199b6b8e2d06ee1017f7214.part /opt/stack/data/nova/instances/_base/57f83a61f4e1bf2db199b6b8e2d06ee1017f7214.converted {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:20:56 user nova-compute[71731]: DEBUG nova.network.neutron [None req-7c6f31e7-806d-4b11-9302-4bddd57294b7 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] [instance: cf54be22-2a5d-40c4-8a1a-0060c77f83f6] Successfully created port: 3e9128bc-6e2e-4c5e-bf37-1142304eff26 {{(pid=71731) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 16:20:56 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-7c6f31e7-806d-4b11-9302-4bddd57294b7 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/57f83a61f4e1bf2db199b6b8e2d06ee1017f7214.part /opt/stack/data/nova/instances/_base/57f83a61f4e1bf2db199b6b8e2d06ee1017f7214.converted" returned: 0 in 0.223s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:20:56 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-7c6f31e7-806d-4b11-9302-4bddd57294b7 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/57f83a61f4e1bf2db199b6b8e2d06ee1017f7214.converted --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:20:56 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-7c6f31e7-806d-4b11-9302-4bddd57294b7 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/57f83a61f4e1bf2db199b6b8e2d06ee1017f7214.converted --force-share --output=json" returned: 0 in 0.166s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:20:56 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-7c6f31e7-806d-4b11-9302-4bddd57294b7 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] Lock "57f83a61f4e1bf2db199b6b8e2d06ee1017f7214" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.190s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:20:56 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-7c6f31e7-806d-4b11-9302-4bddd57294b7 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/57f83a61f4e1bf2db199b6b8e2d06ee1017f7214 --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:20:56 user nova-compute[71731]: DEBUG nova.compute.provider_tree [None req-c288f58e-9ce6-4120-b7ca-12a8bbdd7b2e tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] Inventory has not changed in ProviderTree for provider: cb6b1a64-0c24-4e2d-af1e-16576ca9165c {{(pid=71731) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 16:20:56 user nova-compute[71731]: DEBUG nova.scheduler.client.report [None req-c288f58e-9ce6-4120-b7ca-12a8bbdd7b2e tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] Inventory has not changed for provider cb6b1a64-0c24-4e2d-af1e-16576ca9165c based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71731) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 16:20:56 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-7c6f31e7-806d-4b11-9302-4bddd57294b7 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/57f83a61f4e1bf2db199b6b8e2d06ee1017f7214 --force-share --output=json" returned: 0 in 0.163s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:20:56 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-7c6f31e7-806d-4b11-9302-4bddd57294b7 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] Acquiring lock "57f83a61f4e1bf2db199b6b8e2d06ee1017f7214" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:20:56 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-7c6f31e7-806d-4b11-9302-4bddd57294b7 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] Lock "57f83a61f4e1bf2db199b6b8e2d06ee1017f7214" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:20:56 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-7c6f31e7-806d-4b11-9302-4bddd57294b7 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/57f83a61f4e1bf2db199b6b8e2d06ee1017f7214 --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:20:56 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-c288f58e-9ce6-4120-b7ca-12a8bbdd7b2e tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.688s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:20:56 user nova-compute[71731]: DEBUG nova.compute.manager [None req-c288f58e-9ce6-4120-b7ca-12a8bbdd7b2e tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] [instance: 8c6d8096-853b-4091-ad82-6faf8ffc85fa] Start building networks asynchronously for instance. {{(pid=71731) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 16:20:56 user nova-compute[71731]: DEBUG nova.compute.manager [None req-c288f58e-9ce6-4120-b7ca-12a8bbdd7b2e tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] [instance: 8c6d8096-853b-4091-ad82-6faf8ffc85fa] Allocating IP information in the background. {{(pid=71731) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 16:20:56 user nova-compute[71731]: DEBUG nova.network.neutron [None req-c288f58e-9ce6-4120-b7ca-12a8bbdd7b2e tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] [instance: 8c6d8096-853b-4091-ad82-6faf8ffc85fa] allocate_for_instance() {{(pid=71731) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 16:20:56 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-c288f58e-9ce6-4120-b7ca-12a8bbdd7b2e tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] [instance: 8c6d8096-853b-4091-ad82-6faf8ffc85fa] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 16:20:56 user nova-compute[71731]: DEBUG nova.compute.manager [None req-c288f58e-9ce6-4120-b7ca-12a8bbdd7b2e tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] [instance: 8c6d8096-853b-4091-ad82-6faf8ffc85fa] Start building block device mappings for instance. {{(pid=71731) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 16:20:56 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-7c6f31e7-806d-4b11-9302-4bddd57294b7 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/57f83a61f4e1bf2db199b6b8e2d06ee1017f7214 --force-share --output=json" returned: 0 in 0.198s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:20:56 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-7c6f31e7-806d-4b11-9302-4bddd57294b7 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/57f83a61f4e1bf2db199b6b8e2d06ee1017f7214,backing_fmt=raw /opt/stack/data/nova/instances/cf54be22-2a5d-40c4-8a1a-0060c77f83f6/disk 1073741824 {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:20:56 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-7c6f31e7-806d-4b11-9302-4bddd57294b7 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/57f83a61f4e1bf2db199b6b8e2d06ee1017f7214,backing_fmt=raw /opt/stack/data/nova/instances/cf54be22-2a5d-40c4-8a1a-0060c77f83f6/disk 1073741824" returned: 0 in 0.085s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:20:56 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-7c6f31e7-806d-4b11-9302-4bddd57294b7 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] Lock "57f83a61f4e1bf2db199b6b8e2d06ee1017f7214" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.290s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:20:56 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-7c6f31e7-806d-4b11-9302-4bddd57294b7 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/57f83a61f4e1bf2db199b6b8e2d06ee1017f7214 --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:20:56 user nova-compute[71731]: DEBUG nova.compute.manager [None req-c288f58e-9ce6-4120-b7ca-12a8bbdd7b2e tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] [instance: 8c6d8096-853b-4091-ad82-6faf8ffc85fa] Start spawning the instance on the hypervisor. {{(pid=71731) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 16:20:56 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-c288f58e-9ce6-4120-b7ca-12a8bbdd7b2e tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] [instance: 8c6d8096-853b-4091-ad82-6faf8ffc85fa] Creating instance directory {{(pid=71731) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 16:20:56 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-c288f58e-9ce6-4120-b7ca-12a8bbdd7b2e tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] [instance: 8c6d8096-853b-4091-ad82-6faf8ffc85fa] Creating image(s)
Apr 13 16:20:56 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-c288f58e-9ce6-4120-b7ca-12a8bbdd7b2e tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] Acquiring lock "/opt/stack/data/nova/instances/8c6d8096-853b-4091-ad82-6faf8ffc85fa/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:20:56 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-c288f58e-9ce6-4120-b7ca-12a8bbdd7b2e tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] Lock "/opt/stack/data/nova/instances/8c6d8096-853b-4091-ad82-6faf8ffc85fa/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:20:56 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-c288f58e-9ce6-4120-b7ca-12a8bbdd7b2e tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] Lock "/opt/stack/data/nova/instances/8c6d8096-853b-4091-ad82-6faf8ffc85fa/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:20:56 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-c288f58e-9ce6-4120-b7ca-12a8bbdd7b2e tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279 --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:20:56 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-7c6f31e7-806d-4b11-9302-4bddd57294b7 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/57f83a61f4e1bf2db199b6b8e2d06ee1017f7214 --force-share --output=json" returned: 0 in 0.153s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:20:56 user nova-compute[71731]: DEBUG nova.virt.disk.api [None req-7c6f31e7-806d-4b11-9302-4bddd57294b7 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] Checking if we can resize image /opt/stack/data/nova/instances/cf54be22-2a5d-40c4-8a1a-0060c77f83f6/disk. size=1073741824 {{(pid=71731) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 16:20:56 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-7c6f31e7-806d-4b11-9302-4bddd57294b7 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf54be22-2a5d-40c4-8a1a-0060c77f83f6/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:20:57 user nova-compute[71731]: DEBUG nova.policy [None req-c288f58e-9ce6-4120-b7ca-12a8bbdd7b2e tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '25b5e87b35e0471cafe541fdf224b5bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc3e2169a6c44d05b2a2eedbe3a063cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71731) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 16:20:57 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-c288f58e-9ce6-4120-b7ca-12a8bbdd7b2e tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279 --force-share --output=json" returned: 0 in 0.179s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:20:57 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-c288f58e-9ce6-4120-b7ca-12a8bbdd7b2e tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] Acquiring lock "9524227dd898575c3099d3976f096cd935414279" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:20:57 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-c288f58e-9ce6-4120-b7ca-12a8bbdd7b2e tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] Lock "9524227dd898575c3099d3976f096cd935414279" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:20:57 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-c288f58e-9ce6-4120-b7ca-12a8bbdd7b2e tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279 --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:20:57 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-7c6f31e7-806d-4b11-9302-4bddd57294b7 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf54be22-2a5d-40c4-8a1a-0060c77f83f6/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:20:57 user nova-compute[71731]: DEBUG nova.virt.disk.api [None req-7c6f31e7-806d-4b11-9302-4bddd57294b7 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] Cannot resize image /opt/stack/data/nova/instances/cf54be22-2a5d-40c4-8a1a-0060c77f83f6/disk to a smaller size. {{(pid=71731) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 16:20:57 user nova-compute[71731]: DEBUG nova.objects.instance [None req-7c6f31e7-806d-4b11-9302-4bddd57294b7 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] Lazy-loading 'migration_context' on Instance uuid cf54be22-2a5d-40c4-8a1a-0060c77f83f6 {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:20:57 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-7c6f31e7-806d-4b11-9302-4bddd57294b7 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] [instance: cf54be22-2a5d-40c4-8a1a-0060c77f83f6] Created local disks {{(pid=71731) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 16:20:57 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-7c6f31e7-806d-4b11-9302-4bddd57294b7 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] [instance: cf54be22-2a5d-40c4-8a1a-0060c77f83f6] Ensure instance console log exists: /opt/stack/data/nova/instances/cf54be22-2a5d-40c4-8a1a-0060c77f83f6/console.log {{(pid=71731) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 16:20:57 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-7c6f31e7-806d-4b11-9302-4bddd57294b7 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:20:57 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-7c6f31e7-806d-4b11-9302-4bddd57294b7 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:20:57 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-7c6f31e7-806d-4b11-9302-4bddd57294b7 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:20:57 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-c288f58e-9ce6-4120-b7ca-12a8bbdd7b2e tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279 --force-share --output=json" returned: 0 in 0.196s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:20:57 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-c288f58e-9ce6-4120-b7ca-12a8bbdd7b2e tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279,backing_fmt=raw /opt/stack/data/nova/instances/8c6d8096-853b-4091-ad82-6faf8ffc85fa/disk 1073741824 {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:20:57 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-c288f58e-9ce6-4120-b7ca-12a8bbdd7b2e tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279,backing_fmt=raw /opt/stack/data/nova/instances/8c6d8096-853b-4091-ad82-6faf8ffc85fa/disk 1073741824" returned: 0 in 0.066s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:20:57 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-c288f58e-9ce6-4120-b7ca-12a8bbdd7b2e tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] Lock "9524227dd898575c3099d3976f096cd935414279" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.267s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:20:57 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-c288f58e-9ce6-4120-b7ca-12a8bbdd7b2e tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279 --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:20:57 user nova-compute[71731]: DEBUG nova.network.neutron [None req-7c6f31e7-806d-4b11-9302-4bddd57294b7 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] [instance: cf54be22-2a5d-40c4-8a1a-0060c77f83f6] Successfully updated port: 3e9128bc-6e2e-4c5e-bf37-1142304eff26 {{(pid=71731) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 16:20:57 user nova-compute[71731]: DEBUG nova.compute.manager [req-74b62c21-90ca-4e05-9c9e-19edf820553e req-97f9dd81-5052-40ae-a1ab-41962ac4f0a6 service nova] [instance: cf54be22-2a5d-40c4-8a1a-0060c77f83f6] Received event network-changed-3e9128bc-6e2e-4c5e-bf37-1142304eff26 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:20:57 user nova-compute[71731]: DEBUG nova.compute.manager [req-74b62c21-90ca-4e05-9c9e-19edf820553e req-97f9dd81-5052-40ae-a1ab-41962ac4f0a6 service nova] [instance: cf54be22-2a5d-40c4-8a1a-0060c77f83f6] Refreshing instance network info cache due to event network-changed-3e9128bc-6e2e-4c5e-bf37-1142304eff26. {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 16:20:57 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-74b62c21-90ca-4e05-9c9e-19edf820553e req-97f9dd81-5052-40ae-a1ab-41962ac4f0a6 service nova] Acquiring lock "refresh_cache-cf54be22-2a5d-40c4-8a1a-0060c77f83f6" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 16:20:57 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-74b62c21-90ca-4e05-9c9e-19edf820553e req-97f9dd81-5052-40ae-a1ab-41962ac4f0a6 service nova] Acquired lock "refresh_cache-cf54be22-2a5d-40c4-8a1a-0060c77f83f6" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 16:20:57 user nova-compute[71731]: DEBUG nova.network.neutron [req-74b62c21-90ca-4e05-9c9e-19edf820553e req-97f9dd81-5052-40ae-a1ab-41962ac4f0a6 service nova] [instance: cf54be22-2a5d-40c4-8a1a-0060c77f83f6] Refreshing network info cache for port 3e9128bc-6e2e-4c5e-bf37-1142304eff26 {{(pid=71731) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 16:20:57 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-7c6f31e7-806d-4b11-9302-4bddd57294b7 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] Acquiring lock "refresh_cache-cf54be22-2a5d-40c4-8a1a-0060c77f83f6" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 16:20:57 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-c288f58e-9ce6-4120-b7ca-12a8bbdd7b2e tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279 --force-share --output=json" returned: 0 in 0.182s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:20:57 user nova-compute[71731]: DEBUG nova.virt.disk.api [None req-c288f58e-9ce6-4120-b7ca-12a8bbdd7b2e tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8c6d8096-853b-4091-ad82-6faf8ffc85fa/disk. size=1073741824 {{(pid=71731) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 16:20:57 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-c288f58e-9ce6-4120-b7ca-12a8bbdd7b2e tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c6d8096-853b-4091-ad82-6faf8ffc85fa/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:20:57 user nova-compute[71731]: DEBUG nova.network.neutron [req-74b62c21-90ca-4e05-9c9e-19edf820553e req-97f9dd81-5052-40ae-a1ab-41962ac4f0a6 service nova] [instance: cf54be22-2a5d-40c4-8a1a-0060c77f83f6] Instance cache missing network info. {{(pid=71731) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 16:20:57 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-c288f58e-9ce6-4120-b7ca-12a8bbdd7b2e tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c6d8096-853b-4091-ad82-6faf8ffc85fa/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:20:57 user nova-compute[71731]: DEBUG nova.virt.disk.api [None req-c288f58e-9ce6-4120-b7ca-12a8bbdd7b2e tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] Cannot resize image /opt/stack/data/nova/instances/8c6d8096-853b-4091-ad82-6faf8ffc85fa/disk to a smaller size. {{(pid=71731) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 16:20:57 user nova-compute[71731]: DEBUG nova.objects.instance [None req-c288f58e-9ce6-4120-b7ca-12a8bbdd7b2e tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] Lazy-loading 'migration_context' on Instance uuid 8c6d8096-853b-4091-ad82-6faf8ffc85fa {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:20:57 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-c288f58e-9ce6-4120-b7ca-12a8bbdd7b2e tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] [instance: 8c6d8096-853b-4091-ad82-6faf8ffc85fa] Created local disks {{(pid=71731) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 16:20:57 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-c288f58e-9ce6-4120-b7ca-12a8bbdd7b2e tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] [instance: 8c6d8096-853b-4091-ad82-6faf8ffc85fa] Ensure instance console log exists: /opt/stack/data/nova/instances/8c6d8096-853b-4091-ad82-6faf8ffc85fa/console.log {{(pid=71731) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 16:20:57 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-c288f58e-9ce6-4120-b7ca-12a8bbdd7b2e tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:20:57 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-c288f58e-9ce6-4120-b7ca-12a8bbdd7b2e tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.004s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:20:57 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-c288f58e-9ce6-4120-b7ca-12a8bbdd7b2e tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:20:57 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:20:58 user nova-compute[71731]: DEBUG nova.network.neutron [req-74b62c21-90ca-4e05-9c9e-19edf820553e req-97f9dd81-5052-40ae-a1ab-41962ac4f0a6 service nova] [instance: cf54be22-2a5d-40c4-8a1a-0060c77f83f6] Updating instance_info_cache with network_info: [] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:20:58 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-74b62c21-90ca-4e05-9c9e-19edf820553e req-97f9dd81-5052-40ae-a1ab-41962ac4f0a6 service nova] Releasing lock "refresh_cache-cf54be22-2a5d-40c4-8a1a-0060c77f83f6" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 16:20:58 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-7c6f31e7-806d-4b11-9302-4bddd57294b7 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] Acquired lock "refresh_cache-cf54be22-2a5d-40c4-8a1a-0060c77f83f6" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 16:20:58 user nova-compute[71731]: DEBUG nova.network.neutron [None req-7c6f31e7-806d-4b11-9302-4bddd57294b7 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] [instance: cf54be22-2a5d-40c4-8a1a-0060c77f83f6] Building network info cache for instance {{(pid=71731) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 16:20:58 user nova-compute[71731]: DEBUG nova.network.neutron [None req-c288f58e-9ce6-4120-b7ca-12a8bbdd7b2e tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] [instance: 8c6d8096-853b-4091-ad82-6faf8ffc85fa] Successfully created port: 385dec44-4145-4606-b0af-30fbc721eb2c {{(pid=71731) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 16:20:58 user nova-compute[71731]: DEBUG nova.network.neutron [None req-7c6f31e7-806d-4b11-9302-4bddd57294b7 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] [instance: cf54be22-2a5d-40c4-8a1a-0060c77f83f6] Instance cache missing network info. {{(pid=71731) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 16:20:59 user nova-compute[71731]: DEBUG nova.network.neutron [None req-7c6f31e7-806d-4b11-9302-4bddd57294b7 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] [instance: cf54be22-2a5d-40c4-8a1a-0060c77f83f6] Updating instance_info_cache with network_info: [{"id": "3e9128bc-6e2e-4c5e-bf37-1142304eff26", "address": "fa:16:3e:5b:20:d0", "network": {"id": "a2a5ab65-4be4-4535-b98e-a8eeaedddee8", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-245114435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6365a1e8d6c48499d4b8921244d92a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e9128bc-6e", "ovs_interfaceid": "3e9128bc-6e2e-4c5e-bf37-1142304eff26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:20:59 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-7c6f31e7-806d-4b11-9302-4bddd57294b7 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] Releasing lock "refresh_cache-cf54be22-2a5d-40c4-8a1a-0060c77f83f6" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 16:20:59 user nova-compute[71731]: DEBUG nova.compute.manager [None req-7c6f31e7-806d-4b11-9302-4bddd57294b7 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] [instance: cf54be22-2a5d-40c4-8a1a-0060c77f83f6] Instance network_info: |[{"id": "3e9128bc-6e2e-4c5e-bf37-1142304eff26", "address": "fa:16:3e:5b:20:d0", "network": {"id": "a2a5ab65-4be4-4535-b98e-a8eeaedddee8", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-245114435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6365a1e8d6c48499d4b8921244d92a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e9128bc-6e", "ovs_interfaceid": "3e9128bc-6e2e-4c5e-bf37-1142304eff26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71731) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 16:20:59 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-7c6f31e7-806d-4b11-9302-4bddd57294b7 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] [instance: cf54be22-2a5d-40c4-8a1a-0060c77f83f6] Start _get_guest_xml network_info=[{"id": "3e9128bc-6e2e-4c5e-bf37-1142304eff26", "address": "fa:16:3e:5b:20:d0", "network": {"id": "a2a5ab65-4be4-4535-b98e-a8eeaedddee8", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-245114435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6365a1e8d6c48499d4b8921244d92a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e9128bc-6e", "ovs_interfaceid": "3e9128bc-6e2e-4c5e-bf37-1142304eff26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T16:20:46Z,direct_url=<?>,disk_format='qcow2',id=01cb01f7-9c27-41ff-9feb-78a78b8b56e5,min_disk=0,min_ram=0,name='',owner='63ae3da4a6e64ddc994aff71745eb0a6',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T16:20:49Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'device_name': '/dev/sda', 'size': 0, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'device_type': 'disk', 'encrypted': False, 'disk_bus': 'scsi', 'guest_format': None, 'encryption_options': None, 'image_id': '01cb01f7-9c27-41ff-9feb-78a78b8b56e5'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71731) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 16:20:59 user nova-compute[71731]: WARNING nova.virt.libvirt.driver [None req-7c6f31e7-806d-4b11-9302-4bddd57294b7 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 16:20:59 user nova-compute[71731]: WARNING nova.virt.libvirt.driver [None req-7c6f31e7-806d-4b11-9302-4bddd57294b7 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 16:20:59 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-7c6f31e7-806d-4b11-9302-4bddd57294b7 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71731) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 16:20:59 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-7c6f31e7-806d-4b11-9302-4bddd57294b7 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T16:17:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T16:20:46Z,direct_url=<?>,disk_format='qcow2',id=01cb01f7-9c27-41ff-9feb-78a78b8b56e5,min_disk=0,min_ram=0,name='',owner='63ae3da4a6e64ddc994aff71745eb0a6',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T16:20:49Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 16:20:59 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-7c6f31e7-806d-4b11-9302-4bddd57294b7 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] Flavor limits 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 16:20:59 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-7c6f31e7-806d-4b11-9302-4bddd57294b7 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] Image limits 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 16:20:59 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-7c6f31e7-806d-4b11-9302-4bddd57294b7 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] Flavor pref 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 16:20:59 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-7c6f31e7-806d-4b11-9302-4bddd57294b7 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] Image pref 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 16:20:59 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-7c6f31e7-806d-4b11-9302-4bddd57294b7 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 16:20:59 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-7c6f31e7-806d-4b11-9302-4bddd57294b7 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 16:20:59 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-7c6f31e7-806d-4b11-9302-4bddd57294b7 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71731) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 16:20:59 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-7c6f31e7-806d-4b11-9302-4bddd57294b7 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] Got 1 possible topologies {{(pid=71731) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 16:20:59 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-7c6f31e7-806d-4b11-9302-4bddd57294b7 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 16:20:59 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-7c6f31e7-806d-4b11-9302-4bddd57294b7 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 16:20:59 user nova-compute[71731]: DEBUG nova.virt.libvirt.vif [None req-7c6f31e7-806d-4b11-9302-4bddd57294b7 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T16:20:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-388983342',display_name='tempest-AttachSCSIVolumeTestJSON-server-388983342',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-388983342',id=6,image_ref='01cb01f7-9c27-41ff-9feb-78a78b8b56e5',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKRbzNSMC33JpjfFNT2r74GnYkef8HT04SCtROQjyE6kxj3jEL5OVrLCY3/Vs9414NnlDaybdZ+OiSgBfWjJgF0eyNdGY+70v0keT0GP3beXZnMvCbkO5Jb+eWMj3MAj/g==',key_name='tempest-keypair-420366585',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a6365a1e8d6c48499d4b8921244d92a9',ramdisk_id='',reservation_id='r-woolfliz',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='01cb01f7-9c27-41ff-9feb-78a78b8b56e5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-942770243',owner_user_name='tempest-AttachSCSIVolumeTestJSON-942770243-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T16:20:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0b143a8db8a3410eb09b21ced7bd883e',uuid=cf54be22-2a5d-40c4-8a1a-0060c77f83f6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3e9128bc-6e2e-4c5e-bf37-1142304eff26", "address": "fa:16:3e:5b:20:d0", "network": {"id": "a2a5ab65-4be4-4535-b98e-a8eeaedddee8", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-245114435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6365a1e8d6c48499d4b8921244d92a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e9128bc-6e", "ovs_interfaceid": "3e9128bc-6e2e-4c5e-bf37-1142304eff26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71731) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 16:20:59 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-7c6f31e7-806d-4b11-9302-4bddd57294b7 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] Converting VIF {"id": "3e9128bc-6e2e-4c5e-bf37-1142304eff26", "address": "fa:16:3e:5b:20:d0", "network": {"id": "a2a5ab65-4be4-4535-b98e-a8eeaedddee8", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-245114435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6365a1e8d6c48499d4b8921244d92a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e9128bc-6e", "ovs_interfaceid": "3e9128bc-6e2e-4c5e-bf37-1142304eff26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 16:20:59 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-7c6f31e7-806d-4b11-9302-4bddd57294b7 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:20:d0,bridge_name='br-int',has_traffic_filtering=True,id=3e9128bc-6e2e-4c5e-bf37-1142304eff26,network=Network(a2a5ab65-4be4-4535-b98e-a8eeaedddee8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e9128bc-6e') {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 16:20:59 user nova-compute[71731]: DEBUG nova.objects.instance [None req-7c6f31e7-806d-4b11-9302-4bddd57294b7 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] Lazy-loading 'pci_devices' on Instance uuid cf54be22-2a5d-40c4-8a1a-0060c77f83f6 {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:20:59 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-7c6f31e7-806d-4b11-9302-4bddd57294b7 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] [instance: cf54be22-2a5d-40c4-8a1a-0060c77f83f6] End _get_guest_xml xml=<domain type="kvm">
Apr 13 16:20:59 user nova-compute[71731]:   <uuid>cf54be22-2a5d-40c4-8a1a-0060c77f83f6</uuid>
Apr 13 16:20:59 user nova-compute[71731]:   <name>instance-00000006</name>
Apr 13 16:20:59 user nova-compute[71731]:   <memory>131072</memory>
Apr 13 16:20:59 user nova-compute[71731]:   <vcpu>1</vcpu>
Apr 13 16:20:59 user nova-compute[71731]:   <metadata>
Apr 13 16:20:59 user nova-compute[71731]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 16:20:59 user nova-compute[71731]:       <nova:package version="0.0.0"/>
Apr 13 16:20:59 user nova-compute[71731]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-388983342</nova:name>
Apr 13 16:20:59 user nova-compute[71731]:       <nova:creationTime>2023-04-13 16:20:59</nova:creationTime>
Apr 13 16:20:59 user nova-compute[71731]:       <nova:flavor name="m1.nano">
Apr 13 16:20:59 user nova-compute[71731]:         <nova:memory>128</nova:memory>
Apr 13 16:20:59 user nova-compute[71731]:         <nova:disk>1</nova:disk>
Apr 13 16:20:59 user nova-compute[71731]:         <nova:swap>0</nova:swap>
Apr 13 16:20:59 user nova-compute[71731]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 16:20:59 user nova-compute[71731]:         <nova:vcpus>1</nova:vcpus>
Apr 13 16:20:59 user nova-compute[71731]:       </nova:flavor>
Apr 13 16:20:59 user nova-compute[71731]:       <nova:owner>
Apr 13 16:20:59 user nova-compute[71731]:         <nova:user uuid="0b143a8db8a3410eb09b21ced7bd883e">tempest-AttachSCSIVolumeTestJSON-942770243-project-member</nova:user>
Apr 13 16:20:59 user nova-compute[71731]:         <nova:project uuid="a6365a1e8d6c48499d4b8921244d92a9">tempest-AttachSCSIVolumeTestJSON-942770243</nova:project>
Apr 13 16:20:59 user nova-compute[71731]:       </nova:owner>
Apr 13 16:20:59 user nova-compute[71731]:       <nova:root type="image" uuid="01cb01f7-9c27-41ff-9feb-78a78b8b56e5"/>
Apr 13 16:20:59 user nova-compute[71731]:       <nova:ports>
Apr 13 16:20:59 user nova-compute[71731]:         <nova:port uuid="3e9128bc-6e2e-4c5e-bf37-1142304eff26">
Apr 13 16:20:59 user nova-compute[71731]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Apr 13 16:20:59 user nova-compute[71731]:         </nova:port>
Apr 13 16:20:59 user nova-compute[71731]:       </nova:ports>
Apr 13 16:20:59 user nova-compute[71731]:     </nova:instance>
Apr 13 16:20:59 user nova-compute[71731]:   </metadata>
Apr 13 16:20:59 user nova-compute[71731]:   <sysinfo type="smbios">
Apr 13 16:20:59 user nova-compute[71731]:     <system>
Apr 13 16:20:59 user nova-compute[71731]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 16:20:59 user nova-compute[71731]:       <entry name="product">OpenStack Nova</entry>
Apr 13 16:20:59 user nova-compute[71731]:       <entry name="version">0.0.0</entry>
Apr 13 16:20:59 user nova-compute[71731]:       <entry name="serial">cf54be22-2a5d-40c4-8a1a-0060c77f83f6</entry>
Apr 13 16:20:59 user nova-compute[71731]:       <entry name="uuid">cf54be22-2a5d-40c4-8a1a-0060c77f83f6</entry>
Apr 13 16:20:59 user nova-compute[71731]:       <entry name="family">Virtual Machine</entry>
Apr 13 16:20:59 user nova-compute[71731]:     </system>
Apr 13 16:20:59 user nova-compute[71731]:   </sysinfo>
Apr 13 16:20:59 user nova-compute[71731]:   <os>
Apr 13 16:20:59 user nova-compute[71731]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 16:20:59 user nova-compute[71731]:     <boot dev="hd"/>
Apr 13 16:20:59 user nova-compute[71731]:     <smbios mode="sysinfo"/>
Apr 13 16:20:59 user nova-compute[71731]:   </os>
Apr 13 16:20:59 user nova-compute[71731]:   <features>
Apr 13 16:20:59 user nova-compute[71731]:     <acpi/>
Apr 13 16:20:59 user nova-compute[71731]:     <apic/>
Apr 13 16:20:59 user nova-compute[71731]:     <vmcoreinfo/>
Apr 13 16:20:59 user nova-compute[71731]:   </features>
Apr 13 16:20:59 user nova-compute[71731]:   <clock offset="utc">
Apr 13 16:20:59 user nova-compute[71731]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 16:20:59 user nova-compute[71731]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 16:20:59 user nova-compute[71731]:     <timer name="hpet" present="no"/>
Apr 13 16:20:59 user nova-compute[71731]:   </clock>
Apr 13 16:20:59 user nova-compute[71731]:   <cpu mode="custom" match="exact">
Apr 13 16:20:59 user nova-compute[71731]:     <model>Nehalem</model>
Apr 13 16:20:59 user nova-compute[71731]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 16:20:59 user nova-compute[71731]:   </cpu>
Apr 13 16:20:59 user nova-compute[71731]:   <devices>
Apr 13 16:20:59 user nova-compute[71731]:     <disk type="file" device="disk">
Apr 13 16:20:59 user nova-compute[71731]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 16:20:59 user nova-compute[71731]:       <source file="/opt/stack/data/nova/instances/cf54be22-2a5d-40c4-8a1a-0060c77f83f6/disk"/>
Apr 13 16:20:59 user nova-compute[71731]:       <target dev="sda" bus="scsi"/>
Apr 13 16:20:59 user nova-compute[71731]:       <address type="drive" controller="0" unit="0"/>
Apr 13 16:20:59 user nova-compute[71731]:     </disk>
Apr 13 16:20:59 user nova-compute[71731]:     <disk type="file" device="cdrom">
Apr 13 16:20:59 user nova-compute[71731]:       <driver name="qemu" type="raw" cache="none"/>
Apr 13 16:20:59 user nova-compute[71731]:       <source file="/opt/stack/data/nova/instances/cf54be22-2a5d-40c4-8a1a-0060c77f83f6/disk.config"/>
Apr 13 16:20:59 user nova-compute[71731]:       <target dev="sdb" bus="scsi"/>
Apr 13 16:20:59 user nova-compute[71731]:       <address type="drive" controller="0" unit="1"/>
Apr 13 16:20:59 user nova-compute[71731]:     </disk>
Apr 13 16:20:59 user nova-compute[71731]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Apr 13 16:20:59 user nova-compute[71731]:     <interface type="ethernet">
Apr 13 16:20:59 user nova-compute[71731]:       <mac address="fa:16:3e:5b:20:d0"/>
Apr 13 16:20:59 user nova-compute[71731]:       <model type="virtio"/>
Apr 13 16:20:59 user nova-compute[71731]:       <mtu size="1442"/>
Apr 13 16:20:59 user nova-compute[71731]:       <target dev="tap3e9128bc-6e"/>
Apr 13 16:20:59 user nova-compute[71731]:     </interface>
Apr 13 16:20:59 user nova-compute[71731]:     <serial type="pty">
Apr 13 16:20:59 user nova-compute[71731]:       <log file="/opt/stack/data/nova/instances/cf54be22-2a5d-40c4-8a1a-0060c77f83f6/console.log" append="off"/>
Apr 13 16:20:59 user nova-compute[71731]:     </serial>
Apr 13 16:20:59 user nova-compute[71731]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 16:20:59 user nova-compute[71731]:     <video>
Apr 13 16:20:59 user nova-compute[71731]:       <model type="virtio"/>
Apr 13 16:20:59 user nova-compute[71731]:     </video>
Apr 13 16:20:59 user nova-compute[71731]:     <rng model="virtio">
Apr 13 16:20:59 user nova-compute[71731]:       <backend model="random">/dev/urandom</backend>
Apr 13 16:20:59 user nova-compute[71731]:     </rng>
Apr 13 16:20:59 user nova-compute[71731]:     <controller type="usb" index="0" model="none"/>
Apr 13 16:20:59 user nova-compute[71731]:     <memballoon model="virtio">
Apr 13 16:20:59 user nova-compute[71731]:       <stats period="10"/>
Apr 13 16:20:59 user nova-compute[71731]:     </memballoon>
Apr 13 16:20:59 user nova-compute[71731]:   </devices>
Apr 13 16:20:59 user nova-compute[71731]: </domain>
Apr 13 16:20:59 user nova-compute[71731]:  {{(pid=71731) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 16:20:59 user nova-compute[71731]: DEBUG nova.virt.libvirt.vif [None req-7c6f31e7-806d-4b11-9302-4bddd57294b7 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T16:20:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-388983342',display_name='tempest-AttachSCSIVolumeTestJSON-server-388983342',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-388983342',id=6,image_ref='01cb01f7-9c27-41ff-9feb-78a78b8b56e5',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKRbzNSMC33JpjfFNT2r74GnYkef8HT04SCtROQjyE6kxj3jEL5OVrLCY3/Vs9414NnlDaybdZ+OiSgBfWjJgF0eyNdGY+70v0keT0GP3beXZnMvCbkO5Jb+eWMj3MAj/g==',key_name='tempest-keypair-420366585',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a6365a1e8d6c48499d4b8921244d92a9',ramdisk_id='',reservation_id='r-woolfliz',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='01cb01f7-9c27-41ff-9feb-78a78b8b56e5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-942770243',owner_user_name='tempest-AttachSCSIVolumeTestJSON-942770243-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T16:20:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0b143a8db8a3410eb09b21ced7bd883e',uuid=cf54be22-2a5d-40c4-8a1a-0060c77f83f6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3e9128bc-6e2e-4c5e-bf37-1142304eff26", "address": "fa:16:3e:5b:20:d0", "network": {"id": "a2a5ab65-4be4-4535-b98e-a8eeaedddee8", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-245114435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6365a1e8d6c48499d4b8921244d92a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e9128bc-6e", "ovs_interfaceid": "3e9128bc-6e2e-4c5e-bf37-1142304eff26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 16:20:59 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-7c6f31e7-806d-4b11-9302-4bddd57294b7 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] Converting VIF {"id": "3e9128bc-6e2e-4c5e-bf37-1142304eff26", "address": "fa:16:3e:5b:20:d0", "network": {"id": "a2a5ab65-4be4-4535-b98e-a8eeaedddee8", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-245114435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6365a1e8d6c48499d4b8921244d92a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e9128bc-6e", "ovs_interfaceid": "3e9128bc-6e2e-4c5e-bf37-1142304eff26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 16:20:59 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-7c6f31e7-806d-4b11-9302-4bddd57294b7 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:20:d0,bridge_name='br-int',has_traffic_filtering=True,id=3e9128bc-6e2e-4c5e-bf37-1142304eff26,network=Network(a2a5ab65-4be4-4535-b98e-a8eeaedddee8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e9128bc-6e') {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 16:20:59 user nova-compute[71731]: DEBUG os_vif [None req-7c6f31e7-806d-4b11-9302-4bddd57294b7 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:20:d0,bridge_name='br-int',has_traffic_filtering=True,id=3e9128bc-6e2e-4c5e-bf37-1142304eff26,network=Network(a2a5ab65-4be4-4535-b98e-a8eeaedddee8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e9128bc-6e') {{(pid=71731) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 16:20:59 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:20:59 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:20:59 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 16:20:59 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:20:59 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3e9128bc-6e, may_exist=True) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:20:59 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3e9128bc-6e, col_values=(('external_ids', {'iface-id': '3e9128bc-6e2e-4c5e-bf37-1142304eff26', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5b:20:d0', 'vm-uuid': 'cf54be22-2a5d-40c4-8a1a-0060c77f83f6'}),)) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:20:59 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:20:59 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:20:59 user nova-compute[71731]: INFO os_vif [None req-7c6f31e7-806d-4b11-9302-4bddd57294b7 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:20:d0,bridge_name='br-int',has_traffic_filtering=True,id=3e9128bc-6e2e-4c5e-bf37-1142304eff26,network=Network(a2a5ab65-4be4-4535-b98e-a8eeaedddee8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e9128bc-6e')
Apr 13 16:20:59 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-7c6f31e7-806d-4b11-9302-4bddd57294b7 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] No BDM found with device name sda, not building metadata. {{(pid=71731) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 16:20:59 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-7c6f31e7-806d-4b11-9302-4bddd57294b7 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] No BDM found with device name sdb, not building metadata. {{(pid=71731) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 16:20:59 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-7c6f31e7-806d-4b11-9302-4bddd57294b7 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] No VIF found with MAC fa:16:3e:5b:20:d0, not building metadata {{(pid=71731) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 16:20:59 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-7c6f31e7-806d-4b11-9302-4bddd57294b7 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] [instance: cf54be22-2a5d-40c4-8a1a-0060c77f83f6] Using config drive
Apr 13 16:20:59 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-7c6f31e7-806d-4b11-9302-4bddd57294b7 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] [instance: cf54be22-2a5d-40c4-8a1a-0060c77f83f6] Creating config drive at /opt/stack/data/nova/instances/cf54be22-2a5d-40c4-8a1a-0060c77f83f6/disk.config
Apr 13 16:20:59 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-7c6f31e7-806d-4b11-9302-4bddd57294b7 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/cf54be22-2a5d-40c4-8a1a-0060c77f83f6/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpixaufpv6 {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:20:59 user nova-compute[71731]: DEBUG nova.network.neutron [None req-c288f58e-9ce6-4120-b7ca-12a8bbdd7b2e tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] [instance: 8c6d8096-853b-4091-ad82-6faf8ffc85fa] Successfully updated port: 385dec44-4145-4606-b0af-30fbc721eb2c {{(pid=71731) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 16:20:59 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-7c6f31e7-806d-4b11-9302-4bddd57294b7 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/cf54be22-2a5d-40c4-8a1a-0060c77f83f6/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpixaufpv6" returned: 0 in 0.086s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:20:59 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-c288f58e-9ce6-4120-b7ca-12a8bbdd7b2e tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] Acquiring lock "refresh_cache-8c6d8096-853b-4091-ad82-6faf8ffc85fa" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 16:20:59 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-c288f58e-9ce6-4120-b7ca-12a8bbdd7b2e tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] Acquired lock "refresh_cache-8c6d8096-853b-4091-ad82-6faf8ffc85fa" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 16:20:59 user nova-compute[71731]: DEBUG nova.network.neutron [None req-c288f58e-9ce6-4120-b7ca-12a8bbdd7b2e tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] [instance: 8c6d8096-853b-4091-ad82-6faf8ffc85fa] Building network info cache for instance {{(pid=71731) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 16:21:00 user nova-compute[71731]: DEBUG nova.compute.manager [req-6a5556dd-d9f6-4654-bff8-cac6a8cb4da9 req-6c86355e-124d-41f3-ae30-a70755478fab service nova] [instance: 8c6d8096-853b-4091-ad82-6faf8ffc85fa] Received event network-changed-385dec44-4145-4606-b0af-30fbc721eb2c {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:21:00 user nova-compute[71731]: DEBUG nova.compute.manager [req-6a5556dd-d9f6-4654-bff8-cac6a8cb4da9 req-6c86355e-124d-41f3-ae30-a70755478fab service nova] [instance: 8c6d8096-853b-4091-ad82-6faf8ffc85fa] Refreshing instance network info cache due to event network-changed-385dec44-4145-4606-b0af-30fbc721eb2c. {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 16:21:00 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-6a5556dd-d9f6-4654-bff8-cac6a8cb4da9 req-6c86355e-124d-41f3-ae30-a70755478fab service nova] Acquiring lock "refresh_cache-8c6d8096-853b-4091-ad82-6faf8ffc85fa" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 16:21:00 user nova-compute[71731]: DEBUG nova.network.neutron [None req-c288f58e-9ce6-4120-b7ca-12a8bbdd7b2e tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] [instance: 8c6d8096-853b-4091-ad82-6faf8ffc85fa] Instance cache missing network info. {{(pid=71731) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 16:21:00 user nova-compute[71731]: DEBUG nova.network.neutron [None req-c288f58e-9ce6-4120-b7ca-12a8bbdd7b2e tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] [instance: 8c6d8096-853b-4091-ad82-6faf8ffc85fa] Updating instance_info_cache with network_info: [{"id": "385dec44-4145-4606-b0af-30fbc721eb2c", "address": "fa:16:3e:93:4c:5a", "network": {"id": "dcb487d2-a611-4040-903e-8e1c9c496e02", "bridge": "br-int", "label": "tempest-TestVolumeSwap-309336155-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc3e2169a6c44d05b2a2eedbe3a063cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap385dec44-41", "ovs_interfaceid": "385dec44-4145-4606-b0af-30fbc721eb2c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:21:00 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-c288f58e-9ce6-4120-b7ca-12a8bbdd7b2e tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] Releasing lock "refresh_cache-8c6d8096-853b-4091-ad82-6faf8ffc85fa" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 16:21:00 user nova-compute[71731]: DEBUG nova.compute.manager [None req-c288f58e-9ce6-4120-b7ca-12a8bbdd7b2e tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] [instance: 8c6d8096-853b-4091-ad82-6faf8ffc85fa] Instance network_info: |[{"id": "385dec44-4145-4606-b0af-30fbc721eb2c", "address": "fa:16:3e:93:4c:5a", "network": {"id": "dcb487d2-a611-4040-903e-8e1c9c496e02", "bridge": "br-int", "label": "tempest-TestVolumeSwap-309336155-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc3e2169a6c44d05b2a2eedbe3a063cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap385dec44-41", "ovs_interfaceid": "385dec44-4145-4606-b0af-30fbc721eb2c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71731) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 16:21:00 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-6a5556dd-d9f6-4654-bff8-cac6a8cb4da9 req-6c86355e-124d-41f3-ae30-a70755478fab service nova] Acquired lock "refresh_cache-8c6d8096-853b-4091-ad82-6faf8ffc85fa" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 16:21:00 user nova-compute[71731]: DEBUG nova.network.neutron [req-6a5556dd-d9f6-4654-bff8-cac6a8cb4da9 req-6c86355e-124d-41f3-ae30-a70755478fab service nova] [instance: 8c6d8096-853b-4091-ad82-6faf8ffc85fa] Refreshing network info cache for port 385dec44-4145-4606-b0af-30fbc721eb2c {{(pid=71731) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 16:21:00 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-c288f58e-9ce6-4120-b7ca-12a8bbdd7b2e tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] [instance: 8c6d8096-853b-4091-ad82-6faf8ffc85fa] Start _get_guest_xml network_info=[{"id": "385dec44-4145-4606-b0af-30fbc721eb2c", "address": "fa:16:3e:93:4c:5a", "network": {"id": "dcb487d2-a611-4040-903e-8e1c9c496e02", "bridge": "br-int", "label": "tempest-TestVolumeSwap-309336155-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc3e2169a6c44d05b2a2eedbe3a063cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap385dec44-41", "ovs_interfaceid": "385dec44-4145-4606-b0af-30fbc721eb2c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T16:16:31Z,direct_url=<?>,disk_format='qcow2',id=708622a9-7465-4492-ade8-b827198f7e30,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='0b29a975c552465aba0ac7d6288434bd',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T16:16:33Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'device_type': 'disk', 'encrypted': False, 'disk_bus': 'virtio', 'guest_format': None, 'encryption_options': None, 'image_id': '708622a9-7465-4492-ade8-b827198f7e30'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71731) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 16:21:00 user nova-compute[71731]: WARNING nova.virt.libvirt.driver [None req-c288f58e-9ce6-4120-b7ca-12a8bbdd7b2e tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 16:21:00 user nova-compute[71731]: WARNING nova.virt.libvirt.driver [None req-c288f58e-9ce6-4120-b7ca-12a8bbdd7b2e tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 16:21:00 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-c288f58e-9ce6-4120-b7ca-12a8bbdd7b2e tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71731) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 16:21:00 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-c288f58e-9ce6-4120-b7ca-12a8bbdd7b2e tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T16:17:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T16:16:31Z,direct_url=<?>,disk_format='qcow2',id=708622a9-7465-4492-ade8-b827198f7e30,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='0b29a975c552465aba0ac7d6288434bd',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T16:16:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 16:21:00 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-c288f58e-9ce6-4120-b7ca-12a8bbdd7b2e tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] Flavor limits 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 16:21:00 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-c288f58e-9ce6-4120-b7ca-12a8bbdd7b2e tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] Image limits 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 16:21:00 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-c288f58e-9ce6-4120-b7ca-12a8bbdd7b2e tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] Flavor pref 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 16:21:00 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-c288f58e-9ce6-4120-b7ca-12a8bbdd7b2e tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] Image pref 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 16:21:00 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-c288f58e-9ce6-4120-b7ca-12a8bbdd7b2e tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 16:21:00 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-c288f58e-9ce6-4120-b7ca-12a8bbdd7b2e tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 16:21:00 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-c288f58e-9ce6-4120-b7ca-12a8bbdd7b2e tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71731) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 16:21:00 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-c288f58e-9ce6-4120-b7ca-12a8bbdd7b2e tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] Got 1 possible topologies {{(pid=71731) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 16:21:00 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-c288f58e-9ce6-4120-b7ca-12a8bbdd7b2e tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 16:21:00 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-c288f58e-9ce6-4120-b7ca-12a8bbdd7b2e tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 16:21:00 user nova-compute[71731]: DEBUG nova.virt.libvirt.vif [None req-c288f58e-9ce6-4120-b7ca-12a8bbdd7b2e tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T16:20:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1610258271',display_name='tempest-TestVolumeSwap-server-1610258271',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1610258271',id=7,image_ref='708622a9-7465-4492-ade8-b827198f7e30',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBWY8/7V40qoMYXykoaVvCoJjrpmcKaWXZmsd/8+Lb8oyd/Yg0tsO1LpDqufWXWHL1gAGa6iD4duZNpIqxl7Bq6NQSSW0wh5DQqKcPrR1DjWUD1wKrr8S3Bqu6djvLW5dQ==',key_name='tempest-keypair-1417187439',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dc3e2169a6c44d05b2a2eedbe3a063cb',ramdisk_id='',reservation_id='r-45cbj23p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='708622a9-7465-4492-ade8-b827198f7e30',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-2131472698',owner_user_name='tempest-TestVolumeSwap-2131472698-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T16:20:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='25b5e87b35e0471cafe541fdf224b5bd',uuid=8c6d8096-853b-4091-ad82-6faf8ffc85fa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "385dec44-4145-4606-b0af-30fbc721eb2c", "address": "fa:16:3e:93:4c:5a", "network": {"id": "dcb487d2-a611-4040-903e-8e1c9c496e02", "bridge": "br-int", "label": "tempest-TestVolumeSwap-309336155-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc3e2169a6c44d05b2a2eedbe3a063cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap385dec44-41", "ovs_interfaceid": "385dec44-4145-4606-b0af-30fbc721eb2c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71731) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 16:21:00 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-c288f58e-9ce6-4120-b7ca-12a8bbdd7b2e tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] Converting VIF {"id": "385dec44-4145-4606-b0af-30fbc721eb2c", "address": "fa:16:3e:93:4c:5a", "network": {"id": "dcb487d2-a611-4040-903e-8e1c9c496e02", "bridge": "br-int", "label": "tempest-TestVolumeSwap-309336155-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc3e2169a6c44d05b2a2eedbe3a063cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap385dec44-41", "ovs_interfaceid": "385dec44-4145-4606-b0af-30fbc721eb2c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 16:21:00 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-c288f58e-9ce6-4120-b7ca-12a8bbdd7b2e tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:93:4c:5a,bridge_name='br-int',has_traffic_filtering=True,id=385dec44-4145-4606-b0af-30fbc721eb2c,network=Network(dcb487d2-a611-4040-903e-8e1c9c496e02),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap385dec44-41') {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 16:21:00 user nova-compute[71731]: DEBUG nova.objects.instance [None req-c288f58e-9ce6-4120-b7ca-12a8bbdd7b2e tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] Lazy-loading 'pci_devices' on Instance uuid 8c6d8096-853b-4091-ad82-6faf8ffc85fa {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:21:00 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-c288f58e-9ce6-4120-b7ca-12a8bbdd7b2e tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] [instance: 8c6d8096-853b-4091-ad82-6faf8ffc85fa] End _get_guest_xml xml=<domain type="kvm">
Apr 13 16:21:00 user nova-compute[71731]:   <uuid>8c6d8096-853b-4091-ad82-6faf8ffc85fa</uuid>
Apr 13 16:21:00 user nova-compute[71731]:   <name>instance-00000007</name>
Apr 13 16:21:00 user nova-compute[71731]:   <memory>131072</memory>
Apr 13 16:21:00 user nova-compute[71731]:   <vcpu>1</vcpu>
Apr 13 16:21:00 user nova-compute[71731]:   <metadata>
Apr 13 16:21:00 user nova-compute[71731]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 16:21:00 user nova-compute[71731]:       <nova:package version="0.0.0"/>
Apr 13 16:21:00 user nova-compute[71731]:       <nova:name>tempest-TestVolumeSwap-server-1610258271</nova:name>
Apr 13 16:21:00 user nova-compute[71731]:       <nova:creationTime>2023-04-13 16:21:00</nova:creationTime>
Apr 13 16:21:00 user nova-compute[71731]:       <nova:flavor name="m1.nano">
Apr 13 16:21:00 user nova-compute[71731]:         <nova:memory>128</nova:memory>
Apr 13 16:21:00 user nova-compute[71731]:         <nova:disk>1</nova:disk>
Apr 13 16:21:00 user nova-compute[71731]:         <nova:swap>0</nova:swap>
Apr 13 16:21:00 user nova-compute[71731]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 16:21:00 user nova-compute[71731]:         <nova:vcpus>1</nova:vcpus>
Apr 13 16:21:00 user nova-compute[71731]:       </nova:flavor>
Apr 13 16:21:00 user nova-compute[71731]:       <nova:owner>
Apr 13 16:21:00 user nova-compute[71731]:         <nova:user uuid="25b5e87b35e0471cafe541fdf224b5bd">tempest-TestVolumeSwap-2131472698-project-member</nova:user>
Apr 13 16:21:00 user nova-compute[71731]:         <nova:project uuid="dc3e2169a6c44d05b2a2eedbe3a063cb">tempest-TestVolumeSwap-2131472698</nova:project>
Apr 13 16:21:00 user nova-compute[71731]:       </nova:owner>
Apr 13 16:21:00 user nova-compute[71731]:       <nova:root type="image" uuid="708622a9-7465-4492-ade8-b827198f7e30"/>
Apr 13 16:21:00 user nova-compute[71731]:       <nova:ports>
Apr 13 16:21:00 user nova-compute[71731]:         <nova:port uuid="385dec44-4145-4606-b0af-30fbc721eb2c">
Apr 13 16:21:00 user nova-compute[71731]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Apr 13 16:21:00 user nova-compute[71731]:         </nova:port>
Apr 13 16:21:00 user nova-compute[71731]:       </nova:ports>
Apr 13 16:21:00 user nova-compute[71731]:     </nova:instance>
Apr 13 16:21:00 user nova-compute[71731]:   </metadata>
Apr 13 16:21:00 user nova-compute[71731]:   <sysinfo type="smbios">
Apr 13 16:21:00 user nova-compute[71731]:     <system>
Apr 13 16:21:00 user nova-compute[71731]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 16:21:00 user nova-compute[71731]:       <entry name="product">OpenStack Nova</entry>
Apr 13 16:21:00 user nova-compute[71731]:       <entry name="version">0.0.0</entry>
Apr 13 16:21:00 user nova-compute[71731]:       <entry name="serial">8c6d8096-853b-4091-ad82-6faf8ffc85fa</entry>
Apr 13 16:21:00 user nova-compute[71731]:       <entry name="uuid">8c6d8096-853b-4091-ad82-6faf8ffc85fa</entry>
Apr 13 16:21:00 user nova-compute[71731]:       <entry name="family">Virtual Machine</entry>
Apr 13 16:21:00 user nova-compute[71731]:     </system>
Apr 13 16:21:00 user nova-compute[71731]:   </sysinfo>
Apr 13 16:21:00 user nova-compute[71731]:   <os>
Apr 13 16:21:00 user nova-compute[71731]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 16:21:00 user nova-compute[71731]:     <boot dev="hd"/>
Apr 13 16:21:00 user nova-compute[71731]:     <smbios mode="sysinfo"/>
Apr 13 16:21:00 user nova-compute[71731]:   </os>
Apr 13 16:21:00 user nova-compute[71731]:   <features>
Apr 13 16:21:00 user nova-compute[71731]:     <acpi/>
Apr 13 16:21:00 user nova-compute[71731]:     <apic/>
Apr 13 16:21:00 user nova-compute[71731]:     <vmcoreinfo/>
Apr 13 16:21:00 user nova-compute[71731]:   </features>
Apr 13 16:21:00 user nova-compute[71731]:   <clock offset="utc">
Apr 13 16:21:00 user nova-compute[71731]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 16:21:00 user nova-compute[71731]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 16:21:00 user nova-compute[71731]:     <timer name="hpet" present="no"/>
Apr 13 16:21:00 user nova-compute[71731]:   </clock>
Apr 13 16:21:00 user nova-compute[71731]:   <cpu mode="custom" match="exact">
Apr 13 16:21:00 user nova-compute[71731]:     <model>Nehalem</model>
Apr 13 16:21:00 user nova-compute[71731]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 16:21:00 user nova-compute[71731]:   </cpu>
Apr 13 16:21:00 user nova-compute[71731]:   <devices>
Apr 13 16:21:00 user nova-compute[71731]:     <disk type="file" device="disk">
Apr 13 16:21:00 user nova-compute[71731]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 16:21:00 user nova-compute[71731]:       <source file="/opt/stack/data/nova/instances/8c6d8096-853b-4091-ad82-6faf8ffc85fa/disk"/>
Apr 13 16:21:00 user nova-compute[71731]:       <target dev="vda" bus="virtio"/>
Apr 13 16:21:00 user nova-compute[71731]:     </disk>
Apr 13 16:21:00 user nova-compute[71731]:     <interface type="ethernet">
Apr 13 16:21:00 user nova-compute[71731]:       <mac address="fa:16:3e:93:4c:5a"/>
Apr 13 16:21:00 user nova-compute[71731]:       <model type="virtio"/>
Apr 13 16:21:00 user nova-compute[71731]:       <mtu size="1442"/>
Apr 13 16:21:00 user nova-compute[71731]:       <target dev="tap385dec44-41"/>
Apr 13 16:21:00 user nova-compute[71731]:     </interface>
Apr 13 16:21:00 user nova-compute[71731]:     <serial type="pty">
Apr 13 16:21:00 user nova-compute[71731]:       <log file="/opt/stack/data/nova/instances/8c6d8096-853b-4091-ad82-6faf8ffc85fa/console.log" append="off"/>
Apr 13 16:21:00 user nova-compute[71731]:     </serial>
Apr 13 16:21:00 user nova-compute[71731]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 16:21:00 user nova-compute[71731]:     <video>
Apr 13 16:21:00 user nova-compute[71731]:       <model type="virtio"/>
Apr 13 16:21:00 user nova-compute[71731]:     </video>
Apr 13 16:21:00 user nova-compute[71731]:     <rng model="virtio">
Apr 13 16:21:00 user nova-compute[71731]:       <backend model="random">/dev/urandom</backend>
Apr 13 16:21:00 user nova-compute[71731]:     </rng>
Apr 13 16:21:00 user nova-compute[71731]:     <controller type="usb" index="0" model="none"/>
Apr 13 16:21:00 user nova-compute[71731]:     <memballoon model="virtio">
Apr 13 16:21:00 user nova-compute[71731]:       <stats period="10"/>
Apr 13 16:21:00 user nova-compute[71731]:     </memballoon>
Apr 13 16:21:00 user nova-compute[71731]:   </devices>
Apr 13 16:21:00 user nova-compute[71731]: </domain>
Apr 13 16:21:00 user nova-compute[71731]:  {{(pid=71731) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 16:21:00 user nova-compute[71731]: DEBUG nova.virt.libvirt.vif [None req-c288f58e-9ce6-4120-b7ca-12a8bbdd7b2e tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T16:20:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1610258271',display_name='tempest-TestVolumeSwap-server-1610258271',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1610258271',id=7,image_ref='708622a9-7465-4492-ade8-b827198f7e30',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBWY8/7V40qoMYXykoaVvCoJjrpmcKaWXZmsd/8+Lb8oyd/Yg0tsO1LpDqufWXWHL1gAGa6iD4duZNpIqxl7Bq6NQSSW0wh5DQqKcPrR1DjWUD1wKrr8S3Bqu6djvLW5dQ==',key_name='tempest-keypair-1417187439',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dc3e2169a6c44d05b2a2eedbe3a063cb',ramdisk_id='',reservation_id='r-45cbj23p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='708622a9-7465-4492-ade8-b827198f7e30',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-2131472698',owner_user_name='tempest-TestVolumeSwap-2131472698-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T16:20:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='25b5e87b35e0471cafe541fdf224b5bd',uuid=8c6d8096-853b-4091-ad82-6faf8ffc85fa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "385dec44-4145-4606-b0af-30fbc721eb2c", "address": "fa:16:3e:93:4c:5a", "network": {"id": "dcb487d2-a611-4040-903e-8e1c9c496e02", "bridge": "br-int", "label": "tempest-TestVolumeSwap-309336155-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc3e2169a6c44d05b2a2eedbe3a063cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap385dec44-41", "ovs_interfaceid": "385dec44-4145-4606-b0af-30fbc721eb2c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 16:21:00 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-c288f58e-9ce6-4120-b7ca-12a8bbdd7b2e tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] Converting VIF {"id": "385dec44-4145-4606-b0af-30fbc721eb2c", "address": "fa:16:3e:93:4c:5a", "network": {"id": "dcb487d2-a611-4040-903e-8e1c9c496e02", "bridge": "br-int", "label": "tempest-TestVolumeSwap-309336155-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc3e2169a6c44d05b2a2eedbe3a063cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap385dec44-41", "ovs_interfaceid": "385dec44-4145-4606-b0af-30fbc721eb2c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 16:21:00 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-c288f58e-9ce6-4120-b7ca-12a8bbdd7b2e tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:93:4c:5a,bridge_name='br-int',has_traffic_filtering=True,id=385dec44-4145-4606-b0af-30fbc721eb2c,network=Network(dcb487d2-a611-4040-903e-8e1c9c496e02),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap385dec44-41') {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 16:21:00 user nova-compute[71731]: DEBUG os_vif [None req-c288f58e-9ce6-4120-b7ca-12a8bbdd7b2e tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:93:4c:5a,bridge_name='br-int',has_traffic_filtering=True,id=385dec44-4145-4606-b0af-30fbc721eb2c,network=Network(dcb487d2-a611-4040-903e-8e1c9c496e02),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap385dec44-41') {{(pid=71731) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 16:21:00 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:21:00 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:21:00 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 16:21:00 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:21:00 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap385dec44-41, may_exist=True) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:21:00 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap385dec44-41, col_values=(('external_ids', {'iface-id': '385dec44-4145-4606-b0af-30fbc721eb2c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:93:4c:5a', 'vm-uuid': '8c6d8096-853b-4091-ad82-6faf8ffc85fa'}),)) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:21:00 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:21:00 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 16:21:00 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:21:00 user nova-compute[71731]: INFO os_vif [None req-c288f58e-9ce6-4120-b7ca-12a8bbdd7b2e tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:93:4c:5a,bridge_name='br-int',has_traffic_filtering=True,id=385dec44-4145-4606-b0af-30fbc721eb2c,network=Network(dcb487d2-a611-4040-903e-8e1c9c496e02),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap385dec44-41')
Apr 13 16:21:00 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-c288f58e-9ce6-4120-b7ca-12a8bbdd7b2e tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] No BDM found with device name vda, not building metadata. {{(pid=71731) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 16:21:00 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-c288f58e-9ce6-4120-b7ca-12a8bbdd7b2e tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] No VIF found with MAC fa:16:3e:93:4c:5a, not building metadata {{(pid=71731) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 16:21:00 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:21:00 user nova-compute[71731]: DEBUG nova.network.neutron [req-6a5556dd-d9f6-4654-bff8-cac6a8cb4da9 req-6c86355e-124d-41f3-ae30-a70755478fab service nova] [instance: 8c6d8096-853b-4091-ad82-6faf8ffc85fa] Updated VIF entry in instance network info cache for port 385dec44-4145-4606-b0af-30fbc721eb2c. {{(pid=71731) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 16:21:00 user nova-compute[71731]: DEBUG nova.network.neutron [req-6a5556dd-d9f6-4654-bff8-cac6a8cb4da9 req-6c86355e-124d-41f3-ae30-a70755478fab service nova] [instance: 8c6d8096-853b-4091-ad82-6faf8ffc85fa] Updating instance_info_cache with network_info: [{"id": "385dec44-4145-4606-b0af-30fbc721eb2c", "address": "fa:16:3e:93:4c:5a", "network": {"id": "dcb487d2-a611-4040-903e-8e1c9c496e02", "bridge": "br-int", "label": "tempest-TestVolumeSwap-309336155-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc3e2169a6c44d05b2a2eedbe3a063cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap385dec44-41", "ovs_interfaceid": "385dec44-4145-4606-b0af-30fbc721eb2c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:21:00 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-6a5556dd-d9f6-4654-bff8-cac6a8cb4da9 req-6c86355e-124d-41f3-ae30-a70755478fab service nova] Releasing lock "refresh_cache-8c6d8096-853b-4091-ad82-6faf8ffc85fa" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 16:21:02 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:21:02 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:21:02 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:21:02 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:21:02 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:21:03 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:21:03 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Cleaning up deleted instances {{(pid=71731) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 13 16:21:03 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] There are 0 instances to clean {{(pid=71731) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 13 16:21:03 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:21:03 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Cleaning up deleted instances with incomplete migration  {{(pid=71731) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 13 16:21:03 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:21:03 user nova-compute[71731]: DEBUG nova.compute.manager [req-4d2564a2-5a3a-4123-9df6-b97da2d529d0 req-d4445dc7-ea50-485c-8d1f-e4cf76d03661 service nova] [instance: 8c6d8096-853b-4091-ad82-6faf8ffc85fa] Received event network-vif-plugged-385dec44-4145-4606-b0af-30fbc721eb2c {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:21:03 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-4d2564a2-5a3a-4123-9df6-b97da2d529d0 req-d4445dc7-ea50-485c-8d1f-e4cf76d03661 service nova] Acquiring lock "8c6d8096-853b-4091-ad82-6faf8ffc85fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:21:03 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-4d2564a2-5a3a-4123-9df6-b97da2d529d0 req-d4445dc7-ea50-485c-8d1f-e4cf76d03661 service nova] Lock "8c6d8096-853b-4091-ad82-6faf8ffc85fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:21:03 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-4d2564a2-5a3a-4123-9df6-b97da2d529d0 req-d4445dc7-ea50-485c-8d1f-e4cf76d03661 service nova] Lock "8c6d8096-853b-4091-ad82-6faf8ffc85fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:21:03 user nova-compute[71731]: DEBUG nova.compute.manager [req-4d2564a2-5a3a-4123-9df6-b97da2d529d0 req-d4445dc7-ea50-485c-8d1f-e4cf76d03661 service nova] [instance: 8c6d8096-853b-4091-ad82-6faf8ffc85fa] No waiting events found dispatching network-vif-plugged-385dec44-4145-4606-b0af-30fbc721eb2c {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:21:03 user nova-compute[71731]: WARNING nova.compute.manager [req-4d2564a2-5a3a-4123-9df6-b97da2d529d0 req-d4445dc7-ea50-485c-8d1f-e4cf76d03661 service nova] [instance: 8c6d8096-853b-4091-ad82-6faf8ffc85fa] Received unexpected event network-vif-plugged-385dec44-4145-4606-b0af-30fbc721eb2c for instance with vm_state building and task_state spawning.
Apr 13 16:21:03 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:21:03 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:21:03 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:21:03 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:21:03 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:21:03 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:21:03 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:21:04 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:21:04 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:21:05 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager.update_available_resource {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:21:05 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:21:05 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:21:05 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:21:05 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Auditing locally available compute resources for user (node: user) {{(pid=71731) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 16:21:05 user nova-compute[71731]: DEBUG nova.compute.manager [req-1e80780c-329c-4d02-b4e8-d4a0d57425e3 req-6661567e-8f19-4ff9-b40a-2da80fcd12fd service nova] [instance: 8c6d8096-853b-4091-ad82-6faf8ffc85fa] Received event network-vif-plugged-385dec44-4145-4606-b0af-30fbc721eb2c {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:21:05 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-1e80780c-329c-4d02-b4e8-d4a0d57425e3 req-6661567e-8f19-4ff9-b40a-2da80fcd12fd service nova] Acquiring lock "8c6d8096-853b-4091-ad82-6faf8ffc85fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:21:05 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-1e80780c-329c-4d02-b4e8-d4a0d57425e3 req-6661567e-8f19-4ff9-b40a-2da80fcd12fd service nova] Lock "8c6d8096-853b-4091-ad82-6faf8ffc85fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:21:05 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-1e80780c-329c-4d02-b4e8-d4a0d57425e3 req-6661567e-8f19-4ff9-b40a-2da80fcd12fd service nova] Lock "8c6d8096-853b-4091-ad82-6faf8ffc85fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:21:05 user nova-compute[71731]: DEBUG nova.compute.manager [req-1e80780c-329c-4d02-b4e8-d4a0d57425e3 req-6661567e-8f19-4ff9-b40a-2da80fcd12fd service nova] [instance: 8c6d8096-853b-4091-ad82-6faf8ffc85fa] No waiting events found dispatching network-vif-plugged-385dec44-4145-4606-b0af-30fbc721eb2c {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:21:05 user nova-compute[71731]: WARNING nova.compute.manager [req-1e80780c-329c-4d02-b4e8-d4a0d57425e3 req-6661567e-8f19-4ff9-b40a-2da80fcd12fd service nova] [instance: 8c6d8096-853b-4091-ad82-6faf8ffc85fa] Received unexpected event network-vif-plugged-385dec44-4145-4606-b0af-30fbc721eb2c for instance with vm_state building and task_state spawning.
Apr 13 16:21:05 user nova-compute[71731]: DEBUG nova.compute.manager [req-1e80780c-329c-4d02-b4e8-d4a0d57425e3 req-6661567e-8f19-4ff9-b40a-2da80fcd12fd service nova] [instance: cf54be22-2a5d-40c4-8a1a-0060c77f83f6] Received event network-vif-plugged-3e9128bc-6e2e-4c5e-bf37-1142304eff26 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:21:05 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-1e80780c-329c-4d02-b4e8-d4a0d57425e3 req-6661567e-8f19-4ff9-b40a-2da80fcd12fd service nova] Acquiring lock "cf54be22-2a5d-40c4-8a1a-0060c77f83f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:21:05 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-1e80780c-329c-4d02-b4e8-d4a0d57425e3 req-6661567e-8f19-4ff9-b40a-2da80fcd12fd service nova] Lock "cf54be22-2a5d-40c4-8a1a-0060c77f83f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:21:05 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-1e80780c-329c-4d02-b4e8-d4a0d57425e3 req-6661567e-8f19-4ff9-b40a-2da80fcd12fd service nova] Lock "cf54be22-2a5d-40c4-8a1a-0060c77f83f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:21:05 user nova-compute[71731]: DEBUG nova.compute.manager [req-1e80780c-329c-4d02-b4e8-d4a0d57425e3 req-6661567e-8f19-4ff9-b40a-2da80fcd12fd service nova] [instance: cf54be22-2a5d-40c4-8a1a-0060c77f83f6] No waiting events found dispatching network-vif-plugged-3e9128bc-6e2e-4c5e-bf37-1142304eff26 {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:21:05 user nova-compute[71731]: WARNING nova.compute.manager [req-1e80780c-329c-4d02-b4e8-d4a0d57425e3 req-6661567e-8f19-4ff9-b40a-2da80fcd12fd service nova] [instance: cf54be22-2a5d-40c4-8a1a-0060c77f83f6] Received unexpected event network-vif-plugged-3e9128bc-6e2e-4c5e-bf37-1142304eff26 for instance with vm_state building and task_state spawning.
Apr 13 16:21:05 user nova-compute[71731]: DEBUG nova.compute.manager [req-1e80780c-329c-4d02-b4e8-d4a0d57425e3 req-6661567e-8f19-4ff9-b40a-2da80fcd12fd service nova] [instance: cf54be22-2a5d-40c4-8a1a-0060c77f83f6] Received event network-vif-plugged-3e9128bc-6e2e-4c5e-bf37-1142304eff26 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:21:05 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-1e80780c-329c-4d02-b4e8-d4a0d57425e3 req-6661567e-8f19-4ff9-b40a-2da80fcd12fd service nova] Acquiring lock "cf54be22-2a5d-40c4-8a1a-0060c77f83f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:21:05 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-1e80780c-329c-4d02-b4e8-d4a0d57425e3 req-6661567e-8f19-4ff9-b40a-2da80fcd12fd service nova] Lock "cf54be22-2a5d-40c4-8a1a-0060c77f83f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:21:05 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-1e80780c-329c-4d02-b4e8-d4a0d57425e3 req-6661567e-8f19-4ff9-b40a-2da80fcd12fd service nova] Lock "cf54be22-2a5d-40c4-8a1a-0060c77f83f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:21:05 user nova-compute[71731]: DEBUG nova.compute.manager [req-1e80780c-329c-4d02-b4e8-d4a0d57425e3 req-6661567e-8f19-4ff9-b40a-2da80fcd12fd service nova] [instance: cf54be22-2a5d-40c4-8a1a-0060c77f83f6] No waiting events found dispatching network-vif-plugged-3e9128bc-6e2e-4c5e-bf37-1142304eff26 {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:21:05 user nova-compute[71731]: WARNING nova.compute.manager [req-1e80780c-329c-4d02-b4e8-d4a0d57425e3 req-6661567e-8f19-4ff9-b40a-2da80fcd12fd service nova] [instance: cf54be22-2a5d-40c4-8a1a-0060c77f83f6] Received unexpected event network-vif-plugged-3e9128bc-6e2e-4c5e-bf37-1142304eff26 for instance with vm_state building and task_state spawning.
Apr 13 16:21:05 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66553f5-5e1b-4f1d-8c5a-63bc340f7586/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:21:05 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66553f5-5e1b-4f1d-8c5a-63bc340f7586/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:21:05 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66553f5-5e1b-4f1d-8c5a-63bc340f7586/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:21:05 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:21:05 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66553f5-5e1b-4f1d-8c5a-63bc340f7586/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:21:05 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7973e93b-6311-44ed-91ff-e861c32d0277/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:21:05 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7973e93b-6311-44ed-91ff-e861c32d0277/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:21:05 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7973e93b-6311-44ed-91ff-e861c32d0277/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:21:05 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:21:05 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7973e93b-6311-44ed-91ff-e861c32d0277/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:21:05 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbcccf4b-e861-4254-9be3-a491776214e9/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:21:06 user nova-compute[71731]: DEBUG nova.virt.driver [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Emitting event <LifecycleEvent: 1681402866.0041203, 8c6d8096-853b-4091-ad82-6faf8ffc85fa => Resumed> {{(pid=71731) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 16:21:06 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 8c6d8096-853b-4091-ad82-6faf8ffc85fa] VM Resumed (Lifecycle Event)
Apr 13 16:21:06 user nova-compute[71731]: DEBUG nova.compute.manager [None req-c288f58e-9ce6-4120-b7ca-12a8bbdd7b2e tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] [instance: 8c6d8096-853b-4091-ad82-6faf8ffc85fa] Instance event wait completed in 0 seconds for  {{(pid=71731) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 16:21:06 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-c288f58e-9ce6-4120-b7ca-12a8bbdd7b2e tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] [instance: 8c6d8096-853b-4091-ad82-6faf8ffc85fa] Guest created on hypervisor {{(pid=71731) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 16:21:06 user nova-compute[71731]: DEBUG nova.compute.manager [None req-7c6f31e7-806d-4b11-9302-4bddd57294b7 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] [instance: cf54be22-2a5d-40c4-8a1a-0060c77f83f6] Instance event wait completed in 0 seconds for  {{(pid=71731) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 16:21:06 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-7c6f31e7-806d-4b11-9302-4bddd57294b7 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] [instance: cf54be22-2a5d-40c4-8a1a-0060c77f83f6] Guest created on hypervisor {{(pid=71731) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 16:21:06 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 8c6d8096-853b-4091-ad82-6faf8ffc85fa] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:21:06 user nova-compute[71731]: INFO nova.virt.libvirt.driver [-] [instance: 8c6d8096-853b-4091-ad82-6faf8ffc85fa] Instance spawned successfully.
Apr 13 16:21:06 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-c288f58e-9ce6-4120-b7ca-12a8bbdd7b2e tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] [instance: 8c6d8096-853b-4091-ad82-6faf8ffc85fa] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 16:21:06 user nova-compute[71731]: INFO nova.virt.libvirt.driver [-] [instance: cf54be22-2a5d-40c4-8a1a-0060c77f83f6] Instance spawned successfully.
Apr 13 16:21:06 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-7c6f31e7-806d-4b11-9302-4bddd57294b7 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] [instance: cf54be22-2a5d-40c4-8a1a-0060c77f83f6] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 16:21:06 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 8c6d8096-853b-4091-ad82-6faf8ffc85fa] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71731) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 16:21:06 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-7c6f31e7-806d-4b11-9302-4bddd57294b7 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] [instance: cf54be22-2a5d-40c4-8a1a-0060c77f83f6] Found default for hw_input_bus of None {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:21:06 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-7c6f31e7-806d-4b11-9302-4bddd57294b7 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] [instance: cf54be22-2a5d-40c4-8a1a-0060c77f83f6] Found default for hw_pointer_model of None {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:21:06 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-7c6f31e7-806d-4b11-9302-4bddd57294b7 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] [instance: cf54be22-2a5d-40c4-8a1a-0060c77f83f6] Found default for hw_video_model of virtio {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:21:06 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-7c6f31e7-806d-4b11-9302-4bddd57294b7 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] [instance: cf54be22-2a5d-40c4-8a1a-0060c77f83f6] Found default for hw_vif_model of virtio {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:21:06 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-c288f58e-9ce6-4120-b7ca-12a8bbdd7b2e tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] [instance: 8c6d8096-853b-4091-ad82-6faf8ffc85fa] Found default for hw_cdrom_bus of ide {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:21:06 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-c288f58e-9ce6-4120-b7ca-12a8bbdd7b2e tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] [instance: 8c6d8096-853b-4091-ad82-6faf8ffc85fa] Found default for hw_disk_bus of virtio {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:21:06 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-c288f58e-9ce6-4120-b7ca-12a8bbdd7b2e tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] [instance: 8c6d8096-853b-4091-ad82-6faf8ffc85fa] Found default for hw_input_bus of None {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:21:06 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-c288f58e-9ce6-4120-b7ca-12a8bbdd7b2e tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] [instance: 8c6d8096-853b-4091-ad82-6faf8ffc85fa] Found default for hw_pointer_model of None {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:21:06 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-c288f58e-9ce6-4120-b7ca-12a8bbdd7b2e tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] [instance: 8c6d8096-853b-4091-ad82-6faf8ffc85fa] Found default for hw_video_model of virtio {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:21:06 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-c288f58e-9ce6-4120-b7ca-12a8bbdd7b2e tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] [instance: 8c6d8096-853b-4091-ad82-6faf8ffc85fa] Found default for hw_vif_model of virtio {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:21:06 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 8c6d8096-853b-4091-ad82-6faf8ffc85fa] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 16:21:06 user nova-compute[71731]: DEBUG nova.virt.driver [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Emitting event <LifecycleEvent: 1681402866.0067444, 8c6d8096-853b-4091-ad82-6faf8ffc85fa => Started> {{(pid=71731) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 16:21:06 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 8c6d8096-853b-4091-ad82-6faf8ffc85fa] VM Started (Lifecycle Event)
Apr 13 16:21:06 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 8c6d8096-853b-4091-ad82-6faf8ffc85fa] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:21:06 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbcccf4b-e861-4254-9be3-a491776214e9/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:21:06 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbcccf4b-e861-4254-9be3-a491776214e9/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:21:06 user nova-compute[71731]: INFO nova.compute.manager [None req-7c6f31e7-806d-4b11-9302-4bddd57294b7 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] [instance: cf54be22-2a5d-40c4-8a1a-0060c77f83f6] Took 11.09 seconds to spawn the instance on the hypervisor.
Apr 13 16:21:06 user nova-compute[71731]: DEBUG nova.compute.manager [None req-7c6f31e7-806d-4b11-9302-4bddd57294b7 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] [instance: cf54be22-2a5d-40c4-8a1a-0060c77f83f6] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:21:06 user nova-compute[71731]: INFO nova.compute.manager [None req-c288f58e-9ce6-4120-b7ca-12a8bbdd7b2e tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] [instance: 8c6d8096-853b-4091-ad82-6faf8ffc85fa] Took 9.36 seconds to spawn the instance on the hypervisor.
Apr 13 16:21:06 user nova-compute[71731]: DEBUG nova.compute.manager [None req-c288f58e-9ce6-4120-b7ca-12a8bbdd7b2e tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] [instance: 8c6d8096-853b-4091-ad82-6faf8ffc85fa] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:21:06 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 8c6d8096-853b-4091-ad82-6faf8ffc85fa] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71731) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 16:21:06 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 8c6d8096-853b-4091-ad82-6faf8ffc85fa] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 16:21:06 user nova-compute[71731]: DEBUG nova.virt.driver [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Emitting event <LifecycleEvent: 1681402866.0069363, cf54be22-2a5d-40c4-8a1a-0060c77f83f6 => Resumed> {{(pid=71731) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 16:21:06 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: cf54be22-2a5d-40c4-8a1a-0060c77f83f6] VM Resumed (Lifecycle Event)
Apr 13 16:21:06 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: cf54be22-2a5d-40c4-8a1a-0060c77f83f6] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:21:06 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: cf54be22-2a5d-40c4-8a1a-0060c77f83f6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71731) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 16:21:06 user nova-compute[71731]: INFO nova.compute.manager [None req-7c6f31e7-806d-4b11-9302-4bddd57294b7 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] [instance: cf54be22-2a5d-40c4-8a1a-0060c77f83f6] Took 12.16 seconds to build instance.
Apr 13 16:21:06 user nova-compute[71731]: INFO nova.compute.manager [None req-c288f58e-9ce6-4120-b7ca-12a8bbdd7b2e tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] [instance: 8c6d8096-853b-4091-ad82-6faf8ffc85fa] Took 10.52 seconds to build instance.
Apr 13 16:21:06 user nova-compute[71731]: DEBUG nova.virt.driver [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Emitting event <LifecycleEvent: 1681402866.0073657, cf54be22-2a5d-40c4-8a1a-0060c77f83f6 => Started> {{(pid=71731) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 16:21:06 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: cf54be22-2a5d-40c4-8a1a-0060c77f83f6] VM Started (Lifecycle Event)
Apr 13 16:21:06 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbcccf4b-e861-4254-9be3-a491776214e9/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:21:06 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-7c6f31e7-806d-4b11-9302-4bddd57294b7 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] Lock "cf54be22-2a5d-40c4-8a1a-0060c77f83f6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.334s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:21:06 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/823749e1-56ca-44f9-be83-a36b4851c28f/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:21:06 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-c288f58e-9ce6-4120-b7ca-12a8bbdd7b2e tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] Lock "8c6d8096-853b-4091-ad82-6faf8ffc85fa" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.848s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:21:06 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: cf54be22-2a5d-40c4-8a1a-0060c77f83f6] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:21:06 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: cf54be22-2a5d-40c4-8a1a-0060c77f83f6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=71731) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 16:21:06 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/823749e1-56ca-44f9-be83-a36b4851c28f/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:21:06 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/823749e1-56ca-44f9-be83-a36b4851c28f/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:21:06 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/823749e1-56ca-44f9-be83-a36b4851c28f/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:21:06 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf54be22-2a5d-40c4-8a1a-0060c77f83f6/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:21:06 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf54be22-2a5d-40c4-8a1a-0060c77f83f6/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:21:06 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf54be22-2a5d-40c4-8a1a-0060c77f83f6/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:21:07 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf54be22-2a5d-40c4-8a1a-0060c77f83f6/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:21:07 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5db1cb51-2e5a-46c9-8914-cba759a96a65/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:21:07 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5db1cb51-2e5a-46c9-8914-cba759a96a65/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:21:07 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5db1cb51-2e5a-46c9-8914-cba759a96a65/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:21:07 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5db1cb51-2e5a-46c9-8914-cba759a96a65/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:21:07 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c6d8096-853b-4091-ad82-6faf8ffc85fa/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:21:07 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c6d8096-853b-4091-ad82-6faf8ffc85fa/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:21:07 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c6d8096-853b-4091-ad82-6faf8ffc85fa/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:21:07 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c6d8096-853b-4091-ad82-6faf8ffc85fa/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:21:08 user nova-compute[71731]: WARNING nova.virt.libvirt.driver [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 16:21:08 user nova-compute[71731]: WARNING nova.virt.libvirt.driver [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 16:21:08 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Hypervisor/Node resource view: name=user free_ram=7953MB free_disk=26.550174713134766GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=71731) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 16:21:08 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:21:08 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:21:08 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance 7973e93b-6311-44ed-91ff-e861c32d0277 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 16:21:08 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance f66553f5-5e1b-4f1d-8c5a-63bc340f7586 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 16:21:08 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance 823749e1-56ca-44f9-be83-a36b4851c28f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 16:21:08 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance bbcccf4b-e861-4254-9be3-a491776214e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 16:21:08 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance 5db1cb51-2e5a-46c9-8914-cba759a96a65 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 16:21:08 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance cf54be22-2a5d-40c4-8a1a-0060c77f83f6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 16:21:08 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance 8c6d8096-853b-4091-ad82-6faf8ffc85fa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 16:21:08 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=71731) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 16:21:08 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Final resource view: name=user phys_ram=16023MB used_ram=1408MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=71731) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 16:21:08 user nova-compute[71731]: DEBUG nova.compute.provider_tree [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Inventory has not changed in ProviderTree for provider: cb6b1a64-0c24-4e2d-af1e-16576ca9165c {{(pid=71731) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 16:21:08 user nova-compute[71731]: DEBUG nova.scheduler.client.report [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Inventory has not changed for provider cb6b1a64-0c24-4e2d-af1e-16576ca9165c based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71731) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 16:21:09 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Compute_service record updated for user:user {{(pid=71731) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 16:21:09 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.548s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:21:09 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:21:09 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:21:09 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Starting heal instance info cache {{(pid=71731) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 16:21:09 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Rebuilding the list of instances to heal {{(pid=71731) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 13 16:21:10 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Acquiring lock "refresh_cache-7973e93b-6311-44ed-91ff-e861c32d0277" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 16:21:10 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Acquired lock "refresh_cache-7973e93b-6311-44ed-91ff-e861c32d0277" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 16:21:10 user nova-compute[71731]: DEBUG nova.network.neutron [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] [instance: 7973e93b-6311-44ed-91ff-e861c32d0277] Forcefully refreshing network info cache for instance {{(pid=71731) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 16:21:10 user nova-compute[71731]: DEBUG nova.objects.instance [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lazy-loading 'info_cache' on Instance uuid 7973e93b-6311-44ed-91ff-e861c32d0277 {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:21:10 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:21:10 user nova-compute[71731]: DEBUG nova.network.neutron [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] [instance: 7973e93b-6311-44ed-91ff-e861c32d0277] Updating instance_info_cache with network_info: [{"id": "8ae83a6c-4fc7-4e2c-8f83-7aece5c239cd", "address": "fa:16:3e:db:b9:e8", "network": {"id": "ae7f770e-a460-4297-91b5-ed0b908a895a", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1175970469-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5554aa7f1b4d471b8807a845ab1ea33f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ae83a6c-4f", "ovs_interfaceid": "8ae83a6c-4fc7-4e2c-8f83-7aece5c239cd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:21:10 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:21:10 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Releasing lock "refresh_cache-7973e93b-6311-44ed-91ff-e861c32d0277" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 16:21:10 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] [instance: 7973e93b-6311-44ed-91ff-e861c32d0277] Updated the network info_cache for instance {{(pid=71731) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 16:21:10 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:21:10 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:21:10 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:21:10 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:21:10 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:21:10 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:21:10 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71731) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 16:21:15 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:21:15 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:21:17 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:21:20 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:21:20 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:21:21 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:21:24 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Acquiring lock "e4ada2d7-7ace-4ed4-86a6-ed121c95e80f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:21:24 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Lock "e4ada2d7-7ace-4ed4-86a6-ed121c95e80f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:21:25 user nova-compute[71731]: DEBUG nova.compute.manager [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] [instance: e4ada2d7-7ace-4ed4-86a6-ed121c95e80f] Starting instance... {{(pid=71731) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 16:21:25 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Acquiring lock "2549ba85-4e0a-420e-b711-07cafa8c60e9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:21:25 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Lock "2549ba85-4e0a-420e-b711-07cafa8c60e9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:21:25 user nova-compute[71731]: DEBUG nova.compute.manager [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] [instance: 2549ba85-4e0a-420e-b711-07cafa8c60e9] Starting instance... {{(pid=71731) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 16:21:25 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:21:25 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:21:25 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71731) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 16:21:25 user nova-compute[71731]: INFO nova.compute.claims [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] [instance: e4ada2d7-7ace-4ed4-86a6-ed121c95e80f] Claim successful on node user
Apr 13 16:21:25 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:21:25 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:21:25 user nova-compute[71731]: DEBUG nova.scheduler.client.report [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Refreshing inventories for resource provider cb6b1a64-0c24-4e2d-af1e-16576ca9165c {{(pid=71731) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 13 16:21:25 user nova-compute[71731]: DEBUG nova.scheduler.client.report [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Updating ProviderTree inventory for provider cb6b1a64-0c24-4e2d-af1e-16576ca9165c from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71731) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 13 16:21:25 user nova-compute[71731]: DEBUG nova.compute.provider_tree [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Updating inventory in ProviderTree for provider cb6b1a64-0c24-4e2d-af1e-16576ca9165c with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71731) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 13 16:21:25 user nova-compute[71731]: DEBUG nova.scheduler.client.report [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Refreshing aggregate associations for resource provider cb6b1a64-0c24-4e2d-af1e-16576ca9165c, aggregates: None {{(pid=71731) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 13 16:21:25 user nova-compute[71731]: DEBUG nova.scheduler.client.report [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Refreshing trait associations for resource provider cb6b1a64-0c24-4e2d-af1e-16576ca9165c, traits: COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSSE3,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_SATA,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_SSE,COMPUTE_RESCUE_BFV,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE41,HW_CPU_X86_MMX,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_RAW {{(pid=71731) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 13 16:21:25 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:21:25 user nova-compute[71731]: DEBUG nova.compute.provider_tree [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Inventory has not changed in ProviderTree for provider: cb6b1a64-0c24-4e2d-af1e-16576ca9165c {{(pid=71731) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 16:21:25 user nova-compute[71731]: DEBUG nova.scheduler.client.report [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Inventory has not changed for provider cb6b1a64-0c24-4e2d-af1e-16576ca9165c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71731) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 16:21:26 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.602s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:21:26 user nova-compute[71731]: DEBUG nova.compute.manager [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] [instance: e4ada2d7-7ace-4ed4-86a6-ed121c95e80f] Start building networks asynchronously for instance. {{(pid=71731) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 16:21:26 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.579s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:21:26 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71731) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 16:21:26 user nova-compute[71731]: INFO nova.compute.claims [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] [instance: 2549ba85-4e0a-420e-b711-07cafa8c60e9] Claim successful on node user
Apr 13 16:21:26 user nova-compute[71731]: DEBUG nova.compute.manager [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] [instance: e4ada2d7-7ace-4ed4-86a6-ed121c95e80f] Allocating IP information in the background. {{(pid=71731) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 16:21:26 user nova-compute[71731]: DEBUG nova.network.neutron [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] [instance: e4ada2d7-7ace-4ed4-86a6-ed121c95e80f] allocate_for_instance() {{(pid=71731) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 16:21:26 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] [instance: e4ada2d7-7ace-4ed4-86a6-ed121c95e80f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 16:21:26 user nova-compute[71731]: DEBUG nova.compute.manager [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] [instance: e4ada2d7-7ace-4ed4-86a6-ed121c95e80f] Start building block device mappings for instance. {{(pid=71731) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 16:21:26 user nova-compute[71731]: INFO nova.virt.block_device [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] [instance: e4ada2d7-7ace-4ed4-86a6-ed121c95e80f] Booting with volume 84c7f6ad-d2c2-465a-b39e-47347aa85be0 at /dev/vda
Apr 13 16:21:26 user nova-compute[71731]: DEBUG nova.policy [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7e50bd9d540549a194f706dac48ce93d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7649e366b0164e2fa5b3faa0830b6ea6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71731) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 16:21:26 user nova-compute[71731]: DEBUG os_brick.utils [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 16:21:26 user nova-compute[71731]: INFO oslo.privsep.daemon [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmptbfsc9pf/privsep.sock']
Apr 13 16:21:26 user sudo[81769]:    stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmptbfsc9pf/privsep.sock
Apr 13 16:21:26 user sudo[81769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Apr 13 16:21:26 user nova-compute[71731]: DEBUG nova.compute.provider_tree [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Inventory has not changed in ProviderTree for provider: cb6b1a64-0c24-4e2d-af1e-16576ca9165c {{(pid=71731) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 16:21:26 user nova-compute[71731]: DEBUG nova.scheduler.client.report [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Inventory has not changed for provider cb6b1a64-0c24-4e2d-af1e-16576ca9165c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71731) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 16:21:26 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:21:26 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.525s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:21:26 user nova-compute[71731]: DEBUG nova.compute.manager [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] [instance: 2549ba85-4e0a-420e-b711-07cafa8c60e9] Start building networks asynchronously for instance. {{(pid=71731) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 16:21:26 user nova-compute[71731]: DEBUG nova.compute.manager [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] [instance: 2549ba85-4e0a-420e-b711-07cafa8c60e9] Allocating IP information in the background. {{(pid=71731) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 16:21:26 user nova-compute[71731]: DEBUG nova.network.neutron [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] [instance: 2549ba85-4e0a-420e-b711-07cafa8c60e9] allocate_for_instance() {{(pid=71731) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 16:21:26 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] [instance: 2549ba85-4e0a-420e-b711-07cafa8c60e9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 16:21:26 user nova-compute[71731]: DEBUG nova.compute.manager [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] [instance: 2549ba85-4e0a-420e-b711-07cafa8c60e9] Start building block device mappings for instance. {{(pid=71731) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 16:21:26 user nova-compute[71731]: INFO nova.virt.block_device [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] [instance: 2549ba85-4e0a-420e-b711-07cafa8c60e9] Booting with volume 48af37b0-6938-432e-b374-d992c4dd9ae9 at /dev/vda
Apr 13 16:21:26 user nova-compute[71731]: DEBUG os_brick.utils [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 16:21:27 user nova-compute[71731]: DEBUG nova.policy [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '14566b85d0424c08999726ff72a67634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe4e9fb786d4015b035b4d00f75a1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71731) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 16:21:28 user nova-compute[71731]: DEBUG nova.network.neutron [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] [instance: e4ada2d7-7ace-4ed4-86a6-ed121c95e80f] Successfully created port: a409f60c-6c6a-49f8-8520-04614e804002 {{(pid=71731) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 16:21:28 user sudo[81769]: pam_unix(sudo:session): session closed for user root
Apr 13 16:21:28 user nova-compute[71731]: INFO oslo.privsep.daemon [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Spawned new privsep daemon via rootwrap
Apr 13 16:21:28 user nova-compute[71731]: INFO oslo.privsep.daemon [-] privsep daemon starting
Apr 13 16:21:28 user nova-compute[71731]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Apr 13 16:21:28 user nova-compute[71731]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Apr 13 16:21:28 user nova-compute[71731]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 81776
Apr 13 16:21:28 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcfcc4b1-9ee1-4c0b-bb93-33eff1e82146]: (2,) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:21:28 user nova-compute[71731]: WARNING oslo_privsep.priv_context [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] privsep daemon already running
Apr 13 16:21:28 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:21:28 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:21:28 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:21:28 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[649e9f4d-410c-4bf3-a8d3-f7469cee1976]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:81501d91421\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:21:28 user nova-compute[71731]: WARNING os_brick.initiator.connectors.nvmeof [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Apr 13 16:21:28 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:21:28 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd1bffae-4c4f-4bc4-86e4-27b89371f183]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:81501d91421\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:21:28 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:21:28 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:21:28 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.023s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:21:28 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d4dea54-9caa-4d4a-8df8-a7304c4ac5c2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:21:28 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:21:28 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[56b82719-9f37-45a9-b69c-9e9f0d3b6340]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:21:28 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:21:28 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:21:28 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:21:28 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[91615fe5-09b6-4f9e-9757-efd75649c91c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:21:28 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:21:28 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[7769f69d-5b96-48fc-acb9-3c63da08ca70]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:21:28 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ae0d151-8259-41cb-83b2-de0649a06389]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:21:28 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Running cmd (subprocess): nvme version {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:21:28 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] 'nvme version' failed. Not Retrying. {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 16:21:28 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcfa190f-d63c-4cfb-b938-9eadb7dd0a77]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:21:28 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.nvmeof [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] nvme not present on system {{(pid=71731) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 16:21:28 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Running cmd (subprocess): nvme version {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:21:28 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:21:28 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 16:21:28 user nova-compute[71731]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 16:21:28 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[741f9032-937c-4c80-bd77-0757fc12bcde]: (4, '') {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:21:28 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.lightos [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71731) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 16:21:28 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.lightos [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71731) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 16:21:28 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.lightos [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] LIGHTOS: no hostnqn found. {{(pid=71731) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 16:21:28 user nova-compute[71731]: DEBUG os_brick.utils [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] <== get_connector_properties: return (2188ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:81501d91421', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 16:21:28 user nova-compute[71731]: DEBUG nova.virt.block_device [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] [instance: e4ada2d7-7ace-4ed4-86a6-ed121c95e80f] Updating existing volume attachment record: 018bbd8c-9148-4f51-9990-8ff62601382a {{(pid=71731) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 16:21:28 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] 'nvme version' failed. Not Retrying. {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 16:21:28 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] nvme not present on system {{(pid=71731) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 16:21:28 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:21:28 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 16:21:28 user nova-compute[71731]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 16:21:28 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[085113dd-02fc-4967-b942-d88d914d1930]: (4, '') {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:21:28 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.lightos [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71731) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 16:21:28 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.lightos [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71731) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 16:21:28 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.lightos [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] LIGHTOS: no hostnqn found. {{(pid=71731) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 16:21:28 user nova-compute[71731]: DEBUG os_brick.utils [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] <== get_connector_properties: return (1766ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:81501d91421', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 16:21:28 user nova-compute[71731]: DEBUG nova.virt.block_device [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] [instance: 2549ba85-4e0a-420e-b711-07cafa8c60e9] Updating existing volume attachment record: 2163f933-0880-45f1-aabc-8b7157bf0d07 {{(pid=71731) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 16:21:29 user nova-compute[71731]: DEBUG nova.network.neutron [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] [instance: 2549ba85-4e0a-420e-b711-07cafa8c60e9] Successfully created port: 36152688-366c-40a2-8bf9-88f69925594a {{(pid=71731) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 16:21:29 user nova-compute[71731]: DEBUG nova.network.neutron [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] [instance: e4ada2d7-7ace-4ed4-86a6-ed121c95e80f] Successfully created port: 8f3a3011-e474-4538-812b-9df3968fd629 {{(pid=71731) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 16:21:30 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:21:30 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:21:30 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:21:30 user nova-compute[71731]: DEBUG nova.network.neutron [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] [instance: 2549ba85-4e0a-420e-b711-07cafa8c60e9] Successfully created port: 0152bbb9-d50d-4e58-8a2b-727c4675ea2f {{(pid=71731) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 16:21:31 user nova-compute[71731]: DEBUG nova.network.neutron [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] [instance: e4ada2d7-7ace-4ed4-86a6-ed121c95e80f] Successfully created port: 2430beb8-b2e4-4493-bdc5-df6b4c1181c6 {{(pid=71731) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 16:21:33 user nova-compute[71731]: DEBUG nova.network.neutron [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] [instance: 2549ba85-4e0a-420e-b711-07cafa8c60e9] Successfully created port: 3730ed6e-b093-4232-800b-b064d650e9e8 {{(pid=71731) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 16:21:33 user nova-compute[71731]: DEBUG nova.network.neutron [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] [instance: e4ada2d7-7ace-4ed4-86a6-ed121c95e80f] Successfully created port: 15dca2c3-5048-4e80-8008-c19400ea34e4 {{(pid=71731) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 16:21:34 user nova-compute[71731]: INFO nova.virt.block_device [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] [instance: 2549ba85-4e0a-420e-b711-07cafa8c60e9] Booting with volume 27919afc-8990-4ed5-af9e-9d6b3d7b231e at /dev/vdb
Apr 13 16:21:34 user nova-compute[71731]: DEBUG os_brick.utils [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 16:21:34 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:21:34 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:21:34 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[194972ec-0fc4-4b5d-98dd-b908353c3a73]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:81501d91421\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:21:34 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:21:34 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:21:34 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[15a58840-aee0-419c-a578-705bcaef2e9d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:21:34 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:21:34 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:21:34 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef05c3bd-9a3f-4749-ad56-feee44f848e1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:21:34 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[347dd354-fefd-41b5-bc5f-5a5d699bfd97]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:21:34 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Running cmd (subprocess): nvme version {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:21:34 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] 'nvme version' failed. Not Retrying. {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 16:21:34 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] nvme not present on system {{(pid=71731) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 16:21:34 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:21:34 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 16:21:34 user nova-compute[71731]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 16:21:34 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[52bf651c-45b4-4bcd-90e8-12bb990cadd7]: (4, '') {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:21:34 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.lightos [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71731) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 16:21:34 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.lightos [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71731) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 16:21:34 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.lightos [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] LIGHTOS: no hostnqn found. {{(pid=71731) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 16:21:34 user nova-compute[71731]: DEBUG os_brick.utils [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:81501d91421', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 16:21:34 user nova-compute[71731]: DEBUG nova.virt.block_device [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] [instance: 2549ba85-4e0a-420e-b711-07cafa8c60e9] Updating existing volume attachment record: 21bff022-8889-4cb5-8329-24b190eafc4c {{(pid=71731) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 16:21:34 user nova-compute[71731]: DEBUG nova.network.neutron [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] [instance: 2549ba85-4e0a-420e-b711-07cafa8c60e9] Successfully created port: 0fbdf291-df5d-41c5-a765-7145a87da272 {{(pid=71731) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 16:21:34 user nova-compute[71731]: INFO nova.virt.block_device [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] [instance: e4ada2d7-7ace-4ed4-86a6-ed121c95e80f] Booting with volume c20e80fa-58de-431a-8901-2535657aaadf at /dev/vdb
Apr 13 16:21:34 user nova-compute[71731]: DEBUG os_brick.utils [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 16:21:34 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:21:34 user nova-compute[71731]: DEBUG nova.network.neutron [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] [instance: e4ada2d7-7ace-4ed4-86a6-ed121c95e80f] Successfully created port: d41765b6-0d5b-43c1-bf58-a82a7bbe3137 {{(pid=71731) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 16:21:34 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:21:34 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[de4df26e-c254-4dab-8aaf-487ae86b2886]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:81501d91421\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:21:34 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:21:34 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.025s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:21:34 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[31c3213a-5fcd-4337-9e7f-6fa243ab9458]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:21:34 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:21:34 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:21:34 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[63346fe2-6ac7-4cce-805f-f659ad9ff95d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:21:34 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5dd6c81-ead5-4646-9d89-bc226301afa3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:21:34 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Running cmd (subprocess): nvme version {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:21:34 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] 'nvme version' failed. Not Retrying. {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 16:21:34 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.nvmeof [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] nvme not present on system {{(pid=71731) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 16:21:34 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:21:34 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 16:21:34 user nova-compute[71731]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 16:21:34 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[b548181b-3f85-418d-b0da-6710d1033010]: (4, '') {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:21:34 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.lightos [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71731) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 16:21:34 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.lightos [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71731) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 16:21:34 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.lightos [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] LIGHTOS: no hostnqn found. {{(pid=71731) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 16:21:34 user nova-compute[71731]: DEBUG os_brick.utils [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] <== get_connector_properties: return (145ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:81501d91421', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 16:21:34 user nova-compute[71731]: DEBUG nova.virt.block_device [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] [instance: e4ada2d7-7ace-4ed4-86a6-ed121c95e80f] Updating existing volume attachment record: b655a4f7-c59f-4268-a1d0-48e38afc3dc3 {{(pid=71731) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 16:21:35 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:21:35 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:21:36 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-9ee02ae8-a4e6-4a99-abe2-322a33b7990b tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Acquiring lock "031c7939-a53c-4f7d-9f36-4ec1d06e2717" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:21:36 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-9ee02ae8-a4e6-4a99-abe2-322a33b7990b tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Lock "031c7939-a53c-4f7d-9f36-4ec1d06e2717" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.003s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:21:36 user nova-compute[71731]: DEBUG nova.compute.manager [None req-9ee02ae8-a4e6-4a99-abe2-322a33b7990b tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] [instance: 031c7939-a53c-4f7d-9f36-4ec1d06e2717] Starting instance... {{(pid=71731) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 16:21:36 user nova-compute[71731]: DEBUG nova.network.neutron [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] [instance: 2549ba85-4e0a-420e-b711-07cafa8c60e9] Successfully created port: 38e92b7c-b7c1-4137-a1db-21bc1d24f3ee {{(pid=71731) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 16:21:36 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-9ee02ae8-a4e6-4a99-abe2-322a33b7990b tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:21:36 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-9ee02ae8-a4e6-4a99-abe2-322a33b7990b tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:21:36 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-9ee02ae8-a4e6-4a99-abe2-322a33b7990b tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71731) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 16:21:36 user nova-compute[71731]: INFO nova.compute.claims [None req-9ee02ae8-a4e6-4a99-abe2-322a33b7990b tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] [instance: 031c7939-a53c-4f7d-9f36-4ec1d06e2717] Claim successful on node user
Apr 13 16:21:36 user nova-compute[71731]: DEBUG nova.network.neutron [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] [instance: e4ada2d7-7ace-4ed4-86a6-ed121c95e80f] Successfully updated port: a409f60c-6c6a-49f8-8520-04614e804002 {{(pid=71731) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 16:21:36 user nova-compute[71731]: DEBUG nova.compute.manager [req-3d3821b5-7431-4521-9d98-b519b05bc0d8 req-4cd26647-3d6e-4c42-92b9-baf98e997226 service nova] [instance: e4ada2d7-7ace-4ed4-86a6-ed121c95e80f] Received event network-changed-a409f60c-6c6a-49f8-8520-04614e804002 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:21:36 user nova-compute[71731]: DEBUG nova.compute.manager [req-3d3821b5-7431-4521-9d98-b519b05bc0d8 req-4cd26647-3d6e-4c42-92b9-baf98e997226 service nova] [instance: e4ada2d7-7ace-4ed4-86a6-ed121c95e80f] Refreshing instance network info cache due to event network-changed-a409f60c-6c6a-49f8-8520-04614e804002. {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 16:21:36 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-3d3821b5-7431-4521-9d98-b519b05bc0d8 req-4cd26647-3d6e-4c42-92b9-baf98e997226 service nova] Acquiring lock "refresh_cache-e4ada2d7-7ace-4ed4-86a6-ed121c95e80f" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 16:21:36 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-3d3821b5-7431-4521-9d98-b519b05bc0d8 req-4cd26647-3d6e-4c42-92b9-baf98e997226 service nova] Acquired lock "refresh_cache-e4ada2d7-7ace-4ed4-86a6-ed121c95e80f" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 16:21:36 user nova-compute[71731]: DEBUG nova.network.neutron [req-3d3821b5-7431-4521-9d98-b519b05bc0d8 req-4cd26647-3d6e-4c42-92b9-baf98e997226 service nova] [instance: e4ada2d7-7ace-4ed4-86a6-ed121c95e80f] Refreshing network info cache for port a409f60c-6c6a-49f8-8520-04614e804002 {{(pid=71731) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 16:21:36 user nova-compute[71731]: DEBUG nova.network.neutron [req-3d3821b5-7431-4521-9d98-b519b05bc0d8 req-4cd26647-3d6e-4c42-92b9-baf98e997226 service nova] [instance: e4ada2d7-7ace-4ed4-86a6-ed121c95e80f] Instance cache missing network info. {{(pid=71731) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 16:21:36 user nova-compute[71731]: DEBUG nova.compute.provider_tree [None req-9ee02ae8-a4e6-4a99-abe2-322a33b7990b tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Inventory has not changed in ProviderTree for provider: cb6b1a64-0c24-4e2d-af1e-16576ca9165c {{(pid=71731) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 16:21:36 user nova-compute[71731]: DEBUG nova.scheduler.client.report [None req-9ee02ae8-a4e6-4a99-abe2-322a33b7990b tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Inventory has not changed for provider cb6b1a64-0c24-4e2d-af1e-16576ca9165c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71731) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 16:21:36 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-9ee02ae8-a4e6-4a99-abe2-322a33b7990b tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.568s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:21:36 user nova-compute[71731]: DEBUG nova.compute.manager [None req-9ee02ae8-a4e6-4a99-abe2-322a33b7990b tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] [instance: 031c7939-a53c-4f7d-9f36-4ec1d06e2717] Start building networks asynchronously for instance. {{(pid=71731) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 16:21:36 user nova-compute[71731]: DEBUG nova.compute.manager [None req-9ee02ae8-a4e6-4a99-abe2-322a33b7990b tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] [instance: 031c7939-a53c-4f7d-9f36-4ec1d06e2717] Allocating IP information in the background. {{(pid=71731) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 16:21:36 user nova-compute[71731]: DEBUG nova.network.neutron [None req-9ee02ae8-a4e6-4a99-abe2-322a33b7990b tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] [instance: 031c7939-a53c-4f7d-9f36-4ec1d06e2717] allocate_for_instance() {{(pid=71731) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 16:21:36 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-9ee02ae8-a4e6-4a99-abe2-322a33b7990b tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] [instance: 031c7939-a53c-4f7d-9f36-4ec1d06e2717] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 16:21:36 user nova-compute[71731]: DEBUG nova.compute.manager [None req-9ee02ae8-a4e6-4a99-abe2-322a33b7990b tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] [instance: 031c7939-a53c-4f7d-9f36-4ec1d06e2717] Start building block device mappings for instance. {{(pid=71731) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 16:21:36 user nova-compute[71731]: DEBUG nova.policy [None req-9ee02ae8-a4e6-4a99-abe2-322a33b7990b tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9223a3efe4bc4e37946c8ed718100de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7395d2408a44cc88cf88eb49d5f8503', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71731) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 16:21:37 user nova-compute[71731]: DEBUG nova.compute.manager [None req-9ee02ae8-a4e6-4a99-abe2-322a33b7990b tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] [instance: 031c7939-a53c-4f7d-9f36-4ec1d06e2717] Start spawning the instance on the hypervisor. {{(pid=71731) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 16:21:37 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-9ee02ae8-a4e6-4a99-abe2-322a33b7990b tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] [instance: 031c7939-a53c-4f7d-9f36-4ec1d06e2717] Creating instance directory {{(pid=71731) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 16:21:37 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-9ee02ae8-a4e6-4a99-abe2-322a33b7990b tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] [instance: 031c7939-a53c-4f7d-9f36-4ec1d06e2717] Creating image(s)
Apr 13 16:21:37 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-9ee02ae8-a4e6-4a99-abe2-322a33b7990b tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Acquiring lock "/opt/stack/data/nova/instances/031c7939-a53c-4f7d-9f36-4ec1d06e2717/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:21:37 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-9ee02ae8-a4e6-4a99-abe2-322a33b7990b tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Lock "/opt/stack/data/nova/instances/031c7939-a53c-4f7d-9f36-4ec1d06e2717/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:21:37 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-9ee02ae8-a4e6-4a99-abe2-322a33b7990b tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Lock "/opt/stack/data/nova/instances/031c7939-a53c-4f7d-9f36-4ec1d06e2717/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:21:37 user nova-compute[71731]: DEBUG nova.network.neutron [req-3d3821b5-7431-4521-9d98-b519b05bc0d8 req-4cd26647-3d6e-4c42-92b9-baf98e997226 service nova] [instance: e4ada2d7-7ace-4ed4-86a6-ed121c95e80f] Updating instance_info_cache with network_info: [] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:21:37 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-9ee02ae8-a4e6-4a99-abe2-322a33b7990b tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279 --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:21:37 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-3d3821b5-7431-4521-9d98-b519b05bc0d8 req-4cd26647-3d6e-4c42-92b9-baf98e997226 service nova] Releasing lock "refresh_cache-e4ada2d7-7ace-4ed4-86a6-ed121c95e80f" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 16:21:37 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-9ee02ae8-a4e6-4a99-abe2-322a33b7990b tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279 --force-share --output=json" returned: 0 in 0.176s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:21:37 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-9ee02ae8-a4e6-4a99-abe2-322a33b7990b tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Acquiring lock "9524227dd898575c3099d3976f096cd935414279" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:21:37 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-9ee02ae8-a4e6-4a99-abe2-322a33b7990b tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Lock "9524227dd898575c3099d3976f096cd935414279" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:21:37 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-9ee02ae8-a4e6-4a99-abe2-322a33b7990b tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279 --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:21:37 user nova-compute[71731]: DEBUG nova.network.neutron [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] [instance: 2549ba85-4e0a-420e-b711-07cafa8c60e9] Successfully updated port: 36152688-366c-40a2-8bf9-88f69925594a {{(pid=71731) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 16:21:37 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-9ee02ae8-a4e6-4a99-abe2-322a33b7990b tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279 --force-share --output=json" returned: 0 in 0.174s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:21:37 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-9ee02ae8-a4e6-4a99-abe2-322a33b7990b tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279,backing_fmt=raw /opt/stack/data/nova/instances/031c7939-a53c-4f7d-9f36-4ec1d06e2717/disk 1073741824 {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:21:37 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-9ee02ae8-a4e6-4a99-abe2-322a33b7990b tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279,backing_fmt=raw /opt/stack/data/nova/instances/031c7939-a53c-4f7d-9f36-4ec1d06e2717/disk 1073741824" returned: 0 in 0.062s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:21:37 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-9ee02ae8-a4e6-4a99-abe2-322a33b7990b tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Lock "9524227dd898575c3099d3976f096cd935414279" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.244s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:21:37 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-9ee02ae8-a4e6-4a99-abe2-322a33b7990b tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279 --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:21:37 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-ce4cfc33-fa3f-4959-a2b8-ca3f91801c9b tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Acquiring lock "bf350da4-9cc2-4900-adf0-506e44984b42" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:21:37 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-ce4cfc33-fa3f-4959-a2b8-ca3f91801c9b tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Lock "bf350da4-9cc2-4900-adf0-506e44984b42" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.003s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:21:37 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-9ee02ae8-a4e6-4a99-abe2-322a33b7990b tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279 --force-share --output=json" returned: 0 in 0.189s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:21:37 user nova-compute[71731]: DEBUG nova.virt.disk.api [None req-9ee02ae8-a4e6-4a99-abe2-322a33b7990b tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Checking if we can resize image /opt/stack/data/nova/instances/031c7939-a53c-4f7d-9f36-4ec1d06e2717/disk. size=1073741824 {{(pid=71731) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 16:21:37 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-9ee02ae8-a4e6-4a99-abe2-322a33b7990b tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/031c7939-a53c-4f7d-9f36-4ec1d06e2717/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:21:37 user nova-compute[71731]: DEBUG nova.compute.manager [None req-ce4cfc33-fa3f-4959-a2b8-ca3f91801c9b tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] [instance: bf350da4-9cc2-4900-adf0-506e44984b42] Starting instance... {{(pid=71731) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 16:21:37 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-ce4cfc33-fa3f-4959-a2b8-ca3f91801c9b tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:21:37 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-ce4cfc33-fa3f-4959-a2b8-ca3f91801c9b tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:21:37 user nova-compute[71731]: DEBUG nova.network.neutron [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] [instance: e4ada2d7-7ace-4ed4-86a6-ed121c95e80f] Successfully updated port: ac94464f-32dc-4cd1-a270-ec8934e77c21 {{(pid=71731) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 16:21:37 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-ce4cfc33-fa3f-4959-a2b8-ca3f91801c9b tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71731) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 16:21:37 user nova-compute[71731]: INFO nova.compute.claims [None req-ce4cfc33-fa3f-4959-a2b8-ca3f91801c9b tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] [instance: bf350da4-9cc2-4900-adf0-506e44984b42] Claim successful on node user
Apr 13 16:21:37 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-9ee02ae8-a4e6-4a99-abe2-322a33b7990b tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/031c7939-a53c-4f7d-9f36-4ec1d06e2717/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:21:37 user nova-compute[71731]: DEBUG nova.virt.disk.api [None req-9ee02ae8-a4e6-4a99-abe2-322a33b7990b tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Cannot resize image /opt/stack/data/nova/instances/031c7939-a53c-4f7d-9f36-4ec1d06e2717/disk to a smaller size. {{(pid=71731) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 16:21:37 user nova-compute[71731]: DEBUG nova.objects.instance [None req-9ee02ae8-a4e6-4a99-abe2-322a33b7990b tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Lazy-loading 'migration_context' on Instance uuid 031c7939-a53c-4f7d-9f36-4ec1d06e2717 {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:21:37 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-9ee02ae8-a4e6-4a99-abe2-322a33b7990b tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] [instance: 031c7939-a53c-4f7d-9f36-4ec1d06e2717] Created local disks {{(pid=71731) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 16:21:37 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-9ee02ae8-a4e6-4a99-abe2-322a33b7990b tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] [instance: 031c7939-a53c-4f7d-9f36-4ec1d06e2717] Ensure instance console log exists: /opt/stack/data/nova/instances/031c7939-a53c-4f7d-9f36-4ec1d06e2717/console.log {{(pid=71731) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 16:21:37 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-9ee02ae8-a4e6-4a99-abe2-322a33b7990b tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:21:37 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-9ee02ae8-a4e6-4a99-abe2-322a33b7990b tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:21:37 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-9ee02ae8-a4e6-4a99-abe2-322a33b7990b tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:21:38 user nova-compute[71731]: DEBUG nova.network.neutron [None req-9ee02ae8-a4e6-4a99-abe2-322a33b7990b tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] [instance: 031c7939-a53c-4f7d-9f36-4ec1d06e2717] Successfully created port: a99b01f1-3495-45d6-a802-a1f740719c17 {{(pid=71731) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 16:21:38 user nova-compute[71731]: DEBUG nova.compute.provider_tree [None req-ce4cfc33-fa3f-4959-a2b8-ca3f91801c9b tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Inventory has not changed in ProviderTree for provider: cb6b1a64-0c24-4e2d-af1e-16576ca9165c {{(pid=71731) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 16:21:38 user nova-compute[71731]: DEBUG nova.scheduler.client.report [None req-ce4cfc33-fa3f-4959-a2b8-ca3f91801c9b tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Inventory has not changed for provider cb6b1a64-0c24-4e2d-af1e-16576ca9165c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71731) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 16:21:38 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-ce4cfc33-fa3f-4959-a2b8-ca3f91801c9b tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.573s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:21:38 user nova-compute[71731]: DEBUG nova.compute.manager [None req-ce4cfc33-fa3f-4959-a2b8-ca3f91801c9b tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] [instance: bf350da4-9cc2-4900-adf0-506e44984b42] Start building networks asynchronously for instance. {{(pid=71731) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 16:21:38 user nova-compute[71731]: DEBUG nova.compute.manager [req-6df9d0f9-2332-4df0-be5d-879bbc100b7f req-a00112c2-c54e-4d3d-902f-13c30ef93157 service nova] [instance: 2549ba85-4e0a-420e-b711-07cafa8c60e9] Received event network-changed-36152688-366c-40a2-8bf9-88f69925594a {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:21:38 user nova-compute[71731]: DEBUG nova.compute.manager [req-6df9d0f9-2332-4df0-be5d-879bbc100b7f req-a00112c2-c54e-4d3d-902f-13c30ef93157 service nova] [instance: 2549ba85-4e0a-420e-b711-07cafa8c60e9] Refreshing instance network info cache due to event network-changed-36152688-366c-40a2-8bf9-88f69925594a. {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 16:21:38 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-6df9d0f9-2332-4df0-be5d-879bbc100b7f req-a00112c2-c54e-4d3d-902f-13c30ef93157 service nova] Acquiring lock "refresh_cache-2549ba85-4e0a-420e-b711-07cafa8c60e9" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 16:21:38 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-6df9d0f9-2332-4df0-be5d-879bbc100b7f req-a00112c2-c54e-4d3d-902f-13c30ef93157 service nova] Acquired lock "refresh_cache-2549ba85-4e0a-420e-b711-07cafa8c60e9" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 16:21:38 user nova-compute[71731]: DEBUG nova.network.neutron [req-6df9d0f9-2332-4df0-be5d-879bbc100b7f req-a00112c2-c54e-4d3d-902f-13c30ef93157 service nova] [instance: 2549ba85-4e0a-420e-b711-07cafa8c60e9] Refreshing network info cache for port 36152688-366c-40a2-8bf9-88f69925594a {{(pid=71731) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 16:21:38 user nova-compute[71731]: DEBUG nova.network.neutron [req-6df9d0f9-2332-4df0-be5d-879bbc100b7f req-a00112c2-c54e-4d3d-902f-13c30ef93157 service nova] [instance: 2549ba85-4e0a-420e-b711-07cafa8c60e9] Instance cache missing network info. {{(pid=71731) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 16:21:38 user nova-compute[71731]: DEBUG nova.compute.manager [None req-ce4cfc33-fa3f-4959-a2b8-ca3f91801c9b tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] [instance: bf350da4-9cc2-4900-adf0-506e44984b42] Allocating IP information in the background. {{(pid=71731) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 16:21:38 user nova-compute[71731]: DEBUG nova.network.neutron [None req-ce4cfc33-fa3f-4959-a2b8-ca3f91801c9b tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] [instance: bf350da4-9cc2-4900-adf0-506e44984b42] allocate_for_instance() {{(pid=71731) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 16:21:38 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-ce4cfc33-fa3f-4959-a2b8-ca3f91801c9b tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] [instance: bf350da4-9cc2-4900-adf0-506e44984b42] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 16:21:38 user nova-compute[71731]: DEBUG nova.compute.manager [None req-ce4cfc33-fa3f-4959-a2b8-ca3f91801c9b tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] [instance: bf350da4-9cc2-4900-adf0-506e44984b42] Start building block device mappings for instance. {{(pid=71731) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 16:21:38 user nova-compute[71731]: DEBUG nova.network.neutron [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] [instance: 2549ba85-4e0a-420e-b711-07cafa8c60e9] Successfully updated port: d7155dcf-9e83-4579-b81a-7277d4a9eeaf {{(pid=71731) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 16:21:38 user nova-compute[71731]: INFO nova.virt.block_device [None req-ce4cfc33-fa3f-4959-a2b8-ca3f91801c9b tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] [instance: bf350da4-9cc2-4900-adf0-506e44984b42] Booting with volume 1ac31388-2626-48e4-a711-54683ef66984 at /dev/vda
Apr 13 16:21:38 user nova-compute[71731]: DEBUG nova.policy [None req-ce4cfc33-fa3f-4959-a2b8-ca3f91801c9b tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fe6a4bf1a7794af2958c3d53ea1e19c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed94fa5d89c2486b8e2951e608e6630f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71731) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 16:21:38 user nova-compute[71731]: DEBUG nova.network.neutron [req-6df9d0f9-2332-4df0-be5d-879bbc100b7f req-a00112c2-c54e-4d3d-902f-13c30ef93157 service nova] [instance: 2549ba85-4e0a-420e-b711-07cafa8c60e9] Updating instance_info_cache with network_info: [] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:21:38 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-6df9d0f9-2332-4df0-be5d-879bbc100b7f req-a00112c2-c54e-4d3d-902f-13c30ef93157 service nova] Releasing lock "refresh_cache-2549ba85-4e0a-420e-b711-07cafa8c60e9" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 16:21:38 user nova-compute[71731]: DEBUG nova.compute.manager [req-6df9d0f9-2332-4df0-be5d-879bbc100b7f req-a00112c2-c54e-4d3d-902f-13c30ef93157 service nova] [instance: e4ada2d7-7ace-4ed4-86a6-ed121c95e80f] Received event network-changed-ac94464f-32dc-4cd1-a270-ec8934e77c21 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:21:38 user nova-compute[71731]: DEBUG nova.compute.manager [req-6df9d0f9-2332-4df0-be5d-879bbc100b7f req-a00112c2-c54e-4d3d-902f-13c30ef93157 service nova] [instance: e4ada2d7-7ace-4ed4-86a6-ed121c95e80f] Refreshing instance network info cache due to event network-changed-ac94464f-32dc-4cd1-a270-ec8934e77c21. {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 16:21:38 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-6df9d0f9-2332-4df0-be5d-879bbc100b7f req-a00112c2-c54e-4d3d-902f-13c30ef93157 service nova] Acquiring lock "refresh_cache-e4ada2d7-7ace-4ed4-86a6-ed121c95e80f" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 16:21:38 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-6df9d0f9-2332-4df0-be5d-879bbc100b7f req-a00112c2-c54e-4d3d-902f-13c30ef93157 service nova] Acquired lock "refresh_cache-e4ada2d7-7ace-4ed4-86a6-ed121c95e80f" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 16:21:38 user nova-compute[71731]: DEBUG nova.network.neutron [req-6df9d0f9-2332-4df0-be5d-879bbc100b7f req-a00112c2-c54e-4d3d-902f-13c30ef93157 service nova] [instance: e4ada2d7-7ace-4ed4-86a6-ed121c95e80f] Refreshing network info cache for port ac94464f-32dc-4cd1-a270-ec8934e77c21 {{(pid=71731) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 16:21:38 user nova-compute[71731]: DEBUG os_brick.utils [None req-ce4cfc33-fa3f-4959-a2b8-ca3f91801c9b tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 16:21:38 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:21:38 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.021s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:21:38 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[bab7c60c-3683-48aa-a6ce-9284fbc3dde6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:81501d91421\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:21:38 user nova-compute[71731]: DEBUG nova.network.neutron [req-6df9d0f9-2332-4df0-be5d-879bbc100b7f req-a00112c2-c54e-4d3d-902f-13c30ef93157 service nova] [instance: e4ada2d7-7ace-4ed4-86a6-ed121c95e80f] Instance cache missing network info. {{(pid=71731) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 16:21:38 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:21:38 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:21:38 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[b14aa088-8c50-4e01-83b9-9b19cfd70bfc]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:21:38 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:21:38 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:21:38 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[af97edf2-d836-48da-965e-61d5ac8aedf7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:21:38 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[50ba7455-8fe7-4417-bc4a-87863517404f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:21:38 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-ce4cfc33-fa3f-4959-a2b8-ca3f91801c9b tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Running cmd (subprocess): nvme version {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:21:38 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-ce4cfc33-fa3f-4959-a2b8-ca3f91801c9b tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] 'nvme version' failed. Not Retrying. {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 16:21:38 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ce4cfc33-fa3f-4959-a2b8-ca3f91801c9b tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] nvme not present on system {{(pid=71731) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 16:21:38 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:21:38 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 16:21:38 user nova-compute[71731]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 16:21:38 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1ba62d1-1100-4a8b-a200-db24cd7bf043]: (4, '') {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:21:39 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.lightos [None req-ce4cfc33-fa3f-4959-a2b8-ca3f91801c9b tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71731) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 16:21:39 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.lightos [None req-ce4cfc33-fa3f-4959-a2b8-ca3f91801c9b tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71731) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 16:21:39 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.lightos [None req-ce4cfc33-fa3f-4959-a2b8-ca3f91801c9b tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] LIGHTOS: no hostnqn found. {{(pid=71731) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 16:21:39 user nova-compute[71731]: DEBUG os_brick.utils [None req-ce4cfc33-fa3f-4959-a2b8-ca3f91801c9b tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] <== get_connector_properties: return (165ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:81501d91421', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 16:21:39 user nova-compute[71731]: DEBUG nova.virt.block_device [None req-ce4cfc33-fa3f-4959-a2b8-ca3f91801c9b tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] [instance: bf350da4-9cc2-4900-adf0-506e44984b42] Updating existing volume attachment record: e626ea75-be62-4b0f-a34e-85bfc884704f {{(pid=71731) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 16:21:39 user nova-compute[71731]: DEBUG nova.network.neutron [req-6df9d0f9-2332-4df0-be5d-879bbc100b7f req-a00112c2-c54e-4d3d-902f-13c30ef93157 service nova] [instance: e4ada2d7-7ace-4ed4-86a6-ed121c95e80f] Updating instance_info_cache with network_info: [] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:21:39 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-6df9d0f9-2332-4df0-be5d-879bbc100b7f req-a00112c2-c54e-4d3d-902f-13c30ef93157 service nova] Releasing lock "refresh_cache-e4ada2d7-7ace-4ed4-86a6-ed121c95e80f" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 16:21:39 user nova-compute[71731]: DEBUG nova.network.neutron [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] [instance: e4ada2d7-7ace-4ed4-86a6-ed121c95e80f] Successfully updated port: 0125a8df-e91c-4d65-be74-fda2f2d93938 {{(pid=71731) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 16:21:39 user nova-compute[71731]: DEBUG nova.network.neutron [None req-9ee02ae8-a4e6-4a99-abe2-322a33b7990b tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] [instance: 031c7939-a53c-4f7d-9f36-4ec1d06e2717] Successfully updated port: a99b01f1-3495-45d6-a802-a1f740719c17 {{(pid=71731) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 16:21:39 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-9ee02ae8-a4e6-4a99-abe2-322a33b7990b tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Acquiring lock "refresh_cache-031c7939-a53c-4f7d-9f36-4ec1d06e2717" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 16:21:39 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-9ee02ae8-a4e6-4a99-abe2-322a33b7990b tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Acquired lock "refresh_cache-031c7939-a53c-4f7d-9f36-4ec1d06e2717" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 16:21:39 user nova-compute[71731]: DEBUG nova.network.neutron [None req-9ee02ae8-a4e6-4a99-abe2-322a33b7990b tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] [instance: 031c7939-a53c-4f7d-9f36-4ec1d06e2717] Building network info cache for instance {{(pid=71731) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 16:21:39 user nova-compute[71731]: DEBUG nova.compute.manager [req-57dbaaf9-03fb-4a52-9bac-6a4fa25cebf2 req-364f6138-54f6-4f56-8dce-cfb38065cd35 service nova] [instance: 031c7939-a53c-4f7d-9f36-4ec1d06e2717] Received event network-changed-a99b01f1-3495-45d6-a802-a1f740719c17 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:21:39 user nova-compute[71731]: DEBUG nova.compute.manager [req-57dbaaf9-03fb-4a52-9bac-6a4fa25cebf2 req-364f6138-54f6-4f56-8dce-cfb38065cd35 service nova] [instance: 031c7939-a53c-4f7d-9f36-4ec1d06e2717] Refreshing instance network info cache due to event network-changed-a99b01f1-3495-45d6-a802-a1f740719c17. {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 16:21:39 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-57dbaaf9-03fb-4a52-9bac-6a4fa25cebf2 req-364f6138-54f6-4f56-8dce-cfb38065cd35 service nova] Acquiring lock "refresh_cache-031c7939-a53c-4f7d-9f36-4ec1d06e2717" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 16:21:39 user nova-compute[71731]: DEBUG nova.network.neutron [None req-9ee02ae8-a4e6-4a99-abe2-322a33b7990b tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] [instance: 031c7939-a53c-4f7d-9f36-4ec1d06e2717] Instance cache missing network info. {{(pid=71731) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 16:21:39 user nova-compute[71731]: INFO nova.virt.block_device [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] [instance: 2549ba85-4e0a-420e-b711-07cafa8c60e9] Booting with volume e0f728f3-fbb5-4ed8-a78b-a5d982b03f7d at /dev/vdc
Apr 13 16:21:39 user nova-compute[71731]: INFO nova.virt.block_device [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] [instance: e4ada2d7-7ace-4ed4-86a6-ed121c95e80f] Booting with volume cc639d00-ef6b-4121-bcb0-c65ec0347abd at /dev/vdc
Apr 13 16:21:40 user nova-compute[71731]: DEBUG os_brick.utils [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 16:21:40 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:21:40 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:21:40 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccb08bd1-91fa-4e28-9db9-58e0d42a64f1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:81501d91421\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:21:40 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:21:40 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:21:40 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[a64ddd10-0eb6-40ce-900d-e8227897e855]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:21:40 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:21:40 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:21:40 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[84a07a57-ead8-496f-8185-8686c6873b22]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:21:40 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[add31cf2-e0a9-40e6-98cb-c1b79d3ce362]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:21:40 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Running cmd (subprocess): nvme version {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:21:40 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] 'nvme version' failed. Not Retrying. {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 16:21:40 user nova-compute[71731]: DEBUG os_brick.utils [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 16:21:40 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] nvme not present on system {{(pid=71731) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 16:21:40 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:21:40 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:21:40 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:21:40 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[d39dd31e-8358-4445-a7b6-3b297e47ba93]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:81501d91421\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:21:40 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:21:40 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 16:21:40 user nova-compute[71731]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 16:21:40 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4c535a0-c5e5-4a43-a78d-e972781b48f8]: (4, '') {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:21:40 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.lightos [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71731) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 16:21:40 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.lightos [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71731) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 16:21:40 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.lightos [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] LIGHTOS: no hostnqn found. {{(pid=71731) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 16:21:40 user nova-compute[71731]: DEBUG os_brick.utils [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] <== get_connector_properties: return (139ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:81501d91421', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 16:21:40 user nova-compute[71731]: DEBUG nova.virt.block_device [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] [instance: 2549ba85-4e0a-420e-b711-07cafa8c60e9] Updating existing volume attachment record: b054ddc1-dae3-4ede-9d9b-e2c2a593f0d8 {{(pid=71731) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 16:21:40 user nova-compute[71731]: DEBUG nova.network.neutron [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] [instance: 2549ba85-4e0a-420e-b711-07cafa8c60e9] Successfully updated port: 4c481745-6342-43f8-9040-3ea1d8c5c572 {{(pid=71731) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 16:21:40 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.022s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:21:40 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[093439e6-61d8-4fb2-a6d5-c888ab6f4371]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:21:40 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:21:40 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:21:40 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a1d39d3-3b5a-4fe4-a341-12ee6ddb68f0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:21:40 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9f78984-2857-4592-a99e-45fd024bd365]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:21:40 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Running cmd (subprocess): nvme version {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:21:40 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] 'nvme version' failed. Not Retrying. {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 16:21:40 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.nvmeof [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] nvme not present on system {{(pid=71731) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 16:21:40 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:21:40 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 16:21:40 user nova-compute[71731]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 16:21:40 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f0aeda3-9265-42b8-ab47-a3e96ce0ac90]: (4, '') {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:21:40 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.lightos [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71731) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 16:21:40 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.lightos [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71731) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 16:21:40 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.lightos [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] LIGHTOS: no hostnqn found. {{(pid=71731) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 16:21:40 user nova-compute[71731]: DEBUG os_brick.utils [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] <== get_connector_properties: return (162ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:81501d91421', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 16:21:40 user nova-compute[71731]: DEBUG nova.virt.block_device [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] [instance: e4ada2d7-7ace-4ed4-86a6-ed121c95e80f] Updating existing volume attachment record: 05ec20c7-b0c7-4c0f-b59f-22e0446509c9 {{(pid=71731) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 16:21:40 user nova-compute[71731]: DEBUG nova.compute.manager [req-76c3e22e-6643-4fbb-8798-9b6c381ecdf8 req-1b45d51e-67a3-4fe8-b854-7e6470e98f80 service nova] [instance: 2549ba85-4e0a-420e-b711-07cafa8c60e9] Received event network-changed-d7155dcf-9e83-4579-b81a-7277d4a9eeaf {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:21:40 user nova-compute[71731]: DEBUG nova.compute.manager [req-76c3e22e-6643-4fbb-8798-9b6c381ecdf8 req-1b45d51e-67a3-4fe8-b854-7e6470e98f80 service nova] [instance: 2549ba85-4e0a-420e-b711-07cafa8c60e9] Refreshing instance network info cache due to event network-changed-d7155dcf-9e83-4579-b81a-7277d4a9eeaf. {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 16:21:40 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-76c3e22e-6643-4fbb-8798-9b6c381ecdf8 req-1b45d51e-67a3-4fe8-b854-7e6470e98f80 service nova] Acquiring lock "refresh_cache-2549ba85-4e0a-420e-b711-07cafa8c60e9" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 16:21:40 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-76c3e22e-6643-4fbb-8798-9b6c381ecdf8 req-1b45d51e-67a3-4fe8-b854-7e6470e98f80 service nova] Acquired lock "refresh_cache-2549ba85-4e0a-420e-b711-07cafa8c60e9" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 16:21:40 user nova-compute[71731]: DEBUG nova.network.neutron [req-76c3e22e-6643-4fbb-8798-9b6c381ecdf8 req-1b45d51e-67a3-4fe8-b854-7e6470e98f80 service nova] [instance: 2549ba85-4e0a-420e-b711-07cafa8c60e9] Refreshing network info cache for port d7155dcf-9e83-4579-b81a-7277d4a9eeaf {{(pid=71731) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 16:21:40 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:21:40 user nova-compute[71731]: DEBUG nova.network.neutron [req-76c3e22e-6643-4fbb-8798-9b6c381ecdf8 req-1b45d51e-67a3-4fe8-b854-7e6470e98f80 service nova] [instance: 2549ba85-4e0a-420e-b711-07cafa8c60e9] Instance cache missing network info. {{(pid=71731) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 16:21:40 user nova-compute[71731]: DEBUG nova.network.neutron [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] [instance: e4ada2d7-7ace-4ed4-86a6-ed121c95e80f] Successfully updated port: 8f3a3011-e474-4538-812b-9df3968fd629 {{(pid=71731) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 16:21:40 user nova-compute[71731]: DEBUG nova.network.neutron [None req-ce4cfc33-fa3f-4959-a2b8-ca3f91801c9b tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] [instance: bf350da4-9cc2-4900-adf0-506e44984b42] Successfully created port: 1a737bae-3b9b-43b4-8a89-0eb98fdf2ec8 {{(pid=71731) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 16:21:40 user nova-compute[71731]: DEBUG nova.network.neutron [req-76c3e22e-6643-4fbb-8798-9b6c381ecdf8 req-1b45d51e-67a3-4fe8-b854-7e6470e98f80 service nova] [instance: 2549ba85-4e0a-420e-b711-07cafa8c60e9] Updating instance_info_cache with network_info: [] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:21:40 user nova-compute[71731]: DEBUG nova.network.neutron [None req-9ee02ae8-a4e6-4a99-abe2-322a33b7990b tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] [instance: 031c7939-a53c-4f7d-9f36-4ec1d06e2717] Updating instance_info_cache with network_info: [{"id": "a99b01f1-3495-45d6-a802-a1f740719c17", "address": "fa:16:3e:42:0a:ee", "network": {"id": "aa17b8d5-dffb-42ba-bb7e-8909e5894bfb", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-386731779-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "e7395d2408a44cc88cf88eb49d5f8503", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa99b01f1-34", "ovs_interfaceid": "a99b01f1-3495-45d6-a802-a1f740719c17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:21:40 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-76c3e22e-6643-4fbb-8798-9b6c381ecdf8 req-1b45d51e-67a3-4fe8-b854-7e6470e98f80 service nova] Releasing lock "refresh_cache-2549ba85-4e0a-420e-b711-07cafa8c60e9" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 16:21:40 user nova-compute[71731]: DEBUG nova.compute.manager [req-76c3e22e-6643-4fbb-8798-9b6c381ecdf8 req-1b45d51e-67a3-4fe8-b854-7e6470e98f80 service nova] [instance: e4ada2d7-7ace-4ed4-86a6-ed121c95e80f] Received event network-changed-0125a8df-e91c-4d65-be74-fda2f2d93938 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:21:40 user nova-compute[71731]: DEBUG nova.compute.manager [req-76c3e22e-6643-4fbb-8798-9b6c381ecdf8 req-1b45d51e-67a3-4fe8-b854-7e6470e98f80 service nova] [instance: e4ada2d7-7ace-4ed4-86a6-ed121c95e80f] Refreshing instance network info cache due to event network-changed-0125a8df-e91c-4d65-be74-fda2f2d93938. {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 16:21:40 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-76c3e22e-6643-4fbb-8798-9b6c381ecdf8 req-1b45d51e-67a3-4fe8-b854-7e6470e98f80 service nova] Acquiring lock "refresh_cache-e4ada2d7-7ace-4ed4-86a6-ed121c95e80f" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 16:21:40 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-76c3e22e-6643-4fbb-8798-9b6c381ecdf8 req-1b45d51e-67a3-4fe8-b854-7e6470e98f80 service nova] Acquired lock "refresh_cache-e4ada2d7-7ace-4ed4-86a6-ed121c95e80f" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 16:21:40 user nova-compute[71731]: DEBUG nova.network.neutron [req-76c3e22e-6643-4fbb-8798-9b6c381ecdf8 req-1b45d51e-67a3-4fe8-b854-7e6470e98f80 service nova] [instance: e4ada2d7-7ace-4ed4-86a6-ed121c95e80f] Refreshing network info cache for port 0125a8df-e91c-4d65-be74-fda2f2d93938 {{(pid=71731) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 16:21:40 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-9ee02ae8-a4e6-4a99-abe2-322a33b7990b tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Releasing lock "refresh_cache-031c7939-a53c-4f7d-9f36-4ec1d06e2717" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 16:21:40 user nova-compute[71731]: DEBUG nova.compute.manager [None req-9ee02ae8-a4e6-4a99-abe2-322a33b7990b tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] [instance: 031c7939-a53c-4f7d-9f36-4ec1d06e2717] Instance network_info: |[{"id": "a99b01f1-3495-45d6-a802-a1f740719c17", "address": "fa:16:3e:42:0a:ee", "network": {"id": "aa17b8d5-dffb-42ba-bb7e-8909e5894bfb", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-386731779-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "e7395d2408a44cc88cf88eb49d5f8503", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa99b01f1-34", "ovs_interfaceid": "a99b01f1-3495-45d6-a802-a1f740719c17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71731) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 16:21:40 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-57dbaaf9-03fb-4a52-9bac-6a4fa25cebf2 req-364f6138-54f6-4f56-8dce-cfb38065cd35 service nova] Acquired lock "refresh_cache-031c7939-a53c-4f7d-9f36-4ec1d06e2717" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 16:21:40 user nova-compute[71731]: DEBUG nova.network.neutron [req-57dbaaf9-03fb-4a52-9bac-6a4fa25cebf2 req-364f6138-54f6-4f56-8dce-cfb38065cd35 service nova] [instance: 031c7939-a53c-4f7d-9f36-4ec1d06e2717] Refreshing network info cache for port a99b01f1-3495-45d6-a802-a1f740719c17 {{(pid=71731) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 16:21:40 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-9ee02ae8-a4e6-4a99-abe2-322a33b7990b tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] [instance: 031c7939-a53c-4f7d-9f36-4ec1d06e2717] Start _get_guest_xml network_info=[{"id": "a99b01f1-3495-45d6-a802-a1f740719c17", "address": "fa:16:3e:42:0a:ee", "network": {"id": "aa17b8d5-dffb-42ba-bb7e-8909e5894bfb", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-386731779-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "e7395d2408a44cc88cf88eb49d5f8503", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa99b01f1-34", "ovs_interfaceid": "a99b01f1-3495-45d6-a802-a1f740719c17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T16:16:31Z,direct_url=<?>,disk_format='qcow2',id=708622a9-7465-4492-ade8-b827198f7e30,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='0b29a975c552465aba0ac7d6288434bd',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T16:16:33Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'device_type': 'disk', 'encrypted': False, 'disk_bus': 'virtio', 'guest_format': None, 'encryption_options': None, 'image_id': '708622a9-7465-4492-ade8-b827198f7e30'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71731) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 16:21:40 user nova-compute[71731]: WARNING nova.virt.libvirt.driver [None req-9ee02ae8-a4e6-4a99-abe2-322a33b7990b tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 16:21:40 user nova-compute[71731]: WARNING nova.virt.libvirt.driver [None req-9ee02ae8-a4e6-4a99-abe2-322a33b7990b tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 16:21:40 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-9ee02ae8-a4e6-4a99-abe2-322a33b7990b tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71731) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 16:21:40 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-9ee02ae8-a4e6-4a99-abe2-322a33b7990b tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T16:17:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T16:16:31Z,direct_url=<?>,disk_format='qcow2',id=708622a9-7465-4492-ade8-b827198f7e30,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='0b29a975c552465aba0ac7d6288434bd',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T16:16:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 16:21:40 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-9ee02ae8-a4e6-4a99-abe2-322a33b7990b tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Flavor limits 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 16:21:40 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-9ee02ae8-a4e6-4a99-abe2-322a33b7990b tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Image limits 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 16:21:40 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-9ee02ae8-a4e6-4a99-abe2-322a33b7990b tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Flavor pref 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 16:21:40 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-9ee02ae8-a4e6-4a99-abe2-322a33b7990b tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Image pref 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 16:21:40 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-9ee02ae8-a4e6-4a99-abe2-322a33b7990b tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 16:21:40 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-9ee02ae8-a4e6-4a99-abe2-322a33b7990b tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 16:21:40 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-9ee02ae8-a4e6-4a99-abe2-322a33b7990b tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71731) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 16:21:40 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-9ee02ae8-a4e6-4a99-abe2-322a33b7990b tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Got 1 possible topologies {{(pid=71731) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 16:21:40 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-9ee02ae8-a4e6-4a99-abe2-322a33b7990b tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 16:21:40 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-9ee02ae8-a4e6-4a99-abe2-322a33b7990b tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 16:21:40 user nova-compute[71731]: DEBUG nova.virt.libvirt.vif [None req-9ee02ae8-a4e6-4a99-abe2-322a33b7990b tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T16:21:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1108271225',display_name='tempest-VolumesSnapshotTestJSON-instance-1108271225',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1108271225',id=10,image_ref='708622a9-7465-4492-ade8-b827198f7e30',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e7395d2408a44cc88cf88eb49d5f8503',ramdisk_id='',reservation_id='r-3dxchrfq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='708622a9-7465-4492-ade8-b827198f7e30',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1985397600',owner_user_name='tempest-VolumesSnapshotTestJSON-1985397600-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T16:21:37Z,user_data=None,user_id='9223a3efe4bc4e37946c8ed718100de4',uuid=031c7939-a53c-4f7d-9f36-4ec1d06e2717,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a99b01f1-3495-45d6-a802-a1f740719c17", "address": "fa:16:3e:42:0a:ee", "network": {"id": "aa17b8d5-dffb-42ba-bb7e-8909e5894bfb", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-386731779-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "e7395d2408a44cc88cf88eb49d5f8503", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa99b01f1-34", "ovs_interfaceid": "a99b01f1-3495-45d6-a802-a1f740719c17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71731) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 16:21:40 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-9ee02ae8-a4e6-4a99-abe2-322a33b7990b tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Converting VIF {"id": "a99b01f1-3495-45d6-a802-a1f740719c17", "address": "fa:16:3e:42:0a:ee", "network": {"id": "aa17b8d5-dffb-42ba-bb7e-8909e5894bfb", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-386731779-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "e7395d2408a44cc88cf88eb49d5f8503", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa99b01f1-34", "ovs_interfaceid": "a99b01f1-3495-45d6-a802-a1f740719c17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 16:21:40 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-9ee02ae8-a4e6-4a99-abe2-322a33b7990b tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:42:0a:ee,bridge_name='br-int',has_traffic_filtering=True,id=a99b01f1-3495-45d6-a802-a1f740719c17,network=Network(aa17b8d5-dffb-42ba-bb7e-8909e5894bfb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa99b01f1-34') {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 16:21:40 user nova-compute[71731]: DEBUG nova.objects.instance [None req-9ee02ae8-a4e6-4a99-abe2-322a33b7990b tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Lazy-loading 'pci_devices' on Instance uuid 031c7939-a53c-4f7d-9f36-4ec1d06e2717 {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:21:40 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-9ee02ae8-a4e6-4a99-abe2-322a33b7990b tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] [instance: 031c7939-a53c-4f7d-9f36-4ec1d06e2717] End _get_guest_xml xml=<domain type="kvm">
Apr 13 16:21:40 user nova-compute[71731]:   <uuid>031c7939-a53c-4f7d-9f36-4ec1d06e2717</uuid>
Apr 13 16:21:40 user nova-compute[71731]:   <name>instance-0000000a</name>
Apr 13 16:21:40 user nova-compute[71731]:   <memory>131072</memory>
Apr 13 16:21:40 user nova-compute[71731]:   <vcpu>1</vcpu>
Apr 13 16:21:40 user nova-compute[71731]:   <metadata>
Apr 13 16:21:40 user nova-compute[71731]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 16:21:40 user nova-compute[71731]:       <nova:package version="0.0.0"/>
Apr 13 16:21:40 user nova-compute[71731]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1108271225</nova:name>
Apr 13 16:21:40 user nova-compute[71731]:       <nova:creationTime>2023-04-13 16:21:40</nova:creationTime>
Apr 13 16:21:40 user nova-compute[71731]:       <nova:flavor name="m1.nano">
Apr 13 16:21:40 user nova-compute[71731]:         <nova:memory>128</nova:memory>
Apr 13 16:21:40 user nova-compute[71731]:         <nova:disk>1</nova:disk>
Apr 13 16:21:40 user nova-compute[71731]:         <nova:swap>0</nova:swap>
Apr 13 16:21:40 user nova-compute[71731]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 16:21:40 user nova-compute[71731]:         <nova:vcpus>1</nova:vcpus>
Apr 13 16:21:40 user nova-compute[71731]:       </nova:flavor>
Apr 13 16:21:40 user nova-compute[71731]:       <nova:owner>
Apr 13 16:21:40 user nova-compute[71731]:         <nova:user uuid="9223a3efe4bc4e37946c8ed718100de4">tempest-VolumesSnapshotTestJSON-1985397600-project-member</nova:user>
Apr 13 16:21:40 user nova-compute[71731]:         <nova:project uuid="e7395d2408a44cc88cf88eb49d5f8503">tempest-VolumesSnapshotTestJSON-1985397600</nova:project>
Apr 13 16:21:40 user nova-compute[71731]:       </nova:owner>
Apr 13 16:21:40 user nova-compute[71731]:       <nova:root type="image" uuid="708622a9-7465-4492-ade8-b827198f7e30"/>
Apr 13 16:21:40 user nova-compute[71731]:       <nova:ports>
Apr 13 16:21:40 user nova-compute[71731]:         <nova:port uuid="a99b01f1-3495-45d6-a802-a1f740719c17">
Apr 13 16:21:40 user nova-compute[71731]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Apr 13 16:21:40 user nova-compute[71731]:         </nova:port>
Apr 13 16:21:40 user nova-compute[71731]:       </nova:ports>
Apr 13 16:21:40 user nova-compute[71731]:     </nova:instance>
Apr 13 16:21:40 user nova-compute[71731]:   </metadata>
Apr 13 16:21:40 user nova-compute[71731]:   <sysinfo type="smbios">
Apr 13 16:21:40 user nova-compute[71731]:     <system>
Apr 13 16:21:40 user nova-compute[71731]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 16:21:40 user nova-compute[71731]:       <entry name="product">OpenStack Nova</entry>
Apr 13 16:21:40 user nova-compute[71731]:       <entry name="version">0.0.0</entry>
Apr 13 16:21:40 user nova-compute[71731]:       <entry name="serial">031c7939-a53c-4f7d-9f36-4ec1d06e2717</entry>
Apr 13 16:21:40 user nova-compute[71731]:       <entry name="uuid">031c7939-a53c-4f7d-9f36-4ec1d06e2717</entry>
Apr 13 16:21:40 user nova-compute[71731]:       <entry name="family">Virtual Machine</entry>
Apr 13 16:21:40 user nova-compute[71731]:     </system>
Apr 13 16:21:40 user nova-compute[71731]:   </sysinfo>
Apr 13 16:21:40 user nova-compute[71731]:   <os>
Apr 13 16:21:40 user nova-compute[71731]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 16:21:40 user nova-compute[71731]:     <boot dev="hd"/>
Apr 13 16:21:40 user nova-compute[71731]:     <smbios mode="sysinfo"/>
Apr 13 16:21:40 user nova-compute[71731]:   </os>
Apr 13 16:21:40 user nova-compute[71731]:   <features>
Apr 13 16:21:40 user nova-compute[71731]:     <acpi/>
Apr 13 16:21:40 user nova-compute[71731]:     <apic/>
Apr 13 16:21:40 user nova-compute[71731]:     <vmcoreinfo/>
Apr 13 16:21:40 user nova-compute[71731]:   </features>
Apr 13 16:21:40 user nova-compute[71731]:   <clock offset="utc">
Apr 13 16:21:40 user nova-compute[71731]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 16:21:40 user nova-compute[71731]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 16:21:40 user nova-compute[71731]:     <timer name="hpet" present="no"/>
Apr 13 16:21:40 user nova-compute[71731]:   </clock>
Apr 13 16:21:40 user nova-compute[71731]:   <cpu mode="custom" match="exact">
Apr 13 16:21:40 user nova-compute[71731]:     <model>Nehalem</model>
Apr 13 16:21:40 user nova-compute[71731]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 16:21:40 user nova-compute[71731]:   </cpu>
Apr 13 16:21:40 user nova-compute[71731]:   <devices>
Apr 13 16:21:40 user nova-compute[71731]:     <disk type="file" device="disk">
Apr 13 16:21:40 user nova-compute[71731]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 16:21:40 user nova-compute[71731]:       <source file="/opt/stack/data/nova/instances/031c7939-a53c-4f7d-9f36-4ec1d06e2717/disk"/>
Apr 13 16:21:40 user nova-compute[71731]:       <target dev="vda" bus="virtio"/>
Apr 13 16:21:40 user nova-compute[71731]:     </disk>
Apr 13 16:21:40 user nova-compute[71731]:     <interface type="ethernet">
Apr 13 16:21:40 user nova-compute[71731]:       <mac address="fa:16:3e:42:0a:ee"/>
Apr 13 16:21:40 user nova-compute[71731]:       <model type="virtio"/>
Apr 13 16:21:40 user nova-compute[71731]:       <mtu size="1442"/>
Apr 13 16:21:40 user nova-compute[71731]:       <target dev="tapa99b01f1-34"/>
Apr 13 16:21:40 user nova-compute[71731]:     </interface>
Apr 13 16:21:40 user nova-compute[71731]:     <serial type="pty">
Apr 13 16:21:40 user nova-compute[71731]:       <log file="/opt/stack/data/nova/instances/031c7939-a53c-4f7d-9f36-4ec1d06e2717/console.log" append="off"/>
Apr 13 16:21:40 user nova-compute[71731]:     </serial>
Apr 13 16:21:40 user nova-compute[71731]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 16:21:40 user nova-compute[71731]:     <video>
Apr 13 16:21:40 user nova-compute[71731]:       <model type="virtio"/>
Apr 13 16:21:40 user nova-compute[71731]:     </video>
Apr 13 16:21:40 user nova-compute[71731]:     <rng model="virtio">
Apr 13 16:21:40 user nova-compute[71731]:       <backend model="random">/dev/urandom</backend>
Apr 13 16:21:40 user nova-compute[71731]:     </rng>
Apr 13 16:21:40 user nova-compute[71731]:     <controller type="usb" index="0" model="none"/>
Apr 13 16:21:40 user nova-compute[71731]:     <memballoon model="virtio">
Apr 13 16:21:40 user nova-compute[71731]:       <stats period="10"/>
Apr 13 16:21:40 user nova-compute[71731]:     </memballoon>
Apr 13 16:21:40 user nova-compute[71731]:   </devices>
Apr 13 16:21:40 user nova-compute[71731]: </domain>
Apr 13 16:21:40 user nova-compute[71731]:  {{(pid=71731) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 16:21:41 user nova-compute[71731]: DEBUG nova.virt.libvirt.vif [None req-9ee02ae8-a4e6-4a99-abe2-322a33b7990b tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T16:21:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1108271225',display_name='tempest-VolumesSnapshotTestJSON-instance-1108271225',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1108271225',id=10,image_ref='708622a9-7465-4492-ade8-b827198f7e30',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e7395d2408a44cc88cf88eb49d5f8503',ramdisk_id='',reservation_id='r-3dxchrfq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='708622a9-7465-4492-ade8-b827198f7e30',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1985397600',owner_user_name='tempest-VolumesSnapshotTestJSON-1985397600-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T16:21:37Z,user_data=None,user_id='9223a3efe4bc4e37946c8ed718100de4',uuid=031c7939-a53c-4f7d-9f36-4ec1d06e2717,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a99b01f1-3495-45d6-a802-a1f740719c17", "address": "fa:16:3e:42:0a:ee", "network": {"id": "aa17b8d5-dffb-42ba-bb7e-8909e5894bfb", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-386731779-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "e7395d2408a44cc88cf88eb49d5f8503", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa99b01f1-34", "ovs_interfaceid": "a99b01f1-3495-45d6-a802-a1f740719c17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 16:21:41 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-9ee02ae8-a4e6-4a99-abe2-322a33b7990b tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Converting VIF {"id": "a99b01f1-3495-45d6-a802-a1f740719c17", "address": "fa:16:3e:42:0a:ee", "network": {"id": "aa17b8d5-dffb-42ba-bb7e-8909e5894bfb", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-386731779-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "e7395d2408a44cc88cf88eb49d5f8503", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa99b01f1-34", "ovs_interfaceid": "a99b01f1-3495-45d6-a802-a1f740719c17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 16:21:41 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-9ee02ae8-a4e6-4a99-abe2-322a33b7990b tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:42:0a:ee,bridge_name='br-int',has_traffic_filtering=True,id=a99b01f1-3495-45d6-a802-a1f740719c17,network=Network(aa17b8d5-dffb-42ba-bb7e-8909e5894bfb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa99b01f1-34') {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 16:21:41 user nova-compute[71731]: DEBUG os_vif [None req-9ee02ae8-a4e6-4a99-abe2-322a33b7990b tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:42:0a:ee,bridge_name='br-int',has_traffic_filtering=True,id=a99b01f1-3495-45d6-a802-a1f740719c17,network=Network(aa17b8d5-dffb-42ba-bb7e-8909e5894bfb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa99b01f1-34') {{(pid=71731) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 16:21:41 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:21:41 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:21:41 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 16:21:41 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:21:41 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa99b01f1-34, may_exist=True) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:21:41 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa99b01f1-34, col_values=(('external_ids', {'iface-id': 'a99b01f1-3495-45d6-a802-a1f740719c17', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:42:0a:ee', 'vm-uuid': '031c7939-a53c-4f7d-9f36-4ec1d06e2717'}),)) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:21:41 user nova-compute[71731]: DEBUG nova.network.neutron [req-76c3e22e-6643-4fbb-8798-9b6c381ecdf8 req-1b45d51e-67a3-4fe8-b854-7e6470e98f80 service nova] [instance: e4ada2d7-7ace-4ed4-86a6-ed121c95e80f] Instance cache missing network info. {{(pid=71731) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 16:21:41 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 16:21:41 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:21:41 user nova-compute[71731]: INFO os_vif [None req-9ee02ae8-a4e6-4a99-abe2-322a33b7990b tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:42:0a:ee,bridge_name='br-int',has_traffic_filtering=True,id=a99b01f1-3495-45d6-a802-a1f740719c17,network=Network(aa17b8d5-dffb-42ba-bb7e-8909e5894bfb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa99b01f1-34')
Apr 13 16:21:41 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-9ee02ae8-a4e6-4a99-abe2-322a33b7990b tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] No BDM found with device name vda, not building metadata. {{(pid=71731) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 16:21:41 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-9ee02ae8-a4e6-4a99-abe2-322a33b7990b tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] No VIF found with MAC fa:16:3e:42:0a:ee, not building metadata {{(pid=71731) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 16:21:41 user nova-compute[71731]: DEBUG nova.network.neutron [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] [instance: 2549ba85-4e0a-420e-b711-07cafa8c60e9] Successfully updated port: 0152bbb9-d50d-4e58-8a2b-727c4675ea2f {{(pid=71731) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 16:21:41 user nova-compute[71731]: DEBUG nova.network.neutron [req-57dbaaf9-03fb-4a52-9bac-6a4fa25cebf2 req-364f6138-54f6-4f56-8dce-cfb38065cd35 service nova] [instance: 031c7939-a53c-4f7d-9f36-4ec1d06e2717] Updated VIF entry in instance network info cache for port a99b01f1-3495-45d6-a802-a1f740719c17. {{(pid=71731) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 16:21:41 user nova-compute[71731]: DEBUG nova.network.neutron [req-57dbaaf9-03fb-4a52-9bac-6a4fa25cebf2 req-364f6138-54f6-4f56-8dce-cfb38065cd35 service nova] [instance: 031c7939-a53c-4f7d-9f36-4ec1d06e2717] Updating instance_info_cache with network_info: [{"id": "a99b01f1-3495-45d6-a802-a1f740719c17", "address": "fa:16:3e:42:0a:ee", "network": {"id": "aa17b8d5-dffb-42ba-bb7e-8909e5894bfb", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-386731779-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "e7395d2408a44cc88cf88eb49d5f8503", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa99b01f1-34", "ovs_interfaceid": "a99b01f1-3495-45d6-a802-a1f740719c17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:21:41 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-57dbaaf9-03fb-4a52-9bac-6a4fa25cebf2 req-364f6138-54f6-4f56-8dce-cfb38065cd35 service nova] Releasing lock "refresh_cache-031c7939-a53c-4f7d-9f36-4ec1d06e2717" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 16:21:41 user nova-compute[71731]: DEBUG nova.network.neutron [req-76c3e22e-6643-4fbb-8798-9b6c381ecdf8 req-1b45d51e-67a3-4fe8-b854-7e6470e98f80 service nova] [instance: e4ada2d7-7ace-4ed4-86a6-ed121c95e80f] Updating instance_info_cache with network_info: [] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:21:41 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-76c3e22e-6643-4fbb-8798-9b6c381ecdf8 req-1b45d51e-67a3-4fe8-b854-7e6470e98f80 service nova] Releasing lock "refresh_cache-e4ada2d7-7ace-4ed4-86a6-ed121c95e80f" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 16:21:41 user nova-compute[71731]: DEBUG nova.compute.manager [req-76c3e22e-6643-4fbb-8798-9b6c381ecdf8 req-1b45d51e-67a3-4fe8-b854-7e6470e98f80 service nova] [instance: 2549ba85-4e0a-420e-b711-07cafa8c60e9] Received event network-changed-4c481745-6342-43f8-9040-3ea1d8c5c572 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:21:41 user nova-compute[71731]: DEBUG nova.compute.manager [req-76c3e22e-6643-4fbb-8798-9b6c381ecdf8 req-1b45d51e-67a3-4fe8-b854-7e6470e98f80 service nova] [instance: 2549ba85-4e0a-420e-b711-07cafa8c60e9] Refreshing instance network info cache due to event network-changed-4c481745-6342-43f8-9040-3ea1d8c5c572. {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 16:21:41 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-76c3e22e-6643-4fbb-8798-9b6c381ecdf8 req-1b45d51e-67a3-4fe8-b854-7e6470e98f80 service nova] Acquiring lock "refresh_cache-2549ba85-4e0a-420e-b711-07cafa8c60e9" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 16:21:41 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-76c3e22e-6643-4fbb-8798-9b6c381ecdf8 req-1b45d51e-67a3-4fe8-b854-7e6470e98f80 service nova] Acquired lock "refresh_cache-2549ba85-4e0a-420e-b711-07cafa8c60e9" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 16:21:41 user nova-compute[71731]: DEBUG nova.network.neutron [req-76c3e22e-6643-4fbb-8798-9b6c381ecdf8 req-1b45d51e-67a3-4fe8-b854-7e6470e98f80 service nova] [instance: 2549ba85-4e0a-420e-b711-07cafa8c60e9] Refreshing network info cache for port 4c481745-6342-43f8-9040-3ea1d8c5c572 {{(pid=71731) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 16:21:41 user nova-compute[71731]: DEBUG nova.network.neutron [req-76c3e22e-6643-4fbb-8798-9b6c381ecdf8 req-1b45d51e-67a3-4fe8-b854-7e6470e98f80 service nova] [instance: 2549ba85-4e0a-420e-b711-07cafa8c60e9] Instance cache missing network info. {{(pid=71731) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 16:21:42 user nova-compute[71731]: DEBUG nova.network.neutron [req-76c3e22e-6643-4fbb-8798-9b6c381ecdf8 req-1b45d51e-67a3-4fe8-b854-7e6470e98f80 service nova] [instance: 2549ba85-4e0a-420e-b711-07cafa8c60e9] Updating instance_info_cache with network_info: [] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:21:42 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-76c3e22e-6643-4fbb-8798-9b6c381ecdf8 req-1b45d51e-67a3-4fe8-b854-7e6470e98f80 service nova] Releasing lock "refresh_cache-2549ba85-4e0a-420e-b711-07cafa8c60e9" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 16:21:42 user nova-compute[71731]: DEBUG nova.network.neutron [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] [instance: e4ada2d7-7ace-4ed4-86a6-ed121c95e80f] Successfully updated port: 2430beb8-b2e4-4493-bdc5-df6b4c1181c6 {{(pid=71731) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 16:21:42 user nova-compute[71731]: DEBUG nova.network.neutron [None req-ce4cfc33-fa3f-4959-a2b8-ca3f91801c9b tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] [instance: bf350da4-9cc2-4900-adf0-506e44984b42] Successfully updated port: 1a737bae-3b9b-43b4-8a89-0eb98fdf2ec8 {{(pid=71731) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 16:21:42 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-ce4cfc33-fa3f-4959-a2b8-ca3f91801c9b tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Acquiring lock "refresh_cache-bf350da4-9cc2-4900-adf0-506e44984b42" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 16:21:42 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-ce4cfc33-fa3f-4959-a2b8-ca3f91801c9b tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Acquired lock "refresh_cache-bf350da4-9cc2-4900-adf0-506e44984b42" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 16:21:42 user nova-compute[71731]: DEBUG nova.network.neutron [None req-ce4cfc33-fa3f-4959-a2b8-ca3f91801c9b tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] [instance: bf350da4-9cc2-4900-adf0-506e44984b42] Building network info cache for instance {{(pid=71731) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 16:21:42 user nova-compute[71731]: DEBUG nova.compute.manager [req-8c795c30-781f-4113-bc64-e29f6c4541a8 req-5e35de7f-c3c6-4b1e-86be-76214a94c803 service nova] [instance: bf350da4-9cc2-4900-adf0-506e44984b42] Received event network-changed-1a737bae-3b9b-43b4-8a89-0eb98fdf2ec8 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:21:42 user nova-compute[71731]: DEBUG nova.compute.manager [req-8c795c30-781f-4113-bc64-e29f6c4541a8 req-5e35de7f-c3c6-4b1e-86be-76214a94c803 service nova] [instance: bf350da4-9cc2-4900-adf0-506e44984b42] Refreshing instance network info cache due to event network-changed-1a737bae-3b9b-43b4-8a89-0eb98fdf2ec8. {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 16:21:42 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-8c795c30-781f-4113-bc64-e29f6c4541a8 req-5e35de7f-c3c6-4b1e-86be-76214a94c803 service nova] Acquiring lock "refresh_cache-bf350da4-9cc2-4900-adf0-506e44984b42" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 16:21:42 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:21:42 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:21:42 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:21:42 user nova-compute[71731]: DEBUG nova.network.neutron [None req-ce4cfc33-fa3f-4959-a2b8-ca3f91801c9b tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] [instance: bf350da4-9cc2-4900-adf0-506e44984b42] Instance cache missing network info. {{(pid=71731) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 16:21:42 user nova-compute[71731]: DEBUG nova.compute.manager [req-2dab2a41-f572-49de-8027-174040823084 req-88aa59ca-9c30-4fc7-91f4-a39c3edd709d service nova] [instance: 031c7939-a53c-4f7d-9f36-4ec1d06e2717] Received event network-vif-plugged-a99b01f1-3495-45d6-a802-a1f740719c17 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:21:42 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-2dab2a41-f572-49de-8027-174040823084 req-88aa59ca-9c30-4fc7-91f4-a39c3edd709d service nova] Acquiring lock "031c7939-a53c-4f7d-9f36-4ec1d06e2717-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:21:42 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-2dab2a41-f572-49de-8027-174040823084 req-88aa59ca-9c30-4fc7-91f4-a39c3edd709d service nova] Lock "031c7939-a53c-4f7d-9f36-4ec1d06e2717-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:21:42 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-2dab2a41-f572-49de-8027-174040823084 req-88aa59ca-9c30-4fc7-91f4-a39c3edd709d service nova] Lock "031c7939-a53c-4f7d-9f36-4ec1d06e2717-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:21:42 user nova-compute[71731]: DEBUG nova.compute.manager [req-2dab2a41-f572-49de-8027-174040823084 req-88aa59ca-9c30-4fc7-91f4-a39c3edd709d service nova] [instance: 031c7939-a53c-4f7d-9f36-4ec1d06e2717] No waiting events found dispatching network-vif-plugged-a99b01f1-3495-45d6-a802-a1f740719c17 {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:21:42 user nova-compute[71731]: WARNING nova.compute.manager [req-2dab2a41-f572-49de-8027-174040823084 req-88aa59ca-9c30-4fc7-91f4-a39c3edd709d service nova] [instance: 031c7939-a53c-4f7d-9f36-4ec1d06e2717] Received unexpected event network-vif-plugged-a99b01f1-3495-45d6-a802-a1f740719c17 for instance with vm_state building and task_state spawning.
Apr 13 16:21:42 user nova-compute[71731]: DEBUG nova.compute.manager [req-a5b1854c-604a-4a79-bfac-24e859f8cab2 req-642034bd-b591-4f4d-967d-05dfbf846282 service nova] [instance: e4ada2d7-7ace-4ed4-86a6-ed121c95e80f] Received event network-changed-8f3a3011-e474-4538-812b-9df3968fd629 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:21:42 user nova-compute[71731]: DEBUG nova.compute.manager [req-a5b1854c-604a-4a79-bfac-24e859f8cab2 req-642034bd-b591-4f4d-967d-05dfbf846282 service nova] [instance: e4ada2d7-7ace-4ed4-86a6-ed121c95e80f] Refreshing instance network info cache due to event network-changed-8f3a3011-e474-4538-812b-9df3968fd629. {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 16:21:42 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-a5b1854c-604a-4a79-bfac-24e859f8cab2 req-642034bd-b591-4f4d-967d-05dfbf846282 service nova] Acquiring lock "refresh_cache-e4ada2d7-7ace-4ed4-86a6-ed121c95e80f" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 16:21:42 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-a5b1854c-604a-4a79-bfac-24e859f8cab2 req-642034bd-b591-4f4d-967d-05dfbf846282 service nova] Acquired lock "refresh_cache-e4ada2d7-7ace-4ed4-86a6-ed121c95e80f" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 16:21:42 user nova-compute[71731]: DEBUG nova.network.neutron [req-a5b1854c-604a-4a79-bfac-24e859f8cab2 req-642034bd-b591-4f4d-967d-05dfbf846282 service nova] [instance: e4ada2d7-7ace-4ed4-86a6-ed121c95e80f] Refreshing network info cache for port 8f3a3011-e474-4538-812b-9df3968fd629 {{(pid=71731) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 16:21:43 user nova-compute[71731]: DEBUG nova.network.neutron [req-a5b1854c-604a-4a79-bfac-24e859f8cab2 req-642034bd-b591-4f4d-967d-05dfbf846282 service nova] [instance: e4ada2d7-7ace-4ed4-86a6-ed121c95e80f] Instance cache missing network info. {{(pid=71731) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 16:21:43 user nova-compute[71731]: DEBUG nova.network.neutron [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] [instance: 2549ba85-4e0a-420e-b711-07cafa8c60e9] Successfully updated port: 3730ed6e-b093-4232-800b-b064d650e9e8 {{(pid=71731) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 16:21:43 user nova-compute[71731]: DEBUG nova.network.neutron [req-a5b1854c-604a-4a79-bfac-24e859f8cab2 req-642034bd-b591-4f4d-967d-05dfbf846282 service nova] [instance: e4ada2d7-7ace-4ed4-86a6-ed121c95e80f] Updating instance_info_cache with network_info: [] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:21:43 user nova-compute[71731]: DEBUG nova.network.neutron [None req-ce4cfc33-fa3f-4959-a2b8-ca3f91801c9b tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] [instance: bf350da4-9cc2-4900-adf0-506e44984b42] Updating instance_info_cache with network_info: [{"id": "1a737bae-3b9b-43b4-8a89-0eb98fdf2ec8", "address": "fa:16:3e:18:7d:11", "network": {"id": "c06f107f-4fa0-46dc-8766-3c882c401851", "bridge": "br-int", "label": "tempest-TestShelveInstance-1490339676-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed94fa5d89c2486b8e2951e608e6630f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a737bae-3b", "ovs_interfaceid": "1a737bae-3b9b-43b4-8a89-0eb98fdf2ec8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:21:43 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-a5b1854c-604a-4a79-bfac-24e859f8cab2 req-642034bd-b591-4f4d-967d-05dfbf846282 service nova] Releasing lock "refresh_cache-e4ada2d7-7ace-4ed4-86a6-ed121c95e80f" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 16:21:43 user nova-compute[71731]: DEBUG nova.compute.manager [req-a5b1854c-604a-4a79-bfac-24e859f8cab2 req-642034bd-b591-4f4d-967d-05dfbf846282 service nova] [instance: 2549ba85-4e0a-420e-b711-07cafa8c60e9] Received event network-changed-0152bbb9-d50d-4e58-8a2b-727c4675ea2f {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:21:43 user nova-compute[71731]: DEBUG nova.compute.manager [req-a5b1854c-604a-4a79-bfac-24e859f8cab2 req-642034bd-b591-4f4d-967d-05dfbf846282 service nova] [instance: 2549ba85-4e0a-420e-b711-07cafa8c60e9] Refreshing instance network info cache due to event network-changed-0152bbb9-d50d-4e58-8a2b-727c4675ea2f. {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 16:21:43 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-a5b1854c-604a-4a79-bfac-24e859f8cab2 req-642034bd-b591-4f4d-967d-05dfbf846282 service nova] Acquiring lock "refresh_cache-2549ba85-4e0a-420e-b711-07cafa8c60e9" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 16:21:43 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-a5b1854c-604a-4a79-bfac-24e859f8cab2 req-642034bd-b591-4f4d-967d-05dfbf846282 service nova] Acquired lock "refresh_cache-2549ba85-4e0a-420e-b711-07cafa8c60e9" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 16:21:43 user nova-compute[71731]: DEBUG nova.network.neutron [req-a5b1854c-604a-4a79-bfac-24e859f8cab2 req-642034bd-b591-4f4d-967d-05dfbf846282 service nova] [instance: 2549ba85-4e0a-420e-b711-07cafa8c60e9] Refreshing network info cache for port 0152bbb9-d50d-4e58-8a2b-727c4675ea2f {{(pid=71731) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 16:21:43 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-ce4cfc33-fa3f-4959-a2b8-ca3f91801c9b tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Releasing lock "refresh_cache-bf350da4-9cc2-4900-adf0-506e44984b42" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 16:21:43 user nova-compute[71731]: DEBUG nova.compute.manager [None req-ce4cfc33-fa3f-4959-a2b8-ca3f91801c9b tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] [instance: bf350da4-9cc2-4900-adf0-506e44984b42] Instance network_info: |[{"id": "1a737bae-3b9b-43b4-8a89-0eb98fdf2ec8", "address": "fa:16:3e:18:7d:11", "network": {"id": "c06f107f-4fa0-46dc-8766-3c882c401851", "bridge": "br-int", "label": "tempest-TestShelveInstance-1490339676-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed94fa5d89c2486b8e2951e608e6630f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a737bae-3b", "ovs_interfaceid": "1a737bae-3b9b-43b4-8a89-0eb98fdf2ec8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71731) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 16:21:43 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-8c795c30-781f-4113-bc64-e29f6c4541a8 req-5e35de7f-c3c6-4b1e-86be-76214a94c803 service nova] Acquired lock "refresh_cache-bf350da4-9cc2-4900-adf0-506e44984b42" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 16:21:43 user nova-compute[71731]: DEBUG nova.network.neutron [req-8c795c30-781f-4113-bc64-e29f6c4541a8 req-5e35de7f-c3c6-4b1e-86be-76214a94c803 service nova] [instance: bf350da4-9cc2-4900-adf0-506e44984b42] Refreshing network info cache for port 1a737bae-3b9b-43b4-8a89-0eb98fdf2ec8 {{(pid=71731) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 16:21:43 user nova-compute[71731]: DEBUG nova.network.neutron [req-a5b1854c-604a-4a79-bfac-24e859f8cab2 req-642034bd-b591-4f4d-967d-05dfbf846282 service nova] [instance: 2549ba85-4e0a-420e-b711-07cafa8c60e9] Instance cache missing network info. {{(pid=71731) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 16:21:43 user nova-compute[71731]: DEBUG nova.network.neutron [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] [instance: e4ada2d7-7ace-4ed4-86a6-ed121c95e80f] Successfully updated port: 15dca2c3-5048-4e80-8008-c19400ea34e4 {{(pid=71731) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 16:21:44 user nova-compute[71731]: DEBUG nova.network.neutron [req-a5b1854c-604a-4a79-bfac-24e859f8cab2 req-642034bd-b591-4f4d-967d-05dfbf846282 service nova] [instance: 2549ba85-4e0a-420e-b711-07cafa8c60e9] Updating instance_info_cache with network_info: [] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:21:44 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-a5b1854c-604a-4a79-bfac-24e859f8cab2 req-642034bd-b591-4f4d-967d-05dfbf846282 service nova] Releasing lock "refresh_cache-2549ba85-4e0a-420e-b711-07cafa8c60e9" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 16:21:44 user nova-compute[71731]: DEBUG nova.compute.manager [req-a5b1854c-604a-4a79-bfac-24e859f8cab2 req-642034bd-b591-4f4d-967d-05dfbf846282 service nova] [instance: e4ada2d7-7ace-4ed4-86a6-ed121c95e80f] Received event network-changed-2430beb8-b2e4-4493-bdc5-df6b4c1181c6 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:21:44 user nova-compute[71731]: DEBUG nova.compute.manager [req-a5b1854c-604a-4a79-bfac-24e859f8cab2 req-642034bd-b591-4f4d-967d-05dfbf846282 service nova] [instance: e4ada2d7-7ace-4ed4-86a6-ed121c95e80f] Refreshing instance network info cache due to event network-changed-2430beb8-b2e4-4493-bdc5-df6b4c1181c6. {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 16:21:44 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-a5b1854c-604a-4a79-bfac-24e859f8cab2 req-642034bd-b591-4f4d-967d-05dfbf846282 service nova] Acquiring lock "refresh_cache-e4ada2d7-7ace-4ed4-86a6-ed121c95e80f" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 16:21:44 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-a5b1854c-604a-4a79-bfac-24e859f8cab2 req-642034bd-b591-4f4d-967d-05dfbf846282 service nova] Acquired lock "refresh_cache-e4ada2d7-7ace-4ed4-86a6-ed121c95e80f" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 16:21:44 user nova-compute[71731]: DEBUG nova.network.neutron [req-a5b1854c-604a-4a79-bfac-24e859f8cab2 req-642034bd-b591-4f4d-967d-05dfbf846282 service nova] [instance: e4ada2d7-7ace-4ed4-86a6-ed121c95e80f] Refreshing network info cache for port 2430beb8-b2e4-4493-bdc5-df6b4c1181c6 {{(pid=71731) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 16:21:44 user nova-compute[71731]: DEBUG nova.network.neutron [req-a5b1854c-604a-4a79-bfac-24e859f8cab2 req-642034bd-b591-4f4d-967d-05dfbf846282 service nova] [instance: e4ada2d7-7ace-4ed4-86a6-ed121c95e80f] Instance cache missing network info. {{(pid=71731) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 16:21:44 user nova-compute[71731]: DEBUG nova.compute.manager [None req-ce4cfc33-fa3f-4959-a2b8-ca3f91801c9b tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] [instance: bf350da4-9cc2-4900-adf0-506e44984b42] Start spawning the instance on the hypervisor. {{(pid=71731) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 16:21:44 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-ce4cfc33-fa3f-4959-a2b8-ca3f91801c9b tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] [instance: bf350da4-9cc2-4900-adf0-506e44984b42] Creating instance directory {{(pid=71731) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 16:21:44 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-ce4cfc33-fa3f-4959-a2b8-ca3f91801c9b tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] [instance: bf350da4-9cc2-4900-adf0-506e44984b42] Creating image(s)
Apr 13 16:21:44 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-ce4cfc33-fa3f-4959-a2b8-ca3f91801c9b tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] [instance: bf350da4-9cc2-4900-adf0-506e44984b42] Did not create local disks {{(pid=71731) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 13 16:21:44 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-ce4cfc33-fa3f-4959-a2b8-ca3f91801c9b tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] [instance: bf350da4-9cc2-4900-adf0-506e44984b42] Ensure instance console log exists: /opt/stack/data/nova/instances/bf350da4-9cc2-4900-adf0-506e44984b42/console.log {{(pid=71731) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 16:21:44 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-ce4cfc33-fa3f-4959-a2b8-ca3f91801c9b tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:21:44 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-ce4cfc33-fa3f-4959-a2b8-ca3f91801c9b tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:21:44 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-ce4cfc33-fa3f-4959-a2b8-ca3f91801c9b tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:21:44 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-ce4cfc33-fa3f-4959-a2b8-ca3f91801c9b tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] [instance: bf350da4-9cc2-4900-adf0-506e44984b42] Start _get_guest_xml network_info=[{"id": "1a737bae-3b9b-43b4-8a89-0eb98fdf2ec8", "address": "fa:16:3e:18:7d:11", "network": {"id": "c06f107f-4fa0-46dc-8766-3c882c401851", "bridge": "br-int", "label": "tempest-TestShelveInstance-1490339676-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed94fa5d89c2486b8e2951e608e6630f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a737bae-3b", "ovs_interfaceid": "1a737bae-3b9b-43b4-8a89-0eb98fdf2ec8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'attachment_id': 'e626ea75-be62-4b0f-a34e-85bfc884704f', 'mount_device': '/dev/vda', 'delete_on_termination': True, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KoxklySD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'bf350da4-9cc2-4900-adf0-506e44984b42', 'attached_at': '', 'detached_at': '', 'volume_id': '1ac31388-2626-48e4-a711-54683ef66984', 'serial': '1ac31388-2626-48e4-a711-54683ef66984'}, 'disk_bus': 'virtio', 'guest_format': None, 'volume_type': None} {{(pid=71731) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 16:21:44 user nova-compute[71731]: WARNING nova.virt.libvirt.driver [None req-ce4cfc33-fa3f-4959-a2b8-ca3f91801c9b tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 16:21:44 user nova-compute[71731]: WARNING nova.virt.libvirt.driver [None req-ce4cfc33-fa3f-4959-a2b8-ca3f91801c9b tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 16:21:44 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-ce4cfc33-fa3f-4959-a2b8-ca3f91801c9b tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71731) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 16:21:44 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-ce4cfc33-fa3f-4959-a2b8-ca3f91801c9b tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T16:17:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 16:21:44 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-ce4cfc33-fa3f-4959-a2b8-ca3f91801c9b tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Flavor limits 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 16:21:44 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-ce4cfc33-fa3f-4959-a2b8-ca3f91801c9b tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Image limits 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 16:21:44 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-ce4cfc33-fa3f-4959-a2b8-ca3f91801c9b tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Flavor pref 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 16:21:44 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-ce4cfc33-fa3f-4959-a2b8-ca3f91801c9b tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Image pref 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 16:21:44 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-ce4cfc33-fa3f-4959-a2b8-ca3f91801c9b tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 16:21:44 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-ce4cfc33-fa3f-4959-a2b8-ca3f91801c9b tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 16:21:44 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-ce4cfc33-fa3f-4959-a2b8-ca3f91801c9b tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71731) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 16:21:44 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-ce4cfc33-fa3f-4959-a2b8-ca3f91801c9b tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Got 1 possible topologies {{(pid=71731) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 16:21:44 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-ce4cfc33-fa3f-4959-a2b8-ca3f91801c9b tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 16:21:44 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-ce4cfc33-fa3f-4959-a2b8-ca3f91801c9b tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 16:21:44 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-ce4cfc33-fa3f-4959-a2b8-ca3f91801c9b tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:21:44 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-ce4cfc33-fa3f-4959-a2b8-ca3f91801c9b tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:21:44 user nova-compute[71731]: DEBUG os_brick.initiator.connector [None req-ce4cfc33-fa3f-4959-a2b8-ca3f91801c9b tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Factory for ISCSI on None {{(pid=71731) factory /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connector.py:281}}
Apr 13 16:21:44 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-ce4cfc33-fa3f-4959-a2b8-ca3f91801c9b tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.005s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:21:44 user nova-compute[71731]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ce4cfc33-fa3f-4959-a2b8-ca3f91801c9b tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] [instance: bf350da4-9cc2-4900-adf0-506e44984b42] Calling os-brick to attach iSCSI Volume {{(pid=71731) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 16:21:44 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce4cfc33-fa3f-4959-a2b8-ca3f91801c9b tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8cf0118790>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KoxklySD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 16:21:44 user nova-compute[71731]: WARNING os_brick.initiator.connectors.base [None req-ce4cfc33-fa3f-4959-a2b8-ca3f91801c9b tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 16:21:44 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-ce4cfc33-fa3f-4959-a2b8-ca3f91801c9b tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 16:21:44 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-ce4cfc33-fa3f-4959-a2b8-ca3f91801c9b tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 16:21:44 user nova-compute[71731]: WARNING os_brick.initiator.connectors.base [None req-ce4cfc33-fa3f-4959-a2b8-ca3f91801c9b tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 16:21:44 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-ce4cfc33-fa3f-4959-a2b8-ca3f91801c9b tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 16:21:44 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-ce4cfc33-fa3f-4959-a2b8-ca3f91801c9b tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 16:21:44 user nova-compute[71731]: INFO os_brick.initiator.connectors.iscsi [None req-ce4cfc33-fa3f-4959-a2b8-ca3f91801c9b tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 16:21:44 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984 -p 172.16.0.220:3260 {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:21:44 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:21:44 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[245b556c-843d-4db3-bc66-34289fe44a3d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:21:44 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce4cfc33-fa3f-4959-a2b8-ca3f91801c9b tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 16:21:44 user nova-compute[71731]:  {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:21:44 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984 -p 172.16.0.220:3260 --interface default --op new {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:21:44 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.030s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:21:44 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cf4a07d-3c01-4d99-a7c9-3a795e70968c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984] added\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:21:44 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce4cfc33-fa3f-4959-a2b8-ca3f91801c9b tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984] added
Apr 13 16:21:44 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:21:44 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:21:44 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:21:44 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[97c94c0b-6a60-485a-a9d9-10f82e710173]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:21:44 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce4cfc33-fa3f-4959-a2b8-ca3f91801c9b tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:21:44 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:21:44 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:21:44 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[376a5428-7375-4dc4-b3d3-c090cd17cca2]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:21:44 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce4cfc33-fa3f-4959-a2b8-ca3f91801c9b tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:21:44 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KoxklySD {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:21:44 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KoxklySD" returned: 0 in 0.021s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:21:44 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[e47a2bf5-967b-48e3-82de-f8889f8b0dc7]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:21:44 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce4cfc33-fa3f-4959-a2b8-ca3f91801c9b tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KoxklySD'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:21:44 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:21:44 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:21:44 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[5175936b-fe94-47bd-a96c-a596917c7e04]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:21:44 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce4cfc33-fa3f-4959-a2b8-ca3f91801c9b tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:21:44 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:21:44 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.020s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:21:44 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[0989d2e3-d5c7-4589-95e6-7d1a91fb378f]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:21:44 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce4cfc33-fa3f-4959-a2b8-ca3f91801c9b tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Apr 13 16:21:44 user nova-compute[71731]:  {{(pid=71731) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 16:21:44 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce4cfc33-fa3f-4959-a2b8-ca3f91801c9b tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Apr 13 16:21:44 user nova-compute[71731]:  {{(pid=71731) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 16:21:44 user nova-compute[71731]: WARNING os_brick.initiator.connectors.iscsi [None req-ce4cfc33-fa3f-4959-a2b8-ca3f91801c9b tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Apr 13 16:21:44 user nova-compute[71731]: 
Apr 13 16:21:44 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984 -p 172.16.0.220:3260 --login {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:21:44 user nova-compute[71731]: DEBUG nova.network.neutron [req-a5b1854c-604a-4a79-bfac-24e859f8cab2 req-642034bd-b591-4f4d-967d-05dfbf846282 service nova] [instance: e4ada2d7-7ace-4ed4-86a6-ed121c95e80f] Updating instance_info_cache with network_info: [] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:21:44 user nova-compute[71731]: DEBUG nova.network.neutron [req-8c795c30-781f-4113-bc64-e29f6c4541a8 req-5e35de7f-c3c6-4b1e-86be-76214a94c803 service nova] [instance: bf350da4-9cc2-4900-adf0-506e44984b42] Updated VIF entry in instance network info cache for port 1a737bae-3b9b-43b4-8a89-0eb98fdf2ec8. {{(pid=71731) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 16:21:44 user nova-compute[71731]: DEBUG nova.network.neutron [req-8c795c30-781f-4113-bc64-e29f6c4541a8 req-5e35de7f-c3c6-4b1e-86be-76214a94c803 service nova] [instance: bf350da4-9cc2-4900-adf0-506e44984b42] Updating instance_info_cache with network_info: [{"id": "1a737bae-3b9b-43b4-8a89-0eb98fdf2ec8", "address": "fa:16:3e:18:7d:11", "network": {"id": "c06f107f-4fa0-46dc-8766-3c882c401851", "bridge": "br-int", "label": "tempest-TestShelveInstance-1490339676-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed94fa5d89c2486b8e2951e608e6630f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a737bae-3b", "ovs_interfaceid": "1a737bae-3b9b-43b4-8a89-0eb98fdf2ec8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:21:44 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-a5b1854c-604a-4a79-bfac-24e859f8cab2 req-642034bd-b591-4f4d-967d-05dfbf846282 service nova] Releasing lock "refresh_cache-e4ada2d7-7ace-4ed4-86a6-ed121c95e80f" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 16:21:44 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-8c795c30-781f-4113-bc64-e29f6c4541a8 req-5e35de7f-c3c6-4b1e-86be-76214a94c803 service nova] Releasing lock "refresh_cache-bf350da4-9cc2-4900-adf0-506e44984b42" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 16:21:44 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984 -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:21:44 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a4aa7bf-2845-449b-9239-01f463de6a47]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:21:44 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce4cfc33-fa3f-4959-a2b8-ca3f91801c9b tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984, portal: 172.16.0.220,3260]
Apr 13 16:21:44 user nova-compute[71731]: Login to [iface: default, target: iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984, portal: 172.16.0.220,3260] successful.
Apr 13 16:21:44 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:21:44 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:21:44 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:21:44 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[95f3b12e-442d-4736-b2b4-9ff65473d458]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:21:44 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce4cfc33-fa3f-4959-a2b8-ca3f91801c9b tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:21:44 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:21:44 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:21:44 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[eea2ed39-ae77-4095-a5c7-864f71ee7b58]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984 (non-flash)\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:21:44 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce4cfc33-fa3f-4959-a2b8-ca3f91801c9b tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984 (non-flash)
Apr 13 16:21:44 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 16:21:44 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce4cfc33-fa3f-4959-a2b8-ca3f91801c9b tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984 (non-flash)
Apr 13 16:21:44 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 16:21:44 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-ce4cfc33-fa3f-4959-a2b8-ca3f91801c9b tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.309s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 16:21:44 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce4cfc33-fa3f-4959-a2b8-ca3f91801c9b tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Connected to 172.16.0.220:3260 {{(pid=71731) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 16:21:44 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-ce4cfc33-fa3f-4959-a2b8-ca3f91801c9b tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=71731) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 16:21:44 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-ce4cfc33-fa3f-4959-a2b8-ca3f91801c9b tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71731) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 16:21:44 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:21:44 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:21:44 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c93fefe-f0c1-4a9e-bd35-658f2acc9065]: (4, ('- - 0', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:21:44 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-ce4cfc33-fa3f-4959-a2b8-ca3f91801c9b tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71731) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 16:21:44 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce4cfc33-fa3f-4959-a2b8-ca3f91801c9b tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KoxklySD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71731) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 16:21:44 user nova-compute[71731]: DEBUG nova.compute.manager [req-15377a1a-ef2d-44ab-8221-a8ba3a8ea11f req-52374293-4314-4e2d-aec3-7b229d8de8b2 service nova] [instance: 031c7939-a53c-4f7d-9f36-4ec1d06e2717] Received event network-vif-plugged-a99b01f1-3495-45d6-a802-a1f740719c17 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:21:44 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-15377a1a-ef2d-44ab-8221-a8ba3a8ea11f req-52374293-4314-4e2d-aec3-7b229d8de8b2 service nova] Acquiring lock "031c7939-a53c-4f7d-9f36-4ec1d06e2717-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:21:44 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-15377a1a-ef2d-44ab-8221-a8ba3a8ea11f req-52374293-4314-4e2d-aec3-7b229d8de8b2 service nova] Lock "031c7939-a53c-4f7d-9f36-4ec1d06e2717-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:21:44 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-15377a1a-ef2d-44ab-8221-a8ba3a8ea11f req-52374293-4314-4e2d-aec3-7b229d8de8b2 service nova] Lock "031c7939-a53c-4f7d-9f36-4ec1d06e2717-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:21:44 user nova-compute[71731]: DEBUG nova.compute.manager [req-15377a1a-ef2d-44ab-8221-a8ba3a8ea11f req-52374293-4314-4e2d-aec3-7b229d8de8b2 service nova] [instance: 031c7939-a53c-4f7d-9f36-4ec1d06e2717] No waiting events found dispatching network-vif-plugged-a99b01f1-3495-45d6-a802-a1f740719c17 {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:21:44 user nova-compute[71731]: WARNING nova.compute.manager [req-15377a1a-ef2d-44ab-8221-a8ba3a8ea11f req-52374293-4314-4e2d-aec3-7b229d8de8b2 service nova] [instance: 031c7939-a53c-4f7d-9f36-4ec1d06e2717] Received unexpected event network-vif-plugged-a99b01f1-3495-45d6-a802-a1f740719c17 for instance with vm_state building and task_state spawning.
Apr 13 16:21:44 user nova-compute[71731]: DEBUG nova.network.neutron [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] [instance: 2549ba85-4e0a-420e-b711-07cafa8c60e9] Successfully updated port: 0fbdf291-df5d-41c5-a765-7145a87da272 {{(pid=71731) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 16:21:45 user nova-compute[71731]: DEBUG nova.compute.manager [req-17b181ac-e444-4f1e-9006-30e4c3fa241e req-537233c7-7d9d-4a20-b151-b92b2fc9c926 service nova] [instance: 2549ba85-4e0a-420e-b711-07cafa8c60e9] Received event network-changed-3730ed6e-b093-4232-800b-b064d650e9e8 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:21:45 user nova-compute[71731]: DEBUG nova.compute.manager [req-17b181ac-e444-4f1e-9006-30e4c3fa241e req-537233c7-7d9d-4a20-b151-b92b2fc9c926 service nova] [instance: 2549ba85-4e0a-420e-b711-07cafa8c60e9] Refreshing instance network info cache due to event network-changed-3730ed6e-b093-4232-800b-b064d650e9e8. {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 16:21:45 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-17b181ac-e444-4f1e-9006-30e4c3fa241e req-537233c7-7d9d-4a20-b151-b92b2fc9c926 service nova] Acquiring lock "refresh_cache-2549ba85-4e0a-420e-b711-07cafa8c60e9" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 16:21:45 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-17b181ac-e444-4f1e-9006-30e4c3fa241e req-537233c7-7d9d-4a20-b151-b92b2fc9c926 service nova] Acquired lock "refresh_cache-2549ba85-4e0a-420e-b711-07cafa8c60e9" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 16:21:45 user nova-compute[71731]: DEBUG nova.network.neutron [req-17b181ac-e444-4f1e-9006-30e4c3fa241e req-537233c7-7d9d-4a20-b151-b92b2fc9c926 service nova] [instance: 2549ba85-4e0a-420e-b711-07cafa8c60e9] Refreshing network info cache for port 3730ed6e-b093-4232-800b-b064d650e9e8 {{(pid=71731) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 16:21:45 user nova-compute[71731]: DEBUG nova.virt.driver [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Emitting event <LifecycleEvent: 1681402905.082273, 031c7939-a53c-4f7d-9f36-4ec1d06e2717 => Resumed> {{(pid=71731) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 16:21:45 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 031c7939-a53c-4f7d-9f36-4ec1d06e2717] VM Resumed (Lifecycle Event)
Apr 13 16:21:45 user nova-compute[71731]: DEBUG nova.network.neutron [req-17b181ac-e444-4f1e-9006-30e4c3fa241e req-537233c7-7d9d-4a20-b151-b92b2fc9c926 service nova] [instance: 2549ba85-4e0a-420e-b711-07cafa8c60e9] Instance cache missing network info. {{(pid=71731) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 16:21:45 user nova-compute[71731]: DEBUG nova.compute.manager [None req-9ee02ae8-a4e6-4a99-abe2-322a33b7990b tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] [instance: 031c7939-a53c-4f7d-9f36-4ec1d06e2717] Instance event wait completed in 0 seconds for  {{(pid=71731) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 16:21:45 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-9ee02ae8-a4e6-4a99-abe2-322a33b7990b tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] [instance: 031c7939-a53c-4f7d-9f36-4ec1d06e2717] Guest created on hypervisor {{(pid=71731) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 16:21:45 user nova-compute[71731]: INFO nova.virt.libvirt.driver [-] [instance: 031c7939-a53c-4f7d-9f36-4ec1d06e2717] Instance spawned successfully.
Apr 13 16:21:45 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-9ee02ae8-a4e6-4a99-abe2-322a33b7990b tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] [instance: 031c7939-a53c-4f7d-9f36-4ec1d06e2717] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 16:21:45 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 031c7939-a53c-4f7d-9f36-4ec1d06e2717] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:21:45 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-9ee02ae8-a4e6-4a99-abe2-322a33b7990b tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] [instance: 031c7939-a53c-4f7d-9f36-4ec1d06e2717] Found default for hw_cdrom_bus of ide {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:21:45 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-9ee02ae8-a4e6-4a99-abe2-322a33b7990b tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] [instance: 031c7939-a53c-4f7d-9f36-4ec1d06e2717] Found default for hw_disk_bus of virtio {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:21:45 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-9ee02ae8-a4e6-4a99-abe2-322a33b7990b tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] [instance: 031c7939-a53c-4f7d-9f36-4ec1d06e2717] Found default for hw_input_bus of None {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:21:45 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-9ee02ae8-a4e6-4a99-abe2-322a33b7990b tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] [instance: 031c7939-a53c-4f7d-9f36-4ec1d06e2717] Found default for hw_pointer_model of None {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:21:45 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-9ee02ae8-a4e6-4a99-abe2-322a33b7990b tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] [instance: 031c7939-a53c-4f7d-9f36-4ec1d06e2717] Found default for hw_video_model of virtio {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:21:45 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-9ee02ae8-a4e6-4a99-abe2-322a33b7990b tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] [instance: 031c7939-a53c-4f7d-9f36-4ec1d06e2717] Found default for hw_vif_model of virtio {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:21:45 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 031c7939-a53c-4f7d-9f36-4ec1d06e2717] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71731) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 16:21:45 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 031c7939-a53c-4f7d-9f36-4ec1d06e2717] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 16:21:45 user nova-compute[71731]: DEBUG nova.virt.driver [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Emitting event <LifecycleEvent: 1681402905.0848773, 031c7939-a53c-4f7d-9f36-4ec1d06e2717 => Started> {{(pid=71731) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 16:21:45 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 031c7939-a53c-4f7d-9f36-4ec1d06e2717] VM Started (Lifecycle Event)
Apr 13 16:21:45 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 031c7939-a53c-4f7d-9f36-4ec1d06e2717] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:21:45 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 031c7939-a53c-4f7d-9f36-4ec1d06e2717] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71731) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 16:21:45 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 031c7939-a53c-4f7d-9f36-4ec1d06e2717] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 16:21:45 user nova-compute[71731]: INFO nova.compute.manager [None req-9ee02ae8-a4e6-4a99-abe2-322a33b7990b tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] [instance: 031c7939-a53c-4f7d-9f36-4ec1d06e2717] Took 8.27 seconds to spawn the instance on the hypervisor.
Apr 13 16:21:45 user nova-compute[71731]: DEBUG nova.compute.manager [None req-9ee02ae8-a4e6-4a99-abe2-322a33b7990b tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] [instance: 031c7939-a53c-4f7d-9f36-4ec1d06e2717] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:21:45 user nova-compute[71731]: DEBUG nova.compute.manager [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] [instance: 2549ba85-4e0a-420e-b711-07cafa8c60e9] Start spawning the instance on the hypervisor. {{(pid=71731) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 16:21:45 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] [instance: 2549ba85-4e0a-420e-b711-07cafa8c60e9] Creating instance directory {{(pid=71731) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 16:21:45 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] [instance: 2549ba85-4e0a-420e-b711-07cafa8c60e9] Creating image(s)
Apr 13 16:21:45 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] [instance: 2549ba85-4e0a-420e-b711-07cafa8c60e9] Did not create local disks {{(pid=71731) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 13 16:21:45 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] [instance: 2549ba85-4e0a-420e-b711-07cafa8c60e9] Ensure instance console log exists: /opt/stack/data/nova/instances/2549ba85-4e0a-420e-b711-07cafa8c60e9/console.log {{(pid=71731) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 16:21:45 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:21:45 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:21:45 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:21:45 user nova-compute[71731]: INFO nova.compute.manager [None req-9ee02ae8-a4e6-4a99-abe2-322a33b7990b tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] [instance: 031c7939-a53c-4f7d-9f36-4ec1d06e2717] Took 9.24 seconds to build instance.
Apr 13 16:21:45 user nova-compute[71731]: DEBUG nova.network.neutron [req-17b181ac-e444-4f1e-9006-30e4c3fa241e req-537233c7-7d9d-4a20-b151-b92b2fc9c926 service nova] [instance: 2549ba85-4e0a-420e-b711-07cafa8c60e9] Updating instance_info_cache with network_info: [] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:21:45 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-9ee02ae8-a4e6-4a99-abe2-322a33b7990b tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Lock "031c7939-a53c-4f7d-9f36-4ec1d06e2717" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.377s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:21:45 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-17b181ac-e444-4f1e-9006-30e4c3fa241e req-537233c7-7d9d-4a20-b151-b92b2fc9c926 service nova] Releasing lock "refresh_cache-2549ba85-4e0a-420e-b711-07cafa8c60e9" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 16:21:45 user nova-compute[71731]: DEBUG nova.compute.manager [req-17b181ac-e444-4f1e-9006-30e4c3fa241e req-537233c7-7d9d-4a20-b151-b92b2fc9c926 service nova] [instance: e4ada2d7-7ace-4ed4-86a6-ed121c95e80f] Received event network-changed-15dca2c3-5048-4e80-8008-c19400ea34e4 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:21:45 user nova-compute[71731]: DEBUG nova.compute.manager [req-17b181ac-e444-4f1e-9006-30e4c3fa241e req-537233c7-7d9d-4a20-b151-b92b2fc9c926 service nova] [instance: e4ada2d7-7ace-4ed4-86a6-ed121c95e80f] Refreshing instance network info cache due to event network-changed-15dca2c3-5048-4e80-8008-c19400ea34e4. {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 16:21:45 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-17b181ac-e444-4f1e-9006-30e4c3fa241e req-537233c7-7d9d-4a20-b151-b92b2fc9c926 service nova] Acquiring lock "refresh_cache-e4ada2d7-7ace-4ed4-86a6-ed121c95e80f" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 16:21:45 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-17b181ac-e444-4f1e-9006-30e4c3fa241e req-537233c7-7d9d-4a20-b151-b92b2fc9c926 service nova] Acquired lock "refresh_cache-e4ada2d7-7ace-4ed4-86a6-ed121c95e80f" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 16:21:45 user nova-compute[71731]: DEBUG nova.network.neutron [req-17b181ac-e444-4f1e-9006-30e4c3fa241e req-537233c7-7d9d-4a20-b151-b92b2fc9c926 service nova] [instance: e4ada2d7-7ace-4ed4-86a6-ed121c95e80f] Refreshing network info cache for port 15dca2c3-5048-4e80-8008-c19400ea34e4 {{(pid=71731) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 16:21:45 user nova-compute[71731]: DEBUG nova.network.neutron [req-17b181ac-e444-4f1e-9006-30e4c3fa241e req-537233c7-7d9d-4a20-b151-b92b2fc9c926 service nova] [instance: e4ada2d7-7ace-4ed4-86a6-ed121c95e80f] Instance cache missing network info. {{(pid=71731) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 16:21:45 user nova-compute[71731]: DEBUG nova.network.neutron [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] [instance: e4ada2d7-7ace-4ed4-86a6-ed121c95e80f] Successfully updated port: d41765b6-0d5b-43c1-bf58-a82a7bbe3137 {{(pid=71731) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 16:21:45 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Acquiring lock "refresh_cache-e4ada2d7-7ace-4ed4-86a6-ed121c95e80f" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 16:21:45 user nova-compute[71731]: DEBUG nova.compute.manager [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] [instance: e4ada2d7-7ace-4ed4-86a6-ed121c95e80f] Start spawning the instance on the hypervisor. {{(pid=71731) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 16:21:45 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] [instance: e4ada2d7-7ace-4ed4-86a6-ed121c95e80f] Creating instance directory {{(pid=71731) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 16:21:45 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] [instance: e4ada2d7-7ace-4ed4-86a6-ed121c95e80f] Creating image(s)
Apr 13 16:21:45 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] [instance: e4ada2d7-7ace-4ed4-86a6-ed121c95e80f] Did not create local disks {{(pid=71731) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 13 16:21:45 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] [instance: e4ada2d7-7ace-4ed4-86a6-ed121c95e80f] Ensure instance console log exists: /opt/stack/data/nova/instances/e4ada2d7-7ace-4ed4-86a6-ed121c95e80f/console.log {{(pid=71731) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 16:21:45 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:21:45 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:21:45 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:21:45 user nova-compute[71731]: DEBUG nova.network.neutron [req-17b181ac-e444-4f1e-9006-30e4c3fa241e req-537233c7-7d9d-4a20-b151-b92b2fc9c926 service nova] [instance: e4ada2d7-7ace-4ed4-86a6-ed121c95e80f] Updating instance_info_cache with network_info: [] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:21:45 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-17b181ac-e444-4f1e-9006-30e4c3fa241e req-537233c7-7d9d-4a20-b151-b92b2fc9c926 service nova] Releasing lock "refresh_cache-e4ada2d7-7ace-4ed4-86a6-ed121c95e80f" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 16:21:45 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Acquired lock "refresh_cache-e4ada2d7-7ace-4ed4-86a6-ed121c95e80f" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 16:21:45 user nova-compute[71731]: DEBUG nova.network.neutron [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] [instance: e4ada2d7-7ace-4ed4-86a6-ed121c95e80f] Building network info cache for instance {{(pid=71731) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 16:21:45 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-ce4cfc33-fa3f-4959-a2b8-ca3f91801c9b tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.354s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 16:21:45 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce4cfc33-fa3f-4959-a2b8-ca3f91801c9b tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] <== connect_volume: return (1357ms) {'type': 'block', 'scsi_wwn': '23736643634636337', 'path': '/dev/sdb'} {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 16:21:45 user nova-compute[71731]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ce4cfc33-fa3f-4959-a2b8-ca3f91801c9b tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] [instance: bf350da4-9cc2-4900-adf0-506e44984b42] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23736643634636337', 'path': '/dev/sdb'} {{(pid=71731) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 16:21:45 user nova-compute[71731]: DEBUG nova.virt.libvirt.vif [None req-ce4cfc33-fa3f-4959-a2b8-ca3f91801c9b tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T16:21:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1925968525',display_name='tempest-TestShelveInstance-server-1925968525',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1925968525',id=11,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDyAJlgxv64OYVoDx7VUkbgPL/6uJGmronkd0R5CCODRVVo/i2lNlZVafBS/KDfrnkMj0B1mexq0GfoaJ06IYh54z6OmormUG7yLrIuZRcmrCeKwYmEEqzhVcYWIYdAQ0Q==',key_name='tempest-TestShelveInstance-2029240993',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ed94fa5d89c2486b8e2951e608e6630f',ramdisk_id='',reservation_id='r-dy6iwcv2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1159741724',owner_user_name='tempest-TestShelveInstance-1159741724-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T16:21:39Z,user_data=None,user_id='fe6a4bf1a7794af2958c3d53ea1e19c6',uuid=bf350da4-9cc2-4900-adf0-506e44984b42,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1a737bae-3b9b-43b4-8a89-0eb98fdf2ec8", "address": "fa:16:3e:18:7d:11", "network": {"id": "c06f107f-4fa0-46dc-8766-3c882c401851", "bridge": "br-int", "label": "tempest-TestShelveInstance-1490339676-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed94fa5d89c2486b8e2951e608e6630f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a737bae-3b", "ovs_interfaceid": "1a737bae-3b9b-43b4-8a89-0eb98fdf2ec8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71731) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 16:21:45 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-ce4cfc33-fa3f-4959-a2b8-ca3f91801c9b tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Converting VIF {"id": "1a737bae-3b9b-43b4-8a89-0eb98fdf2ec8", "address": "fa:16:3e:18:7d:11", "network": {"id": "c06f107f-4fa0-46dc-8766-3c882c401851", "bridge": "br-int", "label": "tempest-TestShelveInstance-1490339676-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed94fa5d89c2486b8e2951e608e6630f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a737bae-3b", "ovs_interfaceid": "1a737bae-3b9b-43b4-8a89-0eb98fdf2ec8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 16:21:45 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-ce4cfc33-fa3f-4959-a2b8-ca3f91801c9b tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:18:7d:11,bridge_name='br-int',has_traffic_filtering=True,id=1a737bae-3b9b-43b4-8a89-0eb98fdf2ec8,network=Network(c06f107f-4fa0-46dc-8766-3c882c401851),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a737bae-3b') {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 16:21:45 user nova-compute[71731]: DEBUG nova.objects.instance [None req-ce4cfc33-fa3f-4959-a2b8-ca3f91801c9b tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Lazy-loading 'pci_devices' on Instance uuid bf350da4-9cc2-4900-adf0-506e44984b42 {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:21:45 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-ce4cfc33-fa3f-4959-a2b8-ca3f91801c9b tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] [instance: bf350da4-9cc2-4900-adf0-506e44984b42] End _get_guest_xml xml=<domain type="kvm">
Apr 13 16:21:45 user nova-compute[71731]:   <uuid>bf350da4-9cc2-4900-adf0-506e44984b42</uuid>
Apr 13 16:21:45 user nova-compute[71731]:   <name>instance-0000000b</name>
Apr 13 16:21:45 user nova-compute[71731]:   <memory>131072</memory>
Apr 13 16:21:45 user nova-compute[71731]:   <vcpu>1</vcpu>
Apr 13 16:21:45 user nova-compute[71731]:   <metadata>
Apr 13 16:21:45 user nova-compute[71731]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 16:21:45 user nova-compute[71731]:       <nova:package version="0.0.0"/>
Apr 13 16:21:45 user nova-compute[71731]:       <nova:name>tempest-TestShelveInstance-server-1925968525</nova:name>
Apr 13 16:21:45 user nova-compute[71731]:       <nova:creationTime>2023-04-13 16:21:44</nova:creationTime>
Apr 13 16:21:45 user nova-compute[71731]:       <nova:flavor name="m1.nano">
Apr 13 16:21:45 user nova-compute[71731]:         <nova:memory>128</nova:memory>
Apr 13 16:21:45 user nova-compute[71731]:         <nova:disk>1</nova:disk>
Apr 13 16:21:45 user nova-compute[71731]:         <nova:swap>0</nova:swap>
Apr 13 16:21:45 user nova-compute[71731]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 16:21:45 user nova-compute[71731]:         <nova:vcpus>1</nova:vcpus>
Apr 13 16:21:45 user nova-compute[71731]:       </nova:flavor>
Apr 13 16:21:45 user nova-compute[71731]:       <nova:owner>
Apr 13 16:21:45 user nova-compute[71731]:         <nova:user uuid="fe6a4bf1a7794af2958c3d53ea1e19c6">tempest-TestShelveInstance-1159741724-project-member</nova:user>
Apr 13 16:21:45 user nova-compute[71731]:         <nova:project uuid="ed94fa5d89c2486b8e2951e608e6630f">tempest-TestShelveInstance-1159741724</nova:project>
Apr 13 16:21:45 user nova-compute[71731]:       </nova:owner>
Apr 13 16:21:45 user nova-compute[71731]:       <nova:ports>
Apr 13 16:21:45 user nova-compute[71731]:         <nova:port uuid="1a737bae-3b9b-43b4-8a89-0eb98fdf2ec8">
Apr 13 16:21:45 user nova-compute[71731]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Apr 13 16:21:45 user nova-compute[71731]:         </nova:port>
Apr 13 16:21:45 user nova-compute[71731]:       </nova:ports>
Apr 13 16:21:45 user nova-compute[71731]:     </nova:instance>
Apr 13 16:21:45 user nova-compute[71731]:   </metadata>
Apr 13 16:21:45 user nova-compute[71731]:   <sysinfo type="smbios">
Apr 13 16:21:45 user nova-compute[71731]:     <system>
Apr 13 16:21:45 user nova-compute[71731]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 16:21:45 user nova-compute[71731]:       <entry name="product">OpenStack Nova</entry>
Apr 13 16:21:45 user nova-compute[71731]:       <entry name="version">0.0.0</entry>
Apr 13 16:21:45 user nova-compute[71731]:       <entry name="serial">bf350da4-9cc2-4900-adf0-506e44984b42</entry>
Apr 13 16:21:45 user nova-compute[71731]:       <entry name="uuid">bf350da4-9cc2-4900-adf0-506e44984b42</entry>
Apr 13 16:21:45 user nova-compute[71731]:       <entry name="family">Virtual Machine</entry>
Apr 13 16:21:45 user nova-compute[71731]:     </system>
Apr 13 16:21:45 user nova-compute[71731]:   </sysinfo>
Apr 13 16:21:45 user nova-compute[71731]:   <os>
Apr 13 16:21:45 user nova-compute[71731]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 16:21:45 user nova-compute[71731]:     <boot dev="hd"/>
Apr 13 16:21:45 user nova-compute[71731]:     <smbios mode="sysinfo"/>
Apr 13 16:21:45 user nova-compute[71731]:   </os>
Apr 13 16:21:45 user nova-compute[71731]:   <features>
Apr 13 16:21:45 user nova-compute[71731]:     <acpi/>
Apr 13 16:21:45 user nova-compute[71731]:     <apic/>
Apr 13 16:21:45 user nova-compute[71731]:     <vmcoreinfo/>
Apr 13 16:21:45 user nova-compute[71731]:   </features>
Apr 13 16:21:45 user nova-compute[71731]:   <clock offset="utc">
Apr 13 16:21:45 user nova-compute[71731]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 16:21:45 user nova-compute[71731]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 16:21:45 user nova-compute[71731]:     <timer name="hpet" present="no"/>
Apr 13 16:21:45 user nova-compute[71731]:   </clock>
Apr 13 16:21:45 user nova-compute[71731]:   <cpu mode="custom" match="exact">
Apr 13 16:21:45 user nova-compute[71731]:     <model>Nehalem</model>
Apr 13 16:21:45 user nova-compute[71731]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 16:21:45 user nova-compute[71731]:   </cpu>
Apr 13 16:21:45 user nova-compute[71731]:   <devices>
Apr 13 16:21:45 user nova-compute[71731]:     <disk type="block" device="disk">
Apr 13 16:21:45 user nova-compute[71731]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 16:21:45 user nova-compute[71731]:       <source dev="/dev/sdb"/>
Apr 13 16:21:45 user nova-compute[71731]:       <target dev="vda" bus="virtio"/>
Apr 13 16:21:45 user nova-compute[71731]:       <serial>1ac31388-2626-48e4-a711-54683ef66984</serial>
Apr 13 16:21:45 user nova-compute[71731]:     </disk>
Apr 13 16:21:45 user nova-compute[71731]:     <interface type="ethernet">
Apr 13 16:21:45 user nova-compute[71731]:       <mac address="fa:16:3e:18:7d:11"/>
Apr 13 16:21:45 user nova-compute[71731]:       <model type="virtio"/>
Apr 13 16:21:45 user nova-compute[71731]:       <mtu size="1442"/>
Apr 13 16:21:45 user nova-compute[71731]:       <target dev="tap1a737bae-3b"/>
Apr 13 16:21:45 user nova-compute[71731]:     </interface>
Apr 13 16:21:45 user nova-compute[71731]:     <serial type="pty">
Apr 13 16:21:45 user nova-compute[71731]:       <log file="/opt/stack/data/nova/instances/bf350da4-9cc2-4900-adf0-506e44984b42/console.log" append="off"/>
Apr 13 16:21:45 user nova-compute[71731]:     </serial>
Apr 13 16:21:45 user nova-compute[71731]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 16:21:45 user nova-compute[71731]:     <video>
Apr 13 16:21:45 user nova-compute[71731]:       <model type="virtio"/>
Apr 13 16:21:45 user nova-compute[71731]:     </video>
Apr 13 16:21:45 user nova-compute[71731]:     <rng model="virtio">
Apr 13 16:21:45 user nova-compute[71731]:       <backend model="random">/dev/urandom</backend>
Apr 13 16:21:45 user nova-compute[71731]:     </rng>
Apr 13 16:21:45 user nova-compute[71731]:     <controller type="usb" index="0" model="none"/>
Apr 13 16:21:45 user nova-compute[71731]:     <memballoon model="virtio">
Apr 13 16:21:45 user nova-compute[71731]:       <stats period="10"/>
Apr 13 16:21:45 user nova-compute[71731]:     </memballoon>
Apr 13 16:21:45 user nova-compute[71731]:   </devices>
Apr 13 16:21:45 user nova-compute[71731]: </domain>
Apr 13 16:21:45 user nova-compute[71731]:  {{(pid=71731) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 16:21:45 user nova-compute[71731]: DEBUG nova.virt.libvirt.vif [None req-ce4cfc33-fa3f-4959-a2b8-ca3f91801c9b tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T16:21:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1925968525',display_name='tempest-TestShelveInstance-server-1925968525',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1925968525',id=11,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDyAJlgxv64OYVoDx7VUkbgPL/6uJGmronkd0R5CCODRVVo/i2lNlZVafBS/KDfrnkMj0B1mexq0GfoaJ06IYh54z6OmormUG7yLrIuZRcmrCeKwYmEEqzhVcYWIYdAQ0Q==',key_name='tempest-TestShelveInstance-2029240993',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ed94fa5d89c2486b8e2951e608e6630f',ramdisk_id='',reservation_id='r-dy6iwcv2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1159741724',owner_user_name='tempest-TestShelveInstance-1159741724-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T16:21:39Z,user_data=None,user_id='fe6a4bf1a7794af2958c3d53ea1e19c6',uuid=bf350da4-9cc2-4900-adf0-506e44984b42,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1a737bae-3b9b-43b4-8a89-0eb98fdf2ec8", "address": "fa:16:3e:18:7d:11", "network": {"id": "c06f107f-4fa0-46dc-8766-3c882c401851", "bridge": "br-int", "label": "tempest-TestShelveInstance-1490339676-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed94fa5d89c2486b8e2951e608e6630f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a737bae-3b", "ovs_interfaceid": "1a737bae-3b9b-43b4-8a89-0eb98fdf2ec8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 16:21:45 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-ce4cfc33-fa3f-4959-a2b8-ca3f91801c9b tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Converting VIF {"id": "1a737bae-3b9b-43b4-8a89-0eb98fdf2ec8", "address": "fa:16:3e:18:7d:11", "network": {"id": "c06f107f-4fa0-46dc-8766-3c882c401851", "bridge": "br-int", "label": "tempest-TestShelveInstance-1490339676-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed94fa5d89c2486b8e2951e608e6630f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a737bae-3b", "ovs_interfaceid": "1a737bae-3b9b-43b4-8a89-0eb98fdf2ec8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 16:21:45 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-ce4cfc33-fa3f-4959-a2b8-ca3f91801c9b tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:18:7d:11,bridge_name='br-int',has_traffic_filtering=True,id=1a737bae-3b9b-43b4-8a89-0eb98fdf2ec8,network=Network(c06f107f-4fa0-46dc-8766-3c882c401851),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a737bae-3b') {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 16:21:45 user nova-compute[71731]: DEBUG os_vif [None req-ce4cfc33-fa3f-4959-a2b8-ca3f91801c9b tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:7d:11,bridge_name='br-int',has_traffic_filtering=True,id=1a737bae-3b9b-43b4-8a89-0eb98fdf2ec8,network=Network(c06f107f-4fa0-46dc-8766-3c882c401851),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a737bae-3b') {{(pid=71731) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 16:21:45 user nova-compute[71731]: DEBUG nova.network.neutron [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] [instance: e4ada2d7-7ace-4ed4-86a6-ed121c95e80f] Instance cache missing network info. {{(pid=71731) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 16:21:45 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:21:45 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:21:45 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 16:21:45 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:21:45 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1a737bae-3b, may_exist=True) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:21:45 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1a737bae-3b, col_values=(('external_ids', {'iface-id': '1a737bae-3b9b-43b4-8a89-0eb98fdf2ec8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:18:7d:11', 'vm-uuid': 'bf350da4-9cc2-4900-adf0-506e44984b42'}),)) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:21:45 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:21:45 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 16:21:45 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:21:45 user nova-compute[71731]: INFO os_vif [None req-ce4cfc33-fa3f-4959-a2b8-ca3f91801c9b tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:7d:11,bridge_name='br-int',has_traffic_filtering=True,id=1a737bae-3b9b-43b4-8a89-0eb98fdf2ec8,network=Network(c06f107f-4fa0-46dc-8766-3c882c401851),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a737bae-3b')
Apr 13 16:21:45 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:21:45 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-ce4cfc33-fa3f-4959-a2b8-ca3f91801c9b tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] No BDM found with device name vda, not building metadata. {{(pid=71731) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 16:21:45 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-ce4cfc33-fa3f-4959-a2b8-ca3f91801c9b tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] No VIF found with MAC fa:16:3e:18:7d:11, not building metadata {{(pid=71731) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 16:21:46 user nova-compute[71731]: DEBUG nova.network.neutron [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] [instance: 2549ba85-4e0a-420e-b711-07cafa8c60e9] Successfully updated port: 38e92b7c-b7c1-4137-a1db-21bc1d24f3ee {{(pid=71731) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 16:21:46 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Acquiring lock "refresh_cache-2549ba85-4e0a-420e-b711-07cafa8c60e9" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 16:21:46 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Acquired lock "refresh_cache-2549ba85-4e0a-420e-b711-07cafa8c60e9" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 16:21:46 user nova-compute[71731]: DEBUG nova.network.neutron [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] [instance: 2549ba85-4e0a-420e-b711-07cafa8c60e9] Building network info cache for instance {{(pid=71731) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 16:21:46 user nova-compute[71731]: DEBUG nova.network.neutron [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] [instance: 2549ba85-4e0a-420e-b711-07cafa8c60e9] Instance cache missing network info. {{(pid=71731) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 16:21:47 user nova-compute[71731]: DEBUG nova.compute.manager [req-09438164-3a12-45af-826e-218eb91b1f6f req-14e94222-211e-4aae-a405-3e995626ca27 service nova] [instance: 2549ba85-4e0a-420e-b711-07cafa8c60e9] Received event network-changed-0fbdf291-df5d-41c5-a765-7145a87da272 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:21:47 user nova-compute[71731]: DEBUG nova.compute.manager [req-09438164-3a12-45af-826e-218eb91b1f6f req-14e94222-211e-4aae-a405-3e995626ca27 service nova] [instance: 2549ba85-4e0a-420e-b711-07cafa8c60e9] Refreshing instance network info cache due to event network-changed-0fbdf291-df5d-41c5-a765-7145a87da272. {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 16:21:47 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-09438164-3a12-45af-826e-218eb91b1f6f req-14e94222-211e-4aae-a405-3e995626ca27 service nova] Acquiring lock "refresh_cache-2549ba85-4e0a-420e-b711-07cafa8c60e9" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 16:21:47 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:21:47 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:21:47 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:21:47 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:21:47 user nova-compute[71731]: DEBUG nova.compute.manager [req-6fc07712-eb49-48e3-a6af-fc1ca057f788 req-56e7898b-25c2-44ae-8e55-ec4b25ce8a6c service nova] [instance: bf350da4-9cc2-4900-adf0-506e44984b42] Received event network-vif-plugged-1a737bae-3b9b-43b4-8a89-0eb98fdf2ec8 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:21:47 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-6fc07712-eb49-48e3-a6af-fc1ca057f788 req-56e7898b-25c2-44ae-8e55-ec4b25ce8a6c service nova] Acquiring lock "bf350da4-9cc2-4900-adf0-506e44984b42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:21:47 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-6fc07712-eb49-48e3-a6af-fc1ca057f788 req-56e7898b-25c2-44ae-8e55-ec4b25ce8a6c service nova] Lock "bf350da4-9cc2-4900-adf0-506e44984b42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:21:47 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-6fc07712-eb49-48e3-a6af-fc1ca057f788 req-56e7898b-25c2-44ae-8e55-ec4b25ce8a6c service nova] Lock "bf350da4-9cc2-4900-adf0-506e44984b42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:21:47 user nova-compute[71731]: DEBUG nova.compute.manager [req-6fc07712-eb49-48e3-a6af-fc1ca057f788 req-56e7898b-25c2-44ae-8e55-ec4b25ce8a6c service nova] [instance: bf350da4-9cc2-4900-adf0-506e44984b42] No waiting events found dispatching network-vif-plugged-1a737bae-3b9b-43b4-8a89-0eb98fdf2ec8 {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:21:47 user nova-compute[71731]: WARNING nova.compute.manager [req-6fc07712-eb49-48e3-a6af-fc1ca057f788 req-56e7898b-25c2-44ae-8e55-ec4b25ce8a6c service nova] [instance: bf350da4-9cc2-4900-adf0-506e44984b42] Received unexpected event network-vif-plugged-1a737bae-3b9b-43b4-8a89-0eb98fdf2ec8 for instance with vm_state building and task_state spawning.
Apr 13 16:21:48 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:21:48 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:21:48 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:21:48 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:21:48 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:21:48 user nova-compute[71731]: DEBUG nova.network.neutron [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] [instance: e4ada2d7-7ace-4ed4-86a6-ed121c95e80f] Updating instance_info_cache with network_info: [{"id": "a409f60c-6c6a-49f8-8520-04614e804002", "address": "fa:16:3e:ee:b5:cc", "network": {"id": "06e8519d-91e2-4c6a-8b74-6f55609e1764", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-420310439-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7649e366b0164e2fa5b3faa0830b6ea6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa409f60c-6c", "ovs_interfaceid": "a409f60c-6c6a-49f8-8520-04614e804002", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ac94464f-32dc-4cd1-a270-ec8934e77c21", "address": "fa:16:3e:5e:a2:3f", "network": {"id": "4b153def-aec7-4f9e-9604-f1e0afb247f3", "bridge": "br-int", "label": "tempest-device-tagging-net1-1029190313", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.127", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7649e366b0164e2fa5b3faa0830b6ea6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac94464f-32", "ovs_interfaceid": "ac94464f-32dc-4cd1-a270-ec8934e77c21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0125a8df-e91c-4d65-be74-fda2f2d93938", "address": "fa:16:3e:39:06:fc", "network": {"id": "4b153def-aec7-4f9e-9604-f1e0afb247f3", "bridge": "br-int", "label": "tempest-device-tagging-net1-1029190313", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.61", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7649e366b0164e2fa5b3faa0830b6ea6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0125a8df-e9", "ovs_interfaceid": "0125a8df-e91c-4d65-be74-fda2f2d93938", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8f3a3011-e474-4538-812b-9df3968fd629", "address": "fa:16:3e:78:12:fd", "network": {"id": "4b153def-aec7-4f9e-9604-f1e0afb247f3", "bridge": "br-int", "label": "tempest-device-tagging-net1-1029190313", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.202", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7649e366b0164e2fa5b3faa0830b6ea6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f3a3011-e4", "ovs_interfaceid": "8f3a3011-e474-4538-812b-9df3968fd629", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2430beb8-b2e4-4493-bdc5-df6b4c1181c6", "address": "fa:16:3e:30:1c:f5", "network": {"id": "4b153def-aec7-4f9e-9604-f1e0afb247f3", "bridge": "br-int", "label": "tempest-device-tagging-net1-1029190313", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.91", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7649e366b0164e2fa5b3faa0830b6ea6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2430beb8-b2", "ovs_interfaceid": "2430beb8-b2e4-4493-bdc5-df6b4c1181c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "15dca2c3-5048-4e80-8008-c19400ea34e4", "address": "fa:16:3e:df:45:fc", "network": {"id": "310c919b-177f-4fb1-956a-1423f7397f77", "bridge": "br-int", "label": "tempest-device-tagging-net2-188582195", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7649e366b0164e2fa5b3faa0830b6ea6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15dca2c3-50", "ovs_interfaceid": "15dca2c3-5048-4e80-8008-c19400ea34e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d41765b6-0d5b-43c1-bf58-a82a7bbe3137", "address": "fa:16:3e:63:86:1f", "network": {"id": "310c919b-177f-4fb1-956a-1423f7397f77", "bridge": "br-int", "label": "tempest-device-tagging-net2-188582195", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7649e366b0164e2fa5b3faa0830b6ea6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd41765b6-0d", "ovs_interfaceid": "d41765b6-0d5b-43c1-bf58-a82a7bbe3137", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:21:48 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Releasing lock "refresh_cache-e4ada2d7-7ace-4ed4-86a6-ed121c95e80f" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 16:21:48 user nova-compute[71731]: DEBUG nova.compute.manager [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] [instance: e4ada2d7-7ace-4ed4-86a6-ed121c95e80f] Instance network_info: |[{"id": "a409f60c-6c6a-49f8-8520-04614e804002", "address": "fa:16:3e:ee:b5:cc", "network": {"id": "06e8519d-91e2-4c6a-8b74-6f55609e1764", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-420310439-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7649e366b0164e2fa5b3faa0830b6ea6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa409f60c-6c", "ovs_interfaceid": "a409f60c-6c6a-49f8-8520-04614e804002", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ac94464f-32dc-4cd1-a270-ec8934e77c21", "address": "fa:16:3e:5e:a2:3f", "network": {"id": "4b153def-aec7-4f9e-9604-f1e0afb247f3", "bridge": "br-int", "label": "tempest-device-tagging-net1-1029190313", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.127", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7649e366b0164e2fa5b3faa0830b6ea6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac94464f-32", "ovs_interfaceid": "ac94464f-32dc-4cd1-a270-ec8934e77c21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0125a8df-e91c-4d65-be74-fda2f2d93938", "address": "fa:16:3e:39:06:fc", "network": {"id": "4b153def-aec7-4f9e-9604-f1e0afb247f3", "bridge": "br-int", "label": "tempest-device-tagging-net1-1029190313", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.61", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7649e366b0164e2fa5b3faa0830b6ea6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0125a8df-e9", "ovs_interfaceid": "0125a8df-e91c-4d65-be74-fda2f2d93938", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8f3a3011-e474-4538-812b-9df3968fd629", "address": "fa:16:3e:78:12:fd", "network": {"id": "4b153def-aec7-4f9e-9604-f1e0afb247f3", "bridge": "br-int", "label": "tempest-device-tagging-net1-1029190313", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.202", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7649e366b0164e2fa5b3faa0830b6ea6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f3a3011-e4", "ovs_interfaceid": "8f3a3011-e474-4538-812b-9df3968fd629", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2430beb8-b2e4-4493-bdc5-df6b4c1181c6", "address": "fa:16:3e:30:1c:f5", "network": {"id": "4b153def-aec7-4f9e-9604-f1e0afb247f3", "bridge": "br-int", "label": "tempest-device-tagging-net1-1029190313", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.91", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7649e366b0164e2fa5b3faa0830b6ea6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2430beb8-b2", "ovs_interfaceid": "2430beb8-b2e4-4493-bdc5-df6b4c1181c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "15dca2c3-5048-4e80-8008-c19400ea34e4", "address": "fa:16:3e:df:45:fc", "network": {"id": "310c919b-177f-4fb1-956a-1423f7397f77", "bridge": "br-int", "label": "tempest-device-tagging-net2-188582195", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7649e366b0164e2fa5b3faa0830b6ea6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15dca2c3-50", "ovs_interfaceid": "15dca2c3-5048-4e80-8008-c19400ea34e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d41765b6-0d5b-43c1-bf58-a82a7bbe3137", "address": "fa:16:3e:63:86:1f", "network": {"id": "310c919b-177f-4fb1-956a-1423f7397f77", "bridge": "br-int", "label": "tempest-device-tagging-net2-188582195", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7649e366b0164e2fa5b3faa0830b6ea6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd41765b6-0d", "ovs_interfaceid": "d41765b6-0d5b-43c1-bf58-a82a7bbe3137", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71731) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 16:21:48 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] [instance: e4ada2d7-7ace-4ed4-86a6-ed121c95e80f] Start _get_guest_xml network_info=[{"id": "a409f60c-6c6a-49f8-8520-04614e804002", "address": "fa:16:3e:ee:b5:cc", "network": {"id": "06e8519d-91e2-4c6a-8b74-6f55609e1764", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-420310439-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7649e366b0164e2fa5b3faa0830b6ea6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa409f60c-6c", "ovs_interfaceid": "a409f60c-6c6a-49f8-8520-04614e804002", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ac94464f-32dc-4cd1-a270-ec8934e77c21", "address": "fa:16:3e:5e:a2:3f", "network": {"id": "4b153def-aec7-4f9e-9604-f1e0afb247f3", "bridge": "br-int", "label": "tempest-device-tagging-net1-1029190313", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.127", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7649e366b0164e2fa5b3faa0830b6ea6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac94464f-32", "ovs_interfaceid": "ac94464f-32dc-4cd1-a270-ec8934e77c21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0125a8df-e91c-4d65-be74-fda2f2d93938", "address": "fa:16:3e:39:06:fc", "network": {"id": "4b153def-aec7-4f9e-9604-f1e0afb247f3", "bridge": "br-int", "label": "tempest-device-tagging-net1-1029190313", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.61", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7649e366b0164e2fa5b3faa0830b6ea6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0125a8df-e9", "ovs_interfaceid": "0125a8df-e91c-4d65-be74-fda2f2d93938", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8f3a3011-e474-4538-812b-9df3968fd629", "address": "fa:16:3e:78:12:fd", "network": {"id": "4b153def-aec7-4f9e-9604-f1e0afb247f3", "bridge": "br-int", "label": "tempest-device-tagging-net1-1029190313", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.202", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7649e366b0164e2fa5b3faa0830b6ea6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f3a3011-e4", "ovs_interfaceid": "8f3a3011-e474-4538-812b-9df3968fd629", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2430beb8-b2e4-4493-bdc5-df6b4c1181c6", "address": "fa:16:3e:30:1c:f5", "network": {"id": "4b153def-aec7-4f9e-9604-f1e0afb247f3", "bridge": "br-int", "label": "tempest-device-tagging-net1-1029190313", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.91", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7649e366b0164e2fa5b3faa0830b6ea6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2430beb8-b2", "ovs_interfaceid": "2430beb8-b2e4-4493-bdc5-df6b4c1181c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "15dca2c3-5048-4e80-8008-c19400ea34e4", "address": "fa:16:3e:df:45:fc", "network": {"id": "310c919b-177f-4fb1-956a-1423f7397f77", "bridge": "br-int", "label": "tempest-device-tagging-net2-188582195", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7649e366b0164e2fa5b3faa0830b6ea6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15dca2c3-50", "ovs_interfaceid": "15dca2c3-5048-4e80-8008-c19400ea34e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d41765b6-0d5b-43c1-bf58-a82a7bbe3137", "address": "fa:16:3e:63:86:1f", "network": {"id": "310c919b-177f-4fb1-956a-1423f7397f77", "bridge": "br-int", "label": "tempest-device-tagging-net2-188582195", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7649e366b0164e2fa5b3faa0830b6ea6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd41765b6-0d", "ovs_interfaceid": "d41765b6-0d5b-43c1-bf58-a82a7bbe3137", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T16:16:31Z,direct_url=<?>,disk_format='qcow2',id=708622a9-7465-4492-ade8-b827198f7e30,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='0b29a975c552465aba0ac7d6288434bd',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T16:16:33Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'attachment_id': '018bbd8c-9148-4f51-9990-8ff62601382a', 'mount_device': '/dev/vda', 'delete_on_termination': False, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:84c7f6ad-d2c2-465a-b39e-47347aa85be0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pGheaJTt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'e4ada2d7-7ace-4ed4-86a6-ed121c95e80f', 'attached_at': '', 'detached_at': '', 'volume_id': '84c7f6ad-d2c2-465a-b39e-47347aa85be0', 'serial': '84c7f6ad-d2c2-465a-b39e-47347aa85be0'}, 'disk_bus': 'virtio', 'guest_format': None, 'volume_type': None}, {'boot_index': 1, 'attachment_id': 'b655a4f7-c59f-4268-a1d0-48e38afc3dc3', 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c20e80fa-58de-431a-8901-2535657aaadf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UVEGFLtB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'e4ada2d7-7ace-4ed4-86a6-ed121c95e80f', 'attached_at': '', 'detached_at': '', 'volume_id': 'c20e80fa-58de-431a-8901-2535657aaadf', 'serial': 'c20e80fa-58de-431a-8901-2535657aaadf'}, 'disk_bus': 'virtio', 'guest_format': None, 'volume_type': None}, {'boot_index': 2, 'attachment_id': '05ec20c7-b0c7-4c0f-b59f-22e0446509c9', 'mount_device': '/dev/vdc', 'delete_on_termination': False, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:cc639d00-ef6b-4121-bcb0-c65ec0347abd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dOqXsWnC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'e4ada2d7-7ace-4ed4-86a6-ed121c95e80f', 'attached_at': '', 'detached_at': '', 'volume_id': 'cc639d00-ef6b-4121-bcb0-c65ec0347abd', 'serial': 'cc639d00-ef6b-4121-bcb0-c65ec0347abd'}, 'disk_bus': 'virtio', 'guest_format': None, 'volume_type': None} {{(pid=71731) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 16:21:48 user nova-compute[71731]: WARNING nova.virt.libvirt.driver [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 16:21:48 user nova-compute[71731]: WARNING nova.virt.libvirt.driver [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 16:21:48 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71731) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 16:21:48 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T16:17:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T16:16:31Z,direct_url=<?>,disk_format='qcow2',id=708622a9-7465-4492-ade8-b827198f7e30,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='0b29a975c552465aba0ac7d6288434bd',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T16:16:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 16:21:48 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Flavor limits 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 16:21:48 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Image limits 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 16:21:48 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Flavor pref 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 16:21:48 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Image pref 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 16:21:48 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 16:21:48 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 16:21:48 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71731) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 16:21:48 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Got 1 possible topologies {{(pid=71731) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 16:21:48 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 16:21:48 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 16:21:48 user nova-compute[71731]: DEBUG nova.virt.libvirt.volume.iscsi [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] [instance: e4ada2d7-7ace-4ed4-86a6-ed121c95e80f] Calling os-brick to attach iSCSI Volume {{(pid=71731) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 16:21:48 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8cf0118790>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:84c7f6ad-d2c2-465a-b39e-47347aa85be0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pGheaJTt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 16:21:48 user nova-compute[71731]: WARNING os_brick.initiator.connectors.base [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 16:21:48 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 16:21:48 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 16:21:48 user nova-compute[71731]: WARNING os_brick.initiator.connectors.base [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 16:21:48 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:84c7f6ad-d2c2-465a-b39e-47347aa85be0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 16:21:48 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:84c7f6ad-d2c2-465a-b39e-47347aa85be0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 16:21:48 user nova-compute[71731]: INFO os_brick.initiator.connectors.iscsi [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 16:21:48 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84c7f6ad-d2c2-465a-b39e-47347aa85be0 -p 172.16.0.220:3260 {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:21:48 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84c7f6ad-d2c2-465a-b39e-47347aa85be0 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:21:48 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccf276b2-b865-4081-b436-a54e279b41b9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:21:48 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 16:21:48 user nova-compute[71731]:  {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:21:48 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84c7f6ad-d2c2-465a-b39e-47347aa85be0 -p 172.16.0.220:3260 --interface default --op new {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:21:49 user nova-compute[71731]: DEBUG nova.network.neutron [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] [instance: 2549ba85-4e0a-420e-b711-07cafa8c60e9] Updating instance_info_cache with network_info: [{"id": "36152688-366c-40a2-8bf9-88f69925594a", "address": "fa:16:3e:1c:8b:59", "network": {"id": "f11266a1-4740-4cb3-8467-e0e95870ac22", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-689537131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbe4e9fb786d4015b035b4d00f75a1ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36152688-36", "ovs_interfaceid": "36152688-366c-40a2-8bf9-88f69925594a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d7155dcf-9e83-4579-b81a-7277d4a9eeaf", "address": "fa:16:3e:d0:1a:bc", "network": {"id": "5d158a82-de85-48b5-9f17-40e61e9b0df8", "bridge": "br-int", "label": "tempest-device-tagging-net1-574676351", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.246", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bbe4e9fb786d4015b035b4d00f75a1ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7155dcf-9e", "ovs_interfaceid": "d7155dcf-9e83-4579-b81a-7277d4a9eeaf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4c481745-6342-43f8-9040-3ea1d8c5c572", "address": "fa:16:3e:e7:ea:ff", "network": {"id": "5d158a82-de85-48b5-9f17-40e61e9b0df8", "bridge": "br-int", "label": "tempest-device-tagging-net1-574676351", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.164", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bbe4e9fb786d4015b035b4d00f75a1ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c481745-63", "ovs_interfaceid": "4c481745-6342-43f8-9040-3ea1d8c5c572", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0152bbb9-d50d-4e58-8a2b-727c4675ea2f", "address": "fa:16:3e:0d:4d:58", "network": {"id": "5d158a82-de85-48b5-9f17-40e61e9b0df8", "bridge": "br-int", "label": "tempest-device-tagging-net1-574676351", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.142", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bbe4e9fb786d4015b035b4d00f75a1ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0152bbb9-d5", "ovs_interfaceid": "0152bbb9-d50d-4e58-8a2b-727c4675ea2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3730ed6e-b093-4232-800b-b064d650e9e8", "address": "fa:16:3e:a8:c4:f6", "network": {"id": "5d158a82-de85-48b5-9f17-40e61e9b0df8", "bridge": "br-int", "label": "tempest-device-tagging-net1-574676351", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.38", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bbe4e9fb786d4015b035b4d00f75a1ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3730ed6e-b0", "ovs_interfaceid": "3730ed6e-b093-4232-800b-b064d650e9e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0fbdf291-df5d-41c5-a765-7145a87da272", "address": "fa:16:3e:dc:57:7b", "network": {"id": "4224b04f-23ed-464e-9b2c-df8c843f9287", "bridge": "br-int", "label": "tempest-device-tagging-net2-109401200", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "bbe4e9fb786d4015b035b4d00f75a1ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fbdf291-df", "ovs_interfaceid": "0fbdf291-df5d-41c5-a765-7145a87da272", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "38e92b7c-b7c1-4137-a1db-21bc1d24f3ee", "address": "fa:16:3e:a3:dd:27", "network": {"id": "4224b04f-23ed-464e-9b2c-df8c843f9287", "bridge": "br-int", "label": "tempest-device-tagging-net2-109401200", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "bbe4e9fb786d4015b035b4d00f75a1ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38e92b7c-b7", "ovs_interfaceid": "38e92b7c-b7c1-4137-a1db-21bc1d24f3ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:21:49 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84c7f6ad-d2c2-465a-b39e-47347aa85be0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:21:49 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9eb764b-626a-4867-ad8f-2d73380076e3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:84c7f6ad-d2c2-465a-b39e-47347aa85be0] added\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:21:49 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:84c7f6ad-d2c2-465a-b39e-47347aa85be0] added
Apr 13 16:21:49 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:21:49 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84c7f6ad-d2c2-465a-b39e-47347aa85be0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:21:49 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Releasing lock "refresh_cache-2549ba85-4e0a-420e-b711-07cafa8c60e9" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 16:21:49 user nova-compute[71731]: DEBUG nova.compute.manager [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] [instance: 2549ba85-4e0a-420e-b711-07cafa8c60e9] Instance network_info: |[{"id": "36152688-366c-40a2-8bf9-88f69925594a", "address": "fa:16:3e:1c:8b:59", "network": {"id": "f11266a1-4740-4cb3-8467-e0e95870ac22", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-689537131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbe4e9fb786d4015b035b4d00f75a1ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36152688-36", "ovs_interfaceid": "36152688-366c-40a2-8bf9-88f69925594a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d7155dcf-9e83-4579-b81a-7277d4a9eeaf", "address": "fa:16:3e:d0:1a:bc", "network": {"id": "5d158a82-de85-48b5-9f17-40e61e9b0df8", "bridge": "br-int", "label": "tempest-device-tagging-net1-574676351", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.246", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bbe4e9fb786d4015b035b4d00f75a1ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7155dcf-9e", "ovs_interfaceid": "d7155dcf-9e83-4579-b81a-7277d4a9eeaf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4c481745-6342-43f8-9040-3ea1d8c5c572", "address": "fa:16:3e:e7:ea:ff", "network": {"id": "5d158a82-de85-48b5-9f17-40e61e9b0df8", "bridge": "br-int", "label": "tempest-device-tagging-net1-574676351", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.164", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bbe4e9fb786d4015b035b4d00f75a1ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c481745-63", "ovs_interfaceid": "4c481745-6342-43f8-9040-3ea1d8c5c572", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0152bbb9-d50d-4e58-8a2b-727c4675ea2f", "address": "fa:16:3e:0d:4d:58", "network": {"id": "5d158a82-de85-48b5-9f17-40e61e9b0df8", "bridge": "br-int", "label": "tempest-device-tagging-net1-574676351", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.142", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bbe4e9fb786d4015b035b4d00f75a1ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0152bbb9-d5", "ovs_interfaceid": "0152bbb9-d50d-4e58-8a2b-727c4675ea2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3730ed6e-b093-4232-800b-b064d650e9e8", "address": "fa:16:3e:a8:c4:f6", "network": {"id": "5d158a82-de85-48b5-9f17-40e61e9b0df8", "bridge": "br-int", "label": "tempest-device-tagging-net1-574676351", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.38", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bbe4e9fb786d4015b035b4d00f75a1ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3730ed6e-b0", "ovs_interfaceid": "3730ed6e-b093-4232-800b-b064d650e9e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0fbdf291-df5d-41c5-a765-7145a87da272", "address": "fa:16:3e:dc:57:7b", "network": {"id": "4224b04f-23ed-464e-9b2c-df8c843f9287", "bridge": "br-int", "label": "tempest-device-tagging-net2-109401200", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "bbe4e9fb786d4015b035b4d00f75a1ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fbdf291-df", "ovs_interfaceid": "0fbdf291-df5d-41c5-a765-7145a87da272", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "38e92b7c-b7c1-4137-a1db-21bc1d24f3ee", "address": "fa:16:3e:a3:dd:27", "network": {"id": "4224b04f-23ed-464e-9b2c-df8c843f9287", "bridge": "br-int", "label": "tempest-device-tagging-net2-109401200", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "bbe4e9fb786d4015b035b4d00f75a1ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38e92b7c-b7", "ovs_interfaceid": "38e92b7c-b7c1-4137-a1db-21bc1d24f3ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71731) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 16:21:49 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-09438164-3a12-45af-826e-218eb91b1f6f req-14e94222-211e-4aae-a405-3e995626ca27 service nova] Acquired lock "refresh_cache-2549ba85-4e0a-420e-b711-07cafa8c60e9" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 16:21:49 user nova-compute[71731]: DEBUG nova.network.neutron [req-09438164-3a12-45af-826e-218eb91b1f6f req-14e94222-211e-4aae-a405-3e995626ca27 service nova] [instance: 2549ba85-4e0a-420e-b711-07cafa8c60e9] Refreshing network info cache for port 0fbdf291-df5d-41c5-a765-7145a87da272 {{(pid=71731) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 16:21:49 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] [instance: 2549ba85-4e0a-420e-b711-07cafa8c60e9] Start _get_guest_xml network_info=[{"id": "36152688-366c-40a2-8bf9-88f69925594a", "address": "fa:16:3e:1c:8b:59", "network": {"id": "f11266a1-4740-4cb3-8467-e0e95870ac22", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-689537131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbe4e9fb786d4015b035b4d00f75a1ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36152688-36", "ovs_interfaceid": "36152688-366c-40a2-8bf9-88f69925594a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d7155dcf-9e83-4579-b81a-7277d4a9eeaf", "address": "fa:16:3e:d0:1a:bc", "network": {"id": "5d158a82-de85-48b5-9f17-40e61e9b0df8", "bridge": "br-int", "label": "tempest-device-tagging-net1-574676351", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.246", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bbe4e9fb786d4015b035b4d00f75a1ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7155dcf-9e", "ovs_interfaceid": "d7155dcf-9e83-4579-b81a-7277d4a9eeaf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4c481745-6342-43f8-9040-3ea1d8c5c572", "address": "fa:16:3e:e7:ea:ff", "network": {"id": "5d158a82-de85-48b5-9f17-40e61e9b0df8", "bridge": "br-int", "label": "tempest-device-tagging-net1-574676351", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.164", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bbe4e9fb786d4015b035b4d00f75a1ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c481745-63", "ovs_interfaceid": "4c481745-6342-43f8-9040-3ea1d8c5c572", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0152bbb9-d50d-4e58-8a2b-727c4675ea2f", "address": "fa:16:3e:0d:4d:58", "network": {"id": "5d158a82-de85-48b5-9f17-40e61e9b0df8", "bridge": "br-int", "label": "tempest-device-tagging-net1-574676351", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.142", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bbe4e9fb786d4015b035b4d00f75a1ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0152bbb9-d5", "ovs_interfaceid": "0152bbb9-d50d-4e58-8a2b-727c4675ea2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3730ed6e-b093-4232-800b-b064d650e9e8", "address": "fa:16:3e:a8:c4:f6", "network": {"id": "5d158a82-de85-48b5-9f17-40e61e9b0df8", "bridge": "br-int", "label": "tempest-device-tagging-net1-574676351", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.38", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bbe4e9fb786d4015b035b4d00f75a1ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3730ed6e-b0", "ovs_interfaceid": "3730ed6e-b093-4232-800b-b064d650e9e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0fbdf291-df5d-41c5-a765-7145a87da272", "address": "fa:16:3e:dc:57:7b", "network": {"id": "4224b04f-23ed-464e-9b2c-df8c843f9287", "bridge": "br-int", "label": "tempest-device-tagging-net2-109401200", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "bbe4e9fb786d4015b035b4d00f75a1ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fbdf291-df", "ovs_interfaceid": "0fbdf291-df5d-41c5-a765-7145a87da272", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "38e92b7c-b7c1-4137-a1db-21bc1d24f3ee", "address": "fa:16:3e:a3:dd:27", "network": {"id": "4224b04f-23ed-464e-9b2c-df8c843f9287", "bridge": "br-int", "label": "tempest-device-tagging-net2-109401200", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "bbe4e9fb786d4015b035b4d00f75a1ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38e92b7c-b7", "ovs_interfaceid": "38e92b7c-b7c1-4137-a1db-21bc1d24f3ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T16:16:31Z,direct_url=<?>,disk_format='qcow2',id=708622a9-7465-4492-ade8-b827198f7e30,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='0b29a975c552465aba0ac7d6288434bd',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T16:16:33Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'attachment_id': '2163f933-0880-45f1-aabc-8b7157bf0d07', 'mount_device': '/dev/vda', 'delete_on_termination': False, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:48af37b0-6938-432e-b374-d992c4dd9ae9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZwQBgjWU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '2549ba85-4e0a-420e-b711-07cafa8c60e9', 'attached_at': '', 'detached_at': '', 'volume_id': '48af37b0-6938-432e-b374-d992c4dd9ae9', 'serial': '48af37b0-6938-432e-b374-d992c4dd9ae9'}, 'disk_bus': 'virtio', 'guest_format': None, 'volume_type': None}, {'boot_index': 1, 'attachment_id': '21bff022-8889-4cb5-8329-24b190eafc4c', 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:27919afc-8990-4ed5-af9e-9d6b3d7b231e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cajfYKuC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '2549ba85-4e0a-420e-b711-07cafa8c60e9', 'attached_at': '', 'detached_at': '', 'volume_id': '27919afc-8990-4ed5-af9e-9d6b3d7b231e', 'serial': '27919afc-8990-4ed5-af9e-9d6b3d7b231e'}, 'disk_bus': 'virtio', 'guest_format': None, 'volume_type': None}, {'boot_index': 2, 'attachment_id': 'b054ddc1-dae3-4ede-9d9b-e2c2a593f0d8', 'mount_device': '/dev/vdc', 'delete_on_termination': False, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e0f728f3-fbb5-4ed8-a78b-a5d982b03f7d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nSEqPQZM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '2549ba85-4e0a-420e-b711-07cafa8c60e9', 'attached_at': '', 'detached_at': '', 'volume_id': 'e0f728f3-fbb5-4ed8-a78b-a5d982b03f7d', 'serial': 'e0f728f3-fbb5-4ed8-a78b-a5d982b03f7d'}, 'disk_bus': 'virtio', 'guest_format': None, 'volume_type': None} {{(pid=71731) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 16:21:49 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84c7f6ad-d2c2-465a-b39e-47347aa85be0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:21:49 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbbe1299-a55a-4624-8853-4c0f67a16bb3]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:21:49 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:21:49 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84c7f6ad-d2c2-465a-b39e-47347aa85be0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:21:49 user nova-compute[71731]: WARNING nova.virt.libvirt.driver [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 16:21:49 user nova-compute[71731]: WARNING nova.virt.libvirt.driver [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 16:21:49 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71731) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 16:21:49 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T16:17:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T16:16:31Z,direct_url=<?>,disk_format='qcow2',id=708622a9-7465-4492-ade8-b827198f7e30,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='0b29a975c552465aba0ac7d6288434bd',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T16:16:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 16:21:49 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Flavor limits 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 16:21:49 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Image limits 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 16:21:49 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Flavor pref 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 16:21:49 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Image pref 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 16:21:49 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 16:21:49 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 16:21:49 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71731) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 16:21:49 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Got 1 possible topologies {{(pid=71731) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 16:21:49 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 16:21:49 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 16:21:49 user nova-compute[71731]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] [instance: 2549ba85-4e0a-420e-b711-07cafa8c60e9] Calling os-brick to attach iSCSI Volume {{(pid=71731) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 16:21:49 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8cf0118790>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:48af37b0-6938-432e-b374-d992c4dd9ae9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZwQBgjWU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 16:21:49 user nova-compute[71731]: WARNING os_brick.initiator.connectors.base [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 16:21:49 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 16:21:49 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84c7f6ad-d2c2-465a-b39e-47347aa85be0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:21:49 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[42a7e884-9237-409f-b238-8b0889df77c7]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:21:49 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:21:49 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84c7f6ad-d2c2-465a-b39e-47347aa85be0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pGheaJTt {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:21:49 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84c7f6ad-d2c2-465a-b39e-47347aa85be0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pGheaJTt" returned: 0 in 0.020s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:21:49 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8a9b146-bc3d-42f1-bf9f-c8d3b07f962e]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:21:49 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pGheaJTt'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:21:49 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84c7f6ad-d2c2-465a-b39e-47347aa85be0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:21:49 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84c7f6ad-d2c2-465a-b39e-47347aa85be0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:21:49 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5905b3d-c397-4120-8551-3f9261977091]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:21:49 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:21:49 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:21:49 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:21:49 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[2288be1f-b08d-411c-89af-bd2bf6685c71]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984 (non-flash)\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:21:49 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984 (non-flash)
Apr 13 16:21:49 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 16:21:49 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984 (non-flash)
Apr 13 16:21:49 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 16:21:49 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84c7f6ad-d2c2-465a-b39e-47347aa85be0 -p 172.16.0.220:3260 --login {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:21:49 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84c7f6ad-d2c2-465a-b39e-47347aa85be0 -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:21:49 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3bd30d7-f0e6-406d-89d1-21ecc50b749d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:84c7f6ad-d2c2-465a-b39e-47347aa85be0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:84c7f6ad-d2c2-465a-b39e-47347aa85be0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:21:49 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:84c7f6ad-d2c2-465a-b39e-47347aa85be0, portal: 172.16.0.220,3260]
Apr 13 16:21:49 user nova-compute[71731]: Login to [iface: default, target: iqn.2010-10.org.openstack:84c7f6ad-d2c2-465a-b39e-47347aa85be0, portal: 172.16.0.220,3260] successful.
Apr 13 16:21:49 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:21:49 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84c7f6ad-d2c2-465a-b39e-47347aa85be0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:21:49 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84c7f6ad-d2c2-465a-b39e-47347aa85be0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:21:49 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0ec02bc-56a5-45f3-abbc-1a3c75bb45f6]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:21:49 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:21:49 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:21:49 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:21:49 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[22d735fd-4605-44fa-9210-7cd842d041f9]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c7f6ad-d2c2-465a-b39e-47347aa85be0 (non-flash)\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:21:49 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984 (non-flash)
Apr 13 16:21:49 user nova-compute[71731]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c7f6ad-d2c2-465a-b39e-47347aa85be0 (non-flash)
Apr 13 16:21:49 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 16:21:49 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984 (non-flash)
Apr 13 16:21:49 user nova-compute[71731]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c7f6ad-d2c2-465a-b39e-47347aa85be0 (non-flash)
Apr 13 16:21:49 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 16:21:49 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:84c7f6ad-d2c2-465a-b39e-47347aa85be0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.308s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 16:21:49 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Connected to 172.16.0.220:3260 {{(pid=71731) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 16:21:49 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=71731) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 16:21:49 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71731) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 16:21:49 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:21:49 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:21:49 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[55cc66ec-4484-4e97-854b-5557e655dfd3]: (4, ('- - 0', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:21:49 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71731) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 16:21:49 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:84c7f6ad-d2c2-465a-b39e-47347aa85be0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pGheaJTt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71731) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 16:21:49 user nova-compute[71731]: DEBUG nova.network.neutron [req-09438164-3a12-45af-826e-218eb91b1f6f req-14e94222-211e-4aae-a405-3e995626ca27 service nova] [instance: 2549ba85-4e0a-420e-b711-07cafa8c60e9] Updated VIF entry in instance network info cache for port 0fbdf291-df5d-41c5-a765-7145a87da272. {{(pid=71731) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 16:21:49 user nova-compute[71731]: DEBUG nova.network.neutron [req-09438164-3a12-45af-826e-218eb91b1f6f req-14e94222-211e-4aae-a405-3e995626ca27 service nova] [instance: 2549ba85-4e0a-420e-b711-07cafa8c60e9] Updating instance_info_cache with network_info: [{"id": "36152688-366c-40a2-8bf9-88f69925594a", "address": "fa:16:3e:1c:8b:59", "network": {"id": "f11266a1-4740-4cb3-8467-e0e95870ac22", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-689537131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbe4e9fb786d4015b035b4d00f75a1ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36152688-36", "ovs_interfaceid": "36152688-366c-40a2-8bf9-88f69925594a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d7155dcf-9e83-4579-b81a-7277d4a9eeaf", "address": "fa:16:3e:d0:1a:bc", "network": {"id": "5d158a82-de85-48b5-9f17-40e61e9b0df8", "bridge": "br-int", "label": "tempest-device-tagging-net1-574676351", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.246", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bbe4e9fb786d4015b035b4d00f75a1ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7155dcf-9e", "ovs_interfaceid": "d7155dcf-9e83-4579-b81a-7277d4a9eeaf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4c481745-6342-43f8-9040-3ea1d8c5c572", "address": "fa:16:3e:e7:ea:ff", "network": {"id": "5d158a82-de85-48b5-9f17-40e61e9b0df8", "bridge": "br-int", "label": "tempest-device-tagging-net1-574676351", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.164", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bbe4e9fb786d4015b035b4d00f75a1ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c481745-63", "ovs_interfaceid": "4c481745-6342-43f8-9040-3ea1d8c5c572", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0152bbb9-d50d-4e58-8a2b-727c4675ea2f", "address": "fa:16:3e:0d:4d:58", "network": {"id": "5d158a82-de85-48b5-9f17-40e61e9b0df8", "bridge": "br-int", "label": "tempest-device-tagging-net1-574676351", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.142", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bbe4e9fb786d4015b035b4d00f75a1ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0152bbb9-d5", "ovs_interfaceid": "0152bbb9-d50d-4e58-8a2b-727c4675ea2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3730ed6e-b093-4232-800b-b064d650e9e8", "address": "fa:16:3e:a8:c4:f6", "network": {"id": "5d158a82-de85-48b5-9f17-40e61e9b0df8", "bridge": "br-int", "label": "tempest-device-tagging-net1-574676351", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.38", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bbe4e9fb786d4015b035b4d00f75a1ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3730ed6e-b0", "ovs_interfaceid": "3730ed6e-b093-4232-800b-b064d650e9e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0fbdf291-df5d-41c5-a765-7145a87da272", "address": "fa:16:3e:dc:57:7b", "network": {"id": "4224b04f-23ed-464e-9b2c-df8c843f9287", "bridge": "br-int", "label": "tempest-device-tagging-net2-109401200", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "bbe4e9fb786d4015b035b4d00f75a1ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fbdf291-df", "ovs_interfaceid": "0fbdf291-df5d-41c5-a765-7145a87da272", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "38e92b7c-b7c1-4137-a1db-21bc1d24f3ee", "address": "fa:16:3e:a3:dd:27", "network": {"id": "4224b04f-23ed-464e-9b2c-df8c843f9287", "bridge": "br-int", "label": "tempest-device-tagging-net2-109401200", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "bbe4e9fb786d4015b035b4d00f75a1ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38e92b7c-b7", "ovs_interfaceid": "38e92b7c-b7c1-4137-a1db-21bc1d24f3ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:21:49 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-09438164-3a12-45af-826e-218eb91b1f6f req-14e94222-211e-4aae-a405-3e995626ca27 service nova] Releasing lock "refresh_cache-2549ba85-4e0a-420e-b711-07cafa8c60e9" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 16:21:49 user nova-compute[71731]: DEBUG nova.compute.manager [req-09438164-3a12-45af-826e-218eb91b1f6f req-14e94222-211e-4aae-a405-3e995626ca27 service nova] [instance: e4ada2d7-7ace-4ed4-86a6-ed121c95e80f] Received event network-changed-d41765b6-0d5b-43c1-bf58-a82a7bbe3137 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:21:49 user nova-compute[71731]: DEBUG nova.compute.manager [req-09438164-3a12-45af-826e-218eb91b1f6f req-14e94222-211e-4aae-a405-3e995626ca27 service nova] [instance: e4ada2d7-7ace-4ed4-86a6-ed121c95e80f] Refreshing instance network info cache due to event network-changed-d41765b6-0d5b-43c1-bf58-a82a7bbe3137. {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 16:21:49 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-09438164-3a12-45af-826e-218eb91b1f6f req-14e94222-211e-4aae-a405-3e995626ca27 service nova] Acquiring lock "refresh_cache-e4ada2d7-7ace-4ed4-86a6-ed121c95e80f" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 16:21:49 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-09438164-3a12-45af-826e-218eb91b1f6f req-14e94222-211e-4aae-a405-3e995626ca27 service nova] Acquired lock "refresh_cache-e4ada2d7-7ace-4ed4-86a6-ed121c95e80f" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 16:21:49 user nova-compute[71731]: DEBUG nova.network.neutron [req-09438164-3a12-45af-826e-218eb91b1f6f req-14e94222-211e-4aae-a405-3e995626ca27 service nova] [instance: e4ada2d7-7ace-4ed4-86a6-ed121c95e80f] Refreshing network info cache for port d41765b6-0d5b-43c1-bf58-a82a7bbe3137 {{(pid=71731) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 16:21:49 user nova-compute[71731]: DEBUG nova.virt.driver [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Emitting event <LifecycleEvent: 1681402909.7809086, bf350da4-9cc2-4900-adf0-506e44984b42 => Resumed> {{(pid=71731) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 16:21:49 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: bf350da4-9cc2-4900-adf0-506e44984b42] VM Resumed (Lifecycle Event)
Apr 13 16:21:49 user nova-compute[71731]: DEBUG nova.compute.manager [None req-ce4cfc33-fa3f-4959-a2b8-ca3f91801c9b tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] [instance: bf350da4-9cc2-4900-adf0-506e44984b42] Instance event wait completed in 0 seconds for  {{(pid=71731) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 16:21:49 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-ce4cfc33-fa3f-4959-a2b8-ca3f91801c9b tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] [instance: bf350da4-9cc2-4900-adf0-506e44984b42] Guest created on hypervisor {{(pid=71731) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 16:21:49 user nova-compute[71731]: INFO nova.virt.libvirt.driver [-] [instance: bf350da4-9cc2-4900-adf0-506e44984b42] Instance spawned successfully.
Apr 13 16:21:49 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-ce4cfc33-fa3f-4959-a2b8-ca3f91801c9b tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] [instance: bf350da4-9cc2-4900-adf0-506e44984b42] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 16:21:49 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: bf350da4-9cc2-4900-adf0-506e44984b42] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:21:49 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: bf350da4-9cc2-4900-adf0-506e44984b42] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71731) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 16:21:49 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-ce4cfc33-fa3f-4959-a2b8-ca3f91801c9b tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] [instance: bf350da4-9cc2-4900-adf0-506e44984b42] Found default for hw_cdrom_bus of ide {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:21:49 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-ce4cfc33-fa3f-4959-a2b8-ca3f91801c9b tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] [instance: bf350da4-9cc2-4900-adf0-506e44984b42] Found default for hw_disk_bus of virtio {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:21:49 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-ce4cfc33-fa3f-4959-a2b8-ca3f91801c9b tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] [instance: bf350da4-9cc2-4900-adf0-506e44984b42] Found default for hw_input_bus of None {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:21:49 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-ce4cfc33-fa3f-4959-a2b8-ca3f91801c9b tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] [instance: bf350da4-9cc2-4900-adf0-506e44984b42] Found default for hw_pointer_model of None {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:21:49 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-ce4cfc33-fa3f-4959-a2b8-ca3f91801c9b tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] [instance: bf350da4-9cc2-4900-adf0-506e44984b42] Found default for hw_video_model of virtio {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:21:49 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-ce4cfc33-fa3f-4959-a2b8-ca3f91801c9b tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] [instance: bf350da4-9cc2-4900-adf0-506e44984b42] Found default for hw_vif_model of virtio {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:21:49 user nova-compute[71731]: DEBUG nova.compute.manager [req-7947b582-fa65-4753-b50c-a8d2eb8a54f7 req-6a58486e-a3c1-486f-9490-73caf216503a service nova] [instance: bf350da4-9cc2-4900-adf0-506e44984b42] Received event network-vif-plugged-1a737bae-3b9b-43b4-8a89-0eb98fdf2ec8 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:21:49 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-7947b582-fa65-4753-b50c-a8d2eb8a54f7 req-6a58486e-a3c1-486f-9490-73caf216503a service nova] Acquiring lock "bf350da4-9cc2-4900-adf0-506e44984b42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:21:49 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-7947b582-fa65-4753-b50c-a8d2eb8a54f7 req-6a58486e-a3c1-486f-9490-73caf216503a service nova] Lock "bf350da4-9cc2-4900-adf0-506e44984b42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:21:49 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-7947b582-fa65-4753-b50c-a8d2eb8a54f7 req-6a58486e-a3c1-486f-9490-73caf216503a service nova] Lock "bf350da4-9cc2-4900-adf0-506e44984b42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:21:49 user nova-compute[71731]: DEBUG nova.compute.manager [req-7947b582-fa65-4753-b50c-a8d2eb8a54f7 req-6a58486e-a3c1-486f-9490-73caf216503a service nova] [instance: bf350da4-9cc2-4900-adf0-506e44984b42] No waiting events found dispatching network-vif-plugged-1a737bae-3b9b-43b4-8a89-0eb98fdf2ec8 {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:21:49 user nova-compute[71731]: WARNING nova.compute.manager [req-7947b582-fa65-4753-b50c-a8d2eb8a54f7 req-6a58486e-a3c1-486f-9490-73caf216503a service nova] [instance: bf350da4-9cc2-4900-adf0-506e44984b42] Received unexpected event network-vif-plugged-1a737bae-3b9b-43b4-8a89-0eb98fdf2ec8 for instance with vm_state building and task_state spawning.
Apr 13 16:21:49 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: bf350da4-9cc2-4900-adf0-506e44984b42] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 16:21:49 user nova-compute[71731]: DEBUG nova.virt.driver [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Emitting event <LifecycleEvent: 1681402909.7818325, bf350da4-9cc2-4900-adf0-506e44984b42 => Started> {{(pid=71731) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 16:21:49 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: bf350da4-9cc2-4900-adf0-506e44984b42] VM Started (Lifecycle Event)
Apr 13 16:21:49 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: bf350da4-9cc2-4900-adf0-506e44984b42] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:21:49 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: bf350da4-9cc2-4900-adf0-506e44984b42] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71731) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 16:21:49 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: bf350da4-9cc2-4900-adf0-506e44984b42] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 16:21:49 user nova-compute[71731]: INFO nova.compute.manager [None req-ce4cfc33-fa3f-4959-a2b8-ca3f91801c9b tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] [instance: bf350da4-9cc2-4900-adf0-506e44984b42] Took 5.56 seconds to spawn the instance on the hypervisor.
Apr 13 16:21:49 user nova-compute[71731]: DEBUG nova.compute.manager [None req-ce4cfc33-fa3f-4959-a2b8-ca3f91801c9b tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] [instance: bf350da4-9cc2-4900-adf0-506e44984b42] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:21:50 user nova-compute[71731]: INFO nova.compute.manager [None req-ce4cfc33-fa3f-4959-a2b8-ca3f91801c9b tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] [instance: bf350da4-9cc2-4900-adf0-506e44984b42] Took 12.21 seconds to build instance.
Apr 13 16:21:50 user nova-compute[71731]: DEBUG nova.network.neutron [req-09438164-3a12-45af-826e-218eb91b1f6f req-14e94222-211e-4aae-a405-3e995626ca27 service nova] [instance: e4ada2d7-7ace-4ed4-86a6-ed121c95e80f] Updated VIF entry in instance network info cache for port d41765b6-0d5b-43c1-bf58-a82a7bbe3137. {{(pid=71731) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 16:21:50 user nova-compute[71731]: DEBUG nova.network.neutron [req-09438164-3a12-45af-826e-218eb91b1f6f req-14e94222-211e-4aae-a405-3e995626ca27 service nova] [instance: e4ada2d7-7ace-4ed4-86a6-ed121c95e80f] Updating instance_info_cache with network_info: [{"id": "a409f60c-6c6a-49f8-8520-04614e804002", "address": "fa:16:3e:ee:b5:cc", "network": {"id": "06e8519d-91e2-4c6a-8b74-6f55609e1764", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-420310439-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7649e366b0164e2fa5b3faa0830b6ea6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa409f60c-6c", "ovs_interfaceid": "a409f60c-6c6a-49f8-8520-04614e804002", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ac94464f-32dc-4cd1-a270-ec8934e77c21", "address": "fa:16:3e:5e:a2:3f", "network": {"id": "4b153def-aec7-4f9e-9604-f1e0afb247f3", "bridge": "br-int", "label": "tempest-device-tagging-net1-1029190313", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.127", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7649e366b0164e2fa5b3faa0830b6ea6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac94464f-32", "ovs_interfaceid": "ac94464f-32dc-4cd1-a270-ec8934e77c21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0125a8df-e91c-4d65-be74-fda2f2d93938", "address": "fa:16:3e:39:06:fc", "network": {"id": "4b153def-aec7-4f9e-9604-f1e0afb247f3", "bridge": "br-int", "label": "tempest-device-tagging-net1-1029190313", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.61", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7649e366b0164e2fa5b3faa0830b6ea6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0125a8df-e9", "ovs_interfaceid": "0125a8df-e91c-4d65-be74-fda2f2d93938", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8f3a3011-e474-4538-812b-9df3968fd629", "address": "fa:16:3e:78:12:fd", "network": {"id": "4b153def-aec7-4f9e-9604-f1e0afb247f3", "bridge": "br-int", "label": "tempest-device-tagging-net1-1029190313", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.202", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7649e366b0164e2fa5b3faa0830b6ea6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f3a3011-e4", "ovs_interfaceid": "8f3a3011-e474-4538-812b-9df3968fd629", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2430beb8-b2e4-4493-bdc5-df6b4c1181c6", "address": "fa:16:3e:30:1c:f5", "network": {"id": "4b153def-aec7-4f9e-9604-f1e0afb247f3", "bridge": "br-int", "label": "tempest-device-tagging-net1-1029190313", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.91", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7649e366b0164e2fa5b3faa0830b6ea6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2430beb8-b2", "ovs_interfaceid": "2430beb8-b2e4-4493-bdc5-df6b4c1181c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "15dca2c3-5048-4e80-8008-c19400ea34e4", "address": "fa:16:3e:df:45:fc", "network": {"id": "310c919b-177f-4fb1-956a-1423f7397f77", "bridge": "br-int", "label": "tempest-device-tagging-net2-188582195", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7649e366b0164e2fa5b3faa0830b6ea6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15dca2c3-50", "ovs_interfaceid": "15dca2c3-5048-4e80-8008-c19400ea34e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d41765b6-0d5b-43c1-bf58-a82a7bbe3137", "address": "fa:16:3e:63:86:1f", "network": {"id": "310c919b-177f-4fb1-956a-1423f7397f77", "bridge": "br-int", "label": "tempest-device-tagging-net2-188582195", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7649e366b0164e2fa5b3faa0830b6ea6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd41765b6-0d", "ovs_interfaceid": "d41765b6-0d5b-43c1-bf58-a82a7bbe3137", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:21:50 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-ce4cfc33-fa3f-4959-a2b8-ca3f91801c9b tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Lock "bf350da4-9cc2-4900-adf0-506e44984b42" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.390s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:21:50 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-09438164-3a12-45af-826e-218eb91b1f6f req-14e94222-211e-4aae-a405-3e995626ca27 service nova] Releasing lock "refresh_cache-e4ada2d7-7ace-4ed4-86a6-ed121c95e80f" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 16:21:50 user nova-compute[71731]: DEBUG nova.compute.manager [req-09438164-3a12-45af-826e-218eb91b1f6f req-14e94222-211e-4aae-a405-3e995626ca27 service nova] [instance: 2549ba85-4e0a-420e-b711-07cafa8c60e9] Received event network-changed-38e92b7c-b7c1-4137-a1db-21bc1d24f3ee {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:21:50 user nova-compute[71731]: DEBUG nova.compute.manager [req-09438164-3a12-45af-826e-218eb91b1f6f req-14e94222-211e-4aae-a405-3e995626ca27 service nova] [instance: 2549ba85-4e0a-420e-b711-07cafa8c60e9] Refreshing instance network info cache due to event network-changed-38e92b7c-b7c1-4137-a1db-21bc1d24f3ee. {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 16:21:50 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-09438164-3a12-45af-826e-218eb91b1f6f req-14e94222-211e-4aae-a405-3e995626ca27 service nova] Acquiring lock "refresh_cache-2549ba85-4e0a-420e-b711-07cafa8c60e9" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 16:21:50 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-09438164-3a12-45af-826e-218eb91b1f6f req-14e94222-211e-4aae-a405-3e995626ca27 service nova] Acquired lock "refresh_cache-2549ba85-4e0a-420e-b711-07cafa8c60e9" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 16:21:50 user nova-compute[71731]: DEBUG nova.network.neutron [req-09438164-3a12-45af-826e-218eb91b1f6f req-14e94222-211e-4aae-a405-3e995626ca27 service nova] [instance: 2549ba85-4e0a-420e-b711-07cafa8c60e9] Refreshing network info cache for port 38e92b7c-b7c1-4137-a1db-21bc1d24f3ee {{(pid=71731) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 16:21:50 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.346s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 16:21:50 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] <== connect_volume: return (1348ms) {'type': 'block', 'scsi_wwn': '23964616135626137', 'path': '/dev/sdc'} {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 16:21:50 user nova-compute[71731]: DEBUG nova.virt.libvirt.volume.iscsi [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] [instance: e4ada2d7-7ace-4ed4-86a6-ed121c95e80f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23964616135626137', 'path': '/dev/sdc'} {{(pid=71731) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 16:21:50 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.224s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 16:21:50 user nova-compute[71731]: WARNING os_brick.initiator.connectors.base [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 16:21:50 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:48af37b0-6938-432e-b374-d992c4dd9ae9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 16:21:50 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:48af37b0-6938-432e-b374-d992c4dd9ae9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 16:21:50 user nova-compute[71731]: INFO os_brick.initiator.connectors.iscsi [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 16:21:50 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48af37b0-6938-432e-b374-d992c4dd9ae9 -p 172.16.0.220:3260 {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:21:50 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48af37b0-6938-432e-b374-d992c4dd9ae9 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:21:50 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[01bcac20-0370-41ab-ab2b-7dc9978fe428]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:21:50 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 16:21:50 user nova-compute[71731]:  {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:21:50 user nova-compute[71731]: DEBUG nova.virt.libvirt.volume.iscsi [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] [instance: e4ada2d7-7ace-4ed4-86a6-ed121c95e80f] Calling os-brick to attach iSCSI Volume {{(pid=71731) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 16:21:50 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8cf0118790>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c20e80fa-58de-431a-8901-2535657aaadf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UVEGFLtB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 16:21:50 user nova-compute[71731]: WARNING os_brick.initiator.connectors.base [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 16:21:50 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 16:21:50 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48af37b0-6938-432e-b374-d992c4dd9ae9 -p 172.16.0.220:3260 --interface default --op new {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:21:50 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48af37b0-6938-432e-b374-d992c4dd9ae9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:21:50 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc181e1b-6a35-47c9-a769-272c01d62d5d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:48af37b0-6938-432e-b374-d992c4dd9ae9] added\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:21:50 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:48af37b0-6938-432e-b374-d992c4dd9ae9] added
Apr 13 16:21:50 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:21:50 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48af37b0-6938-432e-b374-d992c4dd9ae9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:21:50 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48af37b0-6938-432e-b374-d992c4dd9ae9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:21:50 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[47e69a4a-0a27-4abc-ac29-73cf756ab833]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:21:50 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:21:50 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48af37b0-6938-432e-b374-d992c4dd9ae9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:21:50 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48af37b0-6938-432e-b374-d992c4dd9ae9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:21:50 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[093ee5cc-d3be-403a-a1cb-aa8f9a2b2e62]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:21:50 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:21:50 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48af37b0-6938-432e-b374-d992c4dd9ae9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZwQBgjWU {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:21:50 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48af37b0-6938-432e-b374-d992c4dd9ae9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZwQBgjWU" returned: 0 in 0.018s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:21:50 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[27aee77d-6f72-47d3-8ff6-6bc4479d8bbd]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:21:50 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZwQBgjWU'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:21:50 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48af37b0-6938-432e-b374-d992c4dd9ae9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:21:50 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48af37b0-6938-432e-b374-d992c4dd9ae9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:21:50 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e4fff0e-8572-4052-a514-394bb6aab33c]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:21:50 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:21:50 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:21:50 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:21:50 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[08ae7524-4ec6-464c-a228-4b1d9258ca06]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c7f6ad-d2c2-465a-b39e-47347aa85be0 (non-flash)\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:21:50 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984 (non-flash)
Apr 13 16:21:50 user nova-compute[71731]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c7f6ad-d2c2-465a-b39e-47347aa85be0 (non-flash)
Apr 13 16:21:50 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 16:21:50 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984 (non-flash)
Apr 13 16:21:50 user nova-compute[71731]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c7f6ad-d2c2-465a-b39e-47347aa85be0 (non-flash)
Apr 13 16:21:50 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 16:21:50 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48af37b0-6938-432e-b374-d992c4dd9ae9 -p 172.16.0.220:3260 --login {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:21:50 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48af37b0-6938-432e-b374-d992c4dd9ae9 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:21:50 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[801a14a9-da1b-4eca-a8c7-9f58785cfe92]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:48af37b0-6938-432e-b374-d992c4dd9ae9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:48af37b0-6938-432e-b374-d992c4dd9ae9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:21:50 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:48af37b0-6938-432e-b374-d992c4dd9ae9, portal: 172.16.0.220,3260]
Apr 13 16:21:50 user nova-compute[71731]: Login to [iface: default, target: iqn.2010-10.org.openstack:48af37b0-6938-432e-b374-d992c4dd9ae9, portal: 172.16.0.220,3260] successful.
Apr 13 16:21:50 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:21:50 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48af37b0-6938-432e-b374-d992c4dd9ae9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:21:50 user nova-compute[71731]: DEBUG nova.network.neutron [req-09438164-3a12-45af-826e-218eb91b1f6f req-14e94222-211e-4aae-a405-3e995626ca27 service nova] [instance: 2549ba85-4e0a-420e-b711-07cafa8c60e9] Updated VIF entry in instance network info cache for port 38e92b7c-b7c1-4137-a1db-21bc1d24f3ee. {{(pid=71731) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 16:21:50 user nova-compute[71731]: DEBUG nova.network.neutron [req-09438164-3a12-45af-826e-218eb91b1f6f req-14e94222-211e-4aae-a405-3e995626ca27 service nova] [instance: 2549ba85-4e0a-420e-b711-07cafa8c60e9] Updating instance_info_cache with network_info: [{"id": "36152688-366c-40a2-8bf9-88f69925594a", "address": "fa:16:3e:1c:8b:59", "network": {"id": "f11266a1-4740-4cb3-8467-e0e95870ac22", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-689537131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbe4e9fb786d4015b035b4d00f75a1ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36152688-36", "ovs_interfaceid": "36152688-366c-40a2-8bf9-88f69925594a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d7155dcf-9e83-4579-b81a-7277d4a9eeaf", "address": "fa:16:3e:d0:1a:bc", "network": {"id": "5d158a82-de85-48b5-9f17-40e61e9b0df8", "bridge": "br-int", "label": "tempest-device-tagging-net1-574676351", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.246", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bbe4e9fb786d4015b035b4d00f75a1ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7155dcf-9e", "ovs_interfaceid": "d7155dcf-9e83-4579-b81a-7277d4a9eeaf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4c481745-6342-43f8-9040-3ea1d8c5c572", "address": "fa:16:3e:e7:ea:ff", "network": {"id": "5d158a82-de85-48b5-9f17-40e61e9b0df8", "bridge": "br-int", "label": "tempest-device-tagging-net1-574676351", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.164", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bbe4e9fb786d4015b035b4d00f75a1ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c481745-63", "ovs_interfaceid": "4c481745-6342-43f8-9040-3ea1d8c5c572", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0152bbb9-d50d-4e58-8a2b-727c4675ea2f", "address": "fa:16:3e:0d:4d:58", "network": {"id": "5d158a82-de85-48b5-9f17-40e61e9b0df8", "bridge": "br-int", "label": "tempest-device-tagging-net1-574676351", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.142", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bbe4e9fb786d4015b035b4d00f75a1ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0152bbb9-d5", "ovs_interfaceid": "0152bbb9-d50d-4e58-8a2b-727c4675ea2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3730ed6e-b093-4232-800b-b064d650e9e8", "address": "fa:16:3e:a8:c4:f6", "network": {"id": "5d158a82-de85-48b5-9f17-40e61e9b0df8", "bridge": "br-int", "label": "tempest-device-tagging-net1-574676351", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.38", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bbe4e9fb786d4015b035b4d00f75a1ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3730ed6e-b0", "ovs_interfaceid": "3730ed6e-b093-4232-800b-b064d650e9e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0fbdf291-df5d-41c5-a765-7145a87da272", "address": "fa:16:3e:dc:57:7b", "network": {"id": "4224b04f-23ed-464e-9b2c-df8c843f9287", "bridge": "br-int", "label": "tempest-device-tagging-net2-109401200", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "bbe4e9fb786d4015b035b4d00f75a1ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fbdf291-df", "ovs_interfaceid": "0fbdf291-df5d-41c5-a765-7145a87da272", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "38e92b7c-b7c1-4137-a1db-21bc1d24f3ee", "address": "fa:16:3e:a3:dd:27", "network": {"id": "4224b04f-23ed-464e-9b2c-df8c843f9287", "bridge": "br-int", "label": "tempest-device-tagging-net2-109401200", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "bbe4e9fb786d4015b035b4d00f75a1ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38e92b7c-b7", "ovs_interfaceid": "38e92b7c-b7c1-4137-a1db-21bc1d24f3ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:21:50 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48af37b0-6938-432e-b374-d992c4dd9ae9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:21:50 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b68092f-69ef-4277-a767-eb55d69398b7]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:21:50 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:21:50 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:21:50 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-09438164-3a12-45af-826e-218eb91b1f6f req-14e94222-211e-4aae-a405-3e995626ca27 service nova] Releasing lock "refresh_cache-2549ba85-4e0a-420e-b711-07cafa8c60e9" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 16:21:50 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:21:50 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc232c15-2fa4-4422-aec4-65095dd34282]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c7f6ad-d2c2-465a-b39e-47347aa85be0 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48af37b0-6938-432e-b374-d992c4dd9ae9 (non-flash)\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:21:50 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984 (non-flash)
Apr 13 16:21:50 user nova-compute[71731]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c7f6ad-d2c2-465a-b39e-47347aa85be0 (non-flash)
Apr 13 16:21:50 user nova-compute[71731]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48af37b0-6938-432e-b374-d992c4dd9ae9 (non-flash)
Apr 13 16:21:50 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 16:21:50 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984 (non-flash)
Apr 13 16:21:50 user nova-compute[71731]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c7f6ad-d2c2-465a-b39e-47347aa85be0 (non-flash)
Apr 13 16:21:50 user nova-compute[71731]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48af37b0-6938-432e-b374-d992c4dd9ae9 (non-flash)
Apr 13 16:21:50 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 16:21:50 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:48af37b0-6938-432e-b374-d992c4dd9ae9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.288s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 16:21:50 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Connected to 172.16.0.220:3260 {{(pid=71731) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 16:21:50 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] HCTL ('35', '-', '-', 0) found on session 4 with lun 0 {{(pid=71731) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 16:21:50 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=71731) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 16:21:50 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:21:50 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.023s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:21:50 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[f109dffc-de18-4f09-8f67-d845b251573b]: (4, ('- - 0', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:21:50 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=71731) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 16:21:50 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:48af37b0-6938-432e-b374-d992c4dd9ae9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZwQBgjWU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71731) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 16:21:50 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:21:50 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:21:51 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.334s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 16:21:51 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] <== connect_volume: return (2558ms) {'type': 'block', 'scsi_wwn': '23666323135333764', 'path': '/dev/sdd'} {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 16:21:51 user nova-compute[71731]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] [instance: 2549ba85-4e0a-420e-b711-07cafa8c60e9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23666323135333764', 'path': '/dev/sdd'} {{(pid=71731) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 16:21:51 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.305s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 16:21:51 user nova-compute[71731]: WARNING os_brick.initiator.connectors.base [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 16:21:51 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c20e80fa-58de-431a-8901-2535657aaadf" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 16:21:51 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c20e80fa-58de-431a-8901-2535657aaadf" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 16:21:51 user nova-compute[71731]: INFO os_brick.initiator.connectors.iscsi [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 16:21:51 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c20e80fa-58de-431a-8901-2535657aaadf -p 172.16.0.220:3260 {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:21:51 user nova-compute[71731]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] [instance: 2549ba85-4e0a-420e-b711-07cafa8c60e9] Calling os-brick to attach iSCSI Volume {{(pid=71731) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 16:21:51 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8cf0118790>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:27919afc-8990-4ed5-af9e-9d6b3d7b231e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cajfYKuC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 16:21:51 user nova-compute[71731]: WARNING os_brick.initiator.connectors.base [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 16:21:51 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 16:21:51 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c20e80fa-58de-431a-8901-2535657aaadf -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:21:51 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[25317304-a6a0-4c8d-9944-643e1179ea34]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:21:51 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 16:21:51 user nova-compute[71731]:  {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:21:51 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c20e80fa-58de-431a-8901-2535657aaadf -p 172.16.0.220:3260 --interface default --op new {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:21:51 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c20e80fa-58de-431a-8901-2535657aaadf -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:21:51 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[6367345a-8aa0-43fd-b5e6-494b4e8e77d1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c20e80fa-58de-431a-8901-2535657aaadf] added\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:21:51 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c20e80fa-58de-431a-8901-2535657aaadf] added
Apr 13 16:21:51 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:21:51 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c20e80fa-58de-431a-8901-2535657aaadf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:21:51 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c20e80fa-58de-431a-8901-2535657aaadf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:21:51 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[4af190ab-9fec-4d80-b8ca-5230477ce8c3]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:21:51 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:21:51 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c20e80fa-58de-431a-8901-2535657aaadf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:21:51 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c20e80fa-58de-431a-8901-2535657aaadf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:21:51 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d8d3c68-c59f-482e-8cef-4fb55917d5d0]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:21:51 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:21:51 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c20e80fa-58de-431a-8901-2535657aaadf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UVEGFLtB {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:21:51 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c20e80fa-58de-431a-8901-2535657aaadf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UVEGFLtB" returned: 0 in 0.023s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:21:51 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fa7e6b7-961a-4948-9784-962c19ff1ffd]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:21:51 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UVEGFLtB'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:21:51 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c20e80fa-58de-431a-8901-2535657aaadf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:21:51 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c20e80fa-58de-431a-8901-2535657aaadf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:21:51 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[da52a9d5-a3c8-488a-9475-bb3da4e488c5]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:21:51 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:21:51 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:21:51 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:21:51 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bd2a08e-7d12-4a23-b608-ed72dcdccd8c]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c7f6ad-d2c2-465a-b39e-47347aa85be0 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48af37b0-6938-432e-b374-d992c4dd9ae9 (non-flash)\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:21:51 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984 (non-flash)
Apr 13 16:21:51 user nova-compute[71731]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c7f6ad-d2c2-465a-b39e-47347aa85be0 (non-flash)
Apr 13 16:21:51 user nova-compute[71731]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48af37b0-6938-432e-b374-d992c4dd9ae9 (non-flash)
Apr 13 16:21:51 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 16:21:51 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984 (non-flash)
Apr 13 16:21:51 user nova-compute[71731]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c7f6ad-d2c2-465a-b39e-47347aa85be0 (non-flash)
Apr 13 16:21:51 user nova-compute[71731]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48af37b0-6938-432e-b374-d992c4dd9ae9 (non-flash)
Apr 13 16:21:51 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 16:21:51 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c20e80fa-58de-431a-8901-2535657aaadf -p 172.16.0.220:3260 --login {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:21:51 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c20e80fa-58de-431a-8901-2535657aaadf -p 172.16.0.220:3260 --login" returned: 0 in 0.075s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:21:51 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1619775-eb99-4cc7-b3aa-be8cfac16137]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c20e80fa-58de-431a-8901-2535657aaadf, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c20e80fa-58de-431a-8901-2535657aaadf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:21:51 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c20e80fa-58de-431a-8901-2535657aaadf, portal: 172.16.0.220,3260]
Apr 13 16:21:51 user nova-compute[71731]: Login to [iface: default, target: iqn.2010-10.org.openstack:c20e80fa-58de-431a-8901-2535657aaadf, portal: 172.16.0.220,3260] successful.
Apr 13 16:21:51 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:21:51 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c20e80fa-58de-431a-8901-2535657aaadf -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:21:51 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c20e80fa-58de-431a-8901-2535657aaadf -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:21:51 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[38bc7ab0-3a77-447a-b7ed-a38e30378c0b]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:21:51 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:21:51 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:21:51 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:21:51 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec264561-cadd-4ee1-91e8-1241921b450c]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c7f6ad-d2c2-465a-b39e-47347aa85be0 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48af37b0-6938-432e-b374-d992c4dd9ae9 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c20e80fa-58de-431a-8901-2535657aaadf (non-flash)\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:21:51 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984 (non-flash)
Apr 13 16:21:51 user nova-compute[71731]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c7f6ad-d2c2-465a-b39e-47347aa85be0 (non-flash)
Apr 13 16:21:51 user nova-compute[71731]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48af37b0-6938-432e-b374-d992c4dd9ae9 (non-flash)
Apr 13 16:21:51 user nova-compute[71731]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c20e80fa-58de-431a-8901-2535657aaadf (non-flash)
Apr 13 16:21:51 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 16:21:51 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984 (non-flash)
Apr 13 16:21:51 user nova-compute[71731]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c7f6ad-d2c2-465a-b39e-47347aa85be0 (non-flash)
Apr 13 16:21:51 user nova-compute[71731]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48af37b0-6938-432e-b374-d992c4dd9ae9 (non-flash)
Apr 13 16:21:51 user nova-compute[71731]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c20e80fa-58de-431a-8901-2535657aaadf (non-flash)
Apr 13 16:21:51 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 16:21:51 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c20e80fa-58de-431a-8901-2535657aaadf" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.308s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 16:21:51 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Connected to 172.16.0.220:3260 {{(pid=71731) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 16:21:51 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] HCTL ('36', '-', '-', 0) found on session 5 with lun 0 {{(pid=71731) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 16:21:51 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=71731) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 16:21:51 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:21:52 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.022s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:21:52 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4e966c8-bb8e-47f0-9aa0-6d20b37a9a80]: (4, ('- - 0', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:21:52 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Searching for a device in session 5 and hctl ['36', '*', '*', 0] yield: sde {{(pid=71731) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 16:21:52 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:c20e80fa-58de-431a-8901-2535657aaadf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UVEGFLtB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71731) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 16:21:53 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.355s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 16:21:53 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] <== connect_volume: return (2660ms) {'type': 'block', 'scsi_wwn': '23762656462356538', 'path': '/dev/sde'} {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 16:21:53 user nova-compute[71731]: DEBUG nova.virt.libvirt.volume.iscsi [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] [instance: e4ada2d7-7ace-4ed4-86a6-ed121c95e80f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23762656462356538', 'path': '/dev/sde'} {{(pid=71731) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 16:21:53 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.331s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 16:21:53 user nova-compute[71731]: WARNING os_brick.initiator.connectors.base [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 16:21:53 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:27919afc-8990-4ed5-af9e-9d6b3d7b231e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 16:21:53 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:27919afc-8990-4ed5-af9e-9d6b3d7b231e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 16:21:53 user nova-compute[71731]: INFO os_brick.initiator.connectors.iscsi [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 16:21:53 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27919afc-8990-4ed5-af9e-9d6b3d7b231e -p 172.16.0.220:3260 {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:21:53 user nova-compute[71731]: DEBUG nova.virt.libvirt.volume.iscsi [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] [instance: e4ada2d7-7ace-4ed4-86a6-ed121c95e80f] Calling os-brick to attach iSCSI Volume {{(pid=71731) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 16:21:53 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8cf0118790>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:cc639d00-ef6b-4121-bcb0-c65ec0347abd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dOqXsWnC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 16:21:53 user nova-compute[71731]: WARNING os_brick.initiator.connectors.base [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 16:21:53 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 16:21:53 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27919afc-8990-4ed5-af9e-9d6b3d7b231e -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:21:53 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[4566c6ee-dd85-4a3d-b0d5-04e7755de323]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:21:53 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 16:21:53 user nova-compute[71731]:  {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:21:53 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27919afc-8990-4ed5-af9e-9d6b3d7b231e -p 172.16.0.220:3260 --interface default --op new {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:21:53 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27919afc-8990-4ed5-af9e-9d6b3d7b231e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:21:53 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[6da1bda4-dcd7-4bf6-a535-7c811ff86a6e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:27919afc-8990-4ed5-af9e-9d6b3d7b231e] added\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:21:53 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:27919afc-8990-4ed5-af9e-9d6b3d7b231e] added
Apr 13 16:21:53 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:21:53 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27919afc-8990-4ed5-af9e-9d6b3d7b231e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:21:53 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27919afc-8990-4ed5-af9e-9d6b3d7b231e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:21:53 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[fde4a7d2-e32c-40e3-915f-ac8df130b3ba]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:21:53 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:21:53 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27919afc-8990-4ed5-af9e-9d6b3d7b231e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:21:53 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27919afc-8990-4ed5-af9e-9d6b3d7b231e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:21:53 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1884d38-ebdf-44f4-bd11-7341adea3702]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:21:53 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:21:53 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27919afc-8990-4ed5-af9e-9d6b3d7b231e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cajfYKuC {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:21:53 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27919afc-8990-4ed5-af9e-9d6b3d7b231e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cajfYKuC" returned: 0 in 0.018s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:21:53 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[98272495-9c5a-4ebd-8965-32d6099bee36]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:21:53 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cajfYKuC'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:21:53 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27919afc-8990-4ed5-af9e-9d6b3d7b231e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:21:53 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27919afc-8990-4ed5-af9e-9d6b3d7b231e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:21:53 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c1cee1b-18c3-4464-9a19-f70586299c18]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:21:53 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:21:53 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:21:53 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:21:53 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[41586d44-6af9-464d-8d2d-019d4368a207]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c7f6ad-d2c2-465a-b39e-47347aa85be0 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48af37b0-6938-432e-b374-d992c4dd9ae9 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c20e80fa-58de-431a-8901-2535657aaadf (non-flash)\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:21:53 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984 (non-flash)
Apr 13 16:21:53 user nova-compute[71731]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c7f6ad-d2c2-465a-b39e-47347aa85be0 (non-flash)
Apr 13 16:21:53 user nova-compute[71731]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48af37b0-6938-432e-b374-d992c4dd9ae9 (non-flash)
Apr 13 16:21:53 user nova-compute[71731]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c20e80fa-58de-431a-8901-2535657aaadf (non-flash)
Apr 13 16:21:53 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 16:21:53 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984 (non-flash)
Apr 13 16:21:53 user nova-compute[71731]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c7f6ad-d2c2-465a-b39e-47347aa85be0 (non-flash)
Apr 13 16:21:53 user nova-compute[71731]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48af37b0-6938-432e-b374-d992c4dd9ae9 (non-flash)
Apr 13 16:21:53 user nova-compute[71731]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c20e80fa-58de-431a-8901-2535657aaadf (non-flash)
Apr 13 16:21:53 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 16:21:53 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27919afc-8990-4ed5-af9e-9d6b3d7b231e -p 172.16.0.220:3260 --login {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:21:53 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27919afc-8990-4ed5-af9e-9d6b3d7b231e -p 172.16.0.220:3260 --login" returned: 0 in 0.085s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:21:53 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[4987af42-c66e-4049-980d-b720ab9e6f49]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:27919afc-8990-4ed5-af9e-9d6b3d7b231e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:27919afc-8990-4ed5-af9e-9d6b3d7b231e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:21:53 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:27919afc-8990-4ed5-af9e-9d6b3d7b231e, portal: 172.16.0.220,3260]
Apr 13 16:21:53 user nova-compute[71731]: Login to [iface: default, target: iqn.2010-10.org.openstack:27919afc-8990-4ed5-af9e-9d6b3d7b231e, portal: 172.16.0.220,3260] successful.
Apr 13 16:21:53 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:21:53 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27919afc-8990-4ed5-af9e-9d6b3d7b231e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:21:53 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27919afc-8990-4ed5-af9e-9d6b3d7b231e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.031s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:21:53 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcbe8de0-d458-489a-a600-aad2c4ad2d20]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:21:53 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:21:53 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:21:53 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:21:53 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[33899dfb-1807-49db-973f-e4ce2fae0c2a]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c7f6ad-d2c2-465a-b39e-47347aa85be0 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48af37b0-6938-432e-b374-d992c4dd9ae9 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c20e80fa-58de-431a-8901-2535657aaadf (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27919afc-8990-4ed5-af9e-9d6b3d7b231e (non-flash)\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:21:53 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984 (non-flash)
Apr 13 16:21:53 user nova-compute[71731]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c7f6ad-d2c2-465a-b39e-47347aa85be0 (non-flash)
Apr 13 16:21:53 user nova-compute[71731]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48af37b0-6938-432e-b374-d992c4dd9ae9 (non-flash)
Apr 13 16:21:53 user nova-compute[71731]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c20e80fa-58de-431a-8901-2535657aaadf (non-flash)
Apr 13 16:21:53 user nova-compute[71731]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27919afc-8990-4ed5-af9e-9d6b3d7b231e (non-flash)
Apr 13 16:21:53 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 16:21:53 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984 (non-flash)
Apr 13 16:21:53 user nova-compute[71731]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c7f6ad-d2c2-465a-b39e-47347aa85be0 (non-flash)
Apr 13 16:21:53 user nova-compute[71731]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48af37b0-6938-432e-b374-d992c4dd9ae9 (non-flash)
Apr 13 16:21:53 user nova-compute[71731]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c20e80fa-58de-431a-8901-2535657aaadf (non-flash)
Apr 13 16:21:53 user nova-compute[71731]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27919afc-8990-4ed5-af9e-9d6b3d7b231e (non-flash)
Apr 13 16:21:53 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 16:21:53 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:27919afc-8990-4ed5-af9e-9d6b3d7b231e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.330s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 16:21:53 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Connected to 172.16.0.220:3260 {{(pid=71731) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 16:21:53 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] HCTL ('37', '-', '-', 0) found on session 6 with lun 0 {{(pid=71731) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 16:21:53 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=71731) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 16:21:53 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:21:53 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.022s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:21:53 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[e042d5df-b8c0-45f0-a446-716b3164b09c]: (4, ('- - 0', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:21:53 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:21:53 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Searching for a device in session 6 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=71731) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 16:21:53 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:27919afc-8990-4ed5-af9e-9d6b3d7b231e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cajfYKuC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71731) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 16:21:54 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.389s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 16:21:54 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] <== connect_volume: return (2720ms) {'type': 'block', 'scsi_wwn': '23038396262653434', 'path': '/dev/sdf'} {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 16:21:54 user nova-compute[71731]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] [instance: 2549ba85-4e0a-420e-b711-07cafa8c60e9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23038396262653434', 'path': '/dev/sdf'} {{(pid=71731) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 16:21:54 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.365s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 16:21:54 user nova-compute[71731]: WARNING os_brick.initiator.connectors.base [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 16:21:54 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cc639d00-ef6b-4121-bcb0-c65ec0347abd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 16:21:54 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cc639d00-ef6b-4121-bcb0-c65ec0347abd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 16:21:54 user nova-compute[71731]: INFO os_brick.initiator.connectors.iscsi [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 16:21:54 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc639d00-ef6b-4121-bcb0-c65ec0347abd -p 172.16.0.220:3260 {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:21:54 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc639d00-ef6b-4121-bcb0-c65ec0347abd -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:21:54 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[8970a2d0-56ce-4e02-8558-b24e0e9d9ef4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:21:54 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 16:21:54 user nova-compute[71731]:  {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:21:54 user nova-compute[71731]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] [instance: 2549ba85-4e0a-420e-b711-07cafa8c60e9] Calling os-brick to attach iSCSI Volume {{(pid=71731) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 16:21:54 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8cf0118790>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e0f728f3-fbb5-4ed8-a78b-a5d982b03f7d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nSEqPQZM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 16:21:54 user nova-compute[71731]: WARNING os_brick.initiator.connectors.base [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 16:21:54 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 16:21:54 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc639d00-ef6b-4121-bcb0-c65ec0347abd -p 172.16.0.220:3260 --interface default --op new {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:21:54 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc639d00-ef6b-4121-bcb0-c65ec0347abd -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:21:54 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[910f8b55-472b-46a1-abe5-d0f06bbf68cc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cc639d00-ef6b-4121-bcb0-c65ec0347abd] added\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:21:54 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cc639d00-ef6b-4121-bcb0-c65ec0347abd] added
Apr 13 16:21:54 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:21:54 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc639d00-ef6b-4121-bcb0-c65ec0347abd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:21:54 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc639d00-ef6b-4121-bcb0-c65ec0347abd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:21:54 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b47f8e8-ffe1-4f75-9c7f-2bf055ca6e22]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:21:54 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:21:54 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc639d00-ef6b-4121-bcb0-c65ec0347abd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:21:54 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc639d00-ef6b-4121-bcb0-c65ec0347abd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:21:54 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[74f89a13-a9c3-4c57-a4b2-380e1336c818]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:21:54 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:21:54 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc639d00-ef6b-4121-bcb0-c65ec0347abd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dOqXsWnC {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:21:54 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc639d00-ef6b-4121-bcb0-c65ec0347abd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dOqXsWnC" returned: 0 in 0.020s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:21:54 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8821fb8-a95b-4f47-b910-8207f77dab3f]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:21:54 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dOqXsWnC'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:21:54 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc639d00-ef6b-4121-bcb0-c65ec0347abd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:21:54 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc639d00-ef6b-4121-bcb0-c65ec0347abd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:21:54 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[798701bf-6727-4742-89fd-fce552a650e6]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:21:54 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:21:54 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:21:54 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:21:54 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[80d935e4-2b5d-43ca-8f7f-49e3b8afd1b8]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c7f6ad-d2c2-465a-b39e-47347aa85be0 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48af37b0-6938-432e-b374-d992c4dd9ae9 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c20e80fa-58de-431a-8901-2535657aaadf (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27919afc-8990-4ed5-af9e-9d6b3d7b231e (non-flash)\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:21:54 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984 (non-flash)
Apr 13 16:21:54 user nova-compute[71731]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c7f6ad-d2c2-465a-b39e-47347aa85be0 (non-flash)
Apr 13 16:21:54 user nova-compute[71731]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48af37b0-6938-432e-b374-d992c4dd9ae9 (non-flash)
Apr 13 16:21:54 user nova-compute[71731]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c20e80fa-58de-431a-8901-2535657aaadf (non-flash)
Apr 13 16:21:54 user nova-compute[71731]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27919afc-8990-4ed5-af9e-9d6b3d7b231e (non-flash)
Apr 13 16:21:54 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 16:21:54 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984 (non-flash)
Apr 13 16:21:54 user nova-compute[71731]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c7f6ad-d2c2-465a-b39e-47347aa85be0 (non-flash)
Apr 13 16:21:54 user nova-compute[71731]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48af37b0-6938-432e-b374-d992c4dd9ae9 (non-flash)
Apr 13 16:21:54 user nova-compute[71731]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c20e80fa-58de-431a-8901-2535657aaadf (non-flash)
Apr 13 16:21:54 user nova-compute[71731]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27919afc-8990-4ed5-af9e-9d6b3d7b231e (non-flash)
Apr 13 16:21:54 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 16:21:54 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc639d00-ef6b-4121-bcb0-c65ec0347abd -p 172.16.0.220:3260 --login {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:21:54 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc639d00-ef6b-4121-bcb0-c65ec0347abd -p 172.16.0.220:3260 --login" returned: 0 in 0.086s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:21:54 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a0f646b-73b7-46a3-b176-41fd9e910937]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cc639d00-ef6b-4121-bcb0-c65ec0347abd, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cc639d00-ef6b-4121-bcb0-c65ec0347abd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:21:54 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cc639d00-ef6b-4121-bcb0-c65ec0347abd, portal: 172.16.0.220,3260]
Apr 13 16:21:54 user nova-compute[71731]: Login to [iface: default, target: iqn.2010-10.org.openstack:cc639d00-ef6b-4121-bcb0-c65ec0347abd, portal: 172.16.0.220,3260] successful.
Apr 13 16:21:54 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:21:54 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc639d00-ef6b-4121-bcb0-c65ec0347abd -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:21:54 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc639d00-ef6b-4121-bcb0-c65ec0347abd -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:21:54 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[40bc3642-97e9-4dc4-879b-032c50f66b12]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:21:54 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:21:54 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:21:54 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:21:54 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5ec2071-f0ae-4b38-a179-c3905e4e7534]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c7f6ad-d2c2-465a-b39e-47347aa85be0 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48af37b0-6938-432e-b374-d992c4dd9ae9 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c20e80fa-58de-431a-8901-2535657aaadf (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27919afc-8990-4ed5-af9e-9d6b3d7b231e (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc639d00-ef6b-4121-bcb0-c65ec0347abd (non-flash)\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:21:54 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984 (non-flash)
Apr 13 16:21:54 user nova-compute[71731]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c7f6ad-d2c2-465a-b39e-47347aa85be0 (non-flash)
Apr 13 16:21:54 user nova-compute[71731]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48af37b0-6938-432e-b374-d992c4dd9ae9 (non-flash)
Apr 13 16:21:54 user nova-compute[71731]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c20e80fa-58de-431a-8901-2535657aaadf (non-flash)
Apr 13 16:21:54 user nova-compute[71731]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27919afc-8990-4ed5-af9e-9d6b3d7b231e (non-flash)
Apr 13 16:21:54 user nova-compute[71731]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc639d00-ef6b-4121-bcb0-c65ec0347abd (non-flash)
Apr 13 16:21:54 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 16:21:54 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984 (non-flash)
Apr 13 16:21:54 user nova-compute[71731]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c7f6ad-d2c2-465a-b39e-47347aa85be0 (non-flash)
Apr 13 16:21:54 user nova-compute[71731]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48af37b0-6938-432e-b374-d992c4dd9ae9 (non-flash)
Apr 13 16:21:54 user nova-compute[71731]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c20e80fa-58de-431a-8901-2535657aaadf (non-flash)
Apr 13 16:21:54 user nova-compute[71731]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27919afc-8990-4ed5-af9e-9d6b3d7b231e (non-flash)
Apr 13 16:21:54 user nova-compute[71731]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc639d00-ef6b-4121-bcb0-c65ec0347abd (non-flash)
Apr 13 16:21:54 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 16:21:54 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cc639d00-ef6b-4121-bcb0-c65ec0347abd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.330s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 16:21:54 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Connected to 172.16.0.220:3260 {{(pid=71731) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 16:21:54 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] HCTL ('38', '-', '-', 0) found on session 7 with lun 0 {{(pid=71731) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 16:21:54 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=71731) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 16:21:54 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:21:54 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.016s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:21:54 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e9a0f18-60da-430d-a1b3-3a4807c5e3cc]: (4, ('- - 0', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:21:54 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Searching for a device in session 7 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=71731) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 16:21:54 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:cc639d00-ef6b-4121-bcb0-c65ec0347abd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dOqXsWnC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71731) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 16:21:55 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.364s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 16:21:55 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] <== connect_volume: return (2729ms) {'type': 'block', 'scsi_wwn': '23037306564313962', 'path': '/dev/sdg'} {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 16:21:55 user nova-compute[71731]: DEBUG nova.virt.libvirt.volume.iscsi [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] [instance: e4ada2d7-7ace-4ed4-86a6-ed121c95e80f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23037306564313962', 'path': '/dev/sdg'} {{(pid=71731) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 16:21:55 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.333s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 16:21:55 user nova-compute[71731]: WARNING os_brick.initiator.connectors.base [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 16:21:55 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e0f728f3-fbb5-4ed8-a78b-a5d982b03f7d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 16:21:55 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e0f728f3-fbb5-4ed8-a78b-a5d982b03f7d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 16:21:55 user nova-compute[71731]: INFO os_brick.initiator.connectors.iscsi [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 16:21:55 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0f728f3-fbb5-4ed8-a78b-a5d982b03f7d -p 172.16.0.220:3260 {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:21:55 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0f728f3-fbb5-4ed8-a78b-a5d982b03f7d -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:21:55 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[998634d8-ee0e-455e-9998-d233defc8b7d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:21:55 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 16:21:55 user nova-compute[71731]:  {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:21:55 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0f728f3-fbb5-4ed8-a78b-a5d982b03f7d -p 172.16.0.220:3260 --interface default --op new {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:21:55 user nova-compute[71731]: DEBUG nova.virt.libvirt.vif [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T16:21:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-425684793',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-425684793',id=8,image_ref='708622a9-7465-4492-ade8-b827198f7e30',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI5YQpLaGCSGL4ntWt11BFFgnGrQ3fItNIdB138VboyJqclL9H8Ulyx/xxT8IGEQfueXv2SL9+Q3QwgV/gEuhZSJPXCS54honN2kOhqtEWQCcit240y/RW04xC4ADo4EdQ==',key_name='tempest-keypair-135831071',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7649e366b0164e2fa5b3faa0830b6ea6',ramdisk_id='',reservation_id='r-newglzq9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='708622a9-7465-4492-ade8-b827198f7e30',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1193811043',owner_user_name='tempest-TaggedBootDevicesTest_v242-1193811043-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T16:21:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7e50bd9d540549a194f706dac48ce93d',uuid=e4ada2d7-7ace-4ed4-86a6-ed121c95e80f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a409f60c-6c6a-49f8-8520-04614e804002", "address": "fa:16:3e:ee:b5:cc", "network": {"id": "06e8519d-91e2-4c6a-8b74-6f55609e1764", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-420310439-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7649e366b0164e2fa5b3faa0830b6ea6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa409f60c-6c", "ovs_interfaceid": "a409f60c-6c6a-49f8-8520-04614e804002", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71731) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 16:21:55 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Converting VIF {"id": "a409f60c-6c6a-49f8-8520-04614e804002", "address": "fa:16:3e:ee:b5:cc", "network": {"id": "06e8519d-91e2-4c6a-8b74-6f55609e1764", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-420310439-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7649e366b0164e2fa5b3faa0830b6ea6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa409f60c-6c", "ovs_interfaceid": "a409f60c-6c6a-49f8-8520-04614e804002", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 16:21:55 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ee:b5:cc,bridge_name='br-int',has_traffic_filtering=True,id=a409f60c-6c6a-49f8-8520-04614e804002,network=Network(06e8519d-91e2-4c6a-8b74-6f55609e1764),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa409f60c-6c') {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 16:21:55 user nova-compute[71731]: DEBUG nova.virt.libvirt.vif [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T16:21:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-425684793',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-425684793',id=8,image_ref='708622a9-7465-4492-ade8-b827198f7e30',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI5YQpLaGCSGL4ntWt11BFFgnGrQ3fItNIdB138VboyJqclL9H8Ulyx/xxT8IGEQfueXv2SL9+Q3QwgV/gEuhZSJPXCS54honN2kOhqtEWQCcit240y/RW04xC4ADo4EdQ==',key_name='tempest-keypair-135831071',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7649e366b0164e2fa5b3faa0830b6ea6',ramdisk_id='',reservation_id='r-newglzq9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='708622a9-7465-4492-ade8-b827198f7e30',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1193811043',owner_user_name='tempest-TaggedBootDevicesTest_v242-1193811043-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T16:21:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7e50bd9d540549a194f706dac48ce93d',uuid=e4ada2d7-7ace-4ed4-86a6-ed121c95e80f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ac94464f-32dc-4cd1-a270-ec8934e77c21", "address": "fa:16:3e:5e:a2:3f", "network": {"id": "4b153def-aec7-4f9e-9604-f1e0afb247f3", "bridge": "br-int", "label": "tempest-device-tagging-net1-1029190313", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.127", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7649e366b0164e2fa5b3faa0830b6ea6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac94464f-32", "ovs_interfaceid": "ac94464f-32dc-4cd1-a270-ec8934e77c21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71731) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 16:21:55 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Converting VIF {"id": "ac94464f-32dc-4cd1-a270-ec8934e77c21", "address": "fa:16:3e:5e:a2:3f", "network": {"id": "4b153def-aec7-4f9e-9604-f1e0afb247f3", "bridge": "br-int", "label": "tempest-device-tagging-net1-1029190313", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.127", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7649e366b0164e2fa5b3faa0830b6ea6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac94464f-32", "ovs_interfaceid": "ac94464f-32dc-4cd1-a270-ec8934e77c21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 16:21:55 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5e:a2:3f,bridge_name='br-int',has_traffic_filtering=True,id=ac94464f-32dc-4cd1-a270-ec8934e77c21,network=Network(4b153def-aec7-4f9e-9604-f1e0afb247f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapac94464f-32') {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 16:21:55 user nova-compute[71731]: DEBUG nova.virt.libvirt.vif [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T16:21:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-425684793',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-425684793',id=8,image_ref='708622a9-7465-4492-ade8-b827198f7e30',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI5YQpLaGCSGL4ntWt11BFFgnGrQ3fItNIdB138VboyJqclL9H8Ulyx/xxT8IGEQfueXv2SL9+Q3QwgV/gEuhZSJPXCS54honN2kOhqtEWQCcit240y/RW04xC4ADo4EdQ==',key_name='tempest-keypair-135831071',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7649e366b0164e2fa5b3faa0830b6ea6',ramdisk_id='',reservation_id='r-newglzq9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='708622a9-7465-4492-ade8-b827198f7e30',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1193811043',owner_user_name='tempest-TaggedBootDevicesTest_v242-1193811043-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T16:21:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7e50bd9d540549a194f706dac48ce93d',uuid=e4ada2d7-7ace-4ed4-86a6-ed121c95e80f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0125a8df-e91c-4d65-be74-fda2f2d93938", "address": "fa:16:3e:39:06:fc", "network": {"id": "4b153def-aec7-4f9e-9604-f1e0afb247f3", "bridge": "br-int", "label": "tempest-device-tagging-net1-1029190313", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.61", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7649e366b0164e2fa5b3faa0830b6ea6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0125a8df-e9", "ovs_interfaceid": "0125a8df-e91c-4d65-be74-fda2f2d93938", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71731) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 16:21:55 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Converting VIF {"id": "0125a8df-e91c-4d65-be74-fda2f2d93938", "address": "fa:16:3e:39:06:fc", "network": {"id": "4b153def-aec7-4f9e-9604-f1e0afb247f3", "bridge": "br-int", "label": "tempest-device-tagging-net1-1029190313", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.61", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7649e366b0164e2fa5b3faa0830b6ea6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0125a8df-e9", "ovs_interfaceid": "0125a8df-e91c-4d65-be74-fda2f2d93938", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 16:21:55 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:39:06:fc,bridge_name='br-int',has_traffic_filtering=True,id=0125a8df-e91c-4d65-be74-fda2f2d93938,network=Network(4b153def-aec7-4f9e-9604-f1e0afb247f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap0125a8df-e9') {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 16:21:55 user nova-compute[71731]: DEBUG nova.virt.libvirt.vif [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T16:21:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-425684793',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-425684793',id=8,image_ref='708622a9-7465-4492-ade8-b827198f7e30',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI5YQpLaGCSGL4ntWt11BFFgnGrQ3fItNIdB138VboyJqclL9H8Ulyx/xxT8IGEQfueXv2SL9+Q3QwgV/gEuhZSJPXCS54honN2kOhqtEWQCcit240y/RW04xC4ADo4EdQ==',key_name='tempest-keypair-135831071',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7649e366b0164e2fa5b3faa0830b6ea6',ramdisk_id='',reservation_id='r-newglzq9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='708622a9-7465-4492-ade8-b827198f7e30',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1193811043',owner_user_name='tempest-TaggedBootDevicesTest_v242-1193811043-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T16:21:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7e50bd9d540549a194f706dac48ce93d',uuid=e4ada2d7-7ace-4ed4-86a6-ed121c95e80f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8f3a3011-e474-4538-812b-9df3968fd629", "address": "fa:16:3e:78:12:fd", "network": {"id": "4b153def-aec7-4f9e-9604-f1e0afb247f3", "bridge": "br-int", "label": "tempest-device-tagging-net1-1029190313", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.202", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7649e366b0164e2fa5b3faa0830b6ea6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f3a3011-e4", "ovs_interfaceid": "8f3a3011-e474-4538-812b-9df3968fd629", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71731) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 16:21:55 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Converting VIF {"id": "8f3a3011-e474-4538-812b-9df3968fd629", "address": "fa:16:3e:78:12:fd", "network": {"id": "4b153def-aec7-4f9e-9604-f1e0afb247f3", "bridge": "br-int", "label": "tempest-device-tagging-net1-1029190313", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.202", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7649e366b0164e2fa5b3faa0830b6ea6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f3a3011-e4", "ovs_interfaceid": "8f3a3011-e474-4538-812b-9df3968fd629", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 16:21:55 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:78:12:fd,bridge_name='br-int',has_traffic_filtering=True,id=8f3a3011-e474-4538-812b-9df3968fd629,network=Network(4b153def-aec7-4f9e-9604-f1e0afb247f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f3a3011-e4') {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 16:21:55 user nova-compute[71731]: DEBUG nova.virt.libvirt.vif [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T16:21:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-425684793',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-425684793',id=8,image_ref='708622a9-7465-4492-ade8-b827198f7e30',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI5YQpLaGCSGL4ntWt11BFFgnGrQ3fItNIdB138VboyJqclL9H8Ulyx/xxT8IGEQfueXv2SL9+Q3QwgV/gEuhZSJPXCS54honN2kOhqtEWQCcit240y/RW04xC4ADo4EdQ==',key_name='tempest-keypair-135831071',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7649e366b0164e2fa5b3faa0830b6ea6',ramdisk_id='',reservation_id='r-newglzq9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='708622a9-7465-4492-ade8-b827198f7e30',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1193811043',owner_user_name='tempest-TaggedBootDevicesTest_v242-1193811043-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T16:21:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7e50bd9d540549a194f706dac48ce93d',uuid=e4ada2d7-7ace-4ed4-86a6-ed121c95e80f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2430beb8-b2e4-4493-bdc5-df6b4c1181c6", "address": "fa:16:3e:30:1c:f5", "network": {"id": "4b153def-aec7-4f9e-9604-f1e0afb247f3", "bridge": "br-int", "label": "tempest-device-tagging-net1-1029190313", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.91", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7649e366b0164e2fa5b3faa0830b6ea6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2430beb8-b2", "ovs_interfaceid": "2430beb8-b2e4-4493-bdc5-df6b4c1181c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71731) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 16:21:55 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Converting VIF {"id": "2430beb8-b2e4-4493-bdc5-df6b4c1181c6", "address": "fa:16:3e:30:1c:f5", "network": {"id": "4b153def-aec7-4f9e-9604-f1e0afb247f3", "bridge": "br-int", "label": "tempest-device-tagging-net1-1029190313", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.91", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7649e366b0164e2fa5b3faa0830b6ea6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2430beb8-b2", "ovs_interfaceid": "2430beb8-b2e4-4493-bdc5-df6b4c1181c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 16:21:55 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:30:1c:f5,bridge_name='br-int',has_traffic_filtering=True,id=2430beb8-b2e4-4493-bdc5-df6b4c1181c6,network=Network(4b153def-aec7-4f9e-9604-f1e0afb247f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2430beb8-b2') {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 16:21:55 user nova-compute[71731]: DEBUG nova.virt.libvirt.vif [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T16:21:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-425684793',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-425684793',id=8,image_ref='708622a9-7465-4492-ade8-b827198f7e30',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI5YQpLaGCSGL4ntWt11BFFgnGrQ3fItNIdB138VboyJqclL9H8Ulyx/xxT8IGEQfueXv2SL9+Q3QwgV/gEuhZSJPXCS54honN2kOhqtEWQCcit240y/RW04xC4ADo4EdQ==',key_name='tempest-keypair-135831071',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7649e366b0164e2fa5b3faa0830b6ea6',ramdisk_id='',reservation_id='r-newglzq9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='708622a9-7465-4492-ade8-b827198f7e30',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1193811043',owner_user_name='tempest-TaggedBootDevicesTest_v242-1193811043-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T16:21:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7e50bd9d540549a194f706dac48ce93d',uuid=e4ada2d7-7ace-4ed4-86a6-ed121c95e80f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "15dca2c3-5048-4e80-8008-c19400ea34e4", "address": "fa:16:3e:df:45:fc", "network": {"id": "310c919b-177f-4fb1-956a-1423f7397f77", "bridge": "br-int", "label": "tempest-device-tagging-net2-188582195", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7649e366b0164e2fa5b3faa0830b6ea6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15dca2c3-50", "ovs_interfaceid": "15dca2c3-5048-4e80-8008-c19400ea34e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71731) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 16:21:55 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Converting VIF {"id": "15dca2c3-5048-4e80-8008-c19400ea34e4", "address": "fa:16:3e:df:45:fc", "network": {"id": "310c919b-177f-4fb1-956a-1423f7397f77", "bridge": "br-int", "label": "tempest-device-tagging-net2-188582195", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7649e366b0164e2fa5b3faa0830b6ea6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15dca2c3-50", "ovs_interfaceid": "15dca2c3-5048-4e80-8008-c19400ea34e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 16:21:55 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:df:45:fc,bridge_name='br-int',has_traffic_filtering=True,id=15dca2c3-5048-4e80-8008-c19400ea34e4,network=Network(310c919b-177f-4fb1-956a-1423f7397f77),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15dca2c3-50') {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 16:21:55 user nova-compute[71731]: DEBUG nova.virt.libvirt.vif [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T16:21:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-425684793',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-425684793',id=8,image_ref='708622a9-7465-4492-ade8-b827198f7e30',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI5YQpLaGCSGL4ntWt11BFFgnGrQ3fItNIdB138VboyJqclL9H8Ulyx/xxT8IGEQfueXv2SL9+Q3QwgV/gEuhZSJPXCS54honN2kOhqtEWQCcit240y/RW04xC4ADo4EdQ==',key_name='tempest-keypair-135831071',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7649e366b0164e2fa5b3faa0830b6ea6',ramdisk_id='',reservation_id='r-newglzq9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='708622a9-7465-4492-ade8-b827198f7e30',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1193811043',owner_user_name='tempest-TaggedBootDevicesTest_v242-1193811043-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T16:21:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7e50bd9d540549a194f706dac48ce93d',uuid=e4ada2d7-7ace-4ed4-86a6-ed121c95e80f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d41765b6-0d5b-43c1-bf58-a82a7bbe3137", "address": "fa:16:3e:63:86:1f", "network": {"id": "310c919b-177f-4fb1-956a-1423f7397f77", "bridge": "br-int", "label": "tempest-device-tagging-net2-188582195", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7649e366b0164e2fa5b3faa0830b6ea6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd41765b6-0d", "ovs_interfaceid": "d41765b6-0d5b-43c1-bf58-a82a7bbe3137", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71731) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 16:21:55 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Converting VIF {"id": "d41765b6-0d5b-43c1-bf58-a82a7bbe3137", "address": "fa:16:3e:63:86:1f", "network": {"id": "310c919b-177f-4fb1-956a-1423f7397f77", "bridge": "br-int", "label": "tempest-device-tagging-net2-188582195", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7649e366b0164e2fa5b3faa0830b6ea6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd41765b6-0d", "ovs_interfaceid": "d41765b6-0d5b-43c1-bf58-a82a7bbe3137", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 16:21:55 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:63:86:1f,bridge_name='br-int',has_traffic_filtering=True,id=d41765b6-0d5b-43c1-bf58-a82a7bbe3137,network=Network(310c919b-177f-4fb1-956a-1423f7397f77),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd41765b6-0d') {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 16:21:55 user nova-compute[71731]: DEBUG nova.objects.instance [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Lazy-loading 'pci_devices' on Instance uuid e4ada2d7-7ace-4ed4-86a6-ed121c95e80f {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:21:55 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0f728f3-fbb5-4ed8-a78b-a5d982b03f7d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:21:55 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[7170a178-bb3a-4322-afc4-179adad7120a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e0f728f3-fbb5-4ed8-a78b-a5d982b03f7d] added\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:21:55 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e0f728f3-fbb5-4ed8-a78b-a5d982b03f7d] added
Apr 13 16:21:55 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:21:55 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0f728f3-fbb5-4ed8-a78b-a5d982b03f7d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:21:55 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] [instance: e4ada2d7-7ace-4ed4-86a6-ed121c95e80f] End _get_guest_xml xml=<domain type="kvm">
Apr 13 16:21:55 user nova-compute[71731]:   <uuid>e4ada2d7-7ace-4ed4-86a6-ed121c95e80f</uuid>
Apr 13 16:21:55 user nova-compute[71731]:   <name>instance-00000008</name>
Apr 13 16:21:55 user nova-compute[71731]:   <memory>131072</memory>
Apr 13 16:21:55 user nova-compute[71731]:   <vcpu>1</vcpu>
Apr 13 16:21:55 user nova-compute[71731]:   <metadata>
Apr 13 16:21:55 user nova-compute[71731]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 16:21:55 user nova-compute[71731]:       <nova:package version="0.0.0"/>
Apr 13 16:21:55 user nova-compute[71731]:       <nova:name>tempest-device-tagging-server-425684793</nova:name>
Apr 13 16:21:55 user nova-compute[71731]:       <nova:creationTime>2023-04-13 16:21:48</nova:creationTime>
Apr 13 16:21:55 user nova-compute[71731]:       <nova:flavor name="m1.nano">
Apr 13 16:21:55 user nova-compute[71731]:         <nova:memory>128</nova:memory>
Apr 13 16:21:55 user nova-compute[71731]:         <nova:disk>1</nova:disk>
Apr 13 16:21:55 user nova-compute[71731]:         <nova:swap>0</nova:swap>
Apr 13 16:21:55 user nova-compute[71731]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 16:21:55 user nova-compute[71731]:         <nova:vcpus>1</nova:vcpus>
Apr 13 16:21:55 user nova-compute[71731]:       </nova:flavor>
Apr 13 16:21:55 user nova-compute[71731]:       <nova:owner>
Apr 13 16:21:55 user nova-compute[71731]:         <nova:user uuid="7e50bd9d540549a194f706dac48ce93d">tempest-TaggedBootDevicesTest_v242-1193811043-project-member</nova:user>
Apr 13 16:21:55 user nova-compute[71731]:         <nova:project uuid="7649e366b0164e2fa5b3faa0830b6ea6">tempest-TaggedBootDevicesTest_v242-1193811043</nova:project>
Apr 13 16:21:55 user nova-compute[71731]:       </nova:owner>
Apr 13 16:21:55 user nova-compute[71731]:       <nova:root type="image" uuid="708622a9-7465-4492-ade8-b827198f7e30"/>
Apr 13 16:21:55 user nova-compute[71731]:       <nova:ports>
Apr 13 16:21:55 user nova-compute[71731]:         <nova:port uuid="a409f60c-6c6a-49f8-8520-04614e804002">
Apr 13 16:21:55 user nova-compute[71731]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Apr 13 16:21:55 user nova-compute[71731]:         </nova:port>
Apr 13 16:21:55 user nova-compute[71731]:         <nova:port uuid="ac94464f-32dc-4cd1-a270-ec8934e77c21">
Apr 13 16:21:55 user nova-compute[71731]:           <nova:ip type="fixed" address="10.1.1.127" ipVersion="4"/>
Apr 13 16:21:55 user nova-compute[71731]:         </nova:port>
Apr 13 16:21:55 user nova-compute[71731]:         <nova:port uuid="0125a8df-e91c-4d65-be74-fda2f2d93938">
Apr 13 16:21:55 user nova-compute[71731]:           <nova:ip type="fixed" address="10.1.1.61" ipVersion="4"/>
Apr 13 16:21:55 user nova-compute[71731]:         </nova:port>
Apr 13 16:21:55 user nova-compute[71731]:         <nova:port uuid="8f3a3011-e474-4538-812b-9df3968fd629">
Apr 13 16:21:55 user nova-compute[71731]:           <nova:ip type="fixed" address="10.1.1.202" ipVersion="4"/>
Apr 13 16:21:55 user nova-compute[71731]:         </nova:port>
Apr 13 16:21:55 user nova-compute[71731]:         <nova:port uuid="2430beb8-b2e4-4493-bdc5-df6b4c1181c6">
Apr 13 16:21:55 user nova-compute[71731]:           <nova:ip type="fixed" address="10.1.1.91" ipVersion="4"/>
Apr 13 16:21:55 user nova-compute[71731]:         </nova:port>
Apr 13 16:21:55 user nova-compute[71731]:         <nova:port uuid="15dca2c3-5048-4e80-8008-c19400ea34e4">
Apr 13 16:21:55 user nova-compute[71731]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Apr 13 16:21:55 user nova-compute[71731]:         </nova:port>
Apr 13 16:21:55 user nova-compute[71731]:         <nova:port uuid="d41765b6-0d5b-43c1-bf58-a82a7bbe3137">
Apr 13 16:21:55 user nova-compute[71731]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Apr 13 16:21:55 user nova-compute[71731]:         </nova:port>
Apr 13 16:21:55 user nova-compute[71731]:       </nova:ports>
Apr 13 16:21:55 user nova-compute[71731]:     </nova:instance>
Apr 13 16:21:55 user nova-compute[71731]:   </metadata>
Apr 13 16:21:55 user nova-compute[71731]:   <sysinfo type="smbios">
Apr 13 16:21:55 user nova-compute[71731]:     <system>
Apr 13 16:21:55 user nova-compute[71731]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 16:21:55 user nova-compute[71731]:       <entry name="product">OpenStack Nova</entry>
Apr 13 16:21:55 user nova-compute[71731]:       <entry name="version">0.0.0</entry>
Apr 13 16:21:55 user nova-compute[71731]:       <entry name="serial">e4ada2d7-7ace-4ed4-86a6-ed121c95e80f</entry>
Apr 13 16:21:55 user nova-compute[71731]:       <entry name="uuid">e4ada2d7-7ace-4ed4-86a6-ed121c95e80f</entry>
Apr 13 16:21:55 user nova-compute[71731]:       <entry name="family">Virtual Machine</entry>
Apr 13 16:21:55 user nova-compute[71731]:     </system>
Apr 13 16:21:55 user nova-compute[71731]:   </sysinfo>
Apr 13 16:21:55 user nova-compute[71731]:   <os>
Apr 13 16:21:55 user nova-compute[71731]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 16:21:55 user nova-compute[71731]:     <boot dev="hd"/>
Apr 13 16:21:55 user nova-compute[71731]:     <smbios mode="sysinfo"/>
Apr 13 16:21:55 user nova-compute[71731]:   </os>
Apr 13 16:21:55 user nova-compute[71731]:   <features>
Apr 13 16:21:55 user nova-compute[71731]:     <acpi/>
Apr 13 16:21:55 user nova-compute[71731]:     <apic/>
Apr 13 16:21:55 user nova-compute[71731]:     <vmcoreinfo/>
Apr 13 16:21:55 user nova-compute[71731]:   </features>
Apr 13 16:21:55 user nova-compute[71731]:   <clock offset="utc">
Apr 13 16:21:55 user nova-compute[71731]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 16:21:55 user nova-compute[71731]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 16:21:55 user nova-compute[71731]:     <timer name="hpet" present="no"/>
Apr 13 16:21:55 user nova-compute[71731]:   </clock>
Apr 13 16:21:55 user nova-compute[71731]:   <cpu mode="custom" match="exact">
Apr 13 16:21:55 user nova-compute[71731]:     <model>Nehalem</model>
Apr 13 16:21:55 user nova-compute[71731]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 16:21:55 user nova-compute[71731]:   </cpu>
Apr 13 16:21:55 user nova-compute[71731]:   <devices>
Apr 13 16:21:55 user nova-compute[71731]:     <disk type="file" device="cdrom">
Apr 13 16:21:55 user nova-compute[71731]:       <driver name="qemu" type="raw" cache="none"/>
Apr 13 16:21:55 user nova-compute[71731]:       <source file="/opt/stack/data/nova/instances/e4ada2d7-7ace-4ed4-86a6-ed121c95e80f/disk.config"/>
Apr 13 16:21:55 user nova-compute[71731]:       <target dev="hda" bus="ide"/>
Apr 13 16:21:55 user nova-compute[71731]:     </disk>
Apr 13 16:21:55 user nova-compute[71731]:     <disk type="block" device="disk">
Apr 13 16:21:55 user nova-compute[71731]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 16:21:55 user nova-compute[71731]:       <source dev="/dev/sdc"/>
Apr 13 16:21:55 user nova-compute[71731]:       <target dev="vda" bus="virtio"/>
Apr 13 16:21:55 user nova-compute[71731]:       <serial>84c7f6ad-d2c2-465a-b39e-47347aa85be0</serial>
Apr 13 16:21:55 user nova-compute[71731]:     </disk>
Apr 13 16:21:55 user nova-compute[71731]:     <disk type="block" device="disk">
Apr 13 16:21:55 user nova-compute[71731]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 16:21:55 user nova-compute[71731]:       <source dev="/dev/sde"/>
Apr 13 16:21:55 user nova-compute[71731]:       <target dev="vdb" bus="virtio"/>
Apr 13 16:21:55 user nova-compute[71731]:       <serial>c20e80fa-58de-431a-8901-2535657aaadf</serial>
Apr 13 16:21:55 user nova-compute[71731]:     </disk>
Apr 13 16:21:55 user nova-compute[71731]:     <disk type="block" device="disk">
Apr 13 16:21:55 user nova-compute[71731]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 16:21:55 user nova-compute[71731]:       <source dev="/dev/sdg"/>
Apr 13 16:21:55 user nova-compute[71731]:       <target dev="vdc" bus="virtio"/>
Apr 13 16:21:55 user nova-compute[71731]:       <serial>cc639d00-ef6b-4121-bcb0-c65ec0347abd</serial>
Apr 13 16:21:55 user nova-compute[71731]:     </disk>
Apr 13 16:21:55 user nova-compute[71731]:     <interface type="ethernet">
Apr 13 16:21:55 user nova-compute[71731]:       <mac address="fa:16:3e:ee:b5:cc"/>
Apr 13 16:21:55 user nova-compute[71731]:       <model type="virtio"/>
Apr 13 16:21:55 user nova-compute[71731]:       <mtu size="1442"/>
Apr 13 16:21:55 user nova-compute[71731]:       <target dev="tapa409f60c-6c"/>
Apr 13 16:21:55 user nova-compute[71731]:     </interface>
Apr 13 16:21:55 user nova-compute[71731]:     <interface type="ethernet">
Apr 13 16:21:55 user nova-compute[71731]:       <mac address="fa:16:3e:5e:a2:3f"/>
Apr 13 16:21:55 user nova-compute[71731]:       <model type="virtio"/>
Apr 13 16:21:55 user nova-compute[71731]:       <mtu size="1442"/>
Apr 13 16:21:55 user nova-compute[71731]:       <target dev="tapac94464f-32"/>
Apr 13 16:21:55 user nova-compute[71731]:     </interface>
Apr 13 16:21:55 user nova-compute[71731]:     <interface type="ethernet">
Apr 13 16:21:55 user nova-compute[71731]:       <mac address="fa:16:3e:39:06:fc"/>
Apr 13 16:21:55 user nova-compute[71731]:       <model type="virtio"/>
Apr 13 16:21:55 user nova-compute[71731]:       <mtu size="1442"/>
Apr 13 16:21:55 user nova-compute[71731]:       <target dev="tap0125a8df-e9"/>
Apr 13 16:21:55 user nova-compute[71731]:     </interface>
Apr 13 16:21:55 user nova-compute[71731]:     <interface type="ethernet">
Apr 13 16:21:55 user nova-compute[71731]:       <mac address="fa:16:3e:78:12:fd"/>
Apr 13 16:21:55 user nova-compute[71731]:       <model type="virtio"/>
Apr 13 16:21:55 user nova-compute[71731]:       <mtu size="1442"/>
Apr 13 16:21:55 user nova-compute[71731]:       <target dev="tap8f3a3011-e4"/>
Apr 13 16:21:55 user nova-compute[71731]:     </interface>
Apr 13 16:21:55 user nova-compute[71731]:     <interface type="ethernet">
Apr 13 16:21:55 user nova-compute[71731]:       <mac address="fa:16:3e:30:1c:f5"/>
Apr 13 16:21:55 user nova-compute[71731]:       <model type="virtio"/>
Apr 13 16:21:55 user nova-compute[71731]:       <mtu size="1442"/>
Apr 13 16:21:55 user nova-compute[71731]:       <target dev="tap2430beb8-b2"/>
Apr 13 16:21:55 user nova-compute[71731]:     </interface>
Apr 13 16:21:55 user nova-compute[71731]:     <interface type="ethernet">
Apr 13 16:21:55 user nova-compute[71731]:       <mac address="fa:16:3e:df:45:fc"/>
Apr 13 16:21:55 user nova-compute[71731]:       <model type="virtio"/>
Apr 13 16:21:55 user nova-compute[71731]:       <mtu size="1442"/>
Apr 13 16:21:55 user nova-compute[71731]:       <target dev="tap15dca2c3-50"/>
Apr 13 16:21:55 user nova-compute[71731]:     </interface>
Apr 13 16:21:55 user nova-compute[71731]:     <interface type="ethernet">
Apr 13 16:21:55 user nova-compute[71731]:       <mac address="fa:16:3e:63:86:1f"/>
Apr 13 16:21:55 user nova-compute[71731]:       <model type="virtio"/>
Apr 13 16:21:55 user nova-compute[71731]:       <mtu size="1442"/>
Apr 13 16:21:55 user nova-compute[71731]:       <target dev="tapd41765b6-0d"/>
Apr 13 16:21:55 user nova-compute[71731]:     </interface>
Apr 13 16:21:55 user nova-compute[71731]:     <serial type="pty">
Apr 13 16:21:55 user nova-compute[71731]:       <log file="/opt/stack/data/nova/instances/e4ada2d7-7ace-4ed4-86a6-ed121c95e80f/console.log" append="off"/>
Apr 13 16:21:55 user nova-compute[71731]:     </serial>
Apr 13 16:21:55 user nova-compute[71731]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 16:21:55 user nova-compute[71731]:     <video>
Apr 13 16:21:55 user nova-compute[71731]:       <model type="virtio"/>
Apr 13 16:21:55 user nova-compute[71731]:     </video>
Apr 13 16:21:55 user nova-compute[71731]:     <rng model="virtio">
Apr 13 16:21:55 user nova-compute[71731]:       <backend model="random">/dev/urandom</backend>
Apr 13 16:21:55 user nova-compute[71731]:     </rng>
Apr 13 16:21:55 user nova-compute[71731]:     <controller type="usb" index="0" model="none"/>
Apr 13 16:21:55 user nova-compute[71731]:     <memballoon model="virtio">
Apr 13 16:21:55 user nova-compute[71731]:       <stats period="10"/>
Apr 13 16:21:55 user nova-compute[71731]:     </memballoon>
Apr 13 16:21:55 user nova-compute[71731]:   </devices>
Apr 13 16:21:55 user nova-compute[71731]: </domain>
Apr 13 16:21:55 user nova-compute[71731]:  {{(pid=71731) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 16:21:55 user nova-compute[71731]: DEBUG nova.virt.libvirt.vif [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T16:21:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-425684793',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-425684793',id=8,image_ref='708622a9-7465-4492-ade8-b827198f7e30',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI5YQpLaGCSGL4ntWt11BFFgnGrQ3fItNIdB138VboyJqclL9H8Ulyx/xxT8IGEQfueXv2SL9+Q3QwgV/gEuhZSJPXCS54honN2kOhqtEWQCcit240y/RW04xC4ADo4EdQ==',key_name='tempest-keypair-135831071',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7649e366b0164e2fa5b3faa0830b6ea6',ramdisk_id='',reservation_id='r-newglzq9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='708622a9-7465-4492-ade8-b827198f7e30',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1193811043',owner_user_name='tempest-TaggedBootDevicesTest_v242-1193811043-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T16:21:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7e50bd9d540549a194f706dac48ce93d',uuid=e4ada2d7-7ace-4ed4-86a6-ed121c95e80f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a409f60c-6c6a-49f8-8520-04614e804002", "address": "fa:16:3e:ee:b5:cc", "network": {"id": "06e8519d-91e2-4c6a-8b74-6f55609e1764", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-420310439-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7649e366b0164e2fa5b3faa0830b6ea6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa409f60c-6c", "ovs_interfaceid": "a409f60c-6c6a-49f8-8520-04614e804002", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 16:21:55 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Converting VIF {"id": "a409f60c-6c6a-49f8-8520-04614e804002", "address": "fa:16:3e:ee:b5:cc", "network": {"id": "06e8519d-91e2-4c6a-8b74-6f55609e1764", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-420310439-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7649e366b0164e2fa5b3faa0830b6ea6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa409f60c-6c", "ovs_interfaceid": "a409f60c-6c6a-49f8-8520-04614e804002", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 16:21:55 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ee:b5:cc,bridge_name='br-int',has_traffic_filtering=True,id=a409f60c-6c6a-49f8-8520-04614e804002,network=Network(06e8519d-91e2-4c6a-8b74-6f55609e1764),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa409f60c-6c') {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 16:21:55 user nova-compute[71731]: DEBUG os_vif [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ee:b5:cc,bridge_name='br-int',has_traffic_filtering=True,id=a409f60c-6c6a-49f8-8520-04614e804002,network=Network(06e8519d-91e2-4c6a-8b74-6f55609e1764),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa409f60c-6c') {{(pid=71731) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 16:21:55 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:21:55 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:21:55 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 16:21:55 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0f728f3-fbb5-4ed8-a78b-a5d982b03f7d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:21:55 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9b84bb9-c2ba-4b15-b1f7-f2d37b582535]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:21:55 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:21:55 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:21:55 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa409f60c-6c, may_exist=True) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:21:55 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa409f60c-6c, col_values=(('external_ids', {'iface-id': 'a409f60c-6c6a-49f8-8520-04614e804002', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ee:b5:cc', 'vm-uuid': 'e4ada2d7-7ace-4ed4-86a6-ed121c95e80f'}),)) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:21:55 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0f728f3-fbb5-4ed8-a78b-a5d982b03f7d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:21:55 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:21:55 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 16:21:55 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:21:55 user nova-compute[71731]: INFO os_vif [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ee:b5:cc,bridge_name='br-int',has_traffic_filtering=True,id=a409f60c-6c6a-49f8-8520-04614e804002,network=Network(06e8519d-91e2-4c6a-8b74-6f55609e1764),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa409f60c-6c')
Apr 13 16:21:55 user nova-compute[71731]: DEBUG nova.virt.libvirt.vif [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T16:21:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-425684793',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-425684793',id=8,image_ref='708622a9-7465-4492-ade8-b827198f7e30',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI5YQpLaGCSGL4ntWt11BFFgnGrQ3fItNIdB138VboyJqclL9H8Ulyx/xxT8IGEQfueXv2SL9+Q3QwgV/gEuhZSJPXCS54honN2kOhqtEWQCcit240y/RW04xC4ADo4EdQ==',key_name='tempest-keypair-135831071',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7649e366b0164e2fa5b3faa0830b6ea6',ramdisk_id='',reservation_id='r-newglzq9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='708622a9-7465-4492-ade8-b827198f7e30',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1193811043',owner_user_name='tempest-TaggedBootDevicesTest_v242-1193811043-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T16:21:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7e50bd9d540549a194f706dac48ce93d',uuid=e4ada2d7-7ace-4ed4-86a6-ed121c95e80f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ac94464f-32dc-4cd1-a270-ec8934e77c21", "address": "fa:16:3e:5e:a2:3f", "network": {"id": "4b153def-aec7-4f9e-9604-f1e0afb247f3", "bridge": "br-int", "label": "tempest-device-tagging-net1-1029190313", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.127", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7649e366b0164e2fa5b3faa0830b6ea6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac94464f-32", "ovs_interfaceid": "ac94464f-32dc-4cd1-a270-ec8934e77c21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71731) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 16:21:55 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Converting VIF {"id": "ac94464f-32dc-4cd1-a270-ec8934e77c21", "address": "fa:16:3e:5e:a2:3f", "network": {"id": "4b153def-aec7-4f9e-9604-f1e0afb247f3", "bridge": "br-int", "label": "tempest-device-tagging-net1-1029190313", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.127", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7649e366b0164e2fa5b3faa0830b6ea6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac94464f-32", "ovs_interfaceid": "ac94464f-32dc-4cd1-a270-ec8934e77c21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 16:21:55 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5e:a2:3f,bridge_name='br-int',has_traffic_filtering=True,id=ac94464f-32dc-4cd1-a270-ec8934e77c21,network=Network(4b153def-aec7-4f9e-9604-f1e0afb247f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapac94464f-32') {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 16:21:55 user nova-compute[71731]: DEBUG os_vif [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5e:a2:3f,bridge_name='br-int',has_traffic_filtering=True,id=ac94464f-32dc-4cd1-a270-ec8934e77c21,network=Network(4b153def-aec7-4f9e-9604-f1e0afb247f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapac94464f-32') {{(pid=71731) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 16:21:55 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:21:55 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:21:55 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 16:21:55 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0f728f3-fbb5-4ed8-a78b-a5d982b03f7d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:21:55 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[683e99ca-942c-4bf8-b2d7-6b0bdb923ec9]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:21:55 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:21:55 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:21:55 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapac94464f-32, may_exist=True) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:21:55 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapac94464f-32, col_values=(('external_ids', {'iface-id': 'ac94464f-32dc-4cd1-a270-ec8934e77c21', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5e:a2:3f', 'vm-uuid': 'e4ada2d7-7ace-4ed4-86a6-ed121c95e80f'}),)) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:21:55 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:21:55 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0f728f3-fbb5-4ed8-a78b-a5d982b03f7d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nSEqPQZM {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:21:55 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 16:21:55 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0f728f3-fbb5-4ed8-a78b-a5d982b03f7d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nSEqPQZM" returned: 0 in 0.022s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:21:55 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c1df518-5093-49a7-8d7b-6b2e21d5c057]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:21:55 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nSEqPQZM'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:21:55 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:21:55 user nova-compute[71731]: INFO os_vif [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5e:a2:3f,bridge_name='br-int',has_traffic_filtering=True,id=ac94464f-32dc-4cd1-a270-ec8934e77c21,network=Network(4b153def-aec7-4f9e-9604-f1e0afb247f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapac94464f-32')
Apr 13 16:21:55 user nova-compute[71731]: DEBUG nova.virt.libvirt.vif [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T16:21:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-425684793',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-425684793',id=8,image_ref='708622a9-7465-4492-ade8-b827198f7e30',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI5YQpLaGCSGL4ntWt11BFFgnGrQ3fItNIdB138VboyJqclL9H8Ulyx/xxT8IGEQfueXv2SL9+Q3QwgV/gEuhZSJPXCS54honN2kOhqtEWQCcit240y/RW04xC4ADo4EdQ==',key_name='tempest-keypair-135831071',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7649e366b0164e2fa5b3faa0830b6ea6',ramdisk_id='',reservation_id='r-newglzq9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='708622a9-7465-4492-ade8-b827198f7e30',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1193811043',owner_user_name='tempest-TaggedBootDevicesTest_v242-1193811043-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T16:21:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7e50bd9d540549a194f706dac48ce93d',uuid=e4ada2d7-7ace-4ed4-86a6-ed121c95e80f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0125a8df-e91c-4d65-be74-fda2f2d93938", "address": "fa:16:3e:39:06:fc", "network": {"id": "4b153def-aec7-4f9e-9604-f1e0afb247f3", "bridge": "br-int", "label": "tempest-device-tagging-net1-1029190313", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.61", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7649e366b0164e2fa5b3faa0830b6ea6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0125a8df-e9", "ovs_interfaceid": "0125a8df-e91c-4d65-be74-fda2f2d93938", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71731) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 16:21:55 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Converting VIF {"id": "0125a8df-e91c-4d65-be74-fda2f2d93938", "address": "fa:16:3e:39:06:fc", "network": {"id": "4b153def-aec7-4f9e-9604-f1e0afb247f3", "bridge": "br-int", "label": "tempest-device-tagging-net1-1029190313", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.61", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7649e366b0164e2fa5b3faa0830b6ea6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0125a8df-e9", "ovs_interfaceid": "0125a8df-e91c-4d65-be74-fda2f2d93938", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 16:21:55 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:39:06:fc,bridge_name='br-int',has_traffic_filtering=True,id=0125a8df-e91c-4d65-be74-fda2f2d93938,network=Network(4b153def-aec7-4f9e-9604-f1e0afb247f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap0125a8df-e9') {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 16:21:55 user nova-compute[71731]: DEBUG os_vif [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:06:fc,bridge_name='br-int',has_traffic_filtering=True,id=0125a8df-e91c-4d65-be74-fda2f2d93938,network=Network(4b153def-aec7-4f9e-9604-f1e0afb247f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap0125a8df-e9') {{(pid=71731) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 16:21:55 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:21:55 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:21:55 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 16:21:55 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0f728f3-fbb5-4ed8-a78b-a5d982b03f7d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:21:55 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:21:55 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:21:55 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0125a8df-e9, may_exist=True) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:21:55 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0125a8df-e9, col_values=(('external_ids', {'iface-id': '0125a8df-e91c-4d65-be74-fda2f2d93938', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:39:06:fc', 'vm-uuid': 'e4ada2d7-7ace-4ed4-86a6-ed121c95e80f'}),)) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:21:55 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:21:55 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 16:21:55 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0f728f3-fbb5-4ed8-a78b-a5d982b03f7d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:21:55 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6e56cdb-518c-4906-b035-2125f78b9662]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:21:55 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:21:55 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:21:55 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:21:55 user nova-compute[71731]: INFO os_vif [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:06:fc,bridge_name='br-int',has_traffic_filtering=True,id=0125a8df-e91c-4d65-be74-fda2f2d93938,network=Network(4b153def-aec7-4f9e-9604-f1e0afb247f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap0125a8df-e9')
Apr 13 16:21:55 user nova-compute[71731]: DEBUG nova.virt.libvirt.vif [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T16:21:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-425684793',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-425684793',id=8,image_ref='708622a9-7465-4492-ade8-b827198f7e30',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI5YQpLaGCSGL4ntWt11BFFgnGrQ3fItNIdB138VboyJqclL9H8Ulyx/xxT8IGEQfueXv2SL9+Q3QwgV/gEuhZSJPXCS54honN2kOhqtEWQCcit240y/RW04xC4ADo4EdQ==',key_name='tempest-keypair-135831071',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7649e366b0164e2fa5b3faa0830b6ea6',ramdisk_id='',reservation_id='r-newglzq9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='708622a9-7465-4492-ade8-b827198f7e30',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1193811043',owner_user_name='tempest-TaggedBootDevicesTest_v242-1193811043-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T16:21:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7e50bd9d540549a194f706dac48ce93d',uuid=e4ada2d7-7ace-4ed4-86a6-ed121c95e80f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8f3a3011-e474-4538-812b-9df3968fd629", "address": "fa:16:3e:78:12:fd", "network": {"id": "4b153def-aec7-4f9e-9604-f1e0afb247f3", "bridge": "br-int", "label": "tempest-device-tagging-net1-1029190313", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.202", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7649e366b0164e2fa5b3faa0830b6ea6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f3a3011-e4", "ovs_interfaceid": "8f3a3011-e474-4538-812b-9df3968fd629", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 16:21:55 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Converting VIF {"id": "8f3a3011-e474-4538-812b-9df3968fd629", "address": "fa:16:3e:78:12:fd", "network": {"id": "4b153def-aec7-4f9e-9604-f1e0afb247f3", "bridge": "br-int", "label": "tempest-device-tagging-net1-1029190313", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.202", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7649e366b0164e2fa5b3faa0830b6ea6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f3a3011-e4", "ovs_interfaceid": "8f3a3011-e474-4538-812b-9df3968fd629", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 16:21:55 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:78:12:fd,bridge_name='br-int',has_traffic_filtering=True,id=8f3a3011-e474-4538-812b-9df3968fd629,network=Network(4b153def-aec7-4f9e-9604-f1e0afb247f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f3a3011-e4') {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 16:21:55 user nova-compute[71731]: DEBUG os_vif [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:78:12:fd,bridge_name='br-int',has_traffic_filtering=True,id=8f3a3011-e474-4538-812b-9df3968fd629,network=Network(4b153def-aec7-4f9e-9604-f1e0afb247f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f3a3011-e4') {{(pid=71731) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 16:21:55 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:21:55 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:21:55 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 16:21:55 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:21:55 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[8611824c-285d-4424-ba7e-19c650c69197]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c7f6ad-d2c2-465a-b39e-47347aa85be0 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48af37b0-6938-432e-b374-d992c4dd9ae9 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c20e80fa-58de-431a-8901-2535657aaadf (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27919afc-8990-4ed5-af9e-9d6b3d7b231e (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc639d00-ef6b-4121-bcb0-c65ec0347abd (non-flash)\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:21:55 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984 (non-flash)
Apr 13 16:21:55 user nova-compute[71731]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c7f6ad-d2c2-465a-b39e-47347aa85be0 (non-flash)
Apr 13 16:21:55 user nova-compute[71731]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48af37b0-6938-432e-b374-d992c4dd9ae9 (non-flash)
Apr 13 16:21:55 user nova-compute[71731]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c20e80fa-58de-431a-8901-2535657aaadf (non-flash)
Apr 13 16:21:55 user nova-compute[71731]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27919afc-8990-4ed5-af9e-9d6b3d7b231e (non-flash)
Apr 13 16:21:55 user nova-compute[71731]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc639d00-ef6b-4121-bcb0-c65ec0347abd (non-flash)
Apr 13 16:21:55 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 16:21:55 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984 (non-flash)
Apr 13 16:21:55 user nova-compute[71731]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c7f6ad-d2c2-465a-b39e-47347aa85be0 (non-flash)
Apr 13 16:21:55 user nova-compute[71731]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48af37b0-6938-432e-b374-d992c4dd9ae9 (non-flash)
Apr 13 16:21:55 user nova-compute[71731]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c20e80fa-58de-431a-8901-2535657aaadf (non-flash)
Apr 13 16:21:55 user nova-compute[71731]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27919afc-8990-4ed5-af9e-9d6b3d7b231e (non-flash)
Apr 13 16:21:55 user nova-compute[71731]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc639d00-ef6b-4121-bcb0-c65ec0347abd (non-flash)
Apr 13 16:21:55 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 16:21:55 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:21:55 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8f3a3011-e4, may_exist=True) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:21:55 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8f3a3011-e4, col_values=(('external_ids', {'iface-id': '8f3a3011-e474-4538-812b-9df3968fd629', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:78:12:fd', 'vm-uuid': 'e4ada2d7-7ace-4ed4-86a6-ed121c95e80f'}),)) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:21:55 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:21:55 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0f728f3-fbb5-4ed8-a78b-a5d982b03f7d -p 172.16.0.220:3260 --login {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:21:55 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 16:21:56 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:21:56 user nova-compute[71731]: INFO os_vif [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:78:12:fd,bridge_name='br-int',has_traffic_filtering=True,id=8f3a3011-e474-4538-812b-9df3968fd629,network=Network(4b153def-aec7-4f9e-9604-f1e0afb247f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f3a3011-e4')
Apr 13 16:21:56 user nova-compute[71731]: DEBUG nova.virt.libvirt.vif [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T16:21:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-425684793',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-425684793',id=8,image_ref='708622a9-7465-4492-ade8-b827198f7e30',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI5YQpLaGCSGL4ntWt11BFFgnGrQ3fItNIdB138VboyJqclL9H8Ulyx/xxT8IGEQfueXv2SL9+Q3QwgV/gEuhZSJPXCS54honN2kOhqtEWQCcit240y/RW04xC4ADo4EdQ==',key_name='tempest-keypair-135831071',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7649e366b0164e2fa5b3faa0830b6ea6',ramdisk_id='',reservation_id='r-newglzq9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='708622a9-7465-4492-ade8-b827198f7e30',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1193811043',owner_user_name='tempest-TaggedBootDevicesTest_v242-1193811043-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T16:21:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7e50bd9d540549a194f706dac48ce93d',uuid=e4ada2d7-7ace-4ed4-86a6-ed121c95e80f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2430beb8-b2e4-4493-bdc5-df6b4c1181c6", "address": "fa:16:3e:30:1c:f5", "network": {"id": "4b153def-aec7-4f9e-9604-f1e0afb247f3", "bridge": "br-int", "label": "tempest-device-tagging-net1-1029190313", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.91", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7649e366b0164e2fa5b3faa0830b6ea6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2430beb8-b2", "ovs_interfaceid": "2430beb8-b2e4-4493-bdc5-df6b4c1181c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 16:21:56 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Converting VIF {"id": "2430beb8-b2e4-4493-bdc5-df6b4c1181c6", "address": "fa:16:3e:30:1c:f5", "network": {"id": "4b153def-aec7-4f9e-9604-f1e0afb247f3", "bridge": "br-int", "label": "tempest-device-tagging-net1-1029190313", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.91", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7649e366b0164e2fa5b3faa0830b6ea6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2430beb8-b2", "ovs_interfaceid": "2430beb8-b2e4-4493-bdc5-df6b4c1181c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 16:21:56 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:30:1c:f5,bridge_name='br-int',has_traffic_filtering=True,id=2430beb8-b2e4-4493-bdc5-df6b4c1181c6,network=Network(4b153def-aec7-4f9e-9604-f1e0afb247f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2430beb8-b2') {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 16:21:56 user nova-compute[71731]: DEBUG os_vif [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:1c:f5,bridge_name='br-int',has_traffic_filtering=True,id=2430beb8-b2e4-4493-bdc5-df6b4c1181c6,network=Network(4b153def-aec7-4f9e-9604-f1e0afb247f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2430beb8-b2') {{(pid=71731) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 16:21:56 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:21:56 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:21:56 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 16:21:56 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:21:56 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2430beb8-b2, may_exist=True) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:21:56 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2430beb8-b2, col_values=(('external_ids', {'iface-id': '2430beb8-b2e4-4493-bdc5-df6b4c1181c6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:30:1c:f5', 'vm-uuid': 'e4ada2d7-7ace-4ed4-86a6-ed121c95e80f'}),)) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:21:56 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 16:21:56 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0f728f3-fbb5-4ed8-a78b-a5d982b03f7d -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:21:56 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[9112c114-fb33-4bb9-8b03-4e60e104f622]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e0f728f3-fbb5-4ed8-a78b-a5d982b03f7d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e0f728f3-fbb5-4ed8-a78b-a5d982b03f7d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:21:56 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e0f728f3-fbb5-4ed8-a78b-a5d982b03f7d, portal: 172.16.0.220,3260]
Apr 13 16:21:56 user nova-compute[71731]: Login to [iface: default, target: iqn.2010-10.org.openstack:e0f728f3-fbb5-4ed8-a78b-a5d982b03f7d, portal: 172.16.0.220,3260] successful.
Apr 13 16:21:56 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:21:56 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0f728f3-fbb5-4ed8-a78b-a5d982b03f7d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:21:56 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0f728f3-fbb5-4ed8-a78b-a5d982b03f7d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:21:56 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[34fda0b8-e574-492c-8b6f-9d8ae41b00a9]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:21:56 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:21:56 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:21:56 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:21:56 user nova-compute[71731]: INFO os_vif [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:1c:f5,bridge_name='br-int',has_traffic_filtering=True,id=2430beb8-b2e4-4493-bdc5-df6b4c1181c6,network=Network(4b153def-aec7-4f9e-9604-f1e0afb247f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2430beb8-b2')
Apr 13 16:21:56 user nova-compute[71731]: DEBUG nova.virt.libvirt.vif [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T16:21:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-425684793',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-425684793',id=8,image_ref='708622a9-7465-4492-ade8-b827198f7e30',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI5YQpLaGCSGL4ntWt11BFFgnGrQ3fItNIdB138VboyJqclL9H8Ulyx/xxT8IGEQfueXv2SL9+Q3QwgV/gEuhZSJPXCS54honN2kOhqtEWQCcit240y/RW04xC4ADo4EdQ==',key_name='tempest-keypair-135831071',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7649e366b0164e2fa5b3faa0830b6ea6',ramdisk_id='',reservation_id='r-newglzq9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='708622a9-7465-4492-ade8-b827198f7e30',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1193811043',owner_user_name='tempest-TaggedBootDevicesTest_v242-1193811043-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T16:21:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7e50bd9d540549a194f706dac48ce93d',uuid=e4ada2d7-7ace-4ed4-86a6-ed121c95e80f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "15dca2c3-5048-4e80-8008-c19400ea34e4", "address": "fa:16:3e:df:45:fc", "network": {"id": "310c919b-177f-4fb1-956a-1423f7397f77", "bridge": "br-int", "label": "tempest-device-tagging-net2-188582195", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7649e366b0164e2fa5b3faa0830b6ea6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15dca2c3-50", "ovs_interfaceid": "15dca2c3-5048-4e80-8008-c19400ea34e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 16:21:56 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Converting VIF {"id": "15dca2c3-5048-4e80-8008-c19400ea34e4", "address": "fa:16:3e:df:45:fc", "network": {"id": "310c919b-177f-4fb1-956a-1423f7397f77", "bridge": "br-int", "label": "tempest-device-tagging-net2-188582195", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7649e366b0164e2fa5b3faa0830b6ea6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15dca2c3-50", "ovs_interfaceid": "15dca2c3-5048-4e80-8008-c19400ea34e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 16:21:56 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:df:45:fc,bridge_name='br-int',has_traffic_filtering=True,id=15dca2c3-5048-4e80-8008-c19400ea34e4,network=Network(310c919b-177f-4fb1-956a-1423f7397f77),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15dca2c3-50') {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 16:21:56 user nova-compute[71731]: DEBUG os_vif [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:45:fc,bridge_name='br-int',has_traffic_filtering=True,id=15dca2c3-5048-4e80-8008-c19400ea34e4,network=Network(310c919b-177f-4fb1-956a-1423f7397f77),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15dca2c3-50') {{(pid=71731) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 16:21:56 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:21:56 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:21:56 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 16:21:56 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:21:56 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap15dca2c3-50, may_exist=True) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:21:56 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap15dca2c3-50, col_values=(('external_ids', {'iface-id': '15dca2c3-5048-4e80-8008-c19400ea34e4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:df:45:fc', 'vm-uuid': 'e4ada2d7-7ace-4ed4-86a6-ed121c95e80f'}),)) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:21:56 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:21:56 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 16:21:56 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:21:56 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd29157c-83da-413e-8bef-f8abfc2c5baa]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c7f6ad-d2c2-465a-b39e-47347aa85be0 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48af37b0-6938-432e-b374-d992c4dd9ae9 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c20e80fa-58de-431a-8901-2535657aaadf (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27919afc-8990-4ed5-af9e-9d6b3d7b231e (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc639d00-ef6b-4121-bcb0-c65ec0347abd (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0f728f3-fbb5-4ed8-a78b-a5d982b03f7d (non-flash)\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:21:56 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984 (non-flash)
Apr 13 16:21:56 user nova-compute[71731]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c7f6ad-d2c2-465a-b39e-47347aa85be0 (non-flash)
Apr 13 16:21:56 user nova-compute[71731]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48af37b0-6938-432e-b374-d992c4dd9ae9 (non-flash)
Apr 13 16:21:56 user nova-compute[71731]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c20e80fa-58de-431a-8901-2535657aaadf (non-flash)
Apr 13 16:21:56 user nova-compute[71731]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27919afc-8990-4ed5-af9e-9d6b3d7b231e (non-flash)
Apr 13 16:21:56 user nova-compute[71731]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc639d00-ef6b-4121-bcb0-c65ec0347abd (non-flash)
Apr 13 16:21:56 user nova-compute[71731]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0f728f3-fbb5-4ed8-a78b-a5d982b03f7d (non-flash)
Apr 13 16:21:56 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 16:21:56 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984 (non-flash)
Apr 13 16:21:56 user nova-compute[71731]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c7f6ad-d2c2-465a-b39e-47347aa85be0 (non-flash)
Apr 13 16:21:56 user nova-compute[71731]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48af37b0-6938-432e-b374-d992c4dd9ae9 (non-flash)
Apr 13 16:21:56 user nova-compute[71731]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c20e80fa-58de-431a-8901-2535657aaadf (non-flash)
Apr 13 16:21:56 user nova-compute[71731]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27919afc-8990-4ed5-af9e-9d6b3d7b231e (non-flash)
Apr 13 16:21:56 user nova-compute[71731]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc639d00-ef6b-4121-bcb0-c65ec0347abd (non-flash)
Apr 13 16:21:56 user nova-compute[71731]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0f728f3-fbb5-4ed8-a78b-a5d982b03f7d (non-flash)
Apr 13 16:21:56 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 16:21:56 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e0f728f3-fbb5-4ed8-a78b-a5d982b03f7d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.327s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 16:21:56 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Connected to 172.16.0.220:3260 {{(pid=71731) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 16:21:56 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] HCTL ('39', '-', '-', 0) found on session 8 with lun 0 {{(pid=71731) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 16:21:56 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=71731) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 16:21:56 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:21:56 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.022s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:21:56 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c963ae1-072c-4dd4-b15d-4775bb5e07af]: (4, ('- - 0', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:21:56 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Searching for a device in session 8 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=71731) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 16:21:56 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:e0f728f3-fbb5-4ed8-a78b-a5d982b03f7d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nSEqPQZM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71731) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 16:21:56 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:21:56 user nova-compute[71731]: INFO os_vif [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:45:fc,bridge_name='br-int',has_traffic_filtering=True,id=15dca2c3-5048-4e80-8008-c19400ea34e4,network=Network(310c919b-177f-4fb1-956a-1423f7397f77),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15dca2c3-50')
Apr 13 16:21:56 user nova-compute[71731]: DEBUG nova.virt.libvirt.vif [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T16:21:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-425684793',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-425684793',id=8,image_ref='708622a9-7465-4492-ade8-b827198f7e30',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI5YQpLaGCSGL4ntWt11BFFgnGrQ3fItNIdB138VboyJqclL9H8Ulyx/xxT8IGEQfueXv2SL9+Q3QwgV/gEuhZSJPXCS54honN2kOhqtEWQCcit240y/RW04xC4ADo4EdQ==',key_name='tempest-keypair-135831071',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7649e366b0164e2fa5b3faa0830b6ea6',ramdisk_id='',reservation_id='r-newglzq9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='708622a9-7465-4492-ade8-b827198f7e30',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1193811043',owner_user_name='tempest-TaggedBootDevicesTest_v242-1193811043-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T16:21:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7e50bd9d540549a194f706dac48ce93d',uuid=e4ada2d7-7ace-4ed4-86a6-ed121c95e80f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d41765b6-0d5b-43c1-bf58-a82a7bbe3137", "address": "fa:16:3e:63:86:1f", "network": {"id": "310c919b-177f-4fb1-956a-1423f7397f77", "bridge": "br-int", "label": "tempest-device-tagging-net2-188582195", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7649e366b0164e2fa5b3faa0830b6ea6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd41765b6-0d", "ovs_interfaceid": "d41765b6-0d5b-43c1-bf58-a82a7bbe3137", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 16:21:56 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Converting VIF {"id": "d41765b6-0d5b-43c1-bf58-a82a7bbe3137", "address": "fa:16:3e:63:86:1f", "network": {"id": "310c919b-177f-4fb1-956a-1423f7397f77", "bridge": "br-int", "label": "tempest-device-tagging-net2-188582195", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7649e366b0164e2fa5b3faa0830b6ea6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd41765b6-0d", "ovs_interfaceid": "d41765b6-0d5b-43c1-bf58-a82a7bbe3137", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 16:21:56 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:63:86:1f,bridge_name='br-int',has_traffic_filtering=True,id=d41765b6-0d5b-43c1-bf58-a82a7bbe3137,network=Network(310c919b-177f-4fb1-956a-1423f7397f77),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd41765b6-0d') {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 16:21:56 user nova-compute[71731]: DEBUG os_vif [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:63:86:1f,bridge_name='br-int',has_traffic_filtering=True,id=d41765b6-0d5b-43c1-bf58-a82a7bbe3137,network=Network(310c919b-177f-4fb1-956a-1423f7397f77),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd41765b6-0d') {{(pid=71731) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 16:21:56 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:21:56 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:21:56 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 16:21:56 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:21:56 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd41765b6-0d, may_exist=True) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:21:56 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd41765b6-0d, col_values=(('external_ids', {'iface-id': 'd41765b6-0d5b-43c1-bf58-a82a7bbe3137', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:63:86:1f', 'vm-uuid': 'e4ada2d7-7ace-4ed4-86a6-ed121c95e80f'}),)) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:21:56 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 16:21:56 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:21:56 user nova-compute[71731]: INFO os_vif [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:63:86:1f,bridge_name='br-int',has_traffic_filtering=True,id=d41765b6-0d5b-43c1-bf58-a82a7bbe3137,network=Network(310c919b-177f-4fb1-956a-1423f7397f77),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd41765b6-0d')
Apr 13 16:21:56 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] No BDM found with device name hda, not building metadata. {{(pid=71731) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 16:21:56 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] No BDM found with device name vdc, not building metadata. {{(pid=71731) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 16:21:56 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] No VIF found with MAC fa:16:3e:ee:b5:cc, not building metadata {{(pid=71731) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 16:21:56 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] No VIF found with MAC fa:16:3e:30:1c:f5, not building metadata {{(pid=71731) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 16:21:56 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] [instance: e4ada2d7-7ace-4ed4-86a6-ed121c95e80f] Using config drive
Apr 13 16:21:56 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] [instance: e4ada2d7-7ace-4ed4-86a6-ed121c95e80f] Creating config drive at /opt/stack/data/nova/instances/e4ada2d7-7ace-4ed4-86a6-ed121c95e80f/disk.config
Apr 13 16:21:56 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/e4ada2d7-7ace-4ed4-86a6-ed121c95e80f/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp4mz_4ybd {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:21:56 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/e4ada2d7-7ace-4ed4-86a6-ed121c95e80f/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp4mz_4ybd" returned: 0 in 0.053s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:21:56 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:21:57 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.377s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 16:21:57 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] <== connect_volume: return (2710ms) {'type': 'block', 'scsi_wwn': '26638336238633934', 'path': '/dev/sdh'} {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 16:21:57 user nova-compute[71731]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] [instance: 2549ba85-4e0a-420e-b711-07cafa8c60e9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26638336238633934', 'path': '/dev/sdh'} {{(pid=71731) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 16:21:57 user nova-compute[71731]: DEBUG nova.virt.libvirt.vif [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T16:21:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1688495933',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1688495933',id=9,image_ref='708622a9-7465-4492-ade8-b827198f7e30',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCmDAWwVmv7Q34Pz29t07av6aMRdzm3EgCQrfLBn83RkLO81Y7UjJ2zO/1nlrHzXzESZuCtlZxhzD9V6rEN/0ixQxrUu0ZuX2RNLf7aGDMjaY4XAH+0pTu29dKUMlHtNng==',key_name='tempest-keypair-756136845',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bbe4e9fb786d4015b035b4d00f75a1ba',ramdisk_id='',reservation_id='r-ulxepirk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='708622a9-7465-4492-ade8-b827198f7e30',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1779812468',owner_user_name='tempest-TaggedBootDevicesTest-1779812468-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T16:21:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='14566b85d0424c08999726ff72a67634',uuid=2549ba85-4e0a-420e-b711-07cafa8c60e9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "36152688-366c-40a2-8bf9-88f69925594a", "address": "fa:16:3e:1c:8b:59", "network": {"id": "f11266a1-4740-4cb3-8467-e0e95870ac22", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-689537131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbe4e9fb786d4015b035b4d00f75a1ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36152688-36", "ovs_interfaceid": "36152688-366c-40a2-8bf9-88f69925594a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71731) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 16:21:57 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Converting VIF {"id": "36152688-366c-40a2-8bf9-88f69925594a", "address": "fa:16:3e:1c:8b:59", "network": {"id": "f11266a1-4740-4cb3-8467-e0e95870ac22", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-689537131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbe4e9fb786d4015b035b4d00f75a1ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36152688-36", "ovs_interfaceid": "36152688-366c-40a2-8bf9-88f69925594a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 16:21:57 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1c:8b:59,bridge_name='br-int',has_traffic_filtering=True,id=36152688-366c-40a2-8bf9-88f69925594a,network=Network(f11266a1-4740-4cb3-8467-e0e95870ac22),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36152688-36') {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 16:21:57 user nova-compute[71731]: DEBUG nova.virt.libvirt.vif [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T16:21:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1688495933',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1688495933',id=9,image_ref='708622a9-7465-4492-ade8-b827198f7e30',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCmDAWwVmv7Q34Pz29t07av6aMRdzm3EgCQrfLBn83RkLO81Y7UjJ2zO/1nlrHzXzESZuCtlZxhzD9V6rEN/0ixQxrUu0ZuX2RNLf7aGDMjaY4XAH+0pTu29dKUMlHtNng==',key_name='tempest-keypair-756136845',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bbe4e9fb786d4015b035b4d00f75a1ba',ramdisk_id='',reservation_id='r-ulxepirk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='708622a9-7465-4492-ade8-b827198f7e30',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1779812468',owner_user_name='tempest-TaggedBootDevicesTest-1779812468-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T16:21:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='14566b85d0424c08999726ff72a67634',uuid=2549ba85-4e0a-420e-b711-07cafa8c60e9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d7155dcf-9e83-4579-b81a-7277d4a9eeaf", "address": "fa:16:3e:d0:1a:bc", "network": {"id": "5d158a82-de85-48b5-9f17-40e61e9b0df8", "bridge": "br-int", "label": "tempest-device-tagging-net1-574676351", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.246", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bbe4e9fb786d4015b035b4d00f75a1ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7155dcf-9e", "ovs_interfaceid": "d7155dcf-9e83-4579-b81a-7277d4a9eeaf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71731) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 16:21:57 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Converting VIF {"id": "d7155dcf-9e83-4579-b81a-7277d4a9eeaf", "address": "fa:16:3e:d0:1a:bc", "network": {"id": "5d158a82-de85-48b5-9f17-40e61e9b0df8", "bridge": "br-int", "label": "tempest-device-tagging-net1-574676351", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.246", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bbe4e9fb786d4015b035b4d00f75a1ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7155dcf-9e", "ovs_interfaceid": "d7155dcf-9e83-4579-b81a-7277d4a9eeaf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 16:21:57 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d0:1a:bc,bridge_name='br-int',has_traffic_filtering=True,id=d7155dcf-9e83-4579-b81a-7277d4a9eeaf,network=Network(5d158a82-de85-48b5-9f17-40e61e9b0df8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd7155dcf-9e') {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 16:21:57 user nova-compute[71731]: DEBUG nova.virt.libvirt.vif [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T16:21:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1688495933',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1688495933',id=9,image_ref='708622a9-7465-4492-ade8-b827198f7e30',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCmDAWwVmv7Q34Pz29t07av6aMRdzm3EgCQrfLBn83RkLO81Y7UjJ2zO/1nlrHzXzESZuCtlZxhzD9V6rEN/0ixQxrUu0ZuX2RNLf7aGDMjaY4XAH+0pTu29dKUMlHtNng==',key_name='tempest-keypair-756136845',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bbe4e9fb786d4015b035b4d00f75a1ba',ramdisk_id='',reservation_id='r-ulxepirk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='708622a9-7465-4492-ade8-b827198f7e30',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1779812468',owner_user_name='tempest-TaggedBootDevicesTest-1779812468-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T16:21:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='14566b85d0424c08999726ff72a67634',uuid=2549ba85-4e0a-420e-b711-07cafa8c60e9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4c481745-6342-43f8-9040-3ea1d8c5c572", "address": "fa:16:3e:e7:ea:ff", "network": {"id": "5d158a82-de85-48b5-9f17-40e61e9b0df8", "bridge": "br-int", "label": "tempest-device-tagging-net1-574676351", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.164", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bbe4e9fb786d4015b035b4d00f75a1ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c481745-63", "ovs_interfaceid": "4c481745-6342-43f8-9040-3ea1d8c5c572", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71731) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 16:21:57 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Converting VIF {"id": "4c481745-6342-43f8-9040-3ea1d8c5c572", "address": "fa:16:3e:e7:ea:ff", "network": {"id": "5d158a82-de85-48b5-9f17-40e61e9b0df8", "bridge": "br-int", "label": "tempest-device-tagging-net1-574676351", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.164", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bbe4e9fb786d4015b035b4d00f75a1ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c481745-63", "ovs_interfaceid": "4c481745-6342-43f8-9040-3ea1d8c5c572", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 16:21:57 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:ea:ff,bridge_name='br-int',has_traffic_filtering=True,id=4c481745-6342-43f8-9040-3ea1d8c5c572,network=Network(5d158a82-de85-48b5-9f17-40e61e9b0df8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4c481745-63') {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 16:21:57 user nova-compute[71731]: DEBUG nova.virt.libvirt.vif [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T16:21:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1688495933',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1688495933',id=9,image_ref='708622a9-7465-4492-ade8-b827198f7e30',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCmDAWwVmv7Q34Pz29t07av6aMRdzm3EgCQrfLBn83RkLO81Y7UjJ2zO/1nlrHzXzESZuCtlZxhzD9V6rEN/0ixQxrUu0ZuX2RNLf7aGDMjaY4XAH+0pTu29dKUMlHtNng==',key_name='tempest-keypair-756136845',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bbe4e9fb786d4015b035b4d00f75a1ba',ramdisk_id='',reservation_id='r-ulxepirk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='708622a9-7465-4492-ade8-b827198f7e30',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1779812468',owner_user_name='tempest-TaggedBootDevicesTest-1779812468-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T16:21:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='14566b85d0424c08999726ff72a67634',uuid=2549ba85-4e0a-420e-b711-07cafa8c60e9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0152bbb9-d50d-4e58-8a2b-727c4675ea2f", "address": "fa:16:3e:0d:4d:58", "network": {"id": "5d158a82-de85-48b5-9f17-40e61e9b0df8", "bridge": "br-int", "label": "tempest-device-tagging-net1-574676351", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.142", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bbe4e9fb786d4015b035b4d00f75a1ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0152bbb9-d5", "ovs_interfaceid": "0152bbb9-d50d-4e58-8a2b-727c4675ea2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71731) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 16:21:57 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Converting VIF {"id": "0152bbb9-d50d-4e58-8a2b-727c4675ea2f", "address": "fa:16:3e:0d:4d:58", "network": {"id": "5d158a82-de85-48b5-9f17-40e61e9b0df8", "bridge": "br-int", "label": "tempest-device-tagging-net1-574676351", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.142", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bbe4e9fb786d4015b035b4d00f75a1ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0152bbb9-d5", "ovs_interfaceid": "0152bbb9-d50d-4e58-8a2b-727c4675ea2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 16:21:57 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0d:4d:58,bridge_name='br-int',has_traffic_filtering=True,id=0152bbb9-d50d-4e58-8a2b-727c4675ea2f,network=Network(5d158a82-de85-48b5-9f17-40e61e9b0df8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0152bbb9-d5') {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 16:21:57 user nova-compute[71731]: DEBUG nova.virt.libvirt.vif [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T16:21:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1688495933',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1688495933',id=9,image_ref='708622a9-7465-4492-ade8-b827198f7e30',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCmDAWwVmv7Q34Pz29t07av6aMRdzm3EgCQrfLBn83RkLO81Y7UjJ2zO/1nlrHzXzESZuCtlZxhzD9V6rEN/0ixQxrUu0ZuX2RNLf7aGDMjaY4XAH+0pTu29dKUMlHtNng==',key_name='tempest-keypair-756136845',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bbe4e9fb786d4015b035b4d00f75a1ba',ramdisk_id='',reservation_id='r-ulxepirk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='708622a9-7465-4492-ade8-b827198f7e30',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1779812468',owner_user_name='tempest-TaggedBootDevicesTest-1779812468-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T16:21:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='14566b85d0424c08999726ff72a67634',uuid=2549ba85-4e0a-420e-b711-07cafa8c60e9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3730ed6e-b093-4232-800b-b064d650e9e8", "address": "fa:16:3e:a8:c4:f6", "network": {"id": "5d158a82-de85-48b5-9f17-40e61e9b0df8", "bridge": "br-int", "label": "tempest-device-tagging-net1-574676351", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.38", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bbe4e9fb786d4015b035b4d00f75a1ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3730ed6e-b0", "ovs_interfaceid": "3730ed6e-b093-4232-800b-b064d650e9e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71731) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 16:21:57 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Converting VIF {"id": "3730ed6e-b093-4232-800b-b064d650e9e8", "address": "fa:16:3e:a8:c4:f6", "network": {"id": "5d158a82-de85-48b5-9f17-40e61e9b0df8", "bridge": "br-int", "label": "tempest-device-tagging-net1-574676351", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.38", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bbe4e9fb786d4015b035b4d00f75a1ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3730ed6e-b0", "ovs_interfaceid": "3730ed6e-b093-4232-800b-b064d650e9e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 16:21:57 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a8:c4:f6,bridge_name='br-int',has_traffic_filtering=True,id=3730ed6e-b093-4232-800b-b064d650e9e8,network=Network(5d158a82-de85-48b5-9f17-40e61e9b0df8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3730ed6e-b0') {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 16:21:57 user nova-compute[71731]: DEBUG nova.virt.libvirt.vif [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T16:21:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1688495933',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1688495933',id=9,image_ref='708622a9-7465-4492-ade8-b827198f7e30',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCmDAWwVmv7Q34Pz29t07av6aMRdzm3EgCQrfLBn83RkLO81Y7UjJ2zO/1nlrHzXzESZuCtlZxhzD9V6rEN/0ixQxrUu0ZuX2RNLf7aGDMjaY4XAH+0pTu29dKUMlHtNng==',key_name='tempest-keypair-756136845',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bbe4e9fb786d4015b035b4d00f75a1ba',ramdisk_id='',reservation_id='r-ulxepirk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='708622a9-7465-4492-ade8-b827198f7e30',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1779812468',owner_user_name='tempest-TaggedBootDevicesTest-1779812468-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T16:21:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='14566b85d0424c08999726ff72a67634',uuid=2549ba85-4e0a-420e-b711-07cafa8c60e9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0fbdf291-df5d-41c5-a765-7145a87da272", "address": "fa:16:3e:dc:57:7b", "network": {"id": "4224b04f-23ed-464e-9b2c-df8c843f9287", "bridge": "br-int", "label": "tempest-device-tagging-net2-109401200", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "bbe4e9fb786d4015b035b4d00f75a1ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fbdf291-df", "ovs_interfaceid": "0fbdf291-df5d-41c5-a765-7145a87da272", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71731) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 16:21:57 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Converting VIF {"id": "0fbdf291-df5d-41c5-a765-7145a87da272", "address": "fa:16:3e:dc:57:7b", "network": {"id": "4224b04f-23ed-464e-9b2c-df8c843f9287", "bridge": "br-int", "label": "tempest-device-tagging-net2-109401200", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "bbe4e9fb786d4015b035b4d00f75a1ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fbdf291-df", "ovs_interfaceid": "0fbdf291-df5d-41c5-a765-7145a87da272", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 16:21:57 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dc:57:7b,bridge_name='br-int',has_traffic_filtering=True,id=0fbdf291-df5d-41c5-a765-7145a87da272,network=Network(4224b04f-23ed-464e-9b2c-df8c843f9287),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0fbdf291-df') {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 16:21:57 user nova-compute[71731]: DEBUG nova.virt.libvirt.vif [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T16:21:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1688495933',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1688495933',id=9,image_ref='708622a9-7465-4492-ade8-b827198f7e30',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCmDAWwVmv7Q34Pz29t07av6aMRdzm3EgCQrfLBn83RkLO81Y7UjJ2zO/1nlrHzXzESZuCtlZxhzD9V6rEN/0ixQxrUu0ZuX2RNLf7aGDMjaY4XAH+0pTu29dKUMlHtNng==',key_name='tempest-keypair-756136845',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bbe4e9fb786d4015b035b4d00f75a1ba',ramdisk_id='',reservation_id='r-ulxepirk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='708622a9-7465-4492-ade8-b827198f7e30',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1779812468',owner_user_name='tempest-TaggedBootDevicesTest-1779812468-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T16:21:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='14566b85d0424c08999726ff72a67634',uuid=2549ba85-4e0a-420e-b711-07cafa8c60e9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "38e92b7c-b7c1-4137-a1db-21bc1d24f3ee", "address": "fa:16:3e:a3:dd:27", "network": {"id": "4224b04f-23ed-464e-9b2c-df8c843f9287", "bridge": "br-int", "label": "tempest-device-tagging-net2-109401200", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "bbe4e9fb786d4015b035b4d00f75a1ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38e92b7c-b7", "ovs_interfaceid": "38e92b7c-b7c1-4137-a1db-21bc1d24f3ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71731) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 16:21:57 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Converting VIF {"id": "38e92b7c-b7c1-4137-a1db-21bc1d24f3ee", "address": "fa:16:3e:a3:dd:27", "network": {"id": "4224b04f-23ed-464e-9b2c-df8c843f9287", "bridge": "br-int", "label": "tempest-device-tagging-net2-109401200", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "bbe4e9fb786d4015b035b4d00f75a1ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38e92b7c-b7", "ovs_interfaceid": "38e92b7c-b7c1-4137-a1db-21bc1d24f3ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 16:21:57 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a3:dd:27,bridge_name='br-int',has_traffic_filtering=True,id=38e92b7c-b7c1-4137-a1db-21bc1d24f3ee,network=Network(4224b04f-23ed-464e-9b2c-df8c843f9287),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38e92b7c-b7') {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 16:21:57 user nova-compute[71731]: DEBUG nova.objects.instance [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Lazy-loading 'pci_devices' on Instance uuid 2549ba85-4e0a-420e-b711-07cafa8c60e9 {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:21:57 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] [instance: 2549ba85-4e0a-420e-b711-07cafa8c60e9] End _get_guest_xml xml=<domain type="kvm">
Apr 13 16:21:57 user nova-compute[71731]:   <uuid>2549ba85-4e0a-420e-b711-07cafa8c60e9</uuid>
Apr 13 16:21:57 user nova-compute[71731]:   <name>instance-00000009</name>
Apr 13 16:21:57 user nova-compute[71731]:   <memory>131072</memory>
Apr 13 16:21:57 user nova-compute[71731]:   <vcpu>1</vcpu>
Apr 13 16:21:57 user nova-compute[71731]:   <metadata>
Apr 13 16:21:57 user nova-compute[71731]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 16:21:57 user nova-compute[71731]:       <nova:package version="0.0.0"/>
Apr 13 16:21:57 user nova-compute[71731]:       <nova:name>tempest-device-tagging-server-1688495933</nova:name>
Apr 13 16:21:57 user nova-compute[71731]:       <nova:creationTime>2023-04-13 16:21:49</nova:creationTime>
Apr 13 16:21:57 user nova-compute[71731]:       <nova:flavor name="m1.nano">
Apr 13 16:21:57 user nova-compute[71731]:         <nova:memory>128</nova:memory>
Apr 13 16:21:57 user nova-compute[71731]:         <nova:disk>1</nova:disk>
Apr 13 16:21:57 user nova-compute[71731]:         <nova:swap>0</nova:swap>
Apr 13 16:21:57 user nova-compute[71731]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 16:21:57 user nova-compute[71731]:         <nova:vcpus>1</nova:vcpus>
Apr 13 16:21:57 user nova-compute[71731]:       </nova:flavor>
Apr 13 16:21:57 user nova-compute[71731]:       <nova:owner>
Apr 13 16:21:57 user nova-compute[71731]:         <nova:user uuid="14566b85d0424c08999726ff72a67634">tempest-TaggedBootDevicesTest-1779812468-project-member</nova:user>
Apr 13 16:21:57 user nova-compute[71731]:         <nova:project uuid="bbe4e9fb786d4015b035b4d00f75a1ba">tempest-TaggedBootDevicesTest-1779812468</nova:project>
Apr 13 16:21:57 user nova-compute[71731]:       </nova:owner>
Apr 13 16:21:57 user nova-compute[71731]:       <nova:root type="image" uuid="708622a9-7465-4492-ade8-b827198f7e30"/>
Apr 13 16:21:57 user nova-compute[71731]:       <nova:ports>
Apr 13 16:21:57 user nova-compute[71731]:         <nova:port uuid="36152688-366c-40a2-8bf9-88f69925594a">
Apr 13 16:21:57 user nova-compute[71731]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Apr 13 16:21:57 user nova-compute[71731]:         </nova:port>
Apr 13 16:21:57 user nova-compute[71731]:         <nova:port uuid="d7155dcf-9e83-4579-b81a-7277d4a9eeaf">
Apr 13 16:21:57 user nova-compute[71731]:           <nova:ip type="fixed" address="10.1.1.246" ipVersion="4"/>
Apr 13 16:21:57 user nova-compute[71731]:         </nova:port>
Apr 13 16:21:57 user nova-compute[71731]:         <nova:port uuid="4c481745-6342-43f8-9040-3ea1d8c5c572">
Apr 13 16:21:57 user nova-compute[71731]:           <nova:ip type="fixed" address="10.1.1.164" ipVersion="4"/>
Apr 13 16:21:57 user nova-compute[71731]:         </nova:port>
Apr 13 16:21:57 user nova-compute[71731]:         <nova:port uuid="0152bbb9-d50d-4e58-8a2b-727c4675ea2f">
Apr 13 16:21:57 user nova-compute[71731]:           <nova:ip type="fixed" address="10.1.1.142" ipVersion="4"/>
Apr 13 16:21:57 user nova-compute[71731]:         </nova:port>
Apr 13 16:21:57 user nova-compute[71731]:         <nova:port uuid="3730ed6e-b093-4232-800b-b064d650e9e8">
Apr 13 16:21:57 user nova-compute[71731]:           <nova:ip type="fixed" address="10.1.1.38" ipVersion="4"/>
Apr 13 16:21:57 user nova-compute[71731]:         </nova:port>
Apr 13 16:21:57 user nova-compute[71731]:         <nova:port uuid="0fbdf291-df5d-41c5-a765-7145a87da272">
Apr 13 16:21:57 user nova-compute[71731]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Apr 13 16:21:57 user nova-compute[71731]:         </nova:port>
Apr 13 16:21:57 user nova-compute[71731]:         <nova:port uuid="38e92b7c-b7c1-4137-a1db-21bc1d24f3ee">
Apr 13 16:21:57 user nova-compute[71731]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Apr 13 16:21:57 user nova-compute[71731]:         </nova:port>
Apr 13 16:21:57 user nova-compute[71731]:       </nova:ports>
Apr 13 16:21:57 user nova-compute[71731]:     </nova:instance>
Apr 13 16:21:57 user nova-compute[71731]:   </metadata>
Apr 13 16:21:57 user nova-compute[71731]:   <sysinfo type="smbios">
Apr 13 16:21:57 user nova-compute[71731]:     <system>
Apr 13 16:21:57 user nova-compute[71731]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 16:21:57 user nova-compute[71731]:       <entry name="product">OpenStack Nova</entry>
Apr 13 16:21:57 user nova-compute[71731]:       <entry name="version">0.0.0</entry>
Apr 13 16:21:57 user nova-compute[71731]:       <entry name="serial">2549ba85-4e0a-420e-b711-07cafa8c60e9</entry>
Apr 13 16:21:57 user nova-compute[71731]:       <entry name="uuid">2549ba85-4e0a-420e-b711-07cafa8c60e9</entry>
Apr 13 16:21:57 user nova-compute[71731]:       <entry name="family">Virtual Machine</entry>
Apr 13 16:21:57 user nova-compute[71731]:     </system>
Apr 13 16:21:57 user nova-compute[71731]:   </sysinfo>
Apr 13 16:21:57 user nova-compute[71731]:   <os>
Apr 13 16:21:57 user nova-compute[71731]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 16:21:57 user nova-compute[71731]:     <boot dev="hd"/>
Apr 13 16:21:57 user nova-compute[71731]:     <smbios mode="sysinfo"/>
Apr 13 16:21:57 user nova-compute[71731]:   </os>
Apr 13 16:21:57 user nova-compute[71731]:   <features>
Apr 13 16:21:57 user nova-compute[71731]:     <acpi/>
Apr 13 16:21:57 user nova-compute[71731]:     <apic/>
Apr 13 16:21:57 user nova-compute[71731]:     <vmcoreinfo/>
Apr 13 16:21:57 user nova-compute[71731]:   </features>
Apr 13 16:21:57 user nova-compute[71731]:   <clock offset="utc">
Apr 13 16:21:57 user nova-compute[71731]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 16:21:57 user nova-compute[71731]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 16:21:57 user nova-compute[71731]:     <timer name="hpet" present="no"/>
Apr 13 16:21:57 user nova-compute[71731]:   </clock>
Apr 13 16:21:57 user nova-compute[71731]:   <cpu mode="custom" match="exact">
Apr 13 16:21:57 user nova-compute[71731]:     <model>Nehalem</model>
Apr 13 16:21:57 user nova-compute[71731]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 16:21:57 user nova-compute[71731]:   </cpu>
Apr 13 16:21:57 user nova-compute[71731]:   <devices>
Apr 13 16:21:57 user nova-compute[71731]:     <disk type="file" device="cdrom">
Apr 13 16:21:57 user nova-compute[71731]:       <driver name="qemu" type="raw" cache="none"/>
Apr 13 16:21:57 user nova-compute[71731]:       <source file="/opt/stack/data/nova/instances/2549ba85-4e0a-420e-b711-07cafa8c60e9/disk.config"/>
Apr 13 16:21:57 user nova-compute[71731]:       <target dev="hda" bus="ide"/>
Apr 13 16:21:57 user nova-compute[71731]:     </disk>
Apr 13 16:21:57 user nova-compute[71731]:     <disk type="block" device="disk">
Apr 13 16:21:57 user nova-compute[71731]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 16:21:57 user nova-compute[71731]:       <source dev="/dev/sdd"/>
Apr 13 16:21:57 user nova-compute[71731]:       <target dev="vda" bus="virtio"/>
Apr 13 16:21:57 user nova-compute[71731]:       <serial>48af37b0-6938-432e-b374-d992c4dd9ae9</serial>
Apr 13 16:21:57 user nova-compute[71731]:     </disk>
Apr 13 16:21:57 user nova-compute[71731]:     <disk type="block" device="disk">
Apr 13 16:21:57 user nova-compute[71731]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 16:21:57 user nova-compute[71731]:       <source dev="/dev/sdf"/>
Apr 13 16:21:57 user nova-compute[71731]:       <target dev="vdb" bus="virtio"/>
Apr 13 16:21:57 user nova-compute[71731]:       <serial>27919afc-8990-4ed5-af9e-9d6b3d7b231e</serial>
Apr 13 16:21:57 user nova-compute[71731]:     </disk>
Apr 13 16:21:57 user nova-compute[71731]:     <disk type="block" device="disk">
Apr 13 16:21:57 user nova-compute[71731]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 16:21:57 user nova-compute[71731]:       <source dev="/dev/sdh"/>
Apr 13 16:21:57 user nova-compute[71731]:       <target dev="vdc" bus="virtio"/>
Apr 13 16:21:57 user nova-compute[71731]:       <serial>e0f728f3-fbb5-4ed8-a78b-a5d982b03f7d</serial>
Apr 13 16:21:57 user nova-compute[71731]:     </disk>
Apr 13 16:21:57 user nova-compute[71731]:     <interface type="ethernet">
Apr 13 16:21:57 user nova-compute[71731]:       <mac address="fa:16:3e:1c:8b:59"/>
Apr 13 16:21:57 user nova-compute[71731]:       <model type="virtio"/>
Apr 13 16:21:57 user nova-compute[71731]:       <mtu size="1442"/>
Apr 13 16:21:57 user nova-compute[71731]:       <target dev="tap36152688-36"/>
Apr 13 16:21:57 user nova-compute[71731]:     </interface>
Apr 13 16:21:57 user nova-compute[71731]:     <interface type="ethernet">
Apr 13 16:21:57 user nova-compute[71731]:       <mac address="fa:16:3e:d0:1a:bc"/>
Apr 13 16:21:57 user nova-compute[71731]:       <model type="virtio"/>
Apr 13 16:21:57 user nova-compute[71731]:       <mtu size="1442"/>
Apr 13 16:21:57 user nova-compute[71731]:       <target dev="tapd7155dcf-9e"/>
Apr 13 16:21:57 user nova-compute[71731]:     </interface>
Apr 13 16:21:57 user nova-compute[71731]:     <interface type="ethernet">
Apr 13 16:21:57 user nova-compute[71731]:       <mac address="fa:16:3e:e7:ea:ff"/>
Apr 13 16:21:57 user nova-compute[71731]:       <model type="virtio"/>
Apr 13 16:21:57 user nova-compute[71731]:       <mtu size="1442"/>
Apr 13 16:21:57 user nova-compute[71731]:       <target dev="tap4c481745-63"/>
Apr 13 16:21:57 user nova-compute[71731]:     </interface>
Apr 13 16:21:57 user nova-compute[71731]:     <interface type="ethernet">
Apr 13 16:21:57 user nova-compute[71731]:       <mac address="fa:16:3e:0d:4d:58"/>
Apr 13 16:21:57 user nova-compute[71731]:       <model type="virtio"/>
Apr 13 16:21:57 user nova-compute[71731]:       <mtu size="1442"/>
Apr 13 16:21:57 user nova-compute[71731]:       <target dev="tap0152bbb9-d5"/>
Apr 13 16:21:57 user nova-compute[71731]:     </interface>
Apr 13 16:21:57 user nova-compute[71731]:     <interface type="ethernet">
Apr 13 16:21:57 user nova-compute[71731]:       <mac address="fa:16:3e:a8:c4:f6"/>
Apr 13 16:21:57 user nova-compute[71731]:       <model type="virtio"/>
Apr 13 16:21:57 user nova-compute[71731]:       <mtu size="1442"/>
Apr 13 16:21:57 user nova-compute[71731]:       <target dev="tap3730ed6e-b0"/>
Apr 13 16:21:57 user nova-compute[71731]:     </interface>
Apr 13 16:21:57 user nova-compute[71731]:     <interface type="ethernet">
Apr 13 16:21:57 user nova-compute[71731]:       <mac address="fa:16:3e:dc:57:7b"/>
Apr 13 16:21:57 user nova-compute[71731]:       <model type="virtio"/>
Apr 13 16:21:57 user nova-compute[71731]:       <mtu size="1442"/>
Apr 13 16:21:57 user nova-compute[71731]:       <target dev="tap0fbdf291-df"/>
Apr 13 16:21:57 user nova-compute[71731]:     </interface>
Apr 13 16:21:57 user nova-compute[71731]:     <interface type="ethernet">
Apr 13 16:21:57 user nova-compute[71731]:       <mac address="fa:16:3e:a3:dd:27"/>
Apr 13 16:21:57 user nova-compute[71731]:       <model type="virtio"/>
Apr 13 16:21:57 user nova-compute[71731]:       <mtu size="1442"/>
Apr 13 16:21:57 user nova-compute[71731]:       <target dev="tap38e92b7c-b7"/>
Apr 13 16:21:57 user nova-compute[71731]:     </interface>
Apr 13 16:21:57 user nova-compute[71731]:     <serial type="pty">
Apr 13 16:21:57 user nova-compute[71731]:       <log file="/opt/stack/data/nova/instances/2549ba85-4e0a-420e-b711-07cafa8c60e9/console.log" append="off"/>
Apr 13 16:21:57 user nova-compute[71731]:     </serial>
Apr 13 16:21:57 user nova-compute[71731]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 16:21:57 user nova-compute[71731]:     <video>
Apr 13 16:21:57 user nova-compute[71731]:       <model type="virtio"/>
Apr 13 16:21:57 user nova-compute[71731]:     </video>
Apr 13 16:21:57 user nova-compute[71731]:     <rng model="virtio">
Apr 13 16:21:57 user nova-compute[71731]:       <backend model="random">/dev/urandom</backend>
Apr 13 16:21:57 user nova-compute[71731]:     </rng>
Apr 13 16:21:57 user nova-compute[71731]:     <controller type="usb" index="0" model="none"/>
Apr 13 16:21:57 user nova-compute[71731]:     <memballoon model="virtio">
Apr 13 16:21:57 user nova-compute[71731]:       <stats period="10"/>
Apr 13 16:21:57 user nova-compute[71731]:     </memballoon>
Apr 13 16:21:57 user nova-compute[71731]:   </devices>
Apr 13 16:21:57 user nova-compute[71731]: </domain>
Apr 13 16:21:57 user nova-compute[71731]:  {{(pid=71731) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 16:21:57 user nova-compute[71731]: DEBUG nova.virt.libvirt.vif [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T16:21:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1688495933',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1688495933',id=9,image_ref='708622a9-7465-4492-ade8-b827198f7e30',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCmDAWwVmv7Q34Pz29t07av6aMRdzm3EgCQrfLBn83RkLO81Y7UjJ2zO/1nlrHzXzESZuCtlZxhzD9V6rEN/0ixQxrUu0ZuX2RNLf7aGDMjaY4XAH+0pTu29dKUMlHtNng==',key_name='tempest-keypair-756136845',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bbe4e9fb786d4015b035b4d00f75a1ba',ramdisk_id='',reservation_id='r-ulxepirk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='708622a9-7465-4492-ade8-b827198f7e30',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1779812468',owner_user_name='tempest-TaggedBootDevicesTest-1779812468-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T16:21:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='14566b85d0424c08999726ff72a67634',uuid=2549ba85-4e0a-420e-b711-07cafa8c60e9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "36152688-366c-40a2-8bf9-88f69925594a", "address": "fa:16:3e:1c:8b:59", "network": {"id": "f11266a1-4740-4cb3-8467-e0e95870ac22", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-689537131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbe4e9fb786d4015b035b4d00f75a1ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36152688-36", "ovs_interfaceid": "36152688-366c-40a2-8bf9-88f69925594a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 16:21:57 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Converting VIF {"id": "36152688-366c-40a2-8bf9-88f69925594a", "address": "fa:16:3e:1c:8b:59", "network": {"id": "f11266a1-4740-4cb3-8467-e0e95870ac22", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-689537131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbe4e9fb786d4015b035b4d00f75a1ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36152688-36", "ovs_interfaceid": "36152688-366c-40a2-8bf9-88f69925594a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 16:21:57 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1c:8b:59,bridge_name='br-int',has_traffic_filtering=True,id=36152688-366c-40a2-8bf9-88f69925594a,network=Network(f11266a1-4740-4cb3-8467-e0e95870ac22),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36152688-36') {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 16:21:57 user nova-compute[71731]: DEBUG os_vif [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1c:8b:59,bridge_name='br-int',has_traffic_filtering=True,id=36152688-366c-40a2-8bf9-88f69925594a,network=Network(f11266a1-4740-4cb3-8467-e0e95870ac22),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36152688-36') {{(pid=71731) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 16:21:57 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:21:57 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:21:57 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 16:21:57 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:21:57 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap36152688-36, may_exist=True) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:21:57 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap36152688-36, col_values=(('external_ids', {'iface-id': '36152688-366c-40a2-8bf9-88f69925594a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1c:8b:59', 'vm-uuid': '2549ba85-4e0a-420e-b711-07cafa8c60e9'}),)) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:21:57 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:21:57 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 16:21:57 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:21:57 user nova-compute[71731]: INFO os_vif [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1c:8b:59,bridge_name='br-int',has_traffic_filtering=True,id=36152688-366c-40a2-8bf9-88f69925594a,network=Network(f11266a1-4740-4cb3-8467-e0e95870ac22),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36152688-36')
Apr 13 16:21:57 user nova-compute[71731]: DEBUG nova.virt.libvirt.vif [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T16:21:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1688495933',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1688495933',id=9,image_ref='708622a9-7465-4492-ade8-b827198f7e30',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCmDAWwVmv7Q34Pz29t07av6aMRdzm3EgCQrfLBn83RkLO81Y7UjJ2zO/1nlrHzXzESZuCtlZxhzD9V6rEN/0ixQxrUu0ZuX2RNLf7aGDMjaY4XAH+0pTu29dKUMlHtNng==',key_name='tempest-keypair-756136845',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bbe4e9fb786d4015b035b4d00f75a1ba',ramdisk_id='',reservation_id='r-ulxepirk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='708622a9-7465-4492-ade8-b827198f7e30',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1779812468',owner_user_name='tempest-TaggedBootDevicesTest-1779812468-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T16:21:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='14566b85d0424c08999726ff72a67634',uuid=2549ba85-4e0a-420e-b711-07cafa8c60e9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d7155dcf-9e83-4579-b81a-7277d4a9eeaf", "address": "fa:16:3e:d0:1a:bc", "network": {"id": "5d158a82-de85-48b5-9f17-40e61e9b0df8", "bridge": "br-int", "label": "tempest-device-tagging-net1-574676351", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.246", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bbe4e9fb786d4015b035b4d00f75a1ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7155dcf-9e", "ovs_interfaceid": "d7155dcf-9e83-4579-b81a-7277d4a9eeaf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71731) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 16:21:57 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Converting VIF {"id": "d7155dcf-9e83-4579-b81a-7277d4a9eeaf", "address": "fa:16:3e:d0:1a:bc", "network": {"id": "5d158a82-de85-48b5-9f17-40e61e9b0df8", "bridge": "br-int", "label": "tempest-device-tagging-net1-574676351", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.246", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bbe4e9fb786d4015b035b4d00f75a1ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7155dcf-9e", "ovs_interfaceid": "d7155dcf-9e83-4579-b81a-7277d4a9eeaf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 16:21:57 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d0:1a:bc,bridge_name='br-int',has_traffic_filtering=True,id=d7155dcf-9e83-4579-b81a-7277d4a9eeaf,network=Network(5d158a82-de85-48b5-9f17-40e61e9b0df8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd7155dcf-9e') {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 16:21:57 user nova-compute[71731]: DEBUG os_vif [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:1a:bc,bridge_name='br-int',has_traffic_filtering=True,id=d7155dcf-9e83-4579-b81a-7277d4a9eeaf,network=Network(5d158a82-de85-48b5-9f17-40e61e9b0df8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd7155dcf-9e') {{(pid=71731) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 16:21:57 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:21:57 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:21:57 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 16:21:57 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:21:57 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd7155dcf-9e, may_exist=True) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:21:57 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd7155dcf-9e, col_values=(('external_ids', {'iface-id': 'd7155dcf-9e83-4579-b81a-7277d4a9eeaf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d0:1a:bc', 'vm-uuid': '2549ba85-4e0a-420e-b711-07cafa8c60e9'}),)) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:21:57 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:21:57 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 16:21:57 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:21:57 user nova-compute[71731]: INFO os_vif [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:1a:bc,bridge_name='br-int',has_traffic_filtering=True,id=d7155dcf-9e83-4579-b81a-7277d4a9eeaf,network=Network(5d158a82-de85-48b5-9f17-40e61e9b0df8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd7155dcf-9e')
Apr 13 16:21:57 user nova-compute[71731]: DEBUG nova.virt.libvirt.vif [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T16:21:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1688495933',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1688495933',id=9,image_ref='708622a9-7465-4492-ade8-b827198f7e30',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCmDAWwVmv7Q34Pz29t07av6aMRdzm3EgCQrfLBn83RkLO81Y7UjJ2zO/1nlrHzXzESZuCtlZxhzD9V6rEN/0ixQxrUu0ZuX2RNLf7aGDMjaY4XAH+0pTu29dKUMlHtNng==',key_name='tempest-keypair-756136845',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bbe4e9fb786d4015b035b4d00f75a1ba',ramdisk_id='',reservation_id='r-ulxepirk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='708622a9-7465-4492-ade8-b827198f7e30',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1779812468',owner_user_name='tempest-TaggedBootDevicesTest-1779812468-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T16:21:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='14566b85d0424c08999726ff72a67634',uuid=2549ba85-4e0a-420e-b711-07cafa8c60e9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4c481745-6342-43f8-9040-3ea1d8c5c572", "address": "fa:16:3e:e7:ea:ff", "network": {"id": "5d158a82-de85-48b5-9f17-40e61e9b0df8", "bridge": "br-int", "label": "tempest-device-tagging-net1-574676351", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.164", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bbe4e9fb786d4015b035b4d00f75a1ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c481745-63", "ovs_interfaceid": "4c481745-6342-43f8-9040-3ea1d8c5c572", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71731) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 16:21:57 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Converting VIF {"id": "4c481745-6342-43f8-9040-3ea1d8c5c572", "address": "fa:16:3e:e7:ea:ff", "network": {"id": "5d158a82-de85-48b5-9f17-40e61e9b0df8", "bridge": "br-int", "label": "tempest-device-tagging-net1-574676351", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.164", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bbe4e9fb786d4015b035b4d00f75a1ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c481745-63", "ovs_interfaceid": "4c481745-6342-43f8-9040-3ea1d8c5c572", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 16:21:57 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:ea:ff,bridge_name='br-int',has_traffic_filtering=True,id=4c481745-6342-43f8-9040-3ea1d8c5c572,network=Network(5d158a82-de85-48b5-9f17-40e61e9b0df8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4c481745-63') {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 16:21:57 user nova-compute[71731]: DEBUG os_vif [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:ea:ff,bridge_name='br-int',has_traffic_filtering=True,id=4c481745-6342-43f8-9040-3ea1d8c5c572,network=Network(5d158a82-de85-48b5-9f17-40e61e9b0df8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4c481745-63') {{(pid=71731) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 16:21:57 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:21:57 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:21:57 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 16:21:57 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:21:57 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4c481745-63, may_exist=True) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:21:57 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4c481745-63, col_values=(('external_ids', {'iface-id': '4c481745-6342-43f8-9040-3ea1d8c5c572', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e7:ea:ff', 'vm-uuid': '2549ba85-4e0a-420e-b711-07cafa8c60e9'}),)) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:21:57 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:21:57 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 16:21:57 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:21:57 user nova-compute[71731]: INFO os_vif [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:ea:ff,bridge_name='br-int',has_traffic_filtering=True,id=4c481745-6342-43f8-9040-3ea1d8c5c572,network=Network(5d158a82-de85-48b5-9f17-40e61e9b0df8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4c481745-63')
Apr 13 16:21:57 user nova-compute[71731]: DEBUG nova.virt.libvirt.vif [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T16:21:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1688495933',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1688495933',id=9,image_ref='708622a9-7465-4492-ade8-b827198f7e30',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCmDAWwVmv7Q34Pz29t07av6aMRdzm3EgCQrfLBn83RkLO81Y7UjJ2zO/1nlrHzXzESZuCtlZxhzD9V6rEN/0ixQxrUu0ZuX2RNLf7aGDMjaY4XAH+0pTu29dKUMlHtNng==',key_name='tempest-keypair-756136845',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bbe4e9fb786d4015b035b4d00f75a1ba',ramdisk_id='',reservation_id='r-ulxepirk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='708622a9-7465-4492-ade8-b827198f7e30',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1779812468',owner_user_name='tempest-TaggedBootDevicesTest-1779812468-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T16:21:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='14566b85d0424c08999726ff72a67634',uuid=2549ba85-4e0a-420e-b711-07cafa8c60e9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0152bbb9-d50d-4e58-8a2b-727c4675ea2f", "address": "fa:16:3e:0d:4d:58", "network": {"id": "5d158a82-de85-48b5-9f17-40e61e9b0df8", "bridge": "br-int", "label": "tempest-device-tagging-net1-574676351", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.142", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bbe4e9fb786d4015b035b4d00f75a1ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0152bbb9-d5", "ovs_interfaceid": "0152bbb9-d50d-4e58-8a2b-727c4675ea2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 16:21:57 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Converting VIF {"id": "0152bbb9-d50d-4e58-8a2b-727c4675ea2f", "address": "fa:16:3e:0d:4d:58", "network": {"id": "5d158a82-de85-48b5-9f17-40e61e9b0df8", "bridge": "br-int", "label": "tempest-device-tagging-net1-574676351", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.142", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bbe4e9fb786d4015b035b4d00f75a1ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0152bbb9-d5", "ovs_interfaceid": "0152bbb9-d50d-4e58-8a2b-727c4675ea2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 16:21:57 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0d:4d:58,bridge_name='br-int',has_traffic_filtering=True,id=0152bbb9-d50d-4e58-8a2b-727c4675ea2f,network=Network(5d158a82-de85-48b5-9f17-40e61e9b0df8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0152bbb9-d5') {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 16:21:57 user nova-compute[71731]: DEBUG os_vif [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:4d:58,bridge_name='br-int',has_traffic_filtering=True,id=0152bbb9-d50d-4e58-8a2b-727c4675ea2f,network=Network(5d158a82-de85-48b5-9f17-40e61e9b0df8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0152bbb9-d5') {{(pid=71731) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 16:21:57 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:21:57 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:21:57 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 16:21:57 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:21:57 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0152bbb9-d5, may_exist=True) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:21:57 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0152bbb9-d5, col_values=(('external_ids', {'iface-id': '0152bbb9-d50d-4e58-8a2b-727c4675ea2f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0d:4d:58', 'vm-uuid': '2549ba85-4e0a-420e-b711-07cafa8c60e9'}),)) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:21:57 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:21:57 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 16:21:57 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:21:57 user nova-compute[71731]: INFO os_vif [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:4d:58,bridge_name='br-int',has_traffic_filtering=True,id=0152bbb9-d50d-4e58-8a2b-727c4675ea2f,network=Network(5d158a82-de85-48b5-9f17-40e61e9b0df8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0152bbb9-d5')
Apr 13 16:21:57 user nova-compute[71731]: DEBUG nova.virt.libvirt.vif [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T16:21:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1688495933',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1688495933',id=9,image_ref='708622a9-7465-4492-ade8-b827198f7e30',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCmDAWwVmv7Q34Pz29t07av6aMRdzm3EgCQrfLBn83RkLO81Y7UjJ2zO/1nlrHzXzESZuCtlZxhzD9V6rEN/0ixQxrUu0ZuX2RNLf7aGDMjaY4XAH+0pTu29dKUMlHtNng==',key_name='tempest-keypair-756136845',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bbe4e9fb786d4015b035b4d00f75a1ba',ramdisk_id='',reservation_id='r-ulxepirk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='708622a9-7465-4492-ade8-b827198f7e30',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1779812468',owner_user_name='tempest-TaggedBootDevicesTest-1779812468-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T16:21:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='14566b85d0424c08999726ff72a67634',uuid=2549ba85-4e0a-420e-b711-07cafa8c60e9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3730ed6e-b093-4232-800b-b064d650e9e8", "address": "fa:16:3e:a8:c4:f6", "network": {"id": "5d158a82-de85-48b5-9f17-40e61e9b0df8", "bridge": "br-int", "label": "tempest-device-tagging-net1-574676351", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.38", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bbe4e9fb786d4015b035b4d00f75a1ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3730ed6e-b0", "ovs_interfaceid": "3730ed6e-b093-4232-800b-b064d650e9e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 16:21:57 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Converting VIF {"id": "3730ed6e-b093-4232-800b-b064d650e9e8", "address": "fa:16:3e:a8:c4:f6", "network": {"id": "5d158a82-de85-48b5-9f17-40e61e9b0df8", "bridge": "br-int", "label": "tempest-device-tagging-net1-574676351", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.38", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bbe4e9fb786d4015b035b4d00f75a1ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3730ed6e-b0", "ovs_interfaceid": "3730ed6e-b093-4232-800b-b064d650e9e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 16:21:57 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a8:c4:f6,bridge_name='br-int',has_traffic_filtering=True,id=3730ed6e-b093-4232-800b-b064d650e9e8,network=Network(5d158a82-de85-48b5-9f17-40e61e9b0df8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3730ed6e-b0') {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 16:21:57 user nova-compute[71731]: DEBUG os_vif [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:c4:f6,bridge_name='br-int',has_traffic_filtering=True,id=3730ed6e-b093-4232-800b-b064d650e9e8,network=Network(5d158a82-de85-48b5-9f17-40e61e9b0df8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3730ed6e-b0') {{(pid=71731) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 16:21:57 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:21:57 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:21:57 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 16:21:57 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:21:57 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3730ed6e-b0, may_exist=True) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:21:57 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3730ed6e-b0, col_values=(('external_ids', {'iface-id': '3730ed6e-b093-4232-800b-b064d650e9e8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a8:c4:f6', 'vm-uuid': '2549ba85-4e0a-420e-b711-07cafa8c60e9'}),)) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:21:57 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:21:57 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 16:21:57 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:21:57 user nova-compute[71731]: INFO os_vif [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:c4:f6,bridge_name='br-int',has_traffic_filtering=True,id=3730ed6e-b093-4232-800b-b064d650e9e8,network=Network(5d158a82-de85-48b5-9f17-40e61e9b0df8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3730ed6e-b0')
Apr 13 16:21:57 user nova-compute[71731]: DEBUG nova.virt.libvirt.vif [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T16:21:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1688495933',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1688495933',id=9,image_ref='708622a9-7465-4492-ade8-b827198f7e30',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCmDAWwVmv7Q34Pz29t07av6aMRdzm3EgCQrfLBn83RkLO81Y7UjJ2zO/1nlrHzXzESZuCtlZxhzD9V6rEN/0ixQxrUu0ZuX2RNLf7aGDMjaY4XAH+0pTu29dKUMlHtNng==',key_name='tempest-keypair-756136845',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bbe4e9fb786d4015b035b4d00f75a1ba',ramdisk_id='',reservation_id='r-ulxepirk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='708622a9-7465-4492-ade8-b827198f7e30',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1779812468',owner_user_name='tempest-TaggedBootDevicesTest-1779812468-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T16:21:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='14566b85d0424c08999726ff72a67634',uuid=2549ba85-4e0a-420e-b711-07cafa8c60e9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0fbdf291-df5d-41c5-a765-7145a87da272", "address": "fa:16:3e:dc:57:7b", "network": {"id": "4224b04f-23ed-464e-9b2c-df8c843f9287", "bridge": "br-int", "label": "tempest-device-tagging-net2-109401200", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "bbe4e9fb786d4015b035b4d00f75a1ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fbdf291-df", "ovs_interfaceid": "0fbdf291-df5d-41c5-a765-7145a87da272", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 16:21:57 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Converting VIF {"id": "0fbdf291-df5d-41c5-a765-7145a87da272", "address": "fa:16:3e:dc:57:7b", "network": {"id": "4224b04f-23ed-464e-9b2c-df8c843f9287", "bridge": "br-int", "label": "tempest-device-tagging-net2-109401200", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "bbe4e9fb786d4015b035b4d00f75a1ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fbdf291-df", "ovs_interfaceid": "0fbdf291-df5d-41c5-a765-7145a87da272", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 16:21:57 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dc:57:7b,bridge_name='br-int',has_traffic_filtering=True,id=0fbdf291-df5d-41c5-a765-7145a87da272,network=Network(4224b04f-23ed-464e-9b2c-df8c843f9287),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0fbdf291-df') {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 16:21:57 user nova-compute[71731]: DEBUG os_vif [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dc:57:7b,bridge_name='br-int',has_traffic_filtering=True,id=0fbdf291-df5d-41c5-a765-7145a87da272,network=Network(4224b04f-23ed-464e-9b2c-df8c843f9287),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0fbdf291-df') {{(pid=71731) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 16:21:57 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:21:57 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:21:57 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 16:21:57 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:21:57 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0fbdf291-df, may_exist=True) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:21:57 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0fbdf291-df, col_values=(('external_ids', {'iface-id': '0fbdf291-df5d-41c5-a765-7145a87da272', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:dc:57:7b', 'vm-uuid': '2549ba85-4e0a-420e-b711-07cafa8c60e9'}),)) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:21:57 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:21:57 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 16:21:57 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:21:57 user nova-compute[71731]: INFO os_vif [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dc:57:7b,bridge_name='br-int',has_traffic_filtering=True,id=0fbdf291-df5d-41c5-a765-7145a87da272,network=Network(4224b04f-23ed-464e-9b2c-df8c843f9287),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0fbdf291-df')
Apr 13 16:21:57 user nova-compute[71731]: DEBUG nova.virt.libvirt.vif [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T16:21:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1688495933',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1688495933',id=9,image_ref='708622a9-7465-4492-ade8-b827198f7e30',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCmDAWwVmv7Q34Pz29t07av6aMRdzm3EgCQrfLBn83RkLO81Y7UjJ2zO/1nlrHzXzESZuCtlZxhzD9V6rEN/0ixQxrUu0ZuX2RNLf7aGDMjaY4XAH+0pTu29dKUMlHtNng==',key_name='tempest-keypair-756136845',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bbe4e9fb786d4015b035b4d00f75a1ba',ramdisk_id='',reservation_id='r-ulxepirk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='708622a9-7465-4492-ade8-b827198f7e30',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1779812468',owner_user_name='tempest-TaggedBootDevicesTest-1779812468-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T16:21:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='14566b85d0424c08999726ff72a67634',uuid=2549ba85-4e0a-420e-b711-07cafa8c60e9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "38e92b7c-b7c1-4137-a1db-21bc1d24f3ee", "address": "fa:16:3e:a3:dd:27", "network": {"id": "4224b04f-23ed-464e-9b2c-df8c843f9287", "bridge": "br-int", "label": "tempest-device-tagging-net2-109401200", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "bbe4e9fb786d4015b035b4d00f75a1ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38e92b7c-b7", "ovs_interfaceid": "38e92b7c-b7c1-4137-a1db-21bc1d24f3ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 16:21:57 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Converting VIF {"id": "38e92b7c-b7c1-4137-a1db-21bc1d24f3ee", "address": "fa:16:3e:a3:dd:27", "network": {"id": "4224b04f-23ed-464e-9b2c-df8c843f9287", "bridge": "br-int", "label": "tempest-device-tagging-net2-109401200", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "bbe4e9fb786d4015b035b4d00f75a1ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38e92b7c-b7", "ovs_interfaceid": "38e92b7c-b7c1-4137-a1db-21bc1d24f3ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 16:21:57 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a3:dd:27,bridge_name='br-int',has_traffic_filtering=True,id=38e92b7c-b7c1-4137-a1db-21bc1d24f3ee,network=Network(4224b04f-23ed-464e-9b2c-df8c843f9287),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38e92b7c-b7') {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 16:21:57 user nova-compute[71731]: DEBUG os_vif [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a3:dd:27,bridge_name='br-int',has_traffic_filtering=True,id=38e92b7c-b7c1-4137-a1db-21bc1d24f3ee,network=Network(4224b04f-23ed-464e-9b2c-df8c843f9287),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38e92b7c-b7') {{(pid=71731) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 16:21:57 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:21:57 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:21:57 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 16:21:57 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:21:57 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap38e92b7c-b7, may_exist=True) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:21:57 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap38e92b7c-b7, col_values=(('external_ids', {'iface-id': '38e92b7c-b7c1-4137-a1db-21bc1d24f3ee', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a3:dd:27', 'vm-uuid': '2549ba85-4e0a-420e-b711-07cafa8c60e9'}),)) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:21:57 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:21:57 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 16:21:58 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:21:58 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:21:58 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:21:58 user nova-compute[71731]: INFO os_vif [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a3:dd:27,bridge_name='br-int',has_traffic_filtering=True,id=38e92b7c-b7c1-4137-a1db-21bc1d24f3ee,network=Network(4224b04f-23ed-464e-9b2c-df8c843f9287),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38e92b7c-b7')
Apr 13 16:21:58 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] No BDM found with device name hda, not building metadata. {{(pid=71731) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 16:21:58 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] No BDM found with device name vdc, not building metadata. {{(pid=71731) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 16:21:58 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] No VIF found with MAC fa:16:3e:1c:8b:59, not building metadata {{(pid=71731) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 16:21:58 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] No VIF found with MAC fa:16:3e:a8:c4:f6, not building metadata {{(pid=71731) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 16:21:58 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] [instance: 2549ba85-4e0a-420e-b711-07cafa8c60e9] Using config drive
Apr 13 16:21:58 user nova-compute[71731]: DEBUG nova.compute.manager [req-910b0cbb-494a-413a-91fd-99286aaa3bf4 req-fc0ed231-81b8-4cac-983b-cc1a4cf23fa9 service nova] [instance: e4ada2d7-7ace-4ed4-86a6-ed121c95e80f] Received event network-vif-plugged-a409f60c-6c6a-49f8-8520-04614e804002 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:21:58 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-910b0cbb-494a-413a-91fd-99286aaa3bf4 req-fc0ed231-81b8-4cac-983b-cc1a4cf23fa9 service nova] Acquiring lock "e4ada2d7-7ace-4ed4-86a6-ed121c95e80f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:21:58 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-910b0cbb-494a-413a-91fd-99286aaa3bf4 req-fc0ed231-81b8-4cac-983b-cc1a4cf23fa9 service nova] Lock "e4ada2d7-7ace-4ed4-86a6-ed121c95e80f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:21:58 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-910b0cbb-494a-413a-91fd-99286aaa3bf4 req-fc0ed231-81b8-4cac-983b-cc1a4cf23fa9 service nova] Lock "e4ada2d7-7ace-4ed4-86a6-ed121c95e80f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:21:58 user nova-compute[71731]: DEBUG nova.compute.manager [req-910b0cbb-494a-413a-91fd-99286aaa3bf4 req-fc0ed231-81b8-4cac-983b-cc1a4cf23fa9 service nova] [instance: e4ada2d7-7ace-4ed4-86a6-ed121c95e80f] No waiting events found dispatching network-vif-plugged-a409f60c-6c6a-49f8-8520-04614e804002 {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:21:58 user nova-compute[71731]: WARNING nova.compute.manager [req-910b0cbb-494a-413a-91fd-99286aaa3bf4 req-fc0ed231-81b8-4cac-983b-cc1a4cf23fa9 service nova] [instance: e4ada2d7-7ace-4ed4-86a6-ed121c95e80f] Received unexpected event network-vif-plugged-a409f60c-6c6a-49f8-8520-04614e804002 for instance with vm_state building and task_state spawning.
Apr 13 16:21:58 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:21:58 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] [instance: 2549ba85-4e0a-420e-b711-07cafa8c60e9] Creating config drive at /opt/stack/data/nova/instances/2549ba85-4e0a-420e-b711-07cafa8c60e9/disk.config
Apr 13 16:21:58 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/2549ba85-4e0a-420e-b711-07cafa8c60e9/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp5ky962nh {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:21:58 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/2549ba85-4e0a-420e-b711-07cafa8c60e9/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp5ky962nh" returned: 0 in 0.073s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:21:58 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:21:58 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:21:58 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:21:58 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:21:58 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:21:58 user nova-compute[71731]: DEBUG nova.compute.manager [req-9ecdd70c-a2a2-456c-befe-e65e2e13f4a0 req-117f0312-27c5-4a06-9b85-1acedfaf8c39 service nova] [instance: e4ada2d7-7ace-4ed4-86a6-ed121c95e80f] Received event network-vif-plugged-ac94464f-32dc-4cd1-a270-ec8934e77c21 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:21:58 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-9ecdd70c-a2a2-456c-befe-e65e2e13f4a0 req-117f0312-27c5-4a06-9b85-1acedfaf8c39 service nova] Acquiring lock "e4ada2d7-7ace-4ed4-86a6-ed121c95e80f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:21:58 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-9ecdd70c-a2a2-456c-befe-e65e2e13f4a0 req-117f0312-27c5-4a06-9b85-1acedfaf8c39 service nova] Lock "e4ada2d7-7ace-4ed4-86a6-ed121c95e80f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:21:58 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-9ecdd70c-a2a2-456c-befe-e65e2e13f4a0 req-117f0312-27c5-4a06-9b85-1acedfaf8c39 service nova] Lock "e4ada2d7-7ace-4ed4-86a6-ed121c95e80f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:21:58 user nova-compute[71731]: DEBUG nova.compute.manager [req-9ecdd70c-a2a2-456c-befe-e65e2e13f4a0 req-117f0312-27c5-4a06-9b85-1acedfaf8c39 service nova] [instance: e4ada2d7-7ace-4ed4-86a6-ed121c95e80f] No waiting events found dispatching network-vif-plugged-ac94464f-32dc-4cd1-a270-ec8934e77c21 {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:21:58 user nova-compute[71731]: WARNING nova.compute.manager [req-9ecdd70c-a2a2-456c-befe-e65e2e13f4a0 req-117f0312-27c5-4a06-9b85-1acedfaf8c39 service nova] [instance: e4ada2d7-7ace-4ed4-86a6-ed121c95e80f] Received unexpected event network-vif-plugged-ac94464f-32dc-4cd1-a270-ec8934e77c21 for instance with vm_state building and task_state spawning.
Apr 13 16:21:59 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:21:59 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:21:59 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:21:59 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:21:59 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:21:59 user nova-compute[71731]: DEBUG nova.compute.manager [req-269b56a5-05fa-4f13-8eb4-a6c442695de4 req-029ce4dd-9515-4634-8c10-4ab8a19887d4 service nova] [instance: e4ada2d7-7ace-4ed4-86a6-ed121c95e80f] Received event network-vif-plugged-8f3a3011-e474-4538-812b-9df3968fd629 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:21:59 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-269b56a5-05fa-4f13-8eb4-a6c442695de4 req-029ce4dd-9515-4634-8c10-4ab8a19887d4 service nova] Acquiring lock "e4ada2d7-7ace-4ed4-86a6-ed121c95e80f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:21:59 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-269b56a5-05fa-4f13-8eb4-a6c442695de4 req-029ce4dd-9515-4634-8c10-4ab8a19887d4 service nova] Lock "e4ada2d7-7ace-4ed4-86a6-ed121c95e80f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:21:59 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-269b56a5-05fa-4f13-8eb4-a6c442695de4 req-029ce4dd-9515-4634-8c10-4ab8a19887d4 service nova] Lock "e4ada2d7-7ace-4ed4-86a6-ed121c95e80f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:21:59 user nova-compute[71731]: DEBUG nova.compute.manager [req-269b56a5-05fa-4f13-8eb4-a6c442695de4 req-029ce4dd-9515-4634-8c10-4ab8a19887d4 service nova] [instance: e4ada2d7-7ace-4ed4-86a6-ed121c95e80f] No waiting events found dispatching network-vif-plugged-8f3a3011-e474-4538-812b-9df3968fd629 {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:21:59 user nova-compute[71731]: WARNING nova.compute.manager [req-269b56a5-05fa-4f13-8eb4-a6c442695de4 req-029ce4dd-9515-4634-8c10-4ab8a19887d4 service nova] [instance: e4ada2d7-7ace-4ed4-86a6-ed121c95e80f] Received unexpected event network-vif-plugged-8f3a3011-e474-4538-812b-9df3968fd629 for instance with vm_state building and task_state spawning.
Apr 13 16:21:59 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:21:59 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:21:59 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:21:59 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:21:59 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:21:59 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:22:00 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:22:00 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:22:00 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:22:00 user nova-compute[71731]: DEBUG nova.compute.manager [req-ecd99fb2-9e92-454f-93a1-c133f3c5cbbf req-570b6027-b30d-42ea-bf22-3912a187d78d service nova] [instance: e4ada2d7-7ace-4ed4-86a6-ed121c95e80f] Received event network-vif-plugged-a409f60c-6c6a-49f8-8520-04614e804002 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:22:00 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-ecd99fb2-9e92-454f-93a1-c133f3c5cbbf req-570b6027-b30d-42ea-bf22-3912a187d78d service nova] Acquiring lock "e4ada2d7-7ace-4ed4-86a6-ed121c95e80f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:22:00 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-ecd99fb2-9e92-454f-93a1-c133f3c5cbbf req-570b6027-b30d-42ea-bf22-3912a187d78d service nova] Lock "e4ada2d7-7ace-4ed4-86a6-ed121c95e80f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:22:00 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-ecd99fb2-9e92-454f-93a1-c133f3c5cbbf req-570b6027-b30d-42ea-bf22-3912a187d78d service nova] Lock "e4ada2d7-7ace-4ed4-86a6-ed121c95e80f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:22:00 user nova-compute[71731]: DEBUG nova.compute.manager [req-ecd99fb2-9e92-454f-93a1-c133f3c5cbbf req-570b6027-b30d-42ea-bf22-3912a187d78d service nova] [instance: e4ada2d7-7ace-4ed4-86a6-ed121c95e80f] No waiting events found dispatching network-vif-plugged-a409f60c-6c6a-49f8-8520-04614e804002 {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:22:00 user nova-compute[71731]: WARNING nova.compute.manager [req-ecd99fb2-9e92-454f-93a1-c133f3c5cbbf req-570b6027-b30d-42ea-bf22-3912a187d78d service nova] [instance: e4ada2d7-7ace-4ed4-86a6-ed121c95e80f] Received unexpected event network-vif-plugged-a409f60c-6c6a-49f8-8520-04614e804002 for instance with vm_state building and task_state spawning.
Apr 13 16:22:00 user nova-compute[71731]: DEBUG nova.compute.manager [req-ecd99fb2-9e92-454f-93a1-c133f3c5cbbf req-570b6027-b30d-42ea-bf22-3912a187d78d service nova] [instance: e4ada2d7-7ace-4ed4-86a6-ed121c95e80f] Received event network-vif-plugged-0125a8df-e91c-4d65-be74-fda2f2d93938 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:22:00 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-ecd99fb2-9e92-454f-93a1-c133f3c5cbbf req-570b6027-b30d-42ea-bf22-3912a187d78d service nova] Acquiring lock "e4ada2d7-7ace-4ed4-86a6-ed121c95e80f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:22:00 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-ecd99fb2-9e92-454f-93a1-c133f3c5cbbf req-570b6027-b30d-42ea-bf22-3912a187d78d service nova] Lock "e4ada2d7-7ace-4ed4-86a6-ed121c95e80f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:22:00 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-ecd99fb2-9e92-454f-93a1-c133f3c5cbbf req-570b6027-b30d-42ea-bf22-3912a187d78d service nova] Lock "e4ada2d7-7ace-4ed4-86a6-ed121c95e80f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:22:00 user nova-compute[71731]: DEBUG nova.compute.manager [req-ecd99fb2-9e92-454f-93a1-c133f3c5cbbf req-570b6027-b30d-42ea-bf22-3912a187d78d service nova] [instance: e4ada2d7-7ace-4ed4-86a6-ed121c95e80f] No waiting events found dispatching network-vif-plugged-0125a8df-e91c-4d65-be74-fda2f2d93938 {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:22:00 user nova-compute[71731]: WARNING nova.compute.manager [req-ecd99fb2-9e92-454f-93a1-c133f3c5cbbf req-570b6027-b30d-42ea-bf22-3912a187d78d service nova] [instance: e4ada2d7-7ace-4ed4-86a6-ed121c95e80f] Received unexpected event network-vif-plugged-0125a8df-e91c-4d65-be74-fda2f2d93938 for instance with vm_state building and task_state spawning.
Apr 13 16:22:00 user nova-compute[71731]: DEBUG nova.compute.manager [req-ecd99fb2-9e92-454f-93a1-c133f3c5cbbf req-570b6027-b30d-42ea-bf22-3912a187d78d service nova] [instance: e4ada2d7-7ace-4ed4-86a6-ed121c95e80f] Received event network-vif-plugged-0125a8df-e91c-4d65-be74-fda2f2d93938 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:22:00 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-ecd99fb2-9e92-454f-93a1-c133f3c5cbbf req-570b6027-b30d-42ea-bf22-3912a187d78d service nova] Acquiring lock "e4ada2d7-7ace-4ed4-86a6-ed121c95e80f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:22:00 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-ecd99fb2-9e92-454f-93a1-c133f3c5cbbf req-570b6027-b30d-42ea-bf22-3912a187d78d service nova] Lock "e4ada2d7-7ace-4ed4-86a6-ed121c95e80f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:22:00 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-ecd99fb2-9e92-454f-93a1-c133f3c5cbbf req-570b6027-b30d-42ea-bf22-3912a187d78d service nova] Lock "e4ada2d7-7ace-4ed4-86a6-ed121c95e80f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:22:00 user nova-compute[71731]: DEBUG nova.compute.manager [req-ecd99fb2-9e92-454f-93a1-c133f3c5cbbf req-570b6027-b30d-42ea-bf22-3912a187d78d service nova] [instance: e4ada2d7-7ace-4ed4-86a6-ed121c95e80f] No waiting events found dispatching network-vif-plugged-0125a8df-e91c-4d65-be74-fda2f2d93938 {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:22:00 user nova-compute[71731]: WARNING nova.compute.manager [req-ecd99fb2-9e92-454f-93a1-c133f3c5cbbf req-570b6027-b30d-42ea-bf22-3912a187d78d service nova] [instance: e4ada2d7-7ace-4ed4-86a6-ed121c95e80f] Received unexpected event network-vif-plugged-0125a8df-e91c-4d65-be74-fda2f2d93938 for instance with vm_state building and task_state spawning.
Apr 13 16:22:00 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:22:00 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:22:00 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:22:00 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:22:00 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:22:01 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:22:01 user nova-compute[71731]: DEBUG nova.compute.manager [req-f6880c77-0200-4033-a4c4-f0eb34235cd1 req-dbbe0b91-fc5e-4f34-83ab-dcb7a9a6e4b3 service nova] [instance: e4ada2d7-7ace-4ed4-86a6-ed121c95e80f] Received event network-vif-plugged-ac94464f-32dc-4cd1-a270-ec8934e77c21 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:22:01 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-f6880c77-0200-4033-a4c4-f0eb34235cd1 req-dbbe0b91-fc5e-4f34-83ab-dcb7a9a6e4b3 service nova] Acquiring lock "e4ada2d7-7ace-4ed4-86a6-ed121c95e80f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:22:01 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-f6880c77-0200-4033-a4c4-f0eb34235cd1 req-dbbe0b91-fc5e-4f34-83ab-dcb7a9a6e4b3 service nova] Lock "e4ada2d7-7ace-4ed4-86a6-ed121c95e80f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:22:01 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-f6880c77-0200-4033-a4c4-f0eb34235cd1 req-dbbe0b91-fc5e-4f34-83ab-dcb7a9a6e4b3 service nova] Lock "e4ada2d7-7ace-4ed4-86a6-ed121c95e80f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:22:01 user nova-compute[71731]: DEBUG nova.compute.manager [req-f6880c77-0200-4033-a4c4-f0eb34235cd1 req-dbbe0b91-fc5e-4f34-83ab-dcb7a9a6e4b3 service nova] [instance: e4ada2d7-7ace-4ed4-86a6-ed121c95e80f] No waiting events found dispatching network-vif-plugged-ac94464f-32dc-4cd1-a270-ec8934e77c21 {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:22:01 user nova-compute[71731]: WARNING nova.compute.manager [req-f6880c77-0200-4033-a4c4-f0eb34235cd1 req-dbbe0b91-fc5e-4f34-83ab-dcb7a9a6e4b3 service nova] [instance: e4ada2d7-7ace-4ed4-86a6-ed121c95e80f] Received unexpected event network-vif-plugged-ac94464f-32dc-4cd1-a270-ec8934e77c21 for instance with vm_state building and task_state spawning.
Apr 13 16:22:01 user nova-compute[71731]: DEBUG nova.compute.manager [req-f6880c77-0200-4033-a4c4-f0eb34235cd1 req-dbbe0b91-fc5e-4f34-83ab-dcb7a9a6e4b3 service nova] [instance: e4ada2d7-7ace-4ed4-86a6-ed121c95e80f] Received event network-vif-plugged-2430beb8-b2e4-4493-bdc5-df6b4c1181c6 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:22:01 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-f6880c77-0200-4033-a4c4-f0eb34235cd1 req-dbbe0b91-fc5e-4f34-83ab-dcb7a9a6e4b3 service nova] Acquiring lock "e4ada2d7-7ace-4ed4-86a6-ed121c95e80f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:22:01 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-f6880c77-0200-4033-a4c4-f0eb34235cd1 req-dbbe0b91-fc5e-4f34-83ab-dcb7a9a6e4b3 service nova] Lock "e4ada2d7-7ace-4ed4-86a6-ed121c95e80f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:22:01 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-f6880c77-0200-4033-a4c4-f0eb34235cd1 req-dbbe0b91-fc5e-4f34-83ab-dcb7a9a6e4b3 service nova] Lock "e4ada2d7-7ace-4ed4-86a6-ed121c95e80f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:22:01 user nova-compute[71731]: DEBUG nova.compute.manager [req-f6880c77-0200-4033-a4c4-f0eb34235cd1 req-dbbe0b91-fc5e-4f34-83ab-dcb7a9a6e4b3 service nova] [instance: e4ada2d7-7ace-4ed4-86a6-ed121c95e80f] No waiting events found dispatching network-vif-plugged-2430beb8-b2e4-4493-bdc5-df6b4c1181c6 {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:22:01 user nova-compute[71731]: WARNING nova.compute.manager [req-f6880c77-0200-4033-a4c4-f0eb34235cd1 req-dbbe0b91-fc5e-4f34-83ab-dcb7a9a6e4b3 service nova] [instance: e4ada2d7-7ace-4ed4-86a6-ed121c95e80f] Received unexpected event network-vif-plugged-2430beb8-b2e4-4493-bdc5-df6b4c1181c6 for instance with vm_state building and task_state spawning.
Apr 13 16:22:01 user nova-compute[71731]: DEBUG nova.compute.manager [req-f6880c77-0200-4033-a4c4-f0eb34235cd1 req-dbbe0b91-fc5e-4f34-83ab-dcb7a9a6e4b3 service nova] [instance: e4ada2d7-7ace-4ed4-86a6-ed121c95e80f] Received event network-vif-plugged-2430beb8-b2e4-4493-bdc5-df6b4c1181c6 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:22:01 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-f6880c77-0200-4033-a4c4-f0eb34235cd1 req-dbbe0b91-fc5e-4f34-83ab-dcb7a9a6e4b3 service nova] Acquiring lock "e4ada2d7-7ace-4ed4-86a6-ed121c95e80f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:22:01 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-f6880c77-0200-4033-a4c4-f0eb34235cd1 req-dbbe0b91-fc5e-4f34-83ab-dcb7a9a6e4b3 service nova] Lock "e4ada2d7-7ace-4ed4-86a6-ed121c95e80f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:22:01 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-f6880c77-0200-4033-a4c4-f0eb34235cd1 req-dbbe0b91-fc5e-4f34-83ab-dcb7a9a6e4b3 service nova] Lock "e4ada2d7-7ace-4ed4-86a6-ed121c95e80f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:22:01 user nova-compute[71731]: DEBUG nova.compute.manager [req-f6880c77-0200-4033-a4c4-f0eb34235cd1 req-dbbe0b91-fc5e-4f34-83ab-dcb7a9a6e4b3 service nova] [instance: e4ada2d7-7ace-4ed4-86a6-ed121c95e80f] No waiting events found dispatching network-vif-plugged-2430beb8-b2e4-4493-bdc5-df6b4c1181c6 {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:22:01 user nova-compute[71731]: WARNING nova.compute.manager [req-f6880c77-0200-4033-a4c4-f0eb34235cd1 req-dbbe0b91-fc5e-4f34-83ab-dcb7a9a6e4b3 service nova] [instance: e4ada2d7-7ace-4ed4-86a6-ed121c95e80f] Received unexpected event network-vif-plugged-2430beb8-b2e4-4493-bdc5-df6b4c1181c6 for instance with vm_state building and task_state spawning.
Apr 13 16:22:01 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:22:01 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:22:01 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:22:01 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:22:01 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:22:01 user nova-compute[71731]: DEBUG nova.compute.manager [req-c7ee1de2-e71a-42a9-a19b-5ad0cd2dbc1d req-b5ad3e10-83af-489d-8704-7df58abeeb23 service nova] [instance: e4ada2d7-7ace-4ed4-86a6-ed121c95e80f] Received event network-vif-plugged-8f3a3011-e474-4538-812b-9df3968fd629 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:22:01 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-c7ee1de2-e71a-42a9-a19b-5ad0cd2dbc1d req-b5ad3e10-83af-489d-8704-7df58abeeb23 service nova] Acquiring lock "e4ada2d7-7ace-4ed4-86a6-ed121c95e80f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:22:01 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-c7ee1de2-e71a-42a9-a19b-5ad0cd2dbc1d req-b5ad3e10-83af-489d-8704-7df58abeeb23 service nova] Lock "e4ada2d7-7ace-4ed4-86a6-ed121c95e80f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:22:01 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-c7ee1de2-e71a-42a9-a19b-5ad0cd2dbc1d req-b5ad3e10-83af-489d-8704-7df58abeeb23 service nova] Lock "e4ada2d7-7ace-4ed4-86a6-ed121c95e80f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:22:01 user nova-compute[71731]: DEBUG nova.compute.manager [req-c7ee1de2-e71a-42a9-a19b-5ad0cd2dbc1d req-b5ad3e10-83af-489d-8704-7df58abeeb23 service nova] [instance: e4ada2d7-7ace-4ed4-86a6-ed121c95e80f] No waiting events found dispatching network-vif-plugged-8f3a3011-e474-4538-812b-9df3968fd629 {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:22:01 user nova-compute[71731]: WARNING nova.compute.manager [req-c7ee1de2-e71a-42a9-a19b-5ad0cd2dbc1d req-b5ad3e10-83af-489d-8704-7df58abeeb23 service nova] [instance: e4ada2d7-7ace-4ed4-86a6-ed121c95e80f] Received unexpected event network-vif-plugged-8f3a3011-e474-4538-812b-9df3968fd629 for instance with vm_state building and task_state spawning.
Apr 13 16:22:01 user nova-compute[71731]: DEBUG nova.compute.manager [req-c7ee1de2-e71a-42a9-a19b-5ad0cd2dbc1d req-b5ad3e10-83af-489d-8704-7df58abeeb23 service nova] [instance: e4ada2d7-7ace-4ed4-86a6-ed121c95e80f] Received event network-vif-plugged-15dca2c3-5048-4e80-8008-c19400ea34e4 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:22:01 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-c7ee1de2-e71a-42a9-a19b-5ad0cd2dbc1d req-b5ad3e10-83af-489d-8704-7df58abeeb23 service nova] Acquiring lock "e4ada2d7-7ace-4ed4-86a6-ed121c95e80f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:22:01 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-c7ee1de2-e71a-42a9-a19b-5ad0cd2dbc1d req-b5ad3e10-83af-489d-8704-7df58abeeb23 service nova] Lock "e4ada2d7-7ace-4ed4-86a6-ed121c95e80f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:22:01 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-c7ee1de2-e71a-42a9-a19b-5ad0cd2dbc1d req-b5ad3e10-83af-489d-8704-7df58abeeb23 service nova] Lock "e4ada2d7-7ace-4ed4-86a6-ed121c95e80f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:22:01 user nova-compute[71731]: DEBUG nova.compute.manager [req-c7ee1de2-e71a-42a9-a19b-5ad0cd2dbc1d req-b5ad3e10-83af-489d-8704-7df58abeeb23 service nova] [instance: e4ada2d7-7ace-4ed4-86a6-ed121c95e80f] No waiting events found dispatching network-vif-plugged-15dca2c3-5048-4e80-8008-c19400ea34e4 {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:22:01 user nova-compute[71731]: WARNING nova.compute.manager [req-c7ee1de2-e71a-42a9-a19b-5ad0cd2dbc1d req-b5ad3e10-83af-489d-8704-7df58abeeb23 service nova] [instance: e4ada2d7-7ace-4ed4-86a6-ed121c95e80f] Received unexpected event network-vif-plugged-15dca2c3-5048-4e80-8008-c19400ea34e4 for instance with vm_state building and task_state spawning.
Apr 13 16:22:01 user nova-compute[71731]: DEBUG nova.compute.manager [req-c7ee1de2-e71a-42a9-a19b-5ad0cd2dbc1d req-b5ad3e10-83af-489d-8704-7df58abeeb23 service nova] [instance: e4ada2d7-7ace-4ed4-86a6-ed121c95e80f] Received event network-vif-plugged-15dca2c3-5048-4e80-8008-c19400ea34e4 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:22:01 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-c7ee1de2-e71a-42a9-a19b-5ad0cd2dbc1d req-b5ad3e10-83af-489d-8704-7df58abeeb23 service nova] Acquiring lock "e4ada2d7-7ace-4ed4-86a6-ed121c95e80f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:22:01 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-c7ee1de2-e71a-42a9-a19b-5ad0cd2dbc1d req-b5ad3e10-83af-489d-8704-7df58abeeb23 service nova] Lock "e4ada2d7-7ace-4ed4-86a6-ed121c95e80f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:22:01 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-c7ee1de2-e71a-42a9-a19b-5ad0cd2dbc1d req-b5ad3e10-83af-489d-8704-7df58abeeb23 service nova] Lock "e4ada2d7-7ace-4ed4-86a6-ed121c95e80f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:22:01 user nova-compute[71731]: DEBUG nova.compute.manager [req-c7ee1de2-e71a-42a9-a19b-5ad0cd2dbc1d req-b5ad3e10-83af-489d-8704-7df58abeeb23 service nova] [instance: e4ada2d7-7ace-4ed4-86a6-ed121c95e80f] No waiting events found dispatching network-vif-plugged-15dca2c3-5048-4e80-8008-c19400ea34e4 {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:22:01 user nova-compute[71731]: WARNING nova.compute.manager [req-c7ee1de2-e71a-42a9-a19b-5ad0cd2dbc1d req-b5ad3e10-83af-489d-8704-7df58abeeb23 service nova] [instance: e4ada2d7-7ace-4ed4-86a6-ed121c95e80f] Received unexpected event network-vif-plugged-15dca2c3-5048-4e80-8008-c19400ea34e4 for instance with vm_state building and task_state spawning.
Apr 13 16:22:01 user nova-compute[71731]: DEBUG nova.compute.manager [req-c7ee1de2-e71a-42a9-a19b-5ad0cd2dbc1d req-b5ad3e10-83af-489d-8704-7df58abeeb23 service nova] [instance: 2549ba85-4e0a-420e-b711-07cafa8c60e9] Received event network-vif-plugged-36152688-366c-40a2-8bf9-88f69925594a {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:22:01 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-c7ee1de2-e71a-42a9-a19b-5ad0cd2dbc1d req-b5ad3e10-83af-489d-8704-7df58abeeb23 service nova] Acquiring lock "2549ba85-4e0a-420e-b711-07cafa8c60e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:22:01 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-c7ee1de2-e71a-42a9-a19b-5ad0cd2dbc1d req-b5ad3e10-83af-489d-8704-7df58abeeb23 service nova] Lock "2549ba85-4e0a-420e-b711-07cafa8c60e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:22:01 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-c7ee1de2-e71a-42a9-a19b-5ad0cd2dbc1d req-b5ad3e10-83af-489d-8704-7df58abeeb23 service nova] Lock "2549ba85-4e0a-420e-b711-07cafa8c60e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:22:01 user nova-compute[71731]: DEBUG nova.compute.manager [req-c7ee1de2-e71a-42a9-a19b-5ad0cd2dbc1d req-b5ad3e10-83af-489d-8704-7df58abeeb23 service nova] [instance: 2549ba85-4e0a-420e-b711-07cafa8c60e9] No waiting events found dispatching network-vif-plugged-36152688-366c-40a2-8bf9-88f69925594a {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:22:01 user nova-compute[71731]: WARNING nova.compute.manager [req-c7ee1de2-e71a-42a9-a19b-5ad0cd2dbc1d req-b5ad3e10-83af-489d-8704-7df58abeeb23 service nova] [instance: 2549ba85-4e0a-420e-b711-07cafa8c60e9] Received unexpected event network-vif-plugged-36152688-366c-40a2-8bf9-88f69925594a for instance with vm_state building and task_state spawning.
Apr 13 16:22:01 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:22:01 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:22:01 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:22:02 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:22:02 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:22:02 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:22:02 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:22:02 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:22:02 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:22:02 user nova-compute[71731]: DEBUG nova.compute.manager [req-d218762f-690a-4580-b22e-3b0509d0eb43 req-3b3e4e3d-be75-478c-889b-114d77af6f8f service nova] [instance: 2549ba85-4e0a-420e-b711-07cafa8c60e9] Received event network-vif-plugged-d7155dcf-9e83-4579-b81a-7277d4a9eeaf {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:22:02 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-d218762f-690a-4580-b22e-3b0509d0eb43 req-3b3e4e3d-be75-478c-889b-114d77af6f8f service nova] Acquiring lock "2549ba85-4e0a-420e-b711-07cafa8c60e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:22:02 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-d218762f-690a-4580-b22e-3b0509d0eb43 req-3b3e4e3d-be75-478c-889b-114d77af6f8f service nova] Lock "2549ba85-4e0a-420e-b711-07cafa8c60e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:22:02 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-d218762f-690a-4580-b22e-3b0509d0eb43 req-3b3e4e3d-be75-478c-889b-114d77af6f8f service nova] Lock "2549ba85-4e0a-420e-b711-07cafa8c60e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:22:02 user nova-compute[71731]: DEBUG nova.compute.manager [req-d218762f-690a-4580-b22e-3b0509d0eb43 req-3b3e4e3d-be75-478c-889b-114d77af6f8f service nova] [instance: 2549ba85-4e0a-420e-b711-07cafa8c60e9] No waiting events found dispatching network-vif-plugged-d7155dcf-9e83-4579-b81a-7277d4a9eeaf {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:22:02 user nova-compute[71731]: WARNING nova.compute.manager [req-d218762f-690a-4580-b22e-3b0509d0eb43 req-3b3e4e3d-be75-478c-889b-114d77af6f8f service nova] [instance: 2549ba85-4e0a-420e-b711-07cafa8c60e9] Received unexpected event network-vif-plugged-d7155dcf-9e83-4579-b81a-7277d4a9eeaf for instance with vm_state building and task_state spawning.
Apr 13 16:22:02 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:22:02 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:22:02 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:22:02 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:22:02 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:22:02 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:22:03 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:22:03 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:22:03 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:22:03 user nova-compute[71731]: DEBUG nova.compute.manager [req-f2de8b81-5235-4de8-b0de-9f451199cedb req-66cee680-aa6b-40f0-b20f-aaeaac6b782e service nova] [instance: e4ada2d7-7ace-4ed4-86a6-ed121c95e80f] Received event network-vif-plugged-d41765b6-0d5b-43c1-bf58-a82a7bbe3137 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:22:03 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-f2de8b81-5235-4de8-b0de-9f451199cedb req-66cee680-aa6b-40f0-b20f-aaeaac6b782e service nova] Acquiring lock "e4ada2d7-7ace-4ed4-86a6-ed121c95e80f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:22:03 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-f2de8b81-5235-4de8-b0de-9f451199cedb req-66cee680-aa6b-40f0-b20f-aaeaac6b782e service nova] Lock "e4ada2d7-7ace-4ed4-86a6-ed121c95e80f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:22:03 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-f2de8b81-5235-4de8-b0de-9f451199cedb req-66cee680-aa6b-40f0-b20f-aaeaac6b782e service nova] Lock "e4ada2d7-7ace-4ed4-86a6-ed121c95e80f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:22:03 user nova-compute[71731]: DEBUG nova.compute.manager [req-f2de8b81-5235-4de8-b0de-9f451199cedb req-66cee680-aa6b-40f0-b20f-aaeaac6b782e service nova] [instance: e4ada2d7-7ace-4ed4-86a6-ed121c95e80f] No waiting events found dispatching network-vif-plugged-d41765b6-0d5b-43c1-bf58-a82a7bbe3137 {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:22:03 user nova-compute[71731]: WARNING nova.compute.manager [req-f2de8b81-5235-4de8-b0de-9f451199cedb req-66cee680-aa6b-40f0-b20f-aaeaac6b782e service nova] [instance: e4ada2d7-7ace-4ed4-86a6-ed121c95e80f] Received unexpected event network-vif-plugged-d41765b6-0d5b-43c1-bf58-a82a7bbe3137 for instance with vm_state building and task_state spawning.
Apr 13 16:22:03 user nova-compute[71731]: DEBUG nova.compute.manager [req-f2de8b81-5235-4de8-b0de-9f451199cedb req-66cee680-aa6b-40f0-b20f-aaeaac6b782e service nova] [instance: e4ada2d7-7ace-4ed4-86a6-ed121c95e80f] Received event network-vif-plugged-d41765b6-0d5b-43c1-bf58-a82a7bbe3137 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:22:03 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-f2de8b81-5235-4de8-b0de-9f451199cedb req-66cee680-aa6b-40f0-b20f-aaeaac6b782e service nova] Acquiring lock "e4ada2d7-7ace-4ed4-86a6-ed121c95e80f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:22:03 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-f2de8b81-5235-4de8-b0de-9f451199cedb req-66cee680-aa6b-40f0-b20f-aaeaac6b782e service nova] Lock "e4ada2d7-7ace-4ed4-86a6-ed121c95e80f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:22:03 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-f2de8b81-5235-4de8-b0de-9f451199cedb req-66cee680-aa6b-40f0-b20f-aaeaac6b782e service nova] Lock "e4ada2d7-7ace-4ed4-86a6-ed121c95e80f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:22:03 user nova-compute[71731]: DEBUG nova.compute.manager [req-f2de8b81-5235-4de8-b0de-9f451199cedb req-66cee680-aa6b-40f0-b20f-aaeaac6b782e service nova] [instance: e4ada2d7-7ace-4ed4-86a6-ed121c95e80f] No waiting events found dispatching network-vif-plugged-d41765b6-0d5b-43c1-bf58-a82a7bbe3137 {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:22:03 user nova-compute[71731]: WARNING nova.compute.manager [req-f2de8b81-5235-4de8-b0de-9f451199cedb req-66cee680-aa6b-40f0-b20f-aaeaac6b782e service nova] [instance: e4ada2d7-7ace-4ed4-86a6-ed121c95e80f] Received unexpected event network-vif-plugged-d41765b6-0d5b-43c1-bf58-a82a7bbe3137 for instance with vm_state building and task_state spawning.
Apr 13 16:22:03 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:22:03 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:22:03 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:22:03 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:22:03 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:22:03 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:22:03 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:22:03 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:22:03 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:22:03 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:22:03 user nova-compute[71731]: DEBUG nova.compute.manager [req-05711468-f1f4-410d-9e86-5e3faea12a95 req-baeebedc-aa80-4ec1-a532-7008194e1354 service nova] [instance: 2549ba85-4e0a-420e-b711-07cafa8c60e9] Received event network-vif-plugged-36152688-366c-40a2-8bf9-88f69925594a {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:22:03 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-05711468-f1f4-410d-9e86-5e3faea12a95 req-baeebedc-aa80-4ec1-a532-7008194e1354 service nova] Acquiring lock "2549ba85-4e0a-420e-b711-07cafa8c60e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:22:03 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-05711468-f1f4-410d-9e86-5e3faea12a95 req-baeebedc-aa80-4ec1-a532-7008194e1354 service nova] Lock "2549ba85-4e0a-420e-b711-07cafa8c60e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:22:03 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-05711468-f1f4-410d-9e86-5e3faea12a95 req-baeebedc-aa80-4ec1-a532-7008194e1354 service nova] Lock "2549ba85-4e0a-420e-b711-07cafa8c60e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:22:03 user nova-compute[71731]: DEBUG nova.compute.manager [req-05711468-f1f4-410d-9e86-5e3faea12a95 req-baeebedc-aa80-4ec1-a532-7008194e1354 service nova] [instance: 2549ba85-4e0a-420e-b711-07cafa8c60e9] No waiting events found dispatching network-vif-plugged-36152688-366c-40a2-8bf9-88f69925594a {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:22:03 user nova-compute[71731]: WARNING nova.compute.manager [req-05711468-f1f4-410d-9e86-5e3faea12a95 req-baeebedc-aa80-4ec1-a532-7008194e1354 service nova] [instance: 2549ba85-4e0a-420e-b711-07cafa8c60e9] Received unexpected event network-vif-plugged-36152688-366c-40a2-8bf9-88f69925594a for instance with vm_state building and task_state spawning.
Apr 13 16:22:03 user nova-compute[71731]: DEBUG nova.compute.manager [req-05711468-f1f4-410d-9e86-5e3faea12a95 req-baeebedc-aa80-4ec1-a532-7008194e1354 service nova] [instance: 2549ba85-4e0a-420e-b711-07cafa8c60e9] Received event network-vif-plugged-4c481745-6342-43f8-9040-3ea1d8c5c572 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:22:03 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-05711468-f1f4-410d-9e86-5e3faea12a95 req-baeebedc-aa80-4ec1-a532-7008194e1354 service nova] Acquiring lock "2549ba85-4e0a-420e-b711-07cafa8c60e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:22:03 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-05711468-f1f4-410d-9e86-5e3faea12a95 req-baeebedc-aa80-4ec1-a532-7008194e1354 service nova] Lock "2549ba85-4e0a-420e-b711-07cafa8c60e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:22:03 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-05711468-f1f4-410d-9e86-5e3faea12a95 req-baeebedc-aa80-4ec1-a532-7008194e1354 service nova] Lock "2549ba85-4e0a-420e-b711-07cafa8c60e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:22:03 user nova-compute[71731]: DEBUG nova.compute.manager [req-05711468-f1f4-410d-9e86-5e3faea12a95 req-baeebedc-aa80-4ec1-a532-7008194e1354 service nova] [instance: 2549ba85-4e0a-420e-b711-07cafa8c60e9] No waiting events found dispatching network-vif-plugged-4c481745-6342-43f8-9040-3ea1d8c5c572 {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:22:03 user nova-compute[71731]: WARNING nova.compute.manager [req-05711468-f1f4-410d-9e86-5e3faea12a95 req-baeebedc-aa80-4ec1-a532-7008194e1354 service nova] [instance: 2549ba85-4e0a-420e-b711-07cafa8c60e9] Received unexpected event network-vif-plugged-4c481745-6342-43f8-9040-3ea1d8c5c572 for instance with vm_state building and task_state spawning.
Apr 13 16:22:03 user nova-compute[71731]: DEBUG nova.compute.manager [req-05711468-f1f4-410d-9e86-5e3faea12a95 req-baeebedc-aa80-4ec1-a532-7008194e1354 service nova] [instance: 2549ba85-4e0a-420e-b711-07cafa8c60e9] Received event network-vif-plugged-4c481745-6342-43f8-9040-3ea1d8c5c572 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:22:03 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-05711468-f1f4-410d-9e86-5e3faea12a95 req-baeebedc-aa80-4ec1-a532-7008194e1354 service nova] Acquiring lock "2549ba85-4e0a-420e-b711-07cafa8c60e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:22:03 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-05711468-f1f4-410d-9e86-5e3faea12a95 req-baeebedc-aa80-4ec1-a532-7008194e1354 service nova] Lock "2549ba85-4e0a-420e-b711-07cafa8c60e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:22:03 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-05711468-f1f4-410d-9e86-5e3faea12a95 req-baeebedc-aa80-4ec1-a532-7008194e1354 service nova] Lock "2549ba85-4e0a-420e-b711-07cafa8c60e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:22:03 user nova-compute[71731]: DEBUG nova.compute.manager [req-05711468-f1f4-410d-9e86-5e3faea12a95 req-baeebedc-aa80-4ec1-a532-7008194e1354 service nova] [instance: 2549ba85-4e0a-420e-b711-07cafa8c60e9] No waiting events found dispatching network-vif-plugged-4c481745-6342-43f8-9040-3ea1d8c5c572 {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:22:03 user nova-compute[71731]: WARNING nova.compute.manager [req-05711468-f1f4-410d-9e86-5e3faea12a95 req-baeebedc-aa80-4ec1-a532-7008194e1354 service nova] [instance: 2549ba85-4e0a-420e-b711-07cafa8c60e9] Received unexpected event network-vif-plugged-4c481745-6342-43f8-9040-3ea1d8c5c572 for instance with vm_state building and task_state spawning.
Apr 13 16:22:03 user nova-compute[71731]: DEBUG nova.compute.manager [req-05711468-f1f4-410d-9e86-5e3faea12a95 req-baeebedc-aa80-4ec1-a532-7008194e1354 service nova] [instance: 2549ba85-4e0a-420e-b711-07cafa8c60e9] Received event network-vif-plugged-0152bbb9-d50d-4e58-8a2b-727c4675ea2f {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:22:03 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-05711468-f1f4-410d-9e86-5e3faea12a95 req-baeebedc-aa80-4ec1-a532-7008194e1354 service nova] Acquiring lock "2549ba85-4e0a-420e-b711-07cafa8c60e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:22:03 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-05711468-f1f4-410d-9e86-5e3faea12a95 req-baeebedc-aa80-4ec1-a532-7008194e1354 service nova] Lock "2549ba85-4e0a-420e-b711-07cafa8c60e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:22:03 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-05711468-f1f4-410d-9e86-5e3faea12a95 req-baeebedc-aa80-4ec1-a532-7008194e1354 service nova] Lock "2549ba85-4e0a-420e-b711-07cafa8c60e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:22:03 user nova-compute[71731]: DEBUG nova.compute.manager [req-05711468-f1f4-410d-9e86-5e3faea12a95 req-baeebedc-aa80-4ec1-a532-7008194e1354 service nova] [instance: 2549ba85-4e0a-420e-b711-07cafa8c60e9] No waiting events found dispatching network-vif-plugged-0152bbb9-d50d-4e58-8a2b-727c4675ea2f {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:22:03 user nova-compute[71731]: WARNING nova.compute.manager [req-05711468-f1f4-410d-9e86-5e3faea12a95 req-baeebedc-aa80-4ec1-a532-7008194e1354 service nova] [instance: 2549ba85-4e0a-420e-b711-07cafa8c60e9] Received unexpected event network-vif-plugged-0152bbb9-d50d-4e58-8a2b-727c4675ea2f for instance with vm_state building and task_state spawning.
Apr 13 16:22:04 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:22:04 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:22:04 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:22:04 user nova-compute[71731]: DEBUG nova.virt.driver [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Emitting event <LifecycleEvent: 1681402924.4259915, e4ada2d7-7ace-4ed4-86a6-ed121c95e80f => Resumed> {{(pid=71731) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 16:22:04 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: e4ada2d7-7ace-4ed4-86a6-ed121c95e80f] VM Resumed (Lifecycle Event)
Apr 13 16:22:04 user nova-compute[71731]: DEBUG nova.compute.manager [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] [instance: e4ada2d7-7ace-4ed4-86a6-ed121c95e80f] Instance event wait completed in 0 seconds for  {{(pid=71731) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 16:22:04 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] [instance: e4ada2d7-7ace-4ed4-86a6-ed121c95e80f] Guest created on hypervisor {{(pid=71731) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 16:22:04 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: e4ada2d7-7ace-4ed4-86a6-ed121c95e80f] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:22:04 user nova-compute[71731]: INFO nova.virt.libvirt.driver [-] [instance: e4ada2d7-7ace-4ed4-86a6-ed121c95e80f] Instance spawned successfully.
Apr 13 16:22:04 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] [instance: e4ada2d7-7ace-4ed4-86a6-ed121c95e80f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 16:22:04 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: e4ada2d7-7ace-4ed4-86a6-ed121c95e80f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71731) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 16:22:04 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] [instance: e4ada2d7-7ace-4ed4-86a6-ed121c95e80f] Found default for hw_cdrom_bus of ide {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:22:04 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] [instance: e4ada2d7-7ace-4ed4-86a6-ed121c95e80f] Found default for hw_disk_bus of virtio {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:22:04 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] [instance: e4ada2d7-7ace-4ed4-86a6-ed121c95e80f] Found default for hw_input_bus of None {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:22:04 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] [instance: e4ada2d7-7ace-4ed4-86a6-ed121c95e80f] Found default for hw_pointer_model of None {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:22:04 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] [instance: e4ada2d7-7ace-4ed4-86a6-ed121c95e80f] Found default for hw_video_model of virtio {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:22:04 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] [instance: e4ada2d7-7ace-4ed4-86a6-ed121c95e80f] Found default for hw_vif_model of virtio {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:22:04 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: e4ada2d7-7ace-4ed4-86a6-ed121c95e80f] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 16:22:04 user nova-compute[71731]: DEBUG nova.virt.driver [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Emitting event <LifecycleEvent: 1681402924.4286344, e4ada2d7-7ace-4ed4-86a6-ed121c95e80f => Started> {{(pid=71731) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 16:22:04 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: e4ada2d7-7ace-4ed4-86a6-ed121c95e80f] VM Started (Lifecycle Event)
Apr 13 16:22:04 user nova-compute[71731]: DEBUG nova.compute.manager [req-4538fb68-2d89-42e7-8ba4-ba9f8fca92c3 req-3714faa3-a25d-4da3-80a4-b375b69dbf7c service nova] [instance: 2549ba85-4e0a-420e-b711-07cafa8c60e9] Received event network-vif-plugged-d7155dcf-9e83-4579-b81a-7277d4a9eeaf {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:22:04 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-4538fb68-2d89-42e7-8ba4-ba9f8fca92c3 req-3714faa3-a25d-4da3-80a4-b375b69dbf7c service nova] Acquiring lock "2549ba85-4e0a-420e-b711-07cafa8c60e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:22:04 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-4538fb68-2d89-42e7-8ba4-ba9f8fca92c3 req-3714faa3-a25d-4da3-80a4-b375b69dbf7c service nova] Lock "2549ba85-4e0a-420e-b711-07cafa8c60e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:22:04 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-4538fb68-2d89-42e7-8ba4-ba9f8fca92c3 req-3714faa3-a25d-4da3-80a4-b375b69dbf7c service nova] Lock "2549ba85-4e0a-420e-b711-07cafa8c60e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:22:04 user nova-compute[71731]: DEBUG nova.compute.manager [req-4538fb68-2d89-42e7-8ba4-ba9f8fca92c3 req-3714faa3-a25d-4da3-80a4-b375b69dbf7c service nova] [instance: 2549ba85-4e0a-420e-b711-07cafa8c60e9] No waiting events found dispatching network-vif-plugged-d7155dcf-9e83-4579-b81a-7277d4a9eeaf {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:22:04 user nova-compute[71731]: WARNING nova.compute.manager [req-4538fb68-2d89-42e7-8ba4-ba9f8fca92c3 req-3714faa3-a25d-4da3-80a4-b375b69dbf7c service nova] [instance: 2549ba85-4e0a-420e-b711-07cafa8c60e9] Received unexpected event network-vif-plugged-d7155dcf-9e83-4579-b81a-7277d4a9eeaf for instance with vm_state building and task_state spawning.
Apr 13 16:22:04 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: e4ada2d7-7ace-4ed4-86a6-ed121c95e80f] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:22:04 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: e4ada2d7-7ace-4ed4-86a6-ed121c95e80f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71731) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 16:22:04 user nova-compute[71731]: INFO nova.compute.manager [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] [instance: e4ada2d7-7ace-4ed4-86a6-ed121c95e80f] Took 18.93 seconds to spawn the instance on the hypervisor.
Apr 13 16:22:04 user nova-compute[71731]: DEBUG nova.compute.manager [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] [instance: e4ada2d7-7ace-4ed4-86a6-ed121c95e80f] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:22:04 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: e4ada2d7-7ace-4ed4-86a6-ed121c95e80f] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 16:22:04 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:22:04 user nova-compute[71731]: INFO nova.compute.manager [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] [instance: e4ada2d7-7ace-4ed4-86a6-ed121c95e80f] Took 39.63 seconds to build instance.
Apr 13 16:22:04 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-93eb27c2-4ae8-4ff7-8abf-6ba17bf7631c tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Lock "e4ada2d7-7ace-4ed4-86a6-ed121c95e80f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 39.767s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:22:05 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager.update_available_resource {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:22:05 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:22:05 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:22:05 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:22:05 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:22:05 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:22:05 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Auditing locally available compute resources for user (node: user) {{(pid=71731) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 16:22:05 user nova-compute[71731]: DEBUG nova.compute.manager [req-eaff66f5-1465-4b56-bb5f-e5d848b551cb req-61e5c9b2-2b25-4a22-9c78-55327a2c8efd service nova] [instance: 2549ba85-4e0a-420e-b711-07cafa8c60e9] Received event network-vif-plugged-0fbdf291-df5d-41c5-a765-7145a87da272 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:22:05 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-eaff66f5-1465-4b56-bb5f-e5d848b551cb req-61e5c9b2-2b25-4a22-9c78-55327a2c8efd service nova] Acquiring lock "2549ba85-4e0a-420e-b711-07cafa8c60e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:22:05 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-eaff66f5-1465-4b56-bb5f-e5d848b551cb req-61e5c9b2-2b25-4a22-9c78-55327a2c8efd service nova] Lock "2549ba85-4e0a-420e-b711-07cafa8c60e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:22:05 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-eaff66f5-1465-4b56-bb5f-e5d848b551cb req-61e5c9b2-2b25-4a22-9c78-55327a2c8efd service nova] Lock "2549ba85-4e0a-420e-b711-07cafa8c60e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:22:05 user nova-compute[71731]: DEBUG nova.compute.manager [req-eaff66f5-1465-4b56-bb5f-e5d848b551cb req-61e5c9b2-2b25-4a22-9c78-55327a2c8efd service nova] [instance: 2549ba85-4e0a-420e-b711-07cafa8c60e9] No waiting events found dispatching network-vif-plugged-0fbdf291-df5d-41c5-a765-7145a87da272 {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:22:05 user nova-compute[71731]: WARNING nova.compute.manager [req-eaff66f5-1465-4b56-bb5f-e5d848b551cb req-61e5c9b2-2b25-4a22-9c78-55327a2c8efd service nova] [instance: 2549ba85-4e0a-420e-b711-07cafa8c60e9] Received unexpected event network-vif-plugged-0fbdf291-df5d-41c5-a765-7145a87da272 for instance with vm_state building and task_state spawning.
Apr 13 16:22:05 user nova-compute[71731]: DEBUG nova.compute.manager [req-eaff66f5-1465-4b56-bb5f-e5d848b551cb req-61e5c9b2-2b25-4a22-9c78-55327a2c8efd service nova] [instance: 2549ba85-4e0a-420e-b711-07cafa8c60e9] Received event network-vif-plugged-0fbdf291-df5d-41c5-a765-7145a87da272 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:22:05 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-eaff66f5-1465-4b56-bb5f-e5d848b551cb req-61e5c9b2-2b25-4a22-9c78-55327a2c8efd service nova] Acquiring lock "2549ba85-4e0a-420e-b711-07cafa8c60e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:22:05 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-eaff66f5-1465-4b56-bb5f-e5d848b551cb req-61e5c9b2-2b25-4a22-9c78-55327a2c8efd service nova] Lock "2549ba85-4e0a-420e-b711-07cafa8c60e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:22:05 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-eaff66f5-1465-4b56-bb5f-e5d848b551cb req-61e5c9b2-2b25-4a22-9c78-55327a2c8efd service nova] Lock "2549ba85-4e0a-420e-b711-07cafa8c60e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:22:05 user nova-compute[71731]: DEBUG nova.compute.manager [req-eaff66f5-1465-4b56-bb5f-e5d848b551cb req-61e5c9b2-2b25-4a22-9c78-55327a2c8efd service nova] [instance: 2549ba85-4e0a-420e-b711-07cafa8c60e9] No waiting events found dispatching network-vif-plugged-0fbdf291-df5d-41c5-a765-7145a87da272 {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:22:05 user nova-compute[71731]: WARNING nova.compute.manager [req-eaff66f5-1465-4b56-bb5f-e5d848b551cb req-61e5c9b2-2b25-4a22-9c78-55327a2c8efd service nova] [instance: 2549ba85-4e0a-420e-b711-07cafa8c60e9] Received unexpected event network-vif-plugged-0fbdf291-df5d-41c5-a765-7145a87da272 for instance with vm_state building and task_state spawning.
Apr 13 16:22:05 user nova-compute[71731]: DEBUG nova.compute.manager [req-eaff66f5-1465-4b56-bb5f-e5d848b551cb req-61e5c9b2-2b25-4a22-9c78-55327a2c8efd service nova] [instance: 2549ba85-4e0a-420e-b711-07cafa8c60e9] Received event network-vif-plugged-38e92b7c-b7c1-4137-a1db-21bc1d24f3ee {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:22:05 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-eaff66f5-1465-4b56-bb5f-e5d848b551cb req-61e5c9b2-2b25-4a22-9c78-55327a2c8efd service nova] Acquiring lock "2549ba85-4e0a-420e-b711-07cafa8c60e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:22:05 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-eaff66f5-1465-4b56-bb5f-e5d848b551cb req-61e5c9b2-2b25-4a22-9c78-55327a2c8efd service nova] Lock "2549ba85-4e0a-420e-b711-07cafa8c60e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:22:05 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-eaff66f5-1465-4b56-bb5f-e5d848b551cb req-61e5c9b2-2b25-4a22-9c78-55327a2c8efd service nova] Lock "2549ba85-4e0a-420e-b711-07cafa8c60e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:22:05 user nova-compute[71731]: DEBUG nova.compute.manager [req-eaff66f5-1465-4b56-bb5f-e5d848b551cb req-61e5c9b2-2b25-4a22-9c78-55327a2c8efd service nova] [instance: 2549ba85-4e0a-420e-b711-07cafa8c60e9] No waiting events found dispatching network-vif-plugged-38e92b7c-b7c1-4137-a1db-21bc1d24f3ee {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:22:05 user nova-compute[71731]: WARNING nova.compute.manager [req-eaff66f5-1465-4b56-bb5f-e5d848b551cb req-61e5c9b2-2b25-4a22-9c78-55327a2c8efd service nova] [instance: 2549ba85-4e0a-420e-b711-07cafa8c60e9] Received unexpected event network-vif-plugged-38e92b7c-b7c1-4137-a1db-21bc1d24f3ee for instance with vm_state building and task_state spawning.
Apr 13 16:22:05 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:22:05 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=71731) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 16:22:05 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=71731) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 16:22:05 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] skipping disk /dev/sdh (vdc) as it is a volume {{(pid=71731) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 16:22:05 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71731) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 16:22:05 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7973e93b-6311-44ed-91ff-e861c32d0277/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:22:05 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:22:05 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7973e93b-6311-44ed-91ff-e861c32d0277/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:22:05 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7973e93b-6311-44ed-91ff-e861c32d0277/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:22:05 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7973e93b-6311-44ed-91ff-e861c32d0277/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:22:05 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf54be22-2a5d-40c4-8a1a-0060c77f83f6/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:22:05 user nova-compute[71731]: DEBUG nova.compute.manager [req-2cb1d2e4-6dba-4d31-9061-725beed7dfe7 req-65f212b2-865c-47f7-9ad5-9bbd84435334 service nova] [instance: 2549ba85-4e0a-420e-b711-07cafa8c60e9] Received event network-vif-plugged-0152bbb9-d50d-4e58-8a2b-727c4675ea2f {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:22:05 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-2cb1d2e4-6dba-4d31-9061-725beed7dfe7 req-65f212b2-865c-47f7-9ad5-9bbd84435334 service nova] Acquiring lock "2549ba85-4e0a-420e-b711-07cafa8c60e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:22:05 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-2cb1d2e4-6dba-4d31-9061-725beed7dfe7 req-65f212b2-865c-47f7-9ad5-9bbd84435334 service nova] Lock "2549ba85-4e0a-420e-b711-07cafa8c60e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:22:05 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-2cb1d2e4-6dba-4d31-9061-725beed7dfe7 req-65f212b2-865c-47f7-9ad5-9bbd84435334 service nova] Lock "2549ba85-4e0a-420e-b711-07cafa8c60e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:22:05 user nova-compute[71731]: DEBUG nova.compute.manager [req-2cb1d2e4-6dba-4d31-9061-725beed7dfe7 req-65f212b2-865c-47f7-9ad5-9bbd84435334 service nova] [instance: 2549ba85-4e0a-420e-b711-07cafa8c60e9] No waiting events found dispatching network-vif-plugged-0152bbb9-d50d-4e58-8a2b-727c4675ea2f {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:22:05 user nova-compute[71731]: WARNING nova.compute.manager [req-2cb1d2e4-6dba-4d31-9061-725beed7dfe7 req-65f212b2-865c-47f7-9ad5-9bbd84435334 service nova] [instance: 2549ba85-4e0a-420e-b711-07cafa8c60e9] Received unexpected event network-vif-plugged-0152bbb9-d50d-4e58-8a2b-727c4675ea2f for instance with vm_state building and task_state spawning.
Apr 13 16:22:05 user nova-compute[71731]: DEBUG nova.compute.manager [req-2cb1d2e4-6dba-4d31-9061-725beed7dfe7 req-65f212b2-865c-47f7-9ad5-9bbd84435334 service nova] [instance: 2549ba85-4e0a-420e-b711-07cafa8c60e9] Received event network-vif-plugged-3730ed6e-b093-4232-800b-b064d650e9e8 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:22:05 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-2cb1d2e4-6dba-4d31-9061-725beed7dfe7 req-65f212b2-865c-47f7-9ad5-9bbd84435334 service nova] Acquiring lock "2549ba85-4e0a-420e-b711-07cafa8c60e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:22:05 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-2cb1d2e4-6dba-4d31-9061-725beed7dfe7 req-65f212b2-865c-47f7-9ad5-9bbd84435334 service nova] Lock "2549ba85-4e0a-420e-b711-07cafa8c60e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:22:05 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-2cb1d2e4-6dba-4d31-9061-725beed7dfe7 req-65f212b2-865c-47f7-9ad5-9bbd84435334 service nova] Lock "2549ba85-4e0a-420e-b711-07cafa8c60e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:22:05 user nova-compute[71731]: DEBUG nova.compute.manager [req-2cb1d2e4-6dba-4d31-9061-725beed7dfe7 req-65f212b2-865c-47f7-9ad5-9bbd84435334 service nova] [instance: 2549ba85-4e0a-420e-b711-07cafa8c60e9] No waiting events found dispatching network-vif-plugged-3730ed6e-b093-4232-800b-b064d650e9e8 {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:22:05 user nova-compute[71731]: WARNING nova.compute.manager [req-2cb1d2e4-6dba-4d31-9061-725beed7dfe7 req-65f212b2-865c-47f7-9ad5-9bbd84435334 service nova] [instance: 2549ba85-4e0a-420e-b711-07cafa8c60e9] Received unexpected event network-vif-plugged-3730ed6e-b093-4232-800b-b064d650e9e8 for instance with vm_state building and task_state spawning.
Apr 13 16:22:05 user nova-compute[71731]: DEBUG nova.compute.manager [req-2cb1d2e4-6dba-4d31-9061-725beed7dfe7 req-65f212b2-865c-47f7-9ad5-9bbd84435334 service nova] [instance: 2549ba85-4e0a-420e-b711-07cafa8c60e9] Received event network-vif-plugged-3730ed6e-b093-4232-800b-b064d650e9e8 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:22:05 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-2cb1d2e4-6dba-4d31-9061-725beed7dfe7 req-65f212b2-865c-47f7-9ad5-9bbd84435334 service nova] Acquiring lock "2549ba85-4e0a-420e-b711-07cafa8c60e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:22:05 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-2cb1d2e4-6dba-4d31-9061-725beed7dfe7 req-65f212b2-865c-47f7-9ad5-9bbd84435334 service nova] Lock "2549ba85-4e0a-420e-b711-07cafa8c60e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:22:05 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-2cb1d2e4-6dba-4d31-9061-725beed7dfe7 req-65f212b2-865c-47f7-9ad5-9bbd84435334 service nova] Lock "2549ba85-4e0a-420e-b711-07cafa8c60e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:22:05 user nova-compute[71731]: DEBUG nova.compute.manager [req-2cb1d2e4-6dba-4d31-9061-725beed7dfe7 req-65f212b2-865c-47f7-9ad5-9bbd84435334 service nova] [instance: 2549ba85-4e0a-420e-b711-07cafa8c60e9] No waiting events found dispatching network-vif-plugged-3730ed6e-b093-4232-800b-b064d650e9e8 {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:22:05 user nova-compute[71731]: WARNING nova.compute.manager [req-2cb1d2e4-6dba-4d31-9061-725beed7dfe7 req-65f212b2-865c-47f7-9ad5-9bbd84435334 service nova] [instance: 2549ba85-4e0a-420e-b711-07cafa8c60e9] Received unexpected event network-vif-plugged-3730ed6e-b093-4232-800b-b064d650e9e8 for instance with vm_state building and task_state spawning.
Apr 13 16:22:05 user nova-compute[71731]: DEBUG nova.compute.manager [None req-843e772f-18b8-40de-8f3a-53aaedd6c697 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: f66553f5-5e1b-4f1d-8c5a-63bc340f7586] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:22:05 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf54be22-2a5d-40c4-8a1a-0060c77f83f6/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:22:05 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf54be22-2a5d-40c4-8a1a-0060c77f83f6/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:22:06 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:22:06 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf54be22-2a5d-40c4-8a1a-0060c77f83f6/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:22:06 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66553f5-5e1b-4f1d-8c5a-63bc340f7586/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:22:06 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:22:06 user nova-compute[71731]: DEBUG nova.virt.driver [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Emitting event <LifecycleEvent: 1681402926.1594653, 2549ba85-4e0a-420e-b711-07cafa8c60e9 => Resumed> {{(pid=71731) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 16:22:06 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 2549ba85-4e0a-420e-b711-07cafa8c60e9] VM Resumed (Lifecycle Event)
Apr 13 16:22:06 user nova-compute[71731]: INFO nova.compute.manager [None req-843e772f-18b8-40de-8f3a-53aaedd6c697 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: f66553f5-5e1b-4f1d-8c5a-63bc340f7586] instance snapshotting
Apr 13 16:22:06 user nova-compute[71731]: DEBUG nova.compute.manager [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] [instance: 2549ba85-4e0a-420e-b711-07cafa8c60e9] Instance event wait completed in 0 seconds for  {{(pid=71731) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 16:22:06 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] [instance: 2549ba85-4e0a-420e-b711-07cafa8c60e9] Guest created on hypervisor {{(pid=71731) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 16:22:06 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:22:06 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-f5921e11-4030-4131-9efc-8f1f53ecae84 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Acquiring lock "0e731607-fce1-4f19-9e4b-5b892e760179" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:22:06 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-f5921e11-4030-4131-9efc-8f1f53ecae84 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Lock "0e731607-fce1-4f19-9e4b-5b892e760179" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:22:06 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 2549ba85-4e0a-420e-b711-07cafa8c60e9] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:22:06 user nova-compute[71731]: DEBUG nova.compute.manager [None req-f5921e11-4030-4131-9efc-8f1f53ecae84 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] [instance: 0e731607-fce1-4f19-9e4b-5b892e760179] Starting instance... {{(pid=71731) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 16:22:06 user nova-compute[71731]: INFO nova.virt.libvirt.driver [-] [instance: 2549ba85-4e0a-420e-b711-07cafa8c60e9] Instance spawned successfully.
Apr 13 16:22:06 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] [instance: 2549ba85-4e0a-420e-b711-07cafa8c60e9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 16:22:06 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 2549ba85-4e0a-420e-b711-07cafa8c60e9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71731) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 16:22:06 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66553f5-5e1b-4f1d-8c5a-63bc340f7586/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:22:06 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66553f5-5e1b-4f1d-8c5a-63bc340f7586/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:22:06 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 2549ba85-4e0a-420e-b711-07cafa8c60e9] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 16:22:06 user nova-compute[71731]: DEBUG nova.virt.driver [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Emitting event <LifecycleEvent: 1681402926.1609397, 2549ba85-4e0a-420e-b711-07cafa8c60e9 => Started> {{(pid=71731) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 16:22:06 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 2549ba85-4e0a-420e-b711-07cafa8c60e9] VM Started (Lifecycle Event)
Apr 13 16:22:06 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 2549ba85-4e0a-420e-b711-07cafa8c60e9] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:22:06 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:22:06 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66553f5-5e1b-4f1d-8c5a-63bc340f7586/disk --force-share --output=json" returned: 0 in 0.491s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:22:06 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] [instance: 2549ba85-4e0a-420e-b711-07cafa8c60e9] Found default for hw_cdrom_bus of ide {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:22:06 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] [instance: 2549ba85-4e0a-420e-b711-07cafa8c60e9] Found default for hw_disk_bus of virtio {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:22:06 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] [instance: 2549ba85-4e0a-420e-b711-07cafa8c60e9] Found default for hw_input_bus of None {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:22:06 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] [instance: 2549ba85-4e0a-420e-b711-07cafa8c60e9] Found default for hw_pointer_model of None {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:22:06 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] [instance: 2549ba85-4e0a-420e-b711-07cafa8c60e9] Found default for hw_video_model of virtio {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:22:06 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] [instance: 2549ba85-4e0a-420e-b711-07cafa8c60e9] Found default for hw_vif_model of virtio {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:22:06 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-f5921e11-4030-4131-9efc-8f1f53ecae84 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:22:06 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-f5921e11-4030-4131-9efc-8f1f53ecae84 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:22:06 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 2549ba85-4e0a-420e-b711-07cafa8c60e9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71731) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 16:22:06 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-f5921e11-4030-4131-9efc-8f1f53ecae84 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71731) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 16:22:06 user nova-compute[71731]: INFO nova.compute.claims [None req-f5921e11-4030-4131-9efc-8f1f53ecae84 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] [instance: 0e731607-fce1-4f19-9e4b-5b892e760179] Claim successful on node user
Apr 13 16:22:06 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-843e772f-18b8-40de-8f3a-53aaedd6c697 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: f66553f5-5e1b-4f1d-8c5a-63bc340f7586] Beginning live snapshot process
Apr 13 16:22:06 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbcccf4b-e861-4254-9be3-a491776214e9/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:22:06 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 2549ba85-4e0a-420e-b711-07cafa8c60e9] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 16:22:07 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbcccf4b-e861-4254-9be3-a491776214e9/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:22:07 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbcccf4b-e861-4254-9be3-a491776214e9/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:22:07 user nova-compute[71731]: INFO nova.compute.manager [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] [instance: 2549ba85-4e0a-420e-b711-07cafa8c60e9] Took 21.71 seconds to spawn the instance on the hypervisor.
Apr 13 16:22:07 user nova-compute[71731]: DEBUG nova.compute.manager [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] [instance: 2549ba85-4e0a-420e-b711-07cafa8c60e9] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:22:07 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-843e772f-18b8-40de-8f3a-53aaedd6c697 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66553f5-5e1b-4f1d-8c5a-63bc340f7586/disk --force-share --output=json -f qcow2 {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:22:07 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbcccf4b-e861-4254-9be3-a491776214e9/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:22:07 user nova-compute[71731]: INFO nova.compute.manager [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] [instance: 2549ba85-4e0a-420e-b711-07cafa8c60e9] Took 41.91 seconds to build instance.
Apr 13 16:22:07 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/031c7939-a53c-4f7d-9f36-4ec1d06e2717/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:22:07 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-d6450320-90ea-4e7b-a3eb-0acf4894b92f tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Lock "2549ba85-4e0a-420e-b711-07cafa8c60e9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 42.091s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:22:07 user nova-compute[71731]: DEBUG nova.compute.manager [req-c595c58c-808e-449d-81a8-0bbcfb8723c4 req-04568128-076f-420e-b01e-bccd17e3d96a service nova] [instance: 2549ba85-4e0a-420e-b711-07cafa8c60e9] Received event network-vif-plugged-38e92b7c-b7c1-4137-a1db-21bc1d24f3ee {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:22:07 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-c595c58c-808e-449d-81a8-0bbcfb8723c4 req-04568128-076f-420e-b01e-bccd17e3d96a service nova] Acquiring lock "2549ba85-4e0a-420e-b711-07cafa8c60e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:22:07 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-c595c58c-808e-449d-81a8-0bbcfb8723c4 req-04568128-076f-420e-b01e-bccd17e3d96a service nova] Lock "2549ba85-4e0a-420e-b711-07cafa8c60e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:22:07 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-c595c58c-808e-449d-81a8-0bbcfb8723c4 req-04568128-076f-420e-b01e-bccd17e3d96a service nova] Lock "2549ba85-4e0a-420e-b711-07cafa8c60e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:22:07 user nova-compute[71731]: DEBUG nova.compute.manager [req-c595c58c-808e-449d-81a8-0bbcfb8723c4 req-04568128-076f-420e-b01e-bccd17e3d96a service nova] [instance: 2549ba85-4e0a-420e-b711-07cafa8c60e9] No waiting events found dispatching network-vif-plugged-38e92b7c-b7c1-4137-a1db-21bc1d24f3ee {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:22:07 user nova-compute[71731]: WARNING nova.compute.manager [req-c595c58c-808e-449d-81a8-0bbcfb8723c4 req-04568128-076f-420e-b01e-bccd17e3d96a service nova] [instance: 2549ba85-4e0a-420e-b711-07cafa8c60e9] Received unexpected event network-vif-plugged-38e92b7c-b7c1-4137-a1db-21bc1d24f3ee for instance with vm_state active and task_state None.
Apr 13 16:22:07 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-843e772f-18b8-40de-8f3a-53aaedd6c697 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66553f5-5e1b-4f1d-8c5a-63bc340f7586/disk --force-share --output=json -f qcow2" returned: 0 in 0.164s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:22:07 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-843e772f-18b8-40de-8f3a-53aaedd6c697 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66553f5-5e1b-4f1d-8c5a-63bc340f7586/disk --force-share --output=json -f qcow2 {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:22:07 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/031c7939-a53c-4f7d-9f36-4ec1d06e2717/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:22:07 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/031c7939-a53c-4f7d-9f36-4ec1d06e2717/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:22:07 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-843e772f-18b8-40de-8f3a-53aaedd6c697 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66553f5-5e1b-4f1d-8c5a-63bc340f7586/disk --force-share --output=json -f qcow2" returned: 0 in 0.154s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:22:07 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-843e772f-18b8-40de-8f3a-53aaedd6c697 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279 --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:22:07 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/031c7939-a53c-4f7d-9f36-4ec1d06e2717/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:22:07 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71731) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 16:22:07 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=71731) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 16:22:07 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=71731) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 16:22:07 user nova-compute[71731]: DEBUG nova.compute.provider_tree [None req-f5921e11-4030-4131-9efc-8f1f53ecae84 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Inventory has not changed in ProviderTree for provider: cb6b1a64-0c24-4e2d-af1e-16576ca9165c {{(pid=71731) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 16:22:07 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/823749e1-56ca-44f9-be83-a36b4851c28f/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:22:07 user nova-compute[71731]: DEBUG nova.scheduler.client.report [None req-f5921e11-4030-4131-9efc-8f1f53ecae84 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Inventory has not changed for provider cb6b1a64-0c24-4e2d-af1e-16576ca9165c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71731) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 16:22:07 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-843e772f-18b8-40de-8f3a-53aaedd6c697 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279 --force-share --output=json" returned: 0 in 0.198s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:22:07 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-843e772f-18b8-40de-8f3a-53aaedd6c697 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpahjii_n8/4a6161ca70954952a06ee96a7a2921d8.delta 1073741824 {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:22:07 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-f5921e11-4030-4131-9efc-8f1f53ecae84 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.897s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:22:07 user nova-compute[71731]: DEBUG nova.compute.manager [None req-f5921e11-4030-4131-9efc-8f1f53ecae84 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] [instance: 0e731607-fce1-4f19-9e4b-5b892e760179] Start building networks asynchronously for instance. {{(pid=71731) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 16:22:07 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-843e772f-18b8-40de-8f3a-53aaedd6c697 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpahjii_n8/4a6161ca70954952a06ee96a7a2921d8.delta 1073741824" returned: 0 in 0.073s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:22:07 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-843e772f-18b8-40de-8f3a-53aaedd6c697 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: f66553f5-5e1b-4f1d-8c5a-63bc340f7586] Quiescing instance not available: QEMU guest agent is not enabled.
Apr 13 16:22:07 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/823749e1-56ca-44f9-be83-a36b4851c28f/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:22:07 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/823749e1-56ca-44f9-be83-a36b4851c28f/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:22:07 user nova-compute[71731]: DEBUG nova.virt.libvirt.host [None req-843e772f-18b8-40de-8f3a-53aaedd6c697 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Checking UEFI support for host arch (x86_64) {{(pid=71731) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1722}}
Apr 13 16:22:07 user nova-compute[71731]: INFO nova.virt.libvirt.host [None req-843e772f-18b8-40de-8f3a-53aaedd6c697 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] UEFI support detected
Apr 13 16:22:07 user nova-compute[71731]: DEBUG nova.compute.manager [None req-f5921e11-4030-4131-9efc-8f1f53ecae84 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] [instance: 0e731607-fce1-4f19-9e4b-5b892e760179] Allocating IP information in the background. {{(pid=71731) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 16:22:07 user nova-compute[71731]: DEBUG nova.network.neutron [None req-f5921e11-4030-4131-9efc-8f1f53ecae84 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] [instance: 0e731607-fce1-4f19-9e4b-5b892e760179] allocate_for_instance() {{(pid=71731) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 16:22:07 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-f5921e11-4030-4131-9efc-8f1f53ecae84 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] [instance: 0e731607-fce1-4f19-9e4b-5b892e760179] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 16:22:07 user nova-compute[71731]: DEBUG nova.compute.manager [None req-f5921e11-4030-4131-9efc-8f1f53ecae84 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] [instance: 0e731607-fce1-4f19-9e4b-5b892e760179] Start building block device mappings for instance. {{(pid=71731) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 16:22:07 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/823749e1-56ca-44f9-be83-a36b4851c28f/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:22:07 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5db1cb51-2e5a-46c9-8914-cba759a96a65/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:22:07 user nova-compute[71731]: DEBUG nova.policy [None req-f5921e11-4030-4131-9efc-8f1f53ecae84 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4ddd547d240b43ccb213e9d459082309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5554aa7f1b4d471b8807a845ab1ea33f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71731) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 16:22:07 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:22:08 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5db1cb51-2e5a-46c9-8914-cba759a96a65/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:22:08 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5db1cb51-2e5a-46c9-8914-cba759a96a65/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:22:08 user nova-compute[71731]: DEBUG nova.compute.manager [None req-f5921e11-4030-4131-9efc-8f1f53ecae84 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] [instance: 0e731607-fce1-4f19-9e4b-5b892e760179] Start spawning the instance on the hypervisor. {{(pid=71731) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 16:22:08 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-f5921e11-4030-4131-9efc-8f1f53ecae84 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] [instance: 0e731607-fce1-4f19-9e4b-5b892e760179] Creating instance directory {{(pid=71731) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 16:22:08 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-f5921e11-4030-4131-9efc-8f1f53ecae84 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] [instance: 0e731607-fce1-4f19-9e4b-5b892e760179] Creating image(s)
Apr 13 16:22:08 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-f5921e11-4030-4131-9efc-8f1f53ecae84 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Acquiring lock "/opt/stack/data/nova/instances/0e731607-fce1-4f19-9e4b-5b892e760179/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:22:08 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-f5921e11-4030-4131-9efc-8f1f53ecae84 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Lock "/opt/stack/data/nova/instances/0e731607-fce1-4f19-9e4b-5b892e760179/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:22:08 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-f5921e11-4030-4131-9efc-8f1f53ecae84 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Lock "/opt/stack/data/nova/instances/0e731607-fce1-4f19-9e4b-5b892e760179/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:22:08 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-f5921e11-4030-4131-9efc-8f1f53ecae84 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279 --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:22:08 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5db1cb51-2e5a-46c9-8914-cba759a96a65/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:22:08 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c6d8096-853b-4091-ad82-6faf8ffc85fa/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:22:08 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-f5921e11-4030-4131-9efc-8f1f53ecae84 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279 --force-share --output=json" returned: 0 in 0.194s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:22:08 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-f5921e11-4030-4131-9efc-8f1f53ecae84 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Acquiring lock "9524227dd898575c3099d3976f096cd935414279" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:22:08 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-f5921e11-4030-4131-9efc-8f1f53ecae84 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Lock "9524227dd898575c3099d3976f096cd935414279" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:22:08 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-f5921e11-4030-4131-9efc-8f1f53ecae84 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279 --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:22:08 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c6d8096-853b-4091-ad82-6faf8ffc85fa/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:22:08 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c6d8096-853b-4091-ad82-6faf8ffc85fa/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:22:08 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-f5921e11-4030-4131-9efc-8f1f53ecae84 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279 --force-share --output=json" returned: 0 in 0.145s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:22:08 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-f5921e11-4030-4131-9efc-8f1f53ecae84 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279,backing_fmt=raw /opt/stack/data/nova/instances/0e731607-fce1-4f19-9e4b-5b892e760179/disk 1073741824 {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:22:08 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c6d8096-853b-4091-ad82-6faf8ffc85fa/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:22:08 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-f5921e11-4030-4131-9efc-8f1f53ecae84 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279,backing_fmt=raw /opt/stack/data/nova/instances/0e731607-fce1-4f19-9e4b-5b892e760179/disk 1073741824" returned: 0 in 0.068s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:22:08 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-f5921e11-4030-4131-9efc-8f1f53ecae84 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Lock "9524227dd898575c3099d3976f096cd935414279" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.223s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:22:08 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-f5921e11-4030-4131-9efc-8f1f53ecae84 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279 --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:22:09 user nova-compute[71731]: DEBUG nova.network.neutron [None req-f5921e11-4030-4131-9efc-8f1f53ecae84 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] [instance: 0e731607-fce1-4f19-9e4b-5b892e760179] Successfully created port: 62eabc99-73ed-4669-a7ce-6fc646611ff1 {{(pid=71731) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 16:22:09 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-f5921e11-4030-4131-9efc-8f1f53ecae84 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279 --force-share --output=json" returned: 0 in 0.851s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:22:09 user nova-compute[71731]: DEBUG nova.virt.disk.api [None req-f5921e11-4030-4131-9efc-8f1f53ecae84 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0e731607-fce1-4f19-9e4b-5b892e760179/disk. size=1073741824 {{(pid=71731) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 16:22:09 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-f5921e11-4030-4131-9efc-8f1f53ecae84 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e731607-fce1-4f19-9e4b-5b892e760179/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:22:09 user nova-compute[71731]: DEBUG nova.virt.libvirt.guest [None req-843e772f-18b8-40de-8f3a-53aaedd6c697 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] COPY block job progress, current cursor: 43778048 final cursor: 43778048 {{(pid=71731) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 13 16:22:09 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-843e772f-18b8-40de-8f3a-53aaedd6c697 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: f66553f5-5e1b-4f1d-8c5a-63bc340f7586] Skipping quiescing instance: QEMU guest agent is not enabled.
Apr 13 16:22:09 user nova-compute[71731]: WARNING nova.virt.libvirt.driver [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 16:22:09 user nova-compute[71731]: WARNING nova.virt.libvirt.driver [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 16:22:09 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Hypervisor/Node resource view: name=user free_ram=7472MB free_disk=26.452686309814453GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71731) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 16:22:09 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:22:09 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:22:09 user nova-compute[71731]: DEBUG nova.privsep.utils [None req-843e772f-18b8-40de-8f3a-53aaedd6c697 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71731) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 13 16:22:09 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-843e772f-18b8-40de-8f3a-53aaedd6c697 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpahjii_n8/4a6161ca70954952a06ee96a7a2921d8.delta /opt/stack/data/nova/instances/snapshots/tmpahjii_n8/4a6161ca70954952a06ee96a7a2921d8 {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:22:09 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-f5921e11-4030-4131-9efc-8f1f53ecae84 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e731607-fce1-4f19-9e4b-5b892e760179/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:22:09 user nova-compute[71731]: DEBUG nova.virt.disk.api [None req-f5921e11-4030-4131-9efc-8f1f53ecae84 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Cannot resize image /opt/stack/data/nova/instances/0e731607-fce1-4f19-9e4b-5b892e760179/disk to a smaller size. {{(pid=71731) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 16:22:09 user nova-compute[71731]: DEBUG nova.objects.instance [None req-f5921e11-4030-4131-9efc-8f1f53ecae84 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Lazy-loading 'migration_context' on Instance uuid 0e731607-fce1-4f19-9e4b-5b892e760179 {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:22:09 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-f5921e11-4030-4131-9efc-8f1f53ecae84 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] [instance: 0e731607-fce1-4f19-9e4b-5b892e760179] Created local disks {{(pid=71731) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 16:22:09 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-f5921e11-4030-4131-9efc-8f1f53ecae84 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] [instance: 0e731607-fce1-4f19-9e4b-5b892e760179] Ensure instance console log exists: /opt/stack/data/nova/instances/0e731607-fce1-4f19-9e4b-5b892e760179/console.log {{(pid=71731) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 16:22:09 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-f5921e11-4030-4131-9efc-8f1f53ecae84 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:22:09 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-f5921e11-4030-4131-9efc-8f1f53ecae84 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:22:09 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-f5921e11-4030-4131-9efc-8f1f53ecae84 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:22:09 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance 0e731607-fce1-4f19-9e4b-5b892e760179 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 16:22:09 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance 7973e93b-6311-44ed-91ff-e861c32d0277 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 16:22:09 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance 5db1cb51-2e5a-46c9-8914-cba759a96a65 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 16:22:09 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance 823749e1-56ca-44f9-be83-a36b4851c28f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 16:22:09 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance bbcccf4b-e861-4254-9be3-a491776214e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 16:22:09 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance e4ada2d7-7ace-4ed4-86a6-ed121c95e80f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 16:22:09 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance cf54be22-2a5d-40c4-8a1a-0060c77f83f6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 16:22:09 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance f66553f5-5e1b-4f1d-8c5a-63bc340f7586 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 16:22:09 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance 2549ba85-4e0a-420e-b711-07cafa8c60e9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 16:22:09 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance 8c6d8096-853b-4091-ad82-6faf8ffc85fa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 16:22:09 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance 031c7939-a53c-4f7d-9f36-4ec1d06e2717 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 16:22:09 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance bf350da4-9cc2-4900-adf0-506e44984b42 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 16:22:09 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=71731) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 16:22:09 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Final resource view: name=user phys_ram=16023MB used_ram=2048MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=71731) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 16:22:09 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-843e772f-18b8-40de-8f3a-53aaedd6c697 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpahjii_n8/4a6161ca70954952a06ee96a7a2921d8.delta /opt/stack/data/nova/instances/snapshots/tmpahjii_n8/4a6161ca70954952a06ee96a7a2921d8" returned: 0 in 0.417s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:22:10 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-843e772f-18b8-40de-8f3a-53aaedd6c697 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: f66553f5-5e1b-4f1d-8c5a-63bc340f7586] Snapshot extracted, beginning image upload
Apr 13 16:22:10 user nova-compute[71731]: DEBUG nova.network.neutron [None req-f5921e11-4030-4131-9efc-8f1f53ecae84 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] [instance: 0e731607-fce1-4f19-9e4b-5b892e760179] Successfully updated port: 62eabc99-73ed-4669-a7ce-6fc646611ff1 {{(pid=71731) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 16:22:10 user nova-compute[71731]: DEBUG nova.compute.provider_tree [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Inventory has not changed in ProviderTree for provider: cb6b1a64-0c24-4e2d-af1e-16576ca9165c {{(pid=71731) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 16:22:10 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-f5921e11-4030-4131-9efc-8f1f53ecae84 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Acquiring lock "refresh_cache-0e731607-fce1-4f19-9e4b-5b892e760179" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 16:22:10 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-f5921e11-4030-4131-9efc-8f1f53ecae84 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Acquired lock "refresh_cache-0e731607-fce1-4f19-9e4b-5b892e760179" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 16:22:10 user nova-compute[71731]: DEBUG nova.network.neutron [None req-f5921e11-4030-4131-9efc-8f1f53ecae84 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] [instance: 0e731607-fce1-4f19-9e4b-5b892e760179] Building network info cache for instance {{(pid=71731) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 16:22:10 user nova-compute[71731]: DEBUG nova.scheduler.client.report [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Inventory has not changed for provider cb6b1a64-0c24-4e2d-af1e-16576ca9165c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71731) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 16:22:10 user nova-compute[71731]: DEBUG nova.compute.manager [req-81b4c31c-17c3-4b43-9a96-8d0268142283 req-900ef3f0-0b34-4a30-bf00-44821bb99f65 service nova] [instance: 0e731607-fce1-4f19-9e4b-5b892e760179] Received event network-changed-62eabc99-73ed-4669-a7ce-6fc646611ff1 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:22:10 user nova-compute[71731]: DEBUG nova.compute.manager [req-81b4c31c-17c3-4b43-9a96-8d0268142283 req-900ef3f0-0b34-4a30-bf00-44821bb99f65 service nova] [instance: 0e731607-fce1-4f19-9e4b-5b892e760179] Refreshing instance network info cache due to event network-changed-62eabc99-73ed-4669-a7ce-6fc646611ff1. {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 16:22:10 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-81b4c31c-17c3-4b43-9a96-8d0268142283 req-900ef3f0-0b34-4a30-bf00-44821bb99f65 service nova] Acquiring lock "refresh_cache-0e731607-fce1-4f19-9e4b-5b892e760179" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 16:22:10 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Compute_service record updated for user:user {{(pid=71731) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 16:22:10 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.938s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:22:10 user nova-compute[71731]: DEBUG nova.network.neutron [None req-f5921e11-4030-4131-9efc-8f1f53ecae84 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] [instance: 0e731607-fce1-4f19-9e4b-5b892e760179] Instance cache missing network info. {{(pid=71731) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 16:22:10 user nova-compute[71731]: DEBUG nova.network.neutron [None req-f5921e11-4030-4131-9efc-8f1f53ecae84 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] [instance: 0e731607-fce1-4f19-9e4b-5b892e760179] Updating instance_info_cache with network_info: [{"id": "62eabc99-73ed-4669-a7ce-6fc646611ff1", "address": "fa:16:3e:46:a8:2e", "network": {"id": "ae7f770e-a460-4297-91b5-ed0b908a895a", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1175970469-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5554aa7f1b4d471b8807a845ab1ea33f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62eabc99-73", "ovs_interfaceid": "62eabc99-73ed-4669-a7ce-6fc646611ff1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:22:10 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-f5921e11-4030-4131-9efc-8f1f53ecae84 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Releasing lock "refresh_cache-0e731607-fce1-4f19-9e4b-5b892e760179" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 16:22:10 user nova-compute[71731]: DEBUG nova.compute.manager [None req-f5921e11-4030-4131-9efc-8f1f53ecae84 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] [instance: 0e731607-fce1-4f19-9e4b-5b892e760179] Instance network_info: |[{"id": "62eabc99-73ed-4669-a7ce-6fc646611ff1", "address": "fa:16:3e:46:a8:2e", "network": {"id": "ae7f770e-a460-4297-91b5-ed0b908a895a", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1175970469-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5554aa7f1b4d471b8807a845ab1ea33f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62eabc99-73", "ovs_interfaceid": "62eabc99-73ed-4669-a7ce-6fc646611ff1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71731) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 16:22:10 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-81b4c31c-17c3-4b43-9a96-8d0268142283 req-900ef3f0-0b34-4a30-bf00-44821bb99f65 service nova] Acquired lock "refresh_cache-0e731607-fce1-4f19-9e4b-5b892e760179" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 16:22:10 user nova-compute[71731]: DEBUG nova.network.neutron [req-81b4c31c-17c3-4b43-9a96-8d0268142283 req-900ef3f0-0b34-4a30-bf00-44821bb99f65 service nova] [instance: 0e731607-fce1-4f19-9e4b-5b892e760179] Refreshing network info cache for port 62eabc99-73ed-4669-a7ce-6fc646611ff1 {{(pid=71731) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 16:22:10 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-f5921e11-4030-4131-9efc-8f1f53ecae84 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] [instance: 0e731607-fce1-4f19-9e4b-5b892e760179] Start _get_guest_xml network_info=[{"id": "62eabc99-73ed-4669-a7ce-6fc646611ff1", "address": "fa:16:3e:46:a8:2e", "network": {"id": "ae7f770e-a460-4297-91b5-ed0b908a895a", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1175970469-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5554aa7f1b4d471b8807a845ab1ea33f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62eabc99-73", "ovs_interfaceid": "62eabc99-73ed-4669-a7ce-6fc646611ff1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T16:16:31Z,direct_url=<?>,disk_format='qcow2',id=708622a9-7465-4492-ade8-b827198f7e30,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='0b29a975c552465aba0ac7d6288434bd',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T16:16:33Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'device_type': 'disk', 'encrypted': False, 'disk_bus': 'virtio', 'guest_format': None, 'encryption_options': None, 'image_id': '708622a9-7465-4492-ade8-b827198f7e30'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71731) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 16:22:10 user nova-compute[71731]: WARNING nova.virt.libvirt.driver [None req-f5921e11-4030-4131-9efc-8f1f53ecae84 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 16:22:10 user nova-compute[71731]: WARNING nova.virt.libvirt.driver [None req-f5921e11-4030-4131-9efc-8f1f53ecae84 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 16:22:10 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-f5921e11-4030-4131-9efc-8f1f53ecae84 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71731) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 16:22:10 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-f5921e11-4030-4131-9efc-8f1f53ecae84 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T16:17:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T16:16:31Z,direct_url=<?>,disk_format='qcow2',id=708622a9-7465-4492-ade8-b827198f7e30,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='0b29a975c552465aba0ac7d6288434bd',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T16:16:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 16:22:10 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-f5921e11-4030-4131-9efc-8f1f53ecae84 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Flavor limits 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 16:22:10 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-f5921e11-4030-4131-9efc-8f1f53ecae84 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Image limits 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 16:22:10 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-f5921e11-4030-4131-9efc-8f1f53ecae84 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Flavor pref 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 16:22:10 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-f5921e11-4030-4131-9efc-8f1f53ecae84 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Image pref 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 16:22:10 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-f5921e11-4030-4131-9efc-8f1f53ecae84 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 16:22:10 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-f5921e11-4030-4131-9efc-8f1f53ecae84 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 16:22:10 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-f5921e11-4030-4131-9efc-8f1f53ecae84 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71731) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 16:22:10 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-f5921e11-4030-4131-9efc-8f1f53ecae84 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Got 1 possible topologies {{(pid=71731) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 16:22:10 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-f5921e11-4030-4131-9efc-8f1f53ecae84 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 16:22:10 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-f5921e11-4030-4131-9efc-8f1f53ecae84 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 16:22:10 user nova-compute[71731]: DEBUG nova.virt.libvirt.vif [None req-f5921e11-4030-4131-9efc-8f1f53ecae84 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T16:22:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1280800160',display_name='tempest-ServersNegativeTestJSON-server-1280800160',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1280800160',id=12,image_ref='708622a9-7465-4492-ade8-b827198f7e30',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5554aa7f1b4d471b8807a845ab1ea33f',ramdisk_id='',reservation_id='r-a6fgr3ml',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='708622a9-7465-4492-ade8-b827198f7e30',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1820659348',owner_user_name='tempest-ServersNegativeTestJSON-1820659348-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T16:22:08Z,user_data=None,user_id='4ddd547d240b43ccb213e9d459082309',uuid=0e731607-fce1-4f19-9e4b-5b892e760179,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "62eabc99-73ed-4669-a7ce-6fc646611ff1", "address": "fa:16:3e:46:a8:2e", "network": {"id": "ae7f770e-a460-4297-91b5-ed0b908a895a", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1175970469-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5554aa7f1b4d471b8807a845ab1ea33f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62eabc99-73", "ovs_interfaceid": "62eabc99-73ed-4669-a7ce-6fc646611ff1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71731) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 16:22:10 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-f5921e11-4030-4131-9efc-8f1f53ecae84 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Converting VIF {"id": "62eabc99-73ed-4669-a7ce-6fc646611ff1", "address": "fa:16:3e:46:a8:2e", "network": {"id": "ae7f770e-a460-4297-91b5-ed0b908a895a", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1175970469-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5554aa7f1b4d471b8807a845ab1ea33f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62eabc99-73", "ovs_interfaceid": "62eabc99-73ed-4669-a7ce-6fc646611ff1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 16:22:10 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-f5921e11-4030-4131-9efc-8f1f53ecae84 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:46:a8:2e,bridge_name='br-int',has_traffic_filtering=True,id=62eabc99-73ed-4669-a7ce-6fc646611ff1,network=Network(ae7f770e-a460-4297-91b5-ed0b908a895a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62eabc99-73') {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 16:22:10 user nova-compute[71731]: DEBUG nova.objects.instance [None req-f5921e11-4030-4131-9efc-8f1f53ecae84 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Lazy-loading 'pci_devices' on Instance uuid 0e731607-fce1-4f19-9e4b-5b892e760179 {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:22:10 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-f5921e11-4030-4131-9efc-8f1f53ecae84 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] [instance: 0e731607-fce1-4f19-9e4b-5b892e760179] End _get_guest_xml xml=<domain type="kvm">
Apr 13 16:22:10 user nova-compute[71731]:   <uuid>0e731607-fce1-4f19-9e4b-5b892e760179</uuid>
Apr 13 16:22:10 user nova-compute[71731]:   <name>instance-0000000c</name>
Apr 13 16:22:10 user nova-compute[71731]:   <memory>131072</memory>
Apr 13 16:22:10 user nova-compute[71731]:   <vcpu>1</vcpu>
Apr 13 16:22:10 user nova-compute[71731]:   <metadata>
Apr 13 16:22:10 user nova-compute[71731]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 16:22:10 user nova-compute[71731]:       <nova:package version="0.0.0"/>
Apr 13 16:22:10 user nova-compute[71731]:       <nova:name>tempest-ServersNegativeTestJSON-server-1280800160</nova:name>
Apr 13 16:22:10 user nova-compute[71731]:       <nova:creationTime>2023-04-13 16:22:10</nova:creationTime>
Apr 13 16:22:10 user nova-compute[71731]:       <nova:flavor name="m1.nano">
Apr 13 16:22:10 user nova-compute[71731]:         <nova:memory>128</nova:memory>
Apr 13 16:22:10 user nova-compute[71731]:         <nova:disk>1</nova:disk>
Apr 13 16:22:10 user nova-compute[71731]:         <nova:swap>0</nova:swap>
Apr 13 16:22:10 user nova-compute[71731]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 16:22:10 user nova-compute[71731]:         <nova:vcpus>1</nova:vcpus>
Apr 13 16:22:10 user nova-compute[71731]:       </nova:flavor>
Apr 13 16:22:10 user nova-compute[71731]:       <nova:owner>
Apr 13 16:22:10 user nova-compute[71731]:         <nova:user uuid="4ddd547d240b43ccb213e9d459082309">tempest-ServersNegativeTestJSON-1820659348-project-member</nova:user>
Apr 13 16:22:10 user nova-compute[71731]:         <nova:project uuid="5554aa7f1b4d471b8807a845ab1ea33f">tempest-ServersNegativeTestJSON-1820659348</nova:project>
Apr 13 16:22:10 user nova-compute[71731]:       </nova:owner>
Apr 13 16:22:10 user nova-compute[71731]:       <nova:root type="image" uuid="708622a9-7465-4492-ade8-b827198f7e30"/>
Apr 13 16:22:10 user nova-compute[71731]:       <nova:ports>
Apr 13 16:22:10 user nova-compute[71731]:         <nova:port uuid="62eabc99-73ed-4669-a7ce-6fc646611ff1">
Apr 13 16:22:10 user nova-compute[71731]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Apr 13 16:22:10 user nova-compute[71731]:         </nova:port>
Apr 13 16:22:10 user nova-compute[71731]:       </nova:ports>
Apr 13 16:22:10 user nova-compute[71731]:     </nova:instance>
Apr 13 16:22:10 user nova-compute[71731]:   </metadata>
Apr 13 16:22:10 user nova-compute[71731]:   <sysinfo type="smbios">
Apr 13 16:22:10 user nova-compute[71731]:     <system>
Apr 13 16:22:10 user nova-compute[71731]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 16:22:10 user nova-compute[71731]:       <entry name="product">OpenStack Nova</entry>
Apr 13 16:22:10 user nova-compute[71731]:       <entry name="version">0.0.0</entry>
Apr 13 16:22:10 user nova-compute[71731]:       <entry name="serial">0e731607-fce1-4f19-9e4b-5b892e760179</entry>
Apr 13 16:22:10 user nova-compute[71731]:       <entry name="uuid">0e731607-fce1-4f19-9e4b-5b892e760179</entry>
Apr 13 16:22:10 user nova-compute[71731]:       <entry name="family">Virtual Machine</entry>
Apr 13 16:22:10 user nova-compute[71731]:     </system>
Apr 13 16:22:10 user nova-compute[71731]:   </sysinfo>
Apr 13 16:22:10 user nova-compute[71731]:   <os>
Apr 13 16:22:10 user nova-compute[71731]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 16:22:10 user nova-compute[71731]:     <boot dev="hd"/>
Apr 13 16:22:10 user nova-compute[71731]:     <smbios mode="sysinfo"/>
Apr 13 16:22:10 user nova-compute[71731]:   </os>
Apr 13 16:22:10 user nova-compute[71731]:   <features>
Apr 13 16:22:10 user nova-compute[71731]:     <acpi/>
Apr 13 16:22:10 user nova-compute[71731]:     <apic/>
Apr 13 16:22:10 user nova-compute[71731]:     <vmcoreinfo/>
Apr 13 16:22:10 user nova-compute[71731]:   </features>
Apr 13 16:22:10 user nova-compute[71731]:   <clock offset="utc">
Apr 13 16:22:10 user nova-compute[71731]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 16:22:10 user nova-compute[71731]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 16:22:10 user nova-compute[71731]:     <timer name="hpet" present="no"/>
Apr 13 16:22:10 user nova-compute[71731]:   </clock>
Apr 13 16:22:10 user nova-compute[71731]:   <cpu mode="custom" match="exact">
Apr 13 16:22:10 user nova-compute[71731]:     <model>Nehalem</model>
Apr 13 16:22:10 user nova-compute[71731]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 16:22:10 user nova-compute[71731]:   </cpu>
Apr 13 16:22:10 user nova-compute[71731]:   <devices>
Apr 13 16:22:10 user nova-compute[71731]:     <disk type="file" device="disk">
Apr 13 16:22:10 user nova-compute[71731]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 16:22:10 user nova-compute[71731]:       <source file="/opt/stack/data/nova/instances/0e731607-fce1-4f19-9e4b-5b892e760179/disk"/>
Apr 13 16:22:10 user nova-compute[71731]:       <target dev="vda" bus="virtio"/>
Apr 13 16:22:10 user nova-compute[71731]:     </disk>
Apr 13 16:22:10 user nova-compute[71731]:     <interface type="ethernet">
Apr 13 16:22:10 user nova-compute[71731]:       <mac address="fa:16:3e:46:a8:2e"/>
Apr 13 16:22:10 user nova-compute[71731]:       <model type="virtio"/>
Apr 13 16:22:10 user nova-compute[71731]:       <mtu size="1442"/>
Apr 13 16:22:10 user nova-compute[71731]:       <target dev="tap62eabc99-73"/>
Apr 13 16:22:10 user nova-compute[71731]:     </interface>
Apr 13 16:22:10 user nova-compute[71731]:     <serial type="pty">
Apr 13 16:22:10 user nova-compute[71731]:       <log file="/opt/stack/data/nova/instances/0e731607-fce1-4f19-9e4b-5b892e760179/console.log" append="off"/>
Apr 13 16:22:10 user nova-compute[71731]:     </serial>
Apr 13 16:22:10 user nova-compute[71731]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 16:22:10 user nova-compute[71731]:     <video>
Apr 13 16:22:10 user nova-compute[71731]:       <model type="virtio"/>
Apr 13 16:22:10 user nova-compute[71731]:     </video>
Apr 13 16:22:10 user nova-compute[71731]:     <rng model="virtio">
Apr 13 16:22:10 user nova-compute[71731]:       <backend model="random">/dev/urandom</backend>
Apr 13 16:22:10 user nova-compute[71731]:     </rng>
Apr 13 16:22:10 user nova-compute[71731]:     <controller type="usb" index="0" model="none"/>
Apr 13 16:22:10 user nova-compute[71731]:     <memballoon model="virtio">
Apr 13 16:22:10 user nova-compute[71731]:       <stats period="10"/>
Apr 13 16:22:10 user nova-compute[71731]:     </memballoon>
Apr 13 16:22:10 user nova-compute[71731]:   </devices>
Apr 13 16:22:10 user nova-compute[71731]: </domain>
Apr 13 16:22:10 user nova-compute[71731]:  {{(pid=71731) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 16:22:10 user nova-compute[71731]: DEBUG nova.virt.libvirt.vif [None req-f5921e11-4030-4131-9efc-8f1f53ecae84 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T16:22:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1280800160',display_name='tempest-ServersNegativeTestJSON-server-1280800160',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1280800160',id=12,image_ref='708622a9-7465-4492-ade8-b827198f7e30',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5554aa7f1b4d471b8807a845ab1ea33f',ramdisk_id='',reservation_id='r-a6fgr3ml',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='708622a9-7465-4492-ade8-b827198f7e30',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1820659348',owner_user_name='tempest-ServersNegativeTestJSON-1820659348-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T16:22:08Z,user_data=None,user_id='4ddd547d240b43ccb213e9d459082309',uuid=0e731607-fce1-4f19-9e4b-5b892e760179,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "62eabc99-73ed-4669-a7ce-6fc646611ff1", "address": "fa:16:3e:46:a8:2e", "network": {"id": "ae7f770e-a460-4297-91b5-ed0b908a895a", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1175970469-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5554aa7f1b4d471b8807a845ab1ea33f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62eabc99-73", "ovs_interfaceid": "62eabc99-73ed-4669-a7ce-6fc646611ff1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 16:22:10 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-f5921e11-4030-4131-9efc-8f1f53ecae84 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Converting VIF {"id": "62eabc99-73ed-4669-a7ce-6fc646611ff1", "address": "fa:16:3e:46:a8:2e", "network": {"id": "ae7f770e-a460-4297-91b5-ed0b908a895a", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1175970469-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5554aa7f1b4d471b8807a845ab1ea33f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62eabc99-73", "ovs_interfaceid": "62eabc99-73ed-4669-a7ce-6fc646611ff1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 16:22:10 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-f5921e11-4030-4131-9efc-8f1f53ecae84 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:46:a8:2e,bridge_name='br-int',has_traffic_filtering=True,id=62eabc99-73ed-4669-a7ce-6fc646611ff1,network=Network(ae7f770e-a460-4297-91b5-ed0b908a895a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62eabc99-73') {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 16:22:10 user nova-compute[71731]: DEBUG os_vif [None req-f5921e11-4030-4131-9efc-8f1f53ecae84 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:a8:2e,bridge_name='br-int',has_traffic_filtering=True,id=62eabc99-73ed-4669-a7ce-6fc646611ff1,network=Network(ae7f770e-a460-4297-91b5-ed0b908a895a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62eabc99-73') {{(pid=71731) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 16:22:10 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:22:10 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:22:10 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 16:22:10 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:22:10 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap62eabc99-73, may_exist=True) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:22:10 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap62eabc99-73, col_values=(('external_ids', {'iface-id': '62eabc99-73ed-4669-a7ce-6fc646611ff1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:46:a8:2e', 'vm-uuid': '0e731607-fce1-4f19-9e4b-5b892e760179'}),)) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:22:10 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:22:10 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 16:22:10 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:22:10 user nova-compute[71731]: INFO os_vif [None req-f5921e11-4030-4131-9efc-8f1f53ecae84 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:a8:2e,bridge_name='br-int',has_traffic_filtering=True,id=62eabc99-73ed-4669-a7ce-6fc646611ff1,network=Network(ae7f770e-a460-4297-91b5-ed0b908a895a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62eabc99-73')
Apr 13 16:22:10 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-f5921e11-4030-4131-9efc-8f1f53ecae84 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] No BDM found with device name vda, not building metadata. {{(pid=71731) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 16:22:10 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-f5921e11-4030-4131-9efc-8f1f53ecae84 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] No VIF found with MAC fa:16:3e:46:a8:2e, not building metadata {{(pid=71731) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 16:22:11 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:22:11 user nova-compute[71731]: DEBUG nova.network.neutron [req-81b4c31c-17c3-4b43-9a96-8d0268142283 req-900ef3f0-0b34-4a30-bf00-44821bb99f65 service nova] [instance: 0e731607-fce1-4f19-9e4b-5b892e760179] Updated VIF entry in instance network info cache for port 62eabc99-73ed-4669-a7ce-6fc646611ff1. {{(pid=71731) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 16:22:11 user nova-compute[71731]: DEBUG nova.network.neutron [req-81b4c31c-17c3-4b43-9a96-8d0268142283 req-900ef3f0-0b34-4a30-bf00-44821bb99f65 service nova] [instance: 0e731607-fce1-4f19-9e4b-5b892e760179] Updating instance_info_cache with network_info: [{"id": "62eabc99-73ed-4669-a7ce-6fc646611ff1", "address": "fa:16:3e:46:a8:2e", "network": {"id": "ae7f770e-a460-4297-91b5-ed0b908a895a", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1175970469-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5554aa7f1b4d471b8807a845ab1ea33f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62eabc99-73", "ovs_interfaceid": "62eabc99-73ed-4669-a7ce-6fc646611ff1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:22:11 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-81b4c31c-17c3-4b43-9a96-8d0268142283 req-900ef3f0-0b34-4a30-bf00-44821bb99f65 service nova] Releasing lock "refresh_cache-0e731607-fce1-4f19-9e4b-5b892e760179" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 16:22:12 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:22:12 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:22:12 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:22:12 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:22:12 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Starting heal instance info cache {{(pid=71731) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 16:22:12 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:22:12 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:22:12 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Acquiring lock "refresh_cache-f66553f5-5e1b-4f1d-8c5a-63bc340f7586" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 16:22:12 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Acquired lock "refresh_cache-f66553f5-5e1b-4f1d-8c5a-63bc340f7586" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 16:22:12 user nova-compute[71731]: DEBUG nova.network.neutron [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] [instance: f66553f5-5e1b-4f1d-8c5a-63bc340f7586] Forcefully refreshing network info cache for instance {{(pid=71731) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 16:22:12 user nova-compute[71731]: DEBUG nova.compute.manager [req-59be973a-8e9c-4556-a22c-e4228f6bdbe0 req-768dfc16-f433-4729-80b5-f7aca232e563 service nova] [instance: 0e731607-fce1-4f19-9e4b-5b892e760179] Received event network-vif-plugged-62eabc99-73ed-4669-a7ce-6fc646611ff1 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:22:12 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-59be973a-8e9c-4556-a22c-e4228f6bdbe0 req-768dfc16-f433-4729-80b5-f7aca232e563 service nova] Acquiring lock "0e731607-fce1-4f19-9e4b-5b892e760179-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:22:12 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-59be973a-8e9c-4556-a22c-e4228f6bdbe0 req-768dfc16-f433-4729-80b5-f7aca232e563 service nova] Lock "0e731607-fce1-4f19-9e4b-5b892e760179-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:22:12 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-59be973a-8e9c-4556-a22c-e4228f6bdbe0 req-768dfc16-f433-4729-80b5-f7aca232e563 service nova] Lock "0e731607-fce1-4f19-9e4b-5b892e760179-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:22:12 user nova-compute[71731]: DEBUG nova.compute.manager [req-59be973a-8e9c-4556-a22c-e4228f6bdbe0 req-768dfc16-f433-4729-80b5-f7aca232e563 service nova] [instance: 0e731607-fce1-4f19-9e4b-5b892e760179] No waiting events found dispatching network-vif-plugged-62eabc99-73ed-4669-a7ce-6fc646611ff1 {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:22:12 user nova-compute[71731]: WARNING nova.compute.manager [req-59be973a-8e9c-4556-a22c-e4228f6bdbe0 req-768dfc16-f433-4729-80b5-f7aca232e563 service nova] [instance: 0e731607-fce1-4f19-9e4b-5b892e760179] Received unexpected event network-vif-plugged-62eabc99-73ed-4669-a7ce-6fc646611ff1 for instance with vm_state building and task_state spawning.
Apr 13 16:22:12 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-843e772f-18b8-40de-8f3a-53aaedd6c697 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: f66553f5-5e1b-4f1d-8c5a-63bc340f7586] Snapshot image upload complete
Apr 13 16:22:12 user nova-compute[71731]: INFO nova.compute.manager [None req-843e772f-18b8-40de-8f3a-53aaedd6c697 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: f66553f5-5e1b-4f1d-8c5a-63bc340f7586] Took 6.44 seconds to snapshot the instance on the hypervisor.
Apr 13 16:22:12 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:22:13 user nova-compute[71731]: DEBUG nova.network.neutron [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] [instance: f66553f5-5e1b-4f1d-8c5a-63bc340f7586] Updating instance_info_cache with network_info: [{"id": "27d05b76-8556-4365-9050-6bf871e85502", "address": "fa:16:3e:0d:13:8a", "network": {"id": "5a7877ff-8230-470b-90b5-e5dcfc8f0cee", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-779403873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2d09a74bf684a9fb1dd1e95d6c23f3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27d05b76-85", "ovs_interfaceid": "27d05b76-8556-4365-9050-6bf871e85502", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:22:13 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Releasing lock "refresh_cache-f66553f5-5e1b-4f1d-8c5a-63bc340f7586" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 16:22:13 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] [instance: f66553f5-5e1b-4f1d-8c5a-63bc340f7586] Updated the network info_cache for instance {{(pid=71731) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 16:22:13 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:22:13 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:22:13 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:22:13 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:22:13 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:22:13 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:22:13 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71731) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 16:22:13 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-a9e9309a-4a8d-4ece-ad0d-a2ad2657c5d6 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Acquiring lock "db65920b-7872-44c1-a68a-a696681d9d95" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:22:13 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-a9e9309a-4a8d-4ece-ad0d-a2ad2657c5d6 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "db65920b-7872-44c1-a68a-a696681d9d95" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:22:13 user nova-compute[71731]: DEBUG nova.compute.manager [None req-a9e9309a-4a8d-4ece-ad0d-a2ad2657c5d6 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: db65920b-7872-44c1-a68a-a696681d9d95] Starting instance... {{(pid=71731) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 16:22:13 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-a9e9309a-4a8d-4ece-ad0d-a2ad2657c5d6 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:22:13 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-a9e9309a-4a8d-4ece-ad0d-a2ad2657c5d6 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:22:13 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-a9e9309a-4a8d-4ece-ad0d-a2ad2657c5d6 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71731) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 16:22:13 user nova-compute[71731]: INFO nova.compute.claims [None req-a9e9309a-4a8d-4ece-ad0d-a2ad2657c5d6 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: db65920b-7872-44c1-a68a-a696681d9d95] Claim successful on node user
Apr 13 16:22:14 user nova-compute[71731]: DEBUG nova.compute.provider_tree [None req-a9e9309a-4a8d-4ece-ad0d-a2ad2657c5d6 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Inventory has not changed in ProviderTree for provider: cb6b1a64-0c24-4e2d-af1e-16576ca9165c {{(pid=71731) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 16:22:14 user nova-compute[71731]: DEBUG nova.scheduler.client.report [None req-a9e9309a-4a8d-4ece-ad0d-a2ad2657c5d6 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Inventory has not changed for provider cb6b1a64-0c24-4e2d-af1e-16576ca9165c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71731) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 16:22:14 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-a9e9309a-4a8d-4ece-ad0d-a2ad2657c5d6 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.521s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:22:14 user nova-compute[71731]: DEBUG nova.compute.manager [None req-a9e9309a-4a8d-4ece-ad0d-a2ad2657c5d6 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: db65920b-7872-44c1-a68a-a696681d9d95] Start building networks asynchronously for instance. {{(pid=71731) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 16:22:14 user nova-compute[71731]: DEBUG nova.compute.manager [None req-a9e9309a-4a8d-4ece-ad0d-a2ad2657c5d6 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: db65920b-7872-44c1-a68a-a696681d9d95] Allocating IP information in the background. {{(pid=71731) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 16:22:14 user nova-compute[71731]: DEBUG nova.network.neutron [None req-a9e9309a-4a8d-4ece-ad0d-a2ad2657c5d6 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: db65920b-7872-44c1-a68a-a696681d9d95] allocate_for_instance() {{(pid=71731) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 16:22:14 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-a9e9309a-4a8d-4ece-ad0d-a2ad2657c5d6 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: db65920b-7872-44c1-a68a-a696681d9d95] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 16:22:14 user nova-compute[71731]: DEBUG nova.compute.manager [None req-a9e9309a-4a8d-4ece-ad0d-a2ad2657c5d6 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: db65920b-7872-44c1-a68a-a696681d9d95] Start building block device mappings for instance. {{(pid=71731) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 16:22:14 user nova-compute[71731]: INFO nova.virt.block_device [None req-a9e9309a-4a8d-4ece-ad0d-a2ad2657c5d6 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: db65920b-7872-44c1-a68a-a696681d9d95] Booting with volume snapshot ba3ff5e1-f4df-4fb9-a662-f485cc0949e6 at /dev/vda
Apr 13 16:22:14 user nova-compute[71731]: DEBUG nova.policy [None req-a9e9309a-4a8d-4ece-ad0d-a2ad2657c5d6 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd70e10f63cdd49a9a1ebe1fe4c9de0a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d451e0e239f486aa2b3abe9e273eab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71731) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 16:22:14 user nova-compute[71731]: DEBUG nova.compute.manager [req-5f40c581-2a66-4bc7-abd0-26377ab78104 req-a5ab1357-6800-490f-96cb-e9c164678881 service nova] [instance: 0e731607-fce1-4f19-9e4b-5b892e760179] Received event network-vif-plugged-62eabc99-73ed-4669-a7ce-6fc646611ff1 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:22:14 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-5f40c581-2a66-4bc7-abd0-26377ab78104 req-a5ab1357-6800-490f-96cb-e9c164678881 service nova] Acquiring lock "0e731607-fce1-4f19-9e4b-5b892e760179-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:22:14 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-5f40c581-2a66-4bc7-abd0-26377ab78104 req-a5ab1357-6800-490f-96cb-e9c164678881 service nova] Lock "0e731607-fce1-4f19-9e4b-5b892e760179-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:22:14 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-5f40c581-2a66-4bc7-abd0-26377ab78104 req-a5ab1357-6800-490f-96cb-e9c164678881 service nova] Lock "0e731607-fce1-4f19-9e4b-5b892e760179-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:22:14 user nova-compute[71731]: DEBUG nova.compute.manager [req-5f40c581-2a66-4bc7-abd0-26377ab78104 req-a5ab1357-6800-490f-96cb-e9c164678881 service nova] [instance: 0e731607-fce1-4f19-9e4b-5b892e760179] No waiting events found dispatching network-vif-plugged-62eabc99-73ed-4669-a7ce-6fc646611ff1 {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:22:14 user nova-compute[71731]: WARNING nova.compute.manager [req-5f40c581-2a66-4bc7-abd0-26377ab78104 req-a5ab1357-6800-490f-96cb-e9c164678881 service nova] [instance: 0e731607-fce1-4f19-9e4b-5b892e760179] Received unexpected event network-vif-plugged-62eabc99-73ed-4669-a7ce-6fc646611ff1 for instance with vm_state building and task_state spawning.
Apr 13 16:22:14 user nova-compute[71731]: DEBUG nova.virt.driver [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Emitting event <LifecycleEvent: 1681402934.7116528, 0e731607-fce1-4f19-9e4b-5b892e760179 => Resumed> {{(pid=71731) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 16:22:14 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 0e731607-fce1-4f19-9e4b-5b892e760179] VM Resumed (Lifecycle Event)
Apr 13 16:22:14 user nova-compute[71731]: DEBUG nova.compute.manager [None req-f5921e11-4030-4131-9efc-8f1f53ecae84 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] [instance: 0e731607-fce1-4f19-9e4b-5b892e760179] Instance event wait completed in 0 seconds for  {{(pid=71731) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 16:22:14 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-f5921e11-4030-4131-9efc-8f1f53ecae84 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] [instance: 0e731607-fce1-4f19-9e4b-5b892e760179] Guest created on hypervisor {{(pid=71731) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 16:22:14 user nova-compute[71731]: INFO nova.virt.libvirt.driver [-] [instance: 0e731607-fce1-4f19-9e4b-5b892e760179] Instance spawned successfully.
Apr 13 16:22:14 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-f5921e11-4030-4131-9efc-8f1f53ecae84 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] [instance: 0e731607-fce1-4f19-9e4b-5b892e760179] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 16:22:14 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 0e731607-fce1-4f19-9e4b-5b892e760179] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:22:14 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 0e731607-fce1-4f19-9e4b-5b892e760179] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71731) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 16:22:14 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-f5921e11-4030-4131-9efc-8f1f53ecae84 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] [instance: 0e731607-fce1-4f19-9e4b-5b892e760179] Found default for hw_cdrom_bus of ide {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:22:14 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-f5921e11-4030-4131-9efc-8f1f53ecae84 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] [instance: 0e731607-fce1-4f19-9e4b-5b892e760179] Found default for hw_disk_bus of virtio {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:22:14 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-f5921e11-4030-4131-9efc-8f1f53ecae84 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] [instance: 0e731607-fce1-4f19-9e4b-5b892e760179] Found default for hw_input_bus of None {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:22:14 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-f5921e11-4030-4131-9efc-8f1f53ecae84 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] [instance: 0e731607-fce1-4f19-9e4b-5b892e760179] Found default for hw_pointer_model of None {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:22:14 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-f5921e11-4030-4131-9efc-8f1f53ecae84 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] [instance: 0e731607-fce1-4f19-9e4b-5b892e760179] Found default for hw_video_model of virtio {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:22:14 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-f5921e11-4030-4131-9efc-8f1f53ecae84 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] [instance: 0e731607-fce1-4f19-9e4b-5b892e760179] Found default for hw_vif_model of virtio {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:22:14 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 0e731607-fce1-4f19-9e4b-5b892e760179] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 16:22:14 user nova-compute[71731]: DEBUG nova.virt.driver [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Emitting event <LifecycleEvent: 1681402934.7184882, 0e731607-fce1-4f19-9e4b-5b892e760179 => Started> {{(pid=71731) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 16:22:14 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 0e731607-fce1-4f19-9e4b-5b892e760179] VM Started (Lifecycle Event)
Apr 13 16:22:14 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 0e731607-fce1-4f19-9e4b-5b892e760179] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:22:14 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 0e731607-fce1-4f19-9e4b-5b892e760179] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71731) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 16:22:14 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 0e731607-fce1-4f19-9e4b-5b892e760179] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 16:22:14 user nova-compute[71731]: INFO nova.compute.manager [None req-f5921e11-4030-4131-9efc-8f1f53ecae84 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] [instance: 0e731607-fce1-4f19-9e4b-5b892e760179] Took 6.74 seconds to spawn the instance on the hypervisor.
Apr 13 16:22:14 user nova-compute[71731]: DEBUG nova.compute.manager [None req-f5921e11-4030-4131-9efc-8f1f53ecae84 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] [instance: 0e731607-fce1-4f19-9e4b-5b892e760179] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:22:14 user nova-compute[71731]: INFO nova.compute.manager [None req-f5921e11-4030-4131-9efc-8f1f53ecae84 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] [instance: 0e731607-fce1-4f19-9e4b-5b892e760179] Took 8.63 seconds to build instance.
Apr 13 16:22:15 user nova-compute[71731]: DEBUG nova.network.neutron [None req-a9e9309a-4a8d-4ece-ad0d-a2ad2657c5d6 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: db65920b-7872-44c1-a68a-a696681d9d95] Successfully created port: ba686724-ae8a-4e16-9918-d7b2fc64ff62 {{(pid=71731) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 16:22:15 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-f5921e11-4030-4131-9efc-8f1f53ecae84 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Lock "0e731607-fce1-4f19-9e4b-5b892e760179" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.772s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:22:15 user nova-compute[71731]: DEBUG nova.network.neutron [None req-a9e9309a-4a8d-4ece-ad0d-a2ad2657c5d6 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: db65920b-7872-44c1-a68a-a696681d9d95] Successfully updated port: ba686724-ae8a-4e16-9918-d7b2fc64ff62 {{(pid=71731) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 16:22:15 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-a9e9309a-4a8d-4ece-ad0d-a2ad2657c5d6 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Acquiring lock "refresh_cache-db65920b-7872-44c1-a68a-a696681d9d95" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 16:22:15 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-a9e9309a-4a8d-4ece-ad0d-a2ad2657c5d6 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Acquired lock "refresh_cache-db65920b-7872-44c1-a68a-a696681d9d95" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 16:22:15 user nova-compute[71731]: DEBUG nova.network.neutron [None req-a9e9309a-4a8d-4ece-ad0d-a2ad2657c5d6 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: db65920b-7872-44c1-a68a-a696681d9d95] Building network info cache for instance {{(pid=71731) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 16:22:15 user nova-compute[71731]: DEBUG nova.compute.manager [req-1e1c0815-e8ed-4b93-8798-53757435d424 req-107b206a-81bc-4a59-9205-3edeb7ae9a41 service nova] [instance: db65920b-7872-44c1-a68a-a696681d9d95] Received event network-changed-ba686724-ae8a-4e16-9918-d7b2fc64ff62 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:22:15 user nova-compute[71731]: DEBUG nova.compute.manager [req-1e1c0815-e8ed-4b93-8798-53757435d424 req-107b206a-81bc-4a59-9205-3edeb7ae9a41 service nova] [instance: db65920b-7872-44c1-a68a-a696681d9d95] Refreshing instance network info cache due to event network-changed-ba686724-ae8a-4e16-9918-d7b2fc64ff62. {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 16:22:15 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-1e1c0815-e8ed-4b93-8798-53757435d424 req-107b206a-81bc-4a59-9205-3edeb7ae9a41 service nova] Acquiring lock "refresh_cache-db65920b-7872-44c1-a68a-a696681d9d95" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 16:22:15 user nova-compute[71731]: DEBUG nova.network.neutron [None req-a9e9309a-4a8d-4ece-ad0d-a2ad2657c5d6 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: db65920b-7872-44c1-a68a-a696681d9d95] Instance cache missing network info. {{(pid=71731) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 16:22:15 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:22:16 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:22:16 user nova-compute[71731]: DEBUG nova.network.neutron [None req-a9e9309a-4a8d-4ece-ad0d-a2ad2657c5d6 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: db65920b-7872-44c1-a68a-a696681d9d95] Updating instance_info_cache with network_info: [{"id": "ba686724-ae8a-4e16-9918-d7b2fc64ff62", "address": "fa:16:3e:87:f9:e7", "network": {"id": "d36bc206-f629-4d6e-8a3f-458061d7b525", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-893271134-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d451e0e239f486aa2b3abe9e273eab3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba686724-ae", "ovs_interfaceid": "ba686724-ae8a-4e16-9918-d7b2fc64ff62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:22:16 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-a9e9309a-4a8d-4ece-ad0d-a2ad2657c5d6 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Releasing lock "refresh_cache-db65920b-7872-44c1-a68a-a696681d9d95" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 16:22:16 user nova-compute[71731]: DEBUG nova.compute.manager [None req-a9e9309a-4a8d-4ece-ad0d-a2ad2657c5d6 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: db65920b-7872-44c1-a68a-a696681d9d95] Instance network_info: |[{"id": "ba686724-ae8a-4e16-9918-d7b2fc64ff62", "address": "fa:16:3e:87:f9:e7", "network": {"id": "d36bc206-f629-4d6e-8a3f-458061d7b525", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-893271134-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d451e0e239f486aa2b3abe9e273eab3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba686724-ae", "ovs_interfaceid": "ba686724-ae8a-4e16-9918-d7b2fc64ff62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71731) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 16:22:16 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-1e1c0815-e8ed-4b93-8798-53757435d424 req-107b206a-81bc-4a59-9205-3edeb7ae9a41 service nova] Acquired lock "refresh_cache-db65920b-7872-44c1-a68a-a696681d9d95" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 16:22:16 user nova-compute[71731]: DEBUG nova.network.neutron [req-1e1c0815-e8ed-4b93-8798-53757435d424 req-107b206a-81bc-4a59-9205-3edeb7ae9a41 service nova] [instance: db65920b-7872-44c1-a68a-a696681d9d95] Refreshing network info cache for port ba686724-ae8a-4e16-9918-d7b2fc64ff62 {{(pid=71731) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 16:22:16 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-8ec9283e-3674-4995-833a-40927141b14d tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] Acquiring lock "823749e1-56ca-44f9-be83-a36b4851c28f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:22:16 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-8ec9283e-3674-4995-833a-40927141b14d tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] Lock "823749e1-56ca-44f9-be83-a36b4851c28f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:22:16 user nova-compute[71731]: DEBUG nova.objects.instance [None req-8ec9283e-3674-4995-833a-40927141b14d tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] Lazy-loading 'flavor' on Instance uuid 823749e1-56ca-44f9-be83-a36b4851c28f {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:22:16 user nova-compute[71731]: DEBUG nova.network.neutron [req-1e1c0815-e8ed-4b93-8798-53757435d424 req-107b206a-81bc-4a59-9205-3edeb7ae9a41 service nova] [instance: db65920b-7872-44c1-a68a-a696681d9d95] Updated VIF entry in instance network info cache for port ba686724-ae8a-4e16-9918-d7b2fc64ff62. {{(pid=71731) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 16:22:16 user nova-compute[71731]: DEBUG nova.network.neutron [req-1e1c0815-e8ed-4b93-8798-53757435d424 req-107b206a-81bc-4a59-9205-3edeb7ae9a41 service nova] [instance: db65920b-7872-44c1-a68a-a696681d9d95] Updating instance_info_cache with network_info: [{"id": "ba686724-ae8a-4e16-9918-d7b2fc64ff62", "address": "fa:16:3e:87:f9:e7", "network": {"id": "d36bc206-f629-4d6e-8a3f-458061d7b525", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-893271134-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d451e0e239f486aa2b3abe9e273eab3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba686724-ae", "ovs_interfaceid": "ba686724-ae8a-4e16-9918-d7b2fc64ff62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:22:16 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-1e1c0815-e8ed-4b93-8798-53757435d424 req-107b206a-81bc-4a59-9205-3edeb7ae9a41 service nova] Releasing lock "refresh_cache-db65920b-7872-44c1-a68a-a696681d9d95" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 16:22:16 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-8ec9283e-3674-4995-833a-40927141b14d tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] Lock "823749e1-56ca-44f9-be83-a36b4851c28f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.094s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:22:17 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-8ec9283e-3674-4995-833a-40927141b14d tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] Acquiring lock "823749e1-56ca-44f9-be83-a36b4851c28f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:22:17 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-8ec9283e-3674-4995-833a-40927141b14d tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] Lock "823749e1-56ca-44f9-be83-a36b4851c28f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:22:17 user nova-compute[71731]: INFO nova.compute.manager [None req-8ec9283e-3674-4995-833a-40927141b14d tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] [instance: 823749e1-56ca-44f9-be83-a36b4851c28f] Attaching volume 91d1caca-70d0-452f-800d-0073afd5d0c4 to /dev/vdb
Apr 13 16:22:17 user nova-compute[71731]: DEBUG os_brick.utils [None req-8ec9283e-3674-4995-833a-40927141b14d tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 16:22:17 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:22:17 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:22:17 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[65419f21-eab0-406d-8652-87f61ffb0bd8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:81501d91421\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:22:17 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:22:17 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:22:17 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[22bc3f86-4457-46f3-b6cd-c9ce5aee22dd]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:22:17 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:22:17 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:22:17 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e55ed92-fbb9-4bf5-b090-24c414729879]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:22:17 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[300bdb76-907a-4ee0-8c5f-1bec9424ba93]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:22:17 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-8ec9283e-3674-4995-833a-40927141b14d tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] Running cmd (subprocess): nvme version {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:22:17 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-8ec9283e-3674-4995-833a-40927141b14d tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] 'nvme version' failed. Not Retrying. {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 16:22:17 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8ec9283e-3674-4995-833a-40927141b14d tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] nvme not present on system {{(pid=71731) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 16:22:17 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:22:17 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 16:22:17 user nova-compute[71731]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 16:22:17 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[235d90d3-0f2b-47b0-939f-52a74b94537d]: (4, '') {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:22:17 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.lightos [None req-8ec9283e-3674-4995-833a-40927141b14d tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71731) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 16:22:17 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.lightos [None req-8ec9283e-3674-4995-833a-40927141b14d tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71731) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 16:22:17 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.lightos [None req-8ec9283e-3674-4995-833a-40927141b14d tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] LIGHTOS: no hostnqn found. {{(pid=71731) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 16:22:17 user nova-compute[71731]: DEBUG os_brick.utils [None req-8ec9283e-3674-4995-833a-40927141b14d tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:81501d91421', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 16:22:17 user nova-compute[71731]: DEBUG nova.virt.block_device [None req-8ec9283e-3674-4995-833a-40927141b14d tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] [instance: 823749e1-56ca-44f9-be83-a36b4851c28f] Updating existing volume attachment record: 7de825bd-54a8-4c09-8211-04e5a654ea0e {{(pid=71731) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 16:22:19 user nova-compute[71731]: DEBUG nova.compute.manager [req-03e62715-3d97-4c5b-835a-423ed6a17004 req-4dd4b52f-cf04-48b6-8a26-59b304870cec service nova] [instance: bbcccf4b-e861-4254-9be3-a491776214e9] Received event network-changed-dbb2bf27-5de3-499c-ba4d-87867912a143 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:22:19 user nova-compute[71731]: DEBUG nova.compute.manager [req-03e62715-3d97-4c5b-835a-423ed6a17004 req-4dd4b52f-cf04-48b6-8a26-59b304870cec service nova] [instance: bbcccf4b-e861-4254-9be3-a491776214e9] Refreshing instance network info cache due to event network-changed-dbb2bf27-5de3-499c-ba4d-87867912a143. {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 16:22:19 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-03e62715-3d97-4c5b-835a-423ed6a17004 req-4dd4b52f-cf04-48b6-8a26-59b304870cec service nova] Acquiring lock "refresh_cache-bbcccf4b-e861-4254-9be3-a491776214e9" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 16:22:19 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-03e62715-3d97-4c5b-835a-423ed6a17004 req-4dd4b52f-cf04-48b6-8a26-59b304870cec service nova] Acquired lock "refresh_cache-bbcccf4b-e861-4254-9be3-a491776214e9" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 16:22:19 user nova-compute[71731]: DEBUG nova.network.neutron [req-03e62715-3d97-4c5b-835a-423ed6a17004 req-4dd4b52f-cf04-48b6-8a26-59b304870cec service nova] [instance: bbcccf4b-e861-4254-9be3-a491776214e9] Refreshing network info cache for port dbb2bf27-5de3-499c-ba4d-87867912a143 {{(pid=71731) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 16:22:19 user nova-compute[71731]: DEBUG os_brick.utils [None req-a9e9309a-4a8d-4ece-ad0d-a2ad2657c5d6 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 16:22:20 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:22:20 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:22:20 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[69a27b2f-4380-4c9d-ad47-281913d9f09b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:81501d91421\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:22:20 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:22:20 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:22:20 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd636a39-d0e5-4dea-8532-daca5e15edb1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:22:20 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:22:20 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.024s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:22:20 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[dee1b718-b327-4c1c-8796-aa4460781fd6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:22:20 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[c422c689-9592-47c7-b028-0ad3694913b1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:22:20 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-a9e9309a-4a8d-4ece-ad0d-a2ad2657c5d6 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Running cmd (subprocess): nvme version {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:22:20 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-a9e9309a-4a8d-4ece-ad0d-a2ad2657c5d6 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] 'nvme version' failed. Not Retrying. {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 16:22:20 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a9e9309a-4a8d-4ece-ad0d-a2ad2657c5d6 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] nvme not present on system {{(pid=71731) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 16:22:20 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:22:20 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 16:22:20 user nova-compute[71731]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 16:22:20 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1e05fb0-07b7-4d47-bb1c-1e8541c3f3a3]: (4, '') {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:22:20 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.lightos [None req-a9e9309a-4a8d-4ece-ad0d-a2ad2657c5d6 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71731) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 16:22:20 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.lightos [None req-a9e9309a-4a8d-4ece-ad0d-a2ad2657c5d6 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71731) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 16:22:20 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.lightos [None req-a9e9309a-4a8d-4ece-ad0d-a2ad2657c5d6 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] LIGHTOS: no hostnqn found. {{(pid=71731) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 16:22:20 user nova-compute[71731]: DEBUG os_brick.utils [None req-a9e9309a-4a8d-4ece-ad0d-a2ad2657c5d6 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] <== get_connector_properties: return (156ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:81501d91421', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 16:22:20 user nova-compute[71731]: DEBUG nova.virt.block_device [None req-a9e9309a-4a8d-4ece-ad0d-a2ad2657c5d6 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: db65920b-7872-44c1-a68a-a696681d9d95] Updating existing volume attachment record: 45492859-b19e-43e7-bc03-8c61dcef043e {{(pid=71731) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 16:22:20 user nova-compute[71731]: DEBUG nova.network.neutron [req-03e62715-3d97-4c5b-835a-423ed6a17004 req-4dd4b52f-cf04-48b6-8a26-59b304870cec service nova] [instance: bbcccf4b-e861-4254-9be3-a491776214e9] Updated VIF entry in instance network info cache for port dbb2bf27-5de3-499c-ba4d-87867912a143. {{(pid=71731) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 16:22:20 user nova-compute[71731]: DEBUG nova.network.neutron [req-03e62715-3d97-4c5b-835a-423ed6a17004 req-4dd4b52f-cf04-48b6-8a26-59b304870cec service nova] [instance: bbcccf4b-e861-4254-9be3-a491776214e9] Updating instance_info_cache with network_info: [{"id": "dbb2bf27-5de3-499c-ba4d-87867912a143", "address": "fa:16:3e:a3:40:f4", "network": {"id": "5a4fe0b3-5f2f-4125-a17d-e2ff424bf01a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1835633180-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.81", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7061f2f041954ffe90b0c87b422890e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbb2bf27-5d", "ovs_interfaceid": "dbb2bf27-5de3-499c-ba4d-87867912a143", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:22:20 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-03e62715-3d97-4c5b-835a-423ed6a17004 req-4dd4b52f-cf04-48b6-8a26-59b304870cec service nova] Releasing lock "refresh_cache-bbcccf4b-e861-4254-9be3-a491776214e9" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 16:22:20 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:22:20 user nova-compute[71731]: DEBUG nova.compute.manager [None req-3a0f5dbf-e6a1-4d30-9eab-6cfd8107b17f tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] [instance: bbcccf4b-e861-4254-9be3-a491776214e9] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:22:21 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:22:21 user nova-compute[71731]: INFO nova.compute.manager [None req-3a0f5dbf-e6a1-4d30-9eab-6cfd8107b17f tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] [instance: bbcccf4b-e861-4254-9be3-a491776214e9] instance snapshotting
Apr 13 16:22:21 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-3a0f5dbf-e6a1-4d30-9eab-6cfd8107b17f tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] [instance: bbcccf4b-e861-4254-9be3-a491776214e9] Beginning live snapshot process
Apr 13 16:22:21 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-3a0f5dbf-e6a1-4d30-9eab-6cfd8107b17f tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbcccf4b-e861-4254-9be3-a491776214e9/disk --force-share --output=json -f qcow2 {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:22:21 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-3a0f5dbf-e6a1-4d30-9eab-6cfd8107b17f tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbcccf4b-e861-4254-9be3-a491776214e9/disk --force-share --output=json -f qcow2" returned: 0 in 0.146s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:22:21 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-3a0f5dbf-e6a1-4d30-9eab-6cfd8107b17f tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbcccf4b-e861-4254-9be3-a491776214e9/disk --force-share --output=json -f qcow2 {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:22:21 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-3a0f5dbf-e6a1-4d30-9eab-6cfd8107b17f tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbcccf4b-e861-4254-9be3-a491776214e9/disk --force-share --output=json -f qcow2" returned: 0 in 0.151s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:22:21 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-3a0f5dbf-e6a1-4d30-9eab-6cfd8107b17f tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279 --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:22:21 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-3a0f5dbf-e6a1-4d30-9eab-6cfd8107b17f tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279 --force-share --output=json" returned: 0 in 0.150s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:22:21 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-3a0f5dbf-e6a1-4d30-9eab-6cfd8107b17f tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpbjjur2i4/e9dbf7c3f7c44ba68ddcf7ddfe93255e.delta 1073741824 {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:22:21 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-3a0f5dbf-e6a1-4d30-9eab-6cfd8107b17f tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpbjjur2i4/e9dbf7c3f7c44ba68ddcf7ddfe93255e.delta 1073741824" returned: 0 in 0.055s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:22:21 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-3a0f5dbf-e6a1-4d30-9eab-6cfd8107b17f tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] [instance: bbcccf4b-e861-4254-9be3-a491776214e9] Quiescing instance not available: QEMU guest agent is not enabled.
Apr 13 16:22:22 user nova-compute[71731]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8ec9283e-3674-4995-833a-40927141b14d tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] [instance: 823749e1-56ca-44f9-be83-a36b4851c28f] Calling os-brick to attach iSCSI Volume {{(pid=71731) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 16:22:22 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ec9283e-3674-4995-833a-40927141b14d tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8cf0118790>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:91d1caca-70d0-452f-800d-0073afd5d0c4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pBvPhfqI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 16:22:22 user nova-compute[71731]: WARNING os_brick.initiator.connectors.base [None req-8ec9283e-3674-4995-833a-40927141b14d tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 16:22:22 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-8ec9283e-3674-4995-833a-40927141b14d tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 16:22:22 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-8ec9283e-3674-4995-833a-40927141b14d tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 16:22:22 user nova-compute[71731]: WARNING os_brick.initiator.connectors.base [None req-8ec9283e-3674-4995-833a-40927141b14d tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 16:22:22 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-8ec9283e-3674-4995-833a-40927141b14d tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:91d1caca-70d0-452f-800d-0073afd5d0c4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 16:22:22 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-8ec9283e-3674-4995-833a-40927141b14d tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:91d1caca-70d0-452f-800d-0073afd5d0c4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 16:22:22 user nova-compute[71731]: INFO os_brick.initiator.connectors.iscsi [None req-8ec9283e-3674-4995-833a-40927141b14d tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 16:22:22 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91d1caca-70d0-452f-800d-0073afd5d0c4 -p 172.16.0.220:3260 {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:22:22 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91d1caca-70d0-452f-800d-0073afd5d0c4 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:22:22 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ff64bb5-2c4d-441a-a991-97253fe11174]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:22:22 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ec9283e-3674-4995-833a-40927141b14d tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 16:22:22 user nova-compute[71731]:  {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:22:22 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91d1caca-70d0-452f-800d-0073afd5d0c4 -p 172.16.0.220:3260 --interface default --op new {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:22:22 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91d1caca-70d0-452f-800d-0073afd5d0c4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:22:22 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[3000249b-462c-4b30-a4f9-891f2d6b22d2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:91d1caca-70d0-452f-800d-0073afd5d0c4] added\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:22:22 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ec9283e-3674-4995-833a-40927141b14d tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:91d1caca-70d0-452f-800d-0073afd5d0c4] added
Apr 13 16:22:22 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:22:22 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91d1caca-70d0-452f-800d-0073afd5d0c4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:22:22 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91d1caca-70d0-452f-800d-0073afd5d0c4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:22:22 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[4edd9355-d920-4d0d-aa42-563903b7b952]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:22:22 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ec9283e-3674-4995-833a-40927141b14d tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:22:22 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91d1caca-70d0-452f-800d-0073afd5d0c4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:22:22 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91d1caca-70d0-452f-800d-0073afd5d0c4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:22:22 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6b7ccc2-9014-4a2e-bd9e-3dfcf874982e]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:22:22 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ec9283e-3674-4995-833a-40927141b14d tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:22:22 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91d1caca-70d0-452f-800d-0073afd5d0c4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pBvPhfqI {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:22:22 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91d1caca-70d0-452f-800d-0073afd5d0c4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pBvPhfqI" returned: 0 in 0.024s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:22:22 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[830025b5-1b8b-491e-972f-bb6d04948413]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:22:22 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ec9283e-3674-4995-833a-40927141b14d tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pBvPhfqI'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:22:22 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91d1caca-70d0-452f-800d-0073afd5d0c4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:22:22 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91d1caca-70d0-452f-800d-0073afd5d0c4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:22:22 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[967d0d15-79db-48e2-ba27-6452fa595c8d]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:22:22 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ec9283e-3674-4995-833a-40927141b14d tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:22:22 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:22:22 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:22:22 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[9896eefe-c110-4b08-a9a5-5660ec465278]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c7f6ad-d2c2-465a-b39e-47347aa85be0 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48af37b0-6938-432e-b374-d992c4dd9ae9 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c20e80fa-58de-431a-8901-2535657aaadf (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27919afc-8990-4ed5-af9e-9d6b3d7b231e (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc639d00-ef6b-4121-bcb0-c65ec0347abd (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0f728f3-fbb5-4ed8-a78b-a5d982b03f7d (non-flash)\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:22:22 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ec9283e-3674-4995-833a-40927141b14d tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984 (non-flash)
Apr 13 16:22:22 user nova-compute[71731]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c7f6ad-d2c2-465a-b39e-47347aa85be0 (non-flash)
Apr 13 16:22:22 user nova-compute[71731]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48af37b0-6938-432e-b374-d992c4dd9ae9 (non-flash)
Apr 13 16:22:22 user nova-compute[71731]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c20e80fa-58de-431a-8901-2535657aaadf (non-flash)
Apr 13 16:22:22 user nova-compute[71731]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27919afc-8990-4ed5-af9e-9d6b3d7b231e (non-flash)
Apr 13 16:22:22 user nova-compute[71731]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc639d00-ef6b-4121-bcb0-c65ec0347abd (non-flash)
Apr 13 16:22:22 user nova-compute[71731]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0f728f3-fbb5-4ed8-a78b-a5d982b03f7d (non-flash)
Apr 13 16:22:22 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 16:22:22 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ec9283e-3674-4995-833a-40927141b14d tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984 (non-flash)
Apr 13 16:22:22 user nova-compute[71731]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c7f6ad-d2c2-465a-b39e-47347aa85be0 (non-flash)
Apr 13 16:22:22 user nova-compute[71731]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48af37b0-6938-432e-b374-d992c4dd9ae9 (non-flash)
Apr 13 16:22:22 user nova-compute[71731]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c20e80fa-58de-431a-8901-2535657aaadf (non-flash)
Apr 13 16:22:22 user nova-compute[71731]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27919afc-8990-4ed5-af9e-9d6b3d7b231e (non-flash)
Apr 13 16:22:22 user nova-compute[71731]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc639d00-ef6b-4121-bcb0-c65ec0347abd (non-flash)
Apr 13 16:22:22 user nova-compute[71731]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0f728f3-fbb5-4ed8-a78b-a5d982b03f7d (non-flash)
Apr 13 16:22:22 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 16:22:22 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91d1caca-70d0-452f-800d-0073afd5d0c4 -p 172.16.0.220:3260 --login {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:22:22 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91d1caca-70d0-452f-800d-0073afd5d0c4 -p 172.16.0.220:3260 --login" returned: 0 in 0.091s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:22:22 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[28933737-689f-49e6-8025-ecb46c3273d5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:91d1caca-70d0-452f-800d-0073afd5d0c4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:91d1caca-70d0-452f-800d-0073afd5d0c4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:22:22 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ec9283e-3674-4995-833a-40927141b14d tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:91d1caca-70d0-452f-800d-0073afd5d0c4, portal: 172.16.0.220,3260]
Apr 13 16:22:22 user nova-compute[71731]: Login to [iface: default, target: iqn.2010-10.org.openstack:91d1caca-70d0-452f-800d-0073afd5d0c4, portal: 172.16.0.220,3260] successful.
Apr 13 16:22:22 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:22:22 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91d1caca-70d0-452f-800d-0073afd5d0c4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:22:22 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91d1caca-70d0-452f-800d-0073afd5d0c4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:22:22 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b371685-933b-4c30-bc66-571e285b96a3]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:22:22 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ec9283e-3674-4995-833a-40927141b14d tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:22:22 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:22:22 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:22:22 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cce8624-3c07-449a-90d2-9aaabfc2bb83]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c7f6ad-d2c2-465a-b39e-47347aa85be0 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48af37b0-6938-432e-b374-d992c4dd9ae9 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c20e80fa-58de-431a-8901-2535657aaadf (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27919afc-8990-4ed5-af9e-9d6b3d7b231e (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc639d00-ef6b-4121-bcb0-c65ec0347abd (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0f728f3-fbb5-4ed8-a78b-a5d982b03f7d (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91d1caca-70d0-452f-800d-0073afd5d0c4 (non-flash)\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:22:22 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ec9283e-3674-4995-833a-40927141b14d tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984 (non-flash)
Apr 13 16:22:22 user nova-compute[71731]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c7f6ad-d2c2-465a-b39e-47347aa85be0 (non-flash)
Apr 13 16:22:22 user nova-compute[71731]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48af37b0-6938-432e-b374-d992c4dd9ae9 (non-flash)
Apr 13 16:22:22 user nova-compute[71731]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c20e80fa-58de-431a-8901-2535657aaadf (non-flash)
Apr 13 16:22:22 user nova-compute[71731]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27919afc-8990-4ed5-af9e-9d6b3d7b231e (non-flash)
Apr 13 16:22:22 user nova-compute[71731]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc639d00-ef6b-4121-bcb0-c65ec0347abd (non-flash)
Apr 13 16:22:22 user nova-compute[71731]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0f728f3-fbb5-4ed8-a78b-a5d982b03f7d (non-flash)
Apr 13 16:22:22 user nova-compute[71731]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91d1caca-70d0-452f-800d-0073afd5d0c4 (non-flash)
Apr 13 16:22:22 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 16:22:22 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ec9283e-3674-4995-833a-40927141b14d tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984 (non-flash)
Apr 13 16:22:22 user nova-compute[71731]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c7f6ad-d2c2-465a-b39e-47347aa85be0 (non-flash)
Apr 13 16:22:22 user nova-compute[71731]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48af37b0-6938-432e-b374-d992c4dd9ae9 (non-flash)
Apr 13 16:22:22 user nova-compute[71731]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c20e80fa-58de-431a-8901-2535657aaadf (non-flash)
Apr 13 16:22:22 user nova-compute[71731]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27919afc-8990-4ed5-af9e-9d6b3d7b231e (non-flash)
Apr 13 16:22:22 user nova-compute[71731]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc639d00-ef6b-4121-bcb0-c65ec0347abd (non-flash)
Apr 13 16:22:22 user nova-compute[71731]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0f728f3-fbb5-4ed8-a78b-a5d982b03f7d (non-flash)
Apr 13 16:22:22 user nova-compute[71731]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91d1caca-70d0-452f-800d-0073afd5d0c4 (non-flash)
Apr 13 16:22:22 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 16:22:22 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-8ec9283e-3674-4995-833a-40927141b14d tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:91d1caca-70d0-452f-800d-0073afd5d0c4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.338s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 16:22:22 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ec9283e-3674-4995-833a-40927141b14d tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] Connected to 172.16.0.220:3260 {{(pid=71731) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 16:22:22 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-8ec9283e-3674-4995-833a-40927141b14d tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] HCTL ('40', '-', '-', 0) found on session 9 with lun 0 {{(pid=71731) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 16:22:22 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-8ec9283e-3674-4995-833a-40927141b14d tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=71731) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 16:22:22 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:22:22 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.016s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:22:22 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fe7b929-9420-41b3-bb6b-1d5b97cc62cf]: (4, ('- - 0', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:22:22 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-8ec9283e-3674-4995-833a-40927141b14d tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] Searching for a device in session 9 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=71731) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 16:22:22 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ec9283e-3674-4995-833a-40927141b14d tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:91d1caca-70d0-452f-800d-0073afd5d0c4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pBvPhfqI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71731) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 16:22:22 user nova-compute[71731]: DEBUG nova.virt.libvirt.guest [None req-3a0f5dbf-e6a1-4d30-9eab-6cfd8107b17f tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] COPY block job progress, current cursor: 0 final cursor: 43778048 {{(pid=71731) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 13 16:22:23 user nova-compute[71731]: DEBUG nova.virt.libvirt.guest [None req-3a0f5dbf-e6a1-4d30-9eab-6cfd8107b17f tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] COPY block job progress, current cursor: 43778048 final cursor: 43778048 {{(pid=71731) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 13 16:22:23 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-3a0f5dbf-e6a1-4d30-9eab-6cfd8107b17f tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] [instance: bbcccf4b-e861-4254-9be3-a491776214e9] Skipping quiescing instance: QEMU guest agent is not enabled.
Apr 13 16:22:23 user nova-compute[71731]: DEBUG nova.privsep.utils [None req-3a0f5dbf-e6a1-4d30-9eab-6cfd8107b17f tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71731) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 13 16:22:23 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-3a0f5dbf-e6a1-4d30-9eab-6cfd8107b17f tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpbjjur2i4/e9dbf7c3f7c44ba68ddcf7ddfe93255e.delta /opt/stack/data/nova/instances/snapshots/tmpbjjur2i4/e9dbf7c3f7c44ba68ddcf7ddfe93255e {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:22:23 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-3a0f5dbf-e6a1-4d30-9eab-6cfd8107b17f tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpbjjur2i4/e9dbf7c3f7c44ba68ddcf7ddfe93255e.delta /opt/stack/data/nova/instances/snapshots/tmpbjjur2i4/e9dbf7c3f7c44ba68ddcf7ddfe93255e" returned: 0 in 0.204s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:22:23 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-3a0f5dbf-e6a1-4d30-9eab-6cfd8107b17f tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] [instance: bbcccf4b-e861-4254-9be3-a491776214e9] Snapshot extracted, beginning image upload
Apr 13 16:22:23 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-8ec9283e-3674-4995-833a-40927141b14d tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.387s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 16:22:23 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ec9283e-3674-4995-833a-40927141b14d tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] <== connect_volume: return (1390ms) {'type': 'block', 'scsi_wwn': '23736313166343135', 'path': '/dev/sdi'} {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 16:22:23 user nova-compute[71731]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8ec9283e-3674-4995-833a-40927141b14d tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] [instance: 823749e1-56ca-44f9-be83-a36b4851c28f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23736313166343135', 'path': '/dev/sdi'} {{(pid=71731) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 16:22:23 user nova-compute[71731]: DEBUG nova.objects.instance [None req-8ec9283e-3674-4995-833a-40927141b14d tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] Lazy-loading 'flavor' on Instance uuid 823749e1-56ca-44f9-be83-a36b4851c28f {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:22:23 user nova-compute[71731]: DEBUG nova.virt.libvirt.guest [None req-8ec9283e-3674-4995-833a-40927141b14d tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] attach device xml: <disk type="block" device="disk">
Apr 13 16:22:23 user nova-compute[71731]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 16:22:23 user nova-compute[71731]:   <source dev="/dev/sdi"/>
Apr 13 16:22:23 user nova-compute[71731]:   <target dev="vdb" bus="virtio"/>
Apr 13 16:22:23 user nova-compute[71731]:   <serial>91d1caca-70d0-452f-800d-0073afd5d0c4</serial>
Apr 13 16:22:23 user nova-compute[71731]: </disk>
Apr 13 16:22:23 user nova-compute[71731]:  {{(pid=71731) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 13 16:22:24 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-8ec9283e-3674-4995-833a-40927141b14d tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] No BDM found with device name vda, not building metadata. {{(pid=71731) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 16:22:24 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-8ec9283e-3674-4995-833a-40927141b14d tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71731) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 16:22:24 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-8ec9283e-3674-4995-833a-40927141b14d tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] No VIF found with MAC fa:16:3e:58:82:03, not building metadata {{(pid=71731) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 16:22:24 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-8ec9283e-3674-4995-833a-40927141b14d tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] Lock "823749e1-56ca-44f9-be83-a36b4851c28f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.277s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:22:25 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-ef61c617-614d-4200-bf83-d162e485a54c tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] Acquiring lock "823749e1-56ca-44f9-be83-a36b4851c28f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:22:25 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-ef61c617-614d-4200-bf83-d162e485a54c tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] Lock "823749e1-56ca-44f9-be83-a36b4851c28f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:22:25 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-ef61c617-614d-4200-bf83-d162e485a54c tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] Acquiring lock "823749e1-56ca-44f9-be83-a36b4851c28f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:22:25 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-ef61c617-614d-4200-bf83-d162e485a54c tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] Lock "823749e1-56ca-44f9-be83-a36b4851c28f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:22:25 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-ef61c617-614d-4200-bf83-d162e485a54c tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] Lock "823749e1-56ca-44f9-be83-a36b4851c28f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:22:25 user nova-compute[71731]: INFO nova.compute.manager [None req-ef61c617-614d-4200-bf83-d162e485a54c tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] [instance: 823749e1-56ca-44f9-be83-a36b4851c28f] Terminating instance
Apr 13 16:22:25 user nova-compute[71731]: DEBUG nova.compute.manager [None req-ef61c617-614d-4200-bf83-d162e485a54c tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] [instance: 823749e1-56ca-44f9-be83-a36b4851c28f] Start destroying the instance on the hypervisor. {{(pid=71731) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 16:22:25 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:22:25 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:22:25 user nova-compute[71731]: DEBUG nova.compute.manager [None req-a9e9309a-4a8d-4ece-ad0d-a2ad2657c5d6 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: db65920b-7872-44c1-a68a-a696681d9d95] Start spawning the instance on the hypervisor. {{(pid=71731) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 16:22:25 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-a9e9309a-4a8d-4ece-ad0d-a2ad2657c5d6 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: db65920b-7872-44c1-a68a-a696681d9d95] Creating instance directory {{(pid=71731) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 16:22:25 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-a9e9309a-4a8d-4ece-ad0d-a2ad2657c5d6 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: db65920b-7872-44c1-a68a-a696681d9d95] Creating image(s)
Apr 13 16:22:25 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-a9e9309a-4a8d-4ece-ad0d-a2ad2657c5d6 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: db65920b-7872-44c1-a68a-a696681d9d95] Did not create local disks {{(pid=71731) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 13 16:22:25 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-a9e9309a-4a8d-4ece-ad0d-a2ad2657c5d6 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: db65920b-7872-44c1-a68a-a696681d9d95] Ensure instance console log exists: /opt/stack/data/nova/instances/db65920b-7872-44c1-a68a-a696681d9d95/console.log {{(pid=71731) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 16:22:25 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-a9e9309a-4a8d-4ece-ad0d-a2ad2657c5d6 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:22:25 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-a9e9309a-4a8d-4ece-ad0d-a2ad2657c5d6 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:22:25 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-a9e9309a-4a8d-4ece-ad0d-a2ad2657c5d6 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:22:25 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-a9e9309a-4a8d-4ece-ad0d-a2ad2657c5d6 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: db65920b-7872-44c1-a68a-a696681d9d95] Start _get_guest_xml network_info=[{"id": "ba686724-ae8a-4e16-9918-d7b2fc64ff62", "address": "fa:16:3e:87:f9:e7", "network": {"id": "d36bc206-f629-4d6e-8a3f-458061d7b525", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-893271134-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d451e0e239f486aa2b3abe9e273eab3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba686724-ae", "ovs_interfaceid": "ba686724-ae8a-4e16-9918-d7b2fc64ff62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'attachment_id': '45492859-b19e-43e7-bc03-8c61dcef043e', 'mount_device': '/dev/vda', 'delete_on_termination': True, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:0e3b49ec-80af-4c38-9689-f7277e495d21', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IdMXZPYO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'db65920b-7872-44c1-a68a-a696681d9d95', 'attached_at': '', 'detached_at': '', 'volume_id': '0e3b49ec-80af-4c38-9689-f7277e495d21', 'serial': '0e3b49ec-80af-4c38-9689-f7277e495d21'}, 'disk_bus': 'virtio', 'guest_format': None, 'volume_type': None} {{(pid=71731) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 16:22:25 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:22:25 user nova-compute[71731]: WARNING nova.virt.libvirt.driver [None req-a9e9309a-4a8d-4ece-ad0d-a2ad2657c5d6 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 16:22:25 user nova-compute[71731]: WARNING nova.virt.libvirt.driver [None req-a9e9309a-4a8d-4ece-ad0d-a2ad2657c5d6 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 16:22:25 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-a9e9309a-4a8d-4ece-ad0d-a2ad2657c5d6 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71731) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 16:22:25 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-a9e9309a-4a8d-4ece-ad0d-a2ad2657c5d6 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T16:17:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 16:22:25 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-a9e9309a-4a8d-4ece-ad0d-a2ad2657c5d6 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Flavor limits 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 16:22:25 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-a9e9309a-4a8d-4ece-ad0d-a2ad2657c5d6 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Image limits 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 16:22:25 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-a9e9309a-4a8d-4ece-ad0d-a2ad2657c5d6 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Flavor pref 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 16:22:25 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-a9e9309a-4a8d-4ece-ad0d-a2ad2657c5d6 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Image pref 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 16:22:25 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-a9e9309a-4a8d-4ece-ad0d-a2ad2657c5d6 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 16:22:25 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-a9e9309a-4a8d-4ece-ad0d-a2ad2657c5d6 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 16:22:25 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-a9e9309a-4a8d-4ece-ad0d-a2ad2657c5d6 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71731) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 16:22:25 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-a9e9309a-4a8d-4ece-ad0d-a2ad2657c5d6 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Got 1 possible topologies {{(pid=71731) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 16:22:25 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-a9e9309a-4a8d-4ece-ad0d-a2ad2657c5d6 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 16:22:25 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-a9e9309a-4a8d-4ece-ad0d-a2ad2657c5d6 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 16:22:25 user nova-compute[71731]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a9e9309a-4a8d-4ece-ad0d-a2ad2657c5d6 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: db65920b-7872-44c1-a68a-a696681d9d95] Calling os-brick to attach iSCSI Volume {{(pid=71731) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 16:22:25 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9e9309a-4a8d-4ece-ad0d-a2ad2657c5d6 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8cf0118790>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0e3b49ec-80af-4c38-9689-f7277e495d21', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IdMXZPYO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 16:22:25 user nova-compute[71731]: WARNING os_brick.initiator.connectors.base [None req-a9e9309a-4a8d-4ece-ad0d-a2ad2657c5d6 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 16:22:25 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-a9e9309a-4a8d-4ece-ad0d-a2ad2657c5d6 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 16:22:25 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-a9e9309a-4a8d-4ece-ad0d-a2ad2657c5d6 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 16:22:25 user nova-compute[71731]: WARNING os_brick.initiator.connectors.base [None req-a9e9309a-4a8d-4ece-ad0d-a2ad2657c5d6 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 16:22:25 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-a9e9309a-4a8d-4ece-ad0d-a2ad2657c5d6 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0e3b49ec-80af-4c38-9689-f7277e495d21" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 16:22:25 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-a9e9309a-4a8d-4ece-ad0d-a2ad2657c5d6 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0e3b49ec-80af-4c38-9689-f7277e495d21" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 16:22:25 user nova-compute[71731]: INFO os_brick.initiator.connectors.iscsi [None req-a9e9309a-4a8d-4ece-ad0d-a2ad2657c5d6 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 16:22:25 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:22:25 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e3b49ec-80af-4c38-9689-f7277e495d21 -p 172.16.0.220:3260 {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:22:25 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e3b49ec-80af-4c38-9689-f7277e495d21 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:22:25 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8e41511-80c5-4ec7-a1b0-522fafb6cd4c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:22:25 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9e9309a-4a8d-4ece-ad0d-a2ad2657c5d6 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 16:22:25 user nova-compute[71731]:  {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:22:25 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e3b49ec-80af-4c38-9689-f7277e495d21 -p 172.16.0.220:3260 --interface default --op new {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:22:25 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e3b49ec-80af-4c38-9689-f7277e495d21 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:22:25 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[6be93e14-5bb5-4b82-98b8-0c2a9b49a5e7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0e3b49ec-80af-4c38-9689-f7277e495d21] added\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:22:25 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9e9309a-4a8d-4ece-ad0d-a2ad2657c5d6 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0e3b49ec-80af-4c38-9689-f7277e495d21] added
Apr 13 16:22:25 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:22:25 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e3b49ec-80af-4c38-9689-f7277e495d21 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:22:25 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e3b49ec-80af-4c38-9689-f7277e495d21 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:22:25 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[28f4dece-8857-4187-82a9-c2c321695e66]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:22:25 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9e9309a-4a8d-4ece-ad0d-a2ad2657c5d6 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:22:25 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e3b49ec-80af-4c38-9689-f7277e495d21 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:22:25 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e3b49ec-80af-4c38-9689-f7277e495d21 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:22:25 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[8663e377-f011-4d64-b681-e29f7fd332d2]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:22:25 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9e9309a-4a8d-4ece-ad0d-a2ad2657c5d6 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:22:25 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e3b49ec-80af-4c38-9689-f7277e495d21 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IdMXZPYO {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:22:25 user nova-compute[71731]: DEBUG nova.compute.manager [req-0e3765e2-4368-4373-a990-4e96d949c0c2 req-82919a2a-bc5c-4297-a133-892f1afcd638 service nova] [instance: 823749e1-56ca-44f9-be83-a36b4851c28f] Received event network-vif-unplugged-f4e8f99d-1c8f-44b8-84f1-0f43a156e8b0 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:22:25 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-0e3765e2-4368-4373-a990-4e96d949c0c2 req-82919a2a-bc5c-4297-a133-892f1afcd638 service nova] Acquiring lock "823749e1-56ca-44f9-be83-a36b4851c28f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:22:25 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-0e3765e2-4368-4373-a990-4e96d949c0c2 req-82919a2a-bc5c-4297-a133-892f1afcd638 service nova] Lock "823749e1-56ca-44f9-be83-a36b4851c28f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:22:25 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-0e3765e2-4368-4373-a990-4e96d949c0c2 req-82919a2a-bc5c-4297-a133-892f1afcd638 service nova] Lock "823749e1-56ca-44f9-be83-a36b4851c28f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:22:25 user nova-compute[71731]: DEBUG nova.compute.manager [req-0e3765e2-4368-4373-a990-4e96d949c0c2 req-82919a2a-bc5c-4297-a133-892f1afcd638 service nova] [instance: 823749e1-56ca-44f9-be83-a36b4851c28f] No waiting events found dispatching network-vif-unplugged-f4e8f99d-1c8f-44b8-84f1-0f43a156e8b0 {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:22:25 user nova-compute[71731]: DEBUG nova.compute.manager [req-0e3765e2-4368-4373-a990-4e96d949c0c2 req-82919a2a-bc5c-4297-a133-892f1afcd638 service nova] [instance: 823749e1-56ca-44f9-be83-a36b4851c28f] Received event network-vif-unplugged-f4e8f99d-1c8f-44b8-84f1-0f43a156e8b0 for instance with task_state deleting. {{(pid=71731) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 16:22:25 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e3b49ec-80af-4c38-9689-f7277e495d21 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IdMXZPYO" returned: 0 in 0.019s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:22:25 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[9780e582-97be-444e-b879-436c58bd8c86]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:22:25 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9e9309a-4a8d-4ece-ad0d-a2ad2657c5d6 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IdMXZPYO'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:22:25 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e3b49ec-80af-4c38-9689-f7277e495d21 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:22:25 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e3b49ec-80af-4c38-9689-f7277e495d21 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:22:25 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[903e94c0-911b-492f-9807-362f5d567e88]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:22:25 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9e9309a-4a8d-4ece-ad0d-a2ad2657c5d6 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:22:25 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:22:25 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:22:25 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd5712c8-8f7a-439a-84a9-ac7fc07ad6d3]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c7f6ad-d2c2-465a-b39e-47347aa85be0 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48af37b0-6938-432e-b374-d992c4dd9ae9 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c20e80fa-58de-431a-8901-2535657aaadf (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27919afc-8990-4ed5-af9e-9d6b3d7b231e (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc639d00-ef6b-4121-bcb0-c65ec0347abd (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0f728f3-fbb5-4ed8-a78b-a5d982b03f7d (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91d1caca-70d0-452f-800d-0073afd5d0c4 (non-flash)\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:22:25 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9e9309a-4a8d-4ece-ad0d-a2ad2657c5d6 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984 (non-flash)
Apr 13 16:22:25 user nova-compute[71731]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c7f6ad-d2c2-465a-b39e-47347aa85be0 (non-flash)
Apr 13 16:22:25 user nova-compute[71731]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48af37b0-6938-432e-b374-d992c4dd9ae9 (non-flash)
Apr 13 16:22:25 user nova-compute[71731]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c20e80fa-58de-431a-8901-2535657aaadf (non-flash)
Apr 13 16:22:25 user nova-compute[71731]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27919afc-8990-4ed5-af9e-9d6b3d7b231e (non-flash)
Apr 13 16:22:25 user nova-compute[71731]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc639d00-ef6b-4121-bcb0-c65ec0347abd (non-flash)
Apr 13 16:22:25 user nova-compute[71731]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0f728f3-fbb5-4ed8-a78b-a5d982b03f7d (non-flash)
Apr 13 16:22:25 user nova-compute[71731]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91d1caca-70d0-452f-800d-0073afd5d0c4 (non-flash)
Apr 13 16:22:25 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 16:22:25 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9e9309a-4a8d-4ece-ad0d-a2ad2657c5d6 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984 (non-flash)
Apr 13 16:22:25 user nova-compute[71731]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c7f6ad-d2c2-465a-b39e-47347aa85be0 (non-flash)
Apr 13 16:22:25 user nova-compute[71731]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48af37b0-6938-432e-b374-d992c4dd9ae9 (non-flash)
Apr 13 16:22:25 user nova-compute[71731]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c20e80fa-58de-431a-8901-2535657aaadf (non-flash)
Apr 13 16:22:25 user nova-compute[71731]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27919afc-8990-4ed5-af9e-9d6b3d7b231e (non-flash)
Apr 13 16:22:25 user nova-compute[71731]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc639d00-ef6b-4121-bcb0-c65ec0347abd (non-flash)
Apr 13 16:22:25 user nova-compute[71731]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0f728f3-fbb5-4ed8-a78b-a5d982b03f7d (non-flash)
Apr 13 16:22:25 user nova-compute[71731]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91d1caca-70d0-452f-800d-0073afd5d0c4 (non-flash)
Apr 13 16:22:25 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 16:22:25 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e3b49ec-80af-4c38-9689-f7277e495d21 -p 172.16.0.220:3260 --login {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:22:25 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e3b49ec-80af-4c38-9689-f7277e495d21 -p 172.16.0.220:3260 --login" returned: 0 in 0.092s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:22:25 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[67062388-a058-46d7-8225-2239b4875af1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0e3b49ec-80af-4c38-9689-f7277e495d21, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0e3b49ec-80af-4c38-9689-f7277e495d21, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:22:25 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9e9309a-4a8d-4ece-ad0d-a2ad2657c5d6 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0e3b49ec-80af-4c38-9689-f7277e495d21, portal: 172.16.0.220,3260]
Apr 13 16:22:25 user nova-compute[71731]: Login to [iface: default, target: iqn.2010-10.org.openstack:0e3b49ec-80af-4c38-9689-f7277e495d21, portal: 172.16.0.220,3260] successful.
Apr 13 16:22:25 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:22:25 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e3b49ec-80af-4c38-9689-f7277e495d21 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:22:25 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e3b49ec-80af-4c38-9689-f7277e495d21 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:22:25 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[06553859-3e02-47d9-a682-74305cc83ee5]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:22:25 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9e9309a-4a8d-4ece-ad0d-a2ad2657c5d6 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:22:25 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:22:25 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:22:25 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.042s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:22:25 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[621a84c9-2b73-49e0-8cb4-4e33da9161b8]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e3b49ec-80af-4c38-9689-f7277e495d21 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c7f6ad-d2c2-465a-b39e-47347aa85be0 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48af37b0-6938-432e-b374-d992c4dd9ae9 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c20e80fa-58de-431a-8901-2535657aaadf (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27919afc-8990-4ed5-af9e-9d6b3d7b231e (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc639d00-ef6b-4121-bcb0-c65ec0347abd (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0f728f3-fbb5-4ed8-a78b-a5d982b03f7d (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91d1caca-70d0-452f-800d-0073afd5d0c4 (non-flash)\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:22:25 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9e9309a-4a8d-4ece-ad0d-a2ad2657c5d6 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e3b49ec-80af-4c38-9689-f7277e495d21 (non-flash)
Apr 13 16:22:25 user nova-compute[71731]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984 (non-flash)
Apr 13 16:22:25 user nova-compute[71731]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c7f6ad-d2c2-465a-b39e-47347aa85be0 (non-flash)
Apr 13 16:22:25 user nova-compute[71731]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48af37b0-6938-432e-b374-d992c4dd9ae9 (non-flash)
Apr 13 16:22:25 user nova-compute[71731]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c20e80fa-58de-431a-8901-2535657aaadf (non-flash)
Apr 13 16:22:25 user nova-compute[71731]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27919afc-8990-4ed5-af9e-9d6b3d7b231e (non-flash)
Apr 13 16:22:25 user nova-compute[71731]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc639d00-ef6b-4121-bcb0-c65ec0347abd (non-flash)
Apr 13 16:22:25 user nova-compute[71731]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0f728f3-fbb5-4ed8-a78b-a5d982b03f7d (non-flash)
Apr 13 16:22:25 user nova-compute[71731]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91d1caca-70d0-452f-800d-0073afd5d0c4 (non-flash)
Apr 13 16:22:25 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 16:22:25 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9e9309a-4a8d-4ece-ad0d-a2ad2657c5d6 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e3b49ec-80af-4c38-9689-f7277e495d21 (non-flash)
Apr 13 16:22:25 user nova-compute[71731]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984 (non-flash)
Apr 13 16:22:25 user nova-compute[71731]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c7f6ad-d2c2-465a-b39e-47347aa85be0 (non-flash)
Apr 13 16:22:25 user nova-compute[71731]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48af37b0-6938-432e-b374-d992c4dd9ae9 (non-flash)
Apr 13 16:22:25 user nova-compute[71731]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c20e80fa-58de-431a-8901-2535657aaadf (non-flash)
Apr 13 16:22:25 user nova-compute[71731]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27919afc-8990-4ed5-af9e-9d6b3d7b231e (non-flash)
Apr 13 16:22:25 user nova-compute[71731]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc639d00-ef6b-4121-bcb0-c65ec0347abd (non-flash)
Apr 13 16:22:25 user nova-compute[71731]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0f728f3-fbb5-4ed8-a78b-a5d982b03f7d (non-flash)
Apr 13 16:22:25 user nova-compute[71731]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91d1caca-70d0-452f-800d-0073afd5d0c4 (non-flash)
Apr 13 16:22:25 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 16:22:25 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-a9e9309a-4a8d-4ece-ad0d-a2ad2657c5d6 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0e3b49ec-80af-4c38-9689-f7277e495d21" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.358s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 16:22:25 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9e9309a-4a8d-4ece-ad0d-a2ad2657c5d6 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Connected to 172.16.0.220:3260 {{(pid=71731) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 16:22:25 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-a9e9309a-4a8d-4ece-ad0d-a2ad2657c5d6 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] HCTL ('41', '-', '-', 0) found on session 10 with lun 0 {{(pid=71731) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 16:22:25 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-a9e9309a-4a8d-4ece-ad0d-a2ad2657c5d6 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Scanning host 41 c: -, t: -, l: 0) {{(pid=71731) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 16:22:25 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host41/scan {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:22:25 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host41/scan" returned: 0 in 0.015s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:22:25 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b377727-d6f3-48df-a35f-4e98b1f0b071]: (4, ('- - 0', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:22:25 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-a9e9309a-4a8d-4ece-ad0d-a2ad2657c5d6 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Searching for a device in session 10 and hctl ['41', '*', '*', 0] yield: sdj {{(pid=71731) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 16:22:25 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9e9309a-4a8d-4ece-ad0d-a2ad2657c5d6 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Connected to sdj using {'target_iqn': 'iqn.2010-10.org.openstack:0e3b49ec-80af-4c38-9689-f7277e495d21', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IdMXZPYO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71731) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 16:22:25 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-3a0f5dbf-e6a1-4d30-9eab-6cfd8107b17f tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] [instance: bbcccf4b-e861-4254-9be3-a491776214e9] Snapshot image upload complete
Apr 13 16:22:25 user nova-compute[71731]: INFO nova.compute.manager [None req-3a0f5dbf-e6a1-4d30-9eab-6cfd8107b17f tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] [instance: bbcccf4b-e861-4254-9be3-a491776214e9] Took 4.93 seconds to snapshot the instance on the hypervisor.
Apr 13 16:22:26 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:22:26 user nova-compute[71731]: INFO nova.virt.libvirt.driver [-] [instance: 823749e1-56ca-44f9-be83-a36b4851c28f] Instance destroyed successfully.
Apr 13 16:22:26 user nova-compute[71731]: DEBUG nova.objects.instance [None req-ef61c617-614d-4200-bf83-d162e485a54c tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] Lazy-loading 'resources' on Instance uuid 823749e1-56ca-44f9-be83-a36b4851c28f {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:22:26 user nova-compute[71731]: DEBUG nova.virt.libvirt.vif [None req-ef61c617-614d-4200-bf83-d162e485a54c tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T16:20:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-865124722',display_name='tempest-DeleteServersTestJSON-server-865124722',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-865124722',id=3,image_ref='708622a9-7465-4492-ade8-b827198f7e30',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-13T16:20:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='608ff87aadc7408e9010212fd5f482b7',ramdisk_id='',reservation_id='r-30o8gy1d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='708622a9-7465-4492-ade8-b827198f7e30',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-1138024295',owner_user_name='tempest-DeleteServersTestJSON-1138024295-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T16:20:38Z,user_data=None,user_id='55d232911f5742aa83146f19f13dd198',uuid=823749e1-56ca-44f9-be83-a36b4851c28f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f4e8f99d-1c8f-44b8-84f1-0f43a156e8b0", "address": "fa:16:3e:58:82:03", "network": {"id": "39832acb-f932-4804-a559-967d9d0ae0ad", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-174129869-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "608ff87aadc7408e9010212fd5f482b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4e8f99d-1c", "ovs_interfaceid": "f4e8f99d-1c8f-44b8-84f1-0f43a156e8b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 16:22:26 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-ef61c617-614d-4200-bf83-d162e485a54c tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] Converting VIF {"id": "f4e8f99d-1c8f-44b8-84f1-0f43a156e8b0", "address": "fa:16:3e:58:82:03", "network": {"id": "39832acb-f932-4804-a559-967d9d0ae0ad", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-174129869-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "608ff87aadc7408e9010212fd5f482b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4e8f99d-1c", "ovs_interfaceid": "f4e8f99d-1c8f-44b8-84f1-0f43a156e8b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 16:22:26 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-ef61c617-614d-4200-bf83-d162e485a54c tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:58:82:03,bridge_name='br-int',has_traffic_filtering=True,id=f4e8f99d-1c8f-44b8-84f1-0f43a156e8b0,network=Network(39832acb-f932-4804-a559-967d9d0ae0ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4e8f99d-1c') {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 16:22:26 user nova-compute[71731]: DEBUG os_vif [None req-ef61c617-614d-4200-bf83-d162e485a54c tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:82:03,bridge_name='br-int',has_traffic_filtering=True,id=f4e8f99d-1c8f-44b8-84f1-0f43a156e8b0,network=Network(39832acb-f932-4804-a559-967d9d0ae0ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4e8f99d-1c') {{(pid=71731) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 16:22:26 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:22:26 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf4e8f99d-1c, bridge=br-int, if_exists=True) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:22:26 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:22:26 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 16:22:26 user nova-compute[71731]: INFO os_vif [None req-ef61c617-614d-4200-bf83-d162e485a54c tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:82:03,bridge_name='br-int',has_traffic_filtering=True,id=f4e8f99d-1c8f-44b8-84f1-0f43a156e8b0,network=Network(39832acb-f932-4804-a559-967d9d0ae0ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4e8f99d-1c')
Apr 13 16:22:26 user nova-compute[71731]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ef61c617-614d-4200-bf83-d162e485a54c tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] [instance: 823749e1-56ca-44f9-be83-a36b4851c28f] calling os-brick to detach iSCSI Volume {{(pid=71731) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 16:22:26 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef61c617-614d-4200-bf83-d162e485a54c tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8cf0118790>, {'target_iqn': 'iqn.2010-10.org.openstack:91d1caca-70d0-452f-800d-0073afd5d0c4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pBvPhfqI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi': {}}" {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 16:22:26 user nova-compute[71731]: WARNING os_brick.initiator.connectors.base [None req-ef61c617-614d-4200-bf83-d162e485a54c tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 16:22:26 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-ef61c617-614d-4200-bf83-d162e485a54c tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 16:22:26 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-a9e9309a-4a8d-4ece-ad0d-a2ad2657c5d6 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.398s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 16:22:26 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9e9309a-4a8d-4ece-ad0d-a2ad2657c5d6 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] <== connect_volume: return (1403ms) {'type': 'block', 'scsi_wwn': '23664333333336130', 'path': '/dev/sdj'} {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 16:22:26 user nova-compute[71731]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a9e9309a-4a8d-4ece-ad0d-a2ad2657c5d6 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: db65920b-7872-44c1-a68a-a696681d9d95] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23664333333336130', 'path': '/dev/sdj'} {{(pid=71731) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 16:22:26 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-ef61c617-614d-4200-bf83-d162e485a54c tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.788s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 16:22:26 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:22:26 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:22:26 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbcbb288-8f88-47af-88f5-081285f2dc3a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:91d1caca-70d0-452f-800d-0073afd5d0c4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c20e80fa-58de-431a-8901-2535657aaadf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:27919afc-8990-4ed5-af9e-9d6b3d7b231e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0e3b49ec-80af-4c38-9689-f7277e495d21\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cc639d00-ef6b-4121-bcb0-c65ec0347abd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e0f728f3-fbb5-4ed8-a78b-a5d982b03f7d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:84c7f6ad-d2c2-465a-b39e-47347aa85be0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:48af37b0-6938-432e-b374-d992c4dd9ae9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:22:26 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef61c617-614d-4200-bf83-d162e485a54c tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 16:22:26 user nova-compute[71731]: No targets found.
Apr 13 16:22:26 user nova-compute[71731]: iSNS:
Apr 13 16:22:26 user nova-compute[71731]: No targets found.
Apr 13 16:22:26 user nova-compute[71731]: STATIC:
Apr 13 16:22:26 user nova-compute[71731]: Target: iqn.2010-10.org.openstack:91d1caca-70d0-452f-800d-0073afd5d0c4
Apr 13 16:22:26 user nova-compute[71731]:         Portal: 172.16.0.220:3260,-1
Apr 13 16:22:26 user nova-compute[71731]:                 Iface Name: default
Apr 13 16:22:26 user nova-compute[71731]: Target: iqn.2010-10.org.openstack:c20e80fa-58de-431a-8901-2535657aaadf
Apr 13 16:22:26 user nova-compute[71731]:         Portal: 172.16.0.220:3260,-1
Apr 13 16:22:26 user nova-compute[71731]:                 Iface Name: default
Apr 13 16:22:26 user nova-compute[71731]: Target: iqn.2010-10.org.openstack:27919afc-8990-4ed5-af9e-9d6b3d7b231e
Apr 13 16:22:26 user nova-compute[71731]:         Portal: 172.16.0.220:3260,-1
Apr 13 16:22:26 user nova-compute[71731]:                 Iface Name: default
Apr 13 16:22:26 user nova-compute[71731]: Target: iqn.2010-10.org.openstack:0e3b49ec-80af-4c38-9689-f7277e495d21
Apr 13 16:22:26 user nova-compute[71731]:         Portal: 172.16.0.220:3260,-1
Apr 13 16:22:26 user nova-compute[71731]:                 Iface Name: default
Apr 13 16:22:26 user nova-compute[71731]: Target: iqn.2010-10.org.openstack:cc639d00-ef6b-4121-bcb0-c65ec0347abd
Apr 13 16:22:26 user nova-compute[71731]:         Portal: 172.16.0.220:3260,-1
Apr 13 16:22:26 user nova-compute[71731]:                 Iface Name: default
Apr 13 16:22:26 user nova-compute[71731]: Target: iqn.2010-10.org.openstack:e0f728f3-fbb5-4ed8-a78b-a5d982b03f7d
Apr 13 16:22:26 user nova-compute[71731]:         Portal: 172.16.0.220:3260,-1
Apr 13 16:22:26 user nova-compute[71731]:                 Iface Name: default
Apr 13 16:22:26 user nova-compute[71731]: Target: iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984
Apr 13 16:22:26 user nova-compute[71731]:         Portal: 172.16.0.220:3260,-1
Apr 13 16:22:26 user nova-compute[71731]:                 Iface Name: default
Apr 13 16:22:26 user nova-compute[71731]: Target: iqn.2010-10.org.openstack:84c7f6ad-d2c2-465a-b39e-47347aa85be0
Apr 13 16:22:26 user nova-compute[71731]:         Portal: 172.16.0.220:3260,-1
Apr 13 16:22:26 user nova-compute[71731]:                 Iface Name: default
Apr 13 16:22:26 user nova-compute[71731]: Target: iqn.2010-10.org.openstack:48af37b0-6938-432e-b374-d992c4dd9ae9
Apr 13 16:22:26 user nova-compute[71731]:         Portal: 172.16.0.220:3260,-1
Apr 13 16:22:26 user nova-compute[71731]:                 Iface Name: default
Apr 13 16:22:26 user nova-compute[71731]: FIRMWARE:
Apr 13 16:22:26 user nova-compute[71731]: No targets found.
Apr 13 16:22:26 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 16:22:26 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef61c617-614d-4200-bf83-d162e485a54c tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 16:22:26 user nova-compute[71731]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 16:22:26 user nova-compute[71731]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71731) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 16:22:26 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef61c617-614d-4200-bf83-d162e485a54c tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:91d1caca-70d0-452f-800d-0073afd5d0c4', 0)] {{(pid=71731) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 16:22:26 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:22:26 user nova-compute[71731]: DEBUG nova.virt.libvirt.vif [None req-a9e9309a-4a8d-4ece-ad0d-a2ad2657c5d6 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T16:22:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-141352368',display_name='tempest-TestVolumeBootPattern-server-141352368',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-141352368',id=13,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8d451e0e239f486aa2b3abe9e273eab3',ramdisk_id='',reservation_id='r-sltzshdb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-438786227',owner_user_name='tempest-TestVolumeBootPattern-438786227-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T16:22:14Z,user_data=None,user_id='d70e10f63cdd49a9a1ebe1fe4c9de0a2',uuid=db65920b-7872-44c1-a68a-a696681d9d95,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ba686724-ae8a-4e16-9918-d7b2fc64ff62", "address": "fa:16:3e:87:f9:e7", "network": {"id": "d36bc206-f629-4d6e-8a3f-458061d7b525", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-893271134-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d451e0e239f486aa2b3abe9e273eab3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba686724-ae", "ovs_interfaceid": "ba686724-ae8a-4e16-9918-d7b2fc64ff62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71731) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 16:22:26 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-a9e9309a-4a8d-4ece-ad0d-a2ad2657c5d6 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Converting VIF {"id": "ba686724-ae8a-4e16-9918-d7b2fc64ff62", "address": "fa:16:3e:87:f9:e7", "network": {"id": "d36bc206-f629-4d6e-8a3f-458061d7b525", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-893271134-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d451e0e239f486aa2b3abe9e273eab3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba686724-ae", "ovs_interfaceid": "ba686724-ae8a-4e16-9918-d7b2fc64ff62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 16:22:26 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-a9e9309a-4a8d-4ece-ad0d-a2ad2657c5d6 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:87:f9:e7,bridge_name='br-int',has_traffic_filtering=True,id=ba686724-ae8a-4e16-9918-d7b2fc64ff62,network=Network(d36bc206-f629-4d6e-8a3f-458061d7b525),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba686724-ae') {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 16:22:26 user nova-compute[71731]: DEBUG nova.objects.instance [None req-a9e9309a-4a8d-4ece-ad0d-a2ad2657c5d6 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lazy-loading 'pci_devices' on Instance uuid db65920b-7872-44c1-a68a-a696681d9d95 {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:22:27 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:22:27 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[44e83252-7c5f-4e7a-b02a-e8693ad5e6e3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0e3b49ec-80af-4c38-9689-f7277e495d21\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:27919afc-8990-4ed5-af9e-9d6b3d7b231e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:48af37b0-6938-432e-b374-d992c4dd9ae9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:84c7f6ad-d2c2-465a-b39e-47347aa85be0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:91d1caca-70d0-452f-800d-0073afd5d0c4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c20e80fa-58de-431a-8901-2535657aaadf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cc639d00-ef6b-4121-bcb0-c65ec0347abd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e0f728f3-fbb5-4ed8-a78b-a5d982b03f7d\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:22:27 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:22:27 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-a9e9309a-4a8d-4ece-ad0d-a2ad2657c5d6 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: db65920b-7872-44c1-a68a-a696681d9d95] End _get_guest_xml xml=<domain type="kvm">
Apr 13 16:22:27 user nova-compute[71731]:   <uuid>db65920b-7872-44c1-a68a-a696681d9d95</uuid>
Apr 13 16:22:27 user nova-compute[71731]:   <name>instance-0000000d</name>
Apr 13 16:22:27 user nova-compute[71731]:   <memory>131072</memory>
Apr 13 16:22:27 user nova-compute[71731]:   <vcpu>1</vcpu>
Apr 13 16:22:27 user nova-compute[71731]:   <metadata>
Apr 13 16:22:27 user nova-compute[71731]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 16:22:27 user nova-compute[71731]:       <nova:package version="0.0.0"/>
Apr 13 16:22:27 user nova-compute[71731]:       <nova:name>tempest-TestVolumeBootPattern-server-141352368</nova:name>
Apr 13 16:22:27 user nova-compute[71731]:       <nova:creationTime>2023-04-13 16:22:25</nova:creationTime>
Apr 13 16:22:27 user nova-compute[71731]:       <nova:flavor name="m1.nano">
Apr 13 16:22:27 user nova-compute[71731]:         <nova:memory>128</nova:memory>
Apr 13 16:22:27 user nova-compute[71731]:         <nova:disk>1</nova:disk>
Apr 13 16:22:27 user nova-compute[71731]:         <nova:swap>0</nova:swap>
Apr 13 16:22:27 user nova-compute[71731]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 16:22:27 user nova-compute[71731]:         <nova:vcpus>1</nova:vcpus>
Apr 13 16:22:27 user nova-compute[71731]:       </nova:flavor>
Apr 13 16:22:27 user nova-compute[71731]:       <nova:owner>
Apr 13 16:22:27 user nova-compute[71731]:         <nova:user uuid="d70e10f63cdd49a9a1ebe1fe4c9de0a2">tempest-TestVolumeBootPattern-438786227-project-member</nova:user>
Apr 13 16:22:27 user nova-compute[71731]:         <nova:project uuid="8d451e0e239f486aa2b3abe9e273eab3">tempest-TestVolumeBootPattern-438786227</nova:project>
Apr 13 16:22:27 user nova-compute[71731]:       </nova:owner>
Apr 13 16:22:27 user nova-compute[71731]:       <nova:ports>
Apr 13 16:22:27 user nova-compute[71731]:         <nova:port uuid="ba686724-ae8a-4e16-9918-d7b2fc64ff62">
Apr 13 16:22:27 user nova-compute[71731]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Apr 13 16:22:27 user nova-compute[71731]:         </nova:port>
Apr 13 16:22:27 user nova-compute[71731]:       </nova:ports>
Apr 13 16:22:27 user nova-compute[71731]:     </nova:instance>
Apr 13 16:22:27 user nova-compute[71731]:   </metadata>
Apr 13 16:22:27 user nova-compute[71731]:   <sysinfo type="smbios">
Apr 13 16:22:27 user nova-compute[71731]:     <system>
Apr 13 16:22:27 user nova-compute[71731]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 16:22:27 user nova-compute[71731]:       <entry name="product">OpenStack Nova</entry>
Apr 13 16:22:27 user nova-compute[71731]:       <entry name="version">0.0.0</entry>
Apr 13 16:22:27 user nova-compute[71731]:       <entry name="serial">db65920b-7872-44c1-a68a-a696681d9d95</entry>
Apr 13 16:22:27 user nova-compute[71731]:       <entry name="uuid">db65920b-7872-44c1-a68a-a696681d9d95</entry>
Apr 13 16:22:27 user nova-compute[71731]:       <entry name="family">Virtual Machine</entry>
Apr 13 16:22:27 user nova-compute[71731]:     </system>
Apr 13 16:22:27 user nova-compute[71731]:   </sysinfo>
Apr 13 16:22:27 user nova-compute[71731]:   <os>
Apr 13 16:22:27 user nova-compute[71731]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 16:22:27 user nova-compute[71731]:     <boot dev="hd"/>
Apr 13 16:22:27 user nova-compute[71731]:     <smbios mode="sysinfo"/>
Apr 13 16:22:27 user nova-compute[71731]:   </os>
Apr 13 16:22:27 user nova-compute[71731]:   <features>
Apr 13 16:22:27 user nova-compute[71731]:     <acpi/>
Apr 13 16:22:27 user nova-compute[71731]:     <apic/>
Apr 13 16:22:27 user nova-compute[71731]:     <vmcoreinfo/>
Apr 13 16:22:27 user nova-compute[71731]:   </features>
Apr 13 16:22:27 user nova-compute[71731]:   <clock offset="utc">
Apr 13 16:22:27 user nova-compute[71731]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 16:22:27 user nova-compute[71731]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 16:22:27 user nova-compute[71731]:     <timer name="hpet" present="no"/>
Apr 13 16:22:27 user nova-compute[71731]:   </clock>
Apr 13 16:22:27 user nova-compute[71731]:   <cpu mode="custom" match="exact">
Apr 13 16:22:27 user nova-compute[71731]:     <model>Nehalem</model>
Apr 13 16:22:27 user nova-compute[71731]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 16:22:27 user nova-compute[71731]:   </cpu>
Apr 13 16:22:27 user nova-compute[71731]:   <devices>
Apr 13 16:22:27 user nova-compute[71731]:     <disk type="block" device="disk">
Apr 13 16:22:27 user nova-compute[71731]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 16:22:27 user nova-compute[71731]:       <source dev="/dev/sdj"/>
Apr 13 16:22:27 user nova-compute[71731]:       <target dev="vda" bus="virtio"/>
Apr 13 16:22:27 user nova-compute[71731]:       <serial>0e3b49ec-80af-4c38-9689-f7277e495d21</serial>
Apr 13 16:22:27 user nova-compute[71731]:     </disk>
Apr 13 16:22:27 user nova-compute[71731]:     <interface type="ethernet">
Apr 13 16:22:27 user nova-compute[71731]:       <mac address="fa:16:3e:87:f9:e7"/>
Apr 13 16:22:27 user nova-compute[71731]:       <model type="virtio"/>
Apr 13 16:22:27 user nova-compute[71731]:       <mtu size="1442"/>
Apr 13 16:22:27 user nova-compute[71731]:       <target dev="tapba686724-ae"/>
Apr 13 16:22:27 user nova-compute[71731]:     </interface>
Apr 13 16:22:27 user nova-compute[71731]:     <serial type="pty">
Apr 13 16:22:27 user nova-compute[71731]:       <log file="/opt/stack/data/nova/instances/db65920b-7872-44c1-a68a-a696681d9d95/console.log" append="off"/>
Apr 13 16:22:27 user nova-compute[71731]:     </serial>
Apr 13 16:22:27 user nova-compute[71731]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 16:22:27 user nova-compute[71731]:     <video>
Apr 13 16:22:27 user nova-compute[71731]:       <model type="virtio"/>
Apr 13 16:22:27 user nova-compute[71731]:     </video>
Apr 13 16:22:27 user nova-compute[71731]:     <rng model="virtio">
Apr 13 16:22:27 user nova-compute[71731]:       <backend model="random">/dev/urandom</backend>
Apr 13 16:22:27 user nova-compute[71731]:     </rng>
Apr 13 16:22:27 user nova-compute[71731]:     <controller type="usb" index="0" model="none"/>
Apr 13 16:22:27 user nova-compute[71731]:     <memballoon model="virtio">
Apr 13 16:22:27 user nova-compute[71731]:       <stats period="10"/>
Apr 13 16:22:27 user nova-compute[71731]:     </memballoon>
Apr 13 16:22:27 user nova-compute[71731]:   </devices>
Apr 13 16:22:27 user nova-compute[71731]: </domain>
Apr 13 16:22:27 user nova-compute[71731]:  {{(pid=71731) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 16:22:27 user nova-compute[71731]: DEBUG nova.virt.libvirt.vif [None req-a9e9309a-4a8d-4ece-ad0d-a2ad2657c5d6 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T16:22:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-141352368',display_name='tempest-TestVolumeBootPattern-server-141352368',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-141352368',id=13,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8d451e0e239f486aa2b3abe9e273eab3',ramdisk_id='',reservation_id='r-sltzshdb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-438786227',owner_user_name='tempest-TestVolumeBootPattern-438786227-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T16:22:14Z,user_data=None,user_id='d70e10f63cdd49a9a1ebe1fe4c9de0a2',uuid=db65920b-7872-44c1-a68a-a696681d9d95,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ba686724-ae8a-4e16-9918-d7b2fc64ff62", "address": "fa:16:3e:87:f9:e7", "network": {"id": "d36bc206-f629-4d6e-8a3f-458061d7b525", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-893271134-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d451e0e239f486aa2b3abe9e273eab3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba686724-ae", "ovs_interfaceid": "ba686724-ae8a-4e16-9918-d7b2fc64ff62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 16:22:27 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-a9e9309a-4a8d-4ece-ad0d-a2ad2657c5d6 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Converting VIF {"id": "ba686724-ae8a-4e16-9918-d7b2fc64ff62", "address": "fa:16:3e:87:f9:e7", "network": {"id": "d36bc206-f629-4d6e-8a3f-458061d7b525", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-893271134-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d451e0e239f486aa2b3abe9e273eab3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba686724-ae", "ovs_interfaceid": "ba686724-ae8a-4e16-9918-d7b2fc64ff62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 16:22:27 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-a9e9309a-4a8d-4ece-ad0d-a2ad2657c5d6 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:87:f9:e7,bridge_name='br-int',has_traffic_filtering=True,id=ba686724-ae8a-4e16-9918-d7b2fc64ff62,network=Network(d36bc206-f629-4d6e-8a3f-458061d7b525),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba686724-ae') {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 16:22:27 user nova-compute[71731]: DEBUG os_vif [None req-a9e9309a-4a8d-4ece-ad0d-a2ad2657c5d6 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:f9:e7,bridge_name='br-int',has_traffic_filtering=True,id=ba686724-ae8a-4e16-9918-d7b2fc64ff62,network=Network(d36bc206-f629-4d6e-8a3f-458061d7b525),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba686724-ae') {{(pid=71731) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 16:22:27 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:22:27 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:22:27 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 16:22:27 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:22:27 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapba686724-ae, may_exist=True) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:22:27 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapba686724-ae, col_values=(('external_ids', {'iface-id': 'ba686724-ae8a-4e16-9918-d7b2fc64ff62', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:87:f9:e7', 'vm-uuid': 'db65920b-7872-44c1-a68a-a696681d9d95'}),)) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:22:27 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:22:27 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 16:22:27 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:22:27 user nova-compute[71731]: INFO os_vif [None req-a9e9309a-4a8d-4ece-ad0d-a2ad2657c5d6 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:f9:e7,bridge_name='br-int',has_traffic_filtering=True,id=ba686724-ae8a-4e16-9918-d7b2fc64ff62,network=Network(d36bc206-f629-4d6e-8a3f-458061d7b525),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba686724-ae')
Apr 13 16:22:27 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:22:27 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[e826c582-cecd-4f0f-bdb0-6c921bc67293]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e3b49ec-80af-4c38-9689-f7277e495d21 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c7f6ad-d2c2-465a-b39e-47347aa85be0 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48af37b0-6938-432e-b374-d992c4dd9ae9 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c20e80fa-58de-431a-8901-2535657aaadf (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27919afc-8990-4ed5-af9e-9d6b3d7b231e (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc639d00-ef6b-4121-bcb0-c65ec0347abd (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0f728f3-fbb5-4ed8-a78b-a5d982b03f7d (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91d1caca-70d0-452f-800d-0073afd5d0c4 (non-flash)\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:22:27 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef61c617-614d-4200-bf83-d162e485a54c tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e3b49ec-80af-4c38-9689-f7277e495d21 (non-flash)
Apr 13 16:22:27 user nova-compute[71731]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984 (non-flash)
Apr 13 16:22:27 user nova-compute[71731]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c7f6ad-d2c2-465a-b39e-47347aa85be0 (non-flash)
Apr 13 16:22:27 user nova-compute[71731]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48af37b0-6938-432e-b374-d992c4dd9ae9 (non-flash)
Apr 13 16:22:27 user nova-compute[71731]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c20e80fa-58de-431a-8901-2535657aaadf (non-flash)
Apr 13 16:22:27 user nova-compute[71731]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27919afc-8990-4ed5-af9e-9d6b3d7b231e (non-flash)
Apr 13 16:22:27 user nova-compute[71731]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc639d00-ef6b-4121-bcb0-c65ec0347abd (non-flash)
Apr 13 16:22:27 user nova-compute[71731]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0f728f3-fbb5-4ed8-a78b-a5d982b03f7d (non-flash)
Apr 13 16:22:27 user nova-compute[71731]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91d1caca-70d0-452f-800d-0073afd5d0c4 (non-flash)
Apr 13 16:22:27 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 16:22:27 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef61c617-614d-4200-bf83-d162e485a54c tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e3b49ec-80af-4c38-9689-f7277e495d21 (non-flash)
Apr 13 16:22:27 user nova-compute[71731]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984 (non-flash)
Apr 13 16:22:27 user nova-compute[71731]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c7f6ad-d2c2-465a-b39e-47347aa85be0 (non-flash)
Apr 13 16:22:27 user nova-compute[71731]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48af37b0-6938-432e-b374-d992c4dd9ae9 (non-flash)
Apr 13 16:22:27 user nova-compute[71731]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c20e80fa-58de-431a-8901-2535657aaadf (non-flash)
Apr 13 16:22:27 user nova-compute[71731]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27919afc-8990-4ed5-af9e-9d6b3d7b231e (non-flash)
Apr 13 16:22:27 user nova-compute[71731]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc639d00-ef6b-4121-bcb0-c65ec0347abd (non-flash)
Apr 13 16:22:27 user nova-compute[71731]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0f728f3-fbb5-4ed8-a78b-a5d982b03f7d (non-flash)
Apr 13 16:22:27 user nova-compute[71731]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91d1caca-70d0-452f-800d-0073afd5d0c4 (non-flash)
Apr 13 16:22:27 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 16:22:27 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef61c617-614d-4200-bf83-d162e485a54c tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8cff4d8c10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:91d1caca-70d0-452f-800d-0073afd5d0c4'): ({'sdi'}, set())}) {{(pid=71731) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 16:22:27 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-ef61c617-614d-4200-bf83-d162e485a54c tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] Removing single pathed devices sdi {{(pid=71731) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 16:22:27 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:22:27 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:22:27 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[83feee9e-78d0-4b68-a57f-75a9fa758739]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:22:27 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:22:27 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-a9e9309a-4a8d-4ece-ad0d-a2ad2657c5d6 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] No BDM found with device name vda, not building metadata. {{(pid=71731) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 16:22:27 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-a9e9309a-4a8d-4ece-ad0d-a2ad2657c5d6 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] No VIF found with MAC fa:16:3e:87:f9:e7, not building metadata {{(pid=71731) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 16:22:27 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.029s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:22:27 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[37a5d39a-4068-4a21-91e6-3ed0460ff5b7]: (4, ('ok\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:22:27 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-ef61c617-614d-4200-bf83-d162e485a54c tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] Flushing IO for device /dev/sdi {{(pid=71731) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 16:22:27 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:22:27 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.013s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:22:27 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[f730c196-e3a9-4f29-9fe3-bb63ec0faf40]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:22:27 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-ef61c617-614d-4200-bf83-d162e485a54c tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=71731) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 16:22:27 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:22:27 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.042s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:22:27 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[42cb4e81-8773-47f2-9a3f-5371820f7285]: (4, ('1', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:22:27 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-ef61c617-614d-4200-bf83-d162e485a54c tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=71731) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 16:22:27 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-ef61c617-614d-4200-bf83-d162e485a54c tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] SCSI volumes sdi have been removed. {{(pid=71731) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 16:22:27 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef61c617-614d-4200-bf83-d162e485a54c tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:91d1caca-70d0-452f-800d-0073afd5d0c4')] {{(pid=71731) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 16:22:27 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91d1caca-70d0-452f-800d-0073afd5d0c4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:22:27 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91d1caca-70d0-452f-800d-0073afd5d0c4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:22:27 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[55c196b2-0bc8-48f0-ad94-0b389311e893]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:22:27 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef61c617-614d-4200-bf83-d162e485a54c tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:22:27 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91d1caca-70d0-452f-800d-0073afd5d0c4 -p 172.16.0.220:3260 --logout {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:22:27 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91d1caca-70d0-452f-800d-0073afd5d0c4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:22:27 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[01a28b1f-cf80-4cda-b734-3fef2ca52e1d]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:91d1caca-70d0-452f-800d-0073afd5d0c4, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:91d1caca-70d0-452f-800d-0073afd5d0c4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:22:27 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef61c617-614d-4200-bf83-d162e485a54c tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:91d1caca-70d0-452f-800d-0073afd5d0c4, portal: 172.16.0.220,3260]
Apr 13 16:22:27 user nova-compute[71731]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:91d1caca-70d0-452f-800d-0073afd5d0c4, portal: 172.16.0.220,3260] successful.
Apr 13 16:22:27 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:22:27 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91d1caca-70d0-452f-800d-0073afd5d0c4 -p 172.16.0.220:3260 --op delete {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:22:27 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91d1caca-70d0-452f-800d-0073afd5d0c4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.038s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:22:27 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7f8f7f1-c806-431c-b5b0-965a9fe9b9b8]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:22:27 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef61c617-614d-4200-bf83-d162e485a54c tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:22:27 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-ef61c617-614d-4200-bf83-d162e485a54c tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.359s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 16:22:27 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef61c617-614d-4200-bf83-d162e485a54c tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] <== disconnect_volume: return (1146ms) None {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 16:22:27 user nova-compute[71731]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ef61c617-614d-4200-bf83-d162e485a54c tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] [instance: 823749e1-56ca-44f9-be83-a36b4851c28f] Disconnected iSCSI Volume {{(pid=71731) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 16:22:27 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-ef61c617-614d-4200-bf83-d162e485a54c tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] [instance: 823749e1-56ca-44f9-be83-a36b4851c28f] Deleting instance files /opt/stack/data/nova/instances/823749e1-56ca-44f9-be83-a36b4851c28f_del
Apr 13 16:22:27 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-ef61c617-614d-4200-bf83-d162e485a54c tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] [instance: 823749e1-56ca-44f9-be83-a36b4851c28f] Deletion of /opt/stack/data/nova/instances/823749e1-56ca-44f9-be83-a36b4851c28f_del complete
Apr 13 16:22:27 user nova-compute[71731]: INFO nova.compute.manager [None req-ef61c617-614d-4200-bf83-d162e485a54c tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] [instance: 823749e1-56ca-44f9-be83-a36b4851c28f] Took 2.06 seconds to destroy the instance on the hypervisor.
Apr 13 16:22:27 user nova-compute[71731]: DEBUG oslo.service.loopingcall [None req-ef61c617-614d-4200-bf83-d162e485a54c tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71731) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 16:22:27 user nova-compute[71731]: DEBUG nova.compute.manager [-] [instance: 823749e1-56ca-44f9-be83-a36b4851c28f] Deallocating network for instance {{(pid=71731) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 16:22:27 user nova-compute[71731]: DEBUG nova.network.neutron [-] [instance: 823749e1-56ca-44f9-be83-a36b4851c28f] deallocate_for_instance() {{(pid=71731) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 16:22:27 user nova-compute[71731]: DEBUG nova.network.neutron [-] [instance: 823749e1-56ca-44f9-be83-a36b4851c28f] Updating instance_info_cache with network_info: [] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:22:27 user nova-compute[71731]: DEBUG nova.compute.manager [req-e5b2bff3-7d45-4927-9814-d4228c4c685a req-6f21922a-635b-4906-b4a4-c5c35933f9e2 service nova] [instance: 823749e1-56ca-44f9-be83-a36b4851c28f] Received event network-vif-plugged-f4e8f99d-1c8f-44b8-84f1-0f43a156e8b0 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:22:27 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-e5b2bff3-7d45-4927-9814-d4228c4c685a req-6f21922a-635b-4906-b4a4-c5c35933f9e2 service nova] Acquiring lock "823749e1-56ca-44f9-be83-a36b4851c28f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:22:27 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-e5b2bff3-7d45-4927-9814-d4228c4c685a req-6f21922a-635b-4906-b4a4-c5c35933f9e2 service nova] Lock "823749e1-56ca-44f9-be83-a36b4851c28f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:22:27 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-e5b2bff3-7d45-4927-9814-d4228c4c685a req-6f21922a-635b-4906-b4a4-c5c35933f9e2 service nova] Lock "823749e1-56ca-44f9-be83-a36b4851c28f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:22:27 user nova-compute[71731]: DEBUG nova.compute.manager [req-e5b2bff3-7d45-4927-9814-d4228c4c685a req-6f21922a-635b-4906-b4a4-c5c35933f9e2 service nova] [instance: 823749e1-56ca-44f9-be83-a36b4851c28f] No waiting events found dispatching network-vif-plugged-f4e8f99d-1c8f-44b8-84f1-0f43a156e8b0 {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:22:27 user nova-compute[71731]: WARNING nova.compute.manager [req-e5b2bff3-7d45-4927-9814-d4228c4c685a req-6f21922a-635b-4906-b4a4-c5c35933f9e2 service nova] [instance: 823749e1-56ca-44f9-be83-a36b4851c28f] Received unexpected event network-vif-plugged-f4e8f99d-1c8f-44b8-84f1-0f43a156e8b0 for instance with vm_state active and task_state deleting.
Apr 13 16:22:27 user nova-compute[71731]: INFO nova.compute.manager [-] [instance: 823749e1-56ca-44f9-be83-a36b4851c28f] Took 0.54 seconds to deallocate network for instance.
Apr 13 16:22:27 user nova-compute[71731]: DEBUG nova.compute.manager [req-37df6981-08ab-40ac-980a-2cffa9ab330c req-b2b73db1-91c3-4faf-b635-f1867e43a290 service nova] [instance: 823749e1-56ca-44f9-be83-a36b4851c28f] Received event network-vif-deleted-f4e8f99d-1c8f-44b8-84f1-0f43a156e8b0 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:22:27 user nova-compute[71731]: INFO nova.compute.manager [req-37df6981-08ab-40ac-980a-2cffa9ab330c req-b2b73db1-91c3-4faf-b635-f1867e43a290 service nova] [instance: 823749e1-56ca-44f9-be83-a36b4851c28f] Neutron deleted interface f4e8f99d-1c8f-44b8-84f1-0f43a156e8b0; detaching it from the instance and deleting it from the info cache
Apr 13 16:22:27 user nova-compute[71731]: DEBUG nova.network.neutron [req-37df6981-08ab-40ac-980a-2cffa9ab330c req-b2b73db1-91c3-4faf-b635-f1867e43a290 service nova] [instance: 823749e1-56ca-44f9-be83-a36b4851c28f] Updating instance_info_cache with network_info: [] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:22:27 user nova-compute[71731]: DEBUG nova.compute.manager [req-37df6981-08ab-40ac-980a-2cffa9ab330c req-b2b73db1-91c3-4faf-b635-f1867e43a290 service nova] [instance: 823749e1-56ca-44f9-be83-a36b4851c28f] Detach interface failed, port_id=f4e8f99d-1c8f-44b8-84f1-0f43a156e8b0, reason: Instance 823749e1-56ca-44f9-be83-a36b4851c28f could not be found. {{(pid=71731) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 13 16:22:28 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:22:28 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:22:28 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:22:28 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:22:28 user nova-compute[71731]: INFO nova.compute.manager [None req-ef61c617-614d-4200-bf83-d162e485a54c tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] [instance: 823749e1-56ca-44f9-be83-a36b4851c28f] Took 0.95 seconds to detach 1 volumes for instance.
Apr 13 16:22:28 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-ef61c617-614d-4200-bf83-d162e485a54c tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:22:28 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-ef61c617-614d-4200-bf83-d162e485a54c tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:22:28 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:22:28 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:22:29 user nova-compute[71731]: DEBUG nova.compute.provider_tree [None req-ef61c617-614d-4200-bf83-d162e485a54c tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] Inventory has not changed in ProviderTree for provider: cb6b1a64-0c24-4e2d-af1e-16576ca9165c {{(pid=71731) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 16:22:29 user nova-compute[71731]: DEBUG nova.scheduler.client.report [None req-ef61c617-614d-4200-bf83-d162e485a54c tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] Inventory has not changed for provider cb6b1a64-0c24-4e2d-af1e-16576ca9165c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71731) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 16:22:29 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-ef61c617-614d-4200-bf83-d162e485a54c tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.386s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:22:29 user nova-compute[71731]: INFO nova.scheduler.client.report [None req-ef61c617-614d-4200-bf83-d162e485a54c tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] Deleted allocations for instance 823749e1-56ca-44f9-be83-a36b4851c28f
Apr 13 16:22:29 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-ef61c617-614d-4200-bf83-d162e485a54c tempest-DeleteServersTestJSON-1138024295 tempest-DeleteServersTestJSON-1138024295-project-member] Lock "823749e1-56ca-44f9-be83-a36b4851c28f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.189s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:22:29 user nova-compute[71731]: DEBUG nova.compute.manager [req-b8fd4d37-a7e9-4f67-a2ca-ff61ca2bc3ee req-35fa3993-decc-4d7d-8a9b-ab0106f6db4a service nova] [instance: db65920b-7872-44c1-a68a-a696681d9d95] Received event network-vif-plugged-ba686724-ae8a-4e16-9918-d7b2fc64ff62 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:22:29 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-b8fd4d37-a7e9-4f67-a2ca-ff61ca2bc3ee req-35fa3993-decc-4d7d-8a9b-ab0106f6db4a service nova] Acquiring lock "db65920b-7872-44c1-a68a-a696681d9d95-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:22:29 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-b8fd4d37-a7e9-4f67-a2ca-ff61ca2bc3ee req-35fa3993-decc-4d7d-8a9b-ab0106f6db4a service nova] Lock "db65920b-7872-44c1-a68a-a696681d9d95-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:22:29 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-b8fd4d37-a7e9-4f67-a2ca-ff61ca2bc3ee req-35fa3993-decc-4d7d-8a9b-ab0106f6db4a service nova] Lock "db65920b-7872-44c1-a68a-a696681d9d95-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:22:29 user nova-compute[71731]: DEBUG nova.compute.manager [req-b8fd4d37-a7e9-4f67-a2ca-ff61ca2bc3ee req-35fa3993-decc-4d7d-8a9b-ab0106f6db4a service nova] [instance: db65920b-7872-44c1-a68a-a696681d9d95] No waiting events found dispatching network-vif-plugged-ba686724-ae8a-4e16-9918-d7b2fc64ff62 {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:22:29 user nova-compute[71731]: WARNING nova.compute.manager [req-b8fd4d37-a7e9-4f67-a2ca-ff61ca2bc3ee req-35fa3993-decc-4d7d-8a9b-ab0106f6db4a service nova] [instance: db65920b-7872-44c1-a68a-a696681d9d95] Received unexpected event network-vif-plugged-ba686724-ae8a-4e16-9918-d7b2fc64ff62 for instance with vm_state building and task_state spawning.
Apr 13 16:22:29 user nova-compute[71731]: DEBUG nova.compute.manager [req-b8fd4d37-a7e9-4f67-a2ca-ff61ca2bc3ee req-35fa3993-decc-4d7d-8a9b-ab0106f6db4a service nova] [instance: db65920b-7872-44c1-a68a-a696681d9d95] Received event network-vif-plugged-ba686724-ae8a-4e16-9918-d7b2fc64ff62 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:22:29 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-b8fd4d37-a7e9-4f67-a2ca-ff61ca2bc3ee req-35fa3993-decc-4d7d-8a9b-ab0106f6db4a service nova] Acquiring lock "db65920b-7872-44c1-a68a-a696681d9d95-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:22:29 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-b8fd4d37-a7e9-4f67-a2ca-ff61ca2bc3ee req-35fa3993-decc-4d7d-8a9b-ab0106f6db4a service nova] Lock "db65920b-7872-44c1-a68a-a696681d9d95-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:22:29 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-b8fd4d37-a7e9-4f67-a2ca-ff61ca2bc3ee req-35fa3993-decc-4d7d-8a9b-ab0106f6db4a service nova] Lock "db65920b-7872-44c1-a68a-a696681d9d95-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:22:29 user nova-compute[71731]: DEBUG nova.compute.manager [req-b8fd4d37-a7e9-4f67-a2ca-ff61ca2bc3ee req-35fa3993-decc-4d7d-8a9b-ab0106f6db4a service nova] [instance: db65920b-7872-44c1-a68a-a696681d9d95] No waiting events found dispatching network-vif-plugged-ba686724-ae8a-4e16-9918-d7b2fc64ff62 {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:22:29 user nova-compute[71731]: WARNING nova.compute.manager [req-b8fd4d37-a7e9-4f67-a2ca-ff61ca2bc3ee req-35fa3993-decc-4d7d-8a9b-ab0106f6db4a service nova] [instance: db65920b-7872-44c1-a68a-a696681d9d95] Received unexpected event network-vif-plugged-ba686724-ae8a-4e16-9918-d7b2fc64ff62 for instance with vm_state building and task_state spawning.
Apr 13 16:22:30 user nova-compute[71731]: DEBUG nova.virt.driver [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Emitting event <LifecycleEvent: 1681402950.6043756, db65920b-7872-44c1-a68a-a696681d9d95 => Resumed> {{(pid=71731) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 16:22:30 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: db65920b-7872-44c1-a68a-a696681d9d95] VM Resumed (Lifecycle Event)
Apr 13 16:22:30 user nova-compute[71731]: DEBUG nova.compute.manager [None req-a9e9309a-4a8d-4ece-ad0d-a2ad2657c5d6 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: db65920b-7872-44c1-a68a-a696681d9d95] Instance event wait completed in 0 seconds for  {{(pid=71731) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 16:22:30 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-a9e9309a-4a8d-4ece-ad0d-a2ad2657c5d6 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: db65920b-7872-44c1-a68a-a696681d9d95] Guest created on hypervisor {{(pid=71731) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 16:22:30 user nova-compute[71731]: INFO nova.virt.libvirt.driver [-] [instance: db65920b-7872-44c1-a68a-a696681d9d95] Instance spawned successfully.
Apr 13 16:22:30 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-a9e9309a-4a8d-4ece-ad0d-a2ad2657c5d6 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: db65920b-7872-44c1-a68a-a696681d9d95] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 16:22:30 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: db65920b-7872-44c1-a68a-a696681d9d95] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:22:30 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: db65920b-7872-44c1-a68a-a696681d9d95] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71731) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 16:22:30 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-a9e9309a-4a8d-4ece-ad0d-a2ad2657c5d6 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: db65920b-7872-44c1-a68a-a696681d9d95] Found default for hw_cdrom_bus of ide {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:22:30 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-a9e9309a-4a8d-4ece-ad0d-a2ad2657c5d6 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: db65920b-7872-44c1-a68a-a696681d9d95] Found default for hw_disk_bus of virtio {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:22:30 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-a9e9309a-4a8d-4ece-ad0d-a2ad2657c5d6 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: db65920b-7872-44c1-a68a-a696681d9d95] Found default for hw_input_bus of None {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:22:30 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-a9e9309a-4a8d-4ece-ad0d-a2ad2657c5d6 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: db65920b-7872-44c1-a68a-a696681d9d95] Found default for hw_pointer_model of None {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:22:30 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-a9e9309a-4a8d-4ece-ad0d-a2ad2657c5d6 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: db65920b-7872-44c1-a68a-a696681d9d95] Found default for hw_video_model of virtio {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:22:30 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-a9e9309a-4a8d-4ece-ad0d-a2ad2657c5d6 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: db65920b-7872-44c1-a68a-a696681d9d95] Found default for hw_vif_model of virtio {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:22:30 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: db65920b-7872-44c1-a68a-a696681d9d95] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 16:22:30 user nova-compute[71731]: DEBUG nova.virt.driver [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Emitting event <LifecycleEvent: 1681402950.6057484, db65920b-7872-44c1-a68a-a696681d9d95 => Started> {{(pid=71731) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 16:22:30 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: db65920b-7872-44c1-a68a-a696681d9d95] VM Started (Lifecycle Event)
Apr 13 16:22:30 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: db65920b-7872-44c1-a68a-a696681d9d95] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:22:30 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: db65920b-7872-44c1-a68a-a696681d9d95] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71731) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 16:22:30 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: db65920b-7872-44c1-a68a-a696681d9d95] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 16:22:30 user nova-compute[71731]: INFO nova.compute.manager [None req-a9e9309a-4a8d-4ece-ad0d-a2ad2657c5d6 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: db65920b-7872-44c1-a68a-a696681d9d95] Took 5.33 seconds to spawn the instance on the hypervisor.
Apr 13 16:22:30 user nova-compute[71731]: DEBUG nova.compute.manager [None req-a9e9309a-4a8d-4ece-ad0d-a2ad2657c5d6 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: db65920b-7872-44c1-a68a-a696681d9d95] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:22:30 user nova-compute[71731]: INFO nova.compute.manager [None req-a9e9309a-4a8d-4ece-ad0d-a2ad2657c5d6 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: db65920b-7872-44c1-a68a-a696681d9d95] Took 17.46 seconds to build instance.
Apr 13 16:22:31 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-a9e9309a-4a8d-4ece-ad0d-a2ad2657c5d6 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "db65920b-7872-44c1-a68a-a696681d9d95" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.559s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:22:31 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:22:31 user nova-compute[71731]: DEBUG nova.compute.manager [req-d4ec3845-8bc1-4ae0-a3bc-9def28116ab8 req-3445758d-7ba2-4238-8c14-b69005922a60 service nova] [instance: 5db1cb51-2e5a-46c9-8914-cba759a96a65] Received event network-changed-628a1eb7-e3f1-4158-9f9e-1ae752c91c0b {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:22:31 user nova-compute[71731]: DEBUG nova.compute.manager [req-d4ec3845-8bc1-4ae0-a3bc-9def28116ab8 req-3445758d-7ba2-4238-8c14-b69005922a60 service nova] [instance: 5db1cb51-2e5a-46c9-8914-cba759a96a65] Refreshing instance network info cache due to event network-changed-628a1eb7-e3f1-4158-9f9e-1ae752c91c0b. {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 16:22:31 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-d4ec3845-8bc1-4ae0-a3bc-9def28116ab8 req-3445758d-7ba2-4238-8c14-b69005922a60 service nova] Acquiring lock "refresh_cache-5db1cb51-2e5a-46c9-8914-cba759a96a65" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 16:22:31 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-d4ec3845-8bc1-4ae0-a3bc-9def28116ab8 req-3445758d-7ba2-4238-8c14-b69005922a60 service nova] Acquired lock "refresh_cache-5db1cb51-2e5a-46c9-8914-cba759a96a65" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 16:22:31 user nova-compute[71731]: DEBUG nova.network.neutron [req-d4ec3845-8bc1-4ae0-a3bc-9def28116ab8 req-3445758d-7ba2-4238-8c14-b69005922a60 service nova] [instance: 5db1cb51-2e5a-46c9-8914-cba759a96a65] Refreshing network info cache for port 628a1eb7-e3f1-4158-9f9e-1ae752c91c0b {{(pid=71731) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 16:22:31 user nova-compute[71731]: DEBUG nova.network.neutron [req-d4ec3845-8bc1-4ae0-a3bc-9def28116ab8 req-3445758d-7ba2-4238-8c14-b69005922a60 service nova] [instance: 5db1cb51-2e5a-46c9-8914-cba759a96a65] Updated VIF entry in instance network info cache for port 628a1eb7-e3f1-4158-9f9e-1ae752c91c0b. {{(pid=71731) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 16:22:31 user nova-compute[71731]: DEBUG nova.network.neutron [req-d4ec3845-8bc1-4ae0-a3bc-9def28116ab8 req-3445758d-7ba2-4238-8c14-b69005922a60 service nova] [instance: 5db1cb51-2e5a-46c9-8914-cba759a96a65] Updating instance_info_cache with network_info: [{"id": "628a1eb7-e3f1-4158-9f9e-1ae752c91c0b", "address": "fa:16:3e:fa:44:3c", "network": {"id": "fc7f5f86-d676-4a45-b0f4-c93f3eae043e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1421861184-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.129", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ded8a69b7e941f9bcdc502cfeed79db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap628a1eb7-e3", "ovs_interfaceid": "628a1eb7-e3f1-4158-9f9e-1ae752c91c0b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:22:31 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-d4ec3845-8bc1-4ae0-a3bc-9def28116ab8 req-3445758d-7ba2-4238-8c14-b69005922a60 service nova] Releasing lock "refresh_cache-5db1cb51-2e5a-46c9-8914-cba759a96a65" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 16:22:32 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:22:33 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-d67230b8-45f9-4a97-a9d4-1a3fb0962b1c tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Acquiring lock "5db1cb51-2e5a-46c9-8914-cba759a96a65" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:22:33 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-d67230b8-45f9-4a97-a9d4-1a3fb0962b1c tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Lock "5db1cb51-2e5a-46c9-8914-cba759a96a65" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:22:33 user nova-compute[71731]: DEBUG nova.objects.instance [None req-d67230b8-45f9-4a97-a9d4-1a3fb0962b1c tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Lazy-loading 'flavor' on Instance uuid 5db1cb51-2e5a-46c9-8914-cba759a96a65 {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:22:33 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-d67230b8-45f9-4a97-a9d4-1a3fb0962b1c tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Lock "5db1cb51-2e5a-46c9-8914-cba759a96a65" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:22:34 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-d67230b8-45f9-4a97-a9d4-1a3fb0962b1c tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Acquiring lock "5db1cb51-2e5a-46c9-8914-cba759a96a65" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:22:34 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-d67230b8-45f9-4a97-a9d4-1a3fb0962b1c tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Lock "5db1cb51-2e5a-46c9-8914-cba759a96a65" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:22:34 user nova-compute[71731]: INFO nova.compute.manager [None req-d67230b8-45f9-4a97-a9d4-1a3fb0962b1c tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] [instance: 5db1cb51-2e5a-46c9-8914-cba759a96a65] Attaching volume a30cce7b-6caa-4d42-92a5-d1d6892edf6e to /dev/vdb
Apr 13 16:22:34 user nova-compute[71731]: DEBUG os_brick.utils [None req-d67230b8-45f9-4a97-a9d4-1a3fb0962b1c tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 16:22:34 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:22:34 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:22:34 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd0d277d-f606-406c-bde6-c2ef04c08717]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:81501d91421\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:22:34 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:22:34 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:22:34 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[43ef6f42-49b4-4f9e-8b70-9ad6478fd534]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:22:34 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:22:34 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:22:34 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8142de0-9a6d-4239-aa7c-67048cd9ce3d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:22:34 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[00c65713-7c8f-4af4-be6f-12cde9251dad]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:22:34 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-d67230b8-45f9-4a97-a9d4-1a3fb0962b1c tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Running cmd (subprocess): nvme version {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:22:34 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-d67230b8-45f9-4a97-a9d4-1a3fb0962b1c tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] 'nvme version' failed. Not Retrying. {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 16:22:34 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d67230b8-45f9-4a97-a9d4-1a3fb0962b1c tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] nvme not present on system {{(pid=71731) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 16:22:34 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:22:34 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 16:22:34 user nova-compute[71731]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 16:22:34 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[97874dd8-062d-41a4-afbf-b2ab282e5539]: (4, '') {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:22:34 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.lightos [None req-d67230b8-45f9-4a97-a9d4-1a3fb0962b1c tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71731) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 16:22:34 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.lightos [None req-d67230b8-45f9-4a97-a9d4-1a3fb0962b1c tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71731) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 16:22:34 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.lightos [None req-d67230b8-45f9-4a97-a9d4-1a3fb0962b1c tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] LIGHTOS: no hostnqn found. {{(pid=71731) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 16:22:34 user nova-compute[71731]: DEBUG os_brick.utils [None req-d67230b8-45f9-4a97-a9d4-1a3fb0962b1c tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] <== get_connector_properties: return (113ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:81501d91421', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 16:22:34 user nova-compute[71731]: DEBUG nova.virt.block_device [None req-d67230b8-45f9-4a97-a9d4-1a3fb0962b1c tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] [instance: 5db1cb51-2e5a-46c9-8914-cba759a96a65] Updating existing volume attachment record: 06282b43-79b8-4018-a112-4c758ba2af08 {{(pid=71731) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 16:22:36 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:22:37 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:22:38 user nova-compute[71731]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d67230b8-45f9-4a97-a9d4-1a3fb0962b1c tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] [instance: 5db1cb51-2e5a-46c9-8914-cba759a96a65] Calling os-brick to attach iSCSI Volume {{(pid=71731) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 16:22:38 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-d67230b8-45f9-4a97-a9d4-1a3fb0962b1c tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8cf0118790>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a30cce7b-6caa-4d42-92a5-d1d6892edf6e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vQyIlHSq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 16:22:38 user nova-compute[71731]: WARNING os_brick.initiator.connectors.base [None req-d67230b8-45f9-4a97-a9d4-1a3fb0962b1c tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 16:22:38 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-d67230b8-45f9-4a97-a9d4-1a3fb0962b1c tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 16:22:38 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-d67230b8-45f9-4a97-a9d4-1a3fb0962b1c tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 16:22:38 user nova-compute[71731]: WARNING os_brick.initiator.connectors.base [None req-d67230b8-45f9-4a97-a9d4-1a3fb0962b1c tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 16:22:38 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-d67230b8-45f9-4a97-a9d4-1a3fb0962b1c tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a30cce7b-6caa-4d42-92a5-d1d6892edf6e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 16:22:38 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-d67230b8-45f9-4a97-a9d4-1a3fb0962b1c tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a30cce7b-6caa-4d42-92a5-d1d6892edf6e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 16:22:38 user nova-compute[71731]: INFO os_brick.initiator.connectors.iscsi [None req-d67230b8-45f9-4a97-a9d4-1a3fb0962b1c tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 16:22:38 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a30cce7b-6caa-4d42-92a5-d1d6892edf6e -p 172.16.0.220:3260 {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:22:38 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a30cce7b-6caa-4d42-92a5-d1d6892edf6e -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:22:38 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[458797b2-5758-4fae-9f81-03ea911b7b0a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:22:38 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-d67230b8-45f9-4a97-a9d4-1a3fb0962b1c tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 16:22:38 user nova-compute[71731]:  {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:22:38 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a30cce7b-6caa-4d42-92a5-d1d6892edf6e -p 172.16.0.220:3260 --interface default --op new {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:22:38 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a30cce7b-6caa-4d42-92a5-d1d6892edf6e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:22:38 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a24aa9a-ff51-4856-9601-477d22e60b5f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a30cce7b-6caa-4d42-92a5-d1d6892edf6e] added\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:22:38 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-d67230b8-45f9-4a97-a9d4-1a3fb0962b1c tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a30cce7b-6caa-4d42-92a5-d1d6892edf6e] added
Apr 13 16:22:38 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:22:38 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a30cce7b-6caa-4d42-92a5-d1d6892edf6e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:22:39 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a30cce7b-6caa-4d42-92a5-d1d6892edf6e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:22:39 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e6d9491-040f-4362-b31e-1709ce9ec424]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:22:39 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-d67230b8-45f9-4a97-a9d4-1a3fb0962b1c tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:22:39 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a30cce7b-6caa-4d42-92a5-d1d6892edf6e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:22:39 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a30cce7b-6caa-4d42-92a5-d1d6892edf6e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:22:39 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[10615d8e-1d2d-4e17-9c00-f3735df58e92]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:22:39 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-d67230b8-45f9-4a97-a9d4-1a3fb0962b1c tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:22:39 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a30cce7b-6caa-4d42-92a5-d1d6892edf6e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vQyIlHSq {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:22:39 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a30cce7b-6caa-4d42-92a5-d1d6892edf6e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vQyIlHSq" returned: 0 in 0.020s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:22:39 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[e06b79b3-4a3a-4625-a628-64e69b449436]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:22:39 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-d67230b8-45f9-4a97-a9d4-1a3fb0962b1c tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vQyIlHSq'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:22:39 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a30cce7b-6caa-4d42-92a5-d1d6892edf6e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:22:39 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a30cce7b-6caa-4d42-92a5-d1d6892edf6e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:22:39 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[4feed759-f5b3-4c06-a36e-125eb444b774]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:22:39 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-d67230b8-45f9-4a97-a9d4-1a3fb0962b1c tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:22:39 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:22:39 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:22:39 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[93a3945e-1674-4fe8-84e6-de320f2caa16]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e3b49ec-80af-4c38-9689-f7277e495d21 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c7f6ad-d2c2-465a-b39e-47347aa85be0 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48af37b0-6938-432e-b374-d992c4dd9ae9 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c20e80fa-58de-431a-8901-2535657aaadf (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27919afc-8990-4ed5-af9e-9d6b3d7b231e (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc639d00-ef6b-4121-bcb0-c65ec0347abd (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0f728f3-fbb5-4ed8-a78b-a5d982b03f7d (non-flash)\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:22:39 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-d67230b8-45f9-4a97-a9d4-1a3fb0962b1c tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e3b49ec-80af-4c38-9689-f7277e495d21 (non-flash)
Apr 13 16:22:39 user nova-compute[71731]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984 (non-flash)
Apr 13 16:22:39 user nova-compute[71731]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c7f6ad-d2c2-465a-b39e-47347aa85be0 (non-flash)
Apr 13 16:22:39 user nova-compute[71731]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48af37b0-6938-432e-b374-d992c4dd9ae9 (non-flash)
Apr 13 16:22:39 user nova-compute[71731]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c20e80fa-58de-431a-8901-2535657aaadf (non-flash)
Apr 13 16:22:39 user nova-compute[71731]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27919afc-8990-4ed5-af9e-9d6b3d7b231e (non-flash)
Apr 13 16:22:39 user nova-compute[71731]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc639d00-ef6b-4121-bcb0-c65ec0347abd (non-flash)
Apr 13 16:22:39 user nova-compute[71731]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0f728f3-fbb5-4ed8-a78b-a5d982b03f7d (non-flash)
Apr 13 16:22:39 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 16:22:39 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-d67230b8-45f9-4a97-a9d4-1a3fb0962b1c tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e3b49ec-80af-4c38-9689-f7277e495d21 (non-flash)
Apr 13 16:22:39 user nova-compute[71731]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984 (non-flash)
Apr 13 16:22:39 user nova-compute[71731]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c7f6ad-d2c2-465a-b39e-47347aa85be0 (non-flash)
Apr 13 16:22:39 user nova-compute[71731]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48af37b0-6938-432e-b374-d992c4dd9ae9 (non-flash)
Apr 13 16:22:39 user nova-compute[71731]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c20e80fa-58de-431a-8901-2535657aaadf (non-flash)
Apr 13 16:22:39 user nova-compute[71731]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27919afc-8990-4ed5-af9e-9d6b3d7b231e (non-flash)
Apr 13 16:22:39 user nova-compute[71731]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc639d00-ef6b-4121-bcb0-c65ec0347abd (non-flash)
Apr 13 16:22:39 user nova-compute[71731]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0f728f3-fbb5-4ed8-a78b-a5d982b03f7d (non-flash)
Apr 13 16:22:39 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 16:22:39 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a30cce7b-6caa-4d42-92a5-d1d6892edf6e -p 172.16.0.220:3260 --login {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:22:39 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a30cce7b-6caa-4d42-92a5-d1d6892edf6e -p 172.16.0.220:3260 --login" returned: 0 in 0.088s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:22:39 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c86794a-a593-4437-b435-7eb90e714cfe]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a30cce7b-6caa-4d42-92a5-d1d6892edf6e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a30cce7b-6caa-4d42-92a5-d1d6892edf6e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:22:39 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-d67230b8-45f9-4a97-a9d4-1a3fb0962b1c tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a30cce7b-6caa-4d42-92a5-d1d6892edf6e, portal: 172.16.0.220,3260]
Apr 13 16:22:39 user nova-compute[71731]: Login to [iface: default, target: iqn.2010-10.org.openstack:a30cce7b-6caa-4d42-92a5-d1d6892edf6e, portal: 172.16.0.220,3260] successful.
Apr 13 16:22:39 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:22:39 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a30cce7b-6caa-4d42-92a5-d1d6892edf6e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:22:39 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a30cce7b-6caa-4d42-92a5-d1d6892edf6e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:22:39 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[aece3881-19e0-472c-976e-4aeaac9286f3]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:22:39 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-d67230b8-45f9-4a97-a9d4-1a3fb0962b1c tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:22:39 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:22:39 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:22:39 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[74162daa-50bc-4d1b-9249-6d8124c26bed]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e3b49ec-80af-4c38-9689-f7277e495d21 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a30cce7b-6caa-4d42-92a5-d1d6892edf6e (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c7f6ad-d2c2-465a-b39e-47347aa85be0 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48af37b0-6938-432e-b374-d992c4dd9ae9 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c20e80fa-58de-431a-8901-2535657aaadf (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27919afc-8990-4ed5-af9e-9d6b3d7b231e (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc639d00-ef6b-4121-bcb0-c65ec0347abd (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0f728f3-fbb5-4ed8-a78b-a5d982b03f7d (non-flash)\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:22:39 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-d67230b8-45f9-4a97-a9d4-1a3fb0962b1c tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e3b49ec-80af-4c38-9689-f7277e495d21 (non-flash)
Apr 13 16:22:39 user nova-compute[71731]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a30cce7b-6caa-4d42-92a5-d1d6892edf6e (non-flash)
Apr 13 16:22:39 user nova-compute[71731]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984 (non-flash)
Apr 13 16:22:39 user nova-compute[71731]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c7f6ad-d2c2-465a-b39e-47347aa85be0 (non-flash)
Apr 13 16:22:39 user nova-compute[71731]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48af37b0-6938-432e-b374-d992c4dd9ae9 (non-flash)
Apr 13 16:22:39 user nova-compute[71731]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c20e80fa-58de-431a-8901-2535657aaadf (non-flash)
Apr 13 16:22:39 user nova-compute[71731]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27919afc-8990-4ed5-af9e-9d6b3d7b231e (non-flash)
Apr 13 16:22:39 user nova-compute[71731]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc639d00-ef6b-4121-bcb0-c65ec0347abd (non-flash)
Apr 13 16:22:39 user nova-compute[71731]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0f728f3-fbb5-4ed8-a78b-a5d982b03f7d (non-flash)
Apr 13 16:22:39 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 16:22:39 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-d67230b8-45f9-4a97-a9d4-1a3fb0962b1c tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e3b49ec-80af-4c38-9689-f7277e495d21 (non-flash)
Apr 13 16:22:39 user nova-compute[71731]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a30cce7b-6caa-4d42-92a5-d1d6892edf6e (non-flash)
Apr 13 16:22:39 user nova-compute[71731]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984 (non-flash)
Apr 13 16:22:39 user nova-compute[71731]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c7f6ad-d2c2-465a-b39e-47347aa85be0 (non-flash)
Apr 13 16:22:39 user nova-compute[71731]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48af37b0-6938-432e-b374-d992c4dd9ae9 (non-flash)
Apr 13 16:22:39 user nova-compute[71731]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c20e80fa-58de-431a-8901-2535657aaadf (non-flash)
Apr 13 16:22:39 user nova-compute[71731]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27919afc-8990-4ed5-af9e-9d6b3d7b231e (non-flash)
Apr 13 16:22:39 user nova-compute[71731]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc639d00-ef6b-4121-bcb0-c65ec0347abd (non-flash)
Apr 13 16:22:39 user nova-compute[71731]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0f728f3-fbb5-4ed8-a78b-a5d982b03f7d (non-flash)
Apr 13 16:22:39 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 16:22:39 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-d67230b8-45f9-4a97-a9d4-1a3fb0962b1c tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a30cce7b-6caa-4d42-92a5-d1d6892edf6e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.340s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 16:22:39 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-d67230b8-45f9-4a97-a9d4-1a3fb0962b1c tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Connected to 172.16.0.220:3260 {{(pid=71731) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 16:22:39 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-d67230b8-45f9-4a97-a9d4-1a3fb0962b1c tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] HCTL ('40', '-', '-', 0) found on session 11 with lun 0 {{(pid=71731) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 16:22:39 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-d67230b8-45f9-4a97-a9d4-1a3fb0962b1c tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=71731) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 16:22:39 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:22:39 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.015s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:22:39 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9acd7e1-30e2-47c1-beb6-283e8b887d22]: (4, ('- - 0', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:22:39 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-d67230b8-45f9-4a97-a9d4-1a3fb0962b1c tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Searching for a device in session 11 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=71731) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 16:22:39 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-d67230b8-45f9-4a97-a9d4-1a3fb0962b1c tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:a30cce7b-6caa-4d42-92a5-d1d6892edf6e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vQyIlHSq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71731) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 16:22:40 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-d67230b8-45f9-4a97-a9d4-1a3fb0962b1c tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.376s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 16:22:40 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-d67230b8-45f9-4a97-a9d4-1a3fb0962b1c tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] <== connect_volume: return (1378ms) {'type': 'block', 'scsi_wwn': '23063356237326563', 'path': '/dev/sdi'} {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 16:22:40 user nova-compute[71731]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d67230b8-45f9-4a97-a9d4-1a3fb0962b1c tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] [instance: 5db1cb51-2e5a-46c9-8914-cba759a96a65] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23063356237326563', 'path': '/dev/sdi'} {{(pid=71731) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 16:22:40 user nova-compute[71731]: DEBUG nova.objects.instance [None req-d67230b8-45f9-4a97-a9d4-1a3fb0962b1c tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Lazy-loading 'flavor' on Instance uuid 5db1cb51-2e5a-46c9-8914-cba759a96a65 {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:22:40 user nova-compute[71731]: DEBUG nova.virt.libvirt.guest [None req-d67230b8-45f9-4a97-a9d4-1a3fb0962b1c tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] attach device xml: <disk type="block" device="disk">
Apr 13 16:22:40 user nova-compute[71731]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 16:22:40 user nova-compute[71731]:   <source dev="/dev/sdi"/>
Apr 13 16:22:40 user nova-compute[71731]:   <target dev="vdb" bus="virtio"/>
Apr 13 16:22:40 user nova-compute[71731]:   <serial>a30cce7b-6caa-4d42-92a5-d1d6892edf6e</serial>
Apr 13 16:22:40 user nova-compute[71731]: </disk>
Apr 13 16:22:40 user nova-compute[71731]:  {{(pid=71731) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 13 16:22:40 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-d67230b8-45f9-4a97-a9d4-1a3fb0962b1c tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] No BDM found with device name vda, not building metadata. {{(pid=71731) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 16:22:40 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-d67230b8-45f9-4a97-a9d4-1a3fb0962b1c tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71731) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 16:22:40 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-d67230b8-45f9-4a97-a9d4-1a3fb0962b1c tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] No VIF found with MAC fa:16:3e:fa:44:3c, not building metadata {{(pid=71731) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 16:22:41 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:22:41 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-d67230b8-45f9-4a97-a9d4-1a3fb0962b1c tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Lock "5db1cb51-2e5a-46c9-8914-cba759a96a65" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.037s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:22:41 user nova-compute[71731]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681402946.110358, 823749e1-56ca-44f9-be83-a36b4851c28f => Stopped> {{(pid=71731) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 16:22:41 user nova-compute[71731]: INFO nova.compute.manager [-] [instance: 823749e1-56ca-44f9-be83-a36b4851c28f] VM Stopped (Lifecycle Event)
Apr 13 16:22:41 user nova-compute[71731]: DEBUG nova.compute.manager [None req-3e40192d-0434-49f5-8d37-502f4446ac40 None None] [instance: 823749e1-56ca-44f9-be83-a36b4851c28f] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:22:42 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:22:42 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-5457d13f-0ba3-4e09-8eaf-3f1315fb6695 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Acquiring lock "5db1cb51-2e5a-46c9-8914-cba759a96a65" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:22:42 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-5457d13f-0ba3-4e09-8eaf-3f1315fb6695 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Lock "5db1cb51-2e5a-46c9-8914-cba759a96a65" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:22:42 user nova-compute[71731]: INFO nova.compute.manager [None req-5457d13f-0ba3-4e09-8eaf-3f1315fb6695 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] [instance: 5db1cb51-2e5a-46c9-8914-cba759a96a65] Detaching volume a30cce7b-6caa-4d42-92a5-d1d6892edf6e
Apr 13 16:22:42 user nova-compute[71731]: INFO nova.virt.block_device [None req-5457d13f-0ba3-4e09-8eaf-3f1315fb6695 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] [instance: 5db1cb51-2e5a-46c9-8914-cba759a96a65] Attempting to driver detach volume a30cce7b-6caa-4d42-92a5-d1d6892edf6e from mountpoint /dev/vdb
Apr 13 16:22:42 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-5457d13f-0ba3-4e09-8eaf-3f1315fb6695 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Attempting to detach device vdb from instance 5db1cb51-2e5a-46c9-8914-cba759a96a65 from the persistent domain config. {{(pid=71731) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 13 16:22:42 user nova-compute[71731]: DEBUG nova.virt.libvirt.guest [None req-5457d13f-0ba3-4e09-8eaf-3f1315fb6695 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 16:22:42 user nova-compute[71731]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 16:22:42 user nova-compute[71731]:   <source dev="/dev/sdi"/>
Apr 13 16:22:42 user nova-compute[71731]:   <target dev="vdb" bus="virtio"/>
Apr 13 16:22:42 user nova-compute[71731]:   <serial>a30cce7b-6caa-4d42-92a5-d1d6892edf6e</serial>
Apr 13 16:22:42 user nova-compute[71731]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 13 16:22:42 user nova-compute[71731]: </disk>
Apr 13 16:22:42 user nova-compute[71731]:  {{(pid=71731) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 16:22:42 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-5457d13f-0ba3-4e09-8eaf-3f1315fb6695 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Successfully detached device vdb from instance 5db1cb51-2e5a-46c9-8914-cba759a96a65 from the persistent domain config.
Apr 13 16:22:42 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-5457d13f-0ba3-4e09-8eaf-3f1315fb6695 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 5db1cb51-2e5a-46c9-8914-cba759a96a65 from the live domain config. {{(pid=71731) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 13 16:22:42 user nova-compute[71731]: DEBUG nova.virt.libvirt.guest [None req-5457d13f-0ba3-4e09-8eaf-3f1315fb6695 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 16:22:42 user nova-compute[71731]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 16:22:42 user nova-compute[71731]:   <source dev="/dev/sdi"/>
Apr 13 16:22:42 user nova-compute[71731]:   <target dev="vdb" bus="virtio"/>
Apr 13 16:22:42 user nova-compute[71731]:   <serial>a30cce7b-6caa-4d42-92a5-d1d6892edf6e</serial>
Apr 13 16:22:42 user nova-compute[71731]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 13 16:22:42 user nova-compute[71731]: </disk>
Apr 13 16:22:42 user nova-compute[71731]:  {{(pid=71731) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 16:22:42 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Received event <DeviceRemovedEvent: 1681402962.7967494, 5db1cb51-2e5a-46c9-8914-cba759a96a65 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71731) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 13 16:22:42 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-5457d13f-0ba3-4e09-8eaf-3f1315fb6695 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 5db1cb51-2e5a-46c9-8914-cba759a96a65 {{(pid=71731) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 13 16:22:42 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-5457d13f-0ba3-4e09-8eaf-3f1315fb6695 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Successfully detached device vdb from instance 5db1cb51-2e5a-46c9-8914-cba759a96a65 from the live domain config.
Apr 13 16:22:42 user nova-compute[71731]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5457d13f-0ba3-4e09-8eaf-3f1315fb6695 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] [instance: 5db1cb51-2e5a-46c9-8914-cba759a96a65] calling os-brick to detach iSCSI Volume {{(pid=71731) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 16:22:42 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-5457d13f-0ba3-4e09-8eaf-3f1315fb6695 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8cf0118790>, {'target_iqn': 'iqn.2010-10.org.openstack:a30cce7b-6caa-4d42-92a5-d1d6892edf6e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vQyIlHSq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi': {}}" {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 16:22:42 user nova-compute[71731]: WARNING os_brick.initiator.connectors.base [None req-5457d13f-0ba3-4e09-8eaf-3f1315fb6695 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 16:22:42 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-5457d13f-0ba3-4e09-8eaf-3f1315fb6695 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 16:22:42 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-5457d13f-0ba3-4e09-8eaf-3f1315fb6695 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 16:22:42 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:22:42 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:22:42 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c5b3648-37d6-4dab-84bc-6a944c56326d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c20e80fa-58de-431a-8901-2535657aaadf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:27919afc-8990-4ed5-af9e-9d6b3d7b231e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0e3b49ec-80af-4c38-9689-f7277e495d21\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cc639d00-ef6b-4121-bcb0-c65ec0347abd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e0f728f3-fbb5-4ed8-a78b-a5d982b03f7d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:84c7f6ad-d2c2-465a-b39e-47347aa85be0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a30cce7b-6caa-4d42-92a5-d1d6892edf6e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:48af37b0-6938-432e-b374-d992c4dd9ae9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:22:42 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-5457d13f-0ba3-4e09-8eaf-3f1315fb6695 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 16:22:42 user nova-compute[71731]: No targets found.
Apr 13 16:22:42 user nova-compute[71731]: iSNS:
Apr 13 16:22:42 user nova-compute[71731]: No targets found.
Apr 13 16:22:42 user nova-compute[71731]: STATIC:
Apr 13 16:22:42 user nova-compute[71731]: Target: iqn.2010-10.org.openstack:c20e80fa-58de-431a-8901-2535657aaadf
Apr 13 16:22:42 user nova-compute[71731]:         Portal: 172.16.0.220:3260,-1
Apr 13 16:22:42 user nova-compute[71731]:                 Iface Name: default
Apr 13 16:22:42 user nova-compute[71731]: Target: iqn.2010-10.org.openstack:27919afc-8990-4ed5-af9e-9d6b3d7b231e
Apr 13 16:22:42 user nova-compute[71731]:         Portal: 172.16.0.220:3260,-1
Apr 13 16:22:42 user nova-compute[71731]:                 Iface Name: default
Apr 13 16:22:42 user nova-compute[71731]: Target: iqn.2010-10.org.openstack:0e3b49ec-80af-4c38-9689-f7277e495d21
Apr 13 16:22:42 user nova-compute[71731]:         Portal: 172.16.0.220:3260,-1
Apr 13 16:22:42 user nova-compute[71731]:                 Iface Name: default
Apr 13 16:22:42 user nova-compute[71731]: Target: iqn.2010-10.org.openstack:cc639d00-ef6b-4121-bcb0-c65ec0347abd
Apr 13 16:22:42 user nova-compute[71731]:         Portal: 172.16.0.220:3260,-1
Apr 13 16:22:42 user nova-compute[71731]:                 Iface Name: default
Apr 13 16:22:42 user nova-compute[71731]: Target: iqn.2010-10.org.openstack:e0f728f3-fbb5-4ed8-a78b-a5d982b03f7d
Apr 13 16:22:42 user nova-compute[71731]:         Portal: 172.16.0.220:3260,-1
Apr 13 16:22:42 user nova-compute[71731]:                 Iface Name: default
Apr 13 16:22:42 user nova-compute[71731]: Target: iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984
Apr 13 16:22:42 user nova-compute[71731]:         Portal: 172.16.0.220:3260,-1
Apr 13 16:22:42 user nova-compute[71731]:                 Iface Name: default
Apr 13 16:22:42 user nova-compute[71731]: Target: iqn.2010-10.org.openstack:84c7f6ad-d2c2-465a-b39e-47347aa85be0
Apr 13 16:22:42 user nova-compute[71731]:         Portal: 172.16.0.220:3260,-1
Apr 13 16:22:42 user nova-compute[71731]:                 Iface Name: default
Apr 13 16:22:42 user nova-compute[71731]: Target: iqn.2010-10.org.openstack:a30cce7b-6caa-4d42-92a5-d1d6892edf6e
Apr 13 16:22:42 user nova-compute[71731]:         Portal: 172.16.0.220:3260,-1
Apr 13 16:22:42 user nova-compute[71731]:                 Iface Name: default
Apr 13 16:22:42 user nova-compute[71731]: Target: iqn.2010-10.org.openstack:48af37b0-6938-432e-b374-d992c4dd9ae9
Apr 13 16:22:42 user nova-compute[71731]:         Portal: 172.16.0.220:3260,-1
Apr 13 16:22:42 user nova-compute[71731]:                 Iface Name: default
Apr 13 16:22:42 user nova-compute[71731]: FIRMWARE:
Apr 13 16:22:42 user nova-compute[71731]: No targets found.
Apr 13 16:22:42 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 16:22:42 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-5457d13f-0ba3-4e09-8eaf-3f1315fb6695 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 16:22:42 user nova-compute[71731]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 16:22:42 user nova-compute[71731]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71731) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 16:22:42 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-5457d13f-0ba3-4e09-8eaf-3f1315fb6695 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a30cce7b-6caa-4d42-92a5-d1d6892edf6e', 0)] {{(pid=71731) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 16:22:42 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:22:42 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:22:42 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a192906-11f1-4f55-ac22-92eb073b2574]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0e3b49ec-80af-4c38-9689-f7277e495d21\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:27919afc-8990-4ed5-af9e-9d6b3d7b231e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:48af37b0-6938-432e-b374-d992c4dd9ae9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:84c7f6ad-d2c2-465a-b39e-47347aa85be0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a30cce7b-6caa-4d42-92a5-d1d6892edf6e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c20e80fa-58de-431a-8901-2535657aaadf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cc639d00-ef6b-4121-bcb0-c65ec0347abd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e0f728f3-fbb5-4ed8-a78b-a5d982b03f7d\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:22:42 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:22:42 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:22:42 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a14314c-61d3-40ac-98d3-3c4edf75b41b]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e3b49ec-80af-4c38-9689-f7277e495d21 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a30cce7b-6caa-4d42-92a5-d1d6892edf6e (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c7f6ad-d2c2-465a-b39e-47347aa85be0 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48af37b0-6938-432e-b374-d992c4dd9ae9 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c20e80fa-58de-431a-8901-2535657aaadf (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27919afc-8990-4ed5-af9e-9d6b3d7b231e (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc639d00-ef6b-4121-bcb0-c65ec0347abd (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0f728f3-fbb5-4ed8-a78b-a5d982b03f7d (non-flash)\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:22:42 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-5457d13f-0ba3-4e09-8eaf-3f1315fb6695 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e3b49ec-80af-4c38-9689-f7277e495d21 (non-flash)
Apr 13 16:22:42 user nova-compute[71731]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a30cce7b-6caa-4d42-92a5-d1d6892edf6e (non-flash)
Apr 13 16:22:42 user nova-compute[71731]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984 (non-flash)
Apr 13 16:22:42 user nova-compute[71731]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c7f6ad-d2c2-465a-b39e-47347aa85be0 (non-flash)
Apr 13 16:22:42 user nova-compute[71731]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48af37b0-6938-432e-b374-d992c4dd9ae9 (non-flash)
Apr 13 16:22:42 user nova-compute[71731]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c20e80fa-58de-431a-8901-2535657aaadf (non-flash)
Apr 13 16:22:42 user nova-compute[71731]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27919afc-8990-4ed5-af9e-9d6b3d7b231e (non-flash)
Apr 13 16:22:42 user nova-compute[71731]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc639d00-ef6b-4121-bcb0-c65ec0347abd (non-flash)
Apr 13 16:22:42 user nova-compute[71731]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0f728f3-fbb5-4ed8-a78b-a5d982b03f7d (non-flash)
Apr 13 16:22:42 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 16:22:42 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-5457d13f-0ba3-4e09-8eaf-3f1315fb6695 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e3b49ec-80af-4c38-9689-f7277e495d21 (non-flash)
Apr 13 16:22:42 user nova-compute[71731]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a30cce7b-6caa-4d42-92a5-d1d6892edf6e (non-flash)
Apr 13 16:22:42 user nova-compute[71731]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984 (non-flash)
Apr 13 16:22:42 user nova-compute[71731]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c7f6ad-d2c2-465a-b39e-47347aa85be0 (non-flash)
Apr 13 16:22:42 user nova-compute[71731]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48af37b0-6938-432e-b374-d992c4dd9ae9 (non-flash)
Apr 13 16:22:42 user nova-compute[71731]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c20e80fa-58de-431a-8901-2535657aaadf (non-flash)
Apr 13 16:22:42 user nova-compute[71731]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27919afc-8990-4ed5-af9e-9d6b3d7b231e (non-flash)
Apr 13 16:22:42 user nova-compute[71731]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc639d00-ef6b-4121-bcb0-c65ec0347abd (non-flash)
Apr 13 16:22:42 user nova-compute[71731]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0f728f3-fbb5-4ed8-a78b-a5d982b03f7d (non-flash)
Apr 13 16:22:42 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 16:22:42 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-5457d13f-0ba3-4e09-8eaf-3f1315fb6695 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8cff365360>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a30cce7b-6caa-4d42-92a5-d1d6892edf6e'): ({'sdi'}, set())}) {{(pid=71731) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 16:22:42 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-5457d13f-0ba3-4e09-8eaf-3f1315fb6695 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Removing single pathed devices sdi {{(pid=71731) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 16:22:42 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:22:42 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:22:42 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[20064d05-de19-463e-9c63-60effba5996a]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:22:42 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:22:42 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.018s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:22:42 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaead742-9d0f-44a8-bb19-ddf3d88f21e2]: (4, ('ok\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:22:42 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-5457d13f-0ba3-4e09-8eaf-3f1315fb6695 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Flushing IO for device /dev/sdi {{(pid=71731) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 16:22:42 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:22:42 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.013s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:22:42 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[eacbeced-6963-42ae-89bc-047445357e6d]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:22:42 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-5457d13f-0ba3-4e09-8eaf-3f1315fb6695 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=71731) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 16:22:42 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:22:43 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.046s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:22:43 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba3b42ac-1368-4607-8648-0910740916d0]: (4, ('1', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:22:43 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-5457d13f-0ba3-4e09-8eaf-3f1315fb6695 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=71731) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 16:22:43 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-5457d13f-0ba3-4e09-8eaf-3f1315fb6695 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] SCSI volumes sdi have been removed. {{(pid=71731) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 16:22:43 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-5457d13f-0ba3-4e09-8eaf-3f1315fb6695 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a30cce7b-6caa-4d42-92a5-d1d6892edf6e')] {{(pid=71731) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 16:22:43 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a30cce7b-6caa-4d42-92a5-d1d6892edf6e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:22:43 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a30cce7b-6caa-4d42-92a5-d1d6892edf6e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:22:43 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c5ff09a-a5f3-4f66-b48f-07b9ae86fa98]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:22:43 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-5457d13f-0ba3-4e09-8eaf-3f1315fb6695 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:22:43 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a30cce7b-6caa-4d42-92a5-d1d6892edf6e -p 172.16.0.220:3260 --logout {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:22:43 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a30cce7b-6caa-4d42-92a5-d1d6892edf6e -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:22:43 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bf55906-ab3a-4657-ab5d-213d967e84fb]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:a30cce7b-6caa-4d42-92a5-d1d6892edf6e, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:a30cce7b-6caa-4d42-92a5-d1d6892edf6e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:22:43 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-5457d13f-0ba3-4e09-8eaf-3f1315fb6695 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:a30cce7b-6caa-4d42-92a5-d1d6892edf6e, portal: 172.16.0.220,3260]
Apr 13 16:22:43 user nova-compute[71731]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:a30cce7b-6caa-4d42-92a5-d1d6892edf6e, portal: 172.16.0.220,3260] successful.
Apr 13 16:22:43 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:22:43 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a30cce7b-6caa-4d42-92a5-d1d6892edf6e -p 172.16.0.220:3260 --op delete {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:22:43 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a30cce7b-6caa-4d42-92a5-d1d6892edf6e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.041s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:22:43 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed74e77a-4df9-4808-805f-991f6123d25c]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:22:43 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-5457d13f-0ba3-4e09-8eaf-3f1315fb6695 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:22:43 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-5457d13f-0ba3-4e09-8eaf-3f1315fb6695 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.358s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 16:22:43 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-5457d13f-0ba3-4e09-8eaf-3f1315fb6695 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] <== disconnect_volume: return (360ms) None {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 16:22:43 user nova-compute[71731]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5457d13f-0ba3-4e09-8eaf-3f1315fb6695 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] [instance: 5db1cb51-2e5a-46c9-8914-cba759a96a65] Disconnected iSCSI Volume {{(pid=71731) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 16:22:44 user nova-compute[71731]: DEBUG nova.objects.instance [None req-5457d13f-0ba3-4e09-8eaf-3f1315fb6695 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Lazy-loading 'flavor' on Instance uuid 5db1cb51-2e5a-46c9-8914-cba759a96a65 {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:22:44 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-5457d13f-0ba3-4e09-8eaf-3f1315fb6695 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Lock "5db1cb51-2e5a-46c9-8914-cba759a96a65" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.821s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:22:44 user nova-compute[71731]: DEBUG nova.compute.manager [req-b5dca4f0-4d98-4c02-82fb-fb1d0b9c8d93 req-961d6c71-2f2f-44b5-82b1-7f47de89eaea service nova] [instance: cf54be22-2a5d-40c4-8a1a-0060c77f83f6] Received event network-changed-3e9128bc-6e2e-4c5e-bf37-1142304eff26 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:22:44 user nova-compute[71731]: DEBUG nova.compute.manager [req-b5dca4f0-4d98-4c02-82fb-fb1d0b9c8d93 req-961d6c71-2f2f-44b5-82b1-7f47de89eaea service nova] [instance: cf54be22-2a5d-40c4-8a1a-0060c77f83f6] Refreshing instance network info cache due to event network-changed-3e9128bc-6e2e-4c5e-bf37-1142304eff26. {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 16:22:44 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-b5dca4f0-4d98-4c02-82fb-fb1d0b9c8d93 req-961d6c71-2f2f-44b5-82b1-7f47de89eaea service nova] Acquiring lock "refresh_cache-cf54be22-2a5d-40c4-8a1a-0060c77f83f6" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 16:22:44 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-b5dca4f0-4d98-4c02-82fb-fb1d0b9c8d93 req-961d6c71-2f2f-44b5-82b1-7f47de89eaea service nova] Acquired lock "refresh_cache-cf54be22-2a5d-40c4-8a1a-0060c77f83f6" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 16:22:44 user nova-compute[71731]: DEBUG nova.network.neutron [req-b5dca4f0-4d98-4c02-82fb-fb1d0b9c8d93 req-961d6c71-2f2f-44b5-82b1-7f47de89eaea service nova] [instance: cf54be22-2a5d-40c4-8a1a-0060c77f83f6] Refreshing network info cache for port 3e9128bc-6e2e-4c5e-bf37-1142304eff26 {{(pid=71731) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 16:22:45 user nova-compute[71731]: DEBUG nova.network.neutron [req-b5dca4f0-4d98-4c02-82fb-fb1d0b9c8d93 req-961d6c71-2f2f-44b5-82b1-7f47de89eaea service nova] [instance: cf54be22-2a5d-40c4-8a1a-0060c77f83f6] Updated VIF entry in instance network info cache for port 3e9128bc-6e2e-4c5e-bf37-1142304eff26. {{(pid=71731) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 16:22:45 user nova-compute[71731]: DEBUG nova.network.neutron [req-b5dca4f0-4d98-4c02-82fb-fb1d0b9c8d93 req-961d6c71-2f2f-44b5-82b1-7f47de89eaea service nova] [instance: cf54be22-2a5d-40c4-8a1a-0060c77f83f6] Updating instance_info_cache with network_info: [{"id": "3e9128bc-6e2e-4c5e-bf37-1142304eff26", "address": "fa:16:3e:5b:20:d0", "network": {"id": "a2a5ab65-4be4-4535-b98e-a8eeaedddee8", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-245114435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6365a1e8d6c48499d4b8921244d92a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e9128bc-6e", "ovs_interfaceid": "3e9128bc-6e2e-4c5e-bf37-1142304eff26", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:22:45 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-b5dca4f0-4d98-4c02-82fb-fb1d0b9c8d93 req-961d6c71-2f2f-44b5-82b1-7f47de89eaea service nova] Releasing lock "refresh_cache-cf54be22-2a5d-40c4-8a1a-0060c77f83f6" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 16:22:46 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:22:46 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-8308d00e-7207-4925-a623-f7d124684656 tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] Acquiring lock "8c6d8096-853b-4091-ad82-6faf8ffc85fa" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:22:46 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-8308d00e-7207-4925-a623-f7d124684656 tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] Lock "8c6d8096-853b-4091-ad82-6faf8ffc85fa" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:22:46 user nova-compute[71731]: DEBUG nova.objects.instance [None req-8308d00e-7207-4925-a623-f7d124684656 tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] Lazy-loading 'flavor' on Instance uuid 8c6d8096-853b-4091-ad82-6faf8ffc85fa {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:22:46 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-8308d00e-7207-4925-a623-f7d124684656 tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] Lock "8c6d8096-853b-4091-ad82-6faf8ffc85fa" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:22:46 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-8308d00e-7207-4925-a623-f7d124684656 tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] Acquiring lock "8c6d8096-853b-4091-ad82-6faf8ffc85fa" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:22:46 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-8308d00e-7207-4925-a623-f7d124684656 tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] Lock "8c6d8096-853b-4091-ad82-6faf8ffc85fa" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:22:46 user nova-compute[71731]: INFO nova.compute.manager [None req-8308d00e-7207-4925-a623-f7d124684656 tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] [instance: 8c6d8096-853b-4091-ad82-6faf8ffc85fa] Attaching volume 62e7747a-651a-4d0a-a763-bfce9c4a3cff to /dev/vdb
Apr 13 16:22:46 user nova-compute[71731]: DEBUG os_brick.utils [None req-8308d00e-7207-4925-a623-f7d124684656 tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 16:22:46 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:22:46 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:22:46 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8a799a5-4cef-40fb-9781-081489821c9d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:81501d91421\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:22:46 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:22:46 user nova-compute[71731]: DEBUG nova.compute.manager [req-6b5165c3-6f03-451d-8787-e886677b3996 req-74e416b5-94c3-46ad-a637-c7877c8e38a7 service nova] [instance: 8c6d8096-853b-4091-ad82-6faf8ffc85fa] Received event network-changed-385dec44-4145-4606-b0af-30fbc721eb2c {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:22:46 user nova-compute[71731]: DEBUG nova.compute.manager [req-6b5165c3-6f03-451d-8787-e886677b3996 req-74e416b5-94c3-46ad-a637-c7877c8e38a7 service nova] [instance: 8c6d8096-853b-4091-ad82-6faf8ffc85fa] Refreshing instance network info cache due to event network-changed-385dec44-4145-4606-b0af-30fbc721eb2c. {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 16:22:46 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-6b5165c3-6f03-451d-8787-e886677b3996 req-74e416b5-94c3-46ad-a637-c7877c8e38a7 service nova] Acquiring lock "refresh_cache-8c6d8096-853b-4091-ad82-6faf8ffc85fa" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 16:22:46 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-6b5165c3-6f03-451d-8787-e886677b3996 req-74e416b5-94c3-46ad-a637-c7877c8e38a7 service nova] Acquired lock "refresh_cache-8c6d8096-853b-4091-ad82-6faf8ffc85fa" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 16:22:46 user nova-compute[71731]: DEBUG nova.network.neutron [req-6b5165c3-6f03-451d-8787-e886677b3996 req-74e416b5-94c3-46ad-a637-c7877c8e38a7 service nova] [instance: 8c6d8096-853b-4091-ad82-6faf8ffc85fa] Refreshing network info cache for port 385dec44-4145-4606-b0af-30fbc721eb2c {{(pid=71731) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 16:22:46 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:22:46 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[999054b2-dc11-45bd-93bc-d28acdc48f0f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:22:46 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:22:46 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:22:46 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[bea2b210-a414-4a6a-a761-d7bcf66a7314]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:22:46 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[e680cb5d-00d7-4608-90d6-3d980ab5f4dd]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:22:46 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-8308d00e-7207-4925-a623-f7d124684656 tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] Running cmd (subprocess): nvme version {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:22:46 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-8308d00e-7207-4925-a623-f7d124684656 tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] 'nvme version' failed. Not Retrying. {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 16:22:46 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8308d00e-7207-4925-a623-f7d124684656 tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] nvme not present on system {{(pid=71731) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 16:22:46 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:22:46 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 16:22:46 user nova-compute[71731]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 16:22:46 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[df82cb73-b05c-40ae-9b3c-b762b90b11c6]: (4, '') {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:22:46 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.lightos [None req-8308d00e-7207-4925-a623-f7d124684656 tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71731) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 16:22:46 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.lightos [None req-8308d00e-7207-4925-a623-f7d124684656 tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71731) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 16:22:46 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.lightos [None req-8308d00e-7207-4925-a623-f7d124684656 tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] LIGHTOS: no hostnqn found. {{(pid=71731) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 16:22:46 user nova-compute[71731]: DEBUG os_brick.utils [None req-8308d00e-7207-4925-a623-f7d124684656 tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:81501d91421', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 16:22:46 user nova-compute[71731]: DEBUG nova.virt.block_device [None req-8308d00e-7207-4925-a623-f7d124684656 tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] [instance: 8c6d8096-853b-4091-ad82-6faf8ffc85fa] Updating existing volume attachment record: 315a9af3-8f46-4cb3-bc64-b57ff9f4f72f {{(pid=71731) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 16:22:47 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:22:47 user nova-compute[71731]: DEBUG nova.network.neutron [req-6b5165c3-6f03-451d-8787-e886677b3996 req-74e416b5-94c3-46ad-a637-c7877c8e38a7 service nova] [instance: 8c6d8096-853b-4091-ad82-6faf8ffc85fa] Updated VIF entry in instance network info cache for port 385dec44-4145-4606-b0af-30fbc721eb2c. {{(pid=71731) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 16:22:47 user nova-compute[71731]: DEBUG nova.network.neutron [req-6b5165c3-6f03-451d-8787-e886677b3996 req-74e416b5-94c3-46ad-a637-c7877c8e38a7 service nova] [instance: 8c6d8096-853b-4091-ad82-6faf8ffc85fa] Updating instance_info_cache with network_info: [{"id": "385dec44-4145-4606-b0af-30fbc721eb2c", "address": "fa:16:3e:93:4c:5a", "network": {"id": "dcb487d2-a611-4040-903e-8e1c9c496e02", "bridge": "br-int", "label": "tempest-TestVolumeSwap-309336155-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.156", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc3e2169a6c44d05b2a2eedbe3a063cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap385dec44-41", "ovs_interfaceid": "385dec44-4145-4606-b0af-30fbc721eb2c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:22:47 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-6b5165c3-6f03-451d-8787-e886677b3996 req-74e416b5-94c3-46ad-a637-c7877c8e38a7 service nova] Releasing lock "refresh_cache-8c6d8096-853b-4091-ad82-6faf8ffc85fa" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 16:22:47 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-b00db723-aa0b-4c61-a959-7e5eca86fc73 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] Acquiring lock "cf54be22-2a5d-40c4-8a1a-0060c77f83f6" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:22:47 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-b00db723-aa0b-4c61-a959-7e5eca86fc73 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] Lock "cf54be22-2a5d-40c4-8a1a-0060c77f83f6" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:22:47 user nova-compute[71731]: DEBUG nova.objects.instance [None req-b00db723-aa0b-4c61-a959-7e5eca86fc73 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] Lazy-loading 'flavor' on Instance uuid cf54be22-2a5d-40c4-8a1a-0060c77f83f6 {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:22:47 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-b00db723-aa0b-4c61-a959-7e5eca86fc73 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] Lock "cf54be22-2a5d-40c4-8a1a-0060c77f83f6" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:22:47 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-b00db723-aa0b-4c61-a959-7e5eca86fc73 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] Acquiring lock "cf54be22-2a5d-40c4-8a1a-0060c77f83f6" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:22:47 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-b00db723-aa0b-4c61-a959-7e5eca86fc73 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] Lock "cf54be22-2a5d-40c4-8a1a-0060c77f83f6" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:22:47 user nova-compute[71731]: INFO nova.compute.manager [None req-b00db723-aa0b-4c61-a959-7e5eca86fc73 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] [instance: cf54be22-2a5d-40c4-8a1a-0060c77f83f6] Attaching volume a3ec6bc1-d29e-4348-adf7-8bc66e2414a1 to /dev/sdc
Apr 13 16:22:47 user nova-compute[71731]: DEBUG os_brick.utils [None req-b00db723-aa0b-4c61-a959-7e5eca86fc73 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 16:22:47 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:22:47 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:22:47 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4418f04-caef-49b8-8752-0386dcd80342]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:81501d91421\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:22:47 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:22:47 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:22:47 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[b02211ec-1b72-4bd3-87f1-5953cb2b6dee]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:22:47 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:22:47 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.013s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:22:47 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[90659f47-1596-42d6-9089-14534fc5ece4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:22:47 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[806398de-d794-442e-9c9a-4a2919160ccc]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:22:47 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-b00db723-aa0b-4c61-a959-7e5eca86fc73 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] Running cmd (subprocess): nvme version {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:22:47 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-b00db723-aa0b-4c61-a959-7e5eca86fc73 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] 'nvme version' failed. Not Retrying. {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 16:22:47 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b00db723-aa0b-4c61-a959-7e5eca86fc73 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] nvme not present on system {{(pid=71731) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 16:22:47 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:22:47 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 16:22:47 user nova-compute[71731]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 16:22:47 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[212dc5d8-b64b-42fe-b616-ae5bcbc3fc2f]: (4, '') {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:22:47 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.lightos [None req-b00db723-aa0b-4c61-a959-7e5eca86fc73 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71731) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 16:22:47 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.lightos [None req-b00db723-aa0b-4c61-a959-7e5eca86fc73 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71731) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 16:22:47 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.lightos [None req-b00db723-aa0b-4c61-a959-7e5eca86fc73 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] LIGHTOS: no hostnqn found. {{(pid=71731) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 16:22:47 user nova-compute[71731]: DEBUG os_brick.utils [None req-b00db723-aa0b-4c61-a959-7e5eca86fc73 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] <== get_connector_properties: return (113ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:81501d91421', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 16:22:47 user nova-compute[71731]: DEBUG nova.virt.block_device [None req-b00db723-aa0b-4c61-a959-7e5eca86fc73 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] [instance: cf54be22-2a5d-40c4-8a1a-0060c77f83f6] Updating existing volume attachment record: 17d1220b-a2bf-4c50-8864-24221729e324 {{(pid=71731) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 16:22:51 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:22:51 user nova-compute[71731]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8308d00e-7207-4925-a623-f7d124684656 tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] [instance: 8c6d8096-853b-4091-ad82-6faf8ffc85fa] Calling os-brick to attach iSCSI Volume {{(pid=71731) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 16:22:51 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-8308d00e-7207-4925-a623-f7d124684656 tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8cf0118790>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:62e7747a-651a-4d0a-a763-bfce9c4a3cff', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EHjgiLQq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 16:22:51 user nova-compute[71731]: WARNING os_brick.initiator.connectors.base [None req-8308d00e-7207-4925-a623-f7d124684656 tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 16:22:51 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-8308d00e-7207-4925-a623-f7d124684656 tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 16:22:51 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-8308d00e-7207-4925-a623-f7d124684656 tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 16:22:51 user nova-compute[71731]: WARNING os_brick.initiator.connectors.base [None req-8308d00e-7207-4925-a623-f7d124684656 tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 16:22:51 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-8308d00e-7207-4925-a623-f7d124684656 tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:62e7747a-651a-4d0a-a763-bfce9c4a3cff" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 16:22:51 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-8308d00e-7207-4925-a623-f7d124684656 tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:62e7747a-651a-4d0a-a763-bfce9c4a3cff" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 16:22:51 user nova-compute[71731]: INFO os_brick.initiator.connectors.iscsi [None req-8308d00e-7207-4925-a623-f7d124684656 tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 16:22:51 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62e7747a-651a-4d0a-a763-bfce9c4a3cff -p 172.16.0.220:3260 {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:22:51 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62e7747a-651a-4d0a-a763-bfce9c4a3cff -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:22:51 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[82a6a451-65d1-459f-8a2f-7636d7545cf1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:22:51 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-8308d00e-7207-4925-a623-f7d124684656 tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 16:22:51 user nova-compute[71731]:  {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:22:51 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62e7747a-651a-4d0a-a763-bfce9c4a3cff -p 172.16.0.220:3260 --interface default --op new {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:22:51 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62e7747a-651a-4d0a-a763-bfce9c4a3cff -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:22:51 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f5018d3-bc97-4e0b-87bc-6e5dcd6b9f65]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:62e7747a-651a-4d0a-a763-bfce9c4a3cff] added\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:22:51 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-8308d00e-7207-4925-a623-f7d124684656 tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:62e7747a-651a-4d0a-a763-bfce9c4a3cff] added
Apr 13 16:22:51 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:22:51 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62e7747a-651a-4d0a-a763-bfce9c4a3cff -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:22:51 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62e7747a-651a-4d0a-a763-bfce9c4a3cff -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:22:51 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[730dc9a2-9d1d-4835-b172-369b1a50c208]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:22:51 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-8308d00e-7207-4925-a623-f7d124684656 tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:22:51 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62e7747a-651a-4d0a-a763-bfce9c4a3cff -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:22:51 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62e7747a-651a-4d0a-a763-bfce9c4a3cff -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:22:51 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b93053a-3a4a-4e85-aad4-99c358169535]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:22:51 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-8308d00e-7207-4925-a623-f7d124684656 tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:22:51 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62e7747a-651a-4d0a-a763-bfce9c4a3cff -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EHjgiLQq {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:22:51 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62e7747a-651a-4d0a-a763-bfce9c4a3cff -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EHjgiLQq" returned: 0 in 0.019s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:22:51 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[eacca9f1-1be2-414e-90de-8396907bcb8f]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:22:51 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-8308d00e-7207-4925-a623-f7d124684656 tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EHjgiLQq'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:22:51 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62e7747a-651a-4d0a-a763-bfce9c4a3cff -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:22:51 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62e7747a-651a-4d0a-a763-bfce9c4a3cff -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:22:51 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[38ed2bcf-7c8a-477b-8096-212845620b2c]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:22:51 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-8308d00e-7207-4925-a623-f7d124684656 tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:22:51 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:22:51 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:22:51 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d5ba694-fff8-408f-b2d8-7a1336ea6a41]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e3b49ec-80af-4c38-9689-f7277e495d21 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c7f6ad-d2c2-465a-b39e-47347aa85be0 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48af37b0-6938-432e-b374-d992c4dd9ae9 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c20e80fa-58de-431a-8901-2535657aaadf (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27919afc-8990-4ed5-af9e-9d6b3d7b231e (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc639d00-ef6b-4121-bcb0-c65ec0347abd (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0f728f3-fbb5-4ed8-a78b-a5d982b03f7d (non-flash)\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:22:51 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-8308d00e-7207-4925-a623-f7d124684656 tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e3b49ec-80af-4c38-9689-f7277e495d21 (non-flash)
Apr 13 16:22:51 user nova-compute[71731]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984 (non-flash)
Apr 13 16:22:51 user nova-compute[71731]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c7f6ad-d2c2-465a-b39e-47347aa85be0 (non-flash)
Apr 13 16:22:51 user nova-compute[71731]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48af37b0-6938-432e-b374-d992c4dd9ae9 (non-flash)
Apr 13 16:22:51 user nova-compute[71731]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c20e80fa-58de-431a-8901-2535657aaadf (non-flash)
Apr 13 16:22:51 user nova-compute[71731]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27919afc-8990-4ed5-af9e-9d6b3d7b231e (non-flash)
Apr 13 16:22:51 user nova-compute[71731]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc639d00-ef6b-4121-bcb0-c65ec0347abd (non-flash)
Apr 13 16:22:51 user nova-compute[71731]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0f728f3-fbb5-4ed8-a78b-a5d982b03f7d (non-flash)
Apr 13 16:22:51 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 16:22:51 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-8308d00e-7207-4925-a623-f7d124684656 tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e3b49ec-80af-4c38-9689-f7277e495d21 (non-flash)
Apr 13 16:22:51 user nova-compute[71731]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984 (non-flash)
Apr 13 16:22:51 user nova-compute[71731]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c7f6ad-d2c2-465a-b39e-47347aa85be0 (non-flash)
Apr 13 16:22:51 user nova-compute[71731]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48af37b0-6938-432e-b374-d992c4dd9ae9 (non-flash)
Apr 13 16:22:51 user nova-compute[71731]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c20e80fa-58de-431a-8901-2535657aaadf (non-flash)
Apr 13 16:22:51 user nova-compute[71731]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27919afc-8990-4ed5-af9e-9d6b3d7b231e (non-flash)
Apr 13 16:22:51 user nova-compute[71731]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc639d00-ef6b-4121-bcb0-c65ec0347abd (non-flash)
Apr 13 16:22:51 user nova-compute[71731]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0f728f3-fbb5-4ed8-a78b-a5d982b03f7d (non-flash)
Apr 13 16:22:51 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 16:22:51 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62e7747a-651a-4d0a-a763-bfce9c4a3cff -p 172.16.0.220:3260 --login {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:22:51 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62e7747a-651a-4d0a-a763-bfce9c4a3cff -p 172.16.0.220:3260 --login" returned: 0 in 0.087s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:22:51 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[b019bf59-9cbc-4136-b3a8-1ebdefc9482a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:62e7747a-651a-4d0a-a763-bfce9c4a3cff, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:62e7747a-651a-4d0a-a763-bfce9c4a3cff, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:22:51 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-8308d00e-7207-4925-a623-f7d124684656 tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:62e7747a-651a-4d0a-a763-bfce9c4a3cff, portal: 172.16.0.220,3260]
Apr 13 16:22:51 user nova-compute[71731]: Login to [iface: default, target: iqn.2010-10.org.openstack:62e7747a-651a-4d0a-a763-bfce9c4a3cff, portal: 172.16.0.220,3260] successful.
Apr 13 16:22:51 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:22:51 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62e7747a-651a-4d0a-a763-bfce9c4a3cff -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:22:51 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62e7747a-651a-4d0a-a763-bfce9c4a3cff -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:22:51 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[43d43b1a-18cf-4fba-a072-e81e011c4232]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:22:51 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-8308d00e-7207-4925-a623-f7d124684656 tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:22:51 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:22:51 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:22:51 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[63a2d858-a1e1-43ad-999c-1997fa2e9eb7]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e3b49ec-80af-4c38-9689-f7277e495d21 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62e7747a-651a-4d0a-a763-bfce9c4a3cff (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c7f6ad-d2c2-465a-b39e-47347aa85be0 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48af37b0-6938-432e-b374-d992c4dd9ae9 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c20e80fa-58de-431a-8901-2535657aaadf (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27919afc-8990-4ed5-af9e-9d6b3d7b231e (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc639d00-ef6b-4121-bcb0-c65ec0347abd (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0f728f3-fbb5-4ed8-a78b-a5d982b03f7d (non-flash)\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:22:51 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-8308d00e-7207-4925-a623-f7d124684656 tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e3b49ec-80af-4c38-9689-f7277e495d21 (non-flash)
Apr 13 16:22:51 user nova-compute[71731]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62e7747a-651a-4d0a-a763-bfce9c4a3cff (non-flash)
Apr 13 16:22:51 user nova-compute[71731]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984 (non-flash)
Apr 13 16:22:51 user nova-compute[71731]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c7f6ad-d2c2-465a-b39e-47347aa85be0 (non-flash)
Apr 13 16:22:51 user nova-compute[71731]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48af37b0-6938-432e-b374-d992c4dd9ae9 (non-flash)
Apr 13 16:22:51 user nova-compute[71731]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c20e80fa-58de-431a-8901-2535657aaadf (non-flash)
Apr 13 16:22:51 user nova-compute[71731]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27919afc-8990-4ed5-af9e-9d6b3d7b231e (non-flash)
Apr 13 16:22:51 user nova-compute[71731]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc639d00-ef6b-4121-bcb0-c65ec0347abd (non-flash)
Apr 13 16:22:51 user nova-compute[71731]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0f728f3-fbb5-4ed8-a78b-a5d982b03f7d (non-flash)
Apr 13 16:22:51 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 16:22:51 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-8308d00e-7207-4925-a623-f7d124684656 tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e3b49ec-80af-4c38-9689-f7277e495d21 (non-flash)
Apr 13 16:22:51 user nova-compute[71731]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62e7747a-651a-4d0a-a763-bfce9c4a3cff (non-flash)
Apr 13 16:22:51 user nova-compute[71731]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984 (non-flash)
Apr 13 16:22:51 user nova-compute[71731]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c7f6ad-d2c2-465a-b39e-47347aa85be0 (non-flash)
Apr 13 16:22:51 user nova-compute[71731]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48af37b0-6938-432e-b374-d992c4dd9ae9 (non-flash)
Apr 13 16:22:51 user nova-compute[71731]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c20e80fa-58de-431a-8901-2535657aaadf (non-flash)
Apr 13 16:22:51 user nova-compute[71731]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27919afc-8990-4ed5-af9e-9d6b3d7b231e (non-flash)
Apr 13 16:22:51 user nova-compute[71731]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc639d00-ef6b-4121-bcb0-c65ec0347abd (non-flash)
Apr 13 16:22:51 user nova-compute[71731]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0f728f3-fbb5-4ed8-a78b-a5d982b03f7d (non-flash)
Apr 13 16:22:51 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 16:22:51 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-8308d00e-7207-4925-a623-f7d124684656 tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:62e7747a-651a-4d0a-a763-bfce9c4a3cff" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.321s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 16:22:51 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-8308d00e-7207-4925-a623-f7d124684656 tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] Connected to 172.16.0.220:3260 {{(pid=71731) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 16:22:51 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-8308d00e-7207-4925-a623-f7d124684656 tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] HCTL ('40', '-', '-', 0) found on session 12 with lun 0 {{(pid=71731) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 16:22:51 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-8308d00e-7207-4925-a623-f7d124684656 tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=71731) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 16:22:51 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:22:51 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.016s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:22:51 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a0177eb-8c77-45d8-aad0-678028f9e878]: (4, ('- - 0', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:22:51 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-8308d00e-7207-4925-a623-f7d124684656 tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] Searching for a device in session 12 and hctl ['40', '*', '*', 0] yield: None {{(pid=71731) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 16:22:51 user nova-compute[71731]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b00db723-aa0b-4c61-a959-7e5eca86fc73 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] [instance: cf54be22-2a5d-40c4-8a1a-0060c77f83f6] Calling os-brick to attach iSCSI Volume {{(pid=71731) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 16:22:51 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-b00db723-aa0b-4c61-a959-7e5eca86fc73 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8cf0118790>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a3ec6bc1-d29e-4348-adf7-8bc66e2414a1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EXicZdqM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 16:22:51 user nova-compute[71731]: WARNING os_brick.initiator.connectors.base [None req-b00db723-aa0b-4c61-a959-7e5eca86fc73 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 16:22:51 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-b00db723-aa0b-4c61-a959-7e5eca86fc73 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 16:22:52 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:22:52 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-8308d00e-7207-4925-a623-f7d124684656 tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] Searching for a device in session 12 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=71731) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 16:22:52 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-8308d00e-7207-4925-a623-f7d124684656 tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:62e7747a-651a-4d0a-a763-bfce9c4a3cff', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EHjgiLQq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71731) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 16:22:52 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-8308d00e-7207-4925-a623-f7d124684656 tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.352s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 16:22:52 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-8308d00e-7207-4925-a623-f7d124684656 tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] <== connect_volume: return (1353ms) {'type': 'block', 'scsi_wwn': '23133303132313333', 'path': '/dev/sdi'} {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 16:22:52 user nova-compute[71731]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8308d00e-7207-4925-a623-f7d124684656 tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] [instance: 8c6d8096-853b-4091-ad82-6faf8ffc85fa] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23133303132313333', 'path': '/dev/sdi'} {{(pid=71731) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 16:22:52 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-b00db723-aa0b-4c61-a959-7e5eca86fc73 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.564s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 16:22:52 user nova-compute[71731]: WARNING os_brick.initiator.connectors.base [None req-b00db723-aa0b-4c61-a959-7e5eca86fc73 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 16:22:52 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-b00db723-aa0b-4c61-a959-7e5eca86fc73 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a3ec6bc1-d29e-4348-adf7-8bc66e2414a1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 16:22:52 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-b00db723-aa0b-4c61-a959-7e5eca86fc73 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a3ec6bc1-d29e-4348-adf7-8bc66e2414a1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 16:22:52 user nova-compute[71731]: INFO os_brick.initiator.connectors.iscsi [None req-b00db723-aa0b-4c61-a959-7e5eca86fc73 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 16:22:52 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3ec6bc1-d29e-4348-adf7-8bc66e2414a1 -p 172.16.0.220:3260 {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:22:52 user nova-compute[71731]: DEBUG nova.objects.instance [None req-8308d00e-7207-4925-a623-f7d124684656 tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] Lazy-loading 'flavor' on Instance uuid 8c6d8096-853b-4091-ad82-6faf8ffc85fa {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:22:52 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3ec6bc1-d29e-4348-adf7-8bc66e2414a1 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:22:52 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[367ec4e4-cfab-4679-b178-9be79c7ee824]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:22:52 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-b00db723-aa0b-4c61-a959-7e5eca86fc73 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 16:22:52 user nova-compute[71731]:  {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:22:52 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3ec6bc1-d29e-4348-adf7-8bc66e2414a1 -p 172.16.0.220:3260 --interface default --op new {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:22:52 user nova-compute[71731]: DEBUG nova.virt.libvirt.guest [None req-8308d00e-7207-4925-a623-f7d124684656 tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] attach device xml: <disk type="block" device="disk">
Apr 13 16:22:52 user nova-compute[71731]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 16:22:52 user nova-compute[71731]:   <source dev="/dev/sdi"/>
Apr 13 16:22:52 user nova-compute[71731]:   <target dev="vdb" bus="virtio"/>
Apr 13 16:22:52 user nova-compute[71731]:   <serial>62e7747a-651a-4d0a-a763-bfce9c4a3cff</serial>
Apr 13 16:22:52 user nova-compute[71731]: </disk>
Apr 13 16:22:52 user nova-compute[71731]:  {{(pid=71731) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 13 16:22:52 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3ec6bc1-d29e-4348-adf7-8bc66e2414a1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:22:52 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfdf4707-20b4-47d6-8179-72a447c1eb83]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a3ec6bc1-d29e-4348-adf7-8bc66e2414a1] added\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:22:52 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-b00db723-aa0b-4c61-a959-7e5eca86fc73 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a3ec6bc1-d29e-4348-adf7-8bc66e2414a1] added
Apr 13 16:22:52 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:22:52 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3ec6bc1-d29e-4348-adf7-8bc66e2414a1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:22:52 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3ec6bc1-d29e-4348-adf7-8bc66e2414a1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:22:52 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[3414c254-664f-4002-865f-f5dad617bdf2]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:22:52 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-b00db723-aa0b-4c61-a959-7e5eca86fc73 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:22:52 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3ec6bc1-d29e-4348-adf7-8bc66e2414a1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:22:52 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3ec6bc1-d29e-4348-adf7-8bc66e2414a1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:22:52 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[5469b3f3-7253-42ce-b4d8-5a9cf5a2a67c]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:22:52 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-b00db723-aa0b-4c61-a959-7e5eca86fc73 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:22:52 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3ec6bc1-d29e-4348-adf7-8bc66e2414a1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EXicZdqM {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:22:52 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3ec6bc1-d29e-4348-adf7-8bc66e2414a1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EXicZdqM" returned: 0 in 0.019s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:22:52 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[940bf19d-f847-4948-99f7-935330b59aaa]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:22:52 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-b00db723-aa0b-4c61-a959-7e5eca86fc73 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EXicZdqM'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:22:52 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3ec6bc1-d29e-4348-adf7-8bc66e2414a1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:22:52 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3ec6bc1-d29e-4348-adf7-8bc66e2414a1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:22:52 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e0352a1-023c-48e5-9e41-5504b58f1021]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:22:52 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-b00db723-aa0b-4c61-a959-7e5eca86fc73 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:22:52 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:22:52 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:22:52 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[d933031a-8e3a-4e8a-8e5e-54d7da2e03e0]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e3b49ec-80af-4c38-9689-f7277e495d21 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62e7747a-651a-4d0a-a763-bfce9c4a3cff (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c7f6ad-d2c2-465a-b39e-47347aa85be0 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48af37b0-6938-432e-b374-d992c4dd9ae9 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c20e80fa-58de-431a-8901-2535657aaadf (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27919afc-8990-4ed5-af9e-9d6b3d7b231e (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc639d00-ef6b-4121-bcb0-c65ec0347abd (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0f728f3-fbb5-4ed8-a78b-a5d982b03f7d (non-flash)\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:22:52 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-b00db723-aa0b-4c61-a959-7e5eca86fc73 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e3b49ec-80af-4c38-9689-f7277e495d21 (non-flash)
Apr 13 16:22:52 user nova-compute[71731]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62e7747a-651a-4d0a-a763-bfce9c4a3cff (non-flash)
Apr 13 16:22:52 user nova-compute[71731]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984 (non-flash)
Apr 13 16:22:52 user nova-compute[71731]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c7f6ad-d2c2-465a-b39e-47347aa85be0 (non-flash)
Apr 13 16:22:52 user nova-compute[71731]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48af37b0-6938-432e-b374-d992c4dd9ae9 (non-flash)
Apr 13 16:22:52 user nova-compute[71731]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c20e80fa-58de-431a-8901-2535657aaadf (non-flash)
Apr 13 16:22:52 user nova-compute[71731]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27919afc-8990-4ed5-af9e-9d6b3d7b231e (non-flash)
Apr 13 16:22:52 user nova-compute[71731]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc639d00-ef6b-4121-bcb0-c65ec0347abd (non-flash)
Apr 13 16:22:52 user nova-compute[71731]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0f728f3-fbb5-4ed8-a78b-a5d982b03f7d (non-flash)
Apr 13 16:22:52 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 16:22:52 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-b00db723-aa0b-4c61-a959-7e5eca86fc73 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e3b49ec-80af-4c38-9689-f7277e495d21 (non-flash)
Apr 13 16:22:52 user nova-compute[71731]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62e7747a-651a-4d0a-a763-bfce9c4a3cff (non-flash)
Apr 13 16:22:52 user nova-compute[71731]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984 (non-flash)
Apr 13 16:22:52 user nova-compute[71731]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c7f6ad-d2c2-465a-b39e-47347aa85be0 (non-flash)
Apr 13 16:22:52 user nova-compute[71731]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48af37b0-6938-432e-b374-d992c4dd9ae9 (non-flash)
Apr 13 16:22:52 user nova-compute[71731]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c20e80fa-58de-431a-8901-2535657aaadf (non-flash)
Apr 13 16:22:52 user nova-compute[71731]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27919afc-8990-4ed5-af9e-9d6b3d7b231e (non-flash)
Apr 13 16:22:52 user nova-compute[71731]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc639d00-ef6b-4121-bcb0-c65ec0347abd (non-flash)
Apr 13 16:22:52 user nova-compute[71731]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0f728f3-fbb5-4ed8-a78b-a5d982b03f7d (non-flash)
Apr 13 16:22:52 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 16:22:52 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3ec6bc1-d29e-4348-adf7-8bc66e2414a1 -p 172.16.0.220:3260 --login {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:22:52 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3ec6bc1-d29e-4348-adf7-8bc66e2414a1 -p 172.16.0.220:3260 --login" returned: 0 in 0.091s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:22:52 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b0651a6-4144-457c-835d-8a775e635057]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a3ec6bc1-d29e-4348-adf7-8bc66e2414a1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a3ec6bc1-d29e-4348-adf7-8bc66e2414a1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:22:52 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-b00db723-aa0b-4c61-a959-7e5eca86fc73 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a3ec6bc1-d29e-4348-adf7-8bc66e2414a1, portal: 172.16.0.220,3260]
Apr 13 16:22:52 user nova-compute[71731]: Login to [iface: default, target: iqn.2010-10.org.openstack:a3ec6bc1-d29e-4348-adf7-8bc66e2414a1, portal: 172.16.0.220,3260] successful.
Apr 13 16:22:52 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:22:52 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3ec6bc1-d29e-4348-adf7-8bc66e2414a1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:22:52 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3ec6bc1-d29e-4348-adf7-8bc66e2414a1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:22:52 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[afb44fdd-346b-408e-9b87-b912ff789883]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:22:52 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-b00db723-aa0b-4c61-a959-7e5eca86fc73 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:22:52 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:22:52 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:22:52 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[efc4e013-9ec3-445c-97fe-bc1a67731730]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e3b49ec-80af-4c38-9689-f7277e495d21 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62e7747a-651a-4d0a-a763-bfce9c4a3cff (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ec6bc1-d29e-4348-adf7-8bc66e2414a1 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c7f6ad-d2c2-465a-b39e-47347aa85be0 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48af37b0-6938-432e-b374-d992c4dd9ae9 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c20e80fa-58de-431a-8901-2535657aaadf (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27919afc-8990-4ed5-af9e-9d6b3d7b231e (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc639d00-ef6b-4121-bcb0-c65ec0347abd (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0f728f3-fbb5-4ed8-a78b-a5d982b03f7d (non-flash)\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:22:52 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-b00db723-aa0b-4c61-a959-7e5eca86fc73 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e3b49ec-80af-4c38-9689-f7277e495d21 (non-flash)
Apr 13 16:22:52 user nova-compute[71731]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62e7747a-651a-4d0a-a763-bfce9c4a3cff (non-flash)
Apr 13 16:22:52 user nova-compute[71731]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ec6bc1-d29e-4348-adf7-8bc66e2414a1 (non-flash)
Apr 13 16:22:52 user nova-compute[71731]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984 (non-flash)
Apr 13 16:22:52 user nova-compute[71731]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c7f6ad-d2c2-465a-b39e-47347aa85be0 (non-flash)
Apr 13 16:22:52 user nova-compute[71731]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48af37b0-6938-432e-b374-d992c4dd9ae9 (non-flash)
Apr 13 16:22:52 user nova-compute[71731]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c20e80fa-58de-431a-8901-2535657aaadf (non-flash)
Apr 13 16:22:52 user nova-compute[71731]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27919afc-8990-4ed5-af9e-9d6b3d7b231e (non-flash)
Apr 13 16:22:52 user nova-compute[71731]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc639d00-ef6b-4121-bcb0-c65ec0347abd (non-flash)
Apr 13 16:22:52 user nova-compute[71731]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0f728f3-fbb5-4ed8-a78b-a5d982b03f7d (non-flash)
Apr 13 16:22:52 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 16:22:52 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-b00db723-aa0b-4c61-a959-7e5eca86fc73 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e3b49ec-80af-4c38-9689-f7277e495d21 (non-flash)
Apr 13 16:22:52 user nova-compute[71731]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62e7747a-651a-4d0a-a763-bfce9c4a3cff (non-flash)
Apr 13 16:22:52 user nova-compute[71731]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ec6bc1-d29e-4348-adf7-8bc66e2414a1 (non-flash)
Apr 13 16:22:52 user nova-compute[71731]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984 (non-flash)
Apr 13 16:22:52 user nova-compute[71731]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c7f6ad-d2c2-465a-b39e-47347aa85be0 (non-flash)
Apr 13 16:22:52 user nova-compute[71731]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48af37b0-6938-432e-b374-d992c4dd9ae9 (non-flash)
Apr 13 16:22:52 user nova-compute[71731]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c20e80fa-58de-431a-8901-2535657aaadf (non-flash)
Apr 13 16:22:52 user nova-compute[71731]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27919afc-8990-4ed5-af9e-9d6b3d7b231e (non-flash)
Apr 13 16:22:52 user nova-compute[71731]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc639d00-ef6b-4121-bcb0-c65ec0347abd (non-flash)
Apr 13 16:22:52 user nova-compute[71731]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0f728f3-fbb5-4ed8-a78b-a5d982b03f7d (non-flash)
Apr 13 16:22:52 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 16:22:52 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-b00db723-aa0b-4c61-a959-7e5eca86fc73 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a3ec6bc1-d29e-4348-adf7-8bc66e2414a1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.328s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 16:22:52 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-b00db723-aa0b-4c61-a959-7e5eca86fc73 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] Connected to 172.16.0.220:3260 {{(pid=71731) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 16:22:52 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-b00db723-aa0b-4c61-a959-7e5eca86fc73 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] HCTL ('42', '-', '-', 0) found on session 13 with lun 0 {{(pid=71731) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 16:22:52 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-b00db723-aa0b-4c61-a959-7e5eca86fc73 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] Scanning host 42 c: -, t: -, l: 0) {{(pid=71731) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 16:22:52 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host42/scan {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:22:52 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host42/scan" returned: 0 in 0.020s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:22:52 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[6180633e-a60f-40e4-a4d7-0f3053acb0fc]: (4, ('- - 0', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:22:52 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-b00db723-aa0b-4c61-a959-7e5eca86fc73 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] Searching for a device in session 13 and hctl ['42', '*', '*', 0] yield: sdk {{(pid=71731) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 16:22:52 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-b00db723-aa0b-4c61-a959-7e5eca86fc73 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] Connected to sdk using {'target_iqn': 'iqn.2010-10.org.openstack:a3ec6bc1-d29e-4348-adf7-8bc66e2414a1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EXicZdqM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71731) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 16:22:52 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-8308d00e-7207-4925-a623-f7d124684656 tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] No BDM found with device name vda, not building metadata. {{(pid=71731) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 16:22:52 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-8308d00e-7207-4925-a623-f7d124684656 tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71731) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 16:22:52 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-8308d00e-7207-4925-a623-f7d124684656 tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] No VIF found with MAC fa:16:3e:93:4c:5a, not building metadata {{(pid=71731) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 16:22:53 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-8308d00e-7207-4925-a623-f7d124684656 tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] Lock "8c6d8096-853b-4091-ad82-6faf8ffc85fa" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.363s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:22:53 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-f806038a-767a-4661-99e7-7942ce22ab8a tempest-TestVolumeSwap-359764099 tempest-TestVolumeSwap-359764099-project-admin] Acquiring lock "8c6d8096-853b-4091-ad82-6faf8ffc85fa" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:22:53 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-f806038a-767a-4661-99e7-7942ce22ab8a tempest-TestVolumeSwap-359764099 tempest-TestVolumeSwap-359764099-project-admin] Lock "8c6d8096-853b-4091-ad82-6faf8ffc85fa" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:22:53 user nova-compute[71731]: DEBUG os_brick.utils [None req-f806038a-767a-4661-99e7-7942ce22ab8a tempest-TestVolumeSwap-359764099 tempest-TestVolumeSwap-359764099-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 16:22:53 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:22:53 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:22:53 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fef4647-8ed6-419e-a58a-a70445e8c04a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:81501d91421\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:22:53 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:22:53 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:22:53 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0b30bdd-b608-4ec6-a2ea-b749b227e1fe]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:22:53 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:22:53 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:22:53 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[110ffaa3-1585-4537-b137-e54fbbb5ef40]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:22:53 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c92e3e4-8c0a-48de-b701-4dd2f53835bd]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:22:53 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-f806038a-767a-4661-99e7-7942ce22ab8a tempest-TestVolumeSwap-359764099 tempest-TestVolumeSwap-359764099-project-admin] Running cmd (subprocess): nvme version {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:22:53 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-f806038a-767a-4661-99e7-7942ce22ab8a tempest-TestVolumeSwap-359764099 tempest-TestVolumeSwap-359764099-project-admin] 'nvme version' failed. Not Retrying. {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 16:22:53 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f806038a-767a-4661-99e7-7942ce22ab8a tempest-TestVolumeSwap-359764099 tempest-TestVolumeSwap-359764099-project-admin] nvme not present on system {{(pid=71731) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 16:22:53 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:22:53 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 16:22:53 user nova-compute[71731]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 16:22:53 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[82e6416c-8a7e-4711-8b29-934c7066ed5f]: (4, '') {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:22:53 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.lightos [None req-f806038a-767a-4661-99e7-7942ce22ab8a tempest-TestVolumeSwap-359764099 tempest-TestVolumeSwap-359764099-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71731) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 16:22:53 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.lightos [None req-f806038a-767a-4661-99e7-7942ce22ab8a tempest-TestVolumeSwap-359764099 tempest-TestVolumeSwap-359764099-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71731) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 16:22:53 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.lightos [None req-f806038a-767a-4661-99e7-7942ce22ab8a tempest-TestVolumeSwap-359764099 tempest-TestVolumeSwap-359764099-project-admin] LIGHTOS: no hostnqn found. {{(pid=71731) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 16:22:53 user nova-compute[71731]: DEBUG os_brick.utils [None req-f806038a-767a-4661-99e7-7942ce22ab8a tempest-TestVolumeSwap-359764099 tempest-TestVolumeSwap-359764099-project-admin] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:81501d91421', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 16:22:53 user nova-compute[71731]: INFO nova.compute.manager [None req-f806038a-767a-4661-99e7-7942ce22ab8a tempest-TestVolumeSwap-359764099 tempest-TestVolumeSwap-359764099-project-admin] [instance: 8c6d8096-853b-4091-ad82-6faf8ffc85fa] Swapping volume 62e7747a-651a-4d0a-a763-bfce9c4a3cff for d3a41289-1225-4bee-927e-5da050896328
Apr 13 16:22:53 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-b00db723-aa0b-4c61-a959-7e5eca86fc73 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.378s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 16:22:53 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-b00db723-aa0b-4c61-a959-7e5eca86fc73 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] <== connect_volume: return (1942ms) {'type': 'block', 'scsi_wwn': '23737393832313262', 'path': '/dev/sdk'} {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 16:22:53 user nova-compute[71731]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b00db723-aa0b-4c61-a959-7e5eca86fc73 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] [instance: cf54be22-2a5d-40c4-8a1a-0060c77f83f6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23737393832313262', 'path': '/dev/sdk'} {{(pid=71731) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 16:22:53 user nova-compute[71731]: DEBUG nova.objects.instance [None req-b00db723-aa0b-4c61-a959-7e5eca86fc73 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] Lazy-loading 'flavor' on Instance uuid cf54be22-2a5d-40c4-8a1a-0060c77f83f6 {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:22:53 user nova-compute[71731]: DEBUG nova.virt.libvirt.guest [None req-b00db723-aa0b-4c61-a959-7e5eca86fc73 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] attach device xml: <disk type="block" device="disk">
Apr 13 16:22:53 user nova-compute[71731]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 16:22:53 user nova-compute[71731]:   <source dev="/dev/sdk"/>
Apr 13 16:22:53 user nova-compute[71731]:   <target dev="sdc" bus="scsi"/>
Apr 13 16:22:53 user nova-compute[71731]:   <serial>a3ec6bc1-d29e-4348-adf7-8bc66e2414a1</serial>
Apr 13 16:22:53 user nova-compute[71731]:   <address type="drive" controller="0" unit="2"/>
Apr 13 16:22:53 user nova-compute[71731]: </disk>
Apr 13 16:22:53 user nova-compute[71731]:  {{(pid=71731) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 13 16:22:54 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-b00db723-aa0b-4c61-a959-7e5eca86fc73 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] No BDM found with device name sda, not building metadata. {{(pid=71731) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 16:22:54 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-b00db723-aa0b-4c61-a959-7e5eca86fc73 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] No BDM found with device name sdb, not building metadata. {{(pid=71731) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 16:22:54 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-b00db723-aa0b-4c61-a959-7e5eca86fc73 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] No BDM found with device name sdc, not building metadata. {{(pid=71731) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 16:22:54 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-b00db723-aa0b-4c61-a959-7e5eca86fc73 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] No VIF found with MAC fa:16:3e:5b:20:d0, not building metadata {{(pid=71731) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 16:22:54 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-b00db723-aa0b-4c61-a959-7e5eca86fc73 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] Lock "cf54be22-2a5d-40c4-8a1a-0060c77f83f6" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.976s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:22:55 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-d07fab4c-773e-4684-83cb-19e7cefdb3af tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] Acquiring lock "cf54be22-2a5d-40c4-8a1a-0060c77f83f6" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:22:55 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-d07fab4c-773e-4684-83cb-19e7cefdb3af tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] Lock "cf54be22-2a5d-40c4-8a1a-0060c77f83f6" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:22:55 user nova-compute[71731]: INFO nova.compute.manager [None req-d07fab4c-773e-4684-83cb-19e7cefdb3af tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] [instance: cf54be22-2a5d-40c4-8a1a-0060c77f83f6] Detaching volume a3ec6bc1-d29e-4348-adf7-8bc66e2414a1
Apr 13 16:22:55 user nova-compute[71731]: INFO nova.virt.block_device [None req-d07fab4c-773e-4684-83cb-19e7cefdb3af tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] [instance: cf54be22-2a5d-40c4-8a1a-0060c77f83f6] Attempting to driver detach volume a3ec6bc1-d29e-4348-adf7-8bc66e2414a1 from mountpoint /dev/sdc
Apr 13 16:22:55 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-d07fab4c-773e-4684-83cb-19e7cefdb3af tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] Attempting to detach device sdc from instance cf54be22-2a5d-40c4-8a1a-0060c77f83f6 from the persistent domain config. {{(pid=71731) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 13 16:22:55 user nova-compute[71731]: DEBUG nova.virt.libvirt.guest [None req-d07fab4c-773e-4684-83cb-19e7cefdb3af tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 16:22:55 user nova-compute[71731]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 16:22:55 user nova-compute[71731]:   <source dev="/dev/sdk"/>
Apr 13 16:22:55 user nova-compute[71731]:   <target dev="sdc" bus="scsi"/>
Apr 13 16:22:55 user nova-compute[71731]:   <serial>a3ec6bc1-d29e-4348-adf7-8bc66e2414a1</serial>
Apr 13 16:22:55 user nova-compute[71731]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Apr 13 16:22:55 user nova-compute[71731]: </disk>
Apr 13 16:22:55 user nova-compute[71731]:  {{(pid=71731) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 16:22:55 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-d07fab4c-773e-4684-83cb-19e7cefdb3af tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] Successfully detached device sdc from instance cf54be22-2a5d-40c4-8a1a-0060c77f83f6 from the persistent domain config.
Apr 13 16:22:55 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-d07fab4c-773e-4684-83cb-19e7cefdb3af tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance cf54be22-2a5d-40c4-8a1a-0060c77f83f6 from the live domain config. {{(pid=71731) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 13 16:22:55 user nova-compute[71731]: DEBUG nova.virt.libvirt.guest [None req-d07fab4c-773e-4684-83cb-19e7cefdb3af tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 16:22:55 user nova-compute[71731]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 16:22:55 user nova-compute[71731]:   <source dev="/dev/sdk"/>
Apr 13 16:22:55 user nova-compute[71731]:   <target dev="sdc" bus="scsi"/>
Apr 13 16:22:55 user nova-compute[71731]:   <serial>a3ec6bc1-d29e-4348-adf7-8bc66e2414a1</serial>
Apr 13 16:22:55 user nova-compute[71731]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Apr 13 16:22:55 user nova-compute[71731]: </disk>
Apr 13 16:22:55 user nova-compute[71731]:  {{(pid=71731) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 16:22:56 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Received event <DeviceRemovedEvent: 1681402976.0105007, cf54be22-2a5d-40c4-8a1a-0060c77f83f6 => scsi0-0-0-2> from libvirt while the driver is waiting for it; dispatched. {{(pid=71731) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 13 16:22:56 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-d07fab4c-773e-4684-83cb-19e7cefdb3af tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance cf54be22-2a5d-40c4-8a1a-0060c77f83f6 {{(pid=71731) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 13 16:22:56 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-d07fab4c-773e-4684-83cb-19e7cefdb3af tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] Successfully detached device sdc from instance cf54be22-2a5d-40c4-8a1a-0060c77f83f6 from the live domain config.
Apr 13 16:22:56 user nova-compute[71731]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d07fab4c-773e-4684-83cb-19e7cefdb3af tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] [instance: cf54be22-2a5d-40c4-8a1a-0060c77f83f6] calling os-brick to detach iSCSI Volume {{(pid=71731) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 16:22:56 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-d07fab4c-773e-4684-83cb-19e7cefdb3af tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8cf0118790>, {'target_iqn': 'iqn.2010-10.org.openstack:a3ec6bc1-d29e-4348-adf7-8bc66e2414a1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EXicZdqM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdk': {}}" {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 16:22:56 user nova-compute[71731]: WARNING os_brick.initiator.connectors.base [None req-d07fab4c-773e-4684-83cb-19e7cefdb3af tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 16:22:56 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-d07fab4c-773e-4684-83cb-19e7cefdb3af tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 16:22:56 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-d07fab4c-773e-4684-83cb-19e7cefdb3af tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 16:22:56 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:22:56 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:22:56 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[f684d888-e45d-4f68-bf95-d5c34bdaa4e7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:62e7747a-651a-4d0a-a763-bfce9c4a3cff\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c20e80fa-58de-431a-8901-2535657aaadf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:27919afc-8990-4ed5-af9e-9d6b3d7b231e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0e3b49ec-80af-4c38-9689-f7277e495d21\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cc639d00-ef6b-4121-bcb0-c65ec0347abd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e0f728f3-fbb5-4ed8-a78b-a5d982b03f7d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:84c7f6ad-d2c2-465a-b39e-47347aa85be0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:48af37b0-6938-432e-b374-d992c4dd9ae9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a3ec6bc1-d29e-4348-adf7-8bc66e2414a1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:22:56 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-d07fab4c-773e-4684-83cb-19e7cefdb3af tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 16:22:56 user nova-compute[71731]: No targets found.
Apr 13 16:22:56 user nova-compute[71731]: iSNS:
Apr 13 16:22:56 user nova-compute[71731]: No targets found.
Apr 13 16:22:56 user nova-compute[71731]: STATIC:
Apr 13 16:22:56 user nova-compute[71731]: Target: iqn.2010-10.org.openstack:62e7747a-651a-4d0a-a763-bfce9c4a3cff
Apr 13 16:22:56 user nova-compute[71731]:         Portal: 172.16.0.220:3260,-1
Apr 13 16:22:56 user nova-compute[71731]:                 Iface Name: default
Apr 13 16:22:56 user nova-compute[71731]: Target: iqn.2010-10.org.openstack:c20e80fa-58de-431a-8901-2535657aaadf
Apr 13 16:22:56 user nova-compute[71731]:         Portal: 172.16.0.220:3260,-1
Apr 13 16:22:56 user nova-compute[71731]:                 Iface Name: default
Apr 13 16:22:56 user nova-compute[71731]: Target: iqn.2010-10.org.openstack:27919afc-8990-4ed5-af9e-9d6b3d7b231e
Apr 13 16:22:56 user nova-compute[71731]:         Portal: 172.16.0.220:3260,-1
Apr 13 16:22:56 user nova-compute[71731]:                 Iface Name: default
Apr 13 16:22:56 user nova-compute[71731]: Target: iqn.2010-10.org.openstack:0e3b49ec-80af-4c38-9689-f7277e495d21
Apr 13 16:22:56 user nova-compute[71731]:         Portal: 172.16.0.220:3260,-1
Apr 13 16:22:56 user nova-compute[71731]:                 Iface Name: default
Apr 13 16:22:56 user nova-compute[71731]: Target: iqn.2010-10.org.openstack:cc639d00-ef6b-4121-bcb0-c65ec0347abd
Apr 13 16:22:56 user nova-compute[71731]:         Portal: 172.16.0.220:3260,-1
Apr 13 16:22:56 user nova-compute[71731]:                 Iface Name: default
Apr 13 16:22:56 user nova-compute[71731]: Target: iqn.2010-10.org.openstack:e0f728f3-fbb5-4ed8-a78b-a5d982b03f7d
Apr 13 16:22:56 user nova-compute[71731]:         Portal: 172.16.0.220:3260,-1
Apr 13 16:22:56 user nova-compute[71731]:                 Iface Name: default
Apr 13 16:22:56 user nova-compute[71731]: Target: iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984
Apr 13 16:22:56 user nova-compute[71731]:         Portal: 172.16.0.220:3260,-1
Apr 13 16:22:56 user nova-compute[71731]:                 Iface Name: default
Apr 13 16:22:56 user nova-compute[71731]: Target: iqn.2010-10.org.openstack:84c7f6ad-d2c2-465a-b39e-47347aa85be0
Apr 13 16:22:56 user nova-compute[71731]:         Portal: 172.16.0.220:3260,-1
Apr 13 16:22:56 user nova-compute[71731]:                 Iface Name: default
Apr 13 16:22:56 user nova-compute[71731]: Target: iqn.2010-10.org.openstack:48af37b0-6938-432e-b374-d992c4dd9ae9
Apr 13 16:22:56 user nova-compute[71731]:         Portal: 172.16.0.220:3260,-1
Apr 13 16:22:56 user nova-compute[71731]:                 Iface Name: default
Apr 13 16:22:56 user nova-compute[71731]: Target: iqn.2010-10.org.openstack:a3ec6bc1-d29e-4348-adf7-8bc66e2414a1
Apr 13 16:22:56 user nova-compute[71731]:         Portal: 172.16.0.220:3260,-1
Apr 13 16:22:56 user nova-compute[71731]:                 Iface Name: default
Apr 13 16:22:56 user nova-compute[71731]: FIRMWARE:
Apr 13 16:22:56 user nova-compute[71731]: No targets found.
Apr 13 16:22:56 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 16:22:56 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-d07fab4c-773e-4684-83cb-19e7cefdb3af tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 16:22:56 user nova-compute[71731]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 16:22:56 user nova-compute[71731]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71731) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 16:22:56 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-d07fab4c-773e-4684-83cb-19e7cefdb3af tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a3ec6bc1-d29e-4348-adf7-8bc66e2414a1', 0)] {{(pid=71731) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 16:22:56 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:22:56 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:22:56 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2838169-4f71-4bae-812e-2330ebe730b6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0e3b49ec-80af-4c38-9689-f7277e495d21\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:27919afc-8990-4ed5-af9e-9d6b3d7b231e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:48af37b0-6938-432e-b374-d992c4dd9ae9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:62e7747a-651a-4d0a-a763-bfce9c4a3cff\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:84c7f6ad-d2c2-465a-b39e-47347aa85be0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a3ec6bc1-d29e-4348-adf7-8bc66e2414a1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c20e80fa-58de-431a-8901-2535657aaadf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cc639d00-ef6b-4121-bcb0-c65ec0347abd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e0f728f3-fbb5-4ed8-a78b-a5d982b03f7d\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:22:56 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:22:56 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:22:56 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:22:56 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[143d4593-9d1c-433e-921b-f720e0de7e66]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e3b49ec-80af-4c38-9689-f7277e495d21 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62e7747a-651a-4d0a-a763-bfce9c4a3cff (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ec6bc1-d29e-4348-adf7-8bc66e2414a1 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c7f6ad-d2c2-465a-b39e-47347aa85be0 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48af37b0-6938-432e-b374-d992c4dd9ae9 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c20e80fa-58de-431a-8901-2535657aaadf (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27919afc-8990-4ed5-af9e-9d6b3d7b231e (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc639d00-ef6b-4121-bcb0-c65ec0347abd (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0f728f3-fbb5-4ed8-a78b-a5d982b03f7d (non-flash)\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:22:56 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-d07fab4c-773e-4684-83cb-19e7cefdb3af tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e3b49ec-80af-4c38-9689-f7277e495d21 (non-flash)
Apr 13 16:22:56 user nova-compute[71731]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62e7747a-651a-4d0a-a763-bfce9c4a3cff (non-flash)
Apr 13 16:22:56 user nova-compute[71731]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ec6bc1-d29e-4348-adf7-8bc66e2414a1 (non-flash)
Apr 13 16:22:56 user nova-compute[71731]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984 (non-flash)
Apr 13 16:22:56 user nova-compute[71731]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c7f6ad-d2c2-465a-b39e-47347aa85be0 (non-flash)
Apr 13 16:22:56 user nova-compute[71731]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48af37b0-6938-432e-b374-d992c4dd9ae9 (non-flash)
Apr 13 16:22:56 user nova-compute[71731]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c20e80fa-58de-431a-8901-2535657aaadf (non-flash)
Apr 13 16:22:56 user nova-compute[71731]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27919afc-8990-4ed5-af9e-9d6b3d7b231e (non-flash)
Apr 13 16:22:56 user nova-compute[71731]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc639d00-ef6b-4121-bcb0-c65ec0347abd (non-flash)
Apr 13 16:22:56 user nova-compute[71731]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0f728f3-fbb5-4ed8-a78b-a5d982b03f7d (non-flash)
Apr 13 16:22:56 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 16:22:56 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-d07fab4c-773e-4684-83cb-19e7cefdb3af tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e3b49ec-80af-4c38-9689-f7277e495d21 (non-flash)
Apr 13 16:22:56 user nova-compute[71731]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62e7747a-651a-4d0a-a763-bfce9c4a3cff (non-flash)
Apr 13 16:22:56 user nova-compute[71731]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ec6bc1-d29e-4348-adf7-8bc66e2414a1 (non-flash)
Apr 13 16:22:56 user nova-compute[71731]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984 (non-flash)
Apr 13 16:22:56 user nova-compute[71731]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c7f6ad-d2c2-465a-b39e-47347aa85be0 (non-flash)
Apr 13 16:22:56 user nova-compute[71731]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48af37b0-6938-432e-b374-d992c4dd9ae9 (non-flash)
Apr 13 16:22:56 user nova-compute[71731]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c20e80fa-58de-431a-8901-2535657aaadf (non-flash)
Apr 13 16:22:56 user nova-compute[71731]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27919afc-8990-4ed5-af9e-9d6b3d7b231e (non-flash)
Apr 13 16:22:56 user nova-compute[71731]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc639d00-ef6b-4121-bcb0-c65ec0347abd (non-flash)
Apr 13 16:22:56 user nova-compute[71731]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0f728f3-fbb5-4ed8-a78b-a5d982b03f7d (non-flash)
Apr 13 16:22:56 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 16:22:56 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-d07fab4c-773e-4684-83cb-19e7cefdb3af tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8cf03080d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a3ec6bc1-d29e-4348-adf7-8bc66e2414a1'): ({'sdk'}, set())}) {{(pid=71731) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 16:22:56 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-d07fab4c-773e-4684-83cb-19e7cefdb3af tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] Removing single pathed devices sdk {{(pid=71731) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 16:22:56 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:22:56 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:22:56 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fdd5e21-a75e-4bfe-9303-48a97e56397d]: (4, ('path checker states:\nup                  10\n\npaths: 0\nbusy: False\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:22:56 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdk {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:22:56 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdk" returned: 0 in 0.018s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:22:56 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a472e96-e333-47cb-8520-ed84e9b4458d]: (4, ('ok\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:22:56 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-d07fab4c-773e-4684-83cb-19e7cefdb3af tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] Flushing IO for device /dev/sdk {{(pid=71731) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 16:22:56 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdk {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:22:56 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdk" returned: 0 in 0.014s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:22:56 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dd18e58-9cb4-443f-9ee8-013d28d245d5]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:22:56 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-d07fab4c-773e-4684-83cb-19e7cefdb3af tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=71731) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 16:22:56 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdk/device/delete {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:22:56 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdk/device/delete" returned: 0 in 0.047s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:22:56 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[af39d184-d231-404f-842d-c87da5f7d405]: (4, ('1', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:22:56 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-d07fab4c-773e-4684-83cb-19e7cefdb3af tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] Checking to see if SCSI volumes sdk have been removed. {{(pid=71731) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 16:22:56 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-d07fab4c-773e-4684-83cb-19e7cefdb3af tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] SCSI volumes sdk have been removed. {{(pid=71731) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 16:22:56 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-d07fab4c-773e-4684-83cb-19e7cefdb3af tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a3ec6bc1-d29e-4348-adf7-8bc66e2414a1')] {{(pid=71731) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 16:22:56 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3ec6bc1-d29e-4348-adf7-8bc66e2414a1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:22:56 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3ec6bc1-d29e-4348-adf7-8bc66e2414a1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:22:56 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[92a5e213-5c6a-43a0-ad3a-2201e1bb3f71]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:22:56 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-d07fab4c-773e-4684-83cb-19e7cefdb3af tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:22:56 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3ec6bc1-d29e-4348-adf7-8bc66e2414a1 -p 172.16.0.220:3260 --logout {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:22:56 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3ec6bc1-d29e-4348-adf7-8bc66e2414a1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.080s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:22:56 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7365a72-5019-4b4c-8996-c7949355b9ef]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:a3ec6bc1-d29e-4348-adf7-8bc66e2414a1, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:a3ec6bc1-d29e-4348-adf7-8bc66e2414a1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:22:56 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-d07fab4c-773e-4684-83cb-19e7cefdb3af tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:a3ec6bc1-d29e-4348-adf7-8bc66e2414a1, portal: 172.16.0.220,3260]
Apr 13 16:22:56 user nova-compute[71731]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:a3ec6bc1-d29e-4348-adf7-8bc66e2414a1, portal: 172.16.0.220,3260] successful.
Apr 13 16:22:56 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:22:56 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3ec6bc1-d29e-4348-adf7-8bc66e2414a1 -p 172.16.0.220:3260 --op delete {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:22:56 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3ec6bc1-d29e-4348-adf7-8bc66e2414a1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.039s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:22:56 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[512981d3-11c2-400d-9b6f-18232129a521]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:22:56 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-d07fab4c-773e-4684-83cb-19e7cefdb3af tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:22:56 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-d07fab4c-773e-4684-83cb-19e7cefdb3af tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.376s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 16:22:56 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-d07fab4c-773e-4684-83cb-19e7cefdb3af tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] <== disconnect_volume: return (377ms) None {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 16:22:56 user nova-compute[71731]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d07fab4c-773e-4684-83cb-19e7cefdb3af tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] [instance: cf54be22-2a5d-40c4-8a1a-0060c77f83f6] Disconnected iSCSI Volume {{(pid=71731) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 16:22:57 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:22:57 user nova-compute[71731]: DEBUG nova.objects.instance [None req-d07fab4c-773e-4684-83cb-19e7cefdb3af tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] Lazy-loading 'flavor' on Instance uuid cf54be22-2a5d-40c4-8a1a-0060c77f83f6 {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:22:57 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-d07fab4c-773e-4684-83cb-19e7cefdb3af tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] Lock "cf54be22-2a5d-40c4-8a1a-0060c77f83f6" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.775s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:22:58 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-45ae7812-0322-4a05-bda4-66d4168a7ed2 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] Acquiring lock "cf54be22-2a5d-40c4-8a1a-0060c77f83f6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:22:58 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-45ae7812-0322-4a05-bda4-66d4168a7ed2 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] Lock "cf54be22-2a5d-40c4-8a1a-0060c77f83f6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:22:58 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-45ae7812-0322-4a05-bda4-66d4168a7ed2 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] Acquiring lock "cf54be22-2a5d-40c4-8a1a-0060c77f83f6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:22:58 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-45ae7812-0322-4a05-bda4-66d4168a7ed2 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] Lock "cf54be22-2a5d-40c4-8a1a-0060c77f83f6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:22:58 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-45ae7812-0322-4a05-bda4-66d4168a7ed2 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] Lock "cf54be22-2a5d-40c4-8a1a-0060c77f83f6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:22:58 user nova-compute[71731]: INFO nova.compute.manager [None req-45ae7812-0322-4a05-bda4-66d4168a7ed2 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] [instance: cf54be22-2a5d-40c4-8a1a-0060c77f83f6] Terminating instance
Apr 13 16:22:58 user nova-compute[71731]: DEBUG nova.compute.manager [None req-45ae7812-0322-4a05-bda4-66d4168a7ed2 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] [instance: cf54be22-2a5d-40c4-8a1a-0060c77f83f6] Start destroying the instance on the hypervisor. {{(pid=71731) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 16:22:58 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:22:58 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:22:58 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:22:58 user nova-compute[71731]: DEBUG nova.compute.manager [req-b600d3cf-6866-4db2-85dc-6e432f133553 req-c1f3efc2-1269-44d0-9f13-f79621ab56cd service nova] [instance: cf54be22-2a5d-40c4-8a1a-0060c77f83f6] Received event network-vif-unplugged-3e9128bc-6e2e-4c5e-bf37-1142304eff26 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:22:58 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-b600d3cf-6866-4db2-85dc-6e432f133553 req-c1f3efc2-1269-44d0-9f13-f79621ab56cd service nova] Acquiring lock "cf54be22-2a5d-40c4-8a1a-0060c77f83f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:22:58 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-b600d3cf-6866-4db2-85dc-6e432f133553 req-c1f3efc2-1269-44d0-9f13-f79621ab56cd service nova] Lock "cf54be22-2a5d-40c4-8a1a-0060c77f83f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:22:58 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-b600d3cf-6866-4db2-85dc-6e432f133553 req-c1f3efc2-1269-44d0-9f13-f79621ab56cd service nova] Lock "cf54be22-2a5d-40c4-8a1a-0060c77f83f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:22:58 user nova-compute[71731]: DEBUG nova.compute.manager [req-b600d3cf-6866-4db2-85dc-6e432f133553 req-c1f3efc2-1269-44d0-9f13-f79621ab56cd service nova] [instance: cf54be22-2a5d-40c4-8a1a-0060c77f83f6] No waiting events found dispatching network-vif-unplugged-3e9128bc-6e2e-4c5e-bf37-1142304eff26 {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:22:58 user nova-compute[71731]: DEBUG nova.compute.manager [req-b600d3cf-6866-4db2-85dc-6e432f133553 req-c1f3efc2-1269-44d0-9f13-f79621ab56cd service nova] [instance: cf54be22-2a5d-40c4-8a1a-0060c77f83f6] Received event network-vif-unplugged-3e9128bc-6e2e-4c5e-bf37-1142304eff26 for instance with task_state deleting. {{(pid=71731) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 16:22:58 user nova-compute[71731]: DEBUG nova.compute.manager [None req-f806038a-767a-4661-99e7-7942ce22ab8a tempest-TestVolumeSwap-359764099 tempest-TestVolumeSwap-359764099-project-admin] [instance: 8c6d8096-853b-4091-ad82-6faf8ffc85fa] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d3a41289-1225-4bee-927e-5da050896328', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EtZcSkFG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '8c6d8096-853b-4091-ad82-6faf8ffc85fa', 'attached_at': '', 'detached_at': '', 'volume_id': 'd3a41289-1225-4bee-927e-5da050896328', 'serial': 'd3a41289-1225-4bee-927e-5da050896328'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:62e7747a-651a-4d0a-a763-bfce9c4a3cff', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EHjgiLQq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, 'status': 'reserved', 'instance': '8c6d8096-853b-4091-ad82-6faf8ffc85fa', 'attached_at': '', 'detached_at': '', 'volume_id': '62e7747a-651a-4d0a-a763-bfce9c4a3cff', 'serial'} {{(pid=71731) _swap_volume /opt/stack/nova/nova/compute/manager.py:7656}}
Apr 13 16:22:58 user nova-compute[71731]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f806038a-767a-4661-99e7-7942ce22ab8a tempest-TestVolumeSwap-359764099 tempest-TestVolumeSwap-359764099-project-admin] [instance: 8c6d8096-853b-4091-ad82-6faf8ffc85fa] Calling os-brick to attach iSCSI Volume {{(pid=71731) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 16:22:58 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-f806038a-767a-4661-99e7-7942ce22ab8a tempest-TestVolumeSwap-359764099 tempest-TestVolumeSwap-359764099-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8cf0118790>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d3a41289-1225-4bee-927e-5da050896328', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EtZcSkFG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 16:22:58 user nova-compute[71731]: WARNING os_brick.initiator.connectors.base [None req-f806038a-767a-4661-99e7-7942ce22ab8a tempest-TestVolumeSwap-359764099 tempest-TestVolumeSwap-359764099-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 16:22:58 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-f806038a-767a-4661-99e7-7942ce22ab8a tempest-TestVolumeSwap-359764099 tempest-TestVolumeSwap-359764099-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 16:22:58 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-f806038a-767a-4661-99e7-7942ce22ab8a tempest-TestVolumeSwap-359764099 tempest-TestVolumeSwap-359764099-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 16:22:58 user nova-compute[71731]: WARNING os_brick.initiator.connectors.base [None req-f806038a-767a-4661-99e7-7942ce22ab8a tempest-TestVolumeSwap-359764099 tempest-TestVolumeSwap-359764099-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 16:22:58 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-f806038a-767a-4661-99e7-7942ce22ab8a tempest-TestVolumeSwap-359764099 tempest-TestVolumeSwap-359764099-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d3a41289-1225-4bee-927e-5da050896328" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 16:22:58 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-f806038a-767a-4661-99e7-7942ce22ab8a tempest-TestVolumeSwap-359764099 tempest-TestVolumeSwap-359764099-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d3a41289-1225-4bee-927e-5da050896328" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 16:22:58 user nova-compute[71731]: INFO os_brick.initiator.connectors.iscsi [None req-f806038a-767a-4661-99e7-7942ce22ab8a tempest-TestVolumeSwap-359764099 tempest-TestVolumeSwap-359764099-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 16:22:58 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3a41289-1225-4bee-927e-5da050896328 -p 172.16.0.220:3260 {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:22:58 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3a41289-1225-4bee-927e-5da050896328 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:22:58 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[f718a096-4301-470a-a5e8-1e1804201286]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:22:58 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-f806038a-767a-4661-99e7-7942ce22ab8a tempest-TestVolumeSwap-359764099 tempest-TestVolumeSwap-359764099-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 16:22:58 user nova-compute[71731]:  {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:22:58 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3a41289-1225-4bee-927e-5da050896328 -p 172.16.0.220:3260 --interface default --op new {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:22:58 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3a41289-1225-4bee-927e-5da050896328 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:22:58 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca1185b4-a98b-4467-a7aa-415680127661]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d3a41289-1225-4bee-927e-5da050896328] added\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:22:58 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-f806038a-767a-4661-99e7-7942ce22ab8a tempest-TestVolumeSwap-359764099 tempest-TestVolumeSwap-359764099-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d3a41289-1225-4bee-927e-5da050896328] added
Apr 13 16:22:58 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:22:58 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3a41289-1225-4bee-927e-5da050896328 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:22:58 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3a41289-1225-4bee-927e-5da050896328 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:22:58 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfcd29ca-3a85-4040-ad8c-040b9a8ed1a3]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:22:58 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-f806038a-767a-4661-99e7-7942ce22ab8a tempest-TestVolumeSwap-359764099 tempest-TestVolumeSwap-359764099-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:22:58 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3a41289-1225-4bee-927e-5da050896328 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:22:58 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3a41289-1225-4bee-927e-5da050896328 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:22:58 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[80d03e85-6d03-48ab-b882-e23e93a535b1]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:22:58 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-f806038a-767a-4661-99e7-7942ce22ab8a tempest-TestVolumeSwap-359764099 tempest-TestVolumeSwap-359764099-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:22:58 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3a41289-1225-4bee-927e-5da050896328 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EtZcSkFG {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:22:58 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3a41289-1225-4bee-927e-5da050896328 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EtZcSkFG" returned: 0 in 0.030s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:22:58 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0d43dab-c161-46e3-a54c-b5d19d7fba99]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:22:58 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-f806038a-767a-4661-99e7-7942ce22ab8a tempest-TestVolumeSwap-359764099 tempest-TestVolumeSwap-359764099-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EtZcSkFG'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:22:58 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3a41289-1225-4bee-927e-5da050896328 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:22:58 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3a41289-1225-4bee-927e-5da050896328 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:22:58 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[3392b27a-5a2b-4600-afdc-d4e39247b921]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:22:58 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-f806038a-767a-4661-99e7-7942ce22ab8a tempest-TestVolumeSwap-359764099 tempest-TestVolumeSwap-359764099-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:22:58 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:22:58 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:22:58 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[642f16f3-8180-4c6b-a077-ffdf49a9b563]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e3b49ec-80af-4c38-9689-f7277e495d21 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62e7747a-651a-4d0a-a763-bfce9c4a3cff (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c7f6ad-d2c2-465a-b39e-47347aa85be0 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48af37b0-6938-432e-b374-d992c4dd9ae9 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c20e80fa-58de-431a-8901-2535657aaadf (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27919afc-8990-4ed5-af9e-9d6b3d7b231e (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc639d00-ef6b-4121-bcb0-c65ec0347abd (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0f728f3-fbb5-4ed8-a78b-a5d982b03f7d (non-flash)\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:22:58 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-f806038a-767a-4661-99e7-7942ce22ab8a tempest-TestVolumeSwap-359764099 tempest-TestVolumeSwap-359764099-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e3b49ec-80af-4c38-9689-f7277e495d21 (non-flash)
Apr 13 16:22:58 user nova-compute[71731]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62e7747a-651a-4d0a-a763-bfce9c4a3cff (non-flash)
Apr 13 16:22:58 user nova-compute[71731]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984 (non-flash)
Apr 13 16:22:58 user nova-compute[71731]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c7f6ad-d2c2-465a-b39e-47347aa85be0 (non-flash)
Apr 13 16:22:58 user nova-compute[71731]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48af37b0-6938-432e-b374-d992c4dd9ae9 (non-flash)
Apr 13 16:22:58 user nova-compute[71731]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c20e80fa-58de-431a-8901-2535657aaadf (non-flash)
Apr 13 16:22:58 user nova-compute[71731]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27919afc-8990-4ed5-af9e-9d6b3d7b231e (non-flash)
Apr 13 16:22:58 user nova-compute[71731]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc639d00-ef6b-4121-bcb0-c65ec0347abd (non-flash)
Apr 13 16:22:58 user nova-compute[71731]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0f728f3-fbb5-4ed8-a78b-a5d982b03f7d (non-flash)
Apr 13 16:22:58 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 16:22:58 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-f806038a-767a-4661-99e7-7942ce22ab8a tempest-TestVolumeSwap-359764099 tempest-TestVolumeSwap-359764099-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e3b49ec-80af-4c38-9689-f7277e495d21 (non-flash)
Apr 13 16:22:58 user nova-compute[71731]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62e7747a-651a-4d0a-a763-bfce9c4a3cff (non-flash)
Apr 13 16:22:58 user nova-compute[71731]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984 (non-flash)
Apr 13 16:22:58 user nova-compute[71731]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c7f6ad-d2c2-465a-b39e-47347aa85be0 (non-flash)
Apr 13 16:22:58 user nova-compute[71731]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48af37b0-6938-432e-b374-d992c4dd9ae9 (non-flash)
Apr 13 16:22:58 user nova-compute[71731]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c20e80fa-58de-431a-8901-2535657aaadf (non-flash)
Apr 13 16:22:58 user nova-compute[71731]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27919afc-8990-4ed5-af9e-9d6b3d7b231e (non-flash)
Apr 13 16:22:58 user nova-compute[71731]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc639d00-ef6b-4121-bcb0-c65ec0347abd (non-flash)
Apr 13 16:22:58 user nova-compute[71731]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0f728f3-fbb5-4ed8-a78b-a5d982b03f7d (non-flash)
Apr 13 16:22:58 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 16:22:58 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3a41289-1225-4bee-927e-5da050896328 -p 172.16.0.220:3260 --login {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:22:58 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3a41289-1225-4bee-927e-5da050896328 -p 172.16.0.220:3260 --login" returned: 0 in 0.091s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:22:58 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad1b1bcd-4b64-4b9d-a35e-39a4089fba25]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d3a41289-1225-4bee-927e-5da050896328, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d3a41289-1225-4bee-927e-5da050896328, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:22:58 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-f806038a-767a-4661-99e7-7942ce22ab8a tempest-TestVolumeSwap-359764099 tempest-TestVolumeSwap-359764099-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d3a41289-1225-4bee-927e-5da050896328, portal: 172.16.0.220,3260]
Apr 13 16:22:58 user nova-compute[71731]: Login to [iface: default, target: iqn.2010-10.org.openstack:d3a41289-1225-4bee-927e-5da050896328, portal: 172.16.0.220,3260] successful.
Apr 13 16:22:58 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:22:58 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3a41289-1225-4bee-927e-5da050896328 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:22:58 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3a41289-1225-4bee-927e-5da050896328 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:22:58 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[db8d46f5-c8f0-4c78-8516-024d3e28131e]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:22:58 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-f806038a-767a-4661-99e7-7942ce22ab8a tempest-TestVolumeSwap-359764099 tempest-TestVolumeSwap-359764099-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:22:58 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:22:58 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:22:58 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b4068dc-1cb5-4cee-90b0-26b2d1364b24]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e3b49ec-80af-4c38-9689-f7277e495d21 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62e7747a-651a-4d0a-a763-bfce9c4a3cff (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3a41289-1225-4bee-927e-5da050896328 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c7f6ad-d2c2-465a-b39e-47347aa85be0 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48af37b0-6938-432e-b374-d992c4dd9ae9 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c20e80fa-58de-431a-8901-2535657aaadf (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27919afc-8990-4ed5-af9e-9d6b3d7b231e (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc639d00-ef6b-4121-bcb0-c65ec0347abd (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0f728f3-fbb5-4ed8-a78b-a5d982b03f7d (non-flash)\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:22:58 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-f806038a-767a-4661-99e7-7942ce22ab8a tempest-TestVolumeSwap-359764099 tempest-TestVolumeSwap-359764099-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e3b49ec-80af-4c38-9689-f7277e495d21 (non-flash)
Apr 13 16:22:58 user nova-compute[71731]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62e7747a-651a-4d0a-a763-bfce9c4a3cff (non-flash)
Apr 13 16:22:58 user nova-compute[71731]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3a41289-1225-4bee-927e-5da050896328 (non-flash)
Apr 13 16:22:58 user nova-compute[71731]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984 (non-flash)
Apr 13 16:22:58 user nova-compute[71731]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c7f6ad-d2c2-465a-b39e-47347aa85be0 (non-flash)
Apr 13 16:22:58 user nova-compute[71731]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48af37b0-6938-432e-b374-d992c4dd9ae9 (non-flash)
Apr 13 16:22:58 user nova-compute[71731]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c20e80fa-58de-431a-8901-2535657aaadf (non-flash)
Apr 13 16:22:58 user nova-compute[71731]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27919afc-8990-4ed5-af9e-9d6b3d7b231e (non-flash)
Apr 13 16:22:58 user nova-compute[71731]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc639d00-ef6b-4121-bcb0-c65ec0347abd (non-flash)
Apr 13 16:22:58 user nova-compute[71731]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0f728f3-fbb5-4ed8-a78b-a5d982b03f7d (non-flash)
Apr 13 16:22:58 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 16:22:58 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-f806038a-767a-4661-99e7-7942ce22ab8a tempest-TestVolumeSwap-359764099 tempest-TestVolumeSwap-359764099-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e3b49ec-80af-4c38-9689-f7277e495d21 (non-flash)
Apr 13 16:22:58 user nova-compute[71731]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62e7747a-651a-4d0a-a763-bfce9c4a3cff (non-flash)
Apr 13 16:22:58 user nova-compute[71731]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3a41289-1225-4bee-927e-5da050896328 (non-flash)
Apr 13 16:22:58 user nova-compute[71731]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984 (non-flash)
Apr 13 16:22:58 user nova-compute[71731]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c7f6ad-d2c2-465a-b39e-47347aa85be0 (non-flash)
Apr 13 16:22:58 user nova-compute[71731]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48af37b0-6938-432e-b374-d992c4dd9ae9 (non-flash)
Apr 13 16:22:58 user nova-compute[71731]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c20e80fa-58de-431a-8901-2535657aaadf (non-flash)
Apr 13 16:22:58 user nova-compute[71731]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27919afc-8990-4ed5-af9e-9d6b3d7b231e (non-flash)
Apr 13 16:22:58 user nova-compute[71731]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc639d00-ef6b-4121-bcb0-c65ec0347abd (non-flash)
Apr 13 16:22:58 user nova-compute[71731]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0f728f3-fbb5-4ed8-a78b-a5d982b03f7d (non-flash)
Apr 13 16:22:58 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 16:22:58 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-f806038a-767a-4661-99e7-7942ce22ab8a tempest-TestVolumeSwap-359764099 tempest-TestVolumeSwap-359764099-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d3a41289-1225-4bee-927e-5da050896328" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.353s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 16:22:58 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-f806038a-767a-4661-99e7-7942ce22ab8a tempest-TestVolumeSwap-359764099 tempest-TestVolumeSwap-359764099-project-admin] Connected to 172.16.0.220:3260 {{(pid=71731) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 16:22:58 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-f806038a-767a-4661-99e7-7942ce22ab8a tempest-TestVolumeSwap-359764099 tempest-TestVolumeSwap-359764099-project-admin] HCTL ('42', '-', '-', 0) found on session 14 with lun 0 {{(pid=71731) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 16:22:58 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-f806038a-767a-4661-99e7-7942ce22ab8a tempest-TestVolumeSwap-359764099 tempest-TestVolumeSwap-359764099-project-admin] Scanning host 42 c: -, t: -, l: 0) {{(pid=71731) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 16:22:58 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host42/scan {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:22:58 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host42/scan" returned: 0 in 0.024s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:22:58 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6b89cb3-16ae-40c2-b835-0868782cce9b]: (4, ('- - 0', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:22:58 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-f806038a-767a-4661-99e7-7942ce22ab8a tempest-TestVolumeSwap-359764099 tempest-TestVolumeSwap-359764099-project-admin] Searching for a device in session 14 and hctl ['42', '*', '*', 0] yield: sdk {{(pid=71731) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 16:22:58 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-f806038a-767a-4661-99e7-7942ce22ab8a tempest-TestVolumeSwap-359764099 tempest-TestVolumeSwap-359764099-project-admin] Connected to sdk using {'target_iqn': 'iqn.2010-10.org.openstack:d3a41289-1225-4bee-927e-5da050896328', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EtZcSkFG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71731) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 16:22:58 user nova-compute[71731]: INFO nova.virt.libvirt.driver [-] [instance: cf54be22-2a5d-40c4-8a1a-0060c77f83f6] Instance destroyed successfully.
Apr 13 16:22:58 user nova-compute[71731]: DEBUG nova.objects.instance [None req-45ae7812-0322-4a05-bda4-66d4168a7ed2 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] Lazy-loading 'resources' on Instance uuid cf54be22-2a5d-40c4-8a1a-0060c77f83f6 {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:22:58 user nova-compute[71731]: DEBUG nova.virt.libvirt.vif [None req-45ae7812-0322-4a05-bda4-66d4168a7ed2 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T16:20:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-388983342',display_name='tempest-AttachSCSIVolumeTestJSON-server-388983342',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-388983342',id=6,image_ref='01cb01f7-9c27-41ff-9feb-78a78b8b56e5',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKRbzNSMC33JpjfFNT2r74GnYkef8HT04SCtROQjyE6kxj3jEL5OVrLCY3/Vs9414NnlDaybdZ+OiSgBfWjJgF0eyNdGY+70v0keT0GP3beXZnMvCbkO5Jb+eWMj3MAj/g==',key_name='tempest-keypair-420366585',keypairs=<?>,launch_index=0,launched_at=2023-04-13T16:21:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a6365a1e8d6c48499d4b8921244d92a9',ramdisk_id='',reservation_id='r-woolfliz',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='01cb01f7-9c27-41ff-9feb-78a78b8b56e5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-942770243',owner_user_name='tempest-AttachSCSIVolumeTestJSON-942770243-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T16:21:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0b143a8db8a3410eb09b21ced7bd883e',uuid=cf54be22-2a5d-40c4-8a1a-0060c77f83f6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3e9128bc-6e2e-4c5e-bf37-1142304eff26", "address": "fa:16:3e:5b:20:d0", "network": {"id": "a2a5ab65-4be4-4535-b98e-a8eeaedddee8", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-245114435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6365a1e8d6c48499d4b8921244d92a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e9128bc-6e", "ovs_interfaceid": "3e9128bc-6e2e-4c5e-bf37-1142304eff26", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 16:22:58 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-45ae7812-0322-4a05-bda4-66d4168a7ed2 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] Converting VIF {"id": "3e9128bc-6e2e-4c5e-bf37-1142304eff26", "address": "fa:16:3e:5b:20:d0", "network": {"id": "a2a5ab65-4be4-4535-b98e-a8eeaedddee8", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-245114435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6365a1e8d6c48499d4b8921244d92a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e9128bc-6e", "ovs_interfaceid": "3e9128bc-6e2e-4c5e-bf37-1142304eff26", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 16:22:58 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-45ae7812-0322-4a05-bda4-66d4168a7ed2 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5b:20:d0,bridge_name='br-int',has_traffic_filtering=True,id=3e9128bc-6e2e-4c5e-bf37-1142304eff26,network=Network(a2a5ab65-4be4-4535-b98e-a8eeaedddee8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e9128bc-6e') {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 16:22:58 user nova-compute[71731]: DEBUG os_vif [None req-45ae7812-0322-4a05-bda4-66d4168a7ed2 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5b:20:d0,bridge_name='br-int',has_traffic_filtering=True,id=3e9128bc-6e2e-4c5e-bf37-1142304eff26,network=Network(a2a5ab65-4be4-4535-b98e-a8eeaedddee8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e9128bc-6e') {{(pid=71731) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 16:22:58 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:22:58 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3e9128bc-6e, bridge=br-int, if_exists=True) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:22:58 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:22:58 user nova-compute[71731]: INFO os_vif [None req-45ae7812-0322-4a05-bda4-66d4168a7ed2 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5b:20:d0,bridge_name='br-int',has_traffic_filtering=True,id=3e9128bc-6e2e-4c5e-bf37-1142304eff26,network=Network(a2a5ab65-4be4-4535-b98e-a8eeaedddee8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e9128bc-6e')
Apr 13 16:22:58 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-45ae7812-0322-4a05-bda4-66d4168a7ed2 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] [instance: cf54be22-2a5d-40c4-8a1a-0060c77f83f6] Deleting instance files /opt/stack/data/nova/instances/cf54be22-2a5d-40c4-8a1a-0060c77f83f6_del
Apr 13 16:22:58 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-45ae7812-0322-4a05-bda4-66d4168a7ed2 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] [instance: cf54be22-2a5d-40c4-8a1a-0060c77f83f6] Deletion of /opt/stack/data/nova/instances/cf54be22-2a5d-40c4-8a1a-0060c77f83f6_del complete
Apr 13 16:22:58 user nova-compute[71731]: INFO nova.compute.manager [None req-45ae7812-0322-4a05-bda4-66d4168a7ed2 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] [instance: cf54be22-2a5d-40c4-8a1a-0060c77f83f6] Took 0.91 seconds to destroy the instance on the hypervisor.
Apr 13 16:22:58 user nova-compute[71731]: DEBUG oslo.service.loopingcall [None req-45ae7812-0322-4a05-bda4-66d4168a7ed2 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71731) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 16:22:58 user nova-compute[71731]: DEBUG nova.compute.manager [-] [instance: cf54be22-2a5d-40c4-8a1a-0060c77f83f6] Deallocating network for instance {{(pid=71731) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 16:22:58 user nova-compute[71731]: DEBUG nova.network.neutron [-] [instance: cf54be22-2a5d-40c4-8a1a-0060c77f83f6] deallocate_for_instance() {{(pid=71731) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 16:22:59 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-f806038a-767a-4661-99e7-7942ce22ab8a tempest-TestVolumeSwap-359764099 tempest-TestVolumeSwap-359764099-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.407s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 16:22:59 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-f806038a-767a-4661-99e7-7942ce22ab8a tempest-TestVolumeSwap-359764099 tempest-TestVolumeSwap-359764099-project-admin] <== connect_volume: return (1409ms) {'type': 'block', 'scsi_wwn': '23430383730353231', 'path': '/dev/sdk'} {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 16:22:59 user nova-compute[71731]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f806038a-767a-4661-99e7-7942ce22ab8a tempest-TestVolumeSwap-359764099 tempest-TestVolumeSwap-359764099-project-admin] [instance: 8c6d8096-853b-4091-ad82-6faf8ffc85fa] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23430383730353231', 'path': '/dev/sdk'} {{(pid=71731) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 16:22:59 user nova-compute[71731]: DEBUG nova.objects.instance [None req-f806038a-767a-4661-99e7-7942ce22ab8a tempest-TestVolumeSwap-359764099 tempest-TestVolumeSwap-359764099-project-admin] Lazy-loading 'flavor' on Instance uuid 8c6d8096-853b-4091-ad82-6faf8ffc85fa {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:23:00 user nova-compute[71731]: DEBUG nova.network.neutron [-] [instance: cf54be22-2a5d-40c4-8a1a-0060c77f83f6] Updating instance_info_cache with network_info: [] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:23:00 user nova-compute[71731]: INFO nova.compute.manager [-] [instance: cf54be22-2a5d-40c4-8a1a-0060c77f83f6] Took 1.29 seconds to deallocate network for instance.
Apr 13 16:23:00 user nova-compute[71731]: DEBUG nova.compute.manager [req-13fe3719-b2af-4562-aad2-860fbe1b056d req-9b46799f-5202-40d0-b102-9a98e00fcaf4 service nova] [instance: cf54be22-2a5d-40c4-8a1a-0060c77f83f6] Received event network-vif-deleted-3e9128bc-6e2e-4c5e-bf37-1142304eff26 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:23:00 user nova-compute[71731]: DEBUG nova.virt.libvirt.guest [None req-f806038a-767a-4661-99e7-7942ce22ab8a tempest-TestVolumeSwap-359764099 tempest-TestVolumeSwap-359764099-project-admin] COPY block job progress, current cursor: 8388608 final cursor: 1073741824 {{(pid=71731) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 13 16:23:00 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-45ae7812-0322-4a05-bda4-66d4168a7ed2 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:23:00 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-45ae7812-0322-4a05-bda4-66d4168a7ed2 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:23:00 user nova-compute[71731]: DEBUG nova.compute.manager [req-db885a01-036b-4cc1-9249-30cf574cd2a2 req-31ab3289-8bf5-45c7-a4f2-5949f9eb0b0d service nova] [instance: cf54be22-2a5d-40c4-8a1a-0060c77f83f6] Received event network-vif-plugged-3e9128bc-6e2e-4c5e-bf37-1142304eff26 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:23:00 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-db885a01-036b-4cc1-9249-30cf574cd2a2 req-31ab3289-8bf5-45c7-a4f2-5949f9eb0b0d service nova] Acquiring lock "cf54be22-2a5d-40c4-8a1a-0060c77f83f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:23:00 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-db885a01-036b-4cc1-9249-30cf574cd2a2 req-31ab3289-8bf5-45c7-a4f2-5949f9eb0b0d service nova] Lock "cf54be22-2a5d-40c4-8a1a-0060c77f83f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:23:00 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-db885a01-036b-4cc1-9249-30cf574cd2a2 req-31ab3289-8bf5-45c7-a4f2-5949f9eb0b0d service nova] Lock "cf54be22-2a5d-40c4-8a1a-0060c77f83f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:23:00 user nova-compute[71731]: DEBUG nova.compute.manager [req-db885a01-036b-4cc1-9249-30cf574cd2a2 req-31ab3289-8bf5-45c7-a4f2-5949f9eb0b0d service nova] [instance: cf54be22-2a5d-40c4-8a1a-0060c77f83f6] No waiting events found dispatching network-vif-plugged-3e9128bc-6e2e-4c5e-bf37-1142304eff26 {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:23:00 user nova-compute[71731]: WARNING nova.compute.manager [req-db885a01-036b-4cc1-9249-30cf574cd2a2 req-31ab3289-8bf5-45c7-a4f2-5949f9eb0b0d service nova] [instance: cf54be22-2a5d-40c4-8a1a-0060c77f83f6] Received unexpected event network-vif-plugged-3e9128bc-6e2e-4c5e-bf37-1142304eff26 for instance with vm_state deleted and task_state None.
Apr 13 16:23:00 user nova-compute[71731]: DEBUG nova.virt.libvirt.guest [None req-f806038a-767a-4661-99e7-7942ce22ab8a tempest-TestVolumeSwap-359764099 tempest-TestVolumeSwap-359764099-project-admin] COPY block job progress, current cursor: 93323264 final cursor: 1073741824 {{(pid=71731) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 13 16:23:00 user nova-compute[71731]: DEBUG nova.compute.provider_tree [None req-45ae7812-0322-4a05-bda4-66d4168a7ed2 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] Inventory has not changed in ProviderTree for provider: cb6b1a64-0c24-4e2d-af1e-16576ca9165c {{(pid=71731) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 16:23:00 user nova-compute[71731]: DEBUG nova.scheduler.client.report [None req-45ae7812-0322-4a05-bda4-66d4168a7ed2 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] Inventory has not changed for provider cb6b1a64-0c24-4e2d-af1e-16576ca9165c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71731) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 16:23:00 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-45ae7812-0322-4a05-bda4-66d4168a7ed2 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.570s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:23:00 user nova-compute[71731]: INFO nova.scheduler.client.report [None req-45ae7812-0322-4a05-bda4-66d4168a7ed2 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] Deleted allocations for instance cf54be22-2a5d-40c4-8a1a-0060c77f83f6
Apr 13 16:23:01 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-45ae7812-0322-4a05-bda4-66d4168a7ed2 tempest-AttachSCSIVolumeTestJSON-942770243 tempest-AttachSCSIVolumeTestJSON-942770243-project-member] Lock "cf54be22-2a5d-40c4-8a1a-0060c77f83f6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.987s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:23:01 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:23:01 user nova-compute[71731]: DEBUG nova.virt.libvirt.guest [None req-f806038a-767a-4661-99e7-7942ce22ab8a tempest-TestVolumeSwap-359764099 tempest-TestVolumeSwap-359764099-project-admin] COPY block job progress, current cursor: 204472320 final cursor: 1073741824 {{(pid=71731) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 13 16:23:01 user nova-compute[71731]: DEBUG nova.virt.libvirt.guest [None req-f806038a-767a-4661-99e7-7942ce22ab8a tempest-TestVolumeSwap-359764099 tempest-TestVolumeSwap-359764099-project-admin] COPY block job progress, current cursor: 374341632 final cursor: 1073741824 {{(pid=71731) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 13 16:23:02 user nova-compute[71731]: DEBUG nova.virt.libvirt.guest [None req-f806038a-767a-4661-99e7-7942ce22ab8a tempest-TestVolumeSwap-359764099 tempest-TestVolumeSwap-359764099-project-admin] COPY block job progress, current cursor: 552599552 final cursor: 1073741824 {{(pid=71731) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 13 16:23:02 user nova-compute[71731]: DEBUG nova.virt.libvirt.guest [None req-f806038a-767a-4661-99e7-7942ce22ab8a tempest-TestVolumeSwap-359764099 tempest-TestVolumeSwap-359764099-project-admin] COPY block job progress, current cursor: 672137216 final cursor: 1073741824 {{(pid=71731) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 13 16:23:03 user nova-compute[71731]: DEBUG nova.virt.libvirt.guest [None req-f806038a-767a-4661-99e7-7942ce22ab8a tempest-TestVolumeSwap-359764099 tempest-TestVolumeSwap-359764099-project-admin] COPY block job progress, current cursor: 813694976 final cursor: 1073741824 {{(pid=71731) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 13 16:23:03 user nova-compute[71731]: DEBUG nova.virt.libvirt.guest [None req-f806038a-767a-4661-99e7-7942ce22ab8a tempest-TestVolumeSwap-359764099 tempest-TestVolumeSwap-359764099-project-admin] COPY block job progress, current cursor: 1007681536 final cursor: 1073741824 {{(pid=71731) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 13 16:23:03 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:23:04 user nova-compute[71731]: DEBUG nova.virt.libvirt.guest [None req-f806038a-767a-4661-99e7-7942ce22ab8a tempest-TestVolumeSwap-359764099 tempest-TestVolumeSwap-359764099-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=71731) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 13 16:23:04 user nova-compute[71731]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f806038a-767a-4661-99e7-7942ce22ab8a tempest-TestVolumeSwap-359764099 tempest-TestVolumeSwap-359764099-project-admin] [instance: 8c6d8096-853b-4091-ad82-6faf8ffc85fa] calling os-brick to detach iSCSI Volume {{(pid=71731) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 16:23:04 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-f806038a-767a-4661-99e7-7942ce22ab8a tempest-TestVolumeSwap-359764099 tempest-TestVolumeSwap-359764099-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8cf0118790>, {'target_iqn': 'iqn.2010-10.org.openstack:62e7747a-651a-4d0a-a763-bfce9c4a3cff', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EHjgiLQq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi': {}}" {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 16:23:04 user nova-compute[71731]: WARNING os_brick.initiator.connectors.base [None req-f806038a-767a-4661-99e7-7942ce22ab8a tempest-TestVolumeSwap-359764099 tempest-TestVolumeSwap-359764099-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 16:23:04 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-f806038a-767a-4661-99e7-7942ce22ab8a tempest-TestVolumeSwap-359764099 tempest-TestVolumeSwap-359764099-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 16:23:04 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-f806038a-767a-4661-99e7-7942ce22ab8a tempest-TestVolumeSwap-359764099 tempest-TestVolumeSwap-359764099-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 16:23:04 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:23:04 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:23:04 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b9407c0-0e43-4f00-a2b2-f9cbb7ce15c2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:62e7747a-651a-4d0a-a763-bfce9c4a3cff\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c20e80fa-58de-431a-8901-2535657aaadf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:27919afc-8990-4ed5-af9e-9d6b3d7b231e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0e3b49ec-80af-4c38-9689-f7277e495d21\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cc639d00-ef6b-4121-bcb0-c65ec0347abd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e0f728f3-fbb5-4ed8-a78b-a5d982b03f7d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:84c7f6ad-d2c2-465a-b39e-47347aa85be0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d3a41289-1225-4bee-927e-5da050896328\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:48af37b0-6938-432e-b374-d992c4dd9ae9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:23:04 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-f806038a-767a-4661-99e7-7942ce22ab8a tempest-TestVolumeSwap-359764099 tempest-TestVolumeSwap-359764099-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 16:23:04 user nova-compute[71731]: No targets found.
Apr 13 16:23:04 user nova-compute[71731]: iSNS:
Apr 13 16:23:04 user nova-compute[71731]: No targets found.
Apr 13 16:23:04 user nova-compute[71731]: STATIC:
Apr 13 16:23:04 user nova-compute[71731]: Target: iqn.2010-10.org.openstack:62e7747a-651a-4d0a-a763-bfce9c4a3cff
Apr 13 16:23:04 user nova-compute[71731]:         Portal: 172.16.0.220:3260,-1
Apr 13 16:23:04 user nova-compute[71731]:                 Iface Name: default
Apr 13 16:23:04 user nova-compute[71731]: Target: iqn.2010-10.org.openstack:c20e80fa-58de-431a-8901-2535657aaadf
Apr 13 16:23:04 user nova-compute[71731]:         Portal: 172.16.0.220:3260,-1
Apr 13 16:23:04 user nova-compute[71731]:                 Iface Name: default
Apr 13 16:23:04 user nova-compute[71731]: Target: iqn.2010-10.org.openstack:27919afc-8990-4ed5-af9e-9d6b3d7b231e
Apr 13 16:23:04 user nova-compute[71731]:         Portal: 172.16.0.220:3260,-1
Apr 13 16:23:04 user nova-compute[71731]:                 Iface Name: default
Apr 13 16:23:04 user nova-compute[71731]: Target: iqn.2010-10.org.openstack:0e3b49ec-80af-4c38-9689-f7277e495d21
Apr 13 16:23:04 user nova-compute[71731]:         Portal: 172.16.0.220:3260,-1
Apr 13 16:23:04 user nova-compute[71731]:                 Iface Name: default
Apr 13 16:23:04 user nova-compute[71731]: Target: iqn.2010-10.org.openstack:cc639d00-ef6b-4121-bcb0-c65ec0347abd
Apr 13 16:23:04 user nova-compute[71731]:         Portal: 172.16.0.220:3260,-1
Apr 13 16:23:04 user nova-compute[71731]:                 Iface Name: default
Apr 13 16:23:04 user nova-compute[71731]: Target: iqn.2010-10.org.openstack:e0f728f3-fbb5-4ed8-a78b-a5d982b03f7d
Apr 13 16:23:04 user nova-compute[71731]:         Portal: 172.16.0.220:3260,-1
Apr 13 16:23:04 user nova-compute[71731]:                 Iface Name: default
Apr 13 16:23:04 user nova-compute[71731]: Target: iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984
Apr 13 16:23:04 user nova-compute[71731]:         Portal: 172.16.0.220:3260,-1
Apr 13 16:23:04 user nova-compute[71731]:                 Iface Name: default
Apr 13 16:23:04 user nova-compute[71731]: Target: iqn.2010-10.org.openstack:84c7f6ad-d2c2-465a-b39e-47347aa85be0
Apr 13 16:23:04 user nova-compute[71731]:         Portal: 172.16.0.220:3260,-1
Apr 13 16:23:04 user nova-compute[71731]:                 Iface Name: default
Apr 13 16:23:04 user nova-compute[71731]: Target: iqn.2010-10.org.openstack:d3a41289-1225-4bee-927e-5da050896328
Apr 13 16:23:04 user nova-compute[71731]:         Portal: 172.16.0.220:3260,-1
Apr 13 16:23:04 user nova-compute[71731]:                 Iface Name: default
Apr 13 16:23:04 user nova-compute[71731]: Target: iqn.2010-10.org.openstack:48af37b0-6938-432e-b374-d992c4dd9ae9
Apr 13 16:23:04 user nova-compute[71731]:         Portal: 172.16.0.220:3260,-1
Apr 13 16:23:04 user nova-compute[71731]:                 Iface Name: default
Apr 13 16:23:04 user nova-compute[71731]: FIRMWARE:
Apr 13 16:23:04 user nova-compute[71731]: No targets found.
Apr 13 16:23:04 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 16:23:04 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-f806038a-767a-4661-99e7-7942ce22ab8a tempest-TestVolumeSwap-359764099 tempest-TestVolumeSwap-359764099-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 16:23:04 user nova-compute[71731]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 16:23:04 user nova-compute[71731]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71731) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 16:23:04 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-f806038a-767a-4661-99e7-7942ce22ab8a tempest-TestVolumeSwap-359764099 tempest-TestVolumeSwap-359764099-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:62e7747a-651a-4d0a-a763-bfce9c4a3cff', 0)] {{(pid=71731) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 16:23:04 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:23:04 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:23:04 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[95910901-a936-4ac2-a4ac-b716ffc1f257]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0e3b49ec-80af-4c38-9689-f7277e495d21\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:27919afc-8990-4ed5-af9e-9d6b3d7b231e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:48af37b0-6938-432e-b374-d992c4dd9ae9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:62e7747a-651a-4d0a-a763-bfce9c4a3cff\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:84c7f6ad-d2c2-465a-b39e-47347aa85be0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c20e80fa-58de-431a-8901-2535657aaadf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cc639d00-ef6b-4121-bcb0-c65ec0347abd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d3a41289-1225-4bee-927e-5da050896328\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e0f728f3-fbb5-4ed8-a78b-a5d982b03f7d\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:23:04 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:23:04 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:23:04 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[83ae8262-244e-4e75-b14e-05be7498d08f]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e3b49ec-80af-4c38-9689-f7277e495d21 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62e7747a-651a-4d0a-a763-bfce9c4a3cff (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3a41289-1225-4bee-927e-5da050896328 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c7f6ad-d2c2-465a-b39e-47347aa85be0 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48af37b0-6938-432e-b374-d992c4dd9ae9 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c20e80fa-58de-431a-8901-2535657aaadf (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27919afc-8990-4ed5-af9e-9d6b3d7b231e (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc639d00-ef6b-4121-bcb0-c65ec0347abd (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0f728f3-fbb5-4ed8-a78b-a5d982b03f7d (non-flash)\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:23:04 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-f806038a-767a-4661-99e7-7942ce22ab8a tempest-TestVolumeSwap-359764099 tempest-TestVolumeSwap-359764099-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e3b49ec-80af-4c38-9689-f7277e495d21 (non-flash)
Apr 13 16:23:04 user nova-compute[71731]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62e7747a-651a-4d0a-a763-bfce9c4a3cff (non-flash)
Apr 13 16:23:04 user nova-compute[71731]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3a41289-1225-4bee-927e-5da050896328 (non-flash)
Apr 13 16:23:04 user nova-compute[71731]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984 (non-flash)
Apr 13 16:23:04 user nova-compute[71731]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c7f6ad-d2c2-465a-b39e-47347aa85be0 (non-flash)
Apr 13 16:23:04 user nova-compute[71731]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48af37b0-6938-432e-b374-d992c4dd9ae9 (non-flash)
Apr 13 16:23:04 user nova-compute[71731]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c20e80fa-58de-431a-8901-2535657aaadf (non-flash)
Apr 13 16:23:04 user nova-compute[71731]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27919afc-8990-4ed5-af9e-9d6b3d7b231e (non-flash)
Apr 13 16:23:04 user nova-compute[71731]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc639d00-ef6b-4121-bcb0-c65ec0347abd (non-flash)
Apr 13 16:23:04 user nova-compute[71731]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0f728f3-fbb5-4ed8-a78b-a5d982b03f7d (non-flash)
Apr 13 16:23:04 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 16:23:04 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-f806038a-767a-4661-99e7-7942ce22ab8a tempest-TestVolumeSwap-359764099 tempest-TestVolumeSwap-359764099-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e3b49ec-80af-4c38-9689-f7277e495d21 (non-flash)
Apr 13 16:23:04 user nova-compute[71731]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62e7747a-651a-4d0a-a763-bfce9c4a3cff (non-flash)
Apr 13 16:23:04 user nova-compute[71731]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3a41289-1225-4bee-927e-5da050896328 (non-flash)
Apr 13 16:23:04 user nova-compute[71731]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984 (non-flash)
Apr 13 16:23:04 user nova-compute[71731]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c7f6ad-d2c2-465a-b39e-47347aa85be0 (non-flash)
Apr 13 16:23:04 user nova-compute[71731]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48af37b0-6938-432e-b374-d992c4dd9ae9 (non-flash)
Apr 13 16:23:04 user nova-compute[71731]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c20e80fa-58de-431a-8901-2535657aaadf (non-flash)
Apr 13 16:23:04 user nova-compute[71731]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27919afc-8990-4ed5-af9e-9d6b3d7b231e (non-flash)
Apr 13 16:23:04 user nova-compute[71731]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc639d00-ef6b-4121-bcb0-c65ec0347abd (non-flash)
Apr 13 16:23:04 user nova-compute[71731]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0f728f3-fbb5-4ed8-a78b-a5d982b03f7d (non-flash)
Apr 13 16:23:04 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 16:23:04 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-f806038a-767a-4661-99e7-7942ce22ab8a tempest-TestVolumeSwap-359764099 tempest-TestVolumeSwap-359764099-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8cff383640>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:62e7747a-651a-4d0a-a763-bfce9c4a3cff'): ({'sdi'}, set())}) {{(pid=71731) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 16:23:04 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-f806038a-767a-4661-99e7-7942ce22ab8a tempest-TestVolumeSwap-359764099 tempest-TestVolumeSwap-359764099-project-admin] Removing single pathed devices sdi {{(pid=71731) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 16:23:04 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:23:04 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:23:04 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3fc30e0-8d6a-4ce3-90da-3d00c3ac1781]: (4, ('path checker states:\nup                  10\n\npaths: 0\nbusy: False\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:23:04 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:23:04 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.018s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:23:04 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[29a6c554-cf0b-430f-8eb3-2ab22a12c879]: (4, ('ok\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:23:04 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-f806038a-767a-4661-99e7-7942ce22ab8a tempest-TestVolumeSwap-359764099 tempest-TestVolumeSwap-359764099-project-admin] Flushing IO for device /dev/sdi {{(pid=71731) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 16:23:04 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:23:04 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.014s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:23:04 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[906e65d9-8d3f-40a1-ad28-a695ba058bbf]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:23:04 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-f806038a-767a-4661-99e7-7942ce22ab8a tempest-TestVolumeSwap-359764099 tempest-TestVolumeSwap-359764099-project-admin] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=71731) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 16:23:04 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:23:04 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.032s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:23:04 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[101d76a7-8f42-4400-9a1d-a0e7068bb019]: (4, ('1', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:23:04 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-f806038a-767a-4661-99e7-7942ce22ab8a tempest-TestVolumeSwap-359764099 tempest-TestVolumeSwap-359764099-project-admin] Checking to see if SCSI volumes sdi have been removed. {{(pid=71731) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 16:23:04 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-f806038a-767a-4661-99e7-7942ce22ab8a tempest-TestVolumeSwap-359764099 tempest-TestVolumeSwap-359764099-project-admin] SCSI volumes sdi have been removed. {{(pid=71731) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 16:23:04 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-f806038a-767a-4661-99e7-7942ce22ab8a tempest-TestVolumeSwap-359764099 tempest-TestVolumeSwap-359764099-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:62e7747a-651a-4d0a-a763-bfce9c4a3cff')] {{(pid=71731) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 16:23:04 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62e7747a-651a-4d0a-a763-bfce9c4a3cff -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:23:04 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62e7747a-651a-4d0a-a763-bfce9c4a3cff -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:23:04 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e804287-7751-4025-ab08-a7db789fea0f]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:23:04 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-f806038a-767a-4661-99e7-7942ce22ab8a tempest-TestVolumeSwap-359764099 tempest-TestVolumeSwap-359764099-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:23:04 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62e7747a-651a-4d0a-a763-bfce9c4a3cff -p 172.16.0.220:3260 --logout {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:23:04 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62e7747a-651a-4d0a-a763-bfce9c4a3cff -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:23:04 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c03b76b-49d1-4e14-9fe1-38c43a2fc598]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:62e7747a-651a-4d0a-a763-bfce9c4a3cff, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:62e7747a-651a-4d0a-a763-bfce9c4a3cff, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:23:04 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-f806038a-767a-4661-99e7-7942ce22ab8a tempest-TestVolumeSwap-359764099 tempest-TestVolumeSwap-359764099-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:62e7747a-651a-4d0a-a763-bfce9c4a3cff, portal: 172.16.0.220,3260]
Apr 13 16:23:04 user nova-compute[71731]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:62e7747a-651a-4d0a-a763-bfce9c4a3cff, portal: 172.16.0.220,3260] successful.
Apr 13 16:23:04 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:23:04 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62e7747a-651a-4d0a-a763-bfce9c4a3cff -p 172.16.0.220:3260 --op delete {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:23:04 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62e7747a-651a-4d0a-a763-bfce9c4a3cff -p 172.16.0.220:3260 --op delete" returned: 0 in 0.037s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:23:04 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[011285c3-8203-4cff-8d4f-67994ae61c06]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:23:04 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-f806038a-767a-4661-99e7-7942ce22ab8a tempest-TestVolumeSwap-359764099 tempest-TestVolumeSwap-359764099-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:23:04 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-f806038a-767a-4661-99e7-7942ce22ab8a tempest-TestVolumeSwap-359764099 tempest-TestVolumeSwap-359764099-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.337s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 16:23:04 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-f806038a-767a-4661-99e7-7942ce22ab8a tempest-TestVolumeSwap-359764099 tempest-TestVolumeSwap-359764099-project-admin] <== disconnect_volume: return (338ms) None {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 16:23:04 user nova-compute[71731]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f806038a-767a-4661-99e7-7942ce22ab8a tempest-TestVolumeSwap-359764099 tempest-TestVolumeSwap-359764099-project-admin] [instance: 8c6d8096-853b-4091-ad82-6faf8ffc85fa] Disconnected iSCSI Volume {{(pid=71731) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 16:23:04 user nova-compute[71731]: DEBUG nova.compute.manager [None req-f806038a-767a-4661-99e7-7942ce22ab8a tempest-TestVolumeSwap-359764099 tempest-TestVolumeSwap-359764099-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d3a41289-1225-4bee-927e-5da050896328', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EtZcSkFG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdk'}, 'status': 'reserved', 'instance': '8c6d8096-853b-4091-ad82-6faf8ffc85fa', 'attached_at': '', 'detached_at': '', 'volume_id': 'd3a41289-1225-4bee-927e-5da050896328', 'serial'} {{(pid=71731) _swap_volume /opt/stack/nova/nova/compute/manager.py:7665}}
Apr 13 16:23:04 user nova-compute[71731]: DEBUG nova.compute.manager [None req-f806038a-767a-4661-99e7-7942ce22ab8a tempest-TestVolumeSwap-359764099 tempest-TestVolumeSwap-359764099-project-admin] [instance: 8c6d8096-853b-4091-ad82-6faf8ffc85fa] swap_volume: removing Cinder connection for volume 62e7747a-651a-4d0a-a763-bfce9c4a3cff {{(pid=71731) _swap_volume /opt/stack/nova/nova/compute/manager.py:7710}}
Apr 13 16:23:05 user nova-compute[71731]: DEBUG nova.compute.manager [None req-f806038a-767a-4661-99e7-7942ce22ab8a tempest-TestVolumeSwap-359764099 tempest-TestVolumeSwap-359764099-project-admin] [instance: 8c6d8096-853b-4091-ad82-6faf8ffc85fa] swap_volume: Updating volume 62e7747a-651a-4d0a-a763-bfce9c4a3cff BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:d3a41289-1225-4bee-927e-5da050896328", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "EtZcSkFG", "auth_password": "QIulCVPMW8FGhs", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdk", "volume_id": "d3a41289-1225-4bee-927e-5da050896328"}, "status": "reserved", "instance": "8c6d8096-853b-4091-ad82-6faf8ffc85fa", "attached_at": "", "detached_at": "", "volume_id": "d3a41289-1225-4bee-927e-5da050896328", "serial": "d3a41289-1225-4bee-927e-5da050896328"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': 'd3a41289-1225-4bee-927e-5da050896328', 'no_device': None, 'attachment_id': 'acc70577-8bc5-457e-bf28-3e656a44dd57'} {{(pid=71731) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7858}}
Apr 13 16:23:05 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-f806038a-767a-4661-99e7-7942ce22ab8a tempest-TestVolumeSwap-359764099 tempest-TestVolumeSwap-359764099-project-admin] Lock "8c6d8096-853b-4091-ad82-6faf8ffc85fa" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 12.164s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:23:06 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager.update_available_resource {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:23:06 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:23:06 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:23:06 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:23:06 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:23:06 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Auditing locally available compute resources for user (node: user) {{(pid=71731) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 16:23:06 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=71731) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 16:23:06 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=71731) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 16:23:06 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] skipping disk /dev/sdh (vdc) as it is a volume {{(pid=71731) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 16:23:06 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e731607-fce1-4f19-9e4b-5b892e760179/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:23:06 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e731607-fce1-4f19-9e4b-5b892e760179/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:23:06 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e731607-fce1-4f19-9e4b-5b892e760179/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:23:06 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e731607-fce1-4f19-9e4b-5b892e760179/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:23:06 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71731) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 16:23:06 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7973e93b-6311-44ed-91ff-e861c32d0277/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:23:06 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7973e93b-6311-44ed-91ff-e861c32d0277/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:23:06 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7973e93b-6311-44ed-91ff-e861c32d0277/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:23:06 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7973e93b-6311-44ed-91ff-e861c32d0277/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:23:06 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] skipping disk /dev/sdj (vda) as it is a volume {{(pid=71731) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 16:23:06 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66553f5-5e1b-4f1d-8c5a-63bc340f7586/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:23:07 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66553f5-5e1b-4f1d-8c5a-63bc340f7586/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:23:07 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66553f5-5e1b-4f1d-8c5a-63bc340f7586/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:23:07 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-6d9cc235-0c45-4909-a9f0-7f972b8cc030 tempest-TestVolumeSwap-359764099 tempest-TestVolumeSwap-359764099-project-admin] Acquiring lock "8c6d8096-853b-4091-ad82-6faf8ffc85fa" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:23:07 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-6d9cc235-0c45-4909-a9f0-7f972b8cc030 tempest-TestVolumeSwap-359764099 tempest-TestVolumeSwap-359764099-project-admin] Lock "8c6d8096-853b-4091-ad82-6faf8ffc85fa" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:23:07 user nova-compute[71731]: DEBUG os_brick.utils [None req-6d9cc235-0c45-4909-a9f0-7f972b8cc030 tempest-TestVolumeSwap-359764099 tempest-TestVolumeSwap-359764099-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 16:23:07 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:23:07 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66553f5-5e1b-4f1d-8c5a-63bc340f7586/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:23:07 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:23:07 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba1ff082-e9b5-4f95-8e6f-2bb6ec73b0d0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:81501d91421\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:23:07 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:23:07 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbcccf4b-e861-4254-9be3-a491776214e9/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:23:07 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:23:07 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[e404c91e-7dc1-47d2-9990-ea9e5e61dc78]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:23:07 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:23:07 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:23:07 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[29f49cc2-7fa7-4f9d-bcf0-81e9f384cc23]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:23:07 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b6df1a7-35b4-484b-bd01-ded182f69ed7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:23:07 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-6d9cc235-0c45-4909-a9f0-7f972b8cc030 tempest-TestVolumeSwap-359764099 tempest-TestVolumeSwap-359764099-project-admin] Running cmd (subprocess): nvme version {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:23:07 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-6d9cc235-0c45-4909-a9f0-7f972b8cc030 tempest-TestVolumeSwap-359764099 tempest-TestVolumeSwap-359764099-project-admin] 'nvme version' failed. Not Retrying. {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 16:23:07 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6d9cc235-0c45-4909-a9f0-7f972b8cc030 tempest-TestVolumeSwap-359764099 tempest-TestVolumeSwap-359764099-project-admin] nvme not present on system {{(pid=71731) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 16:23:07 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:23:07 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 16:23:07 user nova-compute[71731]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 16:23:07 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2459149-3d31-4873-853e-a164ea7818fc]: (4, '') {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:23:07 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.lightos [None req-6d9cc235-0c45-4909-a9f0-7f972b8cc030 tempest-TestVolumeSwap-359764099 tempest-TestVolumeSwap-359764099-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71731) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 16:23:07 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.lightos [None req-6d9cc235-0c45-4909-a9f0-7f972b8cc030 tempest-TestVolumeSwap-359764099 tempest-TestVolumeSwap-359764099-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71731) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 16:23:07 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.lightos [None req-6d9cc235-0c45-4909-a9f0-7f972b8cc030 tempest-TestVolumeSwap-359764099 tempest-TestVolumeSwap-359764099-project-admin] LIGHTOS: no hostnqn found. {{(pid=71731) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 16:23:07 user nova-compute[71731]: DEBUG os_brick.utils [None req-6d9cc235-0c45-4909-a9f0-7f972b8cc030 tempest-TestVolumeSwap-359764099 tempest-TestVolumeSwap-359764099-project-admin] <== get_connector_properties: return (143ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:81501d91421', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 16:23:07 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbcccf4b-e861-4254-9be3-a491776214e9/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:23:07 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbcccf4b-e861-4254-9be3-a491776214e9/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:23:07 user nova-compute[71731]: INFO nova.compute.manager [None req-6d9cc235-0c45-4909-a9f0-7f972b8cc030 tempest-TestVolumeSwap-359764099 tempest-TestVolumeSwap-359764099-project-admin] [instance: 8c6d8096-853b-4091-ad82-6faf8ffc85fa] Swapping volume d3a41289-1225-4bee-927e-5da050896328 for 62e7747a-651a-4d0a-a763-bfce9c4a3cff
Apr 13 16:23:07 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbcccf4b-e861-4254-9be3-a491776214e9/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:23:07 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/031c7939-a53c-4f7d-9f36-4ec1d06e2717/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:23:07 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/031c7939-a53c-4f7d-9f36-4ec1d06e2717/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:23:07 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/031c7939-a53c-4f7d-9f36-4ec1d06e2717/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:23:07 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/031c7939-a53c-4f7d-9f36-4ec1d06e2717/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:23:07 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71731) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 16:23:07 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=71731) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 16:23:07 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=71731) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 16:23:07 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5db1cb51-2e5a-46c9-8914-cba759a96a65/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:23:07 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5db1cb51-2e5a-46c9-8914-cba759a96a65/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:23:07 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5db1cb51-2e5a-46c9-8914-cba759a96a65/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:23:08 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5db1cb51-2e5a-46c9-8914-cba759a96a65/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:23:08 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c6d8096-853b-4091-ad82-6faf8ffc85fa/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:23:08 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c6d8096-853b-4091-ad82-6faf8ffc85fa/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:23:08 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c6d8096-853b-4091-ad82-6faf8ffc85fa/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:23:08 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c6d8096-853b-4091-ad82-6faf8ffc85fa/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:23:08 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] skipping disk /dev/sdk (vdb) as it is a volume {{(pid=71731) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 16:23:08 user nova-compute[71731]: WARNING nova.virt.libvirt.driver [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 16:23:08 user nova-compute[71731]: WARNING nova.virt.libvirt.driver [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 16:23:08 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Hypervisor/Node resource view: name=user free_ram=7359MB free_disk=26.386905670166016GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71731) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 16:23:08 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:23:08 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:23:08 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:23:09 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance 7973e93b-6311-44ed-91ff-e861c32d0277 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 16:23:09 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance f66553f5-5e1b-4f1d-8c5a-63bc340f7586 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 16:23:09 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance bbcccf4b-e861-4254-9be3-a491776214e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 16:23:09 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance 5db1cb51-2e5a-46c9-8914-cba759a96a65 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 16:23:09 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance 8c6d8096-853b-4091-ad82-6faf8ffc85fa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 16:23:09 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance e4ada2d7-7ace-4ed4-86a6-ed121c95e80f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 16:23:09 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance 2549ba85-4e0a-420e-b711-07cafa8c60e9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 16:23:09 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance 031c7939-a53c-4f7d-9f36-4ec1d06e2717 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 16:23:09 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance bf350da4-9cc2-4900-adf0-506e44984b42 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 16:23:09 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance 0e731607-fce1-4f19-9e4b-5b892e760179 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 16:23:09 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance db65920b-7872-44c1-a68a-a696681d9d95 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 16:23:09 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=71731) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 16:23:09 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Final resource view: name=user phys_ram=16023MB used_ram=1920MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=71731) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 16:23:09 user nova-compute[71731]: DEBUG nova.compute.provider_tree [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Inventory has not changed in ProviderTree for provider: cb6b1a64-0c24-4e2d-af1e-16576ca9165c {{(pid=71731) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 16:23:09 user nova-compute[71731]: DEBUG nova.scheduler.client.report [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Inventory has not changed for provider cb6b1a64-0c24-4e2d-af1e-16576ca9165c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71731) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 16:23:09 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Compute_service record updated for user:user {{(pid=71731) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 16:23:09 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.518s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:23:10 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:23:10 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:23:10 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Starting heal instance info cache {{(pid=71731) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 16:23:10 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Acquiring lock "refresh_cache-bbcccf4b-e861-4254-9be3-a491776214e9" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 16:23:10 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Acquired lock "refresh_cache-bbcccf4b-e861-4254-9be3-a491776214e9" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 16:23:10 user nova-compute[71731]: DEBUG nova.network.neutron [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] [instance: bbcccf4b-e861-4254-9be3-a491776214e9] Forcefully refreshing network info cache for instance {{(pid=71731) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 16:23:11 user nova-compute[71731]: DEBUG nova.network.neutron [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] [instance: bbcccf4b-e861-4254-9be3-a491776214e9] Updating instance_info_cache with network_info: [{"id": "dbb2bf27-5de3-499c-ba4d-87867912a143", "address": "fa:16:3e:a3:40:f4", "network": {"id": "5a4fe0b3-5f2f-4125-a17d-e2ff424bf01a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1835633180-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.81", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7061f2f041954ffe90b0c87b422890e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbb2bf27-5d", "ovs_interfaceid": "dbb2bf27-5de3-499c-ba4d-87867912a143", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:23:11 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Releasing lock "refresh_cache-bbcccf4b-e861-4254-9be3-a491776214e9" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 16:23:11 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] [instance: bbcccf4b-e861-4254-9be3-a491776214e9] Updated the network info_cache for instance {{(pid=71731) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 16:23:11 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:23:11 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:23:11 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:23:11 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:23:11 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:23:11 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:23:11 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71731) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 16:23:11 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:23:11 user nova-compute[71731]: DEBUG nova.compute.manager [None req-6d9cc235-0c45-4909-a9f0-7f972b8cc030 tempest-TestVolumeSwap-359764099 tempest-TestVolumeSwap-359764099-project-admin] [instance: 8c6d8096-853b-4091-ad82-6faf8ffc85fa] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:62e7747a-651a-4d0a-a763-bfce9c4a3cff', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EHjgiLQq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '8c6d8096-853b-4091-ad82-6faf8ffc85fa', 'attached_at': '', 'detached_at': '', 'volume_id': '62e7747a-651a-4d0a-a763-bfce9c4a3cff', 'serial': '62e7747a-651a-4d0a-a763-bfce9c4a3cff'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d3a41289-1225-4bee-927e-5da050896328', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EtZcSkFG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdk', 'volume_id': 'd3a41289-1225-4bee-927e-5da050896328'}, 'status': 'reserved', 'instance': '8c6d8096-853b-4091-ad82-6faf8ffc85fa', 'attached_at': '', 'detached_at': '', 'volume_id': 'd3a41289-1225-4bee-927e-5da050896328', 'serial'} {{(pid=71731) _swap_volume /opt/stack/nova/nova/compute/manager.py:7656}}
Apr 13 16:23:11 user nova-compute[71731]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6d9cc235-0c45-4909-a9f0-7f972b8cc030 tempest-TestVolumeSwap-359764099 tempest-TestVolumeSwap-359764099-project-admin] [instance: 8c6d8096-853b-4091-ad82-6faf8ffc85fa] Calling os-brick to attach iSCSI Volume {{(pid=71731) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 16:23:11 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d9cc235-0c45-4909-a9f0-7f972b8cc030 tempest-TestVolumeSwap-359764099 tempest-TestVolumeSwap-359764099-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8cf0118790>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:62e7747a-651a-4d0a-a763-bfce9c4a3cff', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EHjgiLQq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 16:23:11 user nova-compute[71731]: WARNING os_brick.initiator.connectors.base [None req-6d9cc235-0c45-4909-a9f0-7f972b8cc030 tempest-TestVolumeSwap-359764099 tempest-TestVolumeSwap-359764099-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 16:23:11 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-6d9cc235-0c45-4909-a9f0-7f972b8cc030 tempest-TestVolumeSwap-359764099 tempest-TestVolumeSwap-359764099-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 16:23:11 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-6d9cc235-0c45-4909-a9f0-7f972b8cc030 tempest-TestVolumeSwap-359764099 tempest-TestVolumeSwap-359764099-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 16:23:11 user nova-compute[71731]: WARNING os_brick.initiator.connectors.base [None req-6d9cc235-0c45-4909-a9f0-7f972b8cc030 tempest-TestVolumeSwap-359764099 tempest-TestVolumeSwap-359764099-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 16:23:11 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-6d9cc235-0c45-4909-a9f0-7f972b8cc030 tempest-TestVolumeSwap-359764099 tempest-TestVolumeSwap-359764099-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:62e7747a-651a-4d0a-a763-bfce9c4a3cff" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 16:23:11 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-6d9cc235-0c45-4909-a9f0-7f972b8cc030 tempest-TestVolumeSwap-359764099 tempest-TestVolumeSwap-359764099-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:62e7747a-651a-4d0a-a763-bfce9c4a3cff" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 16:23:11 user nova-compute[71731]: INFO os_brick.initiator.connectors.iscsi [None req-6d9cc235-0c45-4909-a9f0-7f972b8cc030 tempest-TestVolumeSwap-359764099 tempest-TestVolumeSwap-359764099-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 16:23:11 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62e7747a-651a-4d0a-a763-bfce9c4a3cff -p 172.16.0.220:3260 {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:23:11 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62e7747a-651a-4d0a-a763-bfce9c4a3cff -p 172.16.0.220:3260" returned: 21 in 0.028s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:23:11 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e1d4c67-6412-4963-97f9-756915f79273]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:23:11 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d9cc235-0c45-4909-a9f0-7f972b8cc030 tempest-TestVolumeSwap-359764099 tempest-TestVolumeSwap-359764099-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 16:23:11 user nova-compute[71731]:  {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:23:11 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62e7747a-651a-4d0a-a763-bfce9c4a3cff -p 172.16.0.220:3260 --interface default --op new {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:23:11 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62e7747a-651a-4d0a-a763-bfce9c4a3cff -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:23:11 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[498aa60a-25a8-4abb-9871-6c7336574528]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:62e7747a-651a-4d0a-a763-bfce9c4a3cff] added\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:23:11 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d9cc235-0c45-4909-a9f0-7f972b8cc030 tempest-TestVolumeSwap-359764099 tempest-TestVolumeSwap-359764099-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:62e7747a-651a-4d0a-a763-bfce9c4a3cff] added
Apr 13 16:23:11 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:23:11 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62e7747a-651a-4d0a-a763-bfce9c4a3cff -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:23:11 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62e7747a-651a-4d0a-a763-bfce9c4a3cff -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:23:11 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeaeb0b2-1392-4fdc-83f1-691175af61a7]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:23:11 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d9cc235-0c45-4909-a9f0-7f972b8cc030 tempest-TestVolumeSwap-359764099 tempest-TestVolumeSwap-359764099-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:23:11 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62e7747a-651a-4d0a-a763-bfce9c4a3cff -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:23:11 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62e7747a-651a-4d0a-a763-bfce9c4a3cff -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:23:11 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[76985b00-37e3-4cb0-b733-e994f0f85574]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:23:11 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d9cc235-0c45-4909-a9f0-7f972b8cc030 tempest-TestVolumeSwap-359764099 tempest-TestVolumeSwap-359764099-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:23:11 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62e7747a-651a-4d0a-a763-bfce9c4a3cff -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EHjgiLQq {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:23:11 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62e7747a-651a-4d0a-a763-bfce9c4a3cff -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EHjgiLQq" returned: 0 in 0.019s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:23:11 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[d25ecab3-23b8-495d-a448-61330367c61c]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:23:11 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d9cc235-0c45-4909-a9f0-7f972b8cc030 tempest-TestVolumeSwap-359764099 tempest-TestVolumeSwap-359764099-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EHjgiLQq'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:23:11 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62e7747a-651a-4d0a-a763-bfce9c4a3cff -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:23:11 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62e7747a-651a-4d0a-a763-bfce9c4a3cff -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:23:11 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee1451b2-720a-4b10-89bd-f9f45da18a9c]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:23:11 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d9cc235-0c45-4909-a9f0-7f972b8cc030 tempest-TestVolumeSwap-359764099 tempest-TestVolumeSwap-359764099-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:23:11 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:23:12 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:23:12 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5ac050e-cee8-460b-9ecb-3f3249582ec3]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e3b49ec-80af-4c38-9689-f7277e495d21 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3a41289-1225-4bee-927e-5da050896328 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c7f6ad-d2c2-465a-b39e-47347aa85be0 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48af37b0-6938-432e-b374-d992c4dd9ae9 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c20e80fa-58de-431a-8901-2535657aaadf (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27919afc-8990-4ed5-af9e-9d6b3d7b231e (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc639d00-ef6b-4121-bcb0-c65ec0347abd (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0f728f3-fbb5-4ed8-a78b-a5d982b03f7d (non-flash)\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:23:12 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d9cc235-0c45-4909-a9f0-7f972b8cc030 tempest-TestVolumeSwap-359764099 tempest-TestVolumeSwap-359764099-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e3b49ec-80af-4c38-9689-f7277e495d21 (non-flash)
Apr 13 16:23:12 user nova-compute[71731]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3a41289-1225-4bee-927e-5da050896328 (non-flash)
Apr 13 16:23:12 user nova-compute[71731]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984 (non-flash)
Apr 13 16:23:12 user nova-compute[71731]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c7f6ad-d2c2-465a-b39e-47347aa85be0 (non-flash)
Apr 13 16:23:12 user nova-compute[71731]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48af37b0-6938-432e-b374-d992c4dd9ae9 (non-flash)
Apr 13 16:23:12 user nova-compute[71731]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c20e80fa-58de-431a-8901-2535657aaadf (non-flash)
Apr 13 16:23:12 user nova-compute[71731]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27919afc-8990-4ed5-af9e-9d6b3d7b231e (non-flash)
Apr 13 16:23:12 user nova-compute[71731]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc639d00-ef6b-4121-bcb0-c65ec0347abd (non-flash)
Apr 13 16:23:12 user nova-compute[71731]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0f728f3-fbb5-4ed8-a78b-a5d982b03f7d (non-flash)
Apr 13 16:23:12 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 16:23:12 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d9cc235-0c45-4909-a9f0-7f972b8cc030 tempest-TestVolumeSwap-359764099 tempest-TestVolumeSwap-359764099-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e3b49ec-80af-4c38-9689-f7277e495d21 (non-flash)
Apr 13 16:23:12 user nova-compute[71731]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3a41289-1225-4bee-927e-5da050896328 (non-flash)
Apr 13 16:23:12 user nova-compute[71731]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984 (non-flash)
Apr 13 16:23:12 user nova-compute[71731]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c7f6ad-d2c2-465a-b39e-47347aa85be0 (non-flash)
Apr 13 16:23:12 user nova-compute[71731]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48af37b0-6938-432e-b374-d992c4dd9ae9 (non-flash)
Apr 13 16:23:12 user nova-compute[71731]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c20e80fa-58de-431a-8901-2535657aaadf (non-flash)
Apr 13 16:23:12 user nova-compute[71731]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27919afc-8990-4ed5-af9e-9d6b3d7b231e (non-flash)
Apr 13 16:23:12 user nova-compute[71731]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc639d00-ef6b-4121-bcb0-c65ec0347abd (non-flash)
Apr 13 16:23:12 user nova-compute[71731]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0f728f3-fbb5-4ed8-a78b-a5d982b03f7d (non-flash)
Apr 13 16:23:12 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 16:23:12 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62e7747a-651a-4d0a-a763-bfce9c4a3cff -p 172.16.0.220:3260 --login {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:23:12 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62e7747a-651a-4d0a-a763-bfce9c4a3cff -p 172.16.0.220:3260 --login" returned: 0 in 0.089s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:23:12 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae6146bb-781c-4c3f-a0be-047c59448f22]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:62e7747a-651a-4d0a-a763-bfce9c4a3cff, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:62e7747a-651a-4d0a-a763-bfce9c4a3cff, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:23:12 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d9cc235-0c45-4909-a9f0-7f972b8cc030 tempest-TestVolumeSwap-359764099 tempest-TestVolumeSwap-359764099-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:62e7747a-651a-4d0a-a763-bfce9c4a3cff, portal: 172.16.0.220,3260]
Apr 13 16:23:12 user nova-compute[71731]: Login to [iface: default, target: iqn.2010-10.org.openstack:62e7747a-651a-4d0a-a763-bfce9c4a3cff, portal: 172.16.0.220,3260] successful.
Apr 13 16:23:12 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:23:12 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62e7747a-651a-4d0a-a763-bfce9c4a3cff -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:23:12 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62e7747a-651a-4d0a-a763-bfce9c4a3cff -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:23:12 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7e4db40-b455-4ea8-892e-e3bd0d82f488]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:23:12 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d9cc235-0c45-4909-a9f0-7f972b8cc030 tempest-TestVolumeSwap-359764099 tempest-TestVolumeSwap-359764099-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:23:12 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:23:12 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:23:12 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[64b33321-d685-4bb5-969b-f934cd81488f]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e3b49ec-80af-4c38-9689-f7277e495d21 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3a41289-1225-4bee-927e-5da050896328 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62e7747a-651a-4d0a-a763-bfce9c4a3cff (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c7f6ad-d2c2-465a-b39e-47347aa85be0 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48af37b0-6938-432e-b374-d992c4dd9ae9 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c20e80fa-58de-431a-8901-2535657aaadf (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27919afc-8990-4ed5-af9e-9d6b3d7b231e (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc639d00-ef6b-4121-bcb0-c65ec0347abd (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0f728f3-fbb5-4ed8-a78b-a5d982b03f7d (non-flash)\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:23:12 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d9cc235-0c45-4909-a9f0-7f972b8cc030 tempest-TestVolumeSwap-359764099 tempest-TestVolumeSwap-359764099-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e3b49ec-80af-4c38-9689-f7277e495d21 (non-flash)
Apr 13 16:23:12 user nova-compute[71731]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3a41289-1225-4bee-927e-5da050896328 (non-flash)
Apr 13 16:23:12 user nova-compute[71731]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62e7747a-651a-4d0a-a763-bfce9c4a3cff (non-flash)
Apr 13 16:23:12 user nova-compute[71731]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984 (non-flash)
Apr 13 16:23:12 user nova-compute[71731]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c7f6ad-d2c2-465a-b39e-47347aa85be0 (non-flash)
Apr 13 16:23:12 user nova-compute[71731]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48af37b0-6938-432e-b374-d992c4dd9ae9 (non-flash)
Apr 13 16:23:12 user nova-compute[71731]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c20e80fa-58de-431a-8901-2535657aaadf (non-flash)
Apr 13 16:23:12 user nova-compute[71731]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27919afc-8990-4ed5-af9e-9d6b3d7b231e (non-flash)
Apr 13 16:23:12 user nova-compute[71731]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc639d00-ef6b-4121-bcb0-c65ec0347abd (non-flash)
Apr 13 16:23:12 user nova-compute[71731]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0f728f3-fbb5-4ed8-a78b-a5d982b03f7d (non-flash)
Apr 13 16:23:12 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 16:23:12 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d9cc235-0c45-4909-a9f0-7f972b8cc030 tempest-TestVolumeSwap-359764099 tempest-TestVolumeSwap-359764099-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e3b49ec-80af-4c38-9689-f7277e495d21 (non-flash)
Apr 13 16:23:12 user nova-compute[71731]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3a41289-1225-4bee-927e-5da050896328 (non-flash)
Apr 13 16:23:12 user nova-compute[71731]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62e7747a-651a-4d0a-a763-bfce9c4a3cff (non-flash)
Apr 13 16:23:12 user nova-compute[71731]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984 (non-flash)
Apr 13 16:23:12 user nova-compute[71731]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c7f6ad-d2c2-465a-b39e-47347aa85be0 (non-flash)
Apr 13 16:23:12 user nova-compute[71731]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48af37b0-6938-432e-b374-d992c4dd9ae9 (non-flash)
Apr 13 16:23:12 user nova-compute[71731]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c20e80fa-58de-431a-8901-2535657aaadf (non-flash)
Apr 13 16:23:12 user nova-compute[71731]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27919afc-8990-4ed5-af9e-9d6b3d7b231e (non-flash)
Apr 13 16:23:12 user nova-compute[71731]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc639d00-ef6b-4121-bcb0-c65ec0347abd (non-flash)
Apr 13 16:23:12 user nova-compute[71731]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0f728f3-fbb5-4ed8-a78b-a5d982b03f7d (non-flash)
Apr 13 16:23:12 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 16:23:12 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-6d9cc235-0c45-4909-a9f0-7f972b8cc030 tempest-TestVolumeSwap-359764099 tempest-TestVolumeSwap-359764099-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:62e7747a-651a-4d0a-a763-bfce9c4a3cff" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.341s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 16:23:12 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d9cc235-0c45-4909-a9f0-7f972b8cc030 tempest-TestVolumeSwap-359764099 tempest-TestVolumeSwap-359764099-project-admin] Connected to 172.16.0.220:3260 {{(pid=71731) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 16:23:12 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-6d9cc235-0c45-4909-a9f0-7f972b8cc030 tempest-TestVolumeSwap-359764099 tempest-TestVolumeSwap-359764099-project-admin] HCTL ('40', '-', '-', 0) found on session 15 with lun 0 {{(pid=71731) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 16:23:12 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-6d9cc235-0c45-4909-a9f0-7f972b8cc030 tempest-TestVolumeSwap-359764099 tempest-TestVolumeSwap-359764099-project-admin] Scanning host 40 c: -, t: -, l: 0) {{(pid=71731) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 16:23:12 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:23:12 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.015s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:23:12 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[c962d852-fd97-44db-b3b1-10ae7bdfb0fb]: (4, ('- - 0', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:23:12 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-6d9cc235-0c45-4909-a9f0-7f972b8cc030 tempest-TestVolumeSwap-359764099 tempest-TestVolumeSwap-359764099-project-admin] Searching for a device in session 15 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=71731) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 16:23:12 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d9cc235-0c45-4909-a9f0-7f972b8cc030 tempest-TestVolumeSwap-359764099 tempest-TestVolumeSwap-359764099-project-admin] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:62e7747a-651a-4d0a-a763-bfce9c4a3cff', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EHjgiLQq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71731) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 16:23:13 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-6d9cc235-0c45-4909-a9f0-7f972b8cc030 tempest-TestVolumeSwap-359764099 tempest-TestVolumeSwap-359764099-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.376s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 16:23:13 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d9cc235-0c45-4909-a9f0-7f972b8cc030 tempest-TestVolumeSwap-359764099 tempest-TestVolumeSwap-359764099-project-admin] <== connect_volume: return (1377ms) {'type': 'block', 'scsi_wwn': '23133303132313333', 'path': '/dev/sdi'} {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 16:23:13 user nova-compute[71731]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6d9cc235-0c45-4909-a9f0-7f972b8cc030 tempest-TestVolumeSwap-359764099 tempest-TestVolumeSwap-359764099-project-admin] [instance: 8c6d8096-853b-4091-ad82-6faf8ffc85fa] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23133303132313333', 'path': '/dev/sdi'} {{(pid=71731) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 16:23:13 user nova-compute[71731]: DEBUG nova.objects.instance [None req-6d9cc235-0c45-4909-a9f0-7f972b8cc030 tempest-TestVolumeSwap-359764099 tempest-TestVolumeSwap-359764099-project-admin] Lazy-loading 'flavor' on Instance uuid 8c6d8096-853b-4091-ad82-6faf8ffc85fa {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:23:13 user nova-compute[71731]: DEBUG nova.virt.libvirt.guest [None req-6d9cc235-0c45-4909-a9f0-7f972b8cc030 tempest-TestVolumeSwap-359764099 tempest-TestVolumeSwap-359764099-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=71731) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 13 16:23:13 user nova-compute[71731]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681402978.8546302, cf54be22-2a5d-40c4-8a1a-0060c77f83f6 => Stopped> {{(pid=71731) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 16:23:13 user nova-compute[71731]: INFO nova.compute.manager [-] [instance: cf54be22-2a5d-40c4-8a1a-0060c77f83f6] VM Stopped (Lifecycle Event)
Apr 13 16:23:13 user nova-compute[71731]: DEBUG nova.compute.manager [None req-b14414f9-4fb0-478d-95e8-5ea224b0e743 None None] [instance: cf54be22-2a5d-40c4-8a1a-0060c77f83f6] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:23:13 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:23:14 user nova-compute[71731]: DEBUG nova.virt.libvirt.guest [None req-6d9cc235-0c45-4909-a9f0-7f972b8cc030 tempest-TestVolumeSwap-359764099 tempest-TestVolumeSwap-359764099-project-admin] COPY block job progress, current cursor: 153092096 final cursor: 1073741824 {{(pid=71731) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 13 16:23:14 user nova-compute[71731]: DEBUG nova.virt.libvirt.guest [None req-6d9cc235-0c45-4909-a9f0-7f972b8cc030 tempest-TestVolumeSwap-359764099 tempest-TestVolumeSwap-359764099-project-admin] COPY block job progress, current cursor: 276824064 final cursor: 1073741824 {{(pid=71731) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 13 16:23:15 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-9e131767-04d4-45b2-8e12-2a4ab0daa556 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Acquiring lock "235f827c-7116-48e9-84c5-0c9761c18e1e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:23:15 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-9e131767-04d4-45b2-8e12-2a4ab0daa556 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lock "235f827c-7116-48e9-84c5-0c9761c18e1e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:23:15 user nova-compute[71731]: DEBUG nova.compute.manager [None req-9e131767-04d4-45b2-8e12-2a4ab0daa556 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: 235f827c-7116-48e9-84c5-0c9761c18e1e] Starting instance... {{(pid=71731) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 16:23:15 user nova-compute[71731]: DEBUG nova.virt.libvirt.guest [None req-6d9cc235-0c45-4909-a9f0-7f972b8cc030 tempest-TestVolumeSwap-359764099 tempest-TestVolumeSwap-359764099-project-admin] COPY block job progress, current cursor: 437256192 final cursor: 1073741824 {{(pid=71731) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 13 16:23:15 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-9e131767-04d4-45b2-8e12-2a4ab0daa556 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:23:15 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-9e131767-04d4-45b2-8e12-2a4ab0daa556 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:23:15 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-9e131767-04d4-45b2-8e12-2a4ab0daa556 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71731) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 16:23:15 user nova-compute[71731]: INFO nova.compute.claims [None req-9e131767-04d4-45b2-8e12-2a4ab0daa556 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: 235f827c-7116-48e9-84c5-0c9761c18e1e] Claim successful on node user
Apr 13 16:23:15 user nova-compute[71731]: DEBUG nova.virt.libvirt.guest [None req-6d9cc235-0c45-4909-a9f0-7f972b8cc030 tempest-TestVolumeSwap-359764099 tempest-TestVolumeSwap-359764099-project-admin] COPY block job progress, current cursor: 607125504 final cursor: 1073741824 {{(pid=71731) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 13 16:23:15 user nova-compute[71731]: DEBUG nova.compute.provider_tree [None req-9e131767-04d4-45b2-8e12-2a4ab0daa556 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Inventory has not changed in ProviderTree for provider: cb6b1a64-0c24-4e2d-af1e-16576ca9165c {{(pid=71731) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 16:23:15 user nova-compute[71731]: DEBUG nova.scheduler.client.report [None req-9e131767-04d4-45b2-8e12-2a4ab0daa556 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Inventory has not changed for provider cb6b1a64-0c24-4e2d-af1e-16576ca9165c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71731) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 16:23:15 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-9e131767-04d4-45b2-8e12-2a4ab0daa556 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.629s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:23:15 user nova-compute[71731]: DEBUG nova.compute.manager [None req-9e131767-04d4-45b2-8e12-2a4ab0daa556 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: 235f827c-7116-48e9-84c5-0c9761c18e1e] Start building networks asynchronously for instance. {{(pid=71731) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 16:23:15 user nova-compute[71731]: DEBUG nova.compute.manager [None req-9e131767-04d4-45b2-8e12-2a4ab0daa556 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: 235f827c-7116-48e9-84c5-0c9761c18e1e] Allocating IP information in the background. {{(pid=71731) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 16:23:15 user nova-compute[71731]: DEBUG nova.network.neutron [None req-9e131767-04d4-45b2-8e12-2a4ab0daa556 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: 235f827c-7116-48e9-84c5-0c9761c18e1e] allocate_for_instance() {{(pid=71731) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 16:23:15 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-9e131767-04d4-45b2-8e12-2a4ab0daa556 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: 235f827c-7116-48e9-84c5-0c9761c18e1e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 16:23:16 user nova-compute[71731]: DEBUG nova.compute.manager [None req-9e131767-04d4-45b2-8e12-2a4ab0daa556 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: 235f827c-7116-48e9-84c5-0c9761c18e1e] Start building block device mappings for instance. {{(pid=71731) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 16:23:16 user nova-compute[71731]: INFO nova.virt.block_device [None req-9e131767-04d4-45b2-8e12-2a4ab0daa556 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: 235f827c-7116-48e9-84c5-0c9761c18e1e] Booting with blank volume at /dev/vda
Apr 13 16:23:16 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:23:16 user nova-compute[71731]: DEBUG nova.virt.libvirt.guest [None req-6d9cc235-0c45-4909-a9f0-7f972b8cc030 tempest-TestVolumeSwap-359764099 tempest-TestVolumeSwap-359764099-project-admin] COPY block job progress, current cursor: 776994816 final cursor: 1073741824 {{(pid=71731) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 13 16:23:16 user nova-compute[71731]: DEBUG nova.policy [None req-9e131767-04d4-45b2-8e12-2a4ab0daa556 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e45a882dbafb4ea4976e4f45289eb2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2d09a74bf684a9fb1dd1e95d6c23f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71731) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 16:23:16 user nova-compute[71731]: DEBUG nova.virt.libvirt.guest [None req-6d9cc235-0c45-4909-a9f0-7f972b8cc030 tempest-TestVolumeSwap-359764099 tempest-TestVolumeSwap-359764099-project-admin] COPY block job progress, current cursor: 940572672 final cursor: 1073741824 {{(pid=71731) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 13 16:23:16 user nova-compute[71731]: DEBUG nova.compute.manager [req-a4bfb42a-ae92-4e20-be8d-afcd30f7869e req-80f0e18c-3bd1-44fb-aaf5-8f7964ebf203 service nova] [instance: 2549ba85-4e0a-420e-b711-07cafa8c60e9] Received event network-changed-36152688-366c-40a2-8bf9-88f69925594a {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:23:16 user nova-compute[71731]: DEBUG nova.compute.manager [req-a4bfb42a-ae92-4e20-be8d-afcd30f7869e req-80f0e18c-3bd1-44fb-aaf5-8f7964ebf203 service nova] [instance: 2549ba85-4e0a-420e-b711-07cafa8c60e9] Refreshing instance network info cache due to event network-changed-36152688-366c-40a2-8bf9-88f69925594a. {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 16:23:16 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-a4bfb42a-ae92-4e20-be8d-afcd30f7869e req-80f0e18c-3bd1-44fb-aaf5-8f7964ebf203 service nova] Acquiring lock "refresh_cache-2549ba85-4e0a-420e-b711-07cafa8c60e9" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 16:23:16 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-a4bfb42a-ae92-4e20-be8d-afcd30f7869e req-80f0e18c-3bd1-44fb-aaf5-8f7964ebf203 service nova] Acquired lock "refresh_cache-2549ba85-4e0a-420e-b711-07cafa8c60e9" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 16:23:16 user nova-compute[71731]: DEBUG nova.network.neutron [req-a4bfb42a-ae92-4e20-be8d-afcd30f7869e req-80f0e18c-3bd1-44fb-aaf5-8f7964ebf203 service nova] [instance: 2549ba85-4e0a-420e-b711-07cafa8c60e9] Refreshing network info cache for port 36152688-366c-40a2-8bf9-88f69925594a {{(pid=71731) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 16:23:16 user nova-compute[71731]: DEBUG nova.compute.manager [req-7669d726-c8d2-4ff6-aecf-0ad5d113c8a4 req-aeddb40d-66dd-46f2-b890-2b84667b1069 service nova] [instance: e4ada2d7-7ace-4ed4-86a6-ed121c95e80f] Received event network-changed-a409f60c-6c6a-49f8-8520-04614e804002 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:23:16 user nova-compute[71731]: DEBUG nova.compute.manager [req-7669d726-c8d2-4ff6-aecf-0ad5d113c8a4 req-aeddb40d-66dd-46f2-b890-2b84667b1069 service nova] [instance: e4ada2d7-7ace-4ed4-86a6-ed121c95e80f] Refreshing instance network info cache due to event network-changed-a409f60c-6c6a-49f8-8520-04614e804002. {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 16:23:16 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-7669d726-c8d2-4ff6-aecf-0ad5d113c8a4 req-aeddb40d-66dd-46f2-b890-2b84667b1069 service nova] Acquiring lock "refresh_cache-e4ada2d7-7ace-4ed4-86a6-ed121c95e80f" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 16:23:16 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-7669d726-c8d2-4ff6-aecf-0ad5d113c8a4 req-aeddb40d-66dd-46f2-b890-2b84667b1069 service nova] Acquired lock "refresh_cache-e4ada2d7-7ace-4ed4-86a6-ed121c95e80f" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 16:23:16 user nova-compute[71731]: DEBUG nova.network.neutron [req-7669d726-c8d2-4ff6-aecf-0ad5d113c8a4 req-aeddb40d-66dd-46f2-b890-2b84667b1069 service nova] [instance: e4ada2d7-7ace-4ed4-86a6-ed121c95e80f] Refreshing network info cache for port a409f60c-6c6a-49f8-8520-04614e804002 {{(pid=71731) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 16:23:17 user nova-compute[71731]: DEBUG nova.virt.libvirt.guest [None req-6d9cc235-0c45-4909-a9f0-7f972b8cc030 tempest-TestVolumeSwap-359764099 tempest-TestVolumeSwap-359764099-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=71731) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 13 16:23:17 user nova-compute[71731]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6d9cc235-0c45-4909-a9f0-7f972b8cc030 tempest-TestVolumeSwap-359764099 tempest-TestVolumeSwap-359764099-project-admin] [instance: 8c6d8096-853b-4091-ad82-6faf8ffc85fa] calling os-brick to detach iSCSI Volume {{(pid=71731) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 16:23:17 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d9cc235-0c45-4909-a9f0-7f972b8cc030 tempest-TestVolumeSwap-359764099 tempest-TestVolumeSwap-359764099-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8cf0118790>, {'target_iqn': 'iqn.2010-10.org.openstack:d3a41289-1225-4bee-927e-5da050896328', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EtZcSkFG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdk', 'volume_id': 'd3a41289-1225-4bee-927e-5da050896328': {}}" {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 16:23:17 user nova-compute[71731]: WARNING os_brick.initiator.connectors.base [None req-6d9cc235-0c45-4909-a9f0-7f972b8cc030 tempest-TestVolumeSwap-359764099 tempest-TestVolumeSwap-359764099-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 16:23:17 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-6d9cc235-0c45-4909-a9f0-7f972b8cc030 tempest-TestVolumeSwap-359764099 tempest-TestVolumeSwap-359764099-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 16:23:17 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-6d9cc235-0c45-4909-a9f0-7f972b8cc030 tempest-TestVolumeSwap-359764099 tempest-TestVolumeSwap-359764099-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 16:23:17 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:23:17 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.030s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:23:17 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed02f918-45a2-4969-995d-f8d9d0b0a1e9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:62e7747a-651a-4d0a-a763-bfce9c4a3cff\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c20e80fa-58de-431a-8901-2535657aaadf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:27919afc-8990-4ed5-af9e-9d6b3d7b231e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0e3b49ec-80af-4c38-9689-f7277e495d21\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cc639d00-ef6b-4121-bcb0-c65ec0347abd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e0f728f3-fbb5-4ed8-a78b-a5d982b03f7d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:84c7f6ad-d2c2-465a-b39e-47347aa85be0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d3a41289-1225-4bee-927e-5da050896328\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:48af37b0-6938-432e-b374-d992c4dd9ae9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:23:17 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d9cc235-0c45-4909-a9f0-7f972b8cc030 tempest-TestVolumeSwap-359764099 tempest-TestVolumeSwap-359764099-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 16:23:17 user nova-compute[71731]: No targets found.
Apr 13 16:23:17 user nova-compute[71731]: iSNS:
Apr 13 16:23:17 user nova-compute[71731]: No targets found.
Apr 13 16:23:17 user nova-compute[71731]: STATIC:
Apr 13 16:23:17 user nova-compute[71731]: Target: iqn.2010-10.org.openstack:62e7747a-651a-4d0a-a763-bfce9c4a3cff
Apr 13 16:23:17 user nova-compute[71731]:         Portal: 172.16.0.220:3260,-1
Apr 13 16:23:17 user nova-compute[71731]:                 Iface Name: default
Apr 13 16:23:17 user nova-compute[71731]: Target: iqn.2010-10.org.openstack:c20e80fa-58de-431a-8901-2535657aaadf
Apr 13 16:23:17 user nova-compute[71731]:         Portal: 172.16.0.220:3260,-1
Apr 13 16:23:17 user nova-compute[71731]:                 Iface Name: default
Apr 13 16:23:17 user nova-compute[71731]: Target: iqn.2010-10.org.openstack:27919afc-8990-4ed5-af9e-9d6b3d7b231e
Apr 13 16:23:17 user nova-compute[71731]:         Portal: 172.16.0.220:3260,-1
Apr 13 16:23:17 user nova-compute[71731]:                 Iface Name: default
Apr 13 16:23:17 user nova-compute[71731]: Target: iqn.2010-10.org.openstack:0e3b49ec-80af-4c38-9689-f7277e495d21
Apr 13 16:23:17 user nova-compute[71731]:         Portal: 172.16.0.220:3260,-1
Apr 13 16:23:17 user nova-compute[71731]:                 Iface Name: default
Apr 13 16:23:17 user nova-compute[71731]: Target: iqn.2010-10.org.openstack:cc639d00-ef6b-4121-bcb0-c65ec0347abd
Apr 13 16:23:17 user nova-compute[71731]:         Portal: 172.16.0.220:3260,-1
Apr 13 16:23:17 user nova-compute[71731]:                 Iface Name: default
Apr 13 16:23:17 user nova-compute[71731]: Target: iqn.2010-10.org.openstack:e0f728f3-fbb5-4ed8-a78b-a5d982b03f7d
Apr 13 16:23:17 user nova-compute[71731]:         Portal: 172.16.0.220:3260,-1
Apr 13 16:23:17 user nova-compute[71731]:                 Iface Name: default
Apr 13 16:23:17 user nova-compute[71731]: Target: iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984
Apr 13 16:23:17 user nova-compute[71731]:         Portal: 172.16.0.220:3260,-1
Apr 13 16:23:17 user nova-compute[71731]:                 Iface Name: default
Apr 13 16:23:17 user nova-compute[71731]: Target: iqn.2010-10.org.openstack:84c7f6ad-d2c2-465a-b39e-47347aa85be0
Apr 13 16:23:17 user nova-compute[71731]:         Portal: 172.16.0.220:3260,-1
Apr 13 16:23:17 user nova-compute[71731]:                 Iface Name: default
Apr 13 16:23:17 user nova-compute[71731]: Target: iqn.2010-10.org.openstack:d3a41289-1225-4bee-927e-5da050896328
Apr 13 16:23:17 user nova-compute[71731]:         Portal: 172.16.0.220:3260,-1
Apr 13 16:23:17 user nova-compute[71731]:                 Iface Name: default
Apr 13 16:23:17 user nova-compute[71731]: Target: iqn.2010-10.org.openstack:48af37b0-6938-432e-b374-d992c4dd9ae9
Apr 13 16:23:17 user nova-compute[71731]:         Portal: 172.16.0.220:3260,-1
Apr 13 16:23:17 user nova-compute[71731]:                 Iface Name: default
Apr 13 16:23:17 user nova-compute[71731]: FIRMWARE:
Apr 13 16:23:17 user nova-compute[71731]: No targets found.
Apr 13 16:23:17 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 16:23:17 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d9cc235-0c45-4909-a9f0-7f972b8cc030 tempest-TestVolumeSwap-359764099 tempest-TestVolumeSwap-359764099-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 16:23:17 user nova-compute[71731]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 16:23:17 user nova-compute[71731]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71731) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 16:23:17 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d9cc235-0c45-4909-a9f0-7f972b8cc030 tempest-TestVolumeSwap-359764099 tempest-TestVolumeSwap-359764099-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d3a41289-1225-4bee-927e-5da050896328', 0)] {{(pid=71731) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 16:23:17 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:23:17 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:23:17 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[dea9112d-ff34-4791-9ad9-2705b3706e23]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0e3b49ec-80af-4c38-9689-f7277e495d21\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:27919afc-8990-4ed5-af9e-9d6b3d7b231e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:48af37b0-6938-432e-b374-d992c4dd9ae9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:62e7747a-651a-4d0a-a763-bfce9c4a3cff\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:84c7f6ad-d2c2-465a-b39e-47347aa85be0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c20e80fa-58de-431a-8901-2535657aaadf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cc639d00-ef6b-4121-bcb0-c65ec0347abd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d3a41289-1225-4bee-927e-5da050896328\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e0f728f3-fbb5-4ed8-a78b-a5d982b03f7d\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:23:17 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:23:17 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:23:17 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[78a45e5c-a58c-473f-a5ec-e68b0171dfd1]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e3b49ec-80af-4c38-9689-f7277e495d21 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3a41289-1225-4bee-927e-5da050896328 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62e7747a-651a-4d0a-a763-bfce9c4a3cff (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c7f6ad-d2c2-465a-b39e-47347aa85be0 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48af37b0-6938-432e-b374-d992c4dd9ae9 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c20e80fa-58de-431a-8901-2535657aaadf (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27919afc-8990-4ed5-af9e-9d6b3d7b231e (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc639d00-ef6b-4121-bcb0-c65ec0347abd (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0f728f3-fbb5-4ed8-a78b-a5d982b03f7d (non-flash)\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:23:17 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d9cc235-0c45-4909-a9f0-7f972b8cc030 tempest-TestVolumeSwap-359764099 tempest-TestVolumeSwap-359764099-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e3b49ec-80af-4c38-9689-f7277e495d21 (non-flash)
Apr 13 16:23:17 user nova-compute[71731]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3a41289-1225-4bee-927e-5da050896328 (non-flash)
Apr 13 16:23:17 user nova-compute[71731]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62e7747a-651a-4d0a-a763-bfce9c4a3cff (non-flash)
Apr 13 16:23:17 user nova-compute[71731]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984 (non-flash)
Apr 13 16:23:17 user nova-compute[71731]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c7f6ad-d2c2-465a-b39e-47347aa85be0 (non-flash)
Apr 13 16:23:17 user nova-compute[71731]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48af37b0-6938-432e-b374-d992c4dd9ae9 (non-flash)
Apr 13 16:23:17 user nova-compute[71731]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c20e80fa-58de-431a-8901-2535657aaadf (non-flash)
Apr 13 16:23:17 user nova-compute[71731]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27919afc-8990-4ed5-af9e-9d6b3d7b231e (non-flash)
Apr 13 16:23:17 user nova-compute[71731]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc639d00-ef6b-4121-bcb0-c65ec0347abd (non-flash)
Apr 13 16:23:17 user nova-compute[71731]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0f728f3-fbb5-4ed8-a78b-a5d982b03f7d (non-flash)
Apr 13 16:23:17 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 16:23:17 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d9cc235-0c45-4909-a9f0-7f972b8cc030 tempest-TestVolumeSwap-359764099 tempest-TestVolumeSwap-359764099-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e3b49ec-80af-4c38-9689-f7277e495d21 (non-flash)
Apr 13 16:23:17 user nova-compute[71731]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3a41289-1225-4bee-927e-5da050896328 (non-flash)
Apr 13 16:23:17 user nova-compute[71731]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62e7747a-651a-4d0a-a763-bfce9c4a3cff (non-flash)
Apr 13 16:23:17 user nova-compute[71731]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984 (non-flash)
Apr 13 16:23:17 user nova-compute[71731]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c7f6ad-d2c2-465a-b39e-47347aa85be0 (non-flash)
Apr 13 16:23:17 user nova-compute[71731]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48af37b0-6938-432e-b374-d992c4dd9ae9 (non-flash)
Apr 13 16:23:17 user nova-compute[71731]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c20e80fa-58de-431a-8901-2535657aaadf (non-flash)
Apr 13 16:23:17 user nova-compute[71731]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27919afc-8990-4ed5-af9e-9d6b3d7b231e (non-flash)
Apr 13 16:23:17 user nova-compute[71731]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc639d00-ef6b-4121-bcb0-c65ec0347abd (non-flash)
Apr 13 16:23:17 user nova-compute[71731]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0f728f3-fbb5-4ed8-a78b-a5d982b03f7d (non-flash)
Apr 13 16:23:17 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 16:23:17 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d9cc235-0c45-4909-a9f0-7f972b8cc030 tempest-TestVolumeSwap-359764099 tempest-TestVolumeSwap-359764099-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8cf02777f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d3a41289-1225-4bee-927e-5da050896328'): ({'sdk'}, set())}) {{(pid=71731) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 16:23:17 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-6d9cc235-0c45-4909-a9f0-7f972b8cc030 tempest-TestVolumeSwap-359764099 tempest-TestVolumeSwap-359764099-project-admin] Removing single pathed devices sdk {{(pid=71731) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 16:23:17 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:23:17 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:23:17 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[28d58b83-e471-4905-b4e8-ffc009f7359d]: (4, ('path checker states:\nup                  10\n\npaths: 0\nbusy: False\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:23:17 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdk {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:23:17 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdk" returned: 0 in 0.018s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:23:17 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[8649c277-108e-4c55-84bf-a0be83c084c6]: (4, ('ok\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:23:17 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-6d9cc235-0c45-4909-a9f0-7f972b8cc030 tempest-TestVolumeSwap-359764099 tempest-TestVolumeSwap-359764099-project-admin] Flushing IO for device /dev/sdk {{(pid=71731) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 16:23:17 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdk {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:23:17 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdk" returned: 0 in 0.013s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:23:17 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b908603-cb74-4ddd-b84c-cbd3014f0b47]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:23:17 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-6d9cc235-0c45-4909-a9f0-7f972b8cc030 tempest-TestVolumeSwap-359764099 tempest-TestVolumeSwap-359764099-project-admin] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=71731) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 16:23:17 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdk/device/delete {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:23:17 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdk/device/delete" returned: 0 in 0.042s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:23:17 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[37348570-302b-417f-b155-0e2ca2904dbb]: (4, ('1', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:23:17 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-6d9cc235-0c45-4909-a9f0-7f972b8cc030 tempest-TestVolumeSwap-359764099 tempest-TestVolumeSwap-359764099-project-admin] Checking to see if SCSI volumes sdk have been removed. {{(pid=71731) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 16:23:17 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-6d9cc235-0c45-4909-a9f0-7f972b8cc030 tempest-TestVolumeSwap-359764099 tempest-TestVolumeSwap-359764099-project-admin] SCSI volumes sdk have been removed. {{(pid=71731) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 16:23:17 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d9cc235-0c45-4909-a9f0-7f972b8cc030 tempest-TestVolumeSwap-359764099 tempest-TestVolumeSwap-359764099-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d3a41289-1225-4bee-927e-5da050896328')] {{(pid=71731) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 16:23:17 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3a41289-1225-4bee-927e-5da050896328 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:23:17 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3a41289-1225-4bee-927e-5da050896328 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:23:17 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a66db22-11d1-4ac1-a5c1-d3d66e787157]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:23:17 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d9cc235-0c45-4909-a9f0-7f972b8cc030 tempest-TestVolumeSwap-359764099 tempest-TestVolumeSwap-359764099-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:23:17 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3a41289-1225-4bee-927e-5da050896328 -p 172.16.0.220:3260 --logout {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:23:17 user nova-compute[71731]: DEBUG nova.network.neutron [req-a4bfb42a-ae92-4e20-be8d-afcd30f7869e req-80f0e18c-3bd1-44fb-aaf5-8f7964ebf203 service nova] [instance: 2549ba85-4e0a-420e-b711-07cafa8c60e9] Updated VIF entry in instance network info cache for port 36152688-366c-40a2-8bf9-88f69925594a. {{(pid=71731) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 16:23:17 user nova-compute[71731]: DEBUG nova.network.neutron [req-a4bfb42a-ae92-4e20-be8d-afcd30f7869e req-80f0e18c-3bd1-44fb-aaf5-8f7964ebf203 service nova] [instance: 2549ba85-4e0a-420e-b711-07cafa8c60e9] Updating instance_info_cache with network_info: [{"id": "36152688-366c-40a2-8bf9-88f69925594a", "address": "fa:16:3e:1c:8b:59", "network": {"id": "f11266a1-4740-4cb3-8467-e0e95870ac22", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-689537131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbe4e9fb786d4015b035b4d00f75a1ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36152688-36", "ovs_interfaceid": "36152688-366c-40a2-8bf9-88f69925594a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d7155dcf-9e83-4579-b81a-7277d4a9eeaf", "address": "fa:16:3e:d0:1a:bc", "network": {"id": "5d158a82-de85-48b5-9f17-40e61e9b0df8", "bridge": "br-int", "label": "tempest-device-tagging-net1-574676351", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.246", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bbe4e9fb786d4015b035b4d00f75a1ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7155dcf-9e", "ovs_interfaceid": "d7155dcf-9e83-4579-b81a-7277d4a9eeaf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4c481745-6342-43f8-9040-3ea1d8c5c572", "address": "fa:16:3e:e7:ea:ff", "network": {"id": "5d158a82-de85-48b5-9f17-40e61e9b0df8", "bridge": "br-int", "label": "tempest-device-tagging-net1-574676351", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.164", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bbe4e9fb786d4015b035b4d00f75a1ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c481745-63", "ovs_interfaceid": "4c481745-6342-43f8-9040-3ea1d8c5c572", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0152bbb9-d50d-4e58-8a2b-727c4675ea2f", "address": "fa:16:3e:0d:4d:58", "network": {"id": "5d158a82-de85-48b5-9f17-40e61e9b0df8", "bridge": "br-int", "label": "tempest-device-tagging-net1-574676351", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.142", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bbe4e9fb786d4015b035b4d00f75a1ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0152bbb9-d5", "ovs_interfaceid": "0152bbb9-d50d-4e58-8a2b-727c4675ea2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3730ed6e-b093-4232-800b-b064d650e9e8", "address": "fa:16:3e:a8:c4:f6", "network": {"id": "5d158a82-de85-48b5-9f17-40e61e9b0df8", "bridge": "br-int", "label": "tempest-device-tagging-net1-574676351", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.38", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bbe4e9fb786d4015b035b4d00f75a1ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3730ed6e-b0", "ovs_interfaceid": "3730ed6e-b093-4232-800b-b064d650e9e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0fbdf291-df5d-41c5-a765-7145a87da272", "address": "fa:16:3e:dc:57:7b", "network": {"id": "4224b04f-23ed-464e-9b2c-df8c843f9287", "bridge": "br-int", "label": "tempest-device-tagging-net2-109401200", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "bbe4e9fb786d4015b035b4d00f75a1ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fbdf291-df", "ovs_interfaceid": "0fbdf291-df5d-41c5-a765-7145a87da272", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "38e92b7c-b7c1-4137-a1db-21bc1d24f3ee", "address": "fa:16:3e:a3:dd:27", "network": {"id": "4224b04f-23ed-464e-9b2c-df8c843f9287", "bridge": "br-int", "label": "tempest-device-tagging-net2-109401200", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "bbe4e9fb786d4015b035b4d00f75a1ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38e92b7c-b7", "ovs_interfaceid": "38e92b7c-b7c1-4137-a1db-21bc1d24f3ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:23:17 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-a4bfb42a-ae92-4e20-be8d-afcd30f7869e req-80f0e18c-3bd1-44fb-aaf5-8f7964ebf203 service nova] Releasing lock "refresh_cache-2549ba85-4e0a-420e-b711-07cafa8c60e9" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 16:23:17 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3a41289-1225-4bee-927e-5da050896328 -p 172.16.0.220:3260 --logout" returned: 0 in 0.084s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:23:17 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[47edc914-18d2-425a-974c-b9202baa6924]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:d3a41289-1225-4bee-927e-5da050896328, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:d3a41289-1225-4bee-927e-5da050896328, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:23:17 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d9cc235-0c45-4909-a9f0-7f972b8cc030 tempest-TestVolumeSwap-359764099 tempest-TestVolumeSwap-359764099-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:d3a41289-1225-4bee-927e-5da050896328, portal: 172.16.0.220,3260]
Apr 13 16:23:17 user nova-compute[71731]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:d3a41289-1225-4bee-927e-5da050896328, portal: 172.16.0.220,3260] successful.
Apr 13 16:23:17 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:23:17 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3a41289-1225-4bee-927e-5da050896328 -p 172.16.0.220:3260 --op delete {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:23:17 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3a41289-1225-4bee-927e-5da050896328 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.038s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:23:17 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[d298706b-027c-4d44-82b1-b9e08482a2ca]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:23:17 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d9cc235-0c45-4909-a9f0-7f972b8cc030 tempest-TestVolumeSwap-359764099 tempest-TestVolumeSwap-359764099-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:23:17 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-6d9cc235-0c45-4909-a9f0-7f972b8cc030 tempest-TestVolumeSwap-359764099 tempest-TestVolumeSwap-359764099-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.370s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 16:23:17 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d9cc235-0c45-4909-a9f0-7f972b8cc030 tempest-TestVolumeSwap-359764099 tempest-TestVolumeSwap-359764099-project-admin] <== disconnect_volume: return (372ms) None {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 16:23:17 user nova-compute[71731]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6d9cc235-0c45-4909-a9f0-7f972b8cc030 tempest-TestVolumeSwap-359764099 tempest-TestVolumeSwap-359764099-project-admin] [instance: 8c6d8096-853b-4091-ad82-6faf8ffc85fa] Disconnected iSCSI Volume {{(pid=71731) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 16:23:17 user nova-compute[71731]: DEBUG nova.compute.manager [None req-6d9cc235-0c45-4909-a9f0-7f972b8cc030 tempest-TestVolumeSwap-359764099 tempest-TestVolumeSwap-359764099-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:62e7747a-651a-4d0a-a763-bfce9c4a3cff', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EHjgiLQq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, 'status': 'reserved', 'instance': '8c6d8096-853b-4091-ad82-6faf8ffc85fa', 'attached_at': '', 'detached_at': '', 'volume_id': '62e7747a-651a-4d0a-a763-bfce9c4a3cff', 'serial'} {{(pid=71731) _swap_volume /opt/stack/nova/nova/compute/manager.py:7665}}
Apr 13 16:23:17 user nova-compute[71731]: DEBUG nova.compute.manager [None req-6d9cc235-0c45-4909-a9f0-7f972b8cc030 tempest-TestVolumeSwap-359764099 tempest-TestVolumeSwap-359764099-project-admin] [instance: 8c6d8096-853b-4091-ad82-6faf8ffc85fa] swap_volume: removing Cinder connection for volume d3a41289-1225-4bee-927e-5da050896328 {{(pid=71731) _swap_volume /opt/stack/nova/nova/compute/manager.py:7710}}
Apr 13 16:23:17 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:23:18 user nova-compute[71731]: DEBUG nova.network.neutron [None req-9e131767-04d4-45b2-8e12-2a4ab0daa556 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: 235f827c-7116-48e9-84c5-0c9761c18e1e] Successfully created port: b72a6c8b-7244-41c2-a4f7-6da43b4944b8 {{(pid=71731) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 16:23:18 user nova-compute[71731]: DEBUG nova.network.neutron [req-7669d726-c8d2-4ff6-aecf-0ad5d113c8a4 req-aeddb40d-66dd-46f2-b890-2b84667b1069 service nova] [instance: e4ada2d7-7ace-4ed4-86a6-ed121c95e80f] Updated VIF entry in instance network info cache for port a409f60c-6c6a-49f8-8520-04614e804002. {{(pid=71731) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 16:23:18 user nova-compute[71731]: DEBUG nova.network.neutron [req-7669d726-c8d2-4ff6-aecf-0ad5d113c8a4 req-aeddb40d-66dd-46f2-b890-2b84667b1069 service nova] [instance: e4ada2d7-7ace-4ed4-86a6-ed121c95e80f] Updating instance_info_cache with network_info: [{"id": "a409f60c-6c6a-49f8-8520-04614e804002", "address": "fa:16:3e:ee:b5:cc", "network": {"id": "06e8519d-91e2-4c6a-8b74-6f55609e1764", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-420310439-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7649e366b0164e2fa5b3faa0830b6ea6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa409f60c-6c", "ovs_interfaceid": "a409f60c-6c6a-49f8-8520-04614e804002", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ac94464f-32dc-4cd1-a270-ec8934e77c21", "address": "fa:16:3e:5e:a2:3f", "network": {"id": "4b153def-aec7-4f9e-9604-f1e0afb247f3", "bridge": "br-int", "label": "tempest-device-tagging-net1-1029190313", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.127", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7649e366b0164e2fa5b3faa0830b6ea6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac94464f-32", "ovs_interfaceid": "ac94464f-32dc-4cd1-a270-ec8934e77c21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0125a8df-e91c-4d65-be74-fda2f2d93938", "address": "fa:16:3e:39:06:fc", "network": {"id": "4b153def-aec7-4f9e-9604-f1e0afb247f3", "bridge": "br-int", "label": "tempest-device-tagging-net1-1029190313", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.61", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7649e366b0164e2fa5b3faa0830b6ea6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0125a8df-e9", "ovs_interfaceid": "0125a8df-e91c-4d65-be74-fda2f2d93938", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8f3a3011-e474-4538-812b-9df3968fd629", "address": "fa:16:3e:78:12:fd", "network": {"id": "4b153def-aec7-4f9e-9604-f1e0afb247f3", "bridge": "br-int", "label": "tempest-device-tagging-net1-1029190313", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.202", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7649e366b0164e2fa5b3faa0830b6ea6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f3a3011-e4", "ovs_interfaceid": "8f3a3011-e474-4538-812b-9df3968fd629", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2430beb8-b2e4-4493-bdc5-df6b4c1181c6", "address": "fa:16:3e:30:1c:f5", "network": {"id": "4b153def-aec7-4f9e-9604-f1e0afb247f3", "bridge": "br-int", "label": "tempest-device-tagging-net1-1029190313", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.91", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7649e366b0164e2fa5b3faa0830b6ea6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2430beb8-b2", "ovs_interfaceid": "2430beb8-b2e4-4493-bdc5-df6b4c1181c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "15dca2c3-5048-4e80-8008-c19400ea34e4", "address": "fa:16:3e:df:45:fc", "network": {"id": "310c919b-177f-4fb1-956a-1423f7397f77", "bridge": "br-int", "label": "tempest-device-tagging-net2-188582195", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7649e366b0164e2fa5b3faa0830b6ea6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15dca2c3-50", "ovs_interfaceid": "15dca2c3-5048-4e80-8008-c19400ea34e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d41765b6-0d5b-43c1-bf58-a82a7bbe3137", "address": "fa:16:3e:63:86:1f", "network": {"id": "310c919b-177f-4fb1-956a-1423f7397f77", "bridge": "br-int", "label": "tempest-device-tagging-net2-188582195", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7649e366b0164e2fa5b3faa0830b6ea6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd41765b6-0d", "ovs_interfaceid": "d41765b6-0d5b-43c1-bf58-a82a7bbe3137", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:23:18 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-7669d726-c8d2-4ff6-aecf-0ad5d113c8a4 req-aeddb40d-66dd-46f2-b890-2b84667b1069 service nova] Releasing lock "refresh_cache-e4ada2d7-7ace-4ed4-86a6-ed121c95e80f" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 16:23:18 user nova-compute[71731]: DEBUG nova.compute.manager [None req-6d9cc235-0c45-4909-a9f0-7f972b8cc030 tempest-TestVolumeSwap-359764099 tempest-TestVolumeSwap-359764099-project-admin] [instance: 8c6d8096-853b-4091-ad82-6faf8ffc85fa] swap_volume: Updating volume d3a41289-1225-4bee-927e-5da050896328 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:62e7747a-651a-4d0a-a763-bfce9c4a3cff", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "EHjgiLQq", "auth_password": "xY7D4cm2lQHaz1", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdi", "volume_id": "62e7747a-651a-4d0a-a763-bfce9c4a3cff"}, "status": "reserved", "instance": "8c6d8096-853b-4091-ad82-6faf8ffc85fa", "attached_at": "", "detached_at": "", "volume_id": "62e7747a-651a-4d0a-a763-bfce9c4a3cff", "serial": "62e7747a-651a-4d0a-a763-bfce9c4a3cff"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '62e7747a-651a-4d0a-a763-bfce9c4a3cff', 'no_device': None, 'attachment_id': '10ab3ff3-c1c6-4397-8ac4-41bf701cba42'} {{(pid=71731) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7858}}
Apr 13 16:23:18 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-6d9cc235-0c45-4909-a9f0-7f972b8cc030 tempest-TestVolumeSwap-359764099 tempest-TestVolumeSwap-359764099-project-admin] Lock "8c6d8096-853b-4091-ad82-6faf8ffc85fa" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 11.653s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:23:18 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-dbf47c70-b17d-428f-97f0-d7601655d4d4 tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Acquiring lock "e4ada2d7-7ace-4ed4-86a6-ed121c95e80f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:23:18 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-dbf47c70-b17d-428f-97f0-d7601655d4d4 tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Lock "e4ada2d7-7ace-4ed4-86a6-ed121c95e80f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:23:18 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-dbf47c70-b17d-428f-97f0-d7601655d4d4 tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Acquiring lock "e4ada2d7-7ace-4ed4-86a6-ed121c95e80f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:23:18 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-dbf47c70-b17d-428f-97f0-d7601655d4d4 tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Lock "e4ada2d7-7ace-4ed4-86a6-ed121c95e80f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:23:18 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-dbf47c70-b17d-428f-97f0-d7601655d4d4 tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Lock "e4ada2d7-7ace-4ed4-86a6-ed121c95e80f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:23:18 user nova-compute[71731]: INFO nova.compute.manager [None req-dbf47c70-b17d-428f-97f0-d7601655d4d4 tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] [instance: e4ada2d7-7ace-4ed4-86a6-ed121c95e80f] Terminating instance
Apr 13 16:23:18 user nova-compute[71731]: DEBUG nova.compute.manager [None req-dbf47c70-b17d-428f-97f0-d7601655d4d4 tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] [instance: e4ada2d7-7ace-4ed4-86a6-ed121c95e80f] Start destroying the instance on the hypervisor. {{(pid=71731) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 16:23:18 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:23:18 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:23:18 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:23:19 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:23:19 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:23:19 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:23:19 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:23:19 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:23:19 user nova-compute[71731]: DEBUG nova.network.neutron [None req-9e131767-04d4-45b2-8e12-2a4ab0daa556 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: 235f827c-7116-48e9-84c5-0c9761c18e1e] Successfully updated port: b72a6c8b-7244-41c2-a4f7-6da43b4944b8 {{(pid=71731) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 16:23:19 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:23:19 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-48b63815-ac65-4477-a276-ce12f90a7768 tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Acquiring lock "2549ba85-4e0a-420e-b711-07cafa8c60e9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:23:19 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-48b63815-ac65-4477-a276-ce12f90a7768 tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Lock "2549ba85-4e0a-420e-b711-07cafa8c60e9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:23:19 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-48b63815-ac65-4477-a276-ce12f90a7768 tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Acquiring lock "2549ba85-4e0a-420e-b711-07cafa8c60e9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:23:19 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-48b63815-ac65-4477-a276-ce12f90a7768 tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Lock "2549ba85-4e0a-420e-b711-07cafa8c60e9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:23:19 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-48b63815-ac65-4477-a276-ce12f90a7768 tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Lock "2549ba85-4e0a-420e-b711-07cafa8c60e9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.002s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:23:19 user nova-compute[71731]: INFO nova.compute.manager [None req-48b63815-ac65-4477-a276-ce12f90a7768 tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] [instance: 2549ba85-4e0a-420e-b711-07cafa8c60e9] Terminating instance
Apr 13 16:23:19 user nova-compute[71731]: DEBUG nova.compute.manager [None req-48b63815-ac65-4477-a276-ce12f90a7768 tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] [instance: 2549ba85-4e0a-420e-b711-07cafa8c60e9] Start destroying the instance on the hypervisor. {{(pid=71731) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 16:23:19 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-9e131767-04d4-45b2-8e12-2a4ab0daa556 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Acquiring lock "refresh_cache-235f827c-7116-48e9-84c5-0c9761c18e1e" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 16:23:19 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-9e131767-04d4-45b2-8e12-2a4ab0daa556 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Acquired lock "refresh_cache-235f827c-7116-48e9-84c5-0c9761c18e1e" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 16:23:19 user nova-compute[71731]: DEBUG nova.network.neutron [None req-9e131767-04d4-45b2-8e12-2a4ab0daa556 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: 235f827c-7116-48e9-84c5-0c9761c18e1e] Building network info cache for instance {{(pid=71731) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 16:23:19 user nova-compute[71731]: DEBUG nova.compute.manager [req-a0c7e314-7ea4-4d74-b53e-6bfc70abc808 req-6db9cb28-fc39-4943-b8c0-fa3b6ad46371 service nova] [instance: 235f827c-7116-48e9-84c5-0c9761c18e1e] Received event network-changed-b72a6c8b-7244-41c2-a4f7-6da43b4944b8 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:23:19 user nova-compute[71731]: DEBUG nova.compute.manager [req-a0c7e314-7ea4-4d74-b53e-6bfc70abc808 req-6db9cb28-fc39-4943-b8c0-fa3b6ad46371 service nova] [instance: 235f827c-7116-48e9-84c5-0c9761c18e1e] Refreshing instance network info cache due to event network-changed-b72a6c8b-7244-41c2-a4f7-6da43b4944b8. {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 16:23:19 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-a0c7e314-7ea4-4d74-b53e-6bfc70abc808 req-6db9cb28-fc39-4943-b8c0-fa3b6ad46371 service nova] Acquiring lock "refresh_cache-235f827c-7116-48e9-84c5-0c9761c18e1e" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 16:23:19 user nova-compute[71731]: DEBUG nova.network.neutron [None req-9e131767-04d4-45b2-8e12-2a4ab0daa556 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: 235f827c-7116-48e9-84c5-0c9761c18e1e] Instance cache missing network info. {{(pid=71731) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 16:23:19 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:23:19 user nova-compute[71731]: DEBUG nova.compute.manager [req-7f7492f9-1f05-4f2d-b1bb-4f58af44f8c7 req-6cdef93e-a7d0-4780-bbe7-f44557c5fdec service nova] [instance: e4ada2d7-7ace-4ed4-86a6-ed121c95e80f] Received event network-vif-unplugged-ac94464f-32dc-4cd1-a270-ec8934e77c21 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:23:19 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-7f7492f9-1f05-4f2d-b1bb-4f58af44f8c7 req-6cdef93e-a7d0-4780-bbe7-f44557c5fdec service nova] Acquiring lock "e4ada2d7-7ace-4ed4-86a6-ed121c95e80f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:23:19 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-7f7492f9-1f05-4f2d-b1bb-4f58af44f8c7 req-6cdef93e-a7d0-4780-bbe7-f44557c5fdec service nova] Lock "e4ada2d7-7ace-4ed4-86a6-ed121c95e80f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:23:19 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-7f7492f9-1f05-4f2d-b1bb-4f58af44f8c7 req-6cdef93e-a7d0-4780-bbe7-f44557c5fdec service nova] Lock "e4ada2d7-7ace-4ed4-86a6-ed121c95e80f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:23:19 user nova-compute[71731]: DEBUG nova.compute.manager [req-7f7492f9-1f05-4f2d-b1bb-4f58af44f8c7 req-6cdef93e-a7d0-4780-bbe7-f44557c5fdec service nova] [instance: e4ada2d7-7ace-4ed4-86a6-ed121c95e80f] No waiting events found dispatching network-vif-unplugged-ac94464f-32dc-4cd1-a270-ec8934e77c21 {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:23:19 user nova-compute[71731]: DEBUG nova.compute.manager [req-7f7492f9-1f05-4f2d-b1bb-4f58af44f8c7 req-6cdef93e-a7d0-4780-bbe7-f44557c5fdec service nova] [instance: e4ada2d7-7ace-4ed4-86a6-ed121c95e80f] Received event network-vif-unplugged-ac94464f-32dc-4cd1-a270-ec8934e77c21 for instance with task_state deleting. {{(pid=71731) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 16:23:19 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:23:19 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:23:19 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:23:19 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:23:19 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:23:19 user nova-compute[71731]: DEBUG nova.compute.manager [req-9c292206-e760-4ae3-b88a-c4aaa01ad318 req-8af19971-1957-406d-9990-daa8d60d9eec service nova] [instance: e4ada2d7-7ace-4ed4-86a6-ed121c95e80f] Received event network-vif-unplugged-8f3a3011-e474-4538-812b-9df3968fd629 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:23:19 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-9c292206-e760-4ae3-b88a-c4aaa01ad318 req-8af19971-1957-406d-9990-daa8d60d9eec service nova] Acquiring lock "e4ada2d7-7ace-4ed4-86a6-ed121c95e80f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:23:19 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-9c292206-e760-4ae3-b88a-c4aaa01ad318 req-8af19971-1957-406d-9990-daa8d60d9eec service nova] Lock "e4ada2d7-7ace-4ed4-86a6-ed121c95e80f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:23:19 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-9c292206-e760-4ae3-b88a-c4aaa01ad318 req-8af19971-1957-406d-9990-daa8d60d9eec service nova] Lock "e4ada2d7-7ace-4ed4-86a6-ed121c95e80f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:23:19 user nova-compute[71731]: DEBUG nova.compute.manager [req-9c292206-e760-4ae3-b88a-c4aaa01ad318 req-8af19971-1957-406d-9990-daa8d60d9eec service nova] [instance: e4ada2d7-7ace-4ed4-86a6-ed121c95e80f] No waiting events found dispatching network-vif-unplugged-8f3a3011-e474-4538-812b-9df3968fd629 {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:23:19 user nova-compute[71731]: DEBUG nova.compute.manager [req-9c292206-e760-4ae3-b88a-c4aaa01ad318 req-8af19971-1957-406d-9990-daa8d60d9eec service nova] [instance: e4ada2d7-7ace-4ed4-86a6-ed121c95e80f] Received event network-vif-unplugged-8f3a3011-e474-4538-812b-9df3968fd629 for instance with task_state deleting. {{(pid=71731) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 16:23:19 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:23:19 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-cfbbaf71-6557-432f-a527-7937d6bc5423 tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] Acquiring lock "8c6d8096-853b-4091-ad82-6faf8ffc85fa" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:23:19 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-cfbbaf71-6557-432f-a527-7937d6bc5423 tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] Lock "8c6d8096-853b-4091-ad82-6faf8ffc85fa" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:23:19 user nova-compute[71731]: INFO nova.compute.manager [None req-cfbbaf71-6557-432f-a527-7937d6bc5423 tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] [instance: 8c6d8096-853b-4091-ad82-6faf8ffc85fa] Detaching volume 62e7747a-651a-4d0a-a763-bfce9c4a3cff
Apr 13 16:23:19 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:23:19 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:23:19 user nova-compute[71731]: INFO nova.virt.block_device [None req-cfbbaf71-6557-432f-a527-7937d6bc5423 tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] [instance: 8c6d8096-853b-4091-ad82-6faf8ffc85fa] Attempting to driver detach volume 62e7747a-651a-4d0a-a763-bfce9c4a3cff from mountpoint /dev/vdb
Apr 13 16:23:19 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:23:19 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-cfbbaf71-6557-432f-a527-7937d6bc5423 tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] Attempting to detach device vdb from instance 8c6d8096-853b-4091-ad82-6faf8ffc85fa from the persistent domain config. {{(pid=71731) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 13 16:23:19 user nova-compute[71731]: DEBUG nova.virt.libvirt.guest [None req-cfbbaf71-6557-432f-a527-7937d6bc5423 tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 16:23:19 user nova-compute[71731]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 16:23:19 user nova-compute[71731]:   <source dev="/dev/sdi"/>
Apr 13 16:23:19 user nova-compute[71731]:   <target dev="vdb" bus="virtio"/>
Apr 13 16:23:19 user nova-compute[71731]:   <serial>62e7747a-651a-4d0a-a763-bfce9c4a3cff</serial>
Apr 13 16:23:19 user nova-compute[71731]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 13 16:23:19 user nova-compute[71731]: </disk>
Apr 13 16:23:19 user nova-compute[71731]:  {{(pid=71731) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 16:23:19 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-cfbbaf71-6557-432f-a527-7937d6bc5423 tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] Successfully detached device vdb from instance 8c6d8096-853b-4091-ad82-6faf8ffc85fa from the persistent domain config.
Apr 13 16:23:19 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-cfbbaf71-6557-432f-a527-7937d6bc5423 tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 8c6d8096-853b-4091-ad82-6faf8ffc85fa from the live domain config. {{(pid=71731) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 13 16:23:19 user nova-compute[71731]: DEBUG nova.virt.libvirt.guest [None req-cfbbaf71-6557-432f-a527-7937d6bc5423 tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 16:23:19 user nova-compute[71731]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 16:23:19 user nova-compute[71731]:   <source dev="/dev/sdi"/>
Apr 13 16:23:19 user nova-compute[71731]:   <target dev="vdb" bus="virtio"/>
Apr 13 16:23:19 user nova-compute[71731]:   <serial>62e7747a-651a-4d0a-a763-bfce9c4a3cff</serial>
Apr 13 16:23:19 user nova-compute[71731]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 13 16:23:19 user nova-compute[71731]: </disk>
Apr 13 16:23:19 user nova-compute[71731]:  {{(pid=71731) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 16:23:20 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:23:20 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:23:20 user nova-compute[71731]: DEBUG nova.network.neutron [None req-9e131767-04d4-45b2-8e12-2a4ab0daa556 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: 235f827c-7116-48e9-84c5-0c9761c18e1e] Updating instance_info_cache with network_info: [{"id": "b72a6c8b-7244-41c2-a4f7-6da43b4944b8", "address": "fa:16:3e:e3:62:b0", "network": {"id": "5a7877ff-8230-470b-90b5-e5dcfc8f0cee", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-779403873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2d09a74bf684a9fb1dd1e95d6c23f3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb72a6c8b-72", "ovs_interfaceid": "b72a6c8b-7244-41c2-a4f7-6da43b4944b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:23:20 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-9e131767-04d4-45b2-8e12-2a4ab0daa556 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Releasing lock "refresh_cache-235f827c-7116-48e9-84c5-0c9761c18e1e" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 16:23:20 user nova-compute[71731]: DEBUG nova.compute.manager [None req-9e131767-04d4-45b2-8e12-2a4ab0daa556 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: 235f827c-7116-48e9-84c5-0c9761c18e1e] Instance network_info: |[{"id": "b72a6c8b-7244-41c2-a4f7-6da43b4944b8", "address": "fa:16:3e:e3:62:b0", "network": {"id": "5a7877ff-8230-470b-90b5-e5dcfc8f0cee", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-779403873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2d09a74bf684a9fb1dd1e95d6c23f3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb72a6c8b-72", "ovs_interfaceid": "b72a6c8b-7244-41c2-a4f7-6da43b4944b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71731) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 16:23:20 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-a0c7e314-7ea4-4d74-b53e-6bfc70abc808 req-6db9cb28-fc39-4943-b8c0-fa3b6ad46371 service nova] Acquired lock "refresh_cache-235f827c-7116-48e9-84c5-0c9761c18e1e" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 16:23:20 user nova-compute[71731]: DEBUG nova.network.neutron [req-a0c7e314-7ea4-4d74-b53e-6bfc70abc808 req-6db9cb28-fc39-4943-b8c0-fa3b6ad46371 service nova] [instance: 235f827c-7116-48e9-84c5-0c9761c18e1e] Refreshing network info cache for port b72a6c8b-7244-41c2-a4f7-6da43b4944b8 {{(pid=71731) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 16:23:20 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:23:20 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:23:20 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:23:20 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Received event <DeviceRemovedEvent: 1681403000.5747123, 8c6d8096-853b-4091-ad82-6faf8ffc85fa => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71731) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 13 16:23:20 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-cfbbaf71-6557-432f-a527-7937d6bc5423 tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 8c6d8096-853b-4091-ad82-6faf8ffc85fa {{(pid=71731) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 13 16:23:20 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-cfbbaf71-6557-432f-a527-7937d6bc5423 tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] Successfully detached device vdb from instance 8c6d8096-853b-4091-ad82-6faf8ffc85fa from the live domain config.
Apr 13 16:23:20 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:23:20 user nova-compute[71731]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cfbbaf71-6557-432f-a527-7937d6bc5423 tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] [instance: 8c6d8096-853b-4091-ad82-6faf8ffc85fa] calling os-brick to detach iSCSI Volume {{(pid=71731) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 16:23:20 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfbbaf71-6557-432f-a527-7937d6bc5423 tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8cf0118790>, {'target_iqn': 'iqn.2010-10.org.openstack:62e7747a-651a-4d0a-a763-bfce9c4a3cff', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EHjgiLQq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi', 'volume_id': '62e7747a-651a-4d0a-a763-bfce9c4a3cff': {}}" {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 16:23:20 user nova-compute[71731]: WARNING os_brick.initiator.connectors.base [None req-cfbbaf71-6557-432f-a527-7937d6bc5423 tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 16:23:20 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-cfbbaf71-6557-432f-a527-7937d6bc5423 tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 16:23:20 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-cfbbaf71-6557-432f-a527-7937d6bc5423 tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 16:23:20 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:23:20 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.031s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:23:20 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[c684608b-2ee1-4653-bd3b-8bbeda032211]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:62e7747a-651a-4d0a-a763-bfce9c4a3cff\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c20e80fa-58de-431a-8901-2535657aaadf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:27919afc-8990-4ed5-af9e-9d6b3d7b231e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0e3b49ec-80af-4c38-9689-f7277e495d21\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cc639d00-ef6b-4121-bcb0-c65ec0347abd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e0f728f3-fbb5-4ed8-a78b-a5d982b03f7d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:84c7f6ad-d2c2-465a-b39e-47347aa85be0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:48af37b0-6938-432e-b374-d992c4dd9ae9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:23:20 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfbbaf71-6557-432f-a527-7937d6bc5423 tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 16:23:20 user nova-compute[71731]: No targets found.
Apr 13 16:23:20 user nova-compute[71731]: iSNS:
Apr 13 16:23:20 user nova-compute[71731]: No targets found.
Apr 13 16:23:20 user nova-compute[71731]: STATIC:
Apr 13 16:23:20 user nova-compute[71731]: Target: iqn.2010-10.org.openstack:62e7747a-651a-4d0a-a763-bfce9c4a3cff
Apr 13 16:23:20 user nova-compute[71731]:         Portal: 172.16.0.220:3260,-1
Apr 13 16:23:20 user nova-compute[71731]:                 Iface Name: default
Apr 13 16:23:20 user nova-compute[71731]: Target: iqn.2010-10.org.openstack:c20e80fa-58de-431a-8901-2535657aaadf
Apr 13 16:23:20 user nova-compute[71731]:         Portal: 172.16.0.220:3260,-1
Apr 13 16:23:20 user nova-compute[71731]:                 Iface Name: default
Apr 13 16:23:20 user nova-compute[71731]: Target: iqn.2010-10.org.openstack:27919afc-8990-4ed5-af9e-9d6b3d7b231e
Apr 13 16:23:20 user nova-compute[71731]:         Portal: 172.16.0.220:3260,-1
Apr 13 16:23:20 user nova-compute[71731]:                 Iface Name: default
Apr 13 16:23:20 user nova-compute[71731]: Target: iqn.2010-10.org.openstack:0e3b49ec-80af-4c38-9689-f7277e495d21
Apr 13 16:23:20 user nova-compute[71731]:         Portal: 172.16.0.220:3260,-1
Apr 13 16:23:20 user nova-compute[71731]:                 Iface Name: default
Apr 13 16:23:20 user nova-compute[71731]: Target: iqn.2010-10.org.openstack:cc639d00-ef6b-4121-bcb0-c65ec0347abd
Apr 13 16:23:20 user nova-compute[71731]:         Portal: 172.16.0.220:3260,-1
Apr 13 16:23:20 user nova-compute[71731]:                 Iface Name: default
Apr 13 16:23:20 user nova-compute[71731]: Target: iqn.2010-10.org.openstack:e0f728f3-fbb5-4ed8-a78b-a5d982b03f7d
Apr 13 16:23:20 user nova-compute[71731]:         Portal: 172.16.0.220:3260,-1
Apr 13 16:23:20 user nova-compute[71731]:                 Iface Name: default
Apr 13 16:23:20 user nova-compute[71731]: Target: iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984
Apr 13 16:23:20 user nova-compute[71731]:         Portal: 172.16.0.220:3260,-1
Apr 13 16:23:20 user nova-compute[71731]:                 Iface Name: default
Apr 13 16:23:20 user nova-compute[71731]: Target: iqn.2010-10.org.openstack:84c7f6ad-d2c2-465a-b39e-47347aa85be0
Apr 13 16:23:20 user nova-compute[71731]:         Portal: 172.16.0.220:3260,-1
Apr 13 16:23:20 user nova-compute[71731]:                 Iface Name: default
Apr 13 16:23:20 user nova-compute[71731]: Target: iqn.2010-10.org.openstack:48af37b0-6938-432e-b374-d992c4dd9ae9
Apr 13 16:23:20 user nova-compute[71731]:         Portal: 172.16.0.220:3260,-1
Apr 13 16:23:20 user nova-compute[71731]:                 Iface Name: default
Apr 13 16:23:20 user nova-compute[71731]: FIRMWARE:
Apr 13 16:23:20 user nova-compute[71731]: No targets found.
Apr 13 16:23:20 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 16:23:20 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfbbaf71-6557-432f-a527-7937d6bc5423 tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 16:23:20 user nova-compute[71731]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 16:23:20 user nova-compute[71731]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71731) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 16:23:20 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfbbaf71-6557-432f-a527-7937d6bc5423 tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:62e7747a-651a-4d0a-a763-bfce9c4a3cff', 0)] {{(pid=71731) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 16:23:20 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:23:20 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:23:20 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[0af2a1ae-953c-40f5-ab2b-4ba06359d41e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0e3b49ec-80af-4c38-9689-f7277e495d21\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:27919afc-8990-4ed5-af9e-9d6b3d7b231e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:48af37b0-6938-432e-b374-d992c4dd9ae9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:62e7747a-651a-4d0a-a763-bfce9c4a3cff\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:84c7f6ad-d2c2-465a-b39e-47347aa85be0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c20e80fa-58de-431a-8901-2535657aaadf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cc639d00-ef6b-4121-bcb0-c65ec0347abd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e0f728f3-fbb5-4ed8-a78b-a5d982b03f7d\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:23:20 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:23:20 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:23:20 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[5135a0e1-1212-4bc7-bbcf-389577d3197d]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e3b49ec-80af-4c38-9689-f7277e495d21 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62e7747a-651a-4d0a-a763-bfce9c4a3cff (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c7f6ad-d2c2-465a-b39e-47347aa85be0 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48af37b0-6938-432e-b374-d992c4dd9ae9 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c20e80fa-58de-431a-8901-2535657aaadf (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27919afc-8990-4ed5-af9e-9d6b3d7b231e (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc639d00-ef6b-4121-bcb0-c65ec0347abd (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0f728f3-fbb5-4ed8-a78b-a5d982b03f7d (non-flash)\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:23:20 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfbbaf71-6557-432f-a527-7937d6bc5423 tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e3b49ec-80af-4c38-9689-f7277e495d21 (non-flash)
Apr 13 16:23:20 user nova-compute[71731]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62e7747a-651a-4d0a-a763-bfce9c4a3cff (non-flash)
Apr 13 16:23:20 user nova-compute[71731]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984 (non-flash)
Apr 13 16:23:20 user nova-compute[71731]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c7f6ad-d2c2-465a-b39e-47347aa85be0 (non-flash)
Apr 13 16:23:20 user nova-compute[71731]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48af37b0-6938-432e-b374-d992c4dd9ae9 (non-flash)
Apr 13 16:23:20 user nova-compute[71731]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c20e80fa-58de-431a-8901-2535657aaadf (non-flash)
Apr 13 16:23:20 user nova-compute[71731]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27919afc-8990-4ed5-af9e-9d6b3d7b231e (non-flash)
Apr 13 16:23:20 user nova-compute[71731]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc639d00-ef6b-4121-bcb0-c65ec0347abd (non-flash)
Apr 13 16:23:20 user nova-compute[71731]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0f728f3-fbb5-4ed8-a78b-a5d982b03f7d (non-flash)
Apr 13 16:23:20 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 16:23:20 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfbbaf71-6557-432f-a527-7937d6bc5423 tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e3b49ec-80af-4c38-9689-f7277e495d21 (non-flash)
Apr 13 16:23:20 user nova-compute[71731]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62e7747a-651a-4d0a-a763-bfce9c4a3cff (non-flash)
Apr 13 16:23:20 user nova-compute[71731]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984 (non-flash)
Apr 13 16:23:20 user nova-compute[71731]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c7f6ad-d2c2-465a-b39e-47347aa85be0 (non-flash)
Apr 13 16:23:20 user nova-compute[71731]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48af37b0-6938-432e-b374-d992c4dd9ae9 (non-flash)
Apr 13 16:23:20 user nova-compute[71731]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c20e80fa-58de-431a-8901-2535657aaadf (non-flash)
Apr 13 16:23:20 user nova-compute[71731]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27919afc-8990-4ed5-af9e-9d6b3d7b231e (non-flash)
Apr 13 16:23:20 user nova-compute[71731]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc639d00-ef6b-4121-bcb0-c65ec0347abd (non-flash)
Apr 13 16:23:20 user nova-compute[71731]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0f728f3-fbb5-4ed8-a78b-a5d982b03f7d (non-flash)
Apr 13 16:23:20 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 16:23:20 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfbbaf71-6557-432f-a527-7937d6bc5423 tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8cf3f7bc70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:62e7747a-651a-4d0a-a763-bfce9c4a3cff'): ({'sdi'}, set())}) {{(pid=71731) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 16:23:20 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-cfbbaf71-6557-432f-a527-7937d6bc5423 tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] Removing single pathed devices sdi {{(pid=71731) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 16:23:20 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:23:20 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:23:20 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[7245af88-da38-44a1-a170-ad7cb147cb97]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:23:20 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:23:20 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:23:20 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:23:20 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.025s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:23:20 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[39d459a5-e701-4ee8-abd9-8121e4ad1d68]: (4, ('ok\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:23:20 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-cfbbaf71-6557-432f-a527-7937d6bc5423 tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] Flushing IO for device /dev/sdi {{(pid=71731) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 16:23:20 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:23:20 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.013s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:23:20 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[a574edf2-657d-490d-9d4b-00badefd15b1]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:23:20 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-cfbbaf71-6557-432f-a527-7937d6bc5423 tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=71731) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 16:23:20 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:23:20 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.049s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:23:20 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[37998685-ed9a-4413-bc53-4fbc4d87b098]: (4, ('1', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:23:20 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-cfbbaf71-6557-432f-a527-7937d6bc5423 tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=71731) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 16:23:20 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-cfbbaf71-6557-432f-a527-7937d6bc5423 tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] SCSI volumes sdi have been removed. {{(pid=71731) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 16:23:20 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfbbaf71-6557-432f-a527-7937d6bc5423 tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:62e7747a-651a-4d0a-a763-bfce9c4a3cff')] {{(pid=71731) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 16:23:20 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62e7747a-651a-4d0a-a763-bfce9c4a3cff -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:23:20 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62e7747a-651a-4d0a-a763-bfce9c4a3cff -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:23:20 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c752ef3-0d09-493c-ae31-f944ffdd82f5]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:23:20 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfbbaf71-6557-432f-a527-7937d6bc5423 tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:23:20 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62e7747a-651a-4d0a-a763-bfce9c4a3cff -p 172.16.0.220:3260 --logout {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:23:20 user nova-compute[71731]: INFO nova.virt.libvirt.driver [-] [instance: e4ada2d7-7ace-4ed4-86a6-ed121c95e80f] Instance destroyed successfully.
Apr 13 16:23:20 user nova-compute[71731]: DEBUG nova.objects.instance [None req-dbf47c70-b17d-428f-97f0-d7601655d4d4 tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Lazy-loading 'resources' on Instance uuid e4ada2d7-7ace-4ed4-86a6-ed121c95e80f {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:23:20 user nova-compute[71731]: DEBUG nova.virt.libvirt.vif [None req-dbf47c70-b17d-428f-97f0-d7601655d4d4 tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T16:21:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-425684793',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-425684793',id=8,image_ref='708622a9-7465-4492-ade8-b827198f7e30',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI5YQpLaGCSGL4ntWt11BFFgnGrQ3fItNIdB138VboyJqclL9H8Ulyx/xxT8IGEQfueXv2SL9+Q3QwgV/gEuhZSJPXCS54honN2kOhqtEWQCcit240y/RW04xC4ADo4EdQ==',key_name='tempest-keypair-135831071',keypairs=<?>,launch_index=0,launched_at=2023-04-13T16:22:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7649e366b0164e2fa5b3faa0830b6ea6',ramdisk_id='',reservation_id='r-newglzq9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='708622a9-7465-4492-ade8-b827198f7e30',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1193811043',owner_user_name='tempest-TaggedBootDevicesTest_v242-1193811043-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T16:22:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7e50bd9d540549a194f706dac48ce93d',uuid=e4ada2d7-7ace-4ed4-86a6-ed121c95e80f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a409f60c-6c6a-49f8-8520-04614e804002", "address": "fa:16:3e:ee:b5:cc", "network": {"id": "06e8519d-91e2-4c6a-8b74-6f55609e1764", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-420310439-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7649e366b0164e2fa5b3faa0830b6ea6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa409f60c-6c", "ovs_interfaceid": "a409f60c-6c6a-49f8-8520-04614e804002", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 16:23:20 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-dbf47c70-b17d-428f-97f0-d7601655d4d4 tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Converting VIF {"id": "a409f60c-6c6a-49f8-8520-04614e804002", "address": "fa:16:3e:ee:b5:cc", "network": {"id": "06e8519d-91e2-4c6a-8b74-6f55609e1764", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-420310439-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7649e366b0164e2fa5b3faa0830b6ea6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa409f60c-6c", "ovs_interfaceid": "a409f60c-6c6a-49f8-8520-04614e804002", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 16:23:20 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-dbf47c70-b17d-428f-97f0-d7601655d4d4 tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ee:b5:cc,bridge_name='br-int',has_traffic_filtering=True,id=a409f60c-6c6a-49f8-8520-04614e804002,network=Network(06e8519d-91e2-4c6a-8b74-6f55609e1764),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa409f60c-6c') {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 16:23:20 user nova-compute[71731]: DEBUG os_vif [None req-dbf47c70-b17d-428f-97f0-d7601655d4d4 tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ee:b5:cc,bridge_name='br-int',has_traffic_filtering=True,id=a409f60c-6c6a-49f8-8520-04614e804002,network=Network(06e8519d-91e2-4c6a-8b74-6f55609e1764),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa409f60c-6c') {{(pid=71731) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 16:23:20 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:23:20 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa409f60c-6c, bridge=br-int, if_exists=True) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:23:20 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:23:20 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 16:23:20 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62e7747a-651a-4d0a-a763-bfce9c4a3cff -p 172.16.0.220:3260 --logout" returned: 0 in 0.121s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:23:20 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[587b195b-dd73-48a6-8a66-a2592e6a5f24]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:62e7747a-651a-4d0a-a763-bfce9c4a3cff, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:62e7747a-651a-4d0a-a763-bfce9c4a3cff, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:23:20 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfbbaf71-6557-432f-a527-7937d6bc5423 tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:62e7747a-651a-4d0a-a763-bfce9c4a3cff, portal: 172.16.0.220,3260]
Apr 13 16:23:20 user nova-compute[71731]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:62e7747a-651a-4d0a-a763-bfce9c4a3cff, portal: 172.16.0.220,3260] successful.
Apr 13 16:23:20 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:23:20 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62e7747a-651a-4d0a-a763-bfce9c4a3cff -p 172.16.0.220:3260 --op delete {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:23:21 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62e7747a-651a-4d0a-a763-bfce9c4a3cff -p 172.16.0.220:3260 --op delete" returned: 0 in 0.042s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:23:21 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[bec26ae8-a7cd-4d64-bc61-ed7a72152a09]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:23:21 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfbbaf71-6557-432f-a527-7937d6bc5423 tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:23:21 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-cfbbaf71-6557-432f-a527-7937d6bc5423 tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.435s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 16:23:21 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfbbaf71-6557-432f-a527-7937d6bc5423 tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] <== disconnect_volume: return (438ms) None {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 16:23:21 user nova-compute[71731]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cfbbaf71-6557-432f-a527-7937d6bc5423 tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] [instance: 8c6d8096-853b-4091-ad82-6faf8ffc85fa] Disconnected iSCSI Volume {{(pid=71731) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 16:23:21 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:23:21 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:23:21 user nova-compute[71731]: INFO os_vif [None req-dbf47c70-b17d-428f-97f0-d7601655d4d4 tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ee:b5:cc,bridge_name='br-int',has_traffic_filtering=True,id=a409f60c-6c6a-49f8-8520-04614e804002,network=Network(06e8519d-91e2-4c6a-8b74-6f55609e1764),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa409f60c-6c')
Apr 13 16:23:21 user nova-compute[71731]: DEBUG nova.virt.libvirt.vif [None req-dbf47c70-b17d-428f-97f0-d7601655d4d4 tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T16:21:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-425684793',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-425684793',id=8,image_ref='708622a9-7465-4492-ade8-b827198f7e30',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI5YQpLaGCSGL4ntWt11BFFgnGrQ3fItNIdB138VboyJqclL9H8Ulyx/xxT8IGEQfueXv2SL9+Q3QwgV/gEuhZSJPXCS54honN2kOhqtEWQCcit240y/RW04xC4ADo4EdQ==',key_name='tempest-keypair-135831071',keypairs=<?>,launch_index=0,launched_at=2023-04-13T16:22:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7649e366b0164e2fa5b3faa0830b6ea6',ramdisk_id='',reservation_id='r-newglzq9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='708622a9-7465-4492-ade8-b827198f7e30',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1193811043',owner_user_name='tempest-TaggedBootDevicesTest_v242-1193811043-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T16:22:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7e50bd9d540549a194f706dac48ce93d',uuid=e4ada2d7-7ace-4ed4-86a6-ed121c95e80f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ac94464f-32dc-4cd1-a270-ec8934e77c21", "address": "fa:16:3e:5e:a2:3f", "network": {"id": "4b153def-aec7-4f9e-9604-f1e0afb247f3", "bridge": "br-int", "label": "tempest-device-tagging-net1-1029190313", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.127", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7649e366b0164e2fa5b3faa0830b6ea6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac94464f-32", "ovs_interfaceid": "ac94464f-32dc-4cd1-a270-ec8934e77c21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71731) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 16:23:21 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-dbf47c70-b17d-428f-97f0-d7601655d4d4 tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Converting VIF {"id": "ac94464f-32dc-4cd1-a270-ec8934e77c21", "address": "fa:16:3e:5e:a2:3f", "network": {"id": "4b153def-aec7-4f9e-9604-f1e0afb247f3", "bridge": "br-int", "label": "tempest-device-tagging-net1-1029190313", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.127", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7649e366b0164e2fa5b3faa0830b6ea6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac94464f-32", "ovs_interfaceid": "ac94464f-32dc-4cd1-a270-ec8934e77c21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 16:23:21 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-dbf47c70-b17d-428f-97f0-d7601655d4d4 tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5e:a2:3f,bridge_name='br-int',has_traffic_filtering=True,id=ac94464f-32dc-4cd1-a270-ec8934e77c21,network=Network(4b153def-aec7-4f9e-9604-f1e0afb247f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapac94464f-32') {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 16:23:21 user nova-compute[71731]: DEBUG os_vif [None req-dbf47c70-b17d-428f-97f0-d7601655d4d4 tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5e:a2:3f,bridge_name='br-int',has_traffic_filtering=True,id=ac94464f-32dc-4cd1-a270-ec8934e77c21,network=Network(4b153def-aec7-4f9e-9604-f1e0afb247f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapac94464f-32') {{(pid=71731) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 16:23:21 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:23:21 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapac94464f-32, bridge=br-int, if_exists=True) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:23:21 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:23:21 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 16:23:21 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:23:21 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:23:21 user nova-compute[71731]: INFO nova.virt.libvirt.driver [-] [instance: 2549ba85-4e0a-420e-b711-07cafa8c60e9] Instance destroyed successfully.
Apr 13 16:23:21 user nova-compute[71731]: DEBUG nova.objects.instance [None req-48b63815-ac65-4477-a276-ce12f90a7768 tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Lazy-loading 'resources' on Instance uuid 2549ba85-4e0a-420e-b711-07cafa8c60e9 {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:23:21 user nova-compute[71731]: DEBUG nova.virt.libvirt.vif [None req-48b63815-ac65-4477-a276-ce12f90a7768 tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T16:21:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1688495933',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1688495933',id=9,image_ref='708622a9-7465-4492-ade8-b827198f7e30',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCmDAWwVmv7Q34Pz29t07av6aMRdzm3EgCQrfLBn83RkLO81Y7UjJ2zO/1nlrHzXzESZuCtlZxhzD9V6rEN/0ixQxrUu0ZuX2RNLf7aGDMjaY4XAH+0pTu29dKUMlHtNng==',key_name='tempest-keypair-756136845',keypairs=<?>,launch_index=0,launched_at=2023-04-13T16:22:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bbe4e9fb786d4015b035b4d00f75a1ba',ramdisk_id='',reservation_id='r-ulxepirk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='708622a9-7465-4492-ade8-b827198f7e30',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1779812468',owner_user_name='tempest-TaggedBootDevicesTest-1779812468-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T16:22:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='14566b85d0424c08999726ff72a67634',uuid=2549ba85-4e0a-420e-b711-07cafa8c60e9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "36152688-366c-40a2-8bf9-88f69925594a", "address": "fa:16:3e:1c:8b:59", "network": {"id": "f11266a1-4740-4cb3-8467-e0e95870ac22", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-689537131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbe4e9fb786d4015b035b4d00f75a1ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36152688-36", "ovs_interfaceid": "36152688-366c-40a2-8bf9-88f69925594a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 16:23:21 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-48b63815-ac65-4477-a276-ce12f90a7768 tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Converting VIF {"id": "36152688-366c-40a2-8bf9-88f69925594a", "address": "fa:16:3e:1c:8b:59", "network": {"id": "f11266a1-4740-4cb3-8467-e0e95870ac22", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-689537131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbe4e9fb786d4015b035b4d00f75a1ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36152688-36", "ovs_interfaceid": "36152688-366c-40a2-8bf9-88f69925594a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 16:23:21 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-48b63815-ac65-4477-a276-ce12f90a7768 tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1c:8b:59,bridge_name='br-int',has_traffic_filtering=True,id=36152688-366c-40a2-8bf9-88f69925594a,network=Network(f11266a1-4740-4cb3-8467-e0e95870ac22),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36152688-36') {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 16:23:21 user nova-compute[71731]: DEBUG os_vif [None req-48b63815-ac65-4477-a276-ce12f90a7768 tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1c:8b:59,bridge_name='br-int',has_traffic_filtering=True,id=36152688-366c-40a2-8bf9-88f69925594a,network=Network(f11266a1-4740-4cb3-8467-e0e95870ac22),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36152688-36') {{(pid=71731) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 16:23:21 user nova-compute[71731]: DEBUG nova.compute.manager [req-3d6e9cfb-7cee-4f6c-8ddd-341c5011adb4 req-705cf505-5ea9-445f-9b08-608afc7a82e0 service nova] [instance: e4ada2d7-7ace-4ed4-86a6-ed121c95e80f] Received event network-vif-unplugged-a409f60c-6c6a-49f8-8520-04614e804002 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:23:21 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-3d6e9cfb-7cee-4f6c-8ddd-341c5011adb4 req-705cf505-5ea9-445f-9b08-608afc7a82e0 service nova] Acquiring lock "e4ada2d7-7ace-4ed4-86a6-ed121c95e80f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:23:21 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-3d6e9cfb-7cee-4f6c-8ddd-341c5011adb4 req-705cf505-5ea9-445f-9b08-608afc7a82e0 service nova] Lock "e4ada2d7-7ace-4ed4-86a6-ed121c95e80f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:23:21 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-3d6e9cfb-7cee-4f6c-8ddd-341c5011adb4 req-705cf505-5ea9-445f-9b08-608afc7a82e0 service nova] Lock "e4ada2d7-7ace-4ed4-86a6-ed121c95e80f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:23:21 user nova-compute[71731]: DEBUG nova.compute.manager [req-3d6e9cfb-7cee-4f6c-8ddd-341c5011adb4 req-705cf505-5ea9-445f-9b08-608afc7a82e0 service nova] [instance: e4ada2d7-7ace-4ed4-86a6-ed121c95e80f] No waiting events found dispatching network-vif-unplugged-a409f60c-6c6a-49f8-8520-04614e804002 {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:23:21 user nova-compute[71731]: DEBUG nova.compute.manager [req-3d6e9cfb-7cee-4f6c-8ddd-341c5011adb4 req-705cf505-5ea9-445f-9b08-608afc7a82e0 service nova] [instance: e4ada2d7-7ace-4ed4-86a6-ed121c95e80f] Received event network-vif-unplugged-a409f60c-6c6a-49f8-8520-04614e804002 for instance with task_state deleting. {{(pid=71731) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 16:23:21 user nova-compute[71731]: DEBUG nova.compute.manager [req-3d6e9cfb-7cee-4f6c-8ddd-341c5011adb4 req-705cf505-5ea9-445f-9b08-608afc7a82e0 service nova] [instance: e4ada2d7-7ace-4ed4-86a6-ed121c95e80f] Received event network-vif-plugged-a409f60c-6c6a-49f8-8520-04614e804002 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:23:21 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-3d6e9cfb-7cee-4f6c-8ddd-341c5011adb4 req-705cf505-5ea9-445f-9b08-608afc7a82e0 service nova] Acquiring lock "e4ada2d7-7ace-4ed4-86a6-ed121c95e80f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:23:21 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-3d6e9cfb-7cee-4f6c-8ddd-341c5011adb4 req-705cf505-5ea9-445f-9b08-608afc7a82e0 service nova] Lock "e4ada2d7-7ace-4ed4-86a6-ed121c95e80f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:23:21 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-3d6e9cfb-7cee-4f6c-8ddd-341c5011adb4 req-705cf505-5ea9-445f-9b08-608afc7a82e0 service nova] Lock "e4ada2d7-7ace-4ed4-86a6-ed121c95e80f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:23:21 user nova-compute[71731]: DEBUG nova.compute.manager [req-3d6e9cfb-7cee-4f6c-8ddd-341c5011adb4 req-705cf505-5ea9-445f-9b08-608afc7a82e0 service nova] [instance: e4ada2d7-7ace-4ed4-86a6-ed121c95e80f] No waiting events found dispatching network-vif-plugged-a409f60c-6c6a-49f8-8520-04614e804002 {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:23:21 user nova-compute[71731]: WARNING nova.compute.manager [req-3d6e9cfb-7cee-4f6c-8ddd-341c5011adb4 req-705cf505-5ea9-445f-9b08-608afc7a82e0 service nova] [instance: e4ada2d7-7ace-4ed4-86a6-ed121c95e80f] Received unexpected event network-vif-plugged-a409f60c-6c6a-49f8-8520-04614e804002 for instance with vm_state active and task_state deleting.
Apr 13 16:23:21 user nova-compute[71731]: DEBUG nova.compute.manager [req-3d6e9cfb-7cee-4f6c-8ddd-341c5011adb4 req-705cf505-5ea9-445f-9b08-608afc7a82e0 service nova] [instance: e4ada2d7-7ace-4ed4-86a6-ed121c95e80f] Received event network-vif-unplugged-0125a8df-e91c-4d65-be74-fda2f2d93938 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:23:21 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-3d6e9cfb-7cee-4f6c-8ddd-341c5011adb4 req-705cf505-5ea9-445f-9b08-608afc7a82e0 service nova] Acquiring lock "e4ada2d7-7ace-4ed4-86a6-ed121c95e80f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:23:21 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-3d6e9cfb-7cee-4f6c-8ddd-341c5011adb4 req-705cf505-5ea9-445f-9b08-608afc7a82e0 service nova] Lock "e4ada2d7-7ace-4ed4-86a6-ed121c95e80f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:23:21 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-3d6e9cfb-7cee-4f6c-8ddd-341c5011adb4 req-705cf505-5ea9-445f-9b08-608afc7a82e0 service nova] Lock "e4ada2d7-7ace-4ed4-86a6-ed121c95e80f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:23:21 user nova-compute[71731]: DEBUG nova.compute.manager [req-3d6e9cfb-7cee-4f6c-8ddd-341c5011adb4 req-705cf505-5ea9-445f-9b08-608afc7a82e0 service nova] [instance: e4ada2d7-7ace-4ed4-86a6-ed121c95e80f] No waiting events found dispatching network-vif-unplugged-0125a8df-e91c-4d65-be74-fda2f2d93938 {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:23:21 user nova-compute[71731]: DEBUG nova.compute.manager [req-3d6e9cfb-7cee-4f6c-8ddd-341c5011adb4 req-705cf505-5ea9-445f-9b08-608afc7a82e0 service nova] [instance: e4ada2d7-7ace-4ed4-86a6-ed121c95e80f] Received event network-vif-unplugged-0125a8df-e91c-4d65-be74-fda2f2d93938 for instance with task_state deleting. {{(pid=71731) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 16:23:21 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:23:21 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:23:21 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap36152688-36, bridge=br-int, if_exists=True) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:23:21 user nova-compute[71731]: INFO os_vif [None req-dbf47c70-b17d-428f-97f0-d7601655d4d4 tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5e:a2:3f,bridge_name='br-int',has_traffic_filtering=True,id=ac94464f-32dc-4cd1-a270-ec8934e77c21,network=Network(4b153def-aec7-4f9e-9604-f1e0afb247f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapac94464f-32')
Apr 13 16:23:21 user nova-compute[71731]: DEBUG nova.virt.libvirt.vif [None req-dbf47c70-b17d-428f-97f0-d7601655d4d4 tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T16:21:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-425684793',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-425684793',id=8,image_ref='708622a9-7465-4492-ade8-b827198f7e30',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI5YQpLaGCSGL4ntWt11BFFgnGrQ3fItNIdB138VboyJqclL9H8Ulyx/xxT8IGEQfueXv2SL9+Q3QwgV/gEuhZSJPXCS54honN2kOhqtEWQCcit240y/RW04xC4ADo4EdQ==',key_name='tempest-keypair-135831071',keypairs=<?>,launch_index=0,launched_at=2023-04-13T16:22:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7649e366b0164e2fa5b3faa0830b6ea6',ramdisk_id='',reservation_id='r-newglzq9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='708622a9-7465-4492-ade8-b827198f7e30',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1193811043',owner_user_name='tempest-TaggedBootDevicesTest_v242-1193811043-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T16:22:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7e50bd9d540549a194f706dac48ce93d',uuid=e4ada2d7-7ace-4ed4-86a6-ed121c95e80f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0125a8df-e91c-4d65-be74-fda2f2d93938", "address": "fa:16:3e:39:06:fc", "network": {"id": "4b153def-aec7-4f9e-9604-f1e0afb247f3", "bridge": "br-int", "label": "tempest-device-tagging-net1-1029190313", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.61", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7649e366b0164e2fa5b3faa0830b6ea6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0125a8df-e9", "ovs_interfaceid": "0125a8df-e91c-4d65-be74-fda2f2d93938", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71731) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 16:23:21 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-dbf47c70-b17d-428f-97f0-d7601655d4d4 tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Converting VIF {"id": "0125a8df-e91c-4d65-be74-fda2f2d93938", "address": "fa:16:3e:39:06:fc", "network": {"id": "4b153def-aec7-4f9e-9604-f1e0afb247f3", "bridge": "br-int", "label": "tempest-device-tagging-net1-1029190313", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.61", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7649e366b0164e2fa5b3faa0830b6ea6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0125a8df-e9", "ovs_interfaceid": "0125a8df-e91c-4d65-be74-fda2f2d93938", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 16:23:21 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-dbf47c70-b17d-428f-97f0-d7601655d4d4 tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:39:06:fc,bridge_name='br-int',has_traffic_filtering=True,id=0125a8df-e91c-4d65-be74-fda2f2d93938,network=Network(4b153def-aec7-4f9e-9604-f1e0afb247f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap0125a8df-e9') {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 16:23:21 user nova-compute[71731]: DEBUG os_vif [None req-dbf47c70-b17d-428f-97f0-d7601655d4d4 tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:06:fc,bridge_name='br-int',has_traffic_filtering=True,id=0125a8df-e91c-4d65-be74-fda2f2d93938,network=Network(4b153def-aec7-4f9e-9604-f1e0afb247f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap0125a8df-e9') {{(pid=71731) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 16:23:21 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 16:23:21 user nova-compute[71731]: DEBUG nova.compute.manager [req-99d9d482-612d-4963-b567-a6df8f50a008 req-0bc37d2f-33d3-4686-90cf-3aef947ef043 service nova] [instance: e4ada2d7-7ace-4ed4-86a6-ed121c95e80f] Received event network-vif-plugged-ac94464f-32dc-4cd1-a270-ec8934e77c21 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:23:21 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-99d9d482-612d-4963-b567-a6df8f50a008 req-0bc37d2f-33d3-4686-90cf-3aef947ef043 service nova] Acquiring lock "e4ada2d7-7ace-4ed4-86a6-ed121c95e80f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:23:21 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-99d9d482-612d-4963-b567-a6df8f50a008 req-0bc37d2f-33d3-4686-90cf-3aef947ef043 service nova] Lock "e4ada2d7-7ace-4ed4-86a6-ed121c95e80f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:23:21 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-99d9d482-612d-4963-b567-a6df8f50a008 req-0bc37d2f-33d3-4686-90cf-3aef947ef043 service nova] Lock "e4ada2d7-7ace-4ed4-86a6-ed121c95e80f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:23:21 user nova-compute[71731]: DEBUG nova.compute.manager [req-99d9d482-612d-4963-b567-a6df8f50a008 req-0bc37d2f-33d3-4686-90cf-3aef947ef043 service nova] [instance: e4ada2d7-7ace-4ed4-86a6-ed121c95e80f] No waiting events found dispatching network-vif-plugged-ac94464f-32dc-4cd1-a270-ec8934e77c21 {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:23:21 user nova-compute[71731]: WARNING nova.compute.manager [req-99d9d482-612d-4963-b567-a6df8f50a008 req-0bc37d2f-33d3-4686-90cf-3aef947ef043 service nova] [instance: e4ada2d7-7ace-4ed4-86a6-ed121c95e80f] Received unexpected event network-vif-plugged-ac94464f-32dc-4cd1-a270-ec8934e77c21 for instance with vm_state active and task_state deleting.
Apr 13 16:23:21 user nova-compute[71731]: DEBUG nova.compute.manager [req-99d9d482-612d-4963-b567-a6df8f50a008 req-0bc37d2f-33d3-4686-90cf-3aef947ef043 service nova] [instance: e4ada2d7-7ace-4ed4-86a6-ed121c95e80f] Received event network-vif-unplugged-2430beb8-b2e4-4493-bdc5-df6b4c1181c6 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:23:21 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-99d9d482-612d-4963-b567-a6df8f50a008 req-0bc37d2f-33d3-4686-90cf-3aef947ef043 service nova] Acquiring lock "e4ada2d7-7ace-4ed4-86a6-ed121c95e80f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:23:21 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-99d9d482-612d-4963-b567-a6df8f50a008 req-0bc37d2f-33d3-4686-90cf-3aef947ef043 service nova] Lock "e4ada2d7-7ace-4ed4-86a6-ed121c95e80f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:23:21 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-99d9d482-612d-4963-b567-a6df8f50a008 req-0bc37d2f-33d3-4686-90cf-3aef947ef043 service nova] Lock "e4ada2d7-7ace-4ed4-86a6-ed121c95e80f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:23:21 user nova-compute[71731]: DEBUG nova.compute.manager [req-99d9d482-612d-4963-b567-a6df8f50a008 req-0bc37d2f-33d3-4686-90cf-3aef947ef043 service nova] [instance: e4ada2d7-7ace-4ed4-86a6-ed121c95e80f] No waiting events found dispatching network-vif-unplugged-2430beb8-b2e4-4493-bdc5-df6b4c1181c6 {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:23:21 user nova-compute[71731]: DEBUG nova.compute.manager [req-99d9d482-612d-4963-b567-a6df8f50a008 req-0bc37d2f-33d3-4686-90cf-3aef947ef043 service nova] [instance: e4ada2d7-7ace-4ed4-86a6-ed121c95e80f] Received event network-vif-unplugged-2430beb8-b2e4-4493-bdc5-df6b4c1181c6 for instance with task_state deleting. {{(pid=71731) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 16:23:21 user nova-compute[71731]: DEBUG nova.compute.manager [req-99d9d482-612d-4963-b567-a6df8f50a008 req-0bc37d2f-33d3-4686-90cf-3aef947ef043 service nova] [instance: e4ada2d7-7ace-4ed4-86a6-ed121c95e80f] Received event network-vif-plugged-2430beb8-b2e4-4493-bdc5-df6b4c1181c6 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:23:21 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-99d9d482-612d-4963-b567-a6df8f50a008 req-0bc37d2f-33d3-4686-90cf-3aef947ef043 service nova] Acquiring lock "e4ada2d7-7ace-4ed4-86a6-ed121c95e80f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:23:21 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-99d9d482-612d-4963-b567-a6df8f50a008 req-0bc37d2f-33d3-4686-90cf-3aef947ef043 service nova] Lock "e4ada2d7-7ace-4ed4-86a6-ed121c95e80f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:23:21 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-99d9d482-612d-4963-b567-a6df8f50a008 req-0bc37d2f-33d3-4686-90cf-3aef947ef043 service nova] Lock "e4ada2d7-7ace-4ed4-86a6-ed121c95e80f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:23:21 user nova-compute[71731]: DEBUG nova.compute.manager [req-99d9d482-612d-4963-b567-a6df8f50a008 req-0bc37d2f-33d3-4686-90cf-3aef947ef043 service nova] [instance: e4ada2d7-7ace-4ed4-86a6-ed121c95e80f] No waiting events found dispatching network-vif-plugged-2430beb8-b2e4-4493-bdc5-df6b4c1181c6 {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:23:21 user nova-compute[71731]: WARNING nova.compute.manager [req-99d9d482-612d-4963-b567-a6df8f50a008 req-0bc37d2f-33d3-4686-90cf-3aef947ef043 service nova] [instance: e4ada2d7-7ace-4ed4-86a6-ed121c95e80f] Received unexpected event network-vif-plugged-2430beb8-b2e4-4493-bdc5-df6b4c1181c6 for instance with vm_state active and task_state deleting.
Apr 13 16:23:21 user nova-compute[71731]: DEBUG nova.compute.manager [req-99d9d482-612d-4963-b567-a6df8f50a008 req-0bc37d2f-33d3-4686-90cf-3aef947ef043 service nova] [instance: e4ada2d7-7ace-4ed4-86a6-ed121c95e80f] Received event network-vif-unplugged-d41765b6-0d5b-43c1-bf58-a82a7bbe3137 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:23:21 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-99d9d482-612d-4963-b567-a6df8f50a008 req-0bc37d2f-33d3-4686-90cf-3aef947ef043 service nova] Acquiring lock "e4ada2d7-7ace-4ed4-86a6-ed121c95e80f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:23:21 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-99d9d482-612d-4963-b567-a6df8f50a008 req-0bc37d2f-33d3-4686-90cf-3aef947ef043 service nova] Lock "e4ada2d7-7ace-4ed4-86a6-ed121c95e80f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:23:21 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-99d9d482-612d-4963-b567-a6df8f50a008 req-0bc37d2f-33d3-4686-90cf-3aef947ef043 service nova] Lock "e4ada2d7-7ace-4ed4-86a6-ed121c95e80f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:23:21 user nova-compute[71731]: DEBUG nova.compute.manager [req-99d9d482-612d-4963-b567-a6df8f50a008 req-0bc37d2f-33d3-4686-90cf-3aef947ef043 service nova] [instance: e4ada2d7-7ace-4ed4-86a6-ed121c95e80f] No waiting events found dispatching network-vif-unplugged-d41765b6-0d5b-43c1-bf58-a82a7bbe3137 {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:23:21 user nova-compute[71731]: DEBUG nova.compute.manager [req-99d9d482-612d-4963-b567-a6df8f50a008 req-0bc37d2f-33d3-4686-90cf-3aef947ef043 service nova] [instance: e4ada2d7-7ace-4ed4-86a6-ed121c95e80f] Received event network-vif-unplugged-d41765b6-0d5b-43c1-bf58-a82a7bbe3137 for instance with task_state deleting. {{(pid=71731) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 16:23:21 user nova-compute[71731]: DEBUG nova.compute.manager [req-99d9d482-612d-4963-b567-a6df8f50a008 req-0bc37d2f-33d3-4686-90cf-3aef947ef043 service nova] [instance: e4ada2d7-7ace-4ed4-86a6-ed121c95e80f] Received event network-vif-plugged-d41765b6-0d5b-43c1-bf58-a82a7bbe3137 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:23:21 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-99d9d482-612d-4963-b567-a6df8f50a008 req-0bc37d2f-33d3-4686-90cf-3aef947ef043 service nova] Acquiring lock "e4ada2d7-7ace-4ed4-86a6-ed121c95e80f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:23:21 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-99d9d482-612d-4963-b567-a6df8f50a008 req-0bc37d2f-33d3-4686-90cf-3aef947ef043 service nova] Lock "e4ada2d7-7ace-4ed4-86a6-ed121c95e80f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:23:21 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-99d9d482-612d-4963-b567-a6df8f50a008 req-0bc37d2f-33d3-4686-90cf-3aef947ef043 service nova] Lock "e4ada2d7-7ace-4ed4-86a6-ed121c95e80f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:23:21 user nova-compute[71731]: DEBUG nova.compute.manager [req-99d9d482-612d-4963-b567-a6df8f50a008 req-0bc37d2f-33d3-4686-90cf-3aef947ef043 service nova] [instance: e4ada2d7-7ace-4ed4-86a6-ed121c95e80f] No waiting events found dispatching network-vif-plugged-d41765b6-0d5b-43c1-bf58-a82a7bbe3137 {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:23:21 user nova-compute[71731]: WARNING nova.compute.manager [req-99d9d482-612d-4963-b567-a6df8f50a008 req-0bc37d2f-33d3-4686-90cf-3aef947ef043 service nova] [instance: e4ada2d7-7ace-4ed4-86a6-ed121c95e80f] Received unexpected event network-vif-plugged-d41765b6-0d5b-43c1-bf58-a82a7bbe3137 for instance with vm_state active and task_state deleting.
Apr 13 16:23:21 user nova-compute[71731]: DEBUG nova.compute.manager [req-99d9d482-612d-4963-b567-a6df8f50a008 req-0bc37d2f-33d3-4686-90cf-3aef947ef043 service nova] [instance: 2549ba85-4e0a-420e-b711-07cafa8c60e9] Received event network-vif-unplugged-0fbdf291-df5d-41c5-a765-7145a87da272 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:23:21 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-99d9d482-612d-4963-b567-a6df8f50a008 req-0bc37d2f-33d3-4686-90cf-3aef947ef043 service nova] Acquiring lock "2549ba85-4e0a-420e-b711-07cafa8c60e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:23:21 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-99d9d482-612d-4963-b567-a6df8f50a008 req-0bc37d2f-33d3-4686-90cf-3aef947ef043 service nova] Lock "2549ba85-4e0a-420e-b711-07cafa8c60e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:23:21 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-99d9d482-612d-4963-b567-a6df8f50a008 req-0bc37d2f-33d3-4686-90cf-3aef947ef043 service nova] Lock "2549ba85-4e0a-420e-b711-07cafa8c60e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:23:21 user nova-compute[71731]: DEBUG nova.compute.manager [req-99d9d482-612d-4963-b567-a6df8f50a008 req-0bc37d2f-33d3-4686-90cf-3aef947ef043 service nova] [instance: 2549ba85-4e0a-420e-b711-07cafa8c60e9] No waiting events found dispatching network-vif-unplugged-0fbdf291-df5d-41c5-a765-7145a87da272 {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:23:21 user nova-compute[71731]: DEBUG nova.compute.manager [req-99d9d482-612d-4963-b567-a6df8f50a008 req-0bc37d2f-33d3-4686-90cf-3aef947ef043 service nova] [instance: 2549ba85-4e0a-420e-b711-07cafa8c60e9] Received event network-vif-unplugged-0fbdf291-df5d-41c5-a765-7145a87da272 for instance with task_state deleting. {{(pid=71731) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 16:23:21 user nova-compute[71731]: DEBUG nova.compute.manager [req-99d9d482-612d-4963-b567-a6df8f50a008 req-0bc37d2f-33d3-4686-90cf-3aef947ef043 service nova] [instance: 2549ba85-4e0a-420e-b711-07cafa8c60e9] Received event network-vif-plugged-0fbdf291-df5d-41c5-a765-7145a87da272 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:23:21 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-99d9d482-612d-4963-b567-a6df8f50a008 req-0bc37d2f-33d3-4686-90cf-3aef947ef043 service nova] Acquiring lock "2549ba85-4e0a-420e-b711-07cafa8c60e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:23:21 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-99d9d482-612d-4963-b567-a6df8f50a008 req-0bc37d2f-33d3-4686-90cf-3aef947ef043 service nova] Lock "2549ba85-4e0a-420e-b711-07cafa8c60e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:23:21 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-99d9d482-612d-4963-b567-a6df8f50a008 req-0bc37d2f-33d3-4686-90cf-3aef947ef043 service nova] Lock "2549ba85-4e0a-420e-b711-07cafa8c60e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:23:21 user nova-compute[71731]: DEBUG nova.compute.manager [req-99d9d482-612d-4963-b567-a6df8f50a008 req-0bc37d2f-33d3-4686-90cf-3aef947ef043 service nova] [instance: 2549ba85-4e0a-420e-b711-07cafa8c60e9] No waiting events found dispatching network-vif-plugged-0fbdf291-df5d-41c5-a765-7145a87da272 {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:23:21 user nova-compute[71731]: WARNING nova.compute.manager [req-99d9d482-612d-4963-b567-a6df8f50a008 req-0bc37d2f-33d3-4686-90cf-3aef947ef043 service nova] [instance: 2549ba85-4e0a-420e-b711-07cafa8c60e9] Received unexpected event network-vif-plugged-0fbdf291-df5d-41c5-a765-7145a87da272 for instance with vm_state active and task_state deleting.
Apr 13 16:23:21 user nova-compute[71731]: DEBUG nova.compute.manager [req-99d9d482-612d-4963-b567-a6df8f50a008 req-0bc37d2f-33d3-4686-90cf-3aef947ef043 service nova] [instance: 2549ba85-4e0a-420e-b711-07cafa8c60e9] Received event network-vif-unplugged-38e92b7c-b7c1-4137-a1db-21bc1d24f3ee {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:23:21 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-99d9d482-612d-4963-b567-a6df8f50a008 req-0bc37d2f-33d3-4686-90cf-3aef947ef043 service nova] Acquiring lock "2549ba85-4e0a-420e-b711-07cafa8c60e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:23:21 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-99d9d482-612d-4963-b567-a6df8f50a008 req-0bc37d2f-33d3-4686-90cf-3aef947ef043 service nova] Lock "2549ba85-4e0a-420e-b711-07cafa8c60e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:23:21 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-99d9d482-612d-4963-b567-a6df8f50a008 req-0bc37d2f-33d3-4686-90cf-3aef947ef043 service nova] Lock "2549ba85-4e0a-420e-b711-07cafa8c60e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:23:21 user nova-compute[71731]: DEBUG nova.compute.manager [req-99d9d482-612d-4963-b567-a6df8f50a008 req-0bc37d2f-33d3-4686-90cf-3aef947ef043 service nova] [instance: 2549ba85-4e0a-420e-b711-07cafa8c60e9] No waiting events found dispatching network-vif-unplugged-38e92b7c-b7c1-4137-a1db-21bc1d24f3ee {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:23:21 user nova-compute[71731]: DEBUG nova.compute.manager [req-99d9d482-612d-4963-b567-a6df8f50a008 req-0bc37d2f-33d3-4686-90cf-3aef947ef043 service nova] [instance: 2549ba85-4e0a-420e-b711-07cafa8c60e9] Received event network-vif-unplugged-38e92b7c-b7c1-4137-a1db-21bc1d24f3ee for instance with task_state deleting. {{(pid=71731) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 16:23:21 user nova-compute[71731]: DEBUG nova.compute.manager [req-99d9d482-612d-4963-b567-a6df8f50a008 req-0bc37d2f-33d3-4686-90cf-3aef947ef043 service nova] [instance: 2549ba85-4e0a-420e-b711-07cafa8c60e9] Received event network-vif-plugged-38e92b7c-b7c1-4137-a1db-21bc1d24f3ee {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:23:21 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-99d9d482-612d-4963-b567-a6df8f50a008 req-0bc37d2f-33d3-4686-90cf-3aef947ef043 service nova] Acquiring lock "2549ba85-4e0a-420e-b711-07cafa8c60e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:23:21 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-99d9d482-612d-4963-b567-a6df8f50a008 req-0bc37d2f-33d3-4686-90cf-3aef947ef043 service nova] Lock "2549ba85-4e0a-420e-b711-07cafa8c60e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:23:21 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-99d9d482-612d-4963-b567-a6df8f50a008 req-0bc37d2f-33d3-4686-90cf-3aef947ef043 service nova] Lock "2549ba85-4e0a-420e-b711-07cafa8c60e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:23:21 user nova-compute[71731]: DEBUG nova.compute.manager [req-99d9d482-612d-4963-b567-a6df8f50a008 req-0bc37d2f-33d3-4686-90cf-3aef947ef043 service nova] [instance: 2549ba85-4e0a-420e-b711-07cafa8c60e9] No waiting events found dispatching network-vif-plugged-38e92b7c-b7c1-4137-a1db-21bc1d24f3ee {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:23:21 user nova-compute[71731]: WARNING nova.compute.manager [req-99d9d482-612d-4963-b567-a6df8f50a008 req-0bc37d2f-33d3-4686-90cf-3aef947ef043 service nova] [instance: 2549ba85-4e0a-420e-b711-07cafa8c60e9] Received unexpected event network-vif-plugged-38e92b7c-b7c1-4137-a1db-21bc1d24f3ee for instance with vm_state active and task_state deleting.
Apr 13 16:23:21 user nova-compute[71731]: DEBUG nova.network.neutron [req-a0c7e314-7ea4-4d74-b53e-6bfc70abc808 req-6db9cb28-fc39-4943-b8c0-fa3b6ad46371 service nova] [instance: 235f827c-7116-48e9-84c5-0c9761c18e1e] Updated VIF entry in instance network info cache for port b72a6c8b-7244-41c2-a4f7-6da43b4944b8. {{(pid=71731) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 16:23:21 user nova-compute[71731]: DEBUG nova.network.neutron [req-a0c7e314-7ea4-4d74-b53e-6bfc70abc808 req-6db9cb28-fc39-4943-b8c0-fa3b6ad46371 service nova] [instance: 235f827c-7116-48e9-84c5-0c9761c18e1e] Updating instance_info_cache with network_info: [{"id": "b72a6c8b-7244-41c2-a4f7-6da43b4944b8", "address": "fa:16:3e:e3:62:b0", "network": {"id": "5a7877ff-8230-470b-90b5-e5dcfc8f0cee", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-779403873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2d09a74bf684a9fb1dd1e95d6c23f3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb72a6c8b-72", "ovs_interfaceid": "b72a6c8b-7244-41c2-a4f7-6da43b4944b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:23:21 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-a0c7e314-7ea4-4d74-b53e-6bfc70abc808 req-6db9cb28-fc39-4943-b8c0-fa3b6ad46371 service nova] Releasing lock "refresh_cache-235f827c-7116-48e9-84c5-0c9761c18e1e" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 16:23:21 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:23:21 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:23:21 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0125a8df-e9, bridge=br-int, if_exists=True) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:23:21 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:23:21 user nova-compute[71731]: INFO os_vif [None req-48b63815-ac65-4477-a276-ce12f90a7768 tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1c:8b:59,bridge_name='br-int',has_traffic_filtering=True,id=36152688-366c-40a2-8bf9-88f69925594a,network=Network(f11266a1-4740-4cb3-8467-e0e95870ac22),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36152688-36')
Apr 13 16:23:21 user nova-compute[71731]: DEBUG nova.virt.libvirt.vif [None req-48b63815-ac65-4477-a276-ce12f90a7768 tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T16:21:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1688495933',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1688495933',id=9,image_ref='708622a9-7465-4492-ade8-b827198f7e30',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCmDAWwVmv7Q34Pz29t07av6aMRdzm3EgCQrfLBn83RkLO81Y7UjJ2zO/1nlrHzXzESZuCtlZxhzD9V6rEN/0ixQxrUu0ZuX2RNLf7aGDMjaY4XAH+0pTu29dKUMlHtNng==',key_name='tempest-keypair-756136845',keypairs=<?>,launch_index=0,launched_at=2023-04-13T16:22:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bbe4e9fb786d4015b035b4d00f75a1ba',ramdisk_id='',reservation_id='r-ulxepirk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='708622a9-7465-4492-ade8-b827198f7e30',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1779812468',owner_user_name='tempest-TaggedBootDevicesTest-1779812468-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T16:22:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='14566b85d0424c08999726ff72a67634',uuid=2549ba85-4e0a-420e-b711-07cafa8c60e9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d7155dcf-9e83-4579-b81a-7277d4a9eeaf", "address": "fa:16:3e:d0:1a:bc", "network": {"id": "5d158a82-de85-48b5-9f17-40e61e9b0df8", "bridge": "br-int", "label": "tempest-device-tagging-net1-574676351", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.246", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bbe4e9fb786d4015b035b4d00f75a1ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7155dcf-9e", "ovs_interfaceid": "d7155dcf-9e83-4579-b81a-7277d4a9eeaf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71731) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 16:23:21 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-48b63815-ac65-4477-a276-ce12f90a7768 tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Converting VIF {"id": "d7155dcf-9e83-4579-b81a-7277d4a9eeaf", "address": "fa:16:3e:d0:1a:bc", "network": {"id": "5d158a82-de85-48b5-9f17-40e61e9b0df8", "bridge": "br-int", "label": "tempest-device-tagging-net1-574676351", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.246", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bbe4e9fb786d4015b035b4d00f75a1ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7155dcf-9e", "ovs_interfaceid": "d7155dcf-9e83-4579-b81a-7277d4a9eeaf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 16:23:21 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-48b63815-ac65-4477-a276-ce12f90a7768 tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d0:1a:bc,bridge_name='br-int',has_traffic_filtering=True,id=d7155dcf-9e83-4579-b81a-7277d4a9eeaf,network=Network(5d158a82-de85-48b5-9f17-40e61e9b0df8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd7155dcf-9e') {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 16:23:21 user nova-compute[71731]: DEBUG os_vif [None req-48b63815-ac65-4477-a276-ce12f90a7768 tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:1a:bc,bridge_name='br-int',has_traffic_filtering=True,id=d7155dcf-9e83-4579-b81a-7277d4a9eeaf,network=Network(5d158a82-de85-48b5-9f17-40e61e9b0df8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd7155dcf-9e') {{(pid=71731) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 16:23:21 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 16:23:21 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:23:21 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:23:21 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd7155dcf-9e, bridge=br-int, if_exists=True) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:23:21 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:23:21 user nova-compute[71731]: INFO os_vif [None req-dbf47c70-b17d-428f-97f0-d7601655d4d4 tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:06:fc,bridge_name='br-int',has_traffic_filtering=True,id=0125a8df-e91c-4d65-be74-fda2f2d93938,network=Network(4b153def-aec7-4f9e-9604-f1e0afb247f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap0125a8df-e9')
Apr 13 16:23:21 user nova-compute[71731]: DEBUG nova.virt.libvirt.vif [None req-dbf47c70-b17d-428f-97f0-d7601655d4d4 tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T16:21:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-425684793',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-425684793',id=8,image_ref='708622a9-7465-4492-ade8-b827198f7e30',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI5YQpLaGCSGL4ntWt11BFFgnGrQ3fItNIdB138VboyJqclL9H8Ulyx/xxT8IGEQfueXv2SL9+Q3QwgV/gEuhZSJPXCS54honN2kOhqtEWQCcit240y/RW04xC4ADo4EdQ==',key_name='tempest-keypair-135831071',keypairs=<?>,launch_index=0,launched_at=2023-04-13T16:22:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7649e366b0164e2fa5b3faa0830b6ea6',ramdisk_id='',reservation_id='r-newglzq9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='708622a9-7465-4492-ade8-b827198f7e30',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1193811043',owner_user_name='tempest-TaggedBootDevicesTest_v242-1193811043-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T16:22:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7e50bd9d540549a194f706dac48ce93d',uuid=e4ada2d7-7ace-4ed4-86a6-ed121c95e80f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8f3a3011-e474-4538-812b-9df3968fd629", "address": "fa:16:3e:78:12:fd", "network": {"id": "4b153def-aec7-4f9e-9604-f1e0afb247f3", "bridge": "br-int", "label": "tempest-device-tagging-net1-1029190313", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.202", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7649e366b0164e2fa5b3faa0830b6ea6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f3a3011-e4", "ovs_interfaceid": "8f3a3011-e474-4538-812b-9df3968fd629", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 16:23:21 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-dbf47c70-b17d-428f-97f0-d7601655d4d4 tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Converting VIF {"id": "8f3a3011-e474-4538-812b-9df3968fd629", "address": "fa:16:3e:78:12:fd", "network": {"id": "4b153def-aec7-4f9e-9604-f1e0afb247f3", "bridge": "br-int", "label": "tempest-device-tagging-net1-1029190313", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.202", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7649e366b0164e2fa5b3faa0830b6ea6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f3a3011-e4", "ovs_interfaceid": "8f3a3011-e474-4538-812b-9df3968fd629", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 16:23:21 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-dbf47c70-b17d-428f-97f0-d7601655d4d4 tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:78:12:fd,bridge_name='br-int',has_traffic_filtering=True,id=8f3a3011-e474-4538-812b-9df3968fd629,network=Network(4b153def-aec7-4f9e-9604-f1e0afb247f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f3a3011-e4') {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 16:23:21 user nova-compute[71731]: DEBUG os_vif [None req-dbf47c70-b17d-428f-97f0-d7601655d4d4 tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:78:12:fd,bridge_name='br-int',has_traffic_filtering=True,id=8f3a3011-e474-4538-812b-9df3968fd629,network=Network(4b153def-aec7-4f9e-9604-f1e0afb247f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f3a3011-e4') {{(pid=71731) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 16:23:21 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 16:23:21 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:23:21 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:23:21 user nova-compute[71731]: DEBUG nova.compute.manager [req-8375c23c-fcbe-4ba0-a6f5-f957cfb42a0d req-34e6fe1c-37e7-4aa3-b365-9a83c233565a service nova] [instance: e4ada2d7-7ace-4ed4-86a6-ed121c95e80f] Received event network-vif-plugged-8f3a3011-e474-4538-812b-9df3968fd629 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:23:21 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-8375c23c-fcbe-4ba0-a6f5-f957cfb42a0d req-34e6fe1c-37e7-4aa3-b365-9a83c233565a service nova] Acquiring lock "e4ada2d7-7ace-4ed4-86a6-ed121c95e80f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:23:21 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-8375c23c-fcbe-4ba0-a6f5-f957cfb42a0d req-34e6fe1c-37e7-4aa3-b365-9a83c233565a service nova] Lock "e4ada2d7-7ace-4ed4-86a6-ed121c95e80f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:23:21 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-8375c23c-fcbe-4ba0-a6f5-f957cfb42a0d req-34e6fe1c-37e7-4aa3-b365-9a83c233565a service nova] Lock "e4ada2d7-7ace-4ed4-86a6-ed121c95e80f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:23:21 user nova-compute[71731]: DEBUG nova.compute.manager [req-8375c23c-fcbe-4ba0-a6f5-f957cfb42a0d req-34e6fe1c-37e7-4aa3-b365-9a83c233565a service nova] [instance: e4ada2d7-7ace-4ed4-86a6-ed121c95e80f] No waiting events found dispatching network-vif-plugged-8f3a3011-e474-4538-812b-9df3968fd629 {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:23:21 user nova-compute[71731]: WARNING nova.compute.manager [req-8375c23c-fcbe-4ba0-a6f5-f957cfb42a0d req-34e6fe1c-37e7-4aa3-b365-9a83c233565a service nova] [instance: e4ada2d7-7ace-4ed4-86a6-ed121c95e80f] Received unexpected event network-vif-plugged-8f3a3011-e474-4538-812b-9df3968fd629 for instance with vm_state active and task_state deleting.
Apr 13 16:23:21 user nova-compute[71731]: DEBUG nova.compute.manager [req-8375c23c-fcbe-4ba0-a6f5-f957cfb42a0d req-34e6fe1c-37e7-4aa3-b365-9a83c233565a service nova] [instance: 2549ba85-4e0a-420e-b711-07cafa8c60e9] Received event network-vif-unplugged-36152688-366c-40a2-8bf9-88f69925594a {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:23:21 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-8375c23c-fcbe-4ba0-a6f5-f957cfb42a0d req-34e6fe1c-37e7-4aa3-b365-9a83c233565a service nova] Acquiring lock "2549ba85-4e0a-420e-b711-07cafa8c60e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:23:21 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-8375c23c-fcbe-4ba0-a6f5-f957cfb42a0d req-34e6fe1c-37e7-4aa3-b365-9a83c233565a service nova] Lock "2549ba85-4e0a-420e-b711-07cafa8c60e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:23:21 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-8375c23c-fcbe-4ba0-a6f5-f957cfb42a0d req-34e6fe1c-37e7-4aa3-b365-9a83c233565a service nova] Lock "2549ba85-4e0a-420e-b711-07cafa8c60e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:23:21 user nova-compute[71731]: DEBUG nova.compute.manager [req-8375c23c-fcbe-4ba0-a6f5-f957cfb42a0d req-34e6fe1c-37e7-4aa3-b365-9a83c233565a service nova] [instance: 2549ba85-4e0a-420e-b711-07cafa8c60e9] No waiting events found dispatching network-vif-unplugged-36152688-366c-40a2-8bf9-88f69925594a {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:23:21 user nova-compute[71731]: DEBUG nova.compute.manager [req-8375c23c-fcbe-4ba0-a6f5-f957cfb42a0d req-34e6fe1c-37e7-4aa3-b365-9a83c233565a service nova] [instance: 2549ba85-4e0a-420e-b711-07cafa8c60e9] Received event network-vif-unplugged-36152688-366c-40a2-8bf9-88f69925594a for instance with task_state deleting. {{(pid=71731) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 16:23:21 user nova-compute[71731]: DEBUG nova.compute.manager [req-8375c23c-fcbe-4ba0-a6f5-f957cfb42a0d req-34e6fe1c-37e7-4aa3-b365-9a83c233565a service nova] [instance: 2549ba85-4e0a-420e-b711-07cafa8c60e9] Received event network-vif-plugged-36152688-366c-40a2-8bf9-88f69925594a {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:23:21 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-8375c23c-fcbe-4ba0-a6f5-f957cfb42a0d req-34e6fe1c-37e7-4aa3-b365-9a83c233565a service nova] Acquiring lock "2549ba85-4e0a-420e-b711-07cafa8c60e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:23:21 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-8375c23c-fcbe-4ba0-a6f5-f957cfb42a0d req-34e6fe1c-37e7-4aa3-b365-9a83c233565a service nova] Lock "2549ba85-4e0a-420e-b711-07cafa8c60e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:23:21 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-8375c23c-fcbe-4ba0-a6f5-f957cfb42a0d req-34e6fe1c-37e7-4aa3-b365-9a83c233565a service nova] Lock "2549ba85-4e0a-420e-b711-07cafa8c60e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:23:21 user nova-compute[71731]: DEBUG nova.compute.manager [req-8375c23c-fcbe-4ba0-a6f5-f957cfb42a0d req-34e6fe1c-37e7-4aa3-b365-9a83c233565a service nova] [instance: 2549ba85-4e0a-420e-b711-07cafa8c60e9] No waiting events found dispatching network-vif-plugged-36152688-366c-40a2-8bf9-88f69925594a {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:23:21 user nova-compute[71731]: WARNING nova.compute.manager [req-8375c23c-fcbe-4ba0-a6f5-f957cfb42a0d req-34e6fe1c-37e7-4aa3-b365-9a83c233565a service nova] [instance: 2549ba85-4e0a-420e-b711-07cafa8c60e9] Received unexpected event network-vif-plugged-36152688-366c-40a2-8bf9-88f69925594a for instance with vm_state active and task_state deleting.
Apr 13 16:23:21 user nova-compute[71731]: DEBUG nova.compute.manager [req-8375c23c-fcbe-4ba0-a6f5-f957cfb42a0d req-34e6fe1c-37e7-4aa3-b365-9a83c233565a service nova] [instance: e4ada2d7-7ace-4ed4-86a6-ed121c95e80f] Received event network-vif-unplugged-15dca2c3-5048-4e80-8008-c19400ea34e4 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:23:21 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-8375c23c-fcbe-4ba0-a6f5-f957cfb42a0d req-34e6fe1c-37e7-4aa3-b365-9a83c233565a service nova] Acquiring lock "e4ada2d7-7ace-4ed4-86a6-ed121c95e80f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:23:21 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-8375c23c-fcbe-4ba0-a6f5-f957cfb42a0d req-34e6fe1c-37e7-4aa3-b365-9a83c233565a service nova] Lock "e4ada2d7-7ace-4ed4-86a6-ed121c95e80f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:23:21 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-8375c23c-fcbe-4ba0-a6f5-f957cfb42a0d req-34e6fe1c-37e7-4aa3-b365-9a83c233565a service nova] Lock "e4ada2d7-7ace-4ed4-86a6-ed121c95e80f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:23:21 user nova-compute[71731]: DEBUG nova.compute.manager [req-8375c23c-fcbe-4ba0-a6f5-f957cfb42a0d req-34e6fe1c-37e7-4aa3-b365-9a83c233565a service nova] [instance: e4ada2d7-7ace-4ed4-86a6-ed121c95e80f] No waiting events found dispatching network-vif-unplugged-15dca2c3-5048-4e80-8008-c19400ea34e4 {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:23:21 user nova-compute[71731]: DEBUG nova.compute.manager [req-8375c23c-fcbe-4ba0-a6f5-f957cfb42a0d req-34e6fe1c-37e7-4aa3-b365-9a83c233565a service nova] [instance: e4ada2d7-7ace-4ed4-86a6-ed121c95e80f] Received event network-vif-unplugged-15dca2c3-5048-4e80-8008-c19400ea34e4 for instance with task_state deleting. {{(pid=71731) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 16:23:21 user nova-compute[71731]: DEBUG nova.compute.manager [req-8375c23c-fcbe-4ba0-a6f5-f957cfb42a0d req-34e6fe1c-37e7-4aa3-b365-9a83c233565a service nova] [instance: e4ada2d7-7ace-4ed4-86a6-ed121c95e80f] Received event network-vif-plugged-15dca2c3-5048-4e80-8008-c19400ea34e4 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:23:21 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-8375c23c-fcbe-4ba0-a6f5-f957cfb42a0d req-34e6fe1c-37e7-4aa3-b365-9a83c233565a service nova] Acquiring lock "e4ada2d7-7ace-4ed4-86a6-ed121c95e80f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:23:21 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-8375c23c-fcbe-4ba0-a6f5-f957cfb42a0d req-34e6fe1c-37e7-4aa3-b365-9a83c233565a service nova] Lock "e4ada2d7-7ace-4ed4-86a6-ed121c95e80f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:23:21 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-8375c23c-fcbe-4ba0-a6f5-f957cfb42a0d req-34e6fe1c-37e7-4aa3-b365-9a83c233565a service nova] Lock "e4ada2d7-7ace-4ed4-86a6-ed121c95e80f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:23:21 user nova-compute[71731]: DEBUG nova.compute.manager [req-8375c23c-fcbe-4ba0-a6f5-f957cfb42a0d req-34e6fe1c-37e7-4aa3-b365-9a83c233565a service nova] [instance: e4ada2d7-7ace-4ed4-86a6-ed121c95e80f] No waiting events found dispatching network-vif-plugged-15dca2c3-5048-4e80-8008-c19400ea34e4 {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:23:21 user nova-compute[71731]: WARNING nova.compute.manager [req-8375c23c-fcbe-4ba0-a6f5-f957cfb42a0d req-34e6fe1c-37e7-4aa3-b365-9a83c233565a service nova] [instance: e4ada2d7-7ace-4ed4-86a6-ed121c95e80f] Received unexpected event network-vif-plugged-15dca2c3-5048-4e80-8008-c19400ea34e4 for instance with vm_state active and task_state deleting.
Apr 13 16:23:21 user nova-compute[71731]: DEBUG nova.compute.manager [req-8375c23c-fcbe-4ba0-a6f5-f957cfb42a0d req-34e6fe1c-37e7-4aa3-b365-9a83c233565a service nova] [instance: 2549ba85-4e0a-420e-b711-07cafa8c60e9] Received event network-vif-unplugged-0152bbb9-d50d-4e58-8a2b-727c4675ea2f {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:23:21 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-8375c23c-fcbe-4ba0-a6f5-f957cfb42a0d req-34e6fe1c-37e7-4aa3-b365-9a83c233565a service nova] Acquiring lock "2549ba85-4e0a-420e-b711-07cafa8c60e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:23:21 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-8375c23c-fcbe-4ba0-a6f5-f957cfb42a0d req-34e6fe1c-37e7-4aa3-b365-9a83c233565a service nova] Lock "2549ba85-4e0a-420e-b711-07cafa8c60e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:23:21 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-8375c23c-fcbe-4ba0-a6f5-f957cfb42a0d req-34e6fe1c-37e7-4aa3-b365-9a83c233565a service nova] Lock "2549ba85-4e0a-420e-b711-07cafa8c60e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:23:21 user nova-compute[71731]: DEBUG nova.compute.manager [req-8375c23c-fcbe-4ba0-a6f5-f957cfb42a0d req-34e6fe1c-37e7-4aa3-b365-9a83c233565a service nova] [instance: 2549ba85-4e0a-420e-b711-07cafa8c60e9] No waiting events found dispatching network-vif-unplugged-0152bbb9-d50d-4e58-8a2b-727c4675ea2f {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:23:21 user nova-compute[71731]: DEBUG nova.compute.manager [req-8375c23c-fcbe-4ba0-a6f5-f957cfb42a0d req-34e6fe1c-37e7-4aa3-b365-9a83c233565a service nova] [instance: 2549ba85-4e0a-420e-b711-07cafa8c60e9] Received event network-vif-unplugged-0152bbb9-d50d-4e58-8a2b-727c4675ea2f for instance with task_state deleting. {{(pid=71731) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 16:23:21 user nova-compute[71731]: DEBUG nova.compute.manager [req-8375c23c-fcbe-4ba0-a6f5-f957cfb42a0d req-34e6fe1c-37e7-4aa3-b365-9a83c233565a service nova] [instance: 2549ba85-4e0a-420e-b711-07cafa8c60e9] Received event network-vif-plugged-0152bbb9-d50d-4e58-8a2b-727c4675ea2f {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:23:21 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-8375c23c-fcbe-4ba0-a6f5-f957cfb42a0d req-34e6fe1c-37e7-4aa3-b365-9a83c233565a service nova] Acquiring lock "2549ba85-4e0a-420e-b711-07cafa8c60e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:23:21 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-8375c23c-fcbe-4ba0-a6f5-f957cfb42a0d req-34e6fe1c-37e7-4aa3-b365-9a83c233565a service nova] Lock "2549ba85-4e0a-420e-b711-07cafa8c60e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:23:21 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-8375c23c-fcbe-4ba0-a6f5-f957cfb42a0d req-34e6fe1c-37e7-4aa3-b365-9a83c233565a service nova] Lock "2549ba85-4e0a-420e-b711-07cafa8c60e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:23:21 user nova-compute[71731]: DEBUG nova.compute.manager [req-8375c23c-fcbe-4ba0-a6f5-f957cfb42a0d req-34e6fe1c-37e7-4aa3-b365-9a83c233565a service nova] [instance: 2549ba85-4e0a-420e-b711-07cafa8c60e9] No waiting events found dispatching network-vif-plugged-0152bbb9-d50d-4e58-8a2b-727c4675ea2f {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:23:21 user nova-compute[71731]: WARNING nova.compute.manager [req-8375c23c-fcbe-4ba0-a6f5-f957cfb42a0d req-34e6fe1c-37e7-4aa3-b365-9a83c233565a service nova] [instance: 2549ba85-4e0a-420e-b711-07cafa8c60e9] Received unexpected event network-vif-plugged-0152bbb9-d50d-4e58-8a2b-727c4675ea2f for instance with vm_state active and task_state deleting.
Apr 13 16:23:21 user nova-compute[71731]: DEBUG nova.compute.manager [req-8375c23c-fcbe-4ba0-a6f5-f957cfb42a0d req-34e6fe1c-37e7-4aa3-b365-9a83c233565a service nova] [instance: 2549ba85-4e0a-420e-b711-07cafa8c60e9] Received event network-vif-unplugged-4c481745-6342-43f8-9040-3ea1d8c5c572 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:23:21 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-8375c23c-fcbe-4ba0-a6f5-f957cfb42a0d req-34e6fe1c-37e7-4aa3-b365-9a83c233565a service nova] Acquiring lock "2549ba85-4e0a-420e-b711-07cafa8c60e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:23:21 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-8375c23c-fcbe-4ba0-a6f5-f957cfb42a0d req-34e6fe1c-37e7-4aa3-b365-9a83c233565a service nova] Lock "2549ba85-4e0a-420e-b711-07cafa8c60e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:23:21 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-8375c23c-fcbe-4ba0-a6f5-f957cfb42a0d req-34e6fe1c-37e7-4aa3-b365-9a83c233565a service nova] Lock "2549ba85-4e0a-420e-b711-07cafa8c60e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:23:21 user nova-compute[71731]: DEBUG nova.compute.manager [req-8375c23c-fcbe-4ba0-a6f5-f957cfb42a0d req-34e6fe1c-37e7-4aa3-b365-9a83c233565a service nova] [instance: 2549ba85-4e0a-420e-b711-07cafa8c60e9] No waiting events found dispatching network-vif-unplugged-4c481745-6342-43f8-9040-3ea1d8c5c572 {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:23:21 user nova-compute[71731]: DEBUG nova.compute.manager [req-8375c23c-fcbe-4ba0-a6f5-f957cfb42a0d req-34e6fe1c-37e7-4aa3-b365-9a83c233565a service nova] [instance: 2549ba85-4e0a-420e-b711-07cafa8c60e9] Received event network-vif-unplugged-4c481745-6342-43f8-9040-3ea1d8c5c572 for instance with task_state deleting. {{(pid=71731) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 16:23:21 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:23:22 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:23:22 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8f3a3011-e4, bridge=br-int, if_exists=True) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:23:22 user nova-compute[71731]: INFO os_vif [None req-48b63815-ac65-4477-a276-ce12f90a7768 tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:1a:bc,bridge_name='br-int',has_traffic_filtering=True,id=d7155dcf-9e83-4579-b81a-7277d4a9eeaf,network=Network(5d158a82-de85-48b5-9f17-40e61e9b0df8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd7155dcf-9e')
Apr 13 16:23:22 user nova-compute[71731]: DEBUG nova.virt.libvirt.vif [None req-48b63815-ac65-4477-a276-ce12f90a7768 tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T16:21:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1688495933',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1688495933',id=9,image_ref='708622a9-7465-4492-ade8-b827198f7e30',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCmDAWwVmv7Q34Pz29t07av6aMRdzm3EgCQrfLBn83RkLO81Y7UjJ2zO/1nlrHzXzESZuCtlZxhzD9V6rEN/0ixQxrUu0ZuX2RNLf7aGDMjaY4XAH+0pTu29dKUMlHtNng==',key_name='tempest-keypair-756136845',keypairs=<?>,launch_index=0,launched_at=2023-04-13T16:22:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bbe4e9fb786d4015b035b4d00f75a1ba',ramdisk_id='',reservation_id='r-ulxepirk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='708622a9-7465-4492-ade8-b827198f7e30',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1779812468',owner_user_name='tempest-TaggedBootDevicesTest-1779812468-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T16:22:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='14566b85d0424c08999726ff72a67634',uuid=2549ba85-4e0a-420e-b711-07cafa8c60e9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4c481745-6342-43f8-9040-3ea1d8c5c572", "address": "fa:16:3e:e7:ea:ff", "network": {"id": "5d158a82-de85-48b5-9f17-40e61e9b0df8", "bridge": "br-int", "label": "tempest-device-tagging-net1-574676351", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.164", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bbe4e9fb786d4015b035b4d00f75a1ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c481745-63", "ovs_interfaceid": "4c481745-6342-43f8-9040-3ea1d8c5c572", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71731) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 16:23:22 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-48b63815-ac65-4477-a276-ce12f90a7768 tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Converting VIF {"id": "4c481745-6342-43f8-9040-3ea1d8c5c572", "address": "fa:16:3e:e7:ea:ff", "network": {"id": "5d158a82-de85-48b5-9f17-40e61e9b0df8", "bridge": "br-int", "label": "tempest-device-tagging-net1-574676351", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.164", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bbe4e9fb786d4015b035b4d00f75a1ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c481745-63", "ovs_interfaceid": "4c481745-6342-43f8-9040-3ea1d8c5c572", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 16:23:22 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-48b63815-ac65-4477-a276-ce12f90a7768 tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:ea:ff,bridge_name='br-int',has_traffic_filtering=True,id=4c481745-6342-43f8-9040-3ea1d8c5c572,network=Network(5d158a82-de85-48b5-9f17-40e61e9b0df8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4c481745-63') {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 16:23:22 user nova-compute[71731]: DEBUG os_vif [None req-48b63815-ac65-4477-a276-ce12f90a7768 tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:ea:ff,bridge_name='br-int',has_traffic_filtering=True,id=4c481745-6342-43f8-9040-3ea1d8c5c572,network=Network(5d158a82-de85-48b5-9f17-40e61e9b0df8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4c481745-63') {{(pid=71731) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 16:23:22 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:23:22 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 16:23:22 user nova-compute[71731]: DEBUG nova.objects.instance [None req-cfbbaf71-6557-432f-a527-7937d6bc5423 tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] Lazy-loading 'flavor' on Instance uuid 8c6d8096-853b-4091-ad82-6faf8ffc85fa {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:23:22 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-cfbbaf71-6557-432f-a527-7937d6bc5423 tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] Lock "8c6d8096-853b-4091-ad82-6faf8ffc85fa" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.491s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:23:22 user nova-compute[71731]: DEBUG os_brick.utils [None req-9e131767-04d4-45b2-8e12-2a4ab0daa556 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 16:23:22 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:23:22 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:23:22 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:23:22 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4c481745-63, bridge=br-int, if_exists=True) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:23:22 user nova-compute[71731]: INFO os_vif [None req-dbf47c70-b17d-428f-97f0-d7601655d4d4 tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:78:12:fd,bridge_name='br-int',has_traffic_filtering=True,id=8f3a3011-e474-4538-812b-9df3968fd629,network=Network(4b153def-aec7-4f9e-9604-f1e0afb247f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f3a3011-e4')
Apr 13 16:23:22 user nova-compute[71731]: DEBUG nova.virt.libvirt.vif [None req-dbf47c70-b17d-428f-97f0-d7601655d4d4 tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T16:21:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-425684793',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-425684793',id=8,image_ref='708622a9-7465-4492-ade8-b827198f7e30',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI5YQpLaGCSGL4ntWt11BFFgnGrQ3fItNIdB138VboyJqclL9H8Ulyx/xxT8IGEQfueXv2SL9+Q3QwgV/gEuhZSJPXCS54honN2kOhqtEWQCcit240y/RW04xC4ADo4EdQ==',key_name='tempest-keypair-135831071',keypairs=<?>,launch_index=0,launched_at=2023-04-13T16:22:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7649e366b0164e2fa5b3faa0830b6ea6',ramdisk_id='',reservation_id='r-newglzq9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='708622a9-7465-4492-ade8-b827198f7e30',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1193811043',owner_user_name='tempest-TaggedBootDevicesTest_v242-1193811043-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T16:22:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7e50bd9d540549a194f706dac48ce93d',uuid=e4ada2d7-7ace-4ed4-86a6-ed121c95e80f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2430beb8-b2e4-4493-bdc5-df6b4c1181c6", "address": "fa:16:3e:30:1c:f5", "network": {"id": "4b153def-aec7-4f9e-9604-f1e0afb247f3", "bridge": "br-int", "label": "tempest-device-tagging-net1-1029190313", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.91", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7649e366b0164e2fa5b3faa0830b6ea6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2430beb8-b2", "ovs_interfaceid": "2430beb8-b2e4-4493-bdc5-df6b4c1181c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 16:23:22 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-dbf47c70-b17d-428f-97f0-d7601655d4d4 tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Converting VIF {"id": "2430beb8-b2e4-4493-bdc5-df6b4c1181c6", "address": "fa:16:3e:30:1c:f5", "network": {"id": "4b153def-aec7-4f9e-9604-f1e0afb247f3", "bridge": "br-int", "label": "tempest-device-tagging-net1-1029190313", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.91", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7649e366b0164e2fa5b3faa0830b6ea6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2430beb8-b2", "ovs_interfaceid": "2430beb8-b2e4-4493-bdc5-df6b4c1181c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 16:23:22 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-dbf47c70-b17d-428f-97f0-d7601655d4d4 tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:30:1c:f5,bridge_name='br-int',has_traffic_filtering=True,id=2430beb8-b2e4-4493-bdc5-df6b4c1181c6,network=Network(4b153def-aec7-4f9e-9604-f1e0afb247f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2430beb8-b2') {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 16:23:22 user nova-compute[71731]: DEBUG os_vif [None req-dbf47c70-b17d-428f-97f0-d7601655d4d4 tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:1c:f5,bridge_name='br-int',has_traffic_filtering=True,id=2430beb8-b2e4-4493-bdc5-df6b4c1181c6,network=Network(4b153def-aec7-4f9e-9604-f1e0afb247f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2430beb8-b2') {{(pid=71731) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 16:23:22 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:23:22 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dc425fc-4b38-471a-9aa2-d543e65f1c88]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:81501d91421\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:23:22 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 16:23:22 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:23:22 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:23:22 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[d83715b8-0352-4d44-bcc0-1f4df5539d3f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:23:22 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:23:22 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:23:22 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[703fe8af-5714-47db-a1bd-63b7f63d4275]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:23:22 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5f2ebae-f62c-43df-8130-a64a37fc03bd]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:23:22 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-9e131767-04d4-45b2-8e12-2a4ab0daa556 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Running cmd (subprocess): nvme version {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:23:22 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-9e131767-04d4-45b2-8e12-2a4ab0daa556 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] 'nvme version' failed. Not Retrying. {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 16:23:22 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:23:22 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9e131767-04d4-45b2-8e12-2a4ab0daa556 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] nvme not present on system {{(pid=71731) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 16:23:22 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:23:22 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2430beb8-b2, bridge=br-int, if_exists=True) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:23:22 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:23:22 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:23:22 user nova-compute[71731]: INFO os_vif [None req-48b63815-ac65-4477-a276-ce12f90a7768 tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:ea:ff,bridge_name='br-int',has_traffic_filtering=True,id=4c481745-6342-43f8-9040-3ea1d8c5c572,network=Network(5d158a82-de85-48b5-9f17-40e61e9b0df8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4c481745-63')
Apr 13 16:23:22 user nova-compute[71731]: DEBUG nova.virt.libvirt.vif [None req-48b63815-ac65-4477-a276-ce12f90a7768 tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T16:21:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1688495933',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1688495933',id=9,image_ref='708622a9-7465-4492-ade8-b827198f7e30',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCmDAWwVmv7Q34Pz29t07av6aMRdzm3EgCQrfLBn83RkLO81Y7UjJ2zO/1nlrHzXzESZuCtlZxhzD9V6rEN/0ixQxrUu0ZuX2RNLf7aGDMjaY4XAH+0pTu29dKUMlHtNng==',key_name='tempest-keypair-756136845',keypairs=<?>,launch_index=0,launched_at=2023-04-13T16:22:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bbe4e9fb786d4015b035b4d00f75a1ba',ramdisk_id='',reservation_id='r-ulxepirk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='708622a9-7465-4492-ade8-b827198f7e30',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1779812468',owner_user_name='tempest-TaggedBootDevicesTest-1779812468-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T16:22:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='14566b85d0424c08999726ff72a67634',uuid=2549ba85-4e0a-420e-b711-07cafa8c60e9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0152bbb9-d50d-4e58-8a2b-727c4675ea2f", "address": "fa:16:3e:0d:4d:58", "network": {"id": "5d158a82-de85-48b5-9f17-40e61e9b0df8", "bridge": "br-int", "label": "tempest-device-tagging-net1-574676351", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.142", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bbe4e9fb786d4015b035b4d00f75a1ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0152bbb9-d5", "ovs_interfaceid": "0152bbb9-d50d-4e58-8a2b-727c4675ea2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 16:23:22 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-48b63815-ac65-4477-a276-ce12f90a7768 tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Converting VIF {"id": "0152bbb9-d50d-4e58-8a2b-727c4675ea2f", "address": "fa:16:3e:0d:4d:58", "network": {"id": "5d158a82-de85-48b5-9f17-40e61e9b0df8", "bridge": "br-int", "label": "tempest-device-tagging-net1-574676351", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.142", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bbe4e9fb786d4015b035b4d00f75a1ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0152bbb9-d5", "ovs_interfaceid": "0152bbb9-d50d-4e58-8a2b-727c4675ea2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 16:23:22 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-48b63815-ac65-4477-a276-ce12f90a7768 tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0d:4d:58,bridge_name='br-int',has_traffic_filtering=True,id=0152bbb9-d50d-4e58-8a2b-727c4675ea2f,network=Network(5d158a82-de85-48b5-9f17-40e61e9b0df8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0152bbb9-d5') {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 16:23:22 user nova-compute[71731]: DEBUG os_vif [None req-48b63815-ac65-4477-a276-ce12f90a7768 tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:4d:58,bridge_name='br-int',has_traffic_filtering=True,id=0152bbb9-d50d-4e58-8a2b-727c4675ea2f,network=Network(5d158a82-de85-48b5-9f17-40e61e9b0df8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0152bbb9-d5') {{(pid=71731) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 16:23:22 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 16:23:22 user nova-compute[71731]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 16:23:22 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[6becd380-0d40-45da-95f6-f938a3a90e3c]: (4, '') {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:23:22 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 16:23:22 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.lightos [None req-9e131767-04d4-45b2-8e12-2a4ab0daa556 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71731) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 16:23:22 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.lightos [None req-9e131767-04d4-45b2-8e12-2a4ab0daa556 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71731) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 16:23:22 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.lightos [None req-9e131767-04d4-45b2-8e12-2a4ab0daa556 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] LIGHTOS: no hostnqn found. {{(pid=71731) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 16:23:22 user nova-compute[71731]: DEBUG os_brick.utils [None req-9e131767-04d4-45b2-8e12-2a4ab0daa556 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] <== get_connector_properties: return (151ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:81501d91421', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 16:23:22 user nova-compute[71731]: DEBUG nova.virt.block_device [None req-9e131767-04d4-45b2-8e12-2a4ab0daa556 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: 235f827c-7116-48e9-84c5-0c9761c18e1e] Updating existing volume attachment record: b8388986-c360-4397-bc94-4299e0fa216f {{(pid=71731) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 16:23:22 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:23:22 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:23:22 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0152bbb9-d5, bridge=br-int, if_exists=True) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:23:22 user nova-compute[71731]: INFO os_vif [None req-dbf47c70-b17d-428f-97f0-d7601655d4d4 tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:1c:f5,bridge_name='br-int',has_traffic_filtering=True,id=2430beb8-b2e4-4493-bdc5-df6b4c1181c6,network=Network(4b153def-aec7-4f9e-9604-f1e0afb247f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2430beb8-b2')
Apr 13 16:23:22 user nova-compute[71731]: DEBUG nova.virt.libvirt.vif [None req-dbf47c70-b17d-428f-97f0-d7601655d4d4 tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T16:21:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-425684793',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-425684793',id=8,image_ref='708622a9-7465-4492-ade8-b827198f7e30',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI5YQpLaGCSGL4ntWt11BFFgnGrQ3fItNIdB138VboyJqclL9H8Ulyx/xxT8IGEQfueXv2SL9+Q3QwgV/gEuhZSJPXCS54honN2kOhqtEWQCcit240y/RW04xC4ADo4EdQ==',key_name='tempest-keypair-135831071',keypairs=<?>,launch_index=0,launched_at=2023-04-13T16:22:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7649e366b0164e2fa5b3faa0830b6ea6',ramdisk_id='',reservation_id='r-newglzq9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='708622a9-7465-4492-ade8-b827198f7e30',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1193811043',owner_user_name='tempest-TaggedBootDevicesTest_v242-1193811043-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T16:22:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7e50bd9d540549a194f706dac48ce93d',uuid=e4ada2d7-7ace-4ed4-86a6-ed121c95e80f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "15dca2c3-5048-4e80-8008-c19400ea34e4", "address": "fa:16:3e:df:45:fc", "network": {"id": "310c919b-177f-4fb1-956a-1423f7397f77", "bridge": "br-int", "label": "tempest-device-tagging-net2-188582195", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7649e366b0164e2fa5b3faa0830b6ea6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15dca2c3-50", "ovs_interfaceid": "15dca2c3-5048-4e80-8008-c19400ea34e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 16:23:22 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-dbf47c70-b17d-428f-97f0-d7601655d4d4 tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Converting VIF {"id": "15dca2c3-5048-4e80-8008-c19400ea34e4", "address": "fa:16:3e:df:45:fc", "network": {"id": "310c919b-177f-4fb1-956a-1423f7397f77", "bridge": "br-int", "label": "tempest-device-tagging-net2-188582195", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7649e366b0164e2fa5b3faa0830b6ea6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15dca2c3-50", "ovs_interfaceid": "15dca2c3-5048-4e80-8008-c19400ea34e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 16:23:22 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-dbf47c70-b17d-428f-97f0-d7601655d4d4 tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:df:45:fc,bridge_name='br-int',has_traffic_filtering=True,id=15dca2c3-5048-4e80-8008-c19400ea34e4,network=Network(310c919b-177f-4fb1-956a-1423f7397f77),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15dca2c3-50') {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 16:23:22 user nova-compute[71731]: DEBUG os_vif [None req-dbf47c70-b17d-428f-97f0-d7601655d4d4 tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:45:fc,bridge_name='br-int',has_traffic_filtering=True,id=15dca2c3-5048-4e80-8008-c19400ea34e4,network=Network(310c919b-177f-4fb1-956a-1423f7397f77),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15dca2c3-50') {{(pid=71731) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 16:23:22 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 16:23:22 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:23:22 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:23:22 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap15dca2c3-50, bridge=br-int, if_exists=True) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:23:22 user nova-compute[71731]: INFO os_vif [None req-48b63815-ac65-4477-a276-ce12f90a7768 tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:4d:58,bridge_name='br-int',has_traffic_filtering=True,id=0152bbb9-d50d-4e58-8a2b-727c4675ea2f,network=Network(5d158a82-de85-48b5-9f17-40e61e9b0df8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0152bbb9-d5')
Apr 13 16:23:22 user nova-compute[71731]: DEBUG nova.virt.libvirt.vif [None req-48b63815-ac65-4477-a276-ce12f90a7768 tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T16:21:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1688495933',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1688495933',id=9,image_ref='708622a9-7465-4492-ade8-b827198f7e30',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCmDAWwVmv7Q34Pz29t07av6aMRdzm3EgCQrfLBn83RkLO81Y7UjJ2zO/1nlrHzXzESZuCtlZxhzD9V6rEN/0ixQxrUu0ZuX2RNLf7aGDMjaY4XAH+0pTu29dKUMlHtNng==',key_name='tempest-keypair-756136845',keypairs=<?>,launch_index=0,launched_at=2023-04-13T16:22:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bbe4e9fb786d4015b035b4d00f75a1ba',ramdisk_id='',reservation_id='r-ulxepirk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='708622a9-7465-4492-ade8-b827198f7e30',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1779812468',owner_user_name='tempest-TaggedBootDevicesTest-1779812468-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T16:22:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='14566b85d0424c08999726ff72a67634',uuid=2549ba85-4e0a-420e-b711-07cafa8c60e9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3730ed6e-b093-4232-800b-b064d650e9e8", "address": "fa:16:3e:a8:c4:f6", "network": {"id": "5d158a82-de85-48b5-9f17-40e61e9b0df8", "bridge": "br-int", "label": "tempest-device-tagging-net1-574676351", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.38", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bbe4e9fb786d4015b035b4d00f75a1ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3730ed6e-b0", "ovs_interfaceid": "3730ed6e-b093-4232-800b-b064d650e9e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 16:23:22 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-48b63815-ac65-4477-a276-ce12f90a7768 tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Converting VIF {"id": "3730ed6e-b093-4232-800b-b064d650e9e8", "address": "fa:16:3e:a8:c4:f6", "network": {"id": "5d158a82-de85-48b5-9f17-40e61e9b0df8", "bridge": "br-int", "label": "tempest-device-tagging-net1-574676351", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.38", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bbe4e9fb786d4015b035b4d00f75a1ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3730ed6e-b0", "ovs_interfaceid": "3730ed6e-b093-4232-800b-b064d650e9e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 16:23:22 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-48b63815-ac65-4477-a276-ce12f90a7768 tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a8:c4:f6,bridge_name='br-int',has_traffic_filtering=True,id=3730ed6e-b093-4232-800b-b064d650e9e8,network=Network(5d158a82-de85-48b5-9f17-40e61e9b0df8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3730ed6e-b0') {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 16:23:22 user nova-compute[71731]: DEBUG os_vif [None req-48b63815-ac65-4477-a276-ce12f90a7768 tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:c4:f6,bridge_name='br-int',has_traffic_filtering=True,id=3730ed6e-b093-4232-800b-b064d650e9e8,network=Network(5d158a82-de85-48b5-9f17-40e61e9b0df8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3730ed6e-b0') {{(pid=71731) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 16:23:22 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:23:22 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 16:23:22 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:23:22 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:23:22 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3730ed6e-b0, bridge=br-int, if_exists=True) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:23:22 user nova-compute[71731]: INFO os_vif [None req-dbf47c70-b17d-428f-97f0-d7601655d4d4 tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:45:fc,bridge_name='br-int',has_traffic_filtering=True,id=15dca2c3-5048-4e80-8008-c19400ea34e4,network=Network(310c919b-177f-4fb1-956a-1423f7397f77),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15dca2c3-50')
Apr 13 16:23:22 user nova-compute[71731]: DEBUG nova.virt.libvirt.vif [None req-dbf47c70-b17d-428f-97f0-d7601655d4d4 tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T16:21:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-425684793',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-425684793',id=8,image_ref='708622a9-7465-4492-ade8-b827198f7e30',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI5YQpLaGCSGL4ntWt11BFFgnGrQ3fItNIdB138VboyJqclL9H8Ulyx/xxT8IGEQfueXv2SL9+Q3QwgV/gEuhZSJPXCS54honN2kOhqtEWQCcit240y/RW04xC4ADo4EdQ==',key_name='tempest-keypair-135831071',keypairs=<?>,launch_index=0,launched_at=2023-04-13T16:22:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7649e366b0164e2fa5b3faa0830b6ea6',ramdisk_id='',reservation_id='r-newglzq9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='708622a9-7465-4492-ade8-b827198f7e30',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1193811043',owner_user_name='tempest-TaggedBootDevicesTest_v242-1193811043-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T16:22:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7e50bd9d540549a194f706dac48ce93d',uuid=e4ada2d7-7ace-4ed4-86a6-ed121c95e80f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d41765b6-0d5b-43c1-bf58-a82a7bbe3137", "address": "fa:16:3e:63:86:1f", "network": {"id": "310c919b-177f-4fb1-956a-1423f7397f77", "bridge": "br-int", "label": "tempest-device-tagging-net2-188582195", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7649e366b0164e2fa5b3faa0830b6ea6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd41765b6-0d", "ovs_interfaceid": "d41765b6-0d5b-43c1-bf58-a82a7bbe3137", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 16:23:22 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-dbf47c70-b17d-428f-97f0-d7601655d4d4 tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Converting VIF {"id": "d41765b6-0d5b-43c1-bf58-a82a7bbe3137", "address": "fa:16:3e:63:86:1f", "network": {"id": "310c919b-177f-4fb1-956a-1423f7397f77", "bridge": "br-int", "label": "tempest-device-tagging-net2-188582195", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7649e366b0164e2fa5b3faa0830b6ea6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd41765b6-0d", "ovs_interfaceid": "d41765b6-0d5b-43c1-bf58-a82a7bbe3137", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 16:23:22 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-dbf47c70-b17d-428f-97f0-d7601655d4d4 tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:63:86:1f,bridge_name='br-int',has_traffic_filtering=True,id=d41765b6-0d5b-43c1-bf58-a82a7bbe3137,network=Network(310c919b-177f-4fb1-956a-1423f7397f77),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd41765b6-0d') {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 16:23:22 user nova-compute[71731]: DEBUG os_vif [None req-dbf47c70-b17d-428f-97f0-d7601655d4d4 tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:63:86:1f,bridge_name='br-int',has_traffic_filtering=True,id=d41765b6-0d5b-43c1-bf58-a82a7bbe3137,network=Network(310c919b-177f-4fb1-956a-1423f7397f77),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd41765b6-0d') {{(pid=71731) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 16:23:22 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:23:22 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 16:23:22 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:23:22 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:23:22 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd41765b6-0d, bridge=br-int, if_exists=True) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:23:22 user nova-compute[71731]: INFO os_vif [None req-48b63815-ac65-4477-a276-ce12f90a7768 tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:c4:f6,bridge_name='br-int',has_traffic_filtering=True,id=3730ed6e-b093-4232-800b-b064d650e9e8,network=Network(5d158a82-de85-48b5-9f17-40e61e9b0df8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3730ed6e-b0')
Apr 13 16:23:22 user nova-compute[71731]: DEBUG nova.virt.libvirt.vif [None req-48b63815-ac65-4477-a276-ce12f90a7768 tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T16:21:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1688495933',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1688495933',id=9,image_ref='708622a9-7465-4492-ade8-b827198f7e30',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCmDAWwVmv7Q34Pz29t07av6aMRdzm3EgCQrfLBn83RkLO81Y7UjJ2zO/1nlrHzXzESZuCtlZxhzD9V6rEN/0ixQxrUu0ZuX2RNLf7aGDMjaY4XAH+0pTu29dKUMlHtNng==',key_name='tempest-keypair-756136845',keypairs=<?>,launch_index=0,launched_at=2023-04-13T16:22:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bbe4e9fb786d4015b035b4d00f75a1ba',ramdisk_id='',reservation_id='r-ulxepirk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='708622a9-7465-4492-ade8-b827198f7e30',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1779812468',owner_user_name='tempest-TaggedBootDevicesTest-1779812468-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T16:22:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='14566b85d0424c08999726ff72a67634',uuid=2549ba85-4e0a-420e-b711-07cafa8c60e9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0fbdf291-df5d-41c5-a765-7145a87da272", "address": "fa:16:3e:dc:57:7b", "network": {"id": "4224b04f-23ed-464e-9b2c-df8c843f9287", "bridge": "br-int", "label": "tempest-device-tagging-net2-109401200", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "bbe4e9fb786d4015b035b4d00f75a1ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fbdf291-df", "ovs_interfaceid": "0fbdf291-df5d-41c5-a765-7145a87da272", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 16:23:22 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-48b63815-ac65-4477-a276-ce12f90a7768 tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Converting VIF {"id": "0fbdf291-df5d-41c5-a765-7145a87da272", "address": "fa:16:3e:dc:57:7b", "network": {"id": "4224b04f-23ed-464e-9b2c-df8c843f9287", "bridge": "br-int", "label": "tempest-device-tagging-net2-109401200", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "bbe4e9fb786d4015b035b4d00f75a1ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fbdf291-df", "ovs_interfaceid": "0fbdf291-df5d-41c5-a765-7145a87da272", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 16:23:22 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-48b63815-ac65-4477-a276-ce12f90a7768 tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dc:57:7b,bridge_name='br-int',has_traffic_filtering=True,id=0fbdf291-df5d-41c5-a765-7145a87da272,network=Network(4224b04f-23ed-464e-9b2c-df8c843f9287),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0fbdf291-df') {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 16:23:22 user nova-compute[71731]: DEBUG os_vif [None req-48b63815-ac65-4477-a276-ce12f90a7768 tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dc:57:7b,bridge_name='br-int',has_traffic_filtering=True,id=0fbdf291-df5d-41c5-a765-7145a87da272,network=Network(4224b04f-23ed-464e-9b2c-df8c843f9287),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0fbdf291-df') {{(pid=71731) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 16:23:22 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:23:22 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 16:23:22 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:23:22 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:23:22 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0fbdf291-df, bridge=br-int, if_exists=True) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:23:22 user nova-compute[71731]: INFO os_vif [None req-dbf47c70-b17d-428f-97f0-d7601655d4d4 tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:63:86:1f,bridge_name='br-int',has_traffic_filtering=True,id=d41765b6-0d5b-43c1-bf58-a82a7bbe3137,network=Network(310c919b-177f-4fb1-956a-1423f7397f77),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd41765b6-0d')
Apr 13 16:23:22 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:23:22 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 16:23:22 user nova-compute[71731]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dbf47c70-b17d-428f-97f0-d7601655d4d4 tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] [instance: e4ada2d7-7ace-4ed4-86a6-ed121c95e80f] calling os-brick to detach iSCSI Volume {{(pid=71731) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 16:23:22 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbf47c70-b17d-428f-97f0-d7601655d4d4 tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8cf0118790>, {'target_iqn': 'iqn.2010-10.org.openstack:84c7f6ad-d2c2-465a-b39e-47347aa85be0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pGheaJTt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 16:23:22 user nova-compute[71731]: WARNING os_brick.initiator.connectors.base [None req-dbf47c70-b17d-428f-97f0-d7601655d4d4 tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 16:23:22 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-dbf47c70-b17d-428f-97f0-d7601655d4d4 tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 16:23:22 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-dbf47c70-b17d-428f-97f0-d7601655d4d4 tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.004s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 16:23:22 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:23:22 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:23:22 user nova-compute[71731]: INFO os_vif [None req-48b63815-ac65-4477-a276-ce12f90a7768 tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dc:57:7b,bridge_name='br-int',has_traffic_filtering=True,id=0fbdf291-df5d-41c5-a765-7145a87da272,network=Network(4224b04f-23ed-464e-9b2c-df8c843f9287),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0fbdf291-df')
Apr 13 16:23:22 user nova-compute[71731]: DEBUG nova.virt.libvirt.vif [None req-48b63815-ac65-4477-a276-ce12f90a7768 tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T16:21:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1688495933',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1688495933',id=9,image_ref='708622a9-7465-4492-ade8-b827198f7e30',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCmDAWwVmv7Q34Pz29t07av6aMRdzm3EgCQrfLBn83RkLO81Y7UjJ2zO/1nlrHzXzESZuCtlZxhzD9V6rEN/0ixQxrUu0ZuX2RNLf7aGDMjaY4XAH+0pTu29dKUMlHtNng==',key_name='tempest-keypair-756136845',keypairs=<?>,launch_index=0,launched_at=2023-04-13T16:22:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bbe4e9fb786d4015b035b4d00f75a1ba',ramdisk_id='',reservation_id='r-ulxepirk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='708622a9-7465-4492-ade8-b827198f7e30',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1779812468',owner_user_name='tempest-TaggedBootDevicesTest-1779812468-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T16:22:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='14566b85d0424c08999726ff72a67634',uuid=2549ba85-4e0a-420e-b711-07cafa8c60e9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "38e92b7c-b7c1-4137-a1db-21bc1d24f3ee", "address": "fa:16:3e:a3:dd:27", "network": {"id": "4224b04f-23ed-464e-9b2c-df8c843f9287", "bridge": "br-int", "label": "tempest-device-tagging-net2-109401200", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "bbe4e9fb786d4015b035b4d00f75a1ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38e92b7c-b7", "ovs_interfaceid": "38e92b7c-b7c1-4137-a1db-21bc1d24f3ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 16:23:22 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-48b63815-ac65-4477-a276-ce12f90a7768 tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Converting VIF {"id": "38e92b7c-b7c1-4137-a1db-21bc1d24f3ee", "address": "fa:16:3e:a3:dd:27", "network": {"id": "4224b04f-23ed-464e-9b2c-df8c843f9287", "bridge": "br-int", "label": "tempest-device-tagging-net2-109401200", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "bbe4e9fb786d4015b035b4d00f75a1ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38e92b7c-b7", "ovs_interfaceid": "38e92b7c-b7c1-4137-a1db-21bc1d24f3ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 16:23:22 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-48b63815-ac65-4477-a276-ce12f90a7768 tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a3:dd:27,bridge_name='br-int',has_traffic_filtering=True,id=38e92b7c-b7c1-4137-a1db-21bc1d24f3ee,network=Network(4224b04f-23ed-464e-9b2c-df8c843f9287),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38e92b7c-b7') {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 16:23:22 user nova-compute[71731]: DEBUG os_vif [None req-48b63815-ac65-4477-a276-ce12f90a7768 tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a3:dd:27,bridge_name='br-int',has_traffic_filtering=True,id=38e92b7c-b7c1-4137-a1db-21bc1d24f3ee,network=Network(4224b04f-23ed-464e-9b2c-df8c843f9287),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38e92b7c-b7') {{(pid=71731) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 16:23:22 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:23:22 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap38e92b7c-b7, bridge=br-int, if_exists=True) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:23:22 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:23:22 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 16:23:22 user nova-compute[71731]: INFO os_vif [None req-48b63815-ac65-4477-a276-ce12f90a7768 tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a3:dd:27,bridge_name='br-int',has_traffic_filtering=True,id=38e92b7c-b7c1-4137-a1db-21bc1d24f3ee,network=Network(4224b04f-23ed-464e-9b2c-df8c843f9287),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38e92b7c-b7')
Apr 13 16:23:22 user nova-compute[71731]: DEBUG nova.virt.libvirt.volume.iscsi [None req-48b63815-ac65-4477-a276-ce12f90a7768 tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] [instance: 2549ba85-4e0a-420e-b711-07cafa8c60e9] calling os-brick to detach iSCSI Volume {{(pid=71731) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 16:23:22 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-48b63815-ac65-4477-a276-ce12f90a7768 tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8cf0118790>, {'target_iqn': 'iqn.2010-10.org.openstack:48af37b0-6938-432e-b374-d992c4dd9ae9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZwQBgjWU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 16:23:22 user nova-compute[71731]: WARNING os_brick.initiator.connectors.base [None req-48b63815-ac65-4477-a276-ce12f90a7768 tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 16:23:22 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-48b63815-ac65-4477-a276-ce12f90a7768 tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 16:23:22 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.031s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:23:22 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[2632b821-4b85-4568-8ea4-fd00feb6c2d1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c20e80fa-58de-431a-8901-2535657aaadf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:27919afc-8990-4ed5-af9e-9d6b3d7b231e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0e3b49ec-80af-4c38-9689-f7277e495d21\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cc639d00-ef6b-4121-bcb0-c65ec0347abd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e0f728f3-fbb5-4ed8-a78b-a5d982b03f7d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:84c7f6ad-d2c2-465a-b39e-47347aa85be0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:48af37b0-6938-432e-b374-d992c4dd9ae9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:23:22 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbf47c70-b17d-428f-97f0-d7601655d4d4 tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 16:23:22 user nova-compute[71731]: No targets found.
Apr 13 16:23:22 user nova-compute[71731]: iSNS:
Apr 13 16:23:22 user nova-compute[71731]: No targets found.
Apr 13 16:23:22 user nova-compute[71731]: STATIC:
Apr 13 16:23:22 user nova-compute[71731]: Target: iqn.2010-10.org.openstack:c20e80fa-58de-431a-8901-2535657aaadf
Apr 13 16:23:22 user nova-compute[71731]:         Portal: 172.16.0.220:3260,-1
Apr 13 16:23:22 user nova-compute[71731]:                 Iface Name: default
Apr 13 16:23:22 user nova-compute[71731]: Target: iqn.2010-10.org.openstack:27919afc-8990-4ed5-af9e-9d6b3d7b231e
Apr 13 16:23:22 user nova-compute[71731]:         Portal: 172.16.0.220:3260,-1
Apr 13 16:23:22 user nova-compute[71731]:                 Iface Name: default
Apr 13 16:23:22 user nova-compute[71731]: Target: iqn.2010-10.org.openstack:0e3b49ec-80af-4c38-9689-f7277e495d21
Apr 13 16:23:22 user nova-compute[71731]:         Portal: 172.16.0.220:3260,-1
Apr 13 16:23:22 user nova-compute[71731]:                 Iface Name: default
Apr 13 16:23:22 user nova-compute[71731]: Target: iqn.2010-10.org.openstack:cc639d00-ef6b-4121-bcb0-c65ec0347abd
Apr 13 16:23:22 user nova-compute[71731]:         Portal: 172.16.0.220:3260,-1
Apr 13 16:23:22 user nova-compute[71731]:                 Iface Name: default
Apr 13 16:23:22 user nova-compute[71731]: Target: iqn.2010-10.org.openstack:e0f728f3-fbb5-4ed8-a78b-a5d982b03f7d
Apr 13 16:23:22 user nova-compute[71731]:         Portal: 172.16.0.220:3260,-1
Apr 13 16:23:22 user nova-compute[71731]:                 Iface Name: default
Apr 13 16:23:22 user nova-compute[71731]: Target: iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984
Apr 13 16:23:22 user nova-compute[71731]:         Portal: 172.16.0.220:3260,-1
Apr 13 16:23:22 user nova-compute[71731]:                 Iface Name: default
Apr 13 16:23:22 user nova-compute[71731]: Target: iqn.2010-10.org.openstack:84c7f6ad-d2c2-465a-b39e-47347aa85be0
Apr 13 16:23:22 user nova-compute[71731]:         Portal: 172.16.0.220:3260,-1
Apr 13 16:23:22 user nova-compute[71731]:                 Iface Name: default
Apr 13 16:23:22 user nova-compute[71731]: Target: iqn.2010-10.org.openstack:48af37b0-6938-432e-b374-d992c4dd9ae9
Apr 13 16:23:22 user nova-compute[71731]:         Portal: 172.16.0.220:3260,-1
Apr 13 16:23:22 user nova-compute[71731]:                 Iface Name: default
Apr 13 16:23:22 user nova-compute[71731]: FIRMWARE:
Apr 13 16:23:22 user nova-compute[71731]: No targets found.
Apr 13 16:23:22 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 16:23:22 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbf47c70-b17d-428f-97f0-d7601655d4d4 tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 16:23:22 user nova-compute[71731]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 16:23:22 user nova-compute[71731]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71731) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 16:23:22 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbf47c70-b17d-428f-97f0-d7601655d4d4 tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:84c7f6ad-d2c2-465a-b39e-47347aa85be0', 0)] {{(pid=71731) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 16:23:22 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:23:22 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:23:22 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b83808c-24bb-4184-957d-c92d9ccdddb4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0e3b49ec-80af-4c38-9689-f7277e495d21\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:27919afc-8990-4ed5-af9e-9d6b3d7b231e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:48af37b0-6938-432e-b374-d992c4dd9ae9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:84c7f6ad-d2c2-465a-b39e-47347aa85be0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c20e80fa-58de-431a-8901-2535657aaadf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cc639d00-ef6b-4121-bcb0-c65ec0347abd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e0f728f3-fbb5-4ed8-a78b-a5d982b03f7d\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:23:22 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:23:22 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:23:22 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cd47c55-3978-450b-99c5-d33061b41489]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e3b49ec-80af-4c38-9689-f7277e495d21 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c7f6ad-d2c2-465a-b39e-47347aa85be0 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48af37b0-6938-432e-b374-d992c4dd9ae9 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c20e80fa-58de-431a-8901-2535657aaadf (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27919afc-8990-4ed5-af9e-9d6b3d7b231e (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc639d00-ef6b-4121-bcb0-c65ec0347abd (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0f728f3-fbb5-4ed8-a78b-a5d982b03f7d (non-flash)\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:23:22 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbf47c70-b17d-428f-97f0-d7601655d4d4 tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e3b49ec-80af-4c38-9689-f7277e495d21 (non-flash)
Apr 13 16:23:22 user nova-compute[71731]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984 (non-flash)
Apr 13 16:23:22 user nova-compute[71731]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c7f6ad-d2c2-465a-b39e-47347aa85be0 (non-flash)
Apr 13 16:23:22 user nova-compute[71731]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48af37b0-6938-432e-b374-d992c4dd9ae9 (non-flash)
Apr 13 16:23:22 user nova-compute[71731]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c20e80fa-58de-431a-8901-2535657aaadf (non-flash)
Apr 13 16:23:22 user nova-compute[71731]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27919afc-8990-4ed5-af9e-9d6b3d7b231e (non-flash)
Apr 13 16:23:22 user nova-compute[71731]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc639d00-ef6b-4121-bcb0-c65ec0347abd (non-flash)
Apr 13 16:23:22 user nova-compute[71731]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0f728f3-fbb5-4ed8-a78b-a5d982b03f7d (non-flash)
Apr 13 16:23:22 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 16:23:22 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbf47c70-b17d-428f-97f0-d7601655d4d4 tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e3b49ec-80af-4c38-9689-f7277e495d21 (non-flash)
Apr 13 16:23:22 user nova-compute[71731]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984 (non-flash)
Apr 13 16:23:22 user nova-compute[71731]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c7f6ad-d2c2-465a-b39e-47347aa85be0 (non-flash)
Apr 13 16:23:22 user nova-compute[71731]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48af37b0-6938-432e-b374-d992c4dd9ae9 (non-flash)
Apr 13 16:23:22 user nova-compute[71731]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c20e80fa-58de-431a-8901-2535657aaadf (non-flash)
Apr 13 16:23:22 user nova-compute[71731]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27919afc-8990-4ed5-af9e-9d6b3d7b231e (non-flash)
Apr 13 16:23:22 user nova-compute[71731]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc639d00-ef6b-4121-bcb0-c65ec0347abd (non-flash)
Apr 13 16:23:22 user nova-compute[71731]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0f728f3-fbb5-4ed8-a78b-a5d982b03f7d (non-flash)
Apr 13 16:23:22 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 16:23:22 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbf47c70-b17d-428f-97f0-d7601655d4d4 tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8cf0277910>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:84c7f6ad-d2c2-465a-b39e-47347aa85be0'): ({'sdc'}, set())}) {{(pid=71731) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 16:23:22 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-dbf47c70-b17d-428f-97f0-d7601655d4d4 tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Removing single pathed devices sdc {{(pid=71731) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 16:23:22 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:23:22 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:23:22 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[db839f45-41d9-4f4f-ae07-784e9ab2c464]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:23:22 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:23:22 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:23:22 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[61894ff4-e1b5-40ed-97b0-80e381d31f9b]: (4, ('ok\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:23:22 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-dbf47c70-b17d-428f-97f0-d7601655d4d4 tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Flushing IO for device /dev/sdc {{(pid=71731) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 16:23:22 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:23:22 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:23:22 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[abaddf60-c0e3-47e9-a376-52ec93e34d34]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:23:22 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-dbf47c70-b17d-428f-97f0-d7601655d4d4 tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71731) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 16:23:22 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:23:22 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.041s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:23:22 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[49359ac0-c1f7-4836-90a8-5f1efd4702f7]: (4, ('1', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:23:22 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-dbf47c70-b17d-428f-97f0-d7601655d4d4 tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71731) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 16:23:22 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-dbf47c70-b17d-428f-97f0-d7601655d4d4 tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] SCSI volumes sdc have been removed. {{(pid=71731) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 16:23:22 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbf47c70-b17d-428f-97f0-d7601655d4d4 tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:84c7f6ad-d2c2-465a-b39e-47347aa85be0')] {{(pid=71731) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 16:23:22 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84c7f6ad-d2c2-465a-b39e-47347aa85be0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:23:22 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84c7f6ad-d2c2-465a-b39e-47347aa85be0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:23:22 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad7c9918-2163-4c8b-92c7-722b11ef5498]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:23:22 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbf47c70-b17d-428f-97f0-d7601655d4d4 tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:23:22 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84c7f6ad-d2c2-465a-b39e-47347aa85be0 -p 172.16.0.220:3260 --logout {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:23:23 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84c7f6ad-d2c2-465a-b39e-47347aa85be0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:23:23 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eb03ab8-3119-4052-ba8b-97f4c409c411]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:84c7f6ad-d2c2-465a-b39e-47347aa85be0, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:84c7f6ad-d2c2-465a-b39e-47347aa85be0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:23:23 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbf47c70-b17d-428f-97f0-d7601655d4d4 tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:84c7f6ad-d2c2-465a-b39e-47347aa85be0, portal: 172.16.0.220,3260]
Apr 13 16:23:23 user nova-compute[71731]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:84c7f6ad-d2c2-465a-b39e-47347aa85be0, portal: 172.16.0.220,3260] successful.
Apr 13 16:23:23 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:23:23 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84c7f6ad-d2c2-465a-b39e-47347aa85be0 -p 172.16.0.220:3260 --op delete {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:23:23 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84c7f6ad-d2c2-465a-b39e-47347aa85be0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.036s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:23:23 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[998dd0b5-eb55-49dd-be2a-8f2fa809c695]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:23:23 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbf47c70-b17d-428f-97f0-d7601655d4d4 tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:23:23 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-dbf47c70-b17d-428f-97f0-d7601655d4d4 tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.353s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 16:23:23 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbf47c70-b17d-428f-97f0-d7601655d4d4 tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] <== disconnect_volume: return (356ms) None {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 16:23:23 user nova-compute[71731]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dbf47c70-b17d-428f-97f0-d7601655d4d4 tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] [instance: e4ada2d7-7ace-4ed4-86a6-ed121c95e80f] Disconnected iSCSI Volume {{(pid=71731) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 16:23:23 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-48b63815-ac65-4477-a276-ce12f90a7768 tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.323s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 16:23:23 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:23:23 user nova-compute[71731]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dbf47c70-b17d-428f-97f0-d7601655d4d4 tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] [instance: e4ada2d7-7ace-4ed4-86a6-ed121c95e80f] calling os-brick to detach iSCSI Volume {{(pid=71731) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 16:23:23 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbf47c70-b17d-428f-97f0-d7601655d4d4 tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8cf0118790>, {'target_iqn': 'iqn.2010-10.org.openstack:c20e80fa-58de-431a-8901-2535657aaadf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UVEGFLtB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde': {}}" {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 16:23:23 user nova-compute[71731]: WARNING os_brick.initiator.connectors.base [None req-dbf47c70-b17d-428f-97f0-d7601655d4d4 tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 16:23:23 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-dbf47c70-b17d-428f-97f0-d7601655d4d4 tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 16:23:23 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:23:23 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2e3a94f-6c4f-49eb-86ec-3a5813f620af]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c20e80fa-58de-431a-8901-2535657aaadf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:27919afc-8990-4ed5-af9e-9d6b3d7b231e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0e3b49ec-80af-4c38-9689-f7277e495d21\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cc639d00-ef6b-4121-bcb0-c65ec0347abd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e0f728f3-fbb5-4ed8-a78b-a5d982b03f7d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:48af37b0-6938-432e-b374-d992c4dd9ae9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:23:23 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-48b63815-ac65-4477-a276-ce12f90a7768 tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 16:23:23 user nova-compute[71731]: No targets found.
Apr 13 16:23:23 user nova-compute[71731]: iSNS:
Apr 13 16:23:23 user nova-compute[71731]: No targets found.
Apr 13 16:23:23 user nova-compute[71731]: STATIC:
Apr 13 16:23:23 user nova-compute[71731]: Target: iqn.2010-10.org.openstack:c20e80fa-58de-431a-8901-2535657aaadf
Apr 13 16:23:23 user nova-compute[71731]:         Portal: 172.16.0.220:3260,-1
Apr 13 16:23:23 user nova-compute[71731]:                 Iface Name: default
Apr 13 16:23:23 user nova-compute[71731]: Target: iqn.2010-10.org.openstack:27919afc-8990-4ed5-af9e-9d6b3d7b231e
Apr 13 16:23:23 user nova-compute[71731]:         Portal: 172.16.0.220:3260,-1
Apr 13 16:23:23 user nova-compute[71731]:                 Iface Name: default
Apr 13 16:23:23 user nova-compute[71731]: Target: iqn.2010-10.org.openstack:0e3b49ec-80af-4c38-9689-f7277e495d21
Apr 13 16:23:23 user nova-compute[71731]:         Portal: 172.16.0.220:3260,-1
Apr 13 16:23:23 user nova-compute[71731]:                 Iface Name: default
Apr 13 16:23:23 user nova-compute[71731]: Target: iqn.2010-10.org.openstack:cc639d00-ef6b-4121-bcb0-c65ec0347abd
Apr 13 16:23:23 user nova-compute[71731]:         Portal: 172.16.0.220:3260,-1
Apr 13 16:23:23 user nova-compute[71731]:                 Iface Name: default
Apr 13 16:23:23 user nova-compute[71731]: Target: iqn.2010-10.org.openstack:e0f728f3-fbb5-4ed8-a78b-a5d982b03f7d
Apr 13 16:23:23 user nova-compute[71731]:         Portal: 172.16.0.220:3260,-1
Apr 13 16:23:23 user nova-compute[71731]:                 Iface Name: default
Apr 13 16:23:23 user nova-compute[71731]: Target: iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984
Apr 13 16:23:23 user nova-compute[71731]:         Portal: 172.16.0.220:3260,-1
Apr 13 16:23:23 user nova-compute[71731]:                 Iface Name: default
Apr 13 16:23:23 user nova-compute[71731]: Target: iqn.2010-10.org.openstack:48af37b0-6938-432e-b374-d992c4dd9ae9
Apr 13 16:23:23 user nova-compute[71731]:         Portal: 172.16.0.220:3260,-1
Apr 13 16:23:23 user nova-compute[71731]:                 Iface Name: default
Apr 13 16:23:23 user nova-compute[71731]: FIRMWARE:
Apr 13 16:23:23 user nova-compute[71731]: No targets found.
Apr 13 16:23:23 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 16:23:23 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-48b63815-ac65-4477-a276-ce12f90a7768 tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 16:23:23 user nova-compute[71731]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 16:23:23 user nova-compute[71731]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71731) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 16:23:23 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-48b63815-ac65-4477-a276-ce12f90a7768 tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:48af37b0-6938-432e-b374-d992c4dd9ae9', 0)] {{(pid=71731) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 16:23:23 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:23:23 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:23:23 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa473f53-4851-44cd-b69a-f18ae33aaba9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0e3b49ec-80af-4c38-9689-f7277e495d21\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:27919afc-8990-4ed5-af9e-9d6b3d7b231e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:48af37b0-6938-432e-b374-d992c4dd9ae9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c20e80fa-58de-431a-8901-2535657aaadf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cc639d00-ef6b-4121-bcb0-c65ec0347abd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e0f728f3-fbb5-4ed8-a78b-a5d982b03f7d\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:23:23 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:23:23 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:23:23 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcb3de93-fd2d-4a5e-84e8-7c87366f0efa]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e3b49ec-80af-4c38-9689-f7277e495d21 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48af37b0-6938-432e-b374-d992c4dd9ae9 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c20e80fa-58de-431a-8901-2535657aaadf (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27919afc-8990-4ed5-af9e-9d6b3d7b231e (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc639d00-ef6b-4121-bcb0-c65ec0347abd (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0f728f3-fbb5-4ed8-a78b-a5d982b03f7d (non-flash)\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:23:23 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-48b63815-ac65-4477-a276-ce12f90a7768 tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e3b49ec-80af-4c38-9689-f7277e495d21 (non-flash)
Apr 13 16:23:23 user nova-compute[71731]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984 (non-flash)
Apr 13 16:23:23 user nova-compute[71731]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48af37b0-6938-432e-b374-d992c4dd9ae9 (non-flash)
Apr 13 16:23:23 user nova-compute[71731]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c20e80fa-58de-431a-8901-2535657aaadf (non-flash)
Apr 13 16:23:23 user nova-compute[71731]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27919afc-8990-4ed5-af9e-9d6b3d7b231e (non-flash)
Apr 13 16:23:23 user nova-compute[71731]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc639d00-ef6b-4121-bcb0-c65ec0347abd (non-flash)
Apr 13 16:23:23 user nova-compute[71731]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0f728f3-fbb5-4ed8-a78b-a5d982b03f7d (non-flash)
Apr 13 16:23:23 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 16:23:23 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-48b63815-ac65-4477-a276-ce12f90a7768 tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e3b49ec-80af-4c38-9689-f7277e495d21 (non-flash)
Apr 13 16:23:23 user nova-compute[71731]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984 (non-flash)
Apr 13 16:23:23 user nova-compute[71731]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48af37b0-6938-432e-b374-d992c4dd9ae9 (non-flash)
Apr 13 16:23:23 user nova-compute[71731]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c20e80fa-58de-431a-8901-2535657aaadf (non-flash)
Apr 13 16:23:23 user nova-compute[71731]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27919afc-8990-4ed5-af9e-9d6b3d7b231e (non-flash)
Apr 13 16:23:23 user nova-compute[71731]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc639d00-ef6b-4121-bcb0-c65ec0347abd (non-flash)
Apr 13 16:23:23 user nova-compute[71731]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0f728f3-fbb5-4ed8-a78b-a5d982b03f7d (non-flash)
Apr 13 16:23:23 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 16:23:23 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-48b63815-ac65-4477-a276-ce12f90a7768 tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8cf0277910>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:48af37b0-6938-432e-b374-d992c4dd9ae9'): ({'sdd'}, set())}) {{(pid=71731) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 16:23:23 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-48b63815-ac65-4477-a276-ce12f90a7768 tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Removing single pathed devices sdd {{(pid=71731) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 16:23:23 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:23:23 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:23:23 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f0795ed-c329-4203-adfe-720602d6abb5]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:23:23 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:23:23 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:23:23 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[20e8957c-8a9a-4c01-adc5-0530bbe34dcb]: (4, ('ok\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:23:23 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-48b63815-ac65-4477-a276-ce12f90a7768 tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Flushing IO for device /dev/sdd {{(pid=71731) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 16:23:23 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:23:23 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:23:23 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[8133303a-9e7b-4f40-a1de-840fee7360cb]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:23:23 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-48b63815-ac65-4477-a276-ce12f90a7768 tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=71731) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 16:23:23 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:23:23 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.044s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:23:23 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[eac84b27-cfb8-437c-ae3b-c71307cac55a]: (4, ('1', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:23:23 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-48b63815-ac65-4477-a276-ce12f90a7768 tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=71731) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 16:23:23 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-48b63815-ac65-4477-a276-ce12f90a7768 tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] SCSI volumes sdd have been removed. {{(pid=71731) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 16:23:23 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-48b63815-ac65-4477-a276-ce12f90a7768 tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:48af37b0-6938-432e-b374-d992c4dd9ae9')] {{(pid=71731) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 16:23:23 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48af37b0-6938-432e-b374-d992c4dd9ae9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:23:23 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48af37b0-6938-432e-b374-d992c4dd9ae9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:23:23 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[b76fa426-a133-4a89-b815-ae68991eca0b]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:23:23 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-48b63815-ac65-4477-a276-ce12f90a7768 tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:23:23 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48af37b0-6938-432e-b374-d992c4dd9ae9 -p 172.16.0.220:3260 --logout {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:23:23 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48af37b0-6938-432e-b374-d992c4dd9ae9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:23:23 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ab693b5-569f-4283-8001-21569a3e6c1a]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:48af37b0-6938-432e-b374-d992c4dd9ae9, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:48af37b0-6938-432e-b374-d992c4dd9ae9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:23:23 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-48b63815-ac65-4477-a276-ce12f90a7768 tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:48af37b0-6938-432e-b374-d992c4dd9ae9, portal: 172.16.0.220,3260]
Apr 13 16:23:23 user nova-compute[71731]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:48af37b0-6938-432e-b374-d992c4dd9ae9, portal: 172.16.0.220,3260] successful.
Apr 13 16:23:23 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:23:23 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48af37b0-6938-432e-b374-d992c4dd9ae9 -p 172.16.0.220:3260 --op delete {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:23:23 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48af37b0-6938-432e-b374-d992c4dd9ae9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.036s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:23:23 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[89ecdf6c-3be2-45ff-9b4c-484e707f4543]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:23:23 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-48b63815-ac65-4477-a276-ce12f90a7768 tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:23:23 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-48b63815-ac65-4477-a276-ce12f90a7768 tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.353s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 16:23:23 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-48b63815-ac65-4477-a276-ce12f90a7768 tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] <== disconnect_volume: return (676ms) None {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 16:23:23 user nova-compute[71731]: DEBUG nova.virt.libvirt.volume.iscsi [None req-48b63815-ac65-4477-a276-ce12f90a7768 tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] [instance: 2549ba85-4e0a-420e-b711-07cafa8c60e9] Disconnected iSCSI Volume {{(pid=71731) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 16:23:23 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-dbf47c70-b17d-428f-97f0-d7601655d4d4 tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.349s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 16:23:23 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:23:23 user nova-compute[71731]: DEBUG nova.virt.libvirt.volume.iscsi [None req-48b63815-ac65-4477-a276-ce12f90a7768 tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] [instance: 2549ba85-4e0a-420e-b711-07cafa8c60e9] calling os-brick to detach iSCSI Volume {{(pid=71731) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 16:23:23 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-48b63815-ac65-4477-a276-ce12f90a7768 tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8cf0118790>, {'target_iqn': 'iqn.2010-10.org.openstack:27919afc-8990-4ed5-af9e-9d6b3d7b231e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cajfYKuC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf': {}}" {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 16:23:23 user nova-compute[71731]: WARNING os_brick.initiator.connectors.base [None req-48b63815-ac65-4477-a276-ce12f90a7768 tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 16:23:23 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-48b63815-ac65-4477-a276-ce12f90a7768 tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 16:23:23 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:23:23 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[66557d90-8749-4135-a5d3-13321f3c0512]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c20e80fa-58de-431a-8901-2535657aaadf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:27919afc-8990-4ed5-af9e-9d6b3d7b231e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0e3b49ec-80af-4c38-9689-f7277e495d21\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cc639d00-ef6b-4121-bcb0-c65ec0347abd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e0f728f3-fbb5-4ed8-a78b-a5d982b03f7d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:23:23 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbf47c70-b17d-428f-97f0-d7601655d4d4 tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 16:23:23 user nova-compute[71731]: No targets found.
Apr 13 16:23:23 user nova-compute[71731]: iSNS:
Apr 13 16:23:23 user nova-compute[71731]: No targets found.
Apr 13 16:23:23 user nova-compute[71731]: STATIC:
Apr 13 16:23:23 user nova-compute[71731]: Target: iqn.2010-10.org.openstack:c20e80fa-58de-431a-8901-2535657aaadf
Apr 13 16:23:23 user nova-compute[71731]:         Portal: 172.16.0.220:3260,-1
Apr 13 16:23:23 user nova-compute[71731]:                 Iface Name: default
Apr 13 16:23:23 user nova-compute[71731]: Target: iqn.2010-10.org.openstack:27919afc-8990-4ed5-af9e-9d6b3d7b231e
Apr 13 16:23:23 user nova-compute[71731]:         Portal: 172.16.0.220:3260,-1
Apr 13 16:23:23 user nova-compute[71731]:                 Iface Name: default
Apr 13 16:23:23 user nova-compute[71731]: Target: iqn.2010-10.org.openstack:0e3b49ec-80af-4c38-9689-f7277e495d21
Apr 13 16:23:23 user nova-compute[71731]:         Portal: 172.16.0.220:3260,-1
Apr 13 16:23:23 user nova-compute[71731]:                 Iface Name: default
Apr 13 16:23:23 user nova-compute[71731]: Target: iqn.2010-10.org.openstack:cc639d00-ef6b-4121-bcb0-c65ec0347abd
Apr 13 16:23:23 user nova-compute[71731]:         Portal: 172.16.0.220:3260,-1
Apr 13 16:23:23 user nova-compute[71731]:                 Iface Name: default
Apr 13 16:23:23 user nova-compute[71731]: Target: iqn.2010-10.org.openstack:e0f728f3-fbb5-4ed8-a78b-a5d982b03f7d
Apr 13 16:23:23 user nova-compute[71731]:         Portal: 172.16.0.220:3260,-1
Apr 13 16:23:23 user nova-compute[71731]:                 Iface Name: default
Apr 13 16:23:23 user nova-compute[71731]: Target: iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984
Apr 13 16:23:23 user nova-compute[71731]:         Portal: 172.16.0.220:3260,-1
Apr 13 16:23:23 user nova-compute[71731]:                 Iface Name: default
Apr 13 16:23:23 user nova-compute[71731]: FIRMWARE:
Apr 13 16:23:23 user nova-compute[71731]: No targets found.
Apr 13 16:23:23 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 16:23:23 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbf47c70-b17d-428f-97f0-d7601655d4d4 tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 16:23:23 user nova-compute[71731]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 16:23:23 user nova-compute[71731]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71731) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 16:23:23 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbf47c70-b17d-428f-97f0-d7601655d4d4 tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c20e80fa-58de-431a-8901-2535657aaadf', 0)] {{(pid=71731) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 16:23:23 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:23:23 user nova-compute[71731]: DEBUG nova.compute.manager [req-f8a0ed5b-19f3-45de-bbde-8f0b34a61bc5 req-b56725a8-e17a-4ee7-8428-a7af02fd6c9e service nova] [instance: e4ada2d7-7ace-4ed4-86a6-ed121c95e80f] Received event network-vif-plugged-0125a8df-e91c-4d65-be74-fda2f2d93938 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:23:23 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-f8a0ed5b-19f3-45de-bbde-8f0b34a61bc5 req-b56725a8-e17a-4ee7-8428-a7af02fd6c9e service nova] Acquiring lock "e4ada2d7-7ace-4ed4-86a6-ed121c95e80f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:23:23 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-f8a0ed5b-19f3-45de-bbde-8f0b34a61bc5 req-b56725a8-e17a-4ee7-8428-a7af02fd6c9e service nova] Lock "e4ada2d7-7ace-4ed4-86a6-ed121c95e80f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:23:23 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-f8a0ed5b-19f3-45de-bbde-8f0b34a61bc5 req-b56725a8-e17a-4ee7-8428-a7af02fd6c9e service nova] Lock "e4ada2d7-7ace-4ed4-86a6-ed121c95e80f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:23:23 user nova-compute[71731]: DEBUG nova.compute.manager [req-f8a0ed5b-19f3-45de-bbde-8f0b34a61bc5 req-b56725a8-e17a-4ee7-8428-a7af02fd6c9e service nova] [instance: e4ada2d7-7ace-4ed4-86a6-ed121c95e80f] No waiting events found dispatching network-vif-plugged-0125a8df-e91c-4d65-be74-fda2f2d93938 {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:23:23 user nova-compute[71731]: WARNING nova.compute.manager [req-f8a0ed5b-19f3-45de-bbde-8f0b34a61bc5 req-b56725a8-e17a-4ee7-8428-a7af02fd6c9e service nova] [instance: e4ada2d7-7ace-4ed4-86a6-ed121c95e80f] Received unexpected event network-vif-plugged-0125a8df-e91c-4d65-be74-fda2f2d93938 for instance with vm_state active and task_state deleting.
Apr 13 16:23:23 user nova-compute[71731]: DEBUG nova.compute.manager [req-f8a0ed5b-19f3-45de-bbde-8f0b34a61bc5 req-b56725a8-e17a-4ee7-8428-a7af02fd6c9e service nova] [instance: 2549ba85-4e0a-420e-b711-07cafa8c60e9] Received event network-vif-unplugged-d7155dcf-9e83-4579-b81a-7277d4a9eeaf {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:23:23 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-f8a0ed5b-19f3-45de-bbde-8f0b34a61bc5 req-b56725a8-e17a-4ee7-8428-a7af02fd6c9e service nova] Acquiring lock "2549ba85-4e0a-420e-b711-07cafa8c60e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:23:23 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-f8a0ed5b-19f3-45de-bbde-8f0b34a61bc5 req-b56725a8-e17a-4ee7-8428-a7af02fd6c9e service nova] Lock "2549ba85-4e0a-420e-b711-07cafa8c60e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:23:23 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-f8a0ed5b-19f3-45de-bbde-8f0b34a61bc5 req-b56725a8-e17a-4ee7-8428-a7af02fd6c9e service nova] Lock "2549ba85-4e0a-420e-b711-07cafa8c60e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:23:23 user nova-compute[71731]: DEBUG nova.compute.manager [req-f8a0ed5b-19f3-45de-bbde-8f0b34a61bc5 req-b56725a8-e17a-4ee7-8428-a7af02fd6c9e service nova] [instance: 2549ba85-4e0a-420e-b711-07cafa8c60e9] No waiting events found dispatching network-vif-unplugged-d7155dcf-9e83-4579-b81a-7277d4a9eeaf {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:23:23 user nova-compute[71731]: DEBUG nova.compute.manager [req-f8a0ed5b-19f3-45de-bbde-8f0b34a61bc5 req-b56725a8-e17a-4ee7-8428-a7af02fd6c9e service nova] [instance: 2549ba85-4e0a-420e-b711-07cafa8c60e9] Received event network-vif-unplugged-d7155dcf-9e83-4579-b81a-7277d4a9eeaf for instance with task_state deleting. {{(pid=71731) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 16:23:23 user nova-compute[71731]: DEBUG nova.compute.manager [req-f8a0ed5b-19f3-45de-bbde-8f0b34a61bc5 req-b56725a8-e17a-4ee7-8428-a7af02fd6c9e service nova] [instance: 2549ba85-4e0a-420e-b711-07cafa8c60e9] Received event network-vif-plugged-d7155dcf-9e83-4579-b81a-7277d4a9eeaf {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:23:23 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-f8a0ed5b-19f3-45de-bbde-8f0b34a61bc5 req-b56725a8-e17a-4ee7-8428-a7af02fd6c9e service nova] Acquiring lock "2549ba85-4e0a-420e-b711-07cafa8c60e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:23:23 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-f8a0ed5b-19f3-45de-bbde-8f0b34a61bc5 req-b56725a8-e17a-4ee7-8428-a7af02fd6c9e service nova] Lock "2549ba85-4e0a-420e-b711-07cafa8c60e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:23:23 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-f8a0ed5b-19f3-45de-bbde-8f0b34a61bc5 req-b56725a8-e17a-4ee7-8428-a7af02fd6c9e service nova] Lock "2549ba85-4e0a-420e-b711-07cafa8c60e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:23:23 user nova-compute[71731]: DEBUG nova.compute.manager [req-f8a0ed5b-19f3-45de-bbde-8f0b34a61bc5 req-b56725a8-e17a-4ee7-8428-a7af02fd6c9e service nova] [instance: 2549ba85-4e0a-420e-b711-07cafa8c60e9] No waiting events found dispatching network-vif-plugged-d7155dcf-9e83-4579-b81a-7277d4a9eeaf {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:23:23 user nova-compute[71731]: WARNING nova.compute.manager [req-f8a0ed5b-19f3-45de-bbde-8f0b34a61bc5 req-b56725a8-e17a-4ee7-8428-a7af02fd6c9e service nova] [instance: 2549ba85-4e0a-420e-b711-07cafa8c60e9] Received unexpected event network-vif-plugged-d7155dcf-9e83-4579-b81a-7277d4a9eeaf for instance with vm_state active and task_state deleting.
Apr 13 16:23:23 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:23:23 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb41160f-a48e-4b56-b984-118b3d55c05b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0e3b49ec-80af-4c38-9689-f7277e495d21\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:27919afc-8990-4ed5-af9e-9d6b3d7b231e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c20e80fa-58de-431a-8901-2535657aaadf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cc639d00-ef6b-4121-bcb0-c65ec0347abd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e0f728f3-fbb5-4ed8-a78b-a5d982b03f7d\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:23:23 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:23:23 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:23:23 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd92289d-2704-480b-8aa9-ad69bedd326e]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e3b49ec-80af-4c38-9689-f7277e495d21 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c20e80fa-58de-431a-8901-2535657aaadf (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27919afc-8990-4ed5-af9e-9d6b3d7b231e (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc639d00-ef6b-4121-bcb0-c65ec0347abd (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0f728f3-fbb5-4ed8-a78b-a5d982b03f7d (non-flash)\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:23:23 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbf47c70-b17d-428f-97f0-d7601655d4d4 tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e3b49ec-80af-4c38-9689-f7277e495d21 (non-flash)
Apr 13 16:23:23 user nova-compute[71731]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984 (non-flash)
Apr 13 16:23:23 user nova-compute[71731]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c20e80fa-58de-431a-8901-2535657aaadf (non-flash)
Apr 13 16:23:23 user nova-compute[71731]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27919afc-8990-4ed5-af9e-9d6b3d7b231e (non-flash)
Apr 13 16:23:23 user nova-compute[71731]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc639d00-ef6b-4121-bcb0-c65ec0347abd (non-flash)
Apr 13 16:23:23 user nova-compute[71731]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0f728f3-fbb5-4ed8-a78b-a5d982b03f7d (non-flash)
Apr 13 16:23:23 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 16:23:23 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbf47c70-b17d-428f-97f0-d7601655d4d4 tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e3b49ec-80af-4c38-9689-f7277e495d21 (non-flash)
Apr 13 16:23:23 user nova-compute[71731]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984 (non-flash)
Apr 13 16:23:23 user nova-compute[71731]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c20e80fa-58de-431a-8901-2535657aaadf (non-flash)
Apr 13 16:23:23 user nova-compute[71731]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27919afc-8990-4ed5-af9e-9d6b3d7b231e (non-flash)
Apr 13 16:23:23 user nova-compute[71731]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc639d00-ef6b-4121-bcb0-c65ec0347abd (non-flash)
Apr 13 16:23:23 user nova-compute[71731]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0f728f3-fbb5-4ed8-a78b-a5d982b03f7d (non-flash)
Apr 13 16:23:23 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 16:23:23 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbf47c70-b17d-428f-97f0-d7601655d4d4 tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8cf02077f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c20e80fa-58de-431a-8901-2535657aaadf'): ({'sde'}, set())}) {{(pid=71731) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 16:23:23 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-dbf47c70-b17d-428f-97f0-d7601655d4d4 tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Removing single pathed devices sde {{(pid=71731) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 16:23:23 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:23:23 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:23:23 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcee923c-426c-44b5-a89a-7a0ce539f6e2]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:23:23 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:23:23 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:23:23 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa35fa86-a4b8-41dc-8e43-a64c00c18082]: (4, ('ok\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:23:23 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-dbf47c70-b17d-428f-97f0-d7601655d4d4 tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Flushing IO for device /dev/sde {{(pid=71731) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 16:23:23 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:23:23 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:23:23 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b3509f6-7799-4e28-860b-eb9dc6e60d43]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:23:23 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-dbf47c70-b17d-428f-97f0-d7601655d4d4 tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=71731) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 16:23:23 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:23:23 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.064s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:23:23 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4406730-9d73-4e0a-8755-3fa954745b53]: (4, ('1', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:23:23 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-dbf47c70-b17d-428f-97f0-d7601655d4d4 tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=71731) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 16:23:23 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-dbf47c70-b17d-428f-97f0-d7601655d4d4 tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] SCSI volumes sde have been removed. {{(pid=71731) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 16:23:23 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbf47c70-b17d-428f-97f0-d7601655d4d4 tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c20e80fa-58de-431a-8901-2535657aaadf')] {{(pid=71731) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 16:23:23 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c20e80fa-58de-431a-8901-2535657aaadf -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:23:23 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c20e80fa-58de-431a-8901-2535657aaadf -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:23:23 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[73593c91-b784-46ab-bf92-a1e35346ff2a]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:23:23 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbf47c70-b17d-428f-97f0-d7601655d4d4 tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:23:23 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c20e80fa-58de-431a-8901-2535657aaadf -p 172.16.0.220:3260 --logout {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:23:23 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:23:23 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c20e80fa-58de-431a-8901-2535657aaadf -p 172.16.0.220:3260 --logout" returned: 0 in 0.075s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:23:23 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce3bb403-32dd-477a-8622-681e1f1245c1]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:c20e80fa-58de-431a-8901-2535657aaadf, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:c20e80fa-58de-431a-8901-2535657aaadf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:23:23 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbf47c70-b17d-428f-97f0-d7601655d4d4 tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:c20e80fa-58de-431a-8901-2535657aaadf, portal: 172.16.0.220,3260]
Apr 13 16:23:23 user nova-compute[71731]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:c20e80fa-58de-431a-8901-2535657aaadf, portal: 172.16.0.220,3260] successful.
Apr 13 16:23:23 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:23:23 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c20e80fa-58de-431a-8901-2535657aaadf -p 172.16.0.220:3260 --op delete {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:23:23 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c20e80fa-58de-431a-8901-2535657aaadf -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:23:23 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[12295480-d370-4626-95ea-f5d2c674ecbd]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:23:23 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbf47c70-b17d-428f-97f0-d7601655d4d4 tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:23:23 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-dbf47c70-b17d-428f-97f0-d7601655d4d4 tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.390s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 16:23:23 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbf47c70-b17d-428f-97f0-d7601655d4d4 tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] <== disconnect_volume: return (738ms) None {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 16:23:23 user nova-compute[71731]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dbf47c70-b17d-428f-97f0-d7601655d4d4 tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] [instance: e4ada2d7-7ace-4ed4-86a6-ed121c95e80f] Disconnected iSCSI Volume {{(pid=71731) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 16:23:23 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-48b63815-ac65-4477-a276-ce12f90a7768 tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.387s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 16:23:23 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:23:23 user nova-compute[71731]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dbf47c70-b17d-428f-97f0-d7601655d4d4 tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] [instance: e4ada2d7-7ace-4ed4-86a6-ed121c95e80f] calling os-brick to detach iSCSI Volume {{(pid=71731) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 16:23:23 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbf47c70-b17d-428f-97f0-d7601655d4d4 tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8cf0118790>, {'target_iqn': 'iqn.2010-10.org.openstack:cc639d00-ef6b-4121-bcb0-c65ec0347abd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dOqXsWnC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg': {}}" {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 16:23:23 user nova-compute[71731]: WARNING os_brick.initiator.connectors.base [None req-dbf47c70-b17d-428f-97f0-d7601655d4d4 tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 16:23:23 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-dbf47c70-b17d-428f-97f0-d7601655d4d4 tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 16:23:23 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:23:23 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[0072843a-90fe-4b3e-9c53-77cc116b42ea]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:27919afc-8990-4ed5-af9e-9d6b3d7b231e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0e3b49ec-80af-4c38-9689-f7277e495d21\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cc639d00-ef6b-4121-bcb0-c65ec0347abd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e0f728f3-fbb5-4ed8-a78b-a5d982b03f7d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:23:23 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-48b63815-ac65-4477-a276-ce12f90a7768 tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 16:23:23 user nova-compute[71731]: No targets found.
Apr 13 16:23:23 user nova-compute[71731]: iSNS:
Apr 13 16:23:23 user nova-compute[71731]: No targets found.
Apr 13 16:23:23 user nova-compute[71731]: STATIC:
Apr 13 16:23:23 user nova-compute[71731]: Target: iqn.2010-10.org.openstack:27919afc-8990-4ed5-af9e-9d6b3d7b231e
Apr 13 16:23:23 user nova-compute[71731]:         Portal: 172.16.0.220:3260,-1
Apr 13 16:23:23 user nova-compute[71731]:                 Iface Name: default
Apr 13 16:23:23 user nova-compute[71731]: Target: iqn.2010-10.org.openstack:0e3b49ec-80af-4c38-9689-f7277e495d21
Apr 13 16:23:23 user nova-compute[71731]:         Portal: 172.16.0.220:3260,-1
Apr 13 16:23:23 user nova-compute[71731]:                 Iface Name: default
Apr 13 16:23:23 user nova-compute[71731]: Target: iqn.2010-10.org.openstack:cc639d00-ef6b-4121-bcb0-c65ec0347abd
Apr 13 16:23:23 user nova-compute[71731]:         Portal: 172.16.0.220:3260,-1
Apr 13 16:23:23 user nova-compute[71731]:                 Iface Name: default
Apr 13 16:23:23 user nova-compute[71731]: Target: iqn.2010-10.org.openstack:e0f728f3-fbb5-4ed8-a78b-a5d982b03f7d
Apr 13 16:23:23 user nova-compute[71731]:         Portal: 172.16.0.220:3260,-1
Apr 13 16:23:23 user nova-compute[71731]:                 Iface Name: default
Apr 13 16:23:23 user nova-compute[71731]: Target: iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984
Apr 13 16:23:23 user nova-compute[71731]:         Portal: 172.16.0.220:3260,-1
Apr 13 16:23:23 user nova-compute[71731]:                 Iface Name: default
Apr 13 16:23:23 user nova-compute[71731]: FIRMWARE:
Apr 13 16:23:23 user nova-compute[71731]: No targets found.
Apr 13 16:23:23 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 16:23:23 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-48b63815-ac65-4477-a276-ce12f90a7768 tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 16:23:23 user nova-compute[71731]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 16:23:23 user nova-compute[71731]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71731) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 16:23:23 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-48b63815-ac65-4477-a276-ce12f90a7768 tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:27919afc-8990-4ed5-af9e-9d6b3d7b231e', 0)] {{(pid=71731) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 16:23:23 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:23:23 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:23:23 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[228f467a-9dd2-472a-9edb-2b99c2924b14]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0e3b49ec-80af-4c38-9689-f7277e495d21\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:27919afc-8990-4ed5-af9e-9d6b3d7b231e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cc639d00-ef6b-4121-bcb0-c65ec0347abd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e0f728f3-fbb5-4ed8-a78b-a5d982b03f7d\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:23:23 user nova-compute[71731]: DEBUG nova.compute.manager [req-f804aa51-bd10-4e3e-a501-e82fcf3e53bd req-a01e3729-0bc3-452b-860e-c040cd63b390 service nova] [instance: 2549ba85-4e0a-420e-b711-07cafa8c60e9] Received event network-vif-plugged-4c481745-6342-43f8-9040-3ea1d8c5c572 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:23:23 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-f804aa51-bd10-4e3e-a501-e82fcf3e53bd req-a01e3729-0bc3-452b-860e-c040cd63b390 service nova] Acquiring lock "2549ba85-4e0a-420e-b711-07cafa8c60e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:23:23 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-f804aa51-bd10-4e3e-a501-e82fcf3e53bd req-a01e3729-0bc3-452b-860e-c040cd63b390 service nova] Lock "2549ba85-4e0a-420e-b711-07cafa8c60e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:23:23 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-f804aa51-bd10-4e3e-a501-e82fcf3e53bd req-a01e3729-0bc3-452b-860e-c040cd63b390 service nova] Lock "2549ba85-4e0a-420e-b711-07cafa8c60e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:23:23 user nova-compute[71731]: DEBUG nova.compute.manager [req-f804aa51-bd10-4e3e-a501-e82fcf3e53bd req-a01e3729-0bc3-452b-860e-c040cd63b390 service nova] [instance: 2549ba85-4e0a-420e-b711-07cafa8c60e9] No waiting events found dispatching network-vif-plugged-4c481745-6342-43f8-9040-3ea1d8c5c572 {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:23:23 user nova-compute[71731]: WARNING nova.compute.manager [req-f804aa51-bd10-4e3e-a501-e82fcf3e53bd req-a01e3729-0bc3-452b-860e-c040cd63b390 service nova] [instance: 2549ba85-4e0a-420e-b711-07cafa8c60e9] Received unexpected event network-vif-plugged-4c481745-6342-43f8-9040-3ea1d8c5c572 for instance with vm_state active and task_state deleting.
Apr 13 16:23:23 user nova-compute[71731]: DEBUG nova.compute.manager [req-f804aa51-bd10-4e3e-a501-e82fcf3e53bd req-a01e3729-0bc3-452b-860e-c040cd63b390 service nova] [instance: 2549ba85-4e0a-420e-b711-07cafa8c60e9] Received event network-vif-unplugged-3730ed6e-b093-4232-800b-b064d650e9e8 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:23:23 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-f804aa51-bd10-4e3e-a501-e82fcf3e53bd req-a01e3729-0bc3-452b-860e-c040cd63b390 service nova] Acquiring lock "2549ba85-4e0a-420e-b711-07cafa8c60e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:23:23 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-f804aa51-bd10-4e3e-a501-e82fcf3e53bd req-a01e3729-0bc3-452b-860e-c040cd63b390 service nova] Lock "2549ba85-4e0a-420e-b711-07cafa8c60e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:23:23 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-f804aa51-bd10-4e3e-a501-e82fcf3e53bd req-a01e3729-0bc3-452b-860e-c040cd63b390 service nova] Lock "2549ba85-4e0a-420e-b711-07cafa8c60e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:23:23 user nova-compute[71731]: DEBUG nova.compute.manager [req-f804aa51-bd10-4e3e-a501-e82fcf3e53bd req-a01e3729-0bc3-452b-860e-c040cd63b390 service nova] [instance: 2549ba85-4e0a-420e-b711-07cafa8c60e9] No waiting events found dispatching network-vif-unplugged-3730ed6e-b093-4232-800b-b064d650e9e8 {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:23:23 user nova-compute[71731]: DEBUG nova.compute.manager [req-f804aa51-bd10-4e3e-a501-e82fcf3e53bd req-a01e3729-0bc3-452b-860e-c040cd63b390 service nova] [instance: 2549ba85-4e0a-420e-b711-07cafa8c60e9] Received event network-vif-unplugged-3730ed6e-b093-4232-800b-b064d650e9e8 for instance with task_state deleting. {{(pid=71731) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 16:23:23 user nova-compute[71731]: DEBUG nova.compute.manager [req-f804aa51-bd10-4e3e-a501-e82fcf3e53bd req-a01e3729-0bc3-452b-860e-c040cd63b390 service nova] [instance: 2549ba85-4e0a-420e-b711-07cafa8c60e9] Received event network-vif-plugged-3730ed6e-b093-4232-800b-b064d650e9e8 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:23:23 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-f804aa51-bd10-4e3e-a501-e82fcf3e53bd req-a01e3729-0bc3-452b-860e-c040cd63b390 service nova] Acquiring lock "2549ba85-4e0a-420e-b711-07cafa8c60e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:23:23 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-f804aa51-bd10-4e3e-a501-e82fcf3e53bd req-a01e3729-0bc3-452b-860e-c040cd63b390 service nova] Lock "2549ba85-4e0a-420e-b711-07cafa8c60e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:23:23 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-f804aa51-bd10-4e3e-a501-e82fcf3e53bd req-a01e3729-0bc3-452b-860e-c040cd63b390 service nova] Lock "2549ba85-4e0a-420e-b711-07cafa8c60e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:23:23 user nova-compute[71731]: DEBUG nova.compute.manager [req-f804aa51-bd10-4e3e-a501-e82fcf3e53bd req-a01e3729-0bc3-452b-860e-c040cd63b390 service nova] [instance: 2549ba85-4e0a-420e-b711-07cafa8c60e9] No waiting events found dispatching network-vif-plugged-3730ed6e-b093-4232-800b-b064d650e9e8 {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:23:23 user nova-compute[71731]: WARNING nova.compute.manager [req-f804aa51-bd10-4e3e-a501-e82fcf3e53bd req-a01e3729-0bc3-452b-860e-c040cd63b390 service nova] [instance: 2549ba85-4e0a-420e-b711-07cafa8c60e9] Received unexpected event network-vif-plugged-3730ed6e-b093-4232-800b-b064d650e9e8 for instance with vm_state active and task_state deleting.
Apr 13 16:23:23 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:23:23 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:23:23 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb07488a-d6fe-4561-b66a-a021367e42cb]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e3b49ec-80af-4c38-9689-f7277e495d21 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27919afc-8990-4ed5-af9e-9d6b3d7b231e (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc639d00-ef6b-4121-bcb0-c65ec0347abd (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0f728f3-fbb5-4ed8-a78b-a5d982b03f7d (non-flash)\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:23:23 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-48b63815-ac65-4477-a276-ce12f90a7768 tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e3b49ec-80af-4c38-9689-f7277e495d21 (non-flash)
Apr 13 16:23:23 user nova-compute[71731]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984 (non-flash)
Apr 13 16:23:23 user nova-compute[71731]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27919afc-8990-4ed5-af9e-9d6b3d7b231e (non-flash)
Apr 13 16:23:23 user nova-compute[71731]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc639d00-ef6b-4121-bcb0-c65ec0347abd (non-flash)
Apr 13 16:23:23 user nova-compute[71731]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0f728f3-fbb5-4ed8-a78b-a5d982b03f7d (non-flash)
Apr 13 16:23:23 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 16:23:23 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-48b63815-ac65-4477-a276-ce12f90a7768 tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e3b49ec-80af-4c38-9689-f7277e495d21 (non-flash)
Apr 13 16:23:23 user nova-compute[71731]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984 (non-flash)
Apr 13 16:23:23 user nova-compute[71731]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27919afc-8990-4ed5-af9e-9d6b3d7b231e (non-flash)
Apr 13 16:23:23 user nova-compute[71731]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc639d00-ef6b-4121-bcb0-c65ec0347abd (non-flash)
Apr 13 16:23:23 user nova-compute[71731]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0f728f3-fbb5-4ed8-a78b-a5d982b03f7d (non-flash)
Apr 13 16:23:23 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 16:23:23 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-48b63815-ac65-4477-a276-ce12f90a7768 tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8cf0205bd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:27919afc-8990-4ed5-af9e-9d6b3d7b231e'): ({'sdf'}, set())}) {{(pid=71731) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 16:23:23 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-48b63815-ac65-4477-a276-ce12f90a7768 tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Removing single pathed devices sdf {{(pid=71731) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 16:23:23 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:23:23 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:23:23 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[84bc532a-e377-4c93-a449-bcd3330179b6]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:23:23 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:23:23 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:23:23 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[04bcb4ec-4f6c-456c-8155-ad89c06d83cb]: (4, ('ok\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:23:23 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-48b63815-ac65-4477-a276-ce12f90a7768 tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Flushing IO for device /dev/sdf {{(pid=71731) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 16:23:23 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:23:23 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.012s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:23:23 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a68ff3d-b98d-4f50-abd3-09f22952a2ba]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:23:23 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-48b63815-ac65-4477-a276-ce12f90a7768 tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=71731) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 16:23:23 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:23:24 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.047s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:23:24 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[a361d50e-70fa-4712-86df-67c4b8e60f28]: (4, ('1', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:23:24 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-48b63815-ac65-4477-a276-ce12f90a7768 tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=71731) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 16:23:24 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-48b63815-ac65-4477-a276-ce12f90a7768 tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] SCSI volumes sdf have been removed. {{(pid=71731) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 16:23:24 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-48b63815-ac65-4477-a276-ce12f90a7768 tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:27919afc-8990-4ed5-af9e-9d6b3d7b231e')] {{(pid=71731) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 16:23:24 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27919afc-8990-4ed5-af9e-9d6b3d7b231e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:23:24 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27919afc-8990-4ed5-af9e-9d6b3d7b231e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:23:24 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[59f7f0d7-165f-4aa1-8a84-b98d11c01cfd]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:23:24 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-48b63815-ac65-4477-a276-ce12f90a7768 tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:23:24 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27919afc-8990-4ed5-af9e-9d6b3d7b231e -p 172.16.0.220:3260 --logout {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:23:24 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27919afc-8990-4ed5-af9e-9d6b3d7b231e -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:23:24 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f1b6eea-a364-4484-adf4-e3000a35cdd4]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:27919afc-8990-4ed5-af9e-9d6b3d7b231e, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:27919afc-8990-4ed5-af9e-9d6b3d7b231e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:23:24 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-48b63815-ac65-4477-a276-ce12f90a7768 tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:27919afc-8990-4ed5-af9e-9d6b3d7b231e, portal: 172.16.0.220,3260]
Apr 13 16:23:24 user nova-compute[71731]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:27919afc-8990-4ed5-af9e-9d6b3d7b231e, portal: 172.16.0.220,3260] successful.
Apr 13 16:23:24 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:23:24 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27919afc-8990-4ed5-af9e-9d6b3d7b231e -p 172.16.0.220:3260 --op delete {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:23:24 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27919afc-8990-4ed5-af9e-9d6b3d7b231e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:23:24 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ebf5f1d-4744-46ce-bc28-680b7ab4349a]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:23:24 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-48b63815-ac65-4477-a276-ce12f90a7768 tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:23:24 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-48b63815-ac65-4477-a276-ce12f90a7768 tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.313s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 16:23:24 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-48b63815-ac65-4477-a276-ce12f90a7768 tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] <== disconnect_volume: return (699ms) None {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 16:23:24 user nova-compute[71731]: DEBUG nova.virt.libvirt.volume.iscsi [None req-48b63815-ac65-4477-a276-ce12f90a7768 tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] [instance: 2549ba85-4e0a-420e-b711-07cafa8c60e9] Disconnected iSCSI Volume {{(pid=71731) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 16:23:24 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-dbf47c70-b17d-428f-97f0-d7601655d4d4 tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.310s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 16:23:24 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:23:24 user nova-compute[71731]: DEBUG nova.virt.libvirt.volume.iscsi [None req-48b63815-ac65-4477-a276-ce12f90a7768 tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] [instance: 2549ba85-4e0a-420e-b711-07cafa8c60e9] calling os-brick to detach iSCSI Volume {{(pid=71731) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 16:23:24 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-48b63815-ac65-4477-a276-ce12f90a7768 tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8cf0118790>, {'target_iqn': 'iqn.2010-10.org.openstack:e0f728f3-fbb5-4ed8-a78b-a5d982b03f7d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nSEqPQZM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh': {}}" {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 16:23:24 user nova-compute[71731]: WARNING os_brick.initiator.connectors.base [None req-48b63815-ac65-4477-a276-ce12f90a7768 tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 16:23:24 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-48b63815-ac65-4477-a276-ce12f90a7768 tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 16:23:24 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:23:24 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9bd0fa4-052f-4701-b0ca-3062b6933712]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0e3b49ec-80af-4c38-9689-f7277e495d21\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cc639d00-ef6b-4121-bcb0-c65ec0347abd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e0f728f3-fbb5-4ed8-a78b-a5d982b03f7d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:23:24 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbf47c70-b17d-428f-97f0-d7601655d4d4 tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 16:23:24 user nova-compute[71731]: No targets found.
Apr 13 16:23:24 user nova-compute[71731]: iSNS:
Apr 13 16:23:24 user nova-compute[71731]: No targets found.
Apr 13 16:23:24 user nova-compute[71731]: STATIC:
Apr 13 16:23:24 user nova-compute[71731]: Target: iqn.2010-10.org.openstack:0e3b49ec-80af-4c38-9689-f7277e495d21
Apr 13 16:23:24 user nova-compute[71731]:         Portal: 172.16.0.220:3260,-1
Apr 13 16:23:24 user nova-compute[71731]:                 Iface Name: default
Apr 13 16:23:24 user nova-compute[71731]: Target: iqn.2010-10.org.openstack:cc639d00-ef6b-4121-bcb0-c65ec0347abd
Apr 13 16:23:24 user nova-compute[71731]:         Portal: 172.16.0.220:3260,-1
Apr 13 16:23:24 user nova-compute[71731]:                 Iface Name: default
Apr 13 16:23:24 user nova-compute[71731]: Target: iqn.2010-10.org.openstack:e0f728f3-fbb5-4ed8-a78b-a5d982b03f7d
Apr 13 16:23:24 user nova-compute[71731]:         Portal: 172.16.0.220:3260,-1
Apr 13 16:23:24 user nova-compute[71731]:                 Iface Name: default
Apr 13 16:23:24 user nova-compute[71731]: Target: iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984
Apr 13 16:23:24 user nova-compute[71731]:         Portal: 172.16.0.220:3260,-1
Apr 13 16:23:24 user nova-compute[71731]:                 Iface Name: default
Apr 13 16:23:24 user nova-compute[71731]: FIRMWARE:
Apr 13 16:23:24 user nova-compute[71731]: No targets found.
Apr 13 16:23:24 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 16:23:24 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbf47c70-b17d-428f-97f0-d7601655d4d4 tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 16:23:24 user nova-compute[71731]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 16:23:24 user nova-compute[71731]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71731) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 16:23:24 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbf47c70-b17d-428f-97f0-d7601655d4d4 tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cc639d00-ef6b-4121-bcb0-c65ec0347abd', 0)] {{(pid=71731) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 16:23:24 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:23:24 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:23:24 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d1415d8-c0be-4e78-80df-67ba6e187f91]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0e3b49ec-80af-4c38-9689-f7277e495d21\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cc639d00-ef6b-4121-bcb0-c65ec0347abd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e0f728f3-fbb5-4ed8-a78b-a5d982b03f7d\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:23:24 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:23:24 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:23:24 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[981ee9a0-cb50-4a0d-b81e-c805ccd7c572]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e3b49ec-80af-4c38-9689-f7277e495d21 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc639d00-ef6b-4121-bcb0-c65ec0347abd (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0f728f3-fbb5-4ed8-a78b-a5d982b03f7d (non-flash)\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:23:24 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbf47c70-b17d-428f-97f0-d7601655d4d4 tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e3b49ec-80af-4c38-9689-f7277e495d21 (non-flash)
Apr 13 16:23:24 user nova-compute[71731]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984 (non-flash)
Apr 13 16:23:24 user nova-compute[71731]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc639d00-ef6b-4121-bcb0-c65ec0347abd (non-flash)
Apr 13 16:23:24 user nova-compute[71731]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0f728f3-fbb5-4ed8-a78b-a5d982b03f7d (non-flash)
Apr 13 16:23:24 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 16:23:24 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbf47c70-b17d-428f-97f0-d7601655d4d4 tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e3b49ec-80af-4c38-9689-f7277e495d21 (non-flash)
Apr 13 16:23:24 user nova-compute[71731]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984 (non-flash)
Apr 13 16:23:24 user nova-compute[71731]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc639d00-ef6b-4121-bcb0-c65ec0347abd (non-flash)
Apr 13 16:23:24 user nova-compute[71731]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0f728f3-fbb5-4ed8-a78b-a5d982b03f7d (non-flash)
Apr 13 16:23:24 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 16:23:24 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbf47c70-b17d-428f-97f0-d7601655d4d4 tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8cff381f30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cc639d00-ef6b-4121-bcb0-c65ec0347abd'): ({'sdg'}, set())}) {{(pid=71731) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 16:23:24 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-dbf47c70-b17d-428f-97f0-d7601655d4d4 tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Removing single pathed devices sdg {{(pid=71731) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 16:23:24 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:23:24 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:23:24 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[20084296-b89e-4e3a-b50b-20634e1aefd2]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:23:24 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:23:24 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.018s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:23:24 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[f38c89a7-8bd0-4774-9257-191501063926]: (4, ('ok\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:23:24 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-dbf47c70-b17d-428f-97f0-d7601655d4d4 tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Flushing IO for device /dev/sdg {{(pid=71731) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 16:23:24 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:23:24 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.016s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:23:24 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fb303b8-1afb-447e-b093-1ca98c664717]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:23:24 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-dbf47c70-b17d-428f-97f0-d7601655d4d4 tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=71731) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 16:23:24 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:23:24 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.040s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:23:24 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bbd47e2-da2f-4ef6-ba62-361245274e93]: (4, ('1', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:23:24 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-dbf47c70-b17d-428f-97f0-d7601655d4d4 tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=71731) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 16:23:24 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-dbf47c70-b17d-428f-97f0-d7601655d4d4 tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] SCSI volumes sdg have been removed. {{(pid=71731) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 16:23:24 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbf47c70-b17d-428f-97f0-d7601655d4d4 tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cc639d00-ef6b-4121-bcb0-c65ec0347abd')] {{(pid=71731) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 16:23:24 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc639d00-ef6b-4121-bcb0-c65ec0347abd -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:23:24 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc639d00-ef6b-4121-bcb0-c65ec0347abd -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:23:24 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3edbe29-b294-4b6d-8b37-81db51ae0495]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:23:24 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbf47c70-b17d-428f-97f0-d7601655d4d4 tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:23:24 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc639d00-ef6b-4121-bcb0-c65ec0347abd -p 172.16.0.220:3260 --logout {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:23:24 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc639d00-ef6b-4121-bcb0-c65ec0347abd -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:23:24 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[831cfbb2-f4c7-415e-8732-ef93b8933c6b]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:cc639d00-ef6b-4121-bcb0-c65ec0347abd, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:cc639d00-ef6b-4121-bcb0-c65ec0347abd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:23:24 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbf47c70-b17d-428f-97f0-d7601655d4d4 tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:cc639d00-ef6b-4121-bcb0-c65ec0347abd, portal: 172.16.0.220,3260]
Apr 13 16:23:24 user nova-compute[71731]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:cc639d00-ef6b-4121-bcb0-c65ec0347abd, portal: 172.16.0.220,3260] successful.
Apr 13 16:23:24 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:23:24 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc639d00-ef6b-4121-bcb0-c65ec0347abd -p 172.16.0.220:3260 --op delete {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:23:24 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc639d00-ef6b-4121-bcb0-c65ec0347abd -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:23:24 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[7060854c-34a8-4cd8-9b55-5afc4dbf90a4]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:23:24 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbf47c70-b17d-428f-97f0-d7601655d4d4 tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:23:24 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-dbf47c70-b17d-428f-97f0-d7601655d4d4 tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.324s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 16:23:24 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbf47c70-b17d-428f-97f0-d7601655d4d4 tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] <== disconnect_volume: return (633ms) None {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 16:23:24 user nova-compute[71731]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dbf47c70-b17d-428f-97f0-d7601655d4d4 tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] [instance: e4ada2d7-7ace-4ed4-86a6-ed121c95e80f] Disconnected iSCSI Volume {{(pid=71731) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 16:23:24 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-dbf47c70-b17d-428f-97f0-d7601655d4d4 tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] [instance: e4ada2d7-7ace-4ed4-86a6-ed121c95e80f] Deleting instance files /opt/stack/data/nova/instances/e4ada2d7-7ace-4ed4-86a6-ed121c95e80f_del
Apr 13 16:23:24 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-dbf47c70-b17d-428f-97f0-d7601655d4d4 tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] [instance: e4ada2d7-7ace-4ed4-86a6-ed121c95e80f] Deletion of /opt/stack/data/nova/instances/e4ada2d7-7ace-4ed4-86a6-ed121c95e80f_del complete
Apr 13 16:23:24 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-48b63815-ac65-4477-a276-ce12f90a7768 tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.337s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 16:23:24 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:23:24 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:23:24 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5bc5826-aef2-467f-8f65-189ffea2a286]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0e3b49ec-80af-4c38-9689-f7277e495d21\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e0f728f3-fbb5-4ed8-a78b-a5d982b03f7d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:23:24 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-48b63815-ac65-4477-a276-ce12f90a7768 tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 16:23:24 user nova-compute[71731]: No targets found.
Apr 13 16:23:24 user nova-compute[71731]: iSNS:
Apr 13 16:23:24 user nova-compute[71731]: No targets found.
Apr 13 16:23:24 user nova-compute[71731]: STATIC:
Apr 13 16:23:24 user nova-compute[71731]: Target: iqn.2010-10.org.openstack:0e3b49ec-80af-4c38-9689-f7277e495d21
Apr 13 16:23:24 user nova-compute[71731]:         Portal: 172.16.0.220:3260,-1
Apr 13 16:23:24 user nova-compute[71731]:                 Iface Name: default
Apr 13 16:23:24 user nova-compute[71731]: Target: iqn.2010-10.org.openstack:e0f728f3-fbb5-4ed8-a78b-a5d982b03f7d
Apr 13 16:23:24 user nova-compute[71731]:         Portal: 172.16.0.220:3260,-1
Apr 13 16:23:24 user nova-compute[71731]:                 Iface Name: default
Apr 13 16:23:24 user nova-compute[71731]: Target: iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984
Apr 13 16:23:24 user nova-compute[71731]:         Portal: 172.16.0.220:3260,-1
Apr 13 16:23:24 user nova-compute[71731]:                 Iface Name: default
Apr 13 16:23:24 user nova-compute[71731]: FIRMWARE:
Apr 13 16:23:24 user nova-compute[71731]: No targets found.
Apr 13 16:23:24 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 16:23:24 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-48b63815-ac65-4477-a276-ce12f90a7768 tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 16:23:24 user nova-compute[71731]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 16:23:24 user nova-compute[71731]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71731) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 16:23:24 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-48b63815-ac65-4477-a276-ce12f90a7768 tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e0f728f3-fbb5-4ed8-a78b-a5d982b03f7d', 0)] {{(pid=71731) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 16:23:24 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:23:24 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:23:24 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc61df7a-01a5-4900-ba6a-e7a9f7dad5d5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0e3b49ec-80af-4c38-9689-f7277e495d21\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e0f728f3-fbb5-4ed8-a78b-a5d982b03f7d\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:23:24 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:23:24 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:23:24 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[0046b033-e771-4458-9507-8626e6a11ca6]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e3b49ec-80af-4c38-9689-f7277e495d21 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0f728f3-fbb5-4ed8-a78b-a5d982b03f7d (non-flash)\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:23:24 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-48b63815-ac65-4477-a276-ce12f90a7768 tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e3b49ec-80af-4c38-9689-f7277e495d21 (non-flash)
Apr 13 16:23:24 user nova-compute[71731]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984 (non-flash)
Apr 13 16:23:24 user nova-compute[71731]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0f728f3-fbb5-4ed8-a78b-a5d982b03f7d (non-flash)
Apr 13 16:23:24 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 16:23:24 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-48b63815-ac65-4477-a276-ce12f90a7768 tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e3b49ec-80af-4c38-9689-f7277e495d21 (non-flash)
Apr 13 16:23:24 user nova-compute[71731]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984 (non-flash)
Apr 13 16:23:24 user nova-compute[71731]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0f728f3-fbb5-4ed8-a78b-a5d982b03f7d (non-flash)
Apr 13 16:23:24 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 16:23:24 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-48b63815-ac65-4477-a276-ce12f90a7768 tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8cf0674af0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e0f728f3-fbb5-4ed8-a78b-a5d982b03f7d'): ({'sdh'}, set())}) {{(pid=71731) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 16:23:24 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-48b63815-ac65-4477-a276-ce12f90a7768 tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Removing single pathed devices sdh {{(pid=71731) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 16:23:24 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:23:24 user nova-compute[71731]: INFO nova.compute.manager [None req-dbf47c70-b17d-428f-97f0-d7601655d4d4 tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] [instance: e4ada2d7-7ace-4ed4-86a6-ed121c95e80f] Took 5.69 seconds to destroy the instance on the hypervisor.
Apr 13 16:23:24 user nova-compute[71731]: DEBUG oslo.service.loopingcall [None req-dbf47c70-b17d-428f-97f0-d7601655d4d4 tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71731) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 16:23:24 user nova-compute[71731]: DEBUG nova.compute.manager [-] [instance: e4ada2d7-7ace-4ed4-86a6-ed121c95e80f] Deallocating network for instance {{(pid=71731) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 16:23:24 user nova-compute[71731]: DEBUG nova.network.neutron [-] [instance: e4ada2d7-7ace-4ed4-86a6-ed121c95e80f] deallocate_for_instance() {{(pid=71731) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 16:23:24 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:23:24 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[46c38546-4301-43fc-a9e3-586e520de78c]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:23:24 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:23:24 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.023s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:23:24 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[4844e25e-1d82-4b33-9172-b8928ce04c27]: (4, ('ok\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:23:24 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-48b63815-ac65-4477-a276-ce12f90a7768 tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Flushing IO for device /dev/sdh {{(pid=71731) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 16:23:24 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:23:24 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.015s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:23:24 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7abf3d6-1312-4039-a904-7a476a7d74df]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:23:24 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-48b63815-ac65-4477-a276-ce12f90a7768 tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=71731) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 16:23:24 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:23:24 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.041s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:23:24 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[d79e652e-ba7e-40c8-807f-d2e9741ac0e4]: (4, ('1', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:23:24 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-48b63815-ac65-4477-a276-ce12f90a7768 tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=71731) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 16:23:24 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-48b63815-ac65-4477-a276-ce12f90a7768 tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] SCSI volumes sdh have been removed. {{(pid=71731) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 16:23:24 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-48b63815-ac65-4477-a276-ce12f90a7768 tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e0f728f3-fbb5-4ed8-a78b-a5d982b03f7d')] {{(pid=71731) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 16:23:24 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0f728f3-fbb5-4ed8-a78b-a5d982b03f7d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:23:24 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0f728f3-fbb5-4ed8-a78b-a5d982b03f7d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:23:24 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[59f3e5d4-3cec-46aa-8f52-4486ad33ea50]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:23:24 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-48b63815-ac65-4477-a276-ce12f90a7768 tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:23:24 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0f728f3-fbb5-4ed8-a78b-a5d982b03f7d -p 172.16.0.220:3260 --logout {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:23:24 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0f728f3-fbb5-4ed8-a78b-a5d982b03f7d -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:23:24 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[d72604d1-3234-4c65-a43a-e6956d749e4d]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:e0f728f3-fbb5-4ed8-a78b-a5d982b03f7d, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:e0f728f3-fbb5-4ed8-a78b-a5d982b03f7d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:23:24 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-48b63815-ac65-4477-a276-ce12f90a7768 tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:e0f728f3-fbb5-4ed8-a78b-a5d982b03f7d, portal: 172.16.0.220,3260]
Apr 13 16:23:24 user nova-compute[71731]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:e0f728f3-fbb5-4ed8-a78b-a5d982b03f7d, portal: 172.16.0.220,3260] successful.
Apr 13 16:23:24 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:23:24 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0f728f3-fbb5-4ed8-a78b-a5d982b03f7d -p 172.16.0.220:3260 --op delete {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:23:24 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0f728f3-fbb5-4ed8-a78b-a5d982b03f7d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:23:24 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[56be2407-4d70-443b-baab-645a438cc82a]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:23:24 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-48b63815-ac65-4477-a276-ce12f90a7768 tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:23:24 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-48b63815-ac65-4477-a276-ce12f90a7768 tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.328s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 16:23:24 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-48b63815-ac65-4477-a276-ce12f90a7768 tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] <== disconnect_volume: return (664ms) None {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 16:23:24 user nova-compute[71731]: DEBUG nova.virt.libvirt.volume.iscsi [None req-48b63815-ac65-4477-a276-ce12f90a7768 tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] [instance: 2549ba85-4e0a-420e-b711-07cafa8c60e9] Disconnected iSCSI Volume {{(pid=71731) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 16:23:24 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-48b63815-ac65-4477-a276-ce12f90a7768 tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] [instance: 2549ba85-4e0a-420e-b711-07cafa8c60e9] Deleting instance files /opt/stack/data/nova/instances/2549ba85-4e0a-420e-b711-07cafa8c60e9_del
Apr 13 16:23:24 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-48b63815-ac65-4477-a276-ce12f90a7768 tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] [instance: 2549ba85-4e0a-420e-b711-07cafa8c60e9] Deletion of /opt/stack/data/nova/instances/2549ba85-4e0a-420e-b711-07cafa8c60e9_del complete
Apr 13 16:23:24 user nova-compute[71731]: INFO nova.compute.manager [None req-48b63815-ac65-4477-a276-ce12f90a7768 tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] [instance: 2549ba85-4e0a-420e-b711-07cafa8c60e9] Took 5.66 seconds to destroy the instance on the hypervisor.
Apr 13 16:23:24 user nova-compute[71731]: DEBUG oslo.service.loopingcall [None req-48b63815-ac65-4477-a276-ce12f90a7768 tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71731) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 16:23:24 user nova-compute[71731]: DEBUG nova.compute.manager [-] [instance: 2549ba85-4e0a-420e-b711-07cafa8c60e9] Deallocating network for instance {{(pid=71731) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 16:23:24 user nova-compute[71731]: DEBUG nova.network.neutron [-] [instance: 2549ba85-4e0a-420e-b711-07cafa8c60e9] deallocate_for_instance() {{(pid=71731) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 16:23:26 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-a969112c-b8b8-4710-b337-1114a7ebb0b2 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Acquiring lock "031c7939-a53c-4f7d-9f36-4ec1d06e2717" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:23:26 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-a969112c-b8b8-4710-b337-1114a7ebb0b2 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Lock "031c7939-a53c-4f7d-9f36-4ec1d06e2717" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:23:26 user nova-compute[71731]: DEBUG nova.objects.instance [None req-a969112c-b8b8-4710-b337-1114a7ebb0b2 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Lazy-loading 'flavor' on Instance uuid 031c7939-a53c-4f7d-9f36-4ec1d06e2717 {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:23:26 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-a969112c-b8b8-4710-b337-1114a7ebb0b2 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] [instance: 031c7939-a53c-4f7d-9f36-4ec1d06e2717] Ignoring supplied device name: /dev/vdb
Apr 13 16:23:26 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-a969112c-b8b8-4710-b337-1114a7ebb0b2 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Lock "031c7939-a53c-4f7d-9f36-4ec1d06e2717" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.064s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:23:26 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-a969112c-b8b8-4710-b337-1114a7ebb0b2 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Acquiring lock "031c7939-a53c-4f7d-9f36-4ec1d06e2717" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:23:26 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-a969112c-b8b8-4710-b337-1114a7ebb0b2 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Lock "031c7939-a53c-4f7d-9f36-4ec1d06e2717" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:23:26 user nova-compute[71731]: INFO nova.compute.manager [None req-a969112c-b8b8-4710-b337-1114a7ebb0b2 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] [instance: 031c7939-a53c-4f7d-9f36-4ec1d06e2717] Attaching volume e962a4d5-41c9-4b3b-b78e-c25e451aa73f to /dev/vdb
Apr 13 16:23:26 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:23:26 user nova-compute[71731]: DEBUG os_brick.utils [None req-a969112c-b8b8-4710-b337-1114a7ebb0b2 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 16:23:26 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:23:26 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:23:26 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fabb31d-b158-43f8-b404-7c10b83e9447]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:81501d91421\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:23:26 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:23:26 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:23:26 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[23eda2ba-3158-486d-b600-961146a758fa]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:23:26 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:23:26 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:23:26 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f667e88-659e-4a6c-bfbc-b0874930216b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:23:26 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[96da73f9-faf0-4fe2-92e3-c088934d597d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:23:26 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-a969112c-b8b8-4710-b337-1114a7ebb0b2 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Running cmd (subprocess): nvme version {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:23:26 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-a969112c-b8b8-4710-b337-1114a7ebb0b2 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] 'nvme version' failed. Not Retrying. {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 16:23:26 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a969112c-b8b8-4710-b337-1114a7ebb0b2 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] nvme not present on system {{(pid=71731) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 16:23:26 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:23:26 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 16:23:26 user nova-compute[71731]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 16:23:26 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[04250922-2604-4e74-8165-cd72f40b0d88]: (4, '') {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:23:26 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.lightos [None req-a969112c-b8b8-4710-b337-1114a7ebb0b2 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71731) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 16:23:26 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.lightos [None req-a969112c-b8b8-4710-b337-1114a7ebb0b2 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71731) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 16:23:26 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.lightos [None req-a969112c-b8b8-4710-b337-1114a7ebb0b2 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] LIGHTOS: no hostnqn found. {{(pid=71731) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 16:23:26 user nova-compute[71731]: DEBUG os_brick.utils [None req-a969112c-b8b8-4710-b337-1114a7ebb0b2 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:81501d91421', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 16:23:26 user nova-compute[71731]: DEBUG nova.virt.block_device [None req-a969112c-b8b8-4710-b337-1114a7ebb0b2 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] [instance: 031c7939-a53c-4f7d-9f36-4ec1d06e2717] Updating existing volume attachment record: 7ca70fe2-eeb6-42b5-9565-83764a8035d0 {{(pid=71731) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 16:23:27 user nova-compute[71731]: DEBUG nova.compute.manager [None req-9e131767-04d4-45b2-8e12-2a4ab0daa556 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: 235f827c-7116-48e9-84c5-0c9761c18e1e] Start spawning the instance on the hypervisor. {{(pid=71731) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 16:23:27 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-9e131767-04d4-45b2-8e12-2a4ab0daa556 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: 235f827c-7116-48e9-84c5-0c9761c18e1e] Creating instance directory {{(pid=71731) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 16:23:27 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-9e131767-04d4-45b2-8e12-2a4ab0daa556 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: 235f827c-7116-48e9-84c5-0c9761c18e1e] Creating image(s)
Apr 13 16:23:27 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-9e131767-04d4-45b2-8e12-2a4ab0daa556 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: 235f827c-7116-48e9-84c5-0c9761c18e1e] Did not create local disks {{(pid=71731) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 13 16:23:27 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-9e131767-04d4-45b2-8e12-2a4ab0daa556 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: 235f827c-7116-48e9-84c5-0c9761c18e1e] Ensure instance console log exists: /opt/stack/data/nova/instances/235f827c-7116-48e9-84c5-0c9761c18e1e/console.log {{(pid=71731) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 16:23:27 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-9e131767-04d4-45b2-8e12-2a4ab0daa556 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:23:27 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-9e131767-04d4-45b2-8e12-2a4ab0daa556 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:23:27 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-9e131767-04d4-45b2-8e12-2a4ab0daa556 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:23:27 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-9e131767-04d4-45b2-8e12-2a4ab0daa556 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: 235f827c-7116-48e9-84c5-0c9761c18e1e] Start _get_guest_xml network_info=[{"id": "b72a6c8b-7244-41c2-a4f7-6da43b4944b8", "address": "fa:16:3e:e3:62:b0", "network": {"id": "5a7877ff-8230-470b-90b5-e5dcfc8f0cee", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-779403873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2d09a74bf684a9fb1dd1e95d6c23f3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb72a6c8b-72", "ovs_interfaceid": "b72a6c8b-7244-41c2-a4f7-6da43b4944b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T16:16:31Z,direct_url=<?>,disk_format='qcow2',id=708622a9-7465-4492-ade8-b827198f7e30,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='0b29a975c552465aba0ac7d6288434bd',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T16:16:33Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'attachment_id': 'b8388986-c360-4397-bc94-4299e0fa216f', 'mount_device': '/dev/vda', 'delete_on_termination': False, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jqPGdnMb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '235f827c-7116-48e9-84c5-0c9761c18e1e', 'attached_at': '', 'detached_at': '', 'volume_id': '417090c0-76a2-4277-9095-5c5095638b97', 'serial': '417090c0-76a2-4277-9095-5c5095638b97'}, 'disk_bus': 'virtio', 'guest_format': None, 'volume_type': None} {{(pid=71731) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 16:23:27 user nova-compute[71731]: WARNING nova.virt.libvirt.driver [None req-9e131767-04d4-45b2-8e12-2a4ab0daa556 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 16:23:27 user nova-compute[71731]: WARNING nova.virt.libvirt.driver [None req-9e131767-04d4-45b2-8e12-2a4ab0daa556 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 16:23:27 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-9e131767-04d4-45b2-8e12-2a4ab0daa556 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71731) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 16:23:27 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-9e131767-04d4-45b2-8e12-2a4ab0daa556 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T16:17:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T16:16:31Z,direct_url=<?>,disk_format='qcow2',id=708622a9-7465-4492-ade8-b827198f7e30,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='0b29a975c552465aba0ac7d6288434bd',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T16:16:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 16:23:27 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-9e131767-04d4-45b2-8e12-2a4ab0daa556 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Flavor limits 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 16:23:27 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-9e131767-04d4-45b2-8e12-2a4ab0daa556 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Image limits 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 16:23:27 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-9e131767-04d4-45b2-8e12-2a4ab0daa556 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Flavor pref 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 16:23:27 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-9e131767-04d4-45b2-8e12-2a4ab0daa556 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Image pref 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 16:23:27 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-9e131767-04d4-45b2-8e12-2a4ab0daa556 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 16:23:27 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-9e131767-04d4-45b2-8e12-2a4ab0daa556 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 16:23:27 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-9e131767-04d4-45b2-8e12-2a4ab0daa556 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71731) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 16:23:27 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-9e131767-04d4-45b2-8e12-2a4ab0daa556 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Got 1 possible topologies {{(pid=71731) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 16:23:27 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-9e131767-04d4-45b2-8e12-2a4ab0daa556 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 16:23:27 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-9e131767-04d4-45b2-8e12-2a4ab0daa556 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 16:23:27 user nova-compute[71731]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9e131767-04d4-45b2-8e12-2a4ab0daa556 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: 235f827c-7116-48e9-84c5-0c9761c18e1e] Calling os-brick to attach iSCSI Volume {{(pid=71731) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 16:23:27 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e131767-04d4-45b2-8e12-2a4ab0daa556 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8cf0118790>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jqPGdnMb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 16:23:27 user nova-compute[71731]: WARNING os_brick.initiator.connectors.base [None req-9e131767-04d4-45b2-8e12-2a4ab0daa556 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 16:23:27 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-9e131767-04d4-45b2-8e12-2a4ab0daa556 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 16:23:27 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-9e131767-04d4-45b2-8e12-2a4ab0daa556 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 16:23:27 user nova-compute[71731]: WARNING os_brick.initiator.connectors.base [None req-9e131767-04d4-45b2-8e12-2a4ab0daa556 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 16:23:27 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-9e131767-04d4-45b2-8e12-2a4ab0daa556 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 16:23:27 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-9e131767-04d4-45b2-8e12-2a4ab0daa556 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 16:23:27 user nova-compute[71731]: INFO os_brick.initiator.connectors.iscsi [None req-9e131767-04d4-45b2-8e12-2a4ab0daa556 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 16:23:27 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 -p 172.16.0.220:3260 {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:23:27 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:23:27 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fccad85-42b6-449c-bbe7-336a7557a406]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:23:27 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e131767-04d4-45b2-8e12-2a4ab0daa556 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 16:23:27 user nova-compute[71731]:  {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:23:27 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 -p 172.16.0.220:3260 --interface default --op new {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:23:27 user nova-compute[71731]: DEBUG nova.compute.manager [req-0bed434e-5fb2-4e06-ad75-779572ca9200 req-424cb285-93cc-464b-ae2c-2a7d8c6af2fe service nova] [instance: e4ada2d7-7ace-4ed4-86a6-ed121c95e80f] Received event network-vif-deleted-2430beb8-b2e4-4493-bdc5-df6b4c1181c6 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:23:27 user nova-compute[71731]: INFO nova.compute.manager [req-0bed434e-5fb2-4e06-ad75-779572ca9200 req-424cb285-93cc-464b-ae2c-2a7d8c6af2fe service nova] [instance: e4ada2d7-7ace-4ed4-86a6-ed121c95e80f] Neutron deleted interface 2430beb8-b2e4-4493-bdc5-df6b4c1181c6; detaching it from the instance and deleting it from the info cache
Apr 13 16:23:27 user nova-compute[71731]: DEBUG nova.network.neutron [req-0bed434e-5fb2-4e06-ad75-779572ca9200 req-424cb285-93cc-464b-ae2c-2a7d8c6af2fe service nova] [instance: e4ada2d7-7ace-4ed4-86a6-ed121c95e80f] Updating instance_info_cache with network_info: [{"id": "a409f60c-6c6a-49f8-8520-04614e804002", "address": "fa:16:3e:ee:b5:cc", "network": {"id": "06e8519d-91e2-4c6a-8b74-6f55609e1764", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-420310439-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7649e366b0164e2fa5b3faa0830b6ea6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa409f60c-6c", "ovs_interfaceid": "a409f60c-6c6a-49f8-8520-04614e804002", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ac94464f-32dc-4cd1-a270-ec8934e77c21", "address": "fa:16:3e:5e:a2:3f", "network": {"id": "4b153def-aec7-4f9e-9604-f1e0afb247f3", "bridge": "br-int", "label": "tempest-device-tagging-net1-1029190313", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.127", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7649e366b0164e2fa5b3faa0830b6ea6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac94464f-32", "ovs_interfaceid": "ac94464f-32dc-4cd1-a270-ec8934e77c21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0125a8df-e91c-4d65-be74-fda2f2d93938", "address": "fa:16:3e:39:06:fc", "network": {"id": "4b153def-aec7-4f9e-9604-f1e0afb247f3", "bridge": "br-int", "label": "tempest-device-tagging-net1-1029190313", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.61", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7649e366b0164e2fa5b3faa0830b6ea6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0125a8df-e9", "ovs_interfaceid": "0125a8df-e91c-4d65-be74-fda2f2d93938", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8f3a3011-e474-4538-812b-9df3968fd629", "address": "fa:16:3e:78:12:fd", "network": {"id": "4b153def-aec7-4f9e-9604-f1e0afb247f3", "bridge": "br-int", "label": "tempest-device-tagging-net1-1029190313", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.202", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7649e366b0164e2fa5b3faa0830b6ea6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f3a3011-e4", "ovs_interfaceid": "8f3a3011-e474-4538-812b-9df3968fd629", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "15dca2c3-5048-4e80-8008-c19400ea34e4", "address": "fa:16:3e:df:45:fc", "network": {"id": "310c919b-177f-4fb1-956a-1423f7397f77", "bridge": "br-int", "label": "tempest-device-tagging-net2-188582195", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7649e366b0164e2fa5b3faa0830b6ea6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15dca2c3-50", "ovs_interfaceid": "15dca2c3-5048-4e80-8008-c19400ea34e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d41765b6-0d5b-43c1-bf58-a82a7bbe3137", "address": "fa:16:3e:63:86:1f", "network": {"id": "310c919b-177f-4fb1-956a-1423f7397f77", "bridge": "br-int", "label": "tempest-device-tagging-net2-188582195", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7649e366b0164e2fa5b3faa0830b6ea6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd41765b6-0d", "ovs_interfaceid": "d41765b6-0d5b-43c1-bf58-a82a7bbe3137", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:23:27 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:23:27 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[43445331-7477-4640-a43c-83c384080af7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97] added\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:23:27 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e131767-04d4-45b2-8e12-2a4ab0daa556 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97] added
Apr 13 16:23:27 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:23:27 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:23:27 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:23:27 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[782a03a0-49df-422a-834f-8296bfd13f69]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:23:27 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e131767-04d4-45b2-8e12-2a4ab0daa556 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:23:27 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:23:27 user nova-compute[71731]: DEBUG nova.compute.manager [req-0bed434e-5fb2-4e06-ad75-779572ca9200 req-424cb285-93cc-464b-ae2c-2a7d8c6af2fe service nova] [instance: e4ada2d7-7ace-4ed4-86a6-ed121c95e80f] Detach interface failed, port_id=2430beb8-b2e4-4493-bdc5-df6b4c1181c6, reason: Instance e4ada2d7-7ace-4ed4-86a6-ed121c95e80f could not be found. {{(pid=71731) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 13 16:23:27 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:23:27 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e287d51-e7d4-4094-8d5d-1c0baedf3c2c]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:23:27 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e131767-04d4-45b2-8e12-2a4ab0daa556 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:23:27 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jqPGdnMb {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:23:27 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jqPGdnMb" returned: 0 in 0.020s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:23:27 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd1c3224-a8da-46d6-becc-f8da81b27c13]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:23:27 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e131767-04d4-45b2-8e12-2a4ab0daa556 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jqPGdnMb'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:23:27 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:23:27 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:23:27 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[98846cff-1b43-4e3b-bed9-6e70844f6a27]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:23:27 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e131767-04d4-45b2-8e12-2a4ab0daa556 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:23:27 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:23:27 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:23:27 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc4e2da4-9aea-41b5-bfcf-e76c85092514]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e3b49ec-80af-4c38-9689-f7277e495d21 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984 (non-flash)\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:23:27 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e131767-04d4-45b2-8e12-2a4ab0daa556 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e3b49ec-80af-4c38-9689-f7277e495d21 (non-flash)
Apr 13 16:23:27 user nova-compute[71731]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984 (non-flash)
Apr 13 16:23:27 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 16:23:27 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e131767-04d4-45b2-8e12-2a4ab0daa556 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e3b49ec-80af-4c38-9689-f7277e495d21 (non-flash)
Apr 13 16:23:27 user nova-compute[71731]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984 (non-flash)
Apr 13 16:23:27 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 16:23:27 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 -p 172.16.0.220:3260 --login {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:23:27 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:23:27 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[069fd410-2838-4f63-9bac-b6ef39bf8087]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:23:27 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e131767-04d4-45b2-8e12-2a4ab0daa556 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97, portal: 172.16.0.220,3260]
Apr 13 16:23:27 user nova-compute[71731]: Login to [iface: default, target: iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97, portal: 172.16.0.220,3260] successful.
Apr 13 16:23:27 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:23:27 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:23:27 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:23:27 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b6704ca-1b10-4eb2-bbf0-401eac3041ac]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:23:27 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e131767-04d4-45b2-8e12-2a4ab0daa556 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:23:27 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:23:27 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:23:27 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:23:27 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3f4821c-9b80-40c3-a4f0-4392094cc89d]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e3b49ec-80af-4c38-9689-f7277e495d21 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984 (non-flash)\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:23:27 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e131767-04d4-45b2-8e12-2a4ab0daa556 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e3b49ec-80af-4c38-9689-f7277e495d21 (non-flash)
Apr 13 16:23:27 user nova-compute[71731]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)
Apr 13 16:23:27 user nova-compute[71731]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984 (non-flash)
Apr 13 16:23:27 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 16:23:27 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e131767-04d4-45b2-8e12-2a4ab0daa556 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e3b49ec-80af-4c38-9689-f7277e495d21 (non-flash)
Apr 13 16:23:27 user nova-compute[71731]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)
Apr 13 16:23:27 user nova-compute[71731]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984 (non-flash)
Apr 13 16:23:27 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 16:23:27 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-9e131767-04d4-45b2-8e12-2a4ab0daa556 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.298s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 16:23:27 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e131767-04d4-45b2-8e12-2a4ab0daa556 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Connected to 172.16.0.220:3260 {{(pid=71731) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 16:23:27 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-9e131767-04d4-45b2-8e12-2a4ab0daa556 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] HCTL ('34', '-', '-', 0) found on session 16 with lun 0 {{(pid=71731) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 16:23:27 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-9e131767-04d4-45b2-8e12-2a4ab0daa556 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71731) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 16:23:27 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:23:27 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.015s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:23:27 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[055f62e9-acb3-459c-98c9-dd19f24a82e0]: (4, ('- - 0', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:23:27 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-9e131767-04d4-45b2-8e12-2a4ab0daa556 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Searching for a device in session 16 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71731) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 16:23:27 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e131767-04d4-45b2-8e12-2a4ab0daa556 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jqPGdnMb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71731) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 16:23:28 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-9e131767-04d4-45b2-8e12-2a4ab0daa556 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.336s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 16:23:28 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e131767-04d4-45b2-8e12-2a4ab0daa556 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] <== connect_volume: return (1337ms) {'type': 'block', 'scsi_wwn': '26462393237386137', 'path': '/dev/sdc'} {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 16:23:28 user nova-compute[71731]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9e131767-04d4-45b2-8e12-2a4ab0daa556 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: 235f827c-7116-48e9-84c5-0c9761c18e1e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26462393237386137', 'path': '/dev/sdc'} {{(pid=71731) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 16:23:28 user nova-compute[71731]: DEBUG nova.virt.libvirt.vif [None req-9e131767-04d4-45b2-8e12-2a4ab0daa556 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T16:23:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1447697852',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1447697852',id=14,image_ref='708622a9-7465-4492-ade8-b827198f7e30',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b2d09a74bf684a9fb1dd1e95d6c23f3c',ramdisk_id='',reservation_id='r-6nx0xd0y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='708622a9-7465-4492-ade8-b827198f7e30',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1960261099',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T16:23:16Z,user_data=None,user_id='e45a882dbafb4ea4976e4f45289eb2b8',uuid=235f827c-7116-48e9-84c5-0c9761c18e1e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b72a6c8b-7244-41c2-a4f7-6da43b4944b8", "address": "fa:16:3e:e3:62:b0", "network": {"id": "5a7877ff-8230-470b-90b5-e5dcfc8f0cee", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-779403873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2d09a74bf684a9fb1dd1e95d6c23f3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb72a6c8b-72", "ovs_interfaceid": "b72a6c8b-7244-41c2-a4f7-6da43b4944b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71731) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 16:23:28 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-9e131767-04d4-45b2-8e12-2a4ab0daa556 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Converting VIF {"id": "b72a6c8b-7244-41c2-a4f7-6da43b4944b8", "address": "fa:16:3e:e3:62:b0", "network": {"id": "5a7877ff-8230-470b-90b5-e5dcfc8f0cee", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-779403873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2d09a74bf684a9fb1dd1e95d6c23f3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb72a6c8b-72", "ovs_interfaceid": "b72a6c8b-7244-41c2-a4f7-6da43b4944b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 16:23:28 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-9e131767-04d4-45b2-8e12-2a4ab0daa556 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e3:62:b0,bridge_name='br-int',has_traffic_filtering=True,id=b72a6c8b-7244-41c2-a4f7-6da43b4944b8,network=Network(5a7877ff-8230-470b-90b5-e5dcfc8f0cee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb72a6c8b-72') {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 16:23:28 user nova-compute[71731]: DEBUG nova.objects.instance [None req-9e131767-04d4-45b2-8e12-2a4ab0daa556 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lazy-loading 'pci_devices' on Instance uuid 235f827c-7116-48e9-84c5-0c9761c18e1e {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:23:28 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-9e131767-04d4-45b2-8e12-2a4ab0daa556 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: 235f827c-7116-48e9-84c5-0c9761c18e1e] End _get_guest_xml xml=<domain type="kvm">
Apr 13 16:23:28 user nova-compute[71731]:   <uuid>235f827c-7116-48e9-84c5-0c9761c18e1e</uuid>
Apr 13 16:23:28 user nova-compute[71731]:   <name>instance-0000000e</name>
Apr 13 16:23:28 user nova-compute[71731]:   <memory>131072</memory>
Apr 13 16:23:28 user nova-compute[71731]:   <vcpu>1</vcpu>
Apr 13 16:23:28 user nova-compute[71731]:   <metadata>
Apr 13 16:23:28 user nova-compute[71731]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 16:23:28 user nova-compute[71731]:       <nova:package version="0.0.0"/>
Apr 13 16:23:28 user nova-compute[71731]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1447697852</nova:name>
Apr 13 16:23:28 user nova-compute[71731]:       <nova:creationTime>2023-04-13 16:23:27</nova:creationTime>
Apr 13 16:23:28 user nova-compute[71731]:       <nova:flavor name="m1.nano">
Apr 13 16:23:28 user nova-compute[71731]:         <nova:memory>128</nova:memory>
Apr 13 16:23:28 user nova-compute[71731]:         <nova:disk>1</nova:disk>
Apr 13 16:23:28 user nova-compute[71731]:         <nova:swap>0</nova:swap>
Apr 13 16:23:28 user nova-compute[71731]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 16:23:28 user nova-compute[71731]:         <nova:vcpus>1</nova:vcpus>
Apr 13 16:23:28 user nova-compute[71731]:       </nova:flavor>
Apr 13 16:23:28 user nova-compute[71731]:       <nova:owner>
Apr 13 16:23:28 user nova-compute[71731]:         <nova:user uuid="e45a882dbafb4ea4976e4f45289eb2b8">tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member</nova:user>
Apr 13 16:23:28 user nova-compute[71731]:         <nova:project uuid="b2d09a74bf684a9fb1dd1e95d6c23f3c">tempest-ServerBootFromVolumeStableRescueTest-1960261099</nova:project>
Apr 13 16:23:28 user nova-compute[71731]:       </nova:owner>
Apr 13 16:23:28 user nova-compute[71731]:       <nova:root type="image" uuid="708622a9-7465-4492-ade8-b827198f7e30"/>
Apr 13 16:23:28 user nova-compute[71731]:       <nova:ports>
Apr 13 16:23:28 user nova-compute[71731]:         <nova:port uuid="b72a6c8b-7244-41c2-a4f7-6da43b4944b8">
Apr 13 16:23:28 user nova-compute[71731]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Apr 13 16:23:28 user nova-compute[71731]:         </nova:port>
Apr 13 16:23:28 user nova-compute[71731]:       </nova:ports>
Apr 13 16:23:28 user nova-compute[71731]:     </nova:instance>
Apr 13 16:23:28 user nova-compute[71731]:   </metadata>
Apr 13 16:23:28 user nova-compute[71731]:   <sysinfo type="smbios">
Apr 13 16:23:28 user nova-compute[71731]:     <system>
Apr 13 16:23:28 user nova-compute[71731]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 16:23:28 user nova-compute[71731]:       <entry name="product">OpenStack Nova</entry>
Apr 13 16:23:28 user nova-compute[71731]:       <entry name="version">0.0.0</entry>
Apr 13 16:23:28 user nova-compute[71731]:       <entry name="serial">235f827c-7116-48e9-84c5-0c9761c18e1e</entry>
Apr 13 16:23:28 user nova-compute[71731]:       <entry name="uuid">235f827c-7116-48e9-84c5-0c9761c18e1e</entry>
Apr 13 16:23:28 user nova-compute[71731]:       <entry name="family">Virtual Machine</entry>
Apr 13 16:23:28 user nova-compute[71731]:     </system>
Apr 13 16:23:28 user nova-compute[71731]:   </sysinfo>
Apr 13 16:23:28 user nova-compute[71731]:   <os>
Apr 13 16:23:28 user nova-compute[71731]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 16:23:28 user nova-compute[71731]:     <boot dev="hd"/>
Apr 13 16:23:28 user nova-compute[71731]:     <smbios mode="sysinfo"/>
Apr 13 16:23:28 user nova-compute[71731]:   </os>
Apr 13 16:23:28 user nova-compute[71731]:   <features>
Apr 13 16:23:28 user nova-compute[71731]:     <acpi/>
Apr 13 16:23:28 user nova-compute[71731]:     <apic/>
Apr 13 16:23:28 user nova-compute[71731]:     <vmcoreinfo/>
Apr 13 16:23:28 user nova-compute[71731]:   </features>
Apr 13 16:23:28 user nova-compute[71731]:   <clock offset="utc">
Apr 13 16:23:28 user nova-compute[71731]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 16:23:28 user nova-compute[71731]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 16:23:28 user nova-compute[71731]:     <timer name="hpet" present="no"/>
Apr 13 16:23:28 user nova-compute[71731]:   </clock>
Apr 13 16:23:28 user nova-compute[71731]:   <cpu mode="custom" match="exact">
Apr 13 16:23:28 user nova-compute[71731]:     <model>Nehalem</model>
Apr 13 16:23:28 user nova-compute[71731]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 16:23:28 user nova-compute[71731]:   </cpu>
Apr 13 16:23:28 user nova-compute[71731]:   <devices>
Apr 13 16:23:28 user nova-compute[71731]:     <disk type="block" device="disk">
Apr 13 16:23:28 user nova-compute[71731]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 16:23:28 user nova-compute[71731]:       <source dev="/dev/sdc"/>
Apr 13 16:23:28 user nova-compute[71731]:       <target dev="vda" bus="virtio"/>
Apr 13 16:23:28 user nova-compute[71731]:       <serial>417090c0-76a2-4277-9095-5c5095638b97</serial>
Apr 13 16:23:28 user nova-compute[71731]:     </disk>
Apr 13 16:23:28 user nova-compute[71731]:     <interface type="ethernet">
Apr 13 16:23:28 user nova-compute[71731]:       <mac address="fa:16:3e:e3:62:b0"/>
Apr 13 16:23:28 user nova-compute[71731]:       <model type="virtio"/>
Apr 13 16:23:28 user nova-compute[71731]:       <mtu size="1442"/>
Apr 13 16:23:28 user nova-compute[71731]:       <target dev="tapb72a6c8b-72"/>
Apr 13 16:23:28 user nova-compute[71731]:     </interface>
Apr 13 16:23:28 user nova-compute[71731]:     <serial type="pty">
Apr 13 16:23:28 user nova-compute[71731]:       <log file="/opt/stack/data/nova/instances/235f827c-7116-48e9-84c5-0c9761c18e1e/console.log" append="off"/>
Apr 13 16:23:28 user nova-compute[71731]:     </serial>
Apr 13 16:23:28 user nova-compute[71731]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 16:23:28 user nova-compute[71731]:     <video>
Apr 13 16:23:28 user nova-compute[71731]:       <model type="virtio"/>
Apr 13 16:23:28 user nova-compute[71731]:     </video>
Apr 13 16:23:28 user nova-compute[71731]:     <rng model="virtio">
Apr 13 16:23:28 user nova-compute[71731]:       <backend model="random">/dev/urandom</backend>
Apr 13 16:23:28 user nova-compute[71731]:     </rng>
Apr 13 16:23:28 user nova-compute[71731]:     <controller type="usb" index="0" model="none"/>
Apr 13 16:23:28 user nova-compute[71731]:     <memballoon model="virtio">
Apr 13 16:23:28 user nova-compute[71731]:       <stats period="10"/>
Apr 13 16:23:28 user nova-compute[71731]:     </memballoon>
Apr 13 16:23:28 user nova-compute[71731]:   </devices>
Apr 13 16:23:28 user nova-compute[71731]: </domain>
Apr 13 16:23:28 user nova-compute[71731]:  {{(pid=71731) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 16:23:28 user nova-compute[71731]: DEBUG nova.virt.libvirt.vif [None req-9e131767-04d4-45b2-8e12-2a4ab0daa556 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T16:23:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1447697852',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1447697852',id=14,image_ref='708622a9-7465-4492-ade8-b827198f7e30',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b2d09a74bf684a9fb1dd1e95d6c23f3c',ramdisk_id='',reservation_id='r-6nx0xd0y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='708622a9-7465-4492-ade8-b827198f7e30',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1960261099',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T16:23:16Z,user_data=None,user_id='e45a882dbafb4ea4976e4f45289eb2b8',uuid=235f827c-7116-48e9-84c5-0c9761c18e1e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b72a6c8b-7244-41c2-a4f7-6da43b4944b8", "address": "fa:16:3e:e3:62:b0", "network": {"id": "5a7877ff-8230-470b-90b5-e5dcfc8f0cee", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-779403873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2d09a74bf684a9fb1dd1e95d6c23f3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb72a6c8b-72", "ovs_interfaceid": "b72a6c8b-7244-41c2-a4f7-6da43b4944b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 16:23:28 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-9e131767-04d4-45b2-8e12-2a4ab0daa556 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Converting VIF {"id": "b72a6c8b-7244-41c2-a4f7-6da43b4944b8", "address": "fa:16:3e:e3:62:b0", "network": {"id": "5a7877ff-8230-470b-90b5-e5dcfc8f0cee", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-779403873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2d09a74bf684a9fb1dd1e95d6c23f3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb72a6c8b-72", "ovs_interfaceid": "b72a6c8b-7244-41c2-a4f7-6da43b4944b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 16:23:28 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-9e131767-04d4-45b2-8e12-2a4ab0daa556 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e3:62:b0,bridge_name='br-int',has_traffic_filtering=True,id=b72a6c8b-7244-41c2-a4f7-6da43b4944b8,network=Network(5a7877ff-8230-470b-90b5-e5dcfc8f0cee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb72a6c8b-72') {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 16:23:28 user nova-compute[71731]: DEBUG os_vif [None req-9e131767-04d4-45b2-8e12-2a4ab0daa556 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:62:b0,bridge_name='br-int',has_traffic_filtering=True,id=b72a6c8b-7244-41c2-a4f7-6da43b4944b8,network=Network(5a7877ff-8230-470b-90b5-e5dcfc8f0cee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb72a6c8b-72') {{(pid=71731) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 16:23:28 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:23:28 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:23:28 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 16:23:28 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:23:28 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb72a6c8b-72, may_exist=True) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:23:28 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb72a6c8b-72, col_values=(('external_ids', {'iface-id': 'b72a6c8b-7244-41c2-a4f7-6da43b4944b8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e3:62:b0', 'vm-uuid': '235f827c-7116-48e9-84c5-0c9761c18e1e'}),)) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:23:28 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:23:28 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 16:23:28 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:23:28 user nova-compute[71731]: INFO os_vif [None req-9e131767-04d4-45b2-8e12-2a4ab0daa556 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:62:b0,bridge_name='br-int',has_traffic_filtering=True,id=b72a6c8b-7244-41c2-a4f7-6da43b4944b8,network=Network(5a7877ff-8230-470b-90b5-e5dcfc8f0cee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb72a6c8b-72')
Apr 13 16:23:28 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-9e131767-04d4-45b2-8e12-2a4ab0daa556 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] No BDM found with device name vda, not building metadata. {{(pid=71731) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 16:23:28 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-9e131767-04d4-45b2-8e12-2a4ab0daa556 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] No VIF found with MAC fa:16:3e:e3:62:b0, not building metadata {{(pid=71731) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 16:23:29 user nova-compute[71731]: DEBUG nova.compute.manager [req-359b3c7b-2454-4fdd-a8cb-58771a1a8b36 req-2e43653c-f150-4bb8-adbf-3e8ae9bdad02 service nova] [instance: 2549ba85-4e0a-420e-b711-07cafa8c60e9] Received event network-vif-deleted-0fbdf291-df5d-41c5-a765-7145a87da272 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:23:29 user nova-compute[71731]: INFO nova.compute.manager [req-359b3c7b-2454-4fdd-a8cb-58771a1a8b36 req-2e43653c-f150-4bb8-adbf-3e8ae9bdad02 service nova] [instance: 2549ba85-4e0a-420e-b711-07cafa8c60e9] Neutron deleted interface 0fbdf291-df5d-41c5-a765-7145a87da272; detaching it from the instance and deleting it from the info cache
Apr 13 16:23:29 user nova-compute[71731]: DEBUG nova.network.neutron [req-359b3c7b-2454-4fdd-a8cb-58771a1a8b36 req-2e43653c-f150-4bb8-adbf-3e8ae9bdad02 service nova] [instance: 2549ba85-4e0a-420e-b711-07cafa8c60e9] Updating instance_info_cache with network_info: [{"id": "36152688-366c-40a2-8bf9-88f69925594a", "address": "fa:16:3e:1c:8b:59", "network": {"id": "f11266a1-4740-4cb3-8467-e0e95870ac22", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-689537131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbe4e9fb786d4015b035b4d00f75a1ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36152688-36", "ovs_interfaceid": "36152688-366c-40a2-8bf9-88f69925594a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d7155dcf-9e83-4579-b81a-7277d4a9eeaf", "address": "fa:16:3e:d0:1a:bc", "network": {"id": "5d158a82-de85-48b5-9f17-40e61e9b0df8", "bridge": "br-int", "label": "tempest-device-tagging-net1-574676351", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.246", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bbe4e9fb786d4015b035b4d00f75a1ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7155dcf-9e", "ovs_interfaceid": "d7155dcf-9e83-4579-b81a-7277d4a9eeaf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4c481745-6342-43f8-9040-3ea1d8c5c572", "address": "fa:16:3e:e7:ea:ff", "network": {"id": "5d158a82-de85-48b5-9f17-40e61e9b0df8", "bridge": "br-int", "label": "tempest-device-tagging-net1-574676351", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.164", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bbe4e9fb786d4015b035b4d00f75a1ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c481745-63", "ovs_interfaceid": "4c481745-6342-43f8-9040-3ea1d8c5c572", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0152bbb9-d50d-4e58-8a2b-727c4675ea2f", "address": "fa:16:3e:0d:4d:58", "network": {"id": "5d158a82-de85-48b5-9f17-40e61e9b0df8", "bridge": "br-int", "label": "tempest-device-tagging-net1-574676351", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.142", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bbe4e9fb786d4015b035b4d00f75a1ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0152bbb9-d5", "ovs_interfaceid": "0152bbb9-d50d-4e58-8a2b-727c4675ea2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3730ed6e-b093-4232-800b-b064d650e9e8", "address": "fa:16:3e:a8:c4:f6", "network": {"id": "5d158a82-de85-48b5-9f17-40e61e9b0df8", "bridge": "br-int", "label": "tempest-device-tagging-net1-574676351", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.38", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bbe4e9fb786d4015b035b4d00f75a1ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3730ed6e-b0", "ovs_interfaceid": "3730ed6e-b093-4232-800b-b064d650e9e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "38e92b7c-b7c1-4137-a1db-21bc1d24f3ee", "address": "fa:16:3e:a3:dd:27", "network": {"id": "4224b04f-23ed-464e-9b2c-df8c843f9287", "bridge": "br-int", "label": "tempest-device-tagging-net2-109401200", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "bbe4e9fb786d4015b035b4d00f75a1ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38e92b7c-b7", "ovs_interfaceid": "38e92b7c-b7c1-4137-a1db-21bc1d24f3ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:23:29 user nova-compute[71731]: DEBUG nova.compute.manager [req-926ddc63-9f10-415a-8a5e-11567d4523d9 req-f659fa69-e66f-4755-a082-d2b149e1aef5 service nova] [instance: bf350da4-9cc2-4900-adf0-506e44984b42] Received event network-changed-1a737bae-3b9b-43b4-8a89-0eb98fdf2ec8 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:23:29 user nova-compute[71731]: DEBUG nova.compute.manager [req-926ddc63-9f10-415a-8a5e-11567d4523d9 req-f659fa69-e66f-4755-a082-d2b149e1aef5 service nova] [instance: bf350da4-9cc2-4900-adf0-506e44984b42] Refreshing instance network info cache due to event network-changed-1a737bae-3b9b-43b4-8a89-0eb98fdf2ec8. {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 16:23:29 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-926ddc63-9f10-415a-8a5e-11567d4523d9 req-f659fa69-e66f-4755-a082-d2b149e1aef5 service nova] Acquiring lock "refresh_cache-bf350da4-9cc2-4900-adf0-506e44984b42" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 16:23:29 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-926ddc63-9f10-415a-8a5e-11567d4523d9 req-f659fa69-e66f-4755-a082-d2b149e1aef5 service nova] Acquired lock "refresh_cache-bf350da4-9cc2-4900-adf0-506e44984b42" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 16:23:29 user nova-compute[71731]: DEBUG nova.network.neutron [req-926ddc63-9f10-415a-8a5e-11567d4523d9 req-f659fa69-e66f-4755-a082-d2b149e1aef5 service nova] [instance: bf350da4-9cc2-4900-adf0-506e44984b42] Refreshing network info cache for port 1a737bae-3b9b-43b4-8a89-0eb98fdf2ec8 {{(pid=71731) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 16:23:29 user nova-compute[71731]: DEBUG nova.compute.manager [req-359b3c7b-2454-4fdd-a8cb-58771a1a8b36 req-2e43653c-f150-4bb8-adbf-3e8ae9bdad02 service nova] [instance: 2549ba85-4e0a-420e-b711-07cafa8c60e9] Detach interface failed, port_id=0fbdf291-df5d-41c5-a765-7145a87da272, reason: Instance 2549ba85-4e0a-420e-b711-07cafa8c60e9 could not be found. {{(pid=71731) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 13 16:23:29 user nova-compute[71731]: DEBUG nova.compute.manager [req-359b3c7b-2454-4fdd-a8cb-58771a1a8b36 req-2e43653c-f150-4bb8-adbf-3e8ae9bdad02 service nova] [instance: e4ada2d7-7ace-4ed4-86a6-ed121c95e80f] Received event network-vif-deleted-d41765b6-0d5b-43c1-bf58-a82a7bbe3137 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:23:29 user nova-compute[71731]: INFO nova.compute.manager [req-359b3c7b-2454-4fdd-a8cb-58771a1a8b36 req-2e43653c-f150-4bb8-adbf-3e8ae9bdad02 service nova] [instance: e4ada2d7-7ace-4ed4-86a6-ed121c95e80f] Neutron deleted interface d41765b6-0d5b-43c1-bf58-a82a7bbe3137; detaching it from the instance and deleting it from the info cache
Apr 13 16:23:29 user nova-compute[71731]: DEBUG nova.network.neutron [req-359b3c7b-2454-4fdd-a8cb-58771a1a8b36 req-2e43653c-f150-4bb8-adbf-3e8ae9bdad02 service nova] [instance: e4ada2d7-7ace-4ed4-86a6-ed121c95e80f] Updating instance_info_cache with network_info: [{"id": "a409f60c-6c6a-49f8-8520-04614e804002", "address": "fa:16:3e:ee:b5:cc", "network": {"id": "06e8519d-91e2-4c6a-8b74-6f55609e1764", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-420310439-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7649e366b0164e2fa5b3faa0830b6ea6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa409f60c-6c", "ovs_interfaceid": "a409f60c-6c6a-49f8-8520-04614e804002", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ac94464f-32dc-4cd1-a270-ec8934e77c21", "address": "fa:16:3e:5e:a2:3f", "network": {"id": "4b153def-aec7-4f9e-9604-f1e0afb247f3", "bridge": "br-int", "label": "tempest-device-tagging-net1-1029190313", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.127", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7649e366b0164e2fa5b3faa0830b6ea6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac94464f-32", "ovs_interfaceid": "ac94464f-32dc-4cd1-a270-ec8934e77c21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0125a8df-e91c-4d65-be74-fda2f2d93938", "address": "fa:16:3e:39:06:fc", "network": {"id": "4b153def-aec7-4f9e-9604-f1e0afb247f3", "bridge": "br-int", "label": "tempest-device-tagging-net1-1029190313", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.61", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7649e366b0164e2fa5b3faa0830b6ea6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0125a8df-e9", "ovs_interfaceid": "0125a8df-e91c-4d65-be74-fda2f2d93938", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8f3a3011-e474-4538-812b-9df3968fd629", "address": "fa:16:3e:78:12:fd", "network": {"id": "4b153def-aec7-4f9e-9604-f1e0afb247f3", "bridge": "br-int", "label": "tempest-device-tagging-net1-1029190313", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.202", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7649e366b0164e2fa5b3faa0830b6ea6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f3a3011-e4", "ovs_interfaceid": "8f3a3011-e474-4538-812b-9df3968fd629", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "15dca2c3-5048-4e80-8008-c19400ea34e4", "address": "fa:16:3e:df:45:fc", "network": {"id": "310c919b-177f-4fb1-956a-1423f7397f77", "bridge": "br-int", "label": "tempest-device-tagging-net2-188582195", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7649e366b0164e2fa5b3faa0830b6ea6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15dca2c3-50", "ovs_interfaceid": "15dca2c3-5048-4e80-8008-c19400ea34e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:23:29 user nova-compute[71731]: DEBUG nova.compute.manager [req-359b3c7b-2454-4fdd-a8cb-58771a1a8b36 req-2e43653c-f150-4bb8-adbf-3e8ae9bdad02 service nova] [instance: e4ada2d7-7ace-4ed4-86a6-ed121c95e80f] Detach interface failed, port_id=d41765b6-0d5b-43c1-bf58-a82a7bbe3137, reason: Instance e4ada2d7-7ace-4ed4-86a6-ed121c95e80f could not be found. {{(pid=71731) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 13 16:23:29 user nova-compute[71731]: DEBUG nova.compute.manager [req-359b3c7b-2454-4fdd-a8cb-58771a1a8b36 req-2e43653c-f150-4bb8-adbf-3e8ae9bdad02 service nova] [instance: e4ada2d7-7ace-4ed4-86a6-ed121c95e80f] Received event network-vif-deleted-15dca2c3-5048-4e80-8008-c19400ea34e4 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:23:29 user nova-compute[71731]: INFO nova.compute.manager [req-359b3c7b-2454-4fdd-a8cb-58771a1a8b36 req-2e43653c-f150-4bb8-adbf-3e8ae9bdad02 service nova] [instance: e4ada2d7-7ace-4ed4-86a6-ed121c95e80f] Neutron deleted interface 15dca2c3-5048-4e80-8008-c19400ea34e4; detaching it from the instance and deleting it from the info cache
Apr 13 16:23:29 user nova-compute[71731]: DEBUG nova.network.neutron [req-359b3c7b-2454-4fdd-a8cb-58771a1a8b36 req-2e43653c-f150-4bb8-adbf-3e8ae9bdad02 service nova] [instance: e4ada2d7-7ace-4ed4-86a6-ed121c95e80f] Updating instance_info_cache with network_info: [{"id": "a409f60c-6c6a-49f8-8520-04614e804002", "address": "fa:16:3e:ee:b5:cc", "network": {"id": "06e8519d-91e2-4c6a-8b74-6f55609e1764", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-420310439-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7649e366b0164e2fa5b3faa0830b6ea6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa409f60c-6c", "ovs_interfaceid": "a409f60c-6c6a-49f8-8520-04614e804002", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ac94464f-32dc-4cd1-a270-ec8934e77c21", "address": "fa:16:3e:5e:a2:3f", "network": {"id": "4b153def-aec7-4f9e-9604-f1e0afb247f3", "bridge": "br-int", "label": "tempest-device-tagging-net1-1029190313", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.127", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7649e366b0164e2fa5b3faa0830b6ea6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac94464f-32", "ovs_interfaceid": "ac94464f-32dc-4cd1-a270-ec8934e77c21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0125a8df-e91c-4d65-be74-fda2f2d93938", "address": "fa:16:3e:39:06:fc", "network": {"id": "4b153def-aec7-4f9e-9604-f1e0afb247f3", "bridge": "br-int", "label": "tempest-device-tagging-net1-1029190313", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.61", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7649e366b0164e2fa5b3faa0830b6ea6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0125a8df-e9", "ovs_interfaceid": "0125a8df-e91c-4d65-be74-fda2f2d93938", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8f3a3011-e474-4538-812b-9df3968fd629", "address": "fa:16:3e:78:12:fd", "network": {"id": "4b153def-aec7-4f9e-9604-f1e0afb247f3", "bridge": "br-int", "label": "tempest-device-tagging-net1-1029190313", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.202", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7649e366b0164e2fa5b3faa0830b6ea6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f3a3011-e4", "ovs_interfaceid": "8f3a3011-e474-4538-812b-9df3968fd629", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:23:29 user nova-compute[71731]: DEBUG nova.compute.manager [req-359b3c7b-2454-4fdd-a8cb-58771a1a8b36 req-2e43653c-f150-4bb8-adbf-3e8ae9bdad02 service nova] [instance: e4ada2d7-7ace-4ed4-86a6-ed121c95e80f] Detach interface failed, port_id=15dca2c3-5048-4e80-8008-c19400ea34e4, reason: Instance e4ada2d7-7ace-4ed4-86a6-ed121c95e80f could not be found. {{(pid=71731) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 13 16:23:29 user nova-compute[71731]: DEBUG nova.compute.manager [req-359b3c7b-2454-4fdd-a8cb-58771a1a8b36 req-2e43653c-f150-4bb8-adbf-3e8ae9bdad02 service nova] [instance: 2549ba85-4e0a-420e-b711-07cafa8c60e9] Received event network-vif-deleted-36152688-366c-40a2-8bf9-88f69925594a {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:23:29 user nova-compute[71731]: INFO nova.compute.manager [req-359b3c7b-2454-4fdd-a8cb-58771a1a8b36 req-2e43653c-f150-4bb8-adbf-3e8ae9bdad02 service nova] [instance: 2549ba85-4e0a-420e-b711-07cafa8c60e9] Neutron deleted interface 36152688-366c-40a2-8bf9-88f69925594a; detaching it from the instance and deleting it from the info cache
Apr 13 16:23:29 user nova-compute[71731]: DEBUG nova.network.neutron [req-359b3c7b-2454-4fdd-a8cb-58771a1a8b36 req-2e43653c-f150-4bb8-adbf-3e8ae9bdad02 service nova] [instance: 2549ba85-4e0a-420e-b711-07cafa8c60e9] Updating instance_info_cache with network_info: [{"id": "d7155dcf-9e83-4579-b81a-7277d4a9eeaf", "address": "fa:16:3e:d0:1a:bc", "network": {"id": "5d158a82-de85-48b5-9f17-40e61e9b0df8", "bridge": "br-int", "label": "tempest-device-tagging-net1-574676351", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.246", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bbe4e9fb786d4015b035b4d00f75a1ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7155dcf-9e", "ovs_interfaceid": "d7155dcf-9e83-4579-b81a-7277d4a9eeaf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4c481745-6342-43f8-9040-3ea1d8c5c572", "address": "fa:16:3e:e7:ea:ff", "network": {"id": "5d158a82-de85-48b5-9f17-40e61e9b0df8", "bridge": "br-int", "label": "tempest-device-tagging-net1-574676351", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.164", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bbe4e9fb786d4015b035b4d00f75a1ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c481745-63", "ovs_interfaceid": "4c481745-6342-43f8-9040-3ea1d8c5c572", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0152bbb9-d50d-4e58-8a2b-727c4675ea2f", "address": "fa:16:3e:0d:4d:58", "network": {"id": "5d158a82-de85-48b5-9f17-40e61e9b0df8", "bridge": "br-int", "label": "tempest-device-tagging-net1-574676351", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.142", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bbe4e9fb786d4015b035b4d00f75a1ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0152bbb9-d5", "ovs_interfaceid": "0152bbb9-d50d-4e58-8a2b-727c4675ea2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3730ed6e-b093-4232-800b-b064d650e9e8", "address": "fa:16:3e:a8:c4:f6", "network": {"id": "5d158a82-de85-48b5-9f17-40e61e9b0df8", "bridge": "br-int", "label": "tempest-device-tagging-net1-574676351", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.38", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bbe4e9fb786d4015b035b4d00f75a1ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3730ed6e-b0", "ovs_interfaceid": "3730ed6e-b093-4232-800b-b064d650e9e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "38e92b7c-b7c1-4137-a1db-21bc1d24f3ee", "address": "fa:16:3e:a3:dd:27", "network": {"id": "4224b04f-23ed-464e-9b2c-df8c843f9287", "bridge": "br-int", "label": "tempest-device-tagging-net2-109401200", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "bbe4e9fb786d4015b035b4d00f75a1ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38e92b7c-b7", "ovs_interfaceid": "38e92b7c-b7c1-4137-a1db-21bc1d24f3ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:23:29 user nova-compute[71731]: DEBUG nova.compute.manager [req-359b3c7b-2454-4fdd-a8cb-58771a1a8b36 req-2e43653c-f150-4bb8-adbf-3e8ae9bdad02 service nova] [instance: 2549ba85-4e0a-420e-b711-07cafa8c60e9] Detach interface failed, port_id=36152688-366c-40a2-8bf9-88f69925594a, reason: Instance 2549ba85-4e0a-420e-b711-07cafa8c60e9 could not be found. {{(pid=71731) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 13 16:23:29 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-12217892-5cbd-46ad-9ee3-cc51a81755e5 tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Acquiring lock "bf350da4-9cc2-4900-adf0-506e44984b42" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:23:29 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-12217892-5cbd-46ad-9ee3-cc51a81755e5 tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Lock "bf350da4-9cc2-4900-adf0-506e44984b42" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.002s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:23:29 user nova-compute[71731]: INFO nova.compute.manager [None req-12217892-5cbd-46ad-9ee3-cc51a81755e5 tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] [instance: bf350da4-9cc2-4900-adf0-506e44984b42] Shelve offloading
Apr 13 16:23:30 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:23:30 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:23:30 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:23:30 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:23:30 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:23:30 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:23:30 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:23:30 user nova-compute[71731]: DEBUG nova.compute.manager [req-b638765b-0ff1-4d2c-9a36-c169674649fb req-edcc4bc8-2625-4038-b63a-eb0e0803430c service nova] [instance: bf350da4-9cc2-4900-adf0-506e44984b42] Received event network-vif-unplugged-1a737bae-3b9b-43b4-8a89-0eb98fdf2ec8 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:23:30 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-b638765b-0ff1-4d2c-9a36-c169674649fb req-edcc4bc8-2625-4038-b63a-eb0e0803430c service nova] Acquiring lock "bf350da4-9cc2-4900-adf0-506e44984b42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:23:30 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-b638765b-0ff1-4d2c-9a36-c169674649fb req-edcc4bc8-2625-4038-b63a-eb0e0803430c service nova] Lock "bf350da4-9cc2-4900-adf0-506e44984b42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:23:30 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-b638765b-0ff1-4d2c-9a36-c169674649fb req-edcc4bc8-2625-4038-b63a-eb0e0803430c service nova] Lock "bf350da4-9cc2-4900-adf0-506e44984b42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:23:30 user nova-compute[71731]: DEBUG nova.compute.manager [req-b638765b-0ff1-4d2c-9a36-c169674649fb req-edcc4bc8-2625-4038-b63a-eb0e0803430c service nova] [instance: bf350da4-9cc2-4900-adf0-506e44984b42] No waiting events found dispatching network-vif-unplugged-1a737bae-3b9b-43b4-8a89-0eb98fdf2ec8 {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:23:30 user nova-compute[71731]: WARNING nova.compute.manager [req-b638765b-0ff1-4d2c-9a36-c169674649fb req-edcc4bc8-2625-4038-b63a-eb0e0803430c service nova] [instance: bf350da4-9cc2-4900-adf0-506e44984b42] Received unexpected event network-vif-unplugged-1a737bae-3b9b-43b4-8a89-0eb98fdf2ec8 for instance with vm_state active and task_state shelving.
Apr 13 16:23:30 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:23:30 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:23:31 user nova-compute[71731]: DEBUG nova.network.neutron [req-926ddc63-9f10-415a-8a5e-11567d4523d9 req-f659fa69-e66f-4755-a082-d2b149e1aef5 service nova] [instance: bf350da4-9cc2-4900-adf0-506e44984b42] Updated VIF entry in instance network info cache for port 1a737bae-3b9b-43b4-8a89-0eb98fdf2ec8. {{(pid=71731) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 16:23:31 user nova-compute[71731]: DEBUG nova.network.neutron [req-926ddc63-9f10-415a-8a5e-11567d4523d9 req-f659fa69-e66f-4755-a082-d2b149e1aef5 service nova] [instance: bf350da4-9cc2-4900-adf0-506e44984b42] Updating instance_info_cache with network_info: [{"id": "1a737bae-3b9b-43b4-8a89-0eb98fdf2ec8", "address": "fa:16:3e:18:7d:11", "network": {"id": "c06f107f-4fa0-46dc-8766-3c882c401851", "bridge": "br-int", "label": "tempest-TestShelveInstance-1490339676-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed94fa5d89c2486b8e2951e608e6630f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a737bae-3b", "ovs_interfaceid": "1a737bae-3b9b-43b4-8a89-0eb98fdf2ec8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:23:31 user nova-compute[71731]: DEBUG nova.network.neutron [-] [instance: e4ada2d7-7ace-4ed4-86a6-ed121c95e80f] Updating instance_info_cache with network_info: [] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:23:31 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-926ddc63-9f10-415a-8a5e-11567d4523d9 req-f659fa69-e66f-4755-a082-d2b149e1aef5 service nova] Releasing lock "refresh_cache-bf350da4-9cc2-4900-adf0-506e44984b42" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 16:23:31 user nova-compute[71731]: INFO nova.compute.manager [-] [instance: e4ada2d7-7ace-4ed4-86a6-ed121c95e80f] Took 6.67 seconds to deallocate network for instance.
Apr 13 16:23:31 user nova-compute[71731]: INFO nova.virt.libvirt.driver [-] [instance: bf350da4-9cc2-4900-adf0-506e44984b42] Instance destroyed successfully.
Apr 13 16:23:31 user nova-compute[71731]: DEBUG nova.compute.manager [None req-12217892-5cbd-46ad-9ee3-cc51a81755e5 tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] [instance: bf350da4-9cc2-4900-adf0-506e44984b42] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:23:31 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-12217892-5cbd-46ad-9ee3-cc51a81755e5 tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Acquiring lock "refresh_cache-bf350da4-9cc2-4900-adf0-506e44984b42" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 16:23:31 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-12217892-5cbd-46ad-9ee3-cc51a81755e5 tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Acquired lock "refresh_cache-bf350da4-9cc2-4900-adf0-506e44984b42" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 16:23:31 user nova-compute[71731]: DEBUG nova.network.neutron [None req-12217892-5cbd-46ad-9ee3-cc51a81755e5 tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] [instance: bf350da4-9cc2-4900-adf0-506e44984b42] Building network info cache for instance {{(pid=71731) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 16:23:31 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:23:31 user nova-compute[71731]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a969112c-b8b8-4710-b337-1114a7ebb0b2 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] [instance: 031c7939-a53c-4f7d-9f36-4ec1d06e2717] Calling os-brick to attach iSCSI Volume {{(pid=71731) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 16:23:31 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-a969112c-b8b8-4710-b337-1114a7ebb0b2 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8cf0118790>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e962a4d5-41c9-4b3b-b78e-c25e451aa73f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iITrFYGA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 16:23:31 user nova-compute[71731]: WARNING os_brick.initiator.connectors.base [None req-a969112c-b8b8-4710-b337-1114a7ebb0b2 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 16:23:31 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-a969112c-b8b8-4710-b337-1114a7ebb0b2 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 16:23:31 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-a969112c-b8b8-4710-b337-1114a7ebb0b2 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 16:23:31 user nova-compute[71731]: WARNING os_brick.initiator.connectors.base [None req-a969112c-b8b8-4710-b337-1114a7ebb0b2 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 16:23:31 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-a969112c-b8b8-4710-b337-1114a7ebb0b2 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e962a4d5-41c9-4b3b-b78e-c25e451aa73f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 16:23:31 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-a969112c-b8b8-4710-b337-1114a7ebb0b2 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e962a4d5-41c9-4b3b-b78e-c25e451aa73f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 16:23:31 user nova-compute[71731]: INFO os_brick.initiator.connectors.iscsi [None req-a969112c-b8b8-4710-b337-1114a7ebb0b2 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 16:23:31 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e962a4d5-41c9-4b3b-b78e-c25e451aa73f -p 172.16.0.220:3260 {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:23:31 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e962a4d5-41c9-4b3b-b78e-c25e451aa73f -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:23:31 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4769133-8e63-46f2-bc41-b32eb7f3397d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:23:31 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-a969112c-b8b8-4710-b337-1114a7ebb0b2 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 16:23:31 user nova-compute[71731]:  {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:23:31 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e962a4d5-41c9-4b3b-b78e-c25e451aa73f -p 172.16.0.220:3260 --interface default --op new {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:23:31 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e962a4d5-41c9-4b3b-b78e-c25e451aa73f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:23:31 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd09809b-a886-4467-834e-690b3b649309]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e962a4d5-41c9-4b3b-b78e-c25e451aa73f] added\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:23:31 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-a969112c-b8b8-4710-b337-1114a7ebb0b2 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e962a4d5-41c9-4b3b-b78e-c25e451aa73f] added
Apr 13 16:23:31 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:23:31 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e962a4d5-41c9-4b3b-b78e-c25e451aa73f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:23:31 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e962a4d5-41c9-4b3b-b78e-c25e451aa73f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:23:31 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[4af662c5-30d4-4552-9d99-347b20d8652f]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:23:31 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-a969112c-b8b8-4710-b337-1114a7ebb0b2 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:23:31 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e962a4d5-41c9-4b3b-b78e-c25e451aa73f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:23:31 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e962a4d5-41c9-4b3b-b78e-c25e451aa73f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:23:31 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[180ca899-f4a1-4bc2-9374-dedf7679a8f7]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:23:31 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-a969112c-b8b8-4710-b337-1114a7ebb0b2 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:23:31 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e962a4d5-41c9-4b3b-b78e-c25e451aa73f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iITrFYGA {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:23:31 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e962a4d5-41c9-4b3b-b78e-c25e451aa73f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iITrFYGA" returned: 0 in 0.025s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:23:31 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4e4b001-bd48-4544-8dd5-e7c1e287a95d]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:23:31 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-a969112c-b8b8-4710-b337-1114a7ebb0b2 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'iITrFYGA'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:23:31 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e962a4d5-41c9-4b3b-b78e-c25e451aa73f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:23:31 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e962a4d5-41c9-4b3b-b78e-c25e451aa73f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:23:31 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ff2c374-a235-4cc2-8808-be192715b4b9]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:23:31 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-a969112c-b8b8-4710-b337-1114a7ebb0b2 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:23:31 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:23:31 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:23:31 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[baa0eaa2-25be-4da5-a400-1f5b163b0d3c]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e3b49ec-80af-4c38-9689-f7277e495d21 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984 (non-flash)\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:23:31 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-a969112c-b8b8-4710-b337-1114a7ebb0b2 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e3b49ec-80af-4c38-9689-f7277e495d21 (non-flash)
Apr 13 16:23:31 user nova-compute[71731]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)
Apr 13 16:23:31 user nova-compute[71731]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984 (non-flash)
Apr 13 16:23:31 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 16:23:31 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-a969112c-b8b8-4710-b337-1114a7ebb0b2 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e3b49ec-80af-4c38-9689-f7277e495d21 (non-flash)
Apr 13 16:23:31 user nova-compute[71731]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)
Apr 13 16:23:31 user nova-compute[71731]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984 (non-flash)
Apr 13 16:23:31 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 16:23:31 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e962a4d5-41c9-4b3b-b78e-c25e451aa73f -p 172.16.0.220:3260 --login {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:23:31 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e962a4d5-41c9-4b3b-b78e-c25e451aa73f -p 172.16.0.220:3260 --login" returned: 0 in 0.080s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:23:31 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[251c7f6b-e2dd-4171-b7a5-b6b63d170f48]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e962a4d5-41c9-4b3b-b78e-c25e451aa73f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e962a4d5-41c9-4b3b-b78e-c25e451aa73f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:23:31 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-a969112c-b8b8-4710-b337-1114a7ebb0b2 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e962a4d5-41c9-4b3b-b78e-c25e451aa73f, portal: 172.16.0.220,3260]
Apr 13 16:23:31 user nova-compute[71731]: Login to [iface: default, target: iqn.2010-10.org.openstack:e962a4d5-41c9-4b3b-b78e-c25e451aa73f, portal: 172.16.0.220,3260] successful.
Apr 13 16:23:31 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:23:31 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e962a4d5-41c9-4b3b-b78e-c25e451aa73f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:23:31 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e962a4d5-41c9-4b3b-b78e-c25e451aa73f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:23:31 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c54ae0a-6426-4131-bf62-3580ea93e865]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:23:31 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-a969112c-b8b8-4710-b337-1114a7ebb0b2 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:23:31 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:23:31 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:23:31 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[6834d174-f6af-45e0-9b5b-733f30ea34a6]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e3b49ec-80af-4c38-9689-f7277e495d21 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e962a4d5-41c9-4b3b-b78e-c25e451aa73f (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984 (non-flash)\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:23:31 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-a969112c-b8b8-4710-b337-1114a7ebb0b2 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e3b49ec-80af-4c38-9689-f7277e495d21 (non-flash)
Apr 13 16:23:31 user nova-compute[71731]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)
Apr 13 16:23:31 user nova-compute[71731]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e962a4d5-41c9-4b3b-b78e-c25e451aa73f (non-flash)
Apr 13 16:23:31 user nova-compute[71731]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984 (non-flash)
Apr 13 16:23:31 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 16:23:31 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-a969112c-b8b8-4710-b337-1114a7ebb0b2 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e3b49ec-80af-4c38-9689-f7277e495d21 (non-flash)
Apr 13 16:23:31 user nova-compute[71731]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)
Apr 13 16:23:31 user nova-compute[71731]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e962a4d5-41c9-4b3b-b78e-c25e451aa73f (non-flash)
Apr 13 16:23:31 user nova-compute[71731]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984 (non-flash)
Apr 13 16:23:31 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 16:23:31 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-a969112c-b8b8-4710-b337-1114a7ebb0b2 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e962a4d5-41c9-4b3b-b78e-c25e451aa73f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.348s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 16:23:31 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-a969112c-b8b8-4710-b337-1114a7ebb0b2 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Connected to 172.16.0.220:3260 {{(pid=71731) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 16:23:31 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-a969112c-b8b8-4710-b337-1114a7ebb0b2 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] HCTL ('35', '-', '-', 0) found on session 17 with lun 0 {{(pid=71731) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 16:23:31 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-a969112c-b8b8-4710-b337-1114a7ebb0b2 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=71731) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 16:23:31 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:23:31 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.026s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:23:31 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[453047ab-0cf8-40b6-bc78-2e8cc476eb1a]: (4, ('- - 0', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:23:31 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-a969112c-b8b8-4710-b337-1114a7ebb0b2 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Searching for a device in session 17 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=71731) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 16:23:31 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-a969112c-b8b8-4710-b337-1114a7ebb0b2 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:e962a4d5-41c9-4b3b-b78e-c25e451aa73f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iITrFYGA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71731) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 16:23:31 user nova-compute[71731]: DEBUG nova.compute.manager [req-8408accb-65cb-4289-b81b-56e27276ddfb req-d07750a9-6020-4112-b629-b218b5586a93 service nova] [instance: e4ada2d7-7ace-4ed4-86a6-ed121c95e80f] Received event network-vif-deleted-8f3a3011-e474-4538-812b-9df3968fd629 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:23:31 user nova-compute[71731]: DEBUG nova.compute.manager [req-8408accb-65cb-4289-b81b-56e27276ddfb req-d07750a9-6020-4112-b629-b218b5586a93 service nova] [instance: 2549ba85-4e0a-420e-b711-07cafa8c60e9] Received event network-vif-deleted-0152bbb9-d50d-4e58-8a2b-727c4675ea2f {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:23:31 user nova-compute[71731]: INFO nova.compute.manager [req-8408accb-65cb-4289-b81b-56e27276ddfb req-d07750a9-6020-4112-b629-b218b5586a93 service nova] [instance: 2549ba85-4e0a-420e-b711-07cafa8c60e9] Neutron deleted interface 0152bbb9-d50d-4e58-8a2b-727c4675ea2f; detaching it from the instance and deleting it from the info cache
Apr 13 16:23:31 user nova-compute[71731]: DEBUG nova.network.neutron [req-8408accb-65cb-4289-b81b-56e27276ddfb req-d07750a9-6020-4112-b629-b218b5586a93 service nova] [instance: 2549ba85-4e0a-420e-b711-07cafa8c60e9] Updating instance_info_cache with network_info: [{"id": "d7155dcf-9e83-4579-b81a-7277d4a9eeaf", "address": "fa:16:3e:d0:1a:bc", "network": {"id": "5d158a82-de85-48b5-9f17-40e61e9b0df8", "bridge": "br-int", "label": "tempest-device-tagging-net1-574676351", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.246", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bbe4e9fb786d4015b035b4d00f75a1ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7155dcf-9e", "ovs_interfaceid": "d7155dcf-9e83-4579-b81a-7277d4a9eeaf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4c481745-6342-43f8-9040-3ea1d8c5c572", "address": "fa:16:3e:e7:ea:ff", "network": {"id": "5d158a82-de85-48b5-9f17-40e61e9b0df8", "bridge": "br-int", "label": "tempest-device-tagging-net1-574676351", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.164", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bbe4e9fb786d4015b035b4d00f75a1ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c481745-63", "ovs_interfaceid": "4c481745-6342-43f8-9040-3ea1d8c5c572", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3730ed6e-b093-4232-800b-b064d650e9e8", "address": "fa:16:3e:a8:c4:f6", "network": {"id": "5d158a82-de85-48b5-9f17-40e61e9b0df8", "bridge": "br-int", "label": "tempest-device-tagging-net1-574676351", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.38", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bbe4e9fb786d4015b035b4d00f75a1ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3730ed6e-b0", "ovs_interfaceid": "3730ed6e-b093-4232-800b-b064d650e9e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "38e92b7c-b7c1-4137-a1db-21bc1d24f3ee", "address": "fa:16:3e:a3:dd:27", "network": {"id": "4224b04f-23ed-464e-9b2c-df8c843f9287", "bridge": "br-int", "label": "tempest-device-tagging-net2-109401200", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "bbe4e9fb786d4015b035b4d00f75a1ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38e92b7c-b7", "ovs_interfaceid": "38e92b7c-b7c1-4137-a1db-21bc1d24f3ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:23:31 user nova-compute[71731]: DEBUG nova.compute.manager [req-8408accb-65cb-4289-b81b-56e27276ddfb req-d07750a9-6020-4112-b629-b218b5586a93 service nova] [instance: 2549ba85-4e0a-420e-b711-07cafa8c60e9] Detach interface failed, port_id=0152bbb9-d50d-4e58-8a2b-727c4675ea2f, reason: Instance 2549ba85-4e0a-420e-b711-07cafa8c60e9 could not be found. {{(pid=71731) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 13 16:23:31 user nova-compute[71731]: DEBUG nova.compute.manager [req-8408accb-65cb-4289-b81b-56e27276ddfb req-d07750a9-6020-4112-b629-b218b5586a93 service nova] [instance: 2549ba85-4e0a-420e-b711-07cafa8c60e9] Received event network-vif-deleted-3730ed6e-b093-4232-800b-b064d650e9e8 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:23:31 user nova-compute[71731]: INFO nova.compute.manager [req-8408accb-65cb-4289-b81b-56e27276ddfb req-d07750a9-6020-4112-b629-b218b5586a93 service nova] [instance: 2549ba85-4e0a-420e-b711-07cafa8c60e9] Neutron deleted interface 3730ed6e-b093-4232-800b-b064d650e9e8; detaching it from the instance and deleting it from the info cache
Apr 13 16:23:31 user nova-compute[71731]: DEBUG nova.network.neutron [req-8408accb-65cb-4289-b81b-56e27276ddfb req-d07750a9-6020-4112-b629-b218b5586a93 service nova] [instance: 2549ba85-4e0a-420e-b711-07cafa8c60e9] Updating instance_info_cache with network_info: [{"id": "d7155dcf-9e83-4579-b81a-7277d4a9eeaf", "address": "fa:16:3e:d0:1a:bc", "network": {"id": "5d158a82-de85-48b5-9f17-40e61e9b0df8", "bridge": "br-int", "label": "tempest-device-tagging-net1-574676351", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.246", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bbe4e9fb786d4015b035b4d00f75a1ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7155dcf-9e", "ovs_interfaceid": "d7155dcf-9e83-4579-b81a-7277d4a9eeaf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4c481745-6342-43f8-9040-3ea1d8c5c572", "address": "fa:16:3e:e7:ea:ff", "network": {"id": "5d158a82-de85-48b5-9f17-40e61e9b0df8", "bridge": "br-int", "label": "tempest-device-tagging-net1-574676351", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.164", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bbe4e9fb786d4015b035b4d00f75a1ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c481745-63", "ovs_interfaceid": "4c481745-6342-43f8-9040-3ea1d8c5c572", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "38e92b7c-b7c1-4137-a1db-21bc1d24f3ee", "address": "fa:16:3e:a3:dd:27", "network": {"id": "4224b04f-23ed-464e-9b2c-df8c843f9287", "bridge": "br-int", "label": "tempest-device-tagging-net2-109401200", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "bbe4e9fb786d4015b035b4d00f75a1ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38e92b7c-b7", "ovs_interfaceid": "38e92b7c-b7c1-4137-a1db-21bc1d24f3ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:23:32 user nova-compute[71731]: DEBUG nova.compute.manager [req-8408accb-65cb-4289-b81b-56e27276ddfb req-d07750a9-6020-4112-b629-b218b5586a93 service nova] [instance: 2549ba85-4e0a-420e-b711-07cafa8c60e9] Detach interface failed, port_id=3730ed6e-b093-4232-800b-b064d650e9e8, reason: Instance 2549ba85-4e0a-420e-b711-07cafa8c60e9 could not be found. {{(pid=71731) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 13 16:23:32 user nova-compute[71731]: DEBUG nova.compute.manager [req-8408accb-65cb-4289-b81b-56e27276ddfb req-d07750a9-6020-4112-b629-b218b5586a93 service nova] [instance: e4ada2d7-7ace-4ed4-86a6-ed121c95e80f] Received event network-vif-deleted-a409f60c-6c6a-49f8-8520-04614e804002 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:23:32 user nova-compute[71731]: DEBUG nova.network.neutron [-] [instance: 2549ba85-4e0a-420e-b711-07cafa8c60e9] Updating instance_info_cache with network_info: [] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:23:32 user nova-compute[71731]: INFO nova.compute.manager [-] [instance: 2549ba85-4e0a-420e-b711-07cafa8c60e9] Took 7.40 seconds to deallocate network for instance.
Apr 13 16:23:32 user nova-compute[71731]: DEBUG nova.compute.manager [req-f37f0d3f-7667-49d8-b844-831d0503ef73 req-36dc23bc-d367-4ff3-866f-0e8e308ef2c4 service nova] [instance: bf350da4-9cc2-4900-adf0-506e44984b42] Received event network-vif-plugged-1a737bae-3b9b-43b4-8a89-0eb98fdf2ec8 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:23:32 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-f37f0d3f-7667-49d8-b844-831d0503ef73 req-36dc23bc-d367-4ff3-866f-0e8e308ef2c4 service nova] Acquiring lock "bf350da4-9cc2-4900-adf0-506e44984b42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:23:32 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-f37f0d3f-7667-49d8-b844-831d0503ef73 req-36dc23bc-d367-4ff3-866f-0e8e308ef2c4 service nova] Lock "bf350da4-9cc2-4900-adf0-506e44984b42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:23:32 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-f37f0d3f-7667-49d8-b844-831d0503ef73 req-36dc23bc-d367-4ff3-866f-0e8e308ef2c4 service nova] Lock "bf350da4-9cc2-4900-adf0-506e44984b42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:23:32 user nova-compute[71731]: DEBUG nova.compute.manager [req-f37f0d3f-7667-49d8-b844-831d0503ef73 req-36dc23bc-d367-4ff3-866f-0e8e308ef2c4 service nova] [instance: bf350da4-9cc2-4900-adf0-506e44984b42] No waiting events found dispatching network-vif-plugged-1a737bae-3b9b-43b4-8a89-0eb98fdf2ec8 {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:23:32 user nova-compute[71731]: WARNING nova.compute.manager [req-f37f0d3f-7667-49d8-b844-831d0503ef73 req-36dc23bc-d367-4ff3-866f-0e8e308ef2c4 service nova] [instance: bf350da4-9cc2-4900-adf0-506e44984b42] Received unexpected event network-vif-plugged-1a737bae-3b9b-43b4-8a89-0eb98fdf2ec8 for instance with vm_state active and task_state shelving.
Apr 13 16:23:32 user nova-compute[71731]: DEBUG nova.compute.manager [req-f37f0d3f-7667-49d8-b844-831d0503ef73 req-36dc23bc-d367-4ff3-866f-0e8e308ef2c4 service nova] [instance: 235f827c-7116-48e9-84c5-0c9761c18e1e] Received event network-vif-plugged-b72a6c8b-7244-41c2-a4f7-6da43b4944b8 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:23:32 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-f37f0d3f-7667-49d8-b844-831d0503ef73 req-36dc23bc-d367-4ff3-866f-0e8e308ef2c4 service nova] Acquiring lock "235f827c-7116-48e9-84c5-0c9761c18e1e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:23:32 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-f37f0d3f-7667-49d8-b844-831d0503ef73 req-36dc23bc-d367-4ff3-866f-0e8e308ef2c4 service nova] Lock "235f827c-7116-48e9-84c5-0c9761c18e1e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:23:32 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-f37f0d3f-7667-49d8-b844-831d0503ef73 req-36dc23bc-d367-4ff3-866f-0e8e308ef2c4 service nova] Lock "235f827c-7116-48e9-84c5-0c9761c18e1e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:23:32 user nova-compute[71731]: DEBUG nova.compute.manager [req-f37f0d3f-7667-49d8-b844-831d0503ef73 req-36dc23bc-d367-4ff3-866f-0e8e308ef2c4 service nova] [instance: 235f827c-7116-48e9-84c5-0c9761c18e1e] No waiting events found dispatching network-vif-plugged-b72a6c8b-7244-41c2-a4f7-6da43b4944b8 {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:23:32 user nova-compute[71731]: WARNING nova.compute.manager [req-f37f0d3f-7667-49d8-b844-831d0503ef73 req-36dc23bc-d367-4ff3-866f-0e8e308ef2c4 service nova] [instance: 235f827c-7116-48e9-84c5-0c9761c18e1e] Received unexpected event network-vif-plugged-b72a6c8b-7244-41c2-a4f7-6da43b4944b8 for instance with vm_state building and task_state spawning.
Apr 13 16:23:32 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-a969112c-b8b8-4710-b337-1114a7ebb0b2 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.395s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 16:23:32 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-a969112c-b8b8-4710-b337-1114a7ebb0b2 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] <== connect_volume: return (1397ms) {'type': 'block', 'scsi_wwn': '23531373265613430', 'path': '/dev/sdd'} {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 16:23:32 user nova-compute[71731]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a969112c-b8b8-4710-b337-1114a7ebb0b2 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] [instance: 031c7939-a53c-4f7d-9f36-4ec1d06e2717] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23531373265613430', 'path': '/dev/sdd'} {{(pid=71731) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 16:23:32 user nova-compute[71731]: DEBUG nova.objects.instance [None req-a969112c-b8b8-4710-b337-1114a7ebb0b2 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Lazy-loading 'flavor' on Instance uuid 031c7939-a53c-4f7d-9f36-4ec1d06e2717 {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:23:32 user nova-compute[71731]: DEBUG nova.virt.libvirt.guest [None req-a969112c-b8b8-4710-b337-1114a7ebb0b2 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] attach device xml: <disk type="block" device="disk">
Apr 13 16:23:32 user nova-compute[71731]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 16:23:32 user nova-compute[71731]:   <source dev="/dev/sdd"/>
Apr 13 16:23:32 user nova-compute[71731]:   <target dev="vdb" bus="virtio"/>
Apr 13 16:23:32 user nova-compute[71731]:   <serial>e962a4d5-41c9-4b3b-b78e-c25e451aa73f</serial>
Apr 13 16:23:32 user nova-compute[71731]: </disk>
Apr 13 16:23:32 user nova-compute[71731]:  {{(pid=71731) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 13 16:23:33 user nova-compute[71731]: DEBUG nova.network.neutron [None req-12217892-5cbd-46ad-9ee3-cc51a81755e5 tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] [instance: bf350da4-9cc2-4900-adf0-506e44984b42] Updating instance_info_cache with network_info: [{"id": "1a737bae-3b9b-43b4-8a89-0eb98fdf2ec8", "address": "fa:16:3e:18:7d:11", "network": {"id": "c06f107f-4fa0-46dc-8766-3c882c401851", "bridge": "br-int", "label": "tempest-TestShelveInstance-1490339676-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed94fa5d89c2486b8e2951e608e6630f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a737bae-3b", "ovs_interfaceid": "1a737bae-3b9b-43b4-8a89-0eb98fdf2ec8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:23:33 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-a969112c-b8b8-4710-b337-1114a7ebb0b2 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] No BDM found with device name vda, not building metadata. {{(pid=71731) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 16:23:33 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-a969112c-b8b8-4710-b337-1114a7ebb0b2 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71731) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 16:23:33 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-a969112c-b8b8-4710-b337-1114a7ebb0b2 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] No VIF found with MAC fa:16:3e:42:0a:ee, not building metadata {{(pid=71731) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 16:23:33 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-12217892-5cbd-46ad-9ee3-cc51a81755e5 tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Releasing lock "refresh_cache-bf350da4-9cc2-4900-adf0-506e44984b42" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 16:23:33 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:23:33 user nova-compute[71731]: DEBUG nova.virt.driver [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Emitting event <LifecycleEvent: 1681403013.5204296, 235f827c-7116-48e9-84c5-0c9761c18e1e => Resumed> {{(pid=71731) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 16:23:33 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 235f827c-7116-48e9-84c5-0c9761c18e1e] VM Resumed (Lifecycle Event)
Apr 13 16:23:33 user nova-compute[71731]: DEBUG nova.compute.manager [None req-9e131767-04d4-45b2-8e12-2a4ab0daa556 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: 235f827c-7116-48e9-84c5-0c9761c18e1e] Instance event wait completed in 0 seconds for  {{(pid=71731) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 16:23:33 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-9e131767-04d4-45b2-8e12-2a4ab0daa556 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: 235f827c-7116-48e9-84c5-0c9761c18e1e] Guest created on hypervisor {{(pid=71731) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 16:23:33 user nova-compute[71731]: INFO nova.virt.libvirt.driver [-] [instance: 235f827c-7116-48e9-84c5-0c9761c18e1e] Instance spawned successfully.
Apr 13 16:23:33 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-9e131767-04d4-45b2-8e12-2a4ab0daa556 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: 235f827c-7116-48e9-84c5-0c9761c18e1e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 16:23:33 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 235f827c-7116-48e9-84c5-0c9761c18e1e] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:23:33 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 235f827c-7116-48e9-84c5-0c9761c18e1e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71731) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 16:23:33 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-9e131767-04d4-45b2-8e12-2a4ab0daa556 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: 235f827c-7116-48e9-84c5-0c9761c18e1e] Found default for hw_cdrom_bus of ide {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:23:33 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-9e131767-04d4-45b2-8e12-2a4ab0daa556 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: 235f827c-7116-48e9-84c5-0c9761c18e1e] Found default for hw_disk_bus of virtio {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:23:33 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-9e131767-04d4-45b2-8e12-2a4ab0daa556 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: 235f827c-7116-48e9-84c5-0c9761c18e1e] Found default for hw_input_bus of None {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:23:33 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-9e131767-04d4-45b2-8e12-2a4ab0daa556 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: 235f827c-7116-48e9-84c5-0c9761c18e1e] Found default for hw_pointer_model of None {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:23:33 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-9e131767-04d4-45b2-8e12-2a4ab0daa556 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: 235f827c-7116-48e9-84c5-0c9761c18e1e] Found default for hw_video_model of virtio {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:23:33 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-9e131767-04d4-45b2-8e12-2a4ab0daa556 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: 235f827c-7116-48e9-84c5-0c9761c18e1e] Found default for hw_vif_model of virtio {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:23:33 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 235f827c-7116-48e9-84c5-0c9761c18e1e] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 16:23:33 user nova-compute[71731]: DEBUG nova.virt.driver [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Emitting event <LifecycleEvent: 1681403013.5282276, 235f827c-7116-48e9-84c5-0c9761c18e1e => Started> {{(pid=71731) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 16:23:33 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 235f827c-7116-48e9-84c5-0c9761c18e1e] VM Started (Lifecycle Event)
Apr 13 16:23:33 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 235f827c-7116-48e9-84c5-0c9761c18e1e] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:23:33 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-a969112c-b8b8-4710-b337-1114a7ebb0b2 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Lock "031c7939-a53c-4f7d-9f36-4ec1d06e2717" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.278s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:23:33 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 235f827c-7116-48e9-84c5-0c9761c18e1e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71731) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 16:23:33 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 235f827c-7116-48e9-84c5-0c9761c18e1e] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 16:23:33 user nova-compute[71731]: INFO nova.compute.manager [None req-9e131767-04d4-45b2-8e12-2a4ab0daa556 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: 235f827c-7116-48e9-84c5-0c9761c18e1e] Took 6.31 seconds to spawn the instance on the hypervisor.
Apr 13 16:23:33 user nova-compute[71731]: DEBUG nova.compute.manager [None req-9e131767-04d4-45b2-8e12-2a4ab0daa556 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: 235f827c-7116-48e9-84c5-0c9761c18e1e] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:23:33 user nova-compute[71731]: INFO nova.compute.manager [None req-9e131767-04d4-45b2-8e12-2a4ab0daa556 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: 235f827c-7116-48e9-84c5-0c9761c18e1e] Took 18.62 seconds to build instance.
Apr 13 16:23:33 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-9e131767-04d4-45b2-8e12-2a4ab0daa556 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lock "235f827c-7116-48e9-84c5-0c9761c18e1e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.738s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:23:33 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:23:33 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-b9c9119a-d4f4-4884-83ee-893254529e1c tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Acquiring lock "94a2b8c9-388d-454c-88a1-54d7a8506511" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:23:33 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-b9c9119a-d4f4-4884-83ee-893254529e1c tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Lock "94a2b8c9-388d-454c-88a1-54d7a8506511" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:23:33 user nova-compute[71731]: DEBUG nova.compute.manager [None req-b9c9119a-d4f4-4884-83ee-893254529e1c tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] [instance: 94a2b8c9-388d-454c-88a1-54d7a8506511] Starting instance... {{(pid=71731) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 16:23:34 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-b9c9119a-d4f4-4884-83ee-893254529e1c tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:23:34 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-b9c9119a-d4f4-4884-83ee-893254529e1c tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:23:34 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-b9c9119a-d4f4-4884-83ee-893254529e1c tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71731) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 16:23:34 user nova-compute[71731]: INFO nova.compute.claims [None req-b9c9119a-d4f4-4884-83ee-893254529e1c tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] [instance: 94a2b8c9-388d-454c-88a1-54d7a8506511] Claim successful on node user
Apr 13 16:23:34 user nova-compute[71731]: DEBUG nova.compute.manager [req-2168ef01-0997-424c-9465-d55dea4f93e7 req-5821bfec-7c2b-4343-86aa-0dbf34121007 service nova] [instance: 2549ba85-4e0a-420e-b711-07cafa8c60e9] Received event network-vif-deleted-38e92b7c-b7c1-4137-a1db-21bc1d24f3ee {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:23:34 user nova-compute[71731]: INFO nova.compute.manager [None req-dbf47c70-b17d-428f-97f0-d7601655d4d4 tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] [instance: e4ada2d7-7ace-4ed4-86a6-ed121c95e80f] Took 2.92 seconds to detach 3 volumes for instance.
Apr 13 16:23:34 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-dbf47c70-b17d-428f-97f0-d7601655d4d4 tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:23:34 user nova-compute[71731]: DEBUG nova.compute.provider_tree [None req-b9c9119a-d4f4-4884-83ee-893254529e1c tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Inventory has not changed in ProviderTree for provider: cb6b1a64-0c24-4e2d-af1e-16576ca9165c {{(pid=71731) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 16:23:34 user nova-compute[71731]: DEBUG nova.scheduler.client.report [None req-b9c9119a-d4f4-4884-83ee-893254529e1c tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Inventory has not changed for provider cb6b1a64-0c24-4e2d-af1e-16576ca9165c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71731) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 16:23:34 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-b9c9119a-d4f4-4884-83ee-893254529e1c tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.577s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:23:34 user nova-compute[71731]: DEBUG nova.compute.manager [None req-b9c9119a-d4f4-4884-83ee-893254529e1c tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] [instance: 94a2b8c9-388d-454c-88a1-54d7a8506511] Start building networks asynchronously for instance. {{(pid=71731) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 16:23:34 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-dbf47c70-b17d-428f-97f0-d7601655d4d4 tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.366s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:23:34 user nova-compute[71731]: INFO nova.virt.libvirt.driver [-] [instance: bf350da4-9cc2-4900-adf0-506e44984b42] Instance destroyed successfully.
Apr 13 16:23:34 user nova-compute[71731]: DEBUG nova.objects.instance [None req-12217892-5cbd-46ad-9ee3-cc51a81755e5 tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Lazy-loading 'resources' on Instance uuid bf350da4-9cc2-4900-adf0-506e44984b42 {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:23:34 user nova-compute[71731]: DEBUG nova.virt.libvirt.vif [None req-12217892-5cbd-46ad-9ee3-cc51a81755e5 tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T16:21:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1925968525',display_name='tempest-TestShelveInstance-server-1925968525',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1925968525',id=11,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDyAJlgxv64OYVoDx7VUkbgPL/6uJGmronkd0R5CCODRVVo/i2lNlZVafBS/KDfrnkMj0B1mexq0GfoaJ06IYh54z6OmormUG7yLrIuZRcmrCeKwYmEEqzhVcYWIYdAQ0Q==',key_name='tempest-TestShelveInstance-2029240993',keypairs=<?>,launch_index=0,launched_at=2023-04-13T16:21:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ed94fa5d89c2486b8e2951e608e6630f',ramdisk_id='',reservation_id='r-dy6iwcv2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1159741724',owner_user_name='tempest-TestShelveInstance-1159741724-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T16:21:50Z,user_data=None,user_id='fe6a4bf1a7794af2958c3d53ea1e19c6',uuid=bf350da4-9cc2-4900-adf0-506e44984b42,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1a737bae-3b9b-43b4-8a89-0eb98fdf2ec8", "address": "fa:16:3e:18:7d:11", "network": {"id": "c06f107f-4fa0-46dc-8766-3c882c401851", "bridge": "br-int", "label": "tempest-TestShelveInstance-1490339676-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed94fa5d89c2486b8e2951e608e6630f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a737bae-3b", "ovs_interfaceid": "1a737bae-3b9b-43b4-8a89-0eb98fdf2ec8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 16:23:34 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-12217892-5cbd-46ad-9ee3-cc51a81755e5 tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Converting VIF {"id": "1a737bae-3b9b-43b4-8a89-0eb98fdf2ec8", "address": "fa:16:3e:18:7d:11", "network": {"id": "c06f107f-4fa0-46dc-8766-3c882c401851", "bridge": "br-int", "label": "tempest-TestShelveInstance-1490339676-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed94fa5d89c2486b8e2951e608e6630f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a737bae-3b", "ovs_interfaceid": "1a737bae-3b9b-43b4-8a89-0eb98fdf2ec8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 16:23:34 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-12217892-5cbd-46ad-9ee3-cc51a81755e5 tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:18:7d:11,bridge_name='br-int',has_traffic_filtering=True,id=1a737bae-3b9b-43b4-8a89-0eb98fdf2ec8,network=Network(c06f107f-4fa0-46dc-8766-3c882c401851),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a737bae-3b') {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 16:23:34 user nova-compute[71731]: DEBUG os_vif [None req-12217892-5cbd-46ad-9ee3-cc51a81755e5 tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:7d:11,bridge_name='br-int',has_traffic_filtering=True,id=1a737bae-3b9b-43b4-8a89-0eb98fdf2ec8,network=Network(c06f107f-4fa0-46dc-8766-3c882c401851),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a737bae-3b') {{(pid=71731) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 16:23:34 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:23:34 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1a737bae-3b, bridge=br-int, if_exists=True) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:23:34 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:23:34 user nova-compute[71731]: DEBUG nova.compute.manager [None req-b9c9119a-d4f4-4884-83ee-893254529e1c tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] [instance: 94a2b8c9-388d-454c-88a1-54d7a8506511] Allocating IP information in the background. {{(pid=71731) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 16:23:34 user nova-compute[71731]: DEBUG nova.network.neutron [None req-b9c9119a-d4f4-4884-83ee-893254529e1c tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] [instance: 94a2b8c9-388d-454c-88a1-54d7a8506511] allocate_for_instance() {{(pid=71731) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 16:23:34 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 16:23:34 user nova-compute[71731]: INFO os_vif [None req-12217892-5cbd-46ad-9ee3-cc51a81755e5 tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:7d:11,bridge_name='br-int',has_traffic_filtering=True,id=1a737bae-3b9b-43b4-8a89-0eb98fdf2ec8,network=Network(c06f107f-4fa0-46dc-8766-3c882c401851),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a737bae-3b')
Apr 13 16:23:34 user nova-compute[71731]: DEBUG nova.virt.libvirt.volume.iscsi [None req-12217892-5cbd-46ad-9ee3-cc51a81755e5 tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] [instance: bf350da4-9cc2-4900-adf0-506e44984b42] calling os-brick to detach iSCSI Volume {{(pid=71731) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 16:23:34 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-12217892-5cbd-46ad-9ee3-cc51a81755e5 tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8cf0118790>, {'target_iqn': 'iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KoxklySD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 16:23:34 user nova-compute[71731]: WARNING os_brick.initiator.connectors.base [None req-12217892-5cbd-46ad-9ee3-cc51a81755e5 tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 16:23:34 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-12217892-5cbd-46ad-9ee3-cc51a81755e5 tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 16:23:34 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-12217892-5cbd-46ad-9ee3-cc51a81755e5 tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 16:23:34 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:23:34 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-b9c9119a-d4f4-4884-83ee-893254529e1c tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] [instance: 94a2b8c9-388d-454c-88a1-54d7a8506511] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 16:23:34 user nova-compute[71731]: DEBUG nova.compute.manager [None req-b9c9119a-d4f4-4884-83ee-893254529e1c tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] [instance: 94a2b8c9-388d-454c-88a1-54d7a8506511] Start building block device mappings for instance. {{(pid=71731) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 16:23:34 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.050s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:23:34 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[f14a4723-1730-4267-a8cb-468c3cdd1f01]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0e3b49ec-80af-4c38-9689-f7277e495d21\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e962a4d5-41c9-4b3b-b78e-c25e451aa73f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:23:34 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-12217892-5cbd-46ad-9ee3-cc51a81755e5 tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 16:23:34 user nova-compute[71731]: No targets found.
Apr 13 16:23:34 user nova-compute[71731]: iSNS:
Apr 13 16:23:34 user nova-compute[71731]: No targets found.
Apr 13 16:23:34 user nova-compute[71731]: STATIC:
Apr 13 16:23:34 user nova-compute[71731]: Target: iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97
Apr 13 16:23:34 user nova-compute[71731]:         Portal: 172.16.0.220:3260,-1
Apr 13 16:23:34 user nova-compute[71731]:                 Iface Name: default
Apr 13 16:23:34 user nova-compute[71731]: Target: iqn.2010-10.org.openstack:0e3b49ec-80af-4c38-9689-f7277e495d21
Apr 13 16:23:34 user nova-compute[71731]:         Portal: 172.16.0.220:3260,-1
Apr 13 16:23:34 user nova-compute[71731]:                 Iface Name: default
Apr 13 16:23:34 user nova-compute[71731]: Target: iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984
Apr 13 16:23:34 user nova-compute[71731]:         Portal: 172.16.0.220:3260,-1
Apr 13 16:23:34 user nova-compute[71731]:                 Iface Name: default
Apr 13 16:23:34 user nova-compute[71731]: Target: iqn.2010-10.org.openstack:e962a4d5-41c9-4b3b-b78e-c25e451aa73f
Apr 13 16:23:34 user nova-compute[71731]:         Portal: 172.16.0.220:3260,-1
Apr 13 16:23:34 user nova-compute[71731]:                 Iface Name: default
Apr 13 16:23:34 user nova-compute[71731]: FIRMWARE:
Apr 13 16:23:34 user nova-compute[71731]: No targets found.
Apr 13 16:23:34 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 16:23:34 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-12217892-5cbd-46ad-9ee3-cc51a81755e5 tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 16:23:34 user nova-compute[71731]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 16:23:34 user nova-compute[71731]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71731) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 16:23:34 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-12217892-5cbd-46ad-9ee3-cc51a81755e5 tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984', 0)] {{(pid=71731) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 16:23:34 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:23:34 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:23:34 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[889d6701-fe4a-4c35-aa3a-d7f24af1ff78]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0e3b49ec-80af-4c38-9689-f7277e495d21\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e962a4d5-41c9-4b3b-b78e-c25e451aa73f\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:23:34 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:23:34 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:23:34 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf2aa012-9590-4e7e-a2fe-b32e546d0180]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e3b49ec-80af-4c38-9689-f7277e495d21 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e962a4d5-41c9-4b3b-b78e-c25e451aa73f (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984 (non-flash)\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:23:34 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-12217892-5cbd-46ad-9ee3-cc51a81755e5 tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e3b49ec-80af-4c38-9689-f7277e495d21 (non-flash)
Apr 13 16:23:34 user nova-compute[71731]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)
Apr 13 16:23:34 user nova-compute[71731]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e962a4d5-41c9-4b3b-b78e-c25e451aa73f (non-flash)
Apr 13 16:23:34 user nova-compute[71731]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984 (non-flash)
Apr 13 16:23:34 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 16:23:34 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-12217892-5cbd-46ad-9ee3-cc51a81755e5 tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e3b49ec-80af-4c38-9689-f7277e495d21 (non-flash)
Apr 13 16:23:34 user nova-compute[71731]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)
Apr 13 16:23:34 user nova-compute[71731]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e962a4d5-41c9-4b3b-b78e-c25e451aa73f (non-flash)
Apr 13 16:23:34 user nova-compute[71731]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984 (non-flash)
Apr 13 16:23:34 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 16:23:34 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-12217892-5cbd-46ad-9ee3-cc51a81755e5 tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8cff4cf7f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984'): ({'sdb'}, set())}) {{(pid=71731) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 16:23:34 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-12217892-5cbd-46ad-9ee3-cc51a81755e5 tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Removing single pathed devices sdb {{(pid=71731) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 16:23:34 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:23:34 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:23:34 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b429319-e5a4-4d92-a15c-6d9cb57ecd68]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:23:34 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:23:34 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:23:34 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[518ef0df-c916-4533-9e42-9d86cfb1ea8e]: (4, ('ok\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:23:34 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-12217892-5cbd-46ad-9ee3-cc51a81755e5 tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Flushing IO for device /dev/sdb {{(pid=71731) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 16:23:34 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:23:34 user nova-compute[71731]: DEBUG nova.compute.manager [None req-b9c9119a-d4f4-4884-83ee-893254529e1c tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] [instance: 94a2b8c9-388d-454c-88a1-54d7a8506511] Start spawning the instance on the hypervisor. {{(pid=71731) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 16:23:34 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-b9c9119a-d4f4-4884-83ee-893254529e1c tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] [instance: 94a2b8c9-388d-454c-88a1-54d7a8506511] Creating instance directory {{(pid=71731) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 16:23:34 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-b9c9119a-d4f4-4884-83ee-893254529e1c tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] [instance: 94a2b8c9-388d-454c-88a1-54d7a8506511] Creating image(s)
Apr 13 16:23:34 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-b9c9119a-d4f4-4884-83ee-893254529e1c tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Acquiring lock "/opt/stack/data/nova/instances/94a2b8c9-388d-454c-88a1-54d7a8506511/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:23:34 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-b9c9119a-d4f4-4884-83ee-893254529e1c tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Lock "/opt/stack/data/nova/instances/94a2b8c9-388d-454c-88a1-54d7a8506511/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:23:34 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-b9c9119a-d4f4-4884-83ee-893254529e1c tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Lock "/opt/stack/data/nova/instances/94a2b8c9-388d-454c-88a1-54d7a8506511/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:23:34 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-b9c9119a-d4f4-4884-83ee-893254529e1c tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279 --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:23:34 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.019s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:23:34 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ca1d1c7-2d2c-49e5-bc14-92d0d23a1e4a]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:23:34 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-12217892-5cbd-46ad-9ee3-cc51a81755e5 tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71731) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 16:23:34 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:23:35 user nova-compute[71731]: DEBUG nova.compute.manager [req-fc33f3be-9d20-46ad-90f9-8873b05de0c6 req-f6499974-171f-4633-912e-619208aaff0e service nova] [instance: 235f827c-7116-48e9-84c5-0c9761c18e1e] Received event network-vif-plugged-b72a6c8b-7244-41c2-a4f7-6da43b4944b8 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:23:35 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-fc33f3be-9d20-46ad-90f9-8873b05de0c6 req-f6499974-171f-4633-912e-619208aaff0e service nova] Acquiring lock "235f827c-7116-48e9-84c5-0c9761c18e1e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:23:35 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-fc33f3be-9d20-46ad-90f9-8873b05de0c6 req-f6499974-171f-4633-912e-619208aaff0e service nova] Lock "235f827c-7116-48e9-84c5-0c9761c18e1e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:23:35 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-fc33f3be-9d20-46ad-90f9-8873b05de0c6 req-f6499974-171f-4633-912e-619208aaff0e service nova] Lock "235f827c-7116-48e9-84c5-0c9761c18e1e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:23:35 user nova-compute[71731]: DEBUG nova.compute.manager [req-fc33f3be-9d20-46ad-90f9-8873b05de0c6 req-f6499974-171f-4633-912e-619208aaff0e service nova] [instance: 235f827c-7116-48e9-84c5-0c9761c18e1e] No waiting events found dispatching network-vif-plugged-b72a6c8b-7244-41c2-a4f7-6da43b4944b8 {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:23:35 user nova-compute[71731]: WARNING nova.compute.manager [req-fc33f3be-9d20-46ad-90f9-8873b05de0c6 req-f6499974-171f-4633-912e-619208aaff0e service nova] [instance: 235f827c-7116-48e9-84c5-0c9761c18e1e] Received unexpected event network-vif-plugged-b72a6c8b-7244-41c2-a4f7-6da43b4944b8 for instance with vm_state active and task_state None.
Apr 13 16:23:35 user nova-compute[71731]: DEBUG nova.compute.manager [req-fc33f3be-9d20-46ad-90f9-8873b05de0c6 req-f6499974-171f-4633-912e-619208aaff0e service nova] [instance: bf350da4-9cc2-4900-adf0-506e44984b42] Received event network-changed-1a737bae-3b9b-43b4-8a89-0eb98fdf2ec8 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:23:35 user nova-compute[71731]: DEBUG nova.compute.manager [req-fc33f3be-9d20-46ad-90f9-8873b05de0c6 req-f6499974-171f-4633-912e-619208aaff0e service nova] [instance: bf350da4-9cc2-4900-adf0-506e44984b42] Refreshing instance network info cache due to event network-changed-1a737bae-3b9b-43b4-8a89-0eb98fdf2ec8. {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 16:23:35 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-fc33f3be-9d20-46ad-90f9-8873b05de0c6 req-f6499974-171f-4633-912e-619208aaff0e service nova] Acquiring lock "refresh_cache-bf350da4-9cc2-4900-adf0-506e44984b42" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 16:23:35 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-fc33f3be-9d20-46ad-90f9-8873b05de0c6 req-f6499974-171f-4633-912e-619208aaff0e service nova] Acquired lock "refresh_cache-bf350da4-9cc2-4900-adf0-506e44984b42" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 16:23:35 user nova-compute[71731]: DEBUG nova.network.neutron [req-fc33f3be-9d20-46ad-90f9-8873b05de0c6 req-f6499974-171f-4633-912e-619208aaff0e service nova] [instance: bf350da4-9cc2-4900-adf0-506e44984b42] Refreshing network info cache for port 1a737bae-3b9b-43b4-8a89-0eb98fdf2ec8 {{(pid=71731) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 16:23:35 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.043s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:23:35 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[8316f240-a274-40a1-9ec7-ee6cf6bc60d9]: (4, ('1', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:23:35 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-12217892-5cbd-46ad-9ee3-cc51a81755e5 tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71731) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 16:23:35 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-12217892-5cbd-46ad-9ee3-cc51a81755e5 tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] SCSI volumes sdb have been removed. {{(pid=71731) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 16:23:35 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-12217892-5cbd-46ad-9ee3-cc51a81755e5 tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984')] {{(pid=71731) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 16:23:35 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:23:35 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.033s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:23:35 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f4dd58c-9638-49d6-b3ec-dce795528b4b]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:23:35 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-12217892-5cbd-46ad-9ee3-cc51a81755e5 tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:23:35 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984 -p 172.16.0.220:3260 --logout {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:23:35 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-b9c9119a-d4f4-4884-83ee-893254529e1c tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279 --force-share --output=json" returned: 0 in 0.170s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:23:35 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-b9c9119a-d4f4-4884-83ee-893254529e1c tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Acquiring lock "9524227dd898575c3099d3976f096cd935414279" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:23:35 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-b9c9119a-d4f4-4884-83ee-893254529e1c tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Lock "9524227dd898575c3099d3976f096cd935414279" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:23:35 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-b9c9119a-d4f4-4884-83ee-893254529e1c tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279 --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:23:35 user nova-compute[71731]: INFO nova.compute.manager [None req-48b63815-ac65-4477-a276-ce12f90a7768 tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] [instance: 2549ba85-4e0a-420e-b711-07cafa8c60e9] Took 2.86 seconds to detach 3 volumes for instance.
Apr 13 16:23:35 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984 -p 172.16.0.220:3260 --logout" returned: 0 in 0.080s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:23:35 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[f48955be-7350-42be-8778-ae9e9e897a41]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:23:35 user nova-compute[71731]: DEBUG nova.policy [None req-b9c9119a-d4f4-4884-83ee-893254529e1c tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '62cf399757f544649fed18ee5a31d50c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ded8a69b7e941f9bcdc502cfeed79db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71731) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 16:23:35 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-12217892-5cbd-46ad-9ee3-cc51a81755e5 tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984, portal: 172.16.0.220,3260]
Apr 13 16:23:35 user nova-compute[71731]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984, portal: 172.16.0.220,3260] successful.
Apr 13 16:23:35 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:23:35 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984 -p 172.16.0.220:3260 --op delete {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:23:35 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:23:35 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[79fd5e42-4689-4fd1-a541-1741b752e4ce]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:23:35 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-12217892-5cbd-46ad-9ee3-cc51a81755e5 tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:23:35 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-12217892-5cbd-46ad-9ee3-cc51a81755e5 tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.485s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 16:23:35 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-12217892-5cbd-46ad-9ee3-cc51a81755e5 tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] <== disconnect_volume: return (486ms) None {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 16:23:35 user nova-compute[71731]: DEBUG nova.virt.libvirt.volume.iscsi [None req-12217892-5cbd-46ad-9ee3-cc51a81755e5 tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] [instance: bf350da4-9cc2-4900-adf0-506e44984b42] Disconnected iSCSI Volume {{(pid=71731) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 16:23:35 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-12217892-5cbd-46ad-9ee3-cc51a81755e5 tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] [instance: bf350da4-9cc2-4900-adf0-506e44984b42] Deleting instance files /opt/stack/data/nova/instances/bf350da4-9cc2-4900-adf0-506e44984b42_del
Apr 13 16:23:35 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-12217892-5cbd-46ad-9ee3-cc51a81755e5 tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] [instance: bf350da4-9cc2-4900-adf0-506e44984b42] Deletion of /opt/stack/data/nova/instances/bf350da4-9cc2-4900-adf0-506e44984b42_del complete
Apr 13 16:23:35 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-48b63815-ac65-4477-a276-ce12f90a7768 tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:23:35 user nova-compute[71731]: DEBUG nova.compute.provider_tree [None req-dbf47c70-b17d-428f-97f0-d7601655d4d4 tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Inventory has not changed in ProviderTree for provider: cb6b1a64-0c24-4e2d-af1e-16576ca9165c {{(pid=71731) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 16:23:35 user nova-compute[71731]: DEBUG nova.scheduler.client.report [None req-dbf47c70-b17d-428f-97f0-d7601655d4d4 tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Inventory has not changed for provider cb6b1a64-0c24-4e2d-af1e-16576ca9165c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71731) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 16:23:35 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-b9c9119a-d4f4-4884-83ee-893254529e1c tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279 --force-share --output=json" returned: 0 in 0.204s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:23:35 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-b9c9119a-d4f4-4884-83ee-893254529e1c tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279,backing_fmt=raw /opt/stack/data/nova/instances/94a2b8c9-388d-454c-88a1-54d7a8506511/disk 1073741824 {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:23:35 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-dbf47c70-b17d-428f-97f0-d7601655d4d4 tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.730s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:23:35 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-48b63815-ac65-4477-a276-ce12f90a7768 tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.121s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:23:35 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-b9c9119a-d4f4-4884-83ee-893254529e1c tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279,backing_fmt=raw /opt/stack/data/nova/instances/94a2b8c9-388d-454c-88a1-54d7a8506511/disk 1073741824" returned: 0 in 0.062s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:23:35 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-b9c9119a-d4f4-4884-83ee-893254529e1c tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Lock "9524227dd898575c3099d3976f096cd935414279" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.272s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:23:35 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-b9c9119a-d4f4-4884-83ee-893254529e1c tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279 --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:23:35 user nova-compute[71731]: INFO nova.scheduler.client.report [None req-dbf47c70-b17d-428f-97f0-d7601655d4d4 tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Deleted allocations for instance e4ada2d7-7ace-4ed4-86a6-ed121c95e80f
Apr 13 16:23:35 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-b9c9119a-d4f4-4884-83ee-893254529e1c tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279 --force-share --output=json" returned: 0 in 0.161s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:23:35 user nova-compute[71731]: DEBUG nova.virt.disk.api [None req-b9c9119a-d4f4-4884-83ee-893254529e1c tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Checking if we can resize image /opt/stack/data/nova/instances/94a2b8c9-388d-454c-88a1-54d7a8506511/disk. size=1073741824 {{(pid=71731) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 16:23:35 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-b9c9119a-d4f4-4884-83ee-893254529e1c tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a2b8c9-388d-454c-88a1-54d7a8506511/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:23:35 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-dbf47c70-b17d-428f-97f0-d7601655d4d4 tempest-TaggedBootDevicesTest_v242-1193811043 tempest-TaggedBootDevicesTest_v242-1193811043-project-member] Lock "e4ada2d7-7ace-4ed4-86a6-ed121c95e80f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 16.735s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:23:35 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-b9c9119a-d4f4-4884-83ee-893254529e1c tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a2b8c9-388d-454c-88a1-54d7a8506511/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:23:35 user nova-compute[71731]: DEBUG nova.virt.disk.api [None req-b9c9119a-d4f4-4884-83ee-893254529e1c tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Cannot resize image /opt/stack/data/nova/instances/94a2b8c9-388d-454c-88a1-54d7a8506511/disk to a smaller size. {{(pid=71731) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 16:23:35 user nova-compute[71731]: DEBUG nova.objects.instance [None req-b9c9119a-d4f4-4884-83ee-893254529e1c tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Lazy-loading 'migration_context' on Instance uuid 94a2b8c9-388d-454c-88a1-54d7a8506511 {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:23:35 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-b9c9119a-d4f4-4884-83ee-893254529e1c tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] [instance: 94a2b8c9-388d-454c-88a1-54d7a8506511] Created local disks {{(pid=71731) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 16:23:35 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-b9c9119a-d4f4-4884-83ee-893254529e1c tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] [instance: 94a2b8c9-388d-454c-88a1-54d7a8506511] Ensure instance console log exists: /opt/stack/data/nova/instances/94a2b8c9-388d-454c-88a1-54d7a8506511/console.log {{(pid=71731) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 16:23:35 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-b9c9119a-d4f4-4884-83ee-893254529e1c tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:23:35 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-b9c9119a-d4f4-4884-83ee-893254529e1c tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:23:35 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-b9c9119a-d4f4-4884-83ee-893254529e1c tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:23:35 user nova-compute[71731]: DEBUG nova.network.neutron [req-fc33f3be-9d20-46ad-90f9-8873b05de0c6 req-f6499974-171f-4633-912e-619208aaff0e service nova] [instance: bf350da4-9cc2-4900-adf0-506e44984b42] Updated VIF entry in instance network info cache for port 1a737bae-3b9b-43b4-8a89-0eb98fdf2ec8. {{(pid=71731) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 16:23:35 user nova-compute[71731]: DEBUG nova.network.neutron [req-fc33f3be-9d20-46ad-90f9-8873b05de0c6 req-f6499974-171f-4633-912e-619208aaff0e service nova] [instance: bf350da4-9cc2-4900-adf0-506e44984b42] Updating instance_info_cache with network_info: [{"id": "1a737bae-3b9b-43b4-8a89-0eb98fdf2ec8", "address": "fa:16:3e:18:7d:11", "network": {"id": "c06f107f-4fa0-46dc-8766-3c882c401851", "bridge": null, "label": "tempest-TestShelveInstance-1490339676-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed94fa5d89c2486b8e2951e608e6630f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap1a737bae-3b", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:23:35 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-fc33f3be-9d20-46ad-90f9-8873b05de0c6 req-f6499974-171f-4633-912e-619208aaff0e service nova] Releasing lock "refresh_cache-bf350da4-9cc2-4900-adf0-506e44984b42" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 16:23:35 user nova-compute[71731]: DEBUG nova.compute.provider_tree [None req-48b63815-ac65-4477-a276-ce12f90a7768 tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Inventory has not changed in ProviderTree for provider: cb6b1a64-0c24-4e2d-af1e-16576ca9165c {{(pid=71731) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 16:23:35 user nova-compute[71731]: DEBUG nova.scheduler.client.report [None req-48b63815-ac65-4477-a276-ce12f90a7768 tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Inventory has not changed for provider cb6b1a64-0c24-4e2d-af1e-16576ca9165c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71731) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 16:23:35 user nova-compute[71731]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681403000.9118407, e4ada2d7-7ace-4ed4-86a6-ed121c95e80f => Stopped> {{(pid=71731) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 16:23:35 user nova-compute[71731]: INFO nova.compute.manager [-] [instance: e4ada2d7-7ace-4ed4-86a6-ed121c95e80f] VM Stopped (Lifecycle Event)
Apr 13 16:23:35 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-48b63815-ac65-4477-a276-ce12f90a7768 tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.591s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:23:35 user nova-compute[71731]: DEBUG nova.compute.manager [None req-0d353b1a-5f7e-4486-95b8-e27464f1a6a1 None None] [instance: e4ada2d7-7ace-4ed4-86a6-ed121c95e80f] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:23:35 user nova-compute[71731]: INFO nova.scheduler.client.report [None req-48b63815-ac65-4477-a276-ce12f90a7768 tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Deleted allocations for instance 2549ba85-4e0a-420e-b711-07cafa8c60e9
Apr 13 16:23:36 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-48b63815-ac65-4477-a276-ce12f90a7768 tempest-TaggedBootDevicesTest-1779812468 tempest-TaggedBootDevicesTest-1779812468-project-member] Lock "2549ba85-4e0a-420e-b711-07cafa8c60e9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 16.871s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:23:36 user nova-compute[71731]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681403001.3271577, 2549ba85-4e0a-420e-b711-07cafa8c60e9 => Stopped> {{(pid=71731) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 16:23:36 user nova-compute[71731]: INFO nova.compute.manager [-] [instance: 2549ba85-4e0a-420e-b711-07cafa8c60e9] VM Stopped (Lifecycle Event)
Apr 13 16:23:36 user nova-compute[71731]: DEBUG nova.compute.manager [None req-2124a992-9df3-4d5b-8004-851dd5a2bbfa None None] [instance: 2549ba85-4e0a-420e-b711-07cafa8c60e9] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:23:36 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:23:36 user nova-compute[71731]: INFO nova.scheduler.client.report [None req-12217892-5cbd-46ad-9ee3-cc51a81755e5 tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Deleted allocations for instance bf350da4-9cc2-4900-adf0-506e44984b42
Apr 13 16:23:36 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-12217892-5cbd-46ad-9ee3-cc51a81755e5 tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:23:36 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-12217892-5cbd-46ad-9ee3-cc51a81755e5 tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:23:36 user nova-compute[71731]: DEBUG nova.objects.instance [None req-12217892-5cbd-46ad-9ee3-cc51a81755e5 tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Lazy-loading 'numa_topology' on Instance uuid bf350da4-9cc2-4900-adf0-506e44984b42 {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:23:36 user nova-compute[71731]: DEBUG nova.network.neutron [None req-b9c9119a-d4f4-4884-83ee-893254529e1c tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] [instance: 94a2b8c9-388d-454c-88a1-54d7a8506511] Successfully created port: 8731e8dd-3e93-4fa1-b8e6-f1d2d10271f7 {{(pid=71731) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 16:23:36 user nova-compute[71731]: DEBUG nova.compute.provider_tree [None req-12217892-5cbd-46ad-9ee3-cc51a81755e5 tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Inventory has not changed in ProviderTree for provider: cb6b1a64-0c24-4e2d-af1e-16576ca9165c {{(pid=71731) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 16:23:36 user nova-compute[71731]: DEBUG nova.scheduler.client.report [None req-12217892-5cbd-46ad-9ee3-cc51a81755e5 tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Inventory has not changed for provider cb6b1a64-0c24-4e2d-af1e-16576ca9165c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71731) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 16:23:36 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-12217892-5cbd-46ad-9ee3-cc51a81755e5 tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.339s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:23:36 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-12217892-5cbd-46ad-9ee3-cc51a81755e5 tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Lock "bf350da4-9cc2-4900-adf0-506e44984b42" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 7.098s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:23:38 user nova-compute[71731]: DEBUG nova.network.neutron [None req-b9c9119a-d4f4-4884-83ee-893254529e1c tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] [instance: 94a2b8c9-388d-454c-88a1-54d7a8506511] Successfully updated port: 8731e8dd-3e93-4fa1-b8e6-f1d2d10271f7 {{(pid=71731) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 16:23:38 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-b9c9119a-d4f4-4884-83ee-893254529e1c tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Acquiring lock "refresh_cache-94a2b8c9-388d-454c-88a1-54d7a8506511" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 16:23:38 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-b9c9119a-d4f4-4884-83ee-893254529e1c tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Acquired lock "refresh_cache-94a2b8c9-388d-454c-88a1-54d7a8506511" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 16:23:38 user nova-compute[71731]: DEBUG nova.network.neutron [None req-b9c9119a-d4f4-4884-83ee-893254529e1c tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] [instance: 94a2b8c9-388d-454c-88a1-54d7a8506511] Building network info cache for instance {{(pid=71731) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 16:23:38 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:23:38 user nova-compute[71731]: DEBUG nova.compute.manager [req-cc9d6026-09d8-47ba-9c7f-d0f9ab1144f7 req-6ca0d72f-2659-42c1-bd8a-19b461f2183f service nova] [instance: 94a2b8c9-388d-454c-88a1-54d7a8506511] Received event network-changed-8731e8dd-3e93-4fa1-b8e6-f1d2d10271f7 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:23:38 user nova-compute[71731]: DEBUG nova.compute.manager [req-cc9d6026-09d8-47ba-9c7f-d0f9ab1144f7 req-6ca0d72f-2659-42c1-bd8a-19b461f2183f service nova] [instance: 94a2b8c9-388d-454c-88a1-54d7a8506511] Refreshing instance network info cache due to event network-changed-8731e8dd-3e93-4fa1-b8e6-f1d2d10271f7. {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 16:23:38 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-cc9d6026-09d8-47ba-9c7f-d0f9ab1144f7 req-6ca0d72f-2659-42c1-bd8a-19b461f2183f service nova] Acquiring lock "refresh_cache-94a2b8c9-388d-454c-88a1-54d7a8506511" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 16:23:38 user nova-compute[71731]: DEBUG nova.network.neutron [None req-b9c9119a-d4f4-4884-83ee-893254529e1c tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] [instance: 94a2b8c9-388d-454c-88a1-54d7a8506511] Instance cache missing network info. {{(pid=71731) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 16:23:38 user nova-compute[71731]: DEBUG nova.network.neutron [None req-b9c9119a-d4f4-4884-83ee-893254529e1c tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] [instance: 94a2b8c9-388d-454c-88a1-54d7a8506511] Updating instance_info_cache with network_info: [{"id": "8731e8dd-3e93-4fa1-b8e6-f1d2d10271f7", "address": "fa:16:3e:fb:19:75", "network": {"id": "fc7f5f86-d676-4a45-b0f4-c93f3eae043e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1421861184-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ded8a69b7e941f9bcdc502cfeed79db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8731e8dd-3e", "ovs_interfaceid": "8731e8dd-3e93-4fa1-b8e6-f1d2d10271f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:23:38 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-b9c9119a-d4f4-4884-83ee-893254529e1c tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Releasing lock "refresh_cache-94a2b8c9-388d-454c-88a1-54d7a8506511" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 16:23:38 user nova-compute[71731]: DEBUG nova.compute.manager [None req-b9c9119a-d4f4-4884-83ee-893254529e1c tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] [instance: 94a2b8c9-388d-454c-88a1-54d7a8506511] Instance network_info: |[{"id": "8731e8dd-3e93-4fa1-b8e6-f1d2d10271f7", "address": "fa:16:3e:fb:19:75", "network": {"id": "fc7f5f86-d676-4a45-b0f4-c93f3eae043e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1421861184-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ded8a69b7e941f9bcdc502cfeed79db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8731e8dd-3e", "ovs_interfaceid": "8731e8dd-3e93-4fa1-b8e6-f1d2d10271f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71731) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 16:23:38 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-cc9d6026-09d8-47ba-9c7f-d0f9ab1144f7 req-6ca0d72f-2659-42c1-bd8a-19b461f2183f service nova] Acquired lock "refresh_cache-94a2b8c9-388d-454c-88a1-54d7a8506511" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 16:23:38 user nova-compute[71731]: DEBUG nova.network.neutron [req-cc9d6026-09d8-47ba-9c7f-d0f9ab1144f7 req-6ca0d72f-2659-42c1-bd8a-19b461f2183f service nova] [instance: 94a2b8c9-388d-454c-88a1-54d7a8506511] Refreshing network info cache for port 8731e8dd-3e93-4fa1-b8e6-f1d2d10271f7 {{(pid=71731) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 16:23:38 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-b9c9119a-d4f4-4884-83ee-893254529e1c tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] [instance: 94a2b8c9-388d-454c-88a1-54d7a8506511] Start _get_guest_xml network_info=[{"id": "8731e8dd-3e93-4fa1-b8e6-f1d2d10271f7", "address": "fa:16:3e:fb:19:75", "network": {"id": "fc7f5f86-d676-4a45-b0f4-c93f3eae043e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1421861184-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ded8a69b7e941f9bcdc502cfeed79db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8731e8dd-3e", "ovs_interfaceid": "8731e8dd-3e93-4fa1-b8e6-f1d2d10271f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T16:16:31Z,direct_url=<?>,disk_format='qcow2',id=708622a9-7465-4492-ade8-b827198f7e30,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='0b29a975c552465aba0ac7d6288434bd',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T16:16:33Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'device_type': 'disk', 'encrypted': False, 'disk_bus': 'virtio', 'guest_format': None, 'encryption_options': None, 'image_id': '708622a9-7465-4492-ade8-b827198f7e30'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71731) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 16:23:38 user nova-compute[71731]: WARNING nova.virt.libvirt.driver [None req-b9c9119a-d4f4-4884-83ee-893254529e1c tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 16:23:38 user nova-compute[71731]: WARNING nova.virt.libvirt.driver [None req-b9c9119a-d4f4-4884-83ee-893254529e1c tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 16:23:38 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-b9c9119a-d4f4-4884-83ee-893254529e1c tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71731) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 16:23:38 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-b9c9119a-d4f4-4884-83ee-893254529e1c tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T16:17:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T16:16:31Z,direct_url=<?>,disk_format='qcow2',id=708622a9-7465-4492-ade8-b827198f7e30,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='0b29a975c552465aba0ac7d6288434bd',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T16:16:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 16:23:38 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-b9c9119a-d4f4-4884-83ee-893254529e1c tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Flavor limits 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 16:23:38 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-b9c9119a-d4f4-4884-83ee-893254529e1c tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Image limits 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 16:23:38 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-b9c9119a-d4f4-4884-83ee-893254529e1c tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Flavor pref 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 16:23:38 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-b9c9119a-d4f4-4884-83ee-893254529e1c tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Image pref 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 16:23:38 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-b9c9119a-d4f4-4884-83ee-893254529e1c tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 16:23:38 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-b9c9119a-d4f4-4884-83ee-893254529e1c tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 16:23:38 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-b9c9119a-d4f4-4884-83ee-893254529e1c tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71731) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 16:23:38 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-b9c9119a-d4f4-4884-83ee-893254529e1c tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Got 1 possible topologies {{(pid=71731) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 16:23:38 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-b9c9119a-d4f4-4884-83ee-893254529e1c tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 16:23:38 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-b9c9119a-d4f4-4884-83ee-893254529e1c tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 16:23:38 user nova-compute[71731]: DEBUG nova.virt.libvirt.vif [None req-b9c9119a-d4f4-4884-83ee-893254529e1c tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T16:23:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1338821197',display_name='tempest-VolumesAdminNegativeTest-server-1338821197',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1338821197',id=15,image_ref='708622a9-7465-4492-ade8-b827198f7e30',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5ded8a69b7e941f9bcdc502cfeed79db',ramdisk_id='',reservation_id='r-gqgs7b89',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='708622a9-7465-4492-ade8-b827198f7e30',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-694044578',owner_user_name='tempest-VolumesAdminNegativeTest-694044578-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T16:23:35Z,user_data=None,user_id='62cf399757f544649fed18ee5a31d50c',uuid=94a2b8c9-388d-454c-88a1-54d7a8506511,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8731e8dd-3e93-4fa1-b8e6-f1d2d10271f7", "address": "fa:16:3e:fb:19:75", "network": {"id": "fc7f5f86-d676-4a45-b0f4-c93f3eae043e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1421861184-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ded8a69b7e941f9bcdc502cfeed79db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8731e8dd-3e", "ovs_interfaceid": "8731e8dd-3e93-4fa1-b8e6-f1d2d10271f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71731) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 16:23:38 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-b9c9119a-d4f4-4884-83ee-893254529e1c tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Converting VIF {"id": "8731e8dd-3e93-4fa1-b8e6-f1d2d10271f7", "address": "fa:16:3e:fb:19:75", "network": {"id": "fc7f5f86-d676-4a45-b0f4-c93f3eae043e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1421861184-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ded8a69b7e941f9bcdc502cfeed79db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8731e8dd-3e", "ovs_interfaceid": "8731e8dd-3e93-4fa1-b8e6-f1d2d10271f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 16:23:38 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-b9c9119a-d4f4-4884-83ee-893254529e1c tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fb:19:75,bridge_name='br-int',has_traffic_filtering=True,id=8731e8dd-3e93-4fa1-b8e6-f1d2d10271f7,network=Network(fc7f5f86-d676-4a45-b0f4-c93f3eae043e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8731e8dd-3e') {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 16:23:38 user nova-compute[71731]: DEBUG nova.objects.instance [None req-b9c9119a-d4f4-4884-83ee-893254529e1c tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Lazy-loading 'pci_devices' on Instance uuid 94a2b8c9-388d-454c-88a1-54d7a8506511 {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:23:38 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-b9c9119a-d4f4-4884-83ee-893254529e1c tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] [instance: 94a2b8c9-388d-454c-88a1-54d7a8506511] End _get_guest_xml xml=<domain type="kvm">
Apr 13 16:23:38 user nova-compute[71731]:   <uuid>94a2b8c9-388d-454c-88a1-54d7a8506511</uuid>
Apr 13 16:23:38 user nova-compute[71731]:   <name>instance-0000000f</name>
Apr 13 16:23:38 user nova-compute[71731]:   <memory>131072</memory>
Apr 13 16:23:38 user nova-compute[71731]:   <vcpu>1</vcpu>
Apr 13 16:23:38 user nova-compute[71731]:   <metadata>
Apr 13 16:23:38 user nova-compute[71731]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 16:23:38 user nova-compute[71731]:       <nova:package version="0.0.0"/>
Apr 13 16:23:38 user nova-compute[71731]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1338821197</nova:name>
Apr 13 16:23:38 user nova-compute[71731]:       <nova:creationTime>2023-04-13 16:23:38</nova:creationTime>
Apr 13 16:23:38 user nova-compute[71731]:       <nova:flavor name="m1.nano">
Apr 13 16:23:38 user nova-compute[71731]:         <nova:memory>128</nova:memory>
Apr 13 16:23:38 user nova-compute[71731]:         <nova:disk>1</nova:disk>
Apr 13 16:23:38 user nova-compute[71731]:         <nova:swap>0</nova:swap>
Apr 13 16:23:38 user nova-compute[71731]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 16:23:38 user nova-compute[71731]:         <nova:vcpus>1</nova:vcpus>
Apr 13 16:23:38 user nova-compute[71731]:       </nova:flavor>
Apr 13 16:23:38 user nova-compute[71731]:       <nova:owner>
Apr 13 16:23:38 user nova-compute[71731]:         <nova:user uuid="62cf399757f544649fed18ee5a31d50c">tempest-VolumesAdminNegativeTest-694044578-project-member</nova:user>
Apr 13 16:23:38 user nova-compute[71731]:         <nova:project uuid="5ded8a69b7e941f9bcdc502cfeed79db">tempest-VolumesAdminNegativeTest-694044578</nova:project>
Apr 13 16:23:38 user nova-compute[71731]:       </nova:owner>
Apr 13 16:23:38 user nova-compute[71731]:       <nova:root type="image" uuid="708622a9-7465-4492-ade8-b827198f7e30"/>
Apr 13 16:23:38 user nova-compute[71731]:       <nova:ports>
Apr 13 16:23:38 user nova-compute[71731]:         <nova:port uuid="8731e8dd-3e93-4fa1-b8e6-f1d2d10271f7">
Apr 13 16:23:38 user nova-compute[71731]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Apr 13 16:23:38 user nova-compute[71731]:         </nova:port>
Apr 13 16:23:38 user nova-compute[71731]:       </nova:ports>
Apr 13 16:23:38 user nova-compute[71731]:     </nova:instance>
Apr 13 16:23:38 user nova-compute[71731]:   </metadata>
Apr 13 16:23:38 user nova-compute[71731]:   <sysinfo type="smbios">
Apr 13 16:23:38 user nova-compute[71731]:     <system>
Apr 13 16:23:38 user nova-compute[71731]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 16:23:38 user nova-compute[71731]:       <entry name="product">OpenStack Nova</entry>
Apr 13 16:23:38 user nova-compute[71731]:       <entry name="version">0.0.0</entry>
Apr 13 16:23:38 user nova-compute[71731]:       <entry name="serial">94a2b8c9-388d-454c-88a1-54d7a8506511</entry>
Apr 13 16:23:38 user nova-compute[71731]:       <entry name="uuid">94a2b8c9-388d-454c-88a1-54d7a8506511</entry>
Apr 13 16:23:38 user nova-compute[71731]:       <entry name="family">Virtual Machine</entry>
Apr 13 16:23:38 user nova-compute[71731]:     </system>
Apr 13 16:23:38 user nova-compute[71731]:   </sysinfo>
Apr 13 16:23:38 user nova-compute[71731]:   <os>
Apr 13 16:23:38 user nova-compute[71731]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 16:23:38 user nova-compute[71731]:     <boot dev="hd"/>
Apr 13 16:23:38 user nova-compute[71731]:     <smbios mode="sysinfo"/>
Apr 13 16:23:38 user nova-compute[71731]:   </os>
Apr 13 16:23:38 user nova-compute[71731]:   <features>
Apr 13 16:23:38 user nova-compute[71731]:     <acpi/>
Apr 13 16:23:38 user nova-compute[71731]:     <apic/>
Apr 13 16:23:38 user nova-compute[71731]:     <vmcoreinfo/>
Apr 13 16:23:38 user nova-compute[71731]:   </features>
Apr 13 16:23:38 user nova-compute[71731]:   <clock offset="utc">
Apr 13 16:23:38 user nova-compute[71731]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 16:23:38 user nova-compute[71731]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 16:23:38 user nova-compute[71731]:     <timer name="hpet" present="no"/>
Apr 13 16:23:38 user nova-compute[71731]:   </clock>
Apr 13 16:23:38 user nova-compute[71731]:   <cpu mode="custom" match="exact">
Apr 13 16:23:38 user nova-compute[71731]:     <model>Nehalem</model>
Apr 13 16:23:38 user nova-compute[71731]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 16:23:38 user nova-compute[71731]:   </cpu>
Apr 13 16:23:38 user nova-compute[71731]:   <devices>
Apr 13 16:23:38 user nova-compute[71731]:     <disk type="file" device="disk">
Apr 13 16:23:38 user nova-compute[71731]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 16:23:38 user nova-compute[71731]:       <source file="/opt/stack/data/nova/instances/94a2b8c9-388d-454c-88a1-54d7a8506511/disk"/>
Apr 13 16:23:38 user nova-compute[71731]:       <target dev="vda" bus="virtio"/>
Apr 13 16:23:38 user nova-compute[71731]:     </disk>
Apr 13 16:23:38 user nova-compute[71731]:     <interface type="ethernet">
Apr 13 16:23:38 user nova-compute[71731]:       <mac address="fa:16:3e:fb:19:75"/>
Apr 13 16:23:38 user nova-compute[71731]:       <model type="virtio"/>
Apr 13 16:23:38 user nova-compute[71731]:       <mtu size="1442"/>
Apr 13 16:23:38 user nova-compute[71731]:       <target dev="tap8731e8dd-3e"/>
Apr 13 16:23:38 user nova-compute[71731]:     </interface>
Apr 13 16:23:38 user nova-compute[71731]:     <serial type="pty">
Apr 13 16:23:38 user nova-compute[71731]:       <log file="/opt/stack/data/nova/instances/94a2b8c9-388d-454c-88a1-54d7a8506511/console.log" append="off"/>
Apr 13 16:23:38 user nova-compute[71731]:     </serial>
Apr 13 16:23:38 user nova-compute[71731]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 16:23:38 user nova-compute[71731]:     <video>
Apr 13 16:23:38 user nova-compute[71731]:       <model type="virtio"/>
Apr 13 16:23:38 user nova-compute[71731]:     </video>
Apr 13 16:23:38 user nova-compute[71731]:     <rng model="virtio">
Apr 13 16:23:38 user nova-compute[71731]:       <backend model="random">/dev/urandom</backend>
Apr 13 16:23:38 user nova-compute[71731]:     </rng>
Apr 13 16:23:38 user nova-compute[71731]:     <controller type="usb" index="0" model="none"/>
Apr 13 16:23:38 user nova-compute[71731]:     <memballoon model="virtio">
Apr 13 16:23:38 user nova-compute[71731]:       <stats period="10"/>
Apr 13 16:23:38 user nova-compute[71731]:     </memballoon>
Apr 13 16:23:38 user nova-compute[71731]:   </devices>
Apr 13 16:23:38 user nova-compute[71731]: </domain>
Apr 13 16:23:38 user nova-compute[71731]:  {{(pid=71731) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 16:23:38 user nova-compute[71731]: DEBUG nova.virt.libvirt.vif [None req-b9c9119a-d4f4-4884-83ee-893254529e1c tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T16:23:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1338821197',display_name='tempest-VolumesAdminNegativeTest-server-1338821197',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1338821197',id=15,image_ref='708622a9-7465-4492-ade8-b827198f7e30',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5ded8a69b7e941f9bcdc502cfeed79db',ramdisk_id='',reservation_id='r-gqgs7b89',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='708622a9-7465-4492-ade8-b827198f7e30',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-694044578',owner_user_name='tempest-VolumesAdminNegativeTest-694044578-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T16:23:35Z,user_data=None,user_id='62cf399757f544649fed18ee5a31d50c',uuid=94a2b8c9-388d-454c-88a1-54d7a8506511,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8731e8dd-3e93-4fa1-b8e6-f1d2d10271f7", "address": "fa:16:3e:fb:19:75", "network": {"id": "fc7f5f86-d676-4a45-b0f4-c93f3eae043e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1421861184-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ded8a69b7e941f9bcdc502cfeed79db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8731e8dd-3e", "ovs_interfaceid": "8731e8dd-3e93-4fa1-b8e6-f1d2d10271f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 16:23:38 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-b9c9119a-d4f4-4884-83ee-893254529e1c tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Converting VIF {"id": "8731e8dd-3e93-4fa1-b8e6-f1d2d10271f7", "address": "fa:16:3e:fb:19:75", "network": {"id": "fc7f5f86-d676-4a45-b0f4-c93f3eae043e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1421861184-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ded8a69b7e941f9bcdc502cfeed79db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8731e8dd-3e", "ovs_interfaceid": "8731e8dd-3e93-4fa1-b8e6-f1d2d10271f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 16:23:38 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-b9c9119a-d4f4-4884-83ee-893254529e1c tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fb:19:75,bridge_name='br-int',has_traffic_filtering=True,id=8731e8dd-3e93-4fa1-b8e6-f1d2d10271f7,network=Network(fc7f5f86-d676-4a45-b0f4-c93f3eae043e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8731e8dd-3e') {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 16:23:38 user nova-compute[71731]: DEBUG os_vif [None req-b9c9119a-d4f4-4884-83ee-893254529e1c tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:19:75,bridge_name='br-int',has_traffic_filtering=True,id=8731e8dd-3e93-4fa1-b8e6-f1d2d10271f7,network=Network(fc7f5f86-d676-4a45-b0f4-c93f3eae043e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8731e8dd-3e') {{(pid=71731) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 16:23:38 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:23:38 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:23:38 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 16:23:38 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:23:38 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8731e8dd-3e, may_exist=True) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:23:38 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8731e8dd-3e, col_values=(('external_ids', {'iface-id': '8731e8dd-3e93-4fa1-b8e6-f1d2d10271f7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fb:19:75', 'vm-uuid': '94a2b8c9-388d-454c-88a1-54d7a8506511'}),)) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:23:38 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:23:38 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 16:23:38 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:23:38 user nova-compute[71731]: INFO os_vif [None req-b9c9119a-d4f4-4884-83ee-893254529e1c tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:19:75,bridge_name='br-int',has_traffic_filtering=True,id=8731e8dd-3e93-4fa1-b8e6-f1d2d10271f7,network=Network(fc7f5f86-d676-4a45-b0f4-c93f3eae043e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8731e8dd-3e')
Apr 13 16:23:38 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-b9c9119a-d4f4-4884-83ee-893254529e1c tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] No BDM found with device name vda, not building metadata. {{(pid=71731) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 16:23:38 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-b9c9119a-d4f4-4884-83ee-893254529e1c tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] No VIF found with MAC fa:16:3e:fb:19:75, not building metadata {{(pid=71731) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 16:23:39 user nova-compute[71731]: DEBUG nova.network.neutron [req-cc9d6026-09d8-47ba-9c7f-d0f9ab1144f7 req-6ca0d72f-2659-42c1-bd8a-19b461f2183f service nova] [instance: 94a2b8c9-388d-454c-88a1-54d7a8506511] Updated VIF entry in instance network info cache for port 8731e8dd-3e93-4fa1-b8e6-f1d2d10271f7. {{(pid=71731) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 16:23:39 user nova-compute[71731]: DEBUG nova.network.neutron [req-cc9d6026-09d8-47ba-9c7f-d0f9ab1144f7 req-6ca0d72f-2659-42c1-bd8a-19b461f2183f service nova] [instance: 94a2b8c9-388d-454c-88a1-54d7a8506511] Updating instance_info_cache with network_info: [{"id": "8731e8dd-3e93-4fa1-b8e6-f1d2d10271f7", "address": "fa:16:3e:fb:19:75", "network": {"id": "fc7f5f86-d676-4a45-b0f4-c93f3eae043e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1421861184-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ded8a69b7e941f9bcdc502cfeed79db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8731e8dd-3e", "ovs_interfaceid": "8731e8dd-3e93-4fa1-b8e6-f1d2d10271f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:23:39 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-cc9d6026-09d8-47ba-9c7f-d0f9ab1144f7 req-6ca0d72f-2659-42c1-bd8a-19b461f2183f service nova] Releasing lock "refresh_cache-94a2b8c9-388d-454c-88a1-54d7a8506511" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 16:23:40 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:23:40 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:23:40 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:23:40 user nova-compute[71731]: DEBUG nova.compute.manager [req-63ec20c0-7393-4d94-bcf5-b279d4a6efef req-0e42ae80-92ca-4e2e-b04a-532ba148748a service nova] [instance: 94a2b8c9-388d-454c-88a1-54d7a8506511] Received event network-vif-plugged-8731e8dd-3e93-4fa1-b8e6-f1d2d10271f7 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:23:40 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-63ec20c0-7393-4d94-bcf5-b279d4a6efef req-0e42ae80-92ca-4e2e-b04a-532ba148748a service nova] Acquiring lock "94a2b8c9-388d-454c-88a1-54d7a8506511-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:23:40 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-63ec20c0-7393-4d94-bcf5-b279d4a6efef req-0e42ae80-92ca-4e2e-b04a-532ba148748a service nova] Lock "94a2b8c9-388d-454c-88a1-54d7a8506511-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:23:40 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-63ec20c0-7393-4d94-bcf5-b279d4a6efef req-0e42ae80-92ca-4e2e-b04a-532ba148748a service nova] Lock "94a2b8c9-388d-454c-88a1-54d7a8506511-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:23:40 user nova-compute[71731]: DEBUG nova.compute.manager [req-63ec20c0-7393-4d94-bcf5-b279d4a6efef req-0e42ae80-92ca-4e2e-b04a-532ba148748a service nova] [instance: 94a2b8c9-388d-454c-88a1-54d7a8506511] No waiting events found dispatching network-vif-plugged-8731e8dd-3e93-4fa1-b8e6-f1d2d10271f7 {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:23:40 user nova-compute[71731]: WARNING nova.compute.manager [req-63ec20c0-7393-4d94-bcf5-b279d4a6efef req-0e42ae80-92ca-4e2e-b04a-532ba148748a service nova] [instance: 94a2b8c9-388d-454c-88a1-54d7a8506511] Received unexpected event network-vif-plugged-8731e8dd-3e93-4fa1-b8e6-f1d2d10271f7 for instance with vm_state building and task_state spawning.
Apr 13 16:23:40 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:23:40 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:23:41 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:23:41 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-bfaa0693-007d-4127-9d17-282e2b179fff tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Acquiring lock "acbcaee0-a47b-4fee-8765-9b1c9597d515" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:23:41 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-bfaa0693-007d-4127-9d17-282e2b179fff tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "acbcaee0-a47b-4fee-8765-9b1c9597d515" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:23:41 user nova-compute[71731]: DEBUG nova.compute.manager [None req-bfaa0693-007d-4127-9d17-282e2b179fff tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] Starting instance... {{(pid=71731) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 16:23:42 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-bfaa0693-007d-4127-9d17-282e2b179fff tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:23:42 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-bfaa0693-007d-4127-9d17-282e2b179fff tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:23:42 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-bfaa0693-007d-4127-9d17-282e2b179fff tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71731) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 16:23:42 user nova-compute[71731]: INFO nova.compute.claims [None req-bfaa0693-007d-4127-9d17-282e2b179fff tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] Claim successful on node user
Apr 13 16:23:42 user nova-compute[71731]: DEBUG nova.virt.driver [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Emitting event <LifecycleEvent: 1681403022.2061522, 94a2b8c9-388d-454c-88a1-54d7a8506511 => Resumed> {{(pid=71731) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 16:23:42 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 94a2b8c9-388d-454c-88a1-54d7a8506511] VM Resumed (Lifecycle Event)
Apr 13 16:23:42 user nova-compute[71731]: DEBUG nova.compute.manager [None req-b9c9119a-d4f4-4884-83ee-893254529e1c tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] [instance: 94a2b8c9-388d-454c-88a1-54d7a8506511] Instance event wait completed in 0 seconds for  {{(pid=71731) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 16:23:42 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-b9c9119a-d4f4-4884-83ee-893254529e1c tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] [instance: 94a2b8c9-388d-454c-88a1-54d7a8506511] Guest created on hypervisor {{(pid=71731) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 16:23:42 user nova-compute[71731]: INFO nova.virt.libvirt.driver [-] [instance: 94a2b8c9-388d-454c-88a1-54d7a8506511] Instance spawned successfully.
Apr 13 16:23:42 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-b9c9119a-d4f4-4884-83ee-893254529e1c tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] [instance: 94a2b8c9-388d-454c-88a1-54d7a8506511] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 16:23:42 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 94a2b8c9-388d-454c-88a1-54d7a8506511] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:23:42 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 94a2b8c9-388d-454c-88a1-54d7a8506511] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71731) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 16:23:42 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-b9c9119a-d4f4-4884-83ee-893254529e1c tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] [instance: 94a2b8c9-388d-454c-88a1-54d7a8506511] Found default for hw_cdrom_bus of ide {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:23:42 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-b9c9119a-d4f4-4884-83ee-893254529e1c tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] [instance: 94a2b8c9-388d-454c-88a1-54d7a8506511] Found default for hw_disk_bus of virtio {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:23:42 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-b9c9119a-d4f4-4884-83ee-893254529e1c tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] [instance: 94a2b8c9-388d-454c-88a1-54d7a8506511] Found default for hw_input_bus of None {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:23:42 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-b9c9119a-d4f4-4884-83ee-893254529e1c tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] [instance: 94a2b8c9-388d-454c-88a1-54d7a8506511] Found default for hw_pointer_model of None {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:23:42 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-b9c9119a-d4f4-4884-83ee-893254529e1c tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] [instance: 94a2b8c9-388d-454c-88a1-54d7a8506511] Found default for hw_video_model of virtio {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:23:42 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-b9c9119a-d4f4-4884-83ee-893254529e1c tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] [instance: 94a2b8c9-388d-454c-88a1-54d7a8506511] Found default for hw_vif_model of virtio {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:23:42 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 94a2b8c9-388d-454c-88a1-54d7a8506511] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 16:23:42 user nova-compute[71731]: DEBUG nova.virt.driver [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Emitting event <LifecycleEvent: 1681403022.2075274, 94a2b8c9-388d-454c-88a1-54d7a8506511 => Started> {{(pid=71731) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 16:23:42 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 94a2b8c9-388d-454c-88a1-54d7a8506511] VM Started (Lifecycle Event)
Apr 13 16:23:42 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 94a2b8c9-388d-454c-88a1-54d7a8506511] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:23:42 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 94a2b8c9-388d-454c-88a1-54d7a8506511] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71731) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 16:23:42 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 94a2b8c9-388d-454c-88a1-54d7a8506511] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 16:23:42 user nova-compute[71731]: INFO nova.compute.manager [None req-b9c9119a-d4f4-4884-83ee-893254529e1c tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] [instance: 94a2b8c9-388d-454c-88a1-54d7a8506511] Took 7.43 seconds to spawn the instance on the hypervisor.
Apr 13 16:23:42 user nova-compute[71731]: DEBUG nova.compute.manager [None req-b9c9119a-d4f4-4884-83ee-893254529e1c tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] [instance: 94a2b8c9-388d-454c-88a1-54d7a8506511] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:23:42 user nova-compute[71731]: DEBUG nova.compute.manager [req-e3f57d28-2df9-4b5e-9f3f-67cd152337df req-1b8f1f86-9e60-412c-bf6d-ea2a6706733f service nova] [instance: 94a2b8c9-388d-454c-88a1-54d7a8506511] Received event network-vif-plugged-8731e8dd-3e93-4fa1-b8e6-f1d2d10271f7 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:23:42 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-e3f57d28-2df9-4b5e-9f3f-67cd152337df req-1b8f1f86-9e60-412c-bf6d-ea2a6706733f service nova] Acquiring lock "94a2b8c9-388d-454c-88a1-54d7a8506511-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:23:42 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-e3f57d28-2df9-4b5e-9f3f-67cd152337df req-1b8f1f86-9e60-412c-bf6d-ea2a6706733f service nova] Lock "94a2b8c9-388d-454c-88a1-54d7a8506511-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:23:42 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-e3f57d28-2df9-4b5e-9f3f-67cd152337df req-1b8f1f86-9e60-412c-bf6d-ea2a6706733f service nova] Lock "94a2b8c9-388d-454c-88a1-54d7a8506511-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:23:42 user nova-compute[71731]: DEBUG nova.compute.manager [req-e3f57d28-2df9-4b5e-9f3f-67cd152337df req-1b8f1f86-9e60-412c-bf6d-ea2a6706733f service nova] [instance: 94a2b8c9-388d-454c-88a1-54d7a8506511] No waiting events found dispatching network-vif-plugged-8731e8dd-3e93-4fa1-b8e6-f1d2d10271f7 {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:23:42 user nova-compute[71731]: WARNING nova.compute.manager [req-e3f57d28-2df9-4b5e-9f3f-67cd152337df req-1b8f1f86-9e60-412c-bf6d-ea2a6706733f service nova] [instance: 94a2b8c9-388d-454c-88a1-54d7a8506511] Received unexpected event network-vif-plugged-8731e8dd-3e93-4fa1-b8e6-f1d2d10271f7 for instance with vm_state building and task_state spawning.
Apr 13 16:23:42 user nova-compute[71731]: INFO nova.compute.manager [None req-b9c9119a-d4f4-4884-83ee-893254529e1c tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] [instance: 94a2b8c9-388d-454c-88a1-54d7a8506511] Took 8.42 seconds to build instance.
Apr 13 16:23:42 user nova-compute[71731]: DEBUG nova.compute.provider_tree [None req-bfaa0693-007d-4127-9d17-282e2b179fff tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Inventory has not changed in ProviderTree for provider: cb6b1a64-0c24-4e2d-af1e-16576ca9165c {{(pid=71731) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 16:23:42 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-b9c9119a-d4f4-4884-83ee-893254529e1c tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Lock "94a2b8c9-388d-454c-88a1-54d7a8506511" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.529s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:23:42 user nova-compute[71731]: DEBUG nova.scheduler.client.report [None req-bfaa0693-007d-4127-9d17-282e2b179fff tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Inventory has not changed for provider cb6b1a64-0c24-4e2d-af1e-16576ca9165c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71731) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 16:23:42 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-bfaa0693-007d-4127-9d17-282e2b179fff tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.473s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:23:42 user nova-compute[71731]: DEBUG nova.compute.manager [None req-bfaa0693-007d-4127-9d17-282e2b179fff tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] Start building networks asynchronously for instance. {{(pid=71731) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 16:23:42 user nova-compute[71731]: DEBUG nova.compute.manager [None req-bfaa0693-007d-4127-9d17-282e2b179fff tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] Allocating IP information in the background. {{(pid=71731) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 16:23:42 user nova-compute[71731]: DEBUG nova.network.neutron [None req-bfaa0693-007d-4127-9d17-282e2b179fff tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] allocate_for_instance() {{(pid=71731) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 16:23:42 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-bfaa0693-007d-4127-9d17-282e2b179fff tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 16:23:42 user nova-compute[71731]: DEBUG nova.compute.manager [None req-bfaa0693-007d-4127-9d17-282e2b179fff tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] Start building block device mappings for instance. {{(pid=71731) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 16:23:42 user nova-compute[71731]: DEBUG nova.policy [None req-bfaa0693-007d-4127-9d17-282e2b179fff tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1b3df1c5c5d441819bcef89ed6966815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980559734a504574a83224deb7423c77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71731) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 16:23:42 user nova-compute[71731]: DEBUG nova.compute.manager [None req-bfaa0693-007d-4127-9d17-282e2b179fff tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] Start spawning the instance on the hypervisor. {{(pid=71731) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 16:23:42 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-bfaa0693-007d-4127-9d17-282e2b179fff tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] Creating instance directory {{(pid=71731) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 16:23:42 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-bfaa0693-007d-4127-9d17-282e2b179fff tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] Creating image(s)
Apr 13 16:23:42 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-bfaa0693-007d-4127-9d17-282e2b179fff tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Acquiring lock "/opt/stack/data/nova/instances/acbcaee0-a47b-4fee-8765-9b1c9597d515/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:23:42 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-bfaa0693-007d-4127-9d17-282e2b179fff tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "/opt/stack/data/nova/instances/acbcaee0-a47b-4fee-8765-9b1c9597d515/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:23:42 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-bfaa0693-007d-4127-9d17-282e2b179fff tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "/opt/stack/data/nova/instances/acbcaee0-a47b-4fee-8765-9b1c9597d515/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:23:42 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-bfaa0693-007d-4127-9d17-282e2b179fff tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279 --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:23:42 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-bfaa0693-007d-4127-9d17-282e2b179fff tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279 --force-share --output=json" returned: 0 in 0.137s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:23:42 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-bfaa0693-007d-4127-9d17-282e2b179fff tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Acquiring lock "9524227dd898575c3099d3976f096cd935414279" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:23:42 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-bfaa0693-007d-4127-9d17-282e2b179fff tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "9524227dd898575c3099d3976f096cd935414279" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:23:42 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-bfaa0693-007d-4127-9d17-282e2b179fff tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279 --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:23:43 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-bfaa0693-007d-4127-9d17-282e2b179fff tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279 --force-share --output=json" returned: 0 in 0.158s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:23:43 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-bfaa0693-007d-4127-9d17-282e2b179fff tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279,backing_fmt=raw /opt/stack/data/nova/instances/acbcaee0-a47b-4fee-8765-9b1c9597d515/disk 1073741824 {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:23:43 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-bfaa0693-007d-4127-9d17-282e2b179fff tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279,backing_fmt=raw /opt/stack/data/nova/instances/acbcaee0-a47b-4fee-8765-9b1c9597d515/disk 1073741824" returned: 0 in 0.153s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:23:43 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-bfaa0693-007d-4127-9d17-282e2b179fff tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "9524227dd898575c3099d3976f096cd935414279" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.318s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:23:43 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-bfaa0693-007d-4127-9d17-282e2b179fff tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279 --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:23:43 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-bfaa0693-007d-4127-9d17-282e2b179fff tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279 --force-share --output=json" returned: 0 in 0.149s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:23:43 user nova-compute[71731]: DEBUG nova.virt.disk.api [None req-bfaa0693-007d-4127-9d17-282e2b179fff tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Checking if we can resize image /opt/stack/data/nova/instances/acbcaee0-a47b-4fee-8765-9b1c9597d515/disk. size=1073741824 {{(pid=71731) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 16:23:43 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-bfaa0693-007d-4127-9d17-282e2b179fff tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acbcaee0-a47b-4fee-8765-9b1c9597d515/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:23:43 user nova-compute[71731]: DEBUG nova.network.neutron [None req-bfaa0693-007d-4127-9d17-282e2b179fff tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] Successfully created port: 13471516-9514-4b85-938f-69657c2990e5 {{(pid=71731) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 16:23:43 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-bfaa0693-007d-4127-9d17-282e2b179fff tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acbcaee0-a47b-4fee-8765-9b1c9597d515/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:23:43 user nova-compute[71731]: DEBUG nova.virt.disk.api [None req-bfaa0693-007d-4127-9d17-282e2b179fff tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Cannot resize image /opt/stack/data/nova/instances/acbcaee0-a47b-4fee-8765-9b1c9597d515/disk to a smaller size. {{(pid=71731) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 16:23:43 user nova-compute[71731]: DEBUG nova.objects.instance [None req-bfaa0693-007d-4127-9d17-282e2b179fff tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lazy-loading 'migration_context' on Instance uuid acbcaee0-a47b-4fee-8765-9b1c9597d515 {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:23:43 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-bfaa0693-007d-4127-9d17-282e2b179fff tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] Created local disks {{(pid=71731) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 16:23:43 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-bfaa0693-007d-4127-9d17-282e2b179fff tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] Ensure instance console log exists: /opt/stack/data/nova/instances/acbcaee0-a47b-4fee-8765-9b1c9597d515/console.log {{(pid=71731) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 16:23:43 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-bfaa0693-007d-4127-9d17-282e2b179fff tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:23:43 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-bfaa0693-007d-4127-9d17-282e2b179fff tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:23:43 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-bfaa0693-007d-4127-9d17-282e2b179fff tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:23:43 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:23:44 user nova-compute[71731]: DEBUG nova.network.neutron [None req-bfaa0693-007d-4127-9d17-282e2b179fff tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] Successfully updated port: 13471516-9514-4b85-938f-69657c2990e5 {{(pid=71731) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 16:23:44 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-bfaa0693-007d-4127-9d17-282e2b179fff tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Acquiring lock "refresh_cache-acbcaee0-a47b-4fee-8765-9b1c9597d515" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 16:23:44 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-bfaa0693-007d-4127-9d17-282e2b179fff tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Acquired lock "refresh_cache-acbcaee0-a47b-4fee-8765-9b1c9597d515" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 16:23:44 user nova-compute[71731]: DEBUG nova.network.neutron [None req-bfaa0693-007d-4127-9d17-282e2b179fff tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] Building network info cache for instance {{(pid=71731) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 16:23:44 user nova-compute[71731]: DEBUG nova.network.neutron [None req-bfaa0693-007d-4127-9d17-282e2b179fff tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] Instance cache missing network info. {{(pid=71731) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 16:23:44 user nova-compute[71731]: DEBUG nova.compute.manager [req-109eff67-fe88-4e2d-8915-37b6aed2aaa6 req-cd3f6141-fec1-472b-83ed-6a6ee32365c8 service nova] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] Received event network-changed-13471516-9514-4b85-938f-69657c2990e5 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:23:44 user nova-compute[71731]: DEBUG nova.compute.manager [req-109eff67-fe88-4e2d-8915-37b6aed2aaa6 req-cd3f6141-fec1-472b-83ed-6a6ee32365c8 service nova] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] Refreshing instance network info cache due to event network-changed-13471516-9514-4b85-938f-69657c2990e5. {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 16:23:44 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-109eff67-fe88-4e2d-8915-37b6aed2aaa6 req-cd3f6141-fec1-472b-83ed-6a6ee32365c8 service nova] Acquiring lock "refresh_cache-acbcaee0-a47b-4fee-8765-9b1c9597d515" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 16:23:44 user nova-compute[71731]: DEBUG nova.network.neutron [None req-bfaa0693-007d-4127-9d17-282e2b179fff tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] Updating instance_info_cache with network_info: [{"id": "13471516-9514-4b85-938f-69657c2990e5", "address": "fa:16:3e:62:32:7f", "network": {"id": "cf1fef97-9ef1-449f-a302-b38110024547", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1138167711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "980559734a504574a83224deb7423c77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13471516-95", "ovs_interfaceid": "13471516-9514-4b85-938f-69657c2990e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:23:44 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-bfaa0693-007d-4127-9d17-282e2b179fff tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Releasing lock "refresh_cache-acbcaee0-a47b-4fee-8765-9b1c9597d515" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 16:23:44 user nova-compute[71731]: DEBUG nova.compute.manager [None req-bfaa0693-007d-4127-9d17-282e2b179fff tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] Instance network_info: |[{"id": "13471516-9514-4b85-938f-69657c2990e5", "address": "fa:16:3e:62:32:7f", "network": {"id": "cf1fef97-9ef1-449f-a302-b38110024547", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1138167711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "980559734a504574a83224deb7423c77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13471516-95", "ovs_interfaceid": "13471516-9514-4b85-938f-69657c2990e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71731) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 16:23:44 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-109eff67-fe88-4e2d-8915-37b6aed2aaa6 req-cd3f6141-fec1-472b-83ed-6a6ee32365c8 service nova] Acquired lock "refresh_cache-acbcaee0-a47b-4fee-8765-9b1c9597d515" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 16:23:44 user nova-compute[71731]: DEBUG nova.network.neutron [req-109eff67-fe88-4e2d-8915-37b6aed2aaa6 req-cd3f6141-fec1-472b-83ed-6a6ee32365c8 service nova] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] Refreshing network info cache for port 13471516-9514-4b85-938f-69657c2990e5 {{(pid=71731) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 16:23:44 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-bfaa0693-007d-4127-9d17-282e2b179fff tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] Start _get_guest_xml network_info=[{"id": "13471516-9514-4b85-938f-69657c2990e5", "address": "fa:16:3e:62:32:7f", "network": {"id": "cf1fef97-9ef1-449f-a302-b38110024547", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1138167711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "980559734a504574a83224deb7423c77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13471516-95", "ovs_interfaceid": "13471516-9514-4b85-938f-69657c2990e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T16:16:31Z,direct_url=<?>,disk_format='qcow2',id=708622a9-7465-4492-ade8-b827198f7e30,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='0b29a975c552465aba0ac7d6288434bd',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T16:16:33Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'device_type': 'disk', 'encrypted': False, 'disk_bus': 'virtio', 'guest_format': None, 'encryption_options': None, 'image_id': '708622a9-7465-4492-ade8-b827198f7e30'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71731) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 16:23:44 user nova-compute[71731]: WARNING nova.virt.libvirt.driver [None req-bfaa0693-007d-4127-9d17-282e2b179fff tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 16:23:44 user nova-compute[71731]: WARNING nova.virt.libvirt.driver [None req-bfaa0693-007d-4127-9d17-282e2b179fff tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 16:23:44 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-bfaa0693-007d-4127-9d17-282e2b179fff tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71731) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 16:23:44 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-bfaa0693-007d-4127-9d17-282e2b179fff tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T16:17:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T16:16:31Z,direct_url=<?>,disk_format='qcow2',id=708622a9-7465-4492-ade8-b827198f7e30,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='0b29a975c552465aba0ac7d6288434bd',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T16:16:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 16:23:44 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-bfaa0693-007d-4127-9d17-282e2b179fff tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Flavor limits 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 16:23:44 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-bfaa0693-007d-4127-9d17-282e2b179fff tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Image limits 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 16:23:44 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-bfaa0693-007d-4127-9d17-282e2b179fff tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Flavor pref 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 16:23:44 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-bfaa0693-007d-4127-9d17-282e2b179fff tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Image pref 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 16:23:44 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-bfaa0693-007d-4127-9d17-282e2b179fff tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 16:23:44 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-bfaa0693-007d-4127-9d17-282e2b179fff tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 16:23:44 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-bfaa0693-007d-4127-9d17-282e2b179fff tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71731) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 16:23:44 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-bfaa0693-007d-4127-9d17-282e2b179fff tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Got 1 possible topologies {{(pid=71731) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 16:23:44 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-bfaa0693-007d-4127-9d17-282e2b179fff tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 16:23:44 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-bfaa0693-007d-4127-9d17-282e2b179fff tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 16:23:44 user nova-compute[71731]: DEBUG nova.virt.libvirt.vif [None req-bfaa0693-007d-4127-9d17-282e2b179fff tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T16:23:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1986504733',display_name='tempest-ServerActionsTestJSON-server-1986504733',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1986504733',id=16,image_ref='708622a9-7465-4492-ade8-b827198f7e30',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPaDda4gTmMbkxKfok8i4i1XcNLza5lOVYjCPDEGVTF1JRQKderq80DnIN4GAkaZiBV5U44gvdu3wadL/M5wOH7VDSuEghHchow1mC9TB1xgdo8GoXeM279SVAyu08uhIQ==',key_name='tempest-keypair-1700037342',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='980559734a504574a83224deb7423c77',ramdisk_id='',reservation_id='r-3vv5sptg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='708622a9-7465-4492-ade8-b827198f7e30',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestJSON-713402718',owner_user_name='tempest-ServerActionsTestJSON-713402718-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T16:23:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1b3df1c5c5d441819bcef89ed6966815',uuid=acbcaee0-a47b-4fee-8765-9b1c9597d515,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "13471516-9514-4b85-938f-69657c2990e5", "address": "fa:16:3e:62:32:7f", "network": {"id": "cf1fef97-9ef1-449f-a302-b38110024547", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1138167711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "980559734a504574a83224deb7423c77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13471516-95", "ovs_interfaceid": "13471516-9514-4b85-938f-69657c2990e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71731) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 16:23:44 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-bfaa0693-007d-4127-9d17-282e2b179fff tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Converting VIF {"id": "13471516-9514-4b85-938f-69657c2990e5", "address": "fa:16:3e:62:32:7f", "network": {"id": "cf1fef97-9ef1-449f-a302-b38110024547", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1138167711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "980559734a504574a83224deb7423c77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13471516-95", "ovs_interfaceid": "13471516-9514-4b85-938f-69657c2990e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 16:23:44 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-bfaa0693-007d-4127-9d17-282e2b179fff tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:62:32:7f,bridge_name='br-int',has_traffic_filtering=True,id=13471516-9514-4b85-938f-69657c2990e5,network=Network(cf1fef97-9ef1-449f-a302-b38110024547),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13471516-95') {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 16:23:44 user nova-compute[71731]: DEBUG nova.objects.instance [None req-bfaa0693-007d-4127-9d17-282e2b179fff tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lazy-loading 'pci_devices' on Instance uuid acbcaee0-a47b-4fee-8765-9b1c9597d515 {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:23:44 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-bfaa0693-007d-4127-9d17-282e2b179fff tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] End _get_guest_xml xml=<domain type="kvm">
Apr 13 16:23:44 user nova-compute[71731]:   <uuid>acbcaee0-a47b-4fee-8765-9b1c9597d515</uuid>
Apr 13 16:23:44 user nova-compute[71731]:   <name>instance-00000010</name>
Apr 13 16:23:44 user nova-compute[71731]:   <memory>131072</memory>
Apr 13 16:23:44 user nova-compute[71731]:   <vcpu>1</vcpu>
Apr 13 16:23:44 user nova-compute[71731]:   <metadata>
Apr 13 16:23:44 user nova-compute[71731]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 16:23:44 user nova-compute[71731]:       <nova:package version="0.0.0"/>
Apr 13 16:23:44 user nova-compute[71731]:       <nova:name>tempest-ServerActionsTestJSON-server-1986504733</nova:name>
Apr 13 16:23:44 user nova-compute[71731]:       <nova:creationTime>2023-04-13 16:23:44</nova:creationTime>
Apr 13 16:23:44 user nova-compute[71731]:       <nova:flavor name="m1.nano">
Apr 13 16:23:44 user nova-compute[71731]:         <nova:memory>128</nova:memory>
Apr 13 16:23:44 user nova-compute[71731]:         <nova:disk>1</nova:disk>
Apr 13 16:23:44 user nova-compute[71731]:         <nova:swap>0</nova:swap>
Apr 13 16:23:44 user nova-compute[71731]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 16:23:44 user nova-compute[71731]:         <nova:vcpus>1</nova:vcpus>
Apr 13 16:23:44 user nova-compute[71731]:       </nova:flavor>
Apr 13 16:23:44 user nova-compute[71731]:       <nova:owner>
Apr 13 16:23:44 user nova-compute[71731]:         <nova:user uuid="1b3df1c5c5d441819bcef89ed6966815">tempest-ServerActionsTestJSON-713402718-project-member</nova:user>
Apr 13 16:23:44 user nova-compute[71731]:         <nova:project uuid="980559734a504574a83224deb7423c77">tempest-ServerActionsTestJSON-713402718</nova:project>
Apr 13 16:23:44 user nova-compute[71731]:       </nova:owner>
Apr 13 16:23:44 user nova-compute[71731]:       <nova:root type="image" uuid="708622a9-7465-4492-ade8-b827198f7e30"/>
Apr 13 16:23:44 user nova-compute[71731]:       <nova:ports>
Apr 13 16:23:44 user nova-compute[71731]:         <nova:port uuid="13471516-9514-4b85-938f-69657c2990e5">
Apr 13 16:23:44 user nova-compute[71731]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Apr 13 16:23:44 user nova-compute[71731]:         </nova:port>
Apr 13 16:23:44 user nova-compute[71731]:       </nova:ports>
Apr 13 16:23:44 user nova-compute[71731]:     </nova:instance>
Apr 13 16:23:44 user nova-compute[71731]:   </metadata>
Apr 13 16:23:44 user nova-compute[71731]:   <sysinfo type="smbios">
Apr 13 16:23:44 user nova-compute[71731]:     <system>
Apr 13 16:23:44 user nova-compute[71731]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 16:23:44 user nova-compute[71731]:       <entry name="product">OpenStack Nova</entry>
Apr 13 16:23:44 user nova-compute[71731]:       <entry name="version">0.0.0</entry>
Apr 13 16:23:44 user nova-compute[71731]:       <entry name="serial">acbcaee0-a47b-4fee-8765-9b1c9597d515</entry>
Apr 13 16:23:44 user nova-compute[71731]:       <entry name="uuid">acbcaee0-a47b-4fee-8765-9b1c9597d515</entry>
Apr 13 16:23:44 user nova-compute[71731]:       <entry name="family">Virtual Machine</entry>
Apr 13 16:23:44 user nova-compute[71731]:     </system>
Apr 13 16:23:44 user nova-compute[71731]:   </sysinfo>
Apr 13 16:23:44 user nova-compute[71731]:   <os>
Apr 13 16:23:44 user nova-compute[71731]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 16:23:44 user nova-compute[71731]:     <boot dev="hd"/>
Apr 13 16:23:44 user nova-compute[71731]:     <smbios mode="sysinfo"/>
Apr 13 16:23:44 user nova-compute[71731]:   </os>
Apr 13 16:23:44 user nova-compute[71731]:   <features>
Apr 13 16:23:44 user nova-compute[71731]:     <acpi/>
Apr 13 16:23:44 user nova-compute[71731]:     <apic/>
Apr 13 16:23:44 user nova-compute[71731]:     <vmcoreinfo/>
Apr 13 16:23:44 user nova-compute[71731]:   </features>
Apr 13 16:23:44 user nova-compute[71731]:   <clock offset="utc">
Apr 13 16:23:44 user nova-compute[71731]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 16:23:44 user nova-compute[71731]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 16:23:44 user nova-compute[71731]:     <timer name="hpet" present="no"/>
Apr 13 16:23:44 user nova-compute[71731]:   </clock>
Apr 13 16:23:44 user nova-compute[71731]:   <cpu mode="custom" match="exact">
Apr 13 16:23:44 user nova-compute[71731]:     <model>Nehalem</model>
Apr 13 16:23:44 user nova-compute[71731]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 16:23:44 user nova-compute[71731]:   </cpu>
Apr 13 16:23:44 user nova-compute[71731]:   <devices>
Apr 13 16:23:44 user nova-compute[71731]:     <disk type="file" device="disk">
Apr 13 16:23:44 user nova-compute[71731]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 16:23:44 user nova-compute[71731]:       <source file="/opt/stack/data/nova/instances/acbcaee0-a47b-4fee-8765-9b1c9597d515/disk"/>
Apr 13 16:23:44 user nova-compute[71731]:       <target dev="vda" bus="virtio"/>
Apr 13 16:23:44 user nova-compute[71731]:     </disk>
Apr 13 16:23:44 user nova-compute[71731]:     <interface type="ethernet">
Apr 13 16:23:44 user nova-compute[71731]:       <mac address="fa:16:3e:62:32:7f"/>
Apr 13 16:23:44 user nova-compute[71731]:       <model type="virtio"/>
Apr 13 16:23:44 user nova-compute[71731]:       <mtu size="1442"/>
Apr 13 16:23:44 user nova-compute[71731]:       <target dev="tap13471516-95"/>
Apr 13 16:23:44 user nova-compute[71731]:     </interface>
Apr 13 16:23:44 user nova-compute[71731]:     <serial type="pty">
Apr 13 16:23:44 user nova-compute[71731]:       <log file="/opt/stack/data/nova/instances/acbcaee0-a47b-4fee-8765-9b1c9597d515/console.log" append="off"/>
Apr 13 16:23:44 user nova-compute[71731]:     </serial>
Apr 13 16:23:44 user nova-compute[71731]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 16:23:44 user nova-compute[71731]:     <video>
Apr 13 16:23:44 user nova-compute[71731]:       <model type="virtio"/>
Apr 13 16:23:44 user nova-compute[71731]:     </video>
Apr 13 16:23:44 user nova-compute[71731]:     <rng model="virtio">
Apr 13 16:23:44 user nova-compute[71731]:       <backend model="random">/dev/urandom</backend>
Apr 13 16:23:44 user nova-compute[71731]:     </rng>
Apr 13 16:23:44 user nova-compute[71731]:     <controller type="usb" index="0" model="none"/>
Apr 13 16:23:44 user nova-compute[71731]:     <memballoon model="virtio">
Apr 13 16:23:44 user nova-compute[71731]:       <stats period="10"/>
Apr 13 16:23:44 user nova-compute[71731]:     </memballoon>
Apr 13 16:23:44 user nova-compute[71731]:   </devices>
Apr 13 16:23:44 user nova-compute[71731]: </domain>
Apr 13 16:23:44 user nova-compute[71731]:  {{(pid=71731) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 16:23:44 user nova-compute[71731]: DEBUG nova.virt.libvirt.vif [None req-bfaa0693-007d-4127-9d17-282e2b179fff tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T16:23:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1986504733',display_name='tempest-ServerActionsTestJSON-server-1986504733',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1986504733',id=16,image_ref='708622a9-7465-4492-ade8-b827198f7e30',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPaDda4gTmMbkxKfok8i4i1XcNLza5lOVYjCPDEGVTF1JRQKderq80DnIN4GAkaZiBV5U44gvdu3wadL/M5wOH7VDSuEghHchow1mC9TB1xgdo8GoXeM279SVAyu08uhIQ==',key_name='tempest-keypair-1700037342',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='980559734a504574a83224deb7423c77',ramdisk_id='',reservation_id='r-3vv5sptg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='708622a9-7465-4492-ade8-b827198f7e30',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestJSON-713402718',owner_user_name='tempest-ServerActionsTestJSON-713402718-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T16:23:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1b3df1c5c5d441819bcef89ed6966815',uuid=acbcaee0-a47b-4fee-8765-9b1c9597d515,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "13471516-9514-4b85-938f-69657c2990e5", "address": "fa:16:3e:62:32:7f", "network": {"id": "cf1fef97-9ef1-449f-a302-b38110024547", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1138167711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "980559734a504574a83224deb7423c77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13471516-95", "ovs_interfaceid": "13471516-9514-4b85-938f-69657c2990e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 16:23:44 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-bfaa0693-007d-4127-9d17-282e2b179fff tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Converting VIF {"id": "13471516-9514-4b85-938f-69657c2990e5", "address": "fa:16:3e:62:32:7f", "network": {"id": "cf1fef97-9ef1-449f-a302-b38110024547", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1138167711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "980559734a504574a83224deb7423c77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13471516-95", "ovs_interfaceid": "13471516-9514-4b85-938f-69657c2990e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 16:23:44 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-bfaa0693-007d-4127-9d17-282e2b179fff tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:62:32:7f,bridge_name='br-int',has_traffic_filtering=True,id=13471516-9514-4b85-938f-69657c2990e5,network=Network(cf1fef97-9ef1-449f-a302-b38110024547),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13471516-95') {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 16:23:44 user nova-compute[71731]: DEBUG os_vif [None req-bfaa0693-007d-4127-9d17-282e2b179fff tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:32:7f,bridge_name='br-int',has_traffic_filtering=True,id=13471516-9514-4b85-938f-69657c2990e5,network=Network(cf1fef97-9ef1-449f-a302-b38110024547),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13471516-95') {{(pid=71731) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 16:23:44 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:23:44 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:23:44 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 16:23:44 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:23:44 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap13471516-95, may_exist=True) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:23:44 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap13471516-95, col_values=(('external_ids', {'iface-id': '13471516-9514-4b85-938f-69657c2990e5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:62:32:7f', 'vm-uuid': 'acbcaee0-a47b-4fee-8765-9b1c9597d515'}),)) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:23:44 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:23:44 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 16:23:44 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:23:44 user nova-compute[71731]: INFO os_vif [None req-bfaa0693-007d-4127-9d17-282e2b179fff tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:32:7f,bridge_name='br-int',has_traffic_filtering=True,id=13471516-9514-4b85-938f-69657c2990e5,network=Network(cf1fef97-9ef1-449f-a302-b38110024547),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13471516-95')
Apr 13 16:23:44 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-bfaa0693-007d-4127-9d17-282e2b179fff tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] No BDM found with device name vda, not building metadata. {{(pid=71731) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 16:23:44 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-bfaa0693-007d-4127-9d17-282e2b179fff tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] No VIF found with MAC fa:16:3e:62:32:7f, not building metadata {{(pid=71731) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 16:23:45 user nova-compute[71731]: DEBUG nova.network.neutron [req-109eff67-fe88-4e2d-8915-37b6aed2aaa6 req-cd3f6141-fec1-472b-83ed-6a6ee32365c8 service nova] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] Updated VIF entry in instance network info cache for port 13471516-9514-4b85-938f-69657c2990e5. {{(pid=71731) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 16:23:45 user nova-compute[71731]: DEBUG nova.network.neutron [req-109eff67-fe88-4e2d-8915-37b6aed2aaa6 req-cd3f6141-fec1-472b-83ed-6a6ee32365c8 service nova] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] Updating instance_info_cache with network_info: [{"id": "13471516-9514-4b85-938f-69657c2990e5", "address": "fa:16:3e:62:32:7f", "network": {"id": "cf1fef97-9ef1-449f-a302-b38110024547", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1138167711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "980559734a504574a83224deb7423c77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13471516-95", "ovs_interfaceid": "13471516-9514-4b85-938f-69657c2990e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:23:45 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-109eff67-fe88-4e2d-8915-37b6aed2aaa6 req-cd3f6141-fec1-472b-83ed-6a6ee32365c8 service nova] Releasing lock "refresh_cache-acbcaee0-a47b-4fee-8765-9b1c9597d515" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 16:23:46 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:23:46 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:23:46 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:23:46 user nova-compute[71731]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681403011.2810013, bf350da4-9cc2-4900-adf0-506e44984b42 => Stopped> {{(pid=71731) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 16:23:46 user nova-compute[71731]: INFO nova.compute.manager [-] [instance: bf350da4-9cc2-4900-adf0-506e44984b42] VM Stopped (Lifecycle Event)
Apr 13 16:23:46 user nova-compute[71731]: DEBUG nova.compute.manager [None req-5e359694-463d-4c76-b110-85bc2b5fddfb None None] [instance: bf350da4-9cc2-4900-adf0-506e44984b42] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:23:46 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:23:46 user nova-compute[71731]: DEBUG nova.compute.manager [req-e190830c-dbf2-4d2d-8e44-8d9cb32ac6de req-ab131f61-dee7-4b37-a475-68337103b350 service nova] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] Received event network-vif-plugged-13471516-9514-4b85-938f-69657c2990e5 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:23:46 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-e190830c-dbf2-4d2d-8e44-8d9cb32ac6de req-ab131f61-dee7-4b37-a475-68337103b350 service nova] Acquiring lock "acbcaee0-a47b-4fee-8765-9b1c9597d515-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:23:46 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-e190830c-dbf2-4d2d-8e44-8d9cb32ac6de req-ab131f61-dee7-4b37-a475-68337103b350 service nova] Lock "acbcaee0-a47b-4fee-8765-9b1c9597d515-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:23:46 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-e190830c-dbf2-4d2d-8e44-8d9cb32ac6de req-ab131f61-dee7-4b37-a475-68337103b350 service nova] Lock "acbcaee0-a47b-4fee-8765-9b1c9597d515-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:23:46 user nova-compute[71731]: DEBUG nova.compute.manager [req-e190830c-dbf2-4d2d-8e44-8d9cb32ac6de req-ab131f61-dee7-4b37-a475-68337103b350 service nova] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] No waiting events found dispatching network-vif-plugged-13471516-9514-4b85-938f-69657c2990e5 {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:23:46 user nova-compute[71731]: WARNING nova.compute.manager [req-e190830c-dbf2-4d2d-8e44-8d9cb32ac6de req-ab131f61-dee7-4b37-a475-68337103b350 service nova] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] Received unexpected event network-vif-plugged-13471516-9514-4b85-938f-69657c2990e5 for instance with vm_state building and task_state spawning.
Apr 13 16:23:46 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:23:46 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:23:46 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:23:46 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:23:47 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-a05bd84b-ad12-4778-8b8a-a4430f7c9fca tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Acquiring lock "031c7939-a53c-4f7d-9f36-4ec1d06e2717" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:23:47 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-a05bd84b-ad12-4778-8b8a-a4430f7c9fca tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Lock "031c7939-a53c-4f7d-9f36-4ec1d06e2717" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:23:47 user nova-compute[71731]: INFO nova.compute.manager [None req-a05bd84b-ad12-4778-8b8a-a4430f7c9fca tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] [instance: 031c7939-a53c-4f7d-9f36-4ec1d06e2717] Detaching volume e962a4d5-41c9-4b3b-b78e-c25e451aa73f
Apr 13 16:23:47 user nova-compute[71731]: INFO nova.virt.block_device [None req-a05bd84b-ad12-4778-8b8a-a4430f7c9fca tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] [instance: 031c7939-a53c-4f7d-9f36-4ec1d06e2717] Attempting to driver detach volume e962a4d5-41c9-4b3b-b78e-c25e451aa73f from mountpoint /dev/vdb
Apr 13 16:23:47 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-a05bd84b-ad12-4778-8b8a-a4430f7c9fca tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Attempting to detach device vdb from instance 031c7939-a53c-4f7d-9f36-4ec1d06e2717 from the persistent domain config. {{(pid=71731) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 13 16:23:47 user nova-compute[71731]: DEBUG nova.virt.libvirt.guest [None req-a05bd84b-ad12-4778-8b8a-a4430f7c9fca tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 16:23:47 user nova-compute[71731]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 16:23:47 user nova-compute[71731]:   <source dev="/dev/sdd"/>
Apr 13 16:23:47 user nova-compute[71731]:   <target dev="vdb" bus="virtio"/>
Apr 13 16:23:47 user nova-compute[71731]:   <serial>e962a4d5-41c9-4b3b-b78e-c25e451aa73f</serial>
Apr 13 16:23:47 user nova-compute[71731]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 13 16:23:47 user nova-compute[71731]: </disk>
Apr 13 16:23:47 user nova-compute[71731]:  {{(pid=71731) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 16:23:47 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-a05bd84b-ad12-4778-8b8a-a4430f7c9fca tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Successfully detached device vdb from instance 031c7939-a53c-4f7d-9f36-4ec1d06e2717 from the persistent domain config.
Apr 13 16:23:47 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-a05bd84b-ad12-4778-8b8a-a4430f7c9fca tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 031c7939-a53c-4f7d-9f36-4ec1d06e2717 from the live domain config. {{(pid=71731) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 13 16:23:47 user nova-compute[71731]: DEBUG nova.virt.libvirt.guest [None req-a05bd84b-ad12-4778-8b8a-a4430f7c9fca tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 16:23:47 user nova-compute[71731]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 16:23:47 user nova-compute[71731]:   <source dev="/dev/sdd"/>
Apr 13 16:23:47 user nova-compute[71731]:   <target dev="vdb" bus="virtio"/>
Apr 13 16:23:47 user nova-compute[71731]:   <serial>e962a4d5-41c9-4b3b-b78e-c25e451aa73f</serial>
Apr 13 16:23:47 user nova-compute[71731]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 13 16:23:47 user nova-compute[71731]: </disk>
Apr 13 16:23:47 user nova-compute[71731]:  {{(pid=71731) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 16:23:47 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-d59a75f8-29c4-46fc-ab0e-5e914b270376 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Acquiring lock "031c7939-a53c-4f7d-9f36-4ec1d06e2717" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:23:48 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Received event <DeviceRemovedEvent: 1681403028.374917, 031c7939-a53c-4f7d-9f36-4ec1d06e2717 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71731) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 13 16:23:48 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-a05bd84b-ad12-4778-8b8a-a4430f7c9fca tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 031c7939-a53c-4f7d-9f36-4ec1d06e2717 {{(pid=71731) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 13 16:23:48 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-a05bd84b-ad12-4778-8b8a-a4430f7c9fca tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Successfully detached device vdb from instance 031c7939-a53c-4f7d-9f36-4ec1d06e2717 from the live domain config.
Apr 13 16:23:48 user nova-compute[71731]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a05bd84b-ad12-4778-8b8a-a4430f7c9fca tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] [instance: 031c7939-a53c-4f7d-9f36-4ec1d06e2717] calling os-brick to detach iSCSI Volume {{(pid=71731) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 16:23:48 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-a05bd84b-ad12-4778-8b8a-a4430f7c9fca tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8cf0118790>, {'target_iqn': 'iqn.2010-10.org.openstack:e962a4d5-41c9-4b3b-b78e-c25e451aa73f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iITrFYGA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 16:23:48 user nova-compute[71731]: WARNING os_brick.initiator.connectors.base [None req-a05bd84b-ad12-4778-8b8a-a4430f7c9fca tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 16:23:48 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-a05bd84b-ad12-4778-8b8a-a4430f7c9fca tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 16:23:48 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-a05bd84b-ad12-4778-8b8a-a4430f7c9fca tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 16:23:48 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:23:48 user nova-compute[71731]: DEBUG nova.virt.driver [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Emitting event <LifecycleEvent: 1681403028.4019942, acbcaee0-a47b-4fee-8765-9b1c9597d515 => Resumed> {{(pid=71731) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 16:23:48 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] VM Resumed (Lifecycle Event)
Apr 13 16:23:48 user nova-compute[71731]: DEBUG nova.compute.manager [None req-bfaa0693-007d-4127-9d17-282e2b179fff tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] Instance event wait completed in 0 seconds for  {{(pid=71731) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 16:23:48 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-bfaa0693-007d-4127-9d17-282e2b179fff tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] Guest created on hypervisor {{(pid=71731) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 16:23:48 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:23:48 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[9001d1aa-cddb-44b7-873a-148c7aa2699b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0e3b49ec-80af-4c38-9689-f7277e495d21\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e962a4d5-41c9-4b3b-b78e-c25e451aa73f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:23:48 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-a05bd84b-ad12-4778-8b8a-a4430f7c9fca tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 16:23:48 user nova-compute[71731]: No targets found.
Apr 13 16:23:48 user nova-compute[71731]: iSNS:
Apr 13 16:23:48 user nova-compute[71731]: No targets found.
Apr 13 16:23:48 user nova-compute[71731]: STATIC:
Apr 13 16:23:48 user nova-compute[71731]: Target: iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97
Apr 13 16:23:48 user nova-compute[71731]:         Portal: 172.16.0.220:3260,-1
Apr 13 16:23:48 user nova-compute[71731]:                 Iface Name: default
Apr 13 16:23:48 user nova-compute[71731]: Target: iqn.2010-10.org.openstack:0e3b49ec-80af-4c38-9689-f7277e495d21
Apr 13 16:23:48 user nova-compute[71731]:         Portal: 172.16.0.220:3260,-1
Apr 13 16:23:48 user nova-compute[71731]:                 Iface Name: default
Apr 13 16:23:48 user nova-compute[71731]: Target: iqn.2010-10.org.openstack:e962a4d5-41c9-4b3b-b78e-c25e451aa73f
Apr 13 16:23:48 user nova-compute[71731]:         Portal: 172.16.0.220:3260,-1
Apr 13 16:23:48 user nova-compute[71731]:                 Iface Name: default
Apr 13 16:23:48 user nova-compute[71731]: FIRMWARE:
Apr 13 16:23:48 user nova-compute[71731]: No targets found.
Apr 13 16:23:48 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 16:23:48 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-a05bd84b-ad12-4778-8b8a-a4430f7c9fca tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 16:23:48 user nova-compute[71731]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 16:23:48 user nova-compute[71731]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71731) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 16:23:48 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-a05bd84b-ad12-4778-8b8a-a4430f7c9fca tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e962a4d5-41c9-4b3b-b78e-c25e451aa73f', 0)] {{(pid=71731) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 16:23:48 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:23:48 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:23:48 user nova-compute[71731]: INFO nova.virt.libvirt.driver [-] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] Instance spawned successfully.
Apr 13 16:23:48 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-bfaa0693-007d-4127-9d17-282e2b179fff tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 16:23:48 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71731) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 16:23:48 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:23:48 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[7da48c0e-178d-4828-9f3c-e83be32186ee]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0e3b49ec-80af-4c38-9689-f7277e495d21\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e962a4d5-41c9-4b3b-b78e-c25e451aa73f\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:23:48 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 16:23:48 user nova-compute[71731]: DEBUG nova.virt.driver [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Emitting event <LifecycleEvent: 1681403028.4053612, acbcaee0-a47b-4fee-8765-9b1c9597d515 => Started> {{(pid=71731) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 16:23:48 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] VM Started (Lifecycle Event)
Apr 13 16:23:48 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:23:48 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-bfaa0693-007d-4127-9d17-282e2b179fff tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] Found default for hw_cdrom_bus of ide {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:23:48 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-bfaa0693-007d-4127-9d17-282e2b179fff tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] Found default for hw_disk_bus of virtio {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:23:48 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-bfaa0693-007d-4127-9d17-282e2b179fff tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] Found default for hw_input_bus of None {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:23:48 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-bfaa0693-007d-4127-9d17-282e2b179fff tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] Found default for hw_pointer_model of None {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:23:48 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-bfaa0693-007d-4127-9d17-282e2b179fff tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] Found default for hw_video_model of virtio {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:23:48 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-bfaa0693-007d-4127-9d17-282e2b179fff tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] Found default for hw_vif_model of virtio {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:23:48 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:23:48 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2a6fbc6-0ce2-494f-a781-4160fe352c53]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e3b49ec-80af-4c38-9689-f7277e495d21 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e962a4d5-41c9-4b3b-b78e-c25e451aa73f (non-flash)\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:23:48 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:23:48 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-a05bd84b-ad12-4778-8b8a-a4430f7c9fca tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e3b49ec-80af-4c38-9689-f7277e495d21 (non-flash)
Apr 13 16:23:48 user nova-compute[71731]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)
Apr 13 16:23:48 user nova-compute[71731]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e962a4d5-41c9-4b3b-b78e-c25e451aa73f (non-flash)
Apr 13 16:23:48 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 16:23:48 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-a05bd84b-ad12-4778-8b8a-a4430f7c9fca tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e3b49ec-80af-4c38-9689-f7277e495d21 (non-flash)
Apr 13 16:23:48 user nova-compute[71731]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)
Apr 13 16:23:48 user nova-compute[71731]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e962a4d5-41c9-4b3b-b78e-c25e451aa73f (non-flash)
Apr 13 16:23:48 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 16:23:48 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-a05bd84b-ad12-4778-8b8a-a4430f7c9fca tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8cf067dcf0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e962a4d5-41c9-4b3b-b78e-c25e451aa73f'): ({'sdd'}, set())}) {{(pid=71731) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 16:23:48 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-a05bd84b-ad12-4778-8b8a-a4430f7c9fca tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Removing single pathed devices sdd {{(pid=71731) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 16:23:48 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:23:48 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71731) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 16:23:48 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:23:48 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[cccba9fc-d6b0-4da7-b679-48beb6d94c96]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:23:48 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:23:48 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 16:23:48 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.028s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:23:48 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[81dc8075-4fd8-4b02-b835-7ec319c117ab]: (4, ('ok\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:23:48 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-a05bd84b-ad12-4778-8b8a-a4430f7c9fca tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Flushing IO for device /dev/sdd {{(pid=71731) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 16:23:48 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:23:48 user nova-compute[71731]: INFO nova.compute.manager [None req-bfaa0693-007d-4127-9d17-282e2b179fff tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] Took 5.87 seconds to spawn the instance on the hypervisor.
Apr 13 16:23:48 user nova-compute[71731]: DEBUG nova.compute.manager [None req-bfaa0693-007d-4127-9d17-282e2b179fff tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:23:48 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:23:48 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[80caa0e4-2cc6-4eb8-84cf-0ce40566b558]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:23:48 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-a05bd84b-ad12-4778-8b8a-a4430f7c9fca tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=71731) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 16:23:48 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:23:48 user nova-compute[71731]: DEBUG nova.compute.manager [req-bac8d8c4-52ab-4c7d-bbc0-d06661111c62 req-22dccc2e-6fc6-4241-8c4b-92b380329a49 service nova] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] Received event network-vif-plugged-13471516-9514-4b85-938f-69657c2990e5 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:23:48 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-bac8d8c4-52ab-4c7d-bbc0-d06661111c62 req-22dccc2e-6fc6-4241-8c4b-92b380329a49 service nova] Acquiring lock "acbcaee0-a47b-4fee-8765-9b1c9597d515-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:23:48 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-bac8d8c4-52ab-4c7d-bbc0-d06661111c62 req-22dccc2e-6fc6-4241-8c4b-92b380329a49 service nova] Lock "acbcaee0-a47b-4fee-8765-9b1c9597d515-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:23:48 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-bac8d8c4-52ab-4c7d-bbc0-d06661111c62 req-22dccc2e-6fc6-4241-8c4b-92b380329a49 service nova] Lock "acbcaee0-a47b-4fee-8765-9b1c9597d515-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:23:48 user nova-compute[71731]: DEBUG nova.compute.manager [req-bac8d8c4-52ab-4c7d-bbc0-d06661111c62 req-22dccc2e-6fc6-4241-8c4b-92b380329a49 service nova] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] No waiting events found dispatching network-vif-plugged-13471516-9514-4b85-938f-69657c2990e5 {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:23:48 user nova-compute[71731]: WARNING nova.compute.manager [req-bac8d8c4-52ab-4c7d-bbc0-d06661111c62 req-22dccc2e-6fc6-4241-8c4b-92b380329a49 service nova] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] Received unexpected event network-vif-plugged-13471516-9514-4b85-938f-69657c2990e5 for instance with vm_state building and task_state spawning.
Apr 13 16:23:48 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.054s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:23:48 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[01181028-323f-423e-82ab-62b309b797c8]: (4, ('1', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:23:48 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-a05bd84b-ad12-4778-8b8a-a4430f7c9fca tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=71731) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 16:23:48 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-a05bd84b-ad12-4778-8b8a-a4430f7c9fca tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] SCSI volumes sdd have been removed. {{(pid=71731) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 16:23:48 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-a05bd84b-ad12-4778-8b8a-a4430f7c9fca tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e962a4d5-41c9-4b3b-b78e-c25e451aa73f')] {{(pid=71731) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 16:23:48 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e962a4d5-41c9-4b3b-b78e-c25e451aa73f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:23:48 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e962a4d5-41c9-4b3b-b78e-c25e451aa73f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:23:48 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[f65f1e36-6ea1-422d-9455-6d0286d83425]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:23:48 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-a05bd84b-ad12-4778-8b8a-a4430f7c9fca tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:23:48 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e962a4d5-41c9-4b3b-b78e-c25e451aa73f -p 172.16.0.220:3260 --logout {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:23:48 user nova-compute[71731]: INFO nova.compute.manager [None req-bfaa0693-007d-4127-9d17-282e2b179fff tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] Took 6.69 seconds to build instance.
Apr 13 16:23:48 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-bfaa0693-007d-4127-9d17-282e2b179fff tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "acbcaee0-a47b-4fee-8765-9b1c9597d515" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.787s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:23:48 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e962a4d5-41c9-4b3b-b78e-c25e451aa73f -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:23:48 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7f2f8c2-83ea-4ed7-97e0-3c25ca739a23]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:e962a4d5-41c9-4b3b-b78e-c25e451aa73f, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:e962a4d5-41c9-4b3b-b78e-c25e451aa73f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:23:48 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-a05bd84b-ad12-4778-8b8a-a4430f7c9fca tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:e962a4d5-41c9-4b3b-b78e-c25e451aa73f, portal: 172.16.0.220,3260]
Apr 13 16:23:48 user nova-compute[71731]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:e962a4d5-41c9-4b3b-b78e-c25e451aa73f, portal: 172.16.0.220,3260] successful.
Apr 13 16:23:48 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:23:48 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e962a4d5-41c9-4b3b-b78e-c25e451aa73f -p 172.16.0.220:3260 --op delete {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:23:48 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e962a4d5-41c9-4b3b-b78e-c25e451aa73f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:23:48 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[33c98c7e-7036-4b78-9206-8fcbc765cf78]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:23:48 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-a05bd84b-ad12-4778-8b8a-a4430f7c9fca tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:23:48 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-a05bd84b-ad12-4778-8b8a-a4430f7c9fca tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.367s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 16:23:48 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-a05bd84b-ad12-4778-8b8a-a4430f7c9fca tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] <== disconnect_volume: return (368ms) None {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 16:23:48 user nova-compute[71731]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a05bd84b-ad12-4778-8b8a-a4430f7c9fca tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] [instance: 031c7939-a53c-4f7d-9f36-4ec1d06e2717] Disconnected iSCSI Volume {{(pid=71731) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 16:23:49 user nova-compute[71731]: DEBUG nova.objects.instance [None req-a05bd84b-ad12-4778-8b8a-a4430f7c9fca tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Lazy-loading 'flavor' on Instance uuid 031c7939-a53c-4f7d-9f36-4ec1d06e2717 {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:23:49 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-a05bd84b-ad12-4778-8b8a-a4430f7c9fca tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Lock "031c7939-a53c-4f7d-9f36-4ec1d06e2717" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.894s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:23:49 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-d59a75f8-29c4-46fc-ab0e-5e914b270376 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Lock "031c7939-a53c-4f7d-9f36-4ec1d06e2717" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 1.754s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:23:49 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-d59a75f8-29c4-46fc-ab0e-5e914b270376 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Acquiring lock "031c7939-a53c-4f7d-9f36-4ec1d06e2717-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:23:49 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-d59a75f8-29c4-46fc-ab0e-5e914b270376 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Lock "031c7939-a53c-4f7d-9f36-4ec1d06e2717-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.006s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:23:49 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-d59a75f8-29c4-46fc-ab0e-5e914b270376 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Lock "031c7939-a53c-4f7d-9f36-4ec1d06e2717-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:23:49 user nova-compute[71731]: INFO nova.compute.manager [None req-d59a75f8-29c4-46fc-ab0e-5e914b270376 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] [instance: 031c7939-a53c-4f7d-9f36-4ec1d06e2717] Terminating instance
Apr 13 16:23:49 user nova-compute[71731]: DEBUG nova.compute.manager [None req-d59a75f8-29c4-46fc-ab0e-5e914b270376 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] [instance: 031c7939-a53c-4f7d-9f36-4ec1d06e2717] Start destroying the instance on the hypervisor. {{(pid=71731) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 16:23:49 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:23:49 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:23:49 user nova-compute[71731]: DEBUG nova.compute.manager [req-99e27b20-acc7-4597-aece-f0a2eebcd137 req-a65d281b-f8de-4681-a21a-93bc3a307b81 service nova] [instance: 031c7939-a53c-4f7d-9f36-4ec1d06e2717] Received event network-vif-unplugged-a99b01f1-3495-45d6-a802-a1f740719c17 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:23:49 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-99e27b20-acc7-4597-aece-f0a2eebcd137 req-a65d281b-f8de-4681-a21a-93bc3a307b81 service nova] Acquiring lock "031c7939-a53c-4f7d-9f36-4ec1d06e2717-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:23:49 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-99e27b20-acc7-4597-aece-f0a2eebcd137 req-a65d281b-f8de-4681-a21a-93bc3a307b81 service nova] Lock "031c7939-a53c-4f7d-9f36-4ec1d06e2717-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:23:49 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-99e27b20-acc7-4597-aece-f0a2eebcd137 req-a65d281b-f8de-4681-a21a-93bc3a307b81 service nova] Lock "031c7939-a53c-4f7d-9f36-4ec1d06e2717-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:23:49 user nova-compute[71731]: DEBUG nova.compute.manager [req-99e27b20-acc7-4597-aece-f0a2eebcd137 req-a65d281b-f8de-4681-a21a-93bc3a307b81 service nova] [instance: 031c7939-a53c-4f7d-9f36-4ec1d06e2717] No waiting events found dispatching network-vif-unplugged-a99b01f1-3495-45d6-a802-a1f740719c17 {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:23:49 user nova-compute[71731]: DEBUG nova.compute.manager [req-99e27b20-acc7-4597-aece-f0a2eebcd137 req-a65d281b-f8de-4681-a21a-93bc3a307b81 service nova] [instance: 031c7939-a53c-4f7d-9f36-4ec1d06e2717] Received event network-vif-unplugged-a99b01f1-3495-45d6-a802-a1f740719c17 for instance with task_state deleting. {{(pid=71731) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 16:23:50 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:23:50 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:23:50 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:23:50 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:23:50 user nova-compute[71731]: INFO nova.virt.libvirt.driver [-] [instance: 031c7939-a53c-4f7d-9f36-4ec1d06e2717] Instance destroyed successfully.
Apr 13 16:23:50 user nova-compute[71731]: DEBUG nova.objects.instance [None req-d59a75f8-29c4-46fc-ab0e-5e914b270376 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Lazy-loading 'resources' on Instance uuid 031c7939-a53c-4f7d-9f36-4ec1d06e2717 {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:23:50 user nova-compute[71731]: DEBUG nova.virt.libvirt.vif [None req-d59a75f8-29c4-46fc-ab0e-5e914b270376 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T16:21:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1108271225',display_name='tempest-VolumesSnapshotTestJSON-instance-1108271225',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1108271225',id=10,image_ref='708622a9-7465-4492-ade8-b827198f7e30',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-13T16:21:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e7395d2408a44cc88cf88eb49d5f8503',ramdisk_id='',reservation_id='r-3dxchrfq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='708622a9-7465-4492-ade8-b827198f7e30',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1985397600',owner_user_name='tempest-VolumesSnapshotTestJSON-1985397600-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T16:21:45Z,user_data=None,user_id='9223a3efe4bc4e37946c8ed718100de4',uuid=031c7939-a53c-4f7d-9f36-4ec1d06e2717,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a99b01f1-3495-45d6-a802-a1f740719c17", "address": "fa:16:3e:42:0a:ee", "network": {"id": "aa17b8d5-dffb-42ba-bb7e-8909e5894bfb", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-386731779-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "e7395d2408a44cc88cf88eb49d5f8503", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa99b01f1-34", "ovs_interfaceid": "a99b01f1-3495-45d6-a802-a1f740719c17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 16:23:50 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-d59a75f8-29c4-46fc-ab0e-5e914b270376 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Converting VIF {"id": "a99b01f1-3495-45d6-a802-a1f740719c17", "address": "fa:16:3e:42:0a:ee", "network": {"id": "aa17b8d5-dffb-42ba-bb7e-8909e5894bfb", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-386731779-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "e7395d2408a44cc88cf88eb49d5f8503", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa99b01f1-34", "ovs_interfaceid": "a99b01f1-3495-45d6-a802-a1f740719c17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 16:23:50 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-d59a75f8-29c4-46fc-ab0e-5e914b270376 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:42:0a:ee,bridge_name='br-int',has_traffic_filtering=True,id=a99b01f1-3495-45d6-a802-a1f740719c17,network=Network(aa17b8d5-dffb-42ba-bb7e-8909e5894bfb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa99b01f1-34') {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 16:23:50 user nova-compute[71731]: DEBUG os_vif [None req-d59a75f8-29c4-46fc-ab0e-5e914b270376 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:42:0a:ee,bridge_name='br-int',has_traffic_filtering=True,id=a99b01f1-3495-45d6-a802-a1f740719c17,network=Network(aa17b8d5-dffb-42ba-bb7e-8909e5894bfb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa99b01f1-34') {{(pid=71731) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 16:23:50 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:23:50 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa99b01f1-34, bridge=br-int, if_exists=True) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:23:50 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:23:50 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 16:23:50 user nova-compute[71731]: INFO os_vif [None req-d59a75f8-29c4-46fc-ab0e-5e914b270376 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:42:0a:ee,bridge_name='br-int',has_traffic_filtering=True,id=a99b01f1-3495-45d6-a802-a1f740719c17,network=Network(aa17b8d5-dffb-42ba-bb7e-8909e5894bfb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa99b01f1-34')
Apr 13 16:23:50 user nova-compute[71731]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d59a75f8-29c4-46fc-ab0e-5e914b270376 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] [instance: 031c7939-a53c-4f7d-9f36-4ec1d06e2717] calling os-brick to detach iSCSI Volume {{(pid=71731) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 16:23:50 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-d59a75f8-29c4-46fc-ab0e-5e914b270376 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8cf0118790>, {'target_iqn': 'iqn.2010-10.org.openstack:e962a4d5-41c9-4b3b-b78e-c25e451aa73f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iITrFYGA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 16:23:50 user nova-compute[71731]: WARNING os_brick.initiator.connectors.base [None req-d59a75f8-29c4-46fc-ab0e-5e914b270376 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 16:23:50 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-d59a75f8-29c4-46fc-ab0e-5e914b270376 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 16:23:50 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-d59a75f8-29c4-46fc-ab0e-5e914b270376 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 16:23:50 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:23:50 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:23:50 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf30af2d-d720-4035-9667-3d778258eea4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0e3b49ec-80af-4c38-9689-f7277e495d21\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:23:50 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-d59a75f8-29c4-46fc-ab0e-5e914b270376 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 16:23:50 user nova-compute[71731]: No targets found.
Apr 13 16:23:50 user nova-compute[71731]: iSNS:
Apr 13 16:23:50 user nova-compute[71731]: No targets found.
Apr 13 16:23:50 user nova-compute[71731]: STATIC:
Apr 13 16:23:50 user nova-compute[71731]: Target: iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97
Apr 13 16:23:50 user nova-compute[71731]:         Portal: 172.16.0.220:3260,-1
Apr 13 16:23:50 user nova-compute[71731]:                 Iface Name: default
Apr 13 16:23:50 user nova-compute[71731]: Target: iqn.2010-10.org.openstack:0e3b49ec-80af-4c38-9689-f7277e495d21
Apr 13 16:23:50 user nova-compute[71731]:         Portal: 172.16.0.220:3260,-1
Apr 13 16:23:50 user nova-compute[71731]:                 Iface Name: default
Apr 13 16:23:50 user nova-compute[71731]: FIRMWARE:
Apr 13 16:23:50 user nova-compute[71731]: No targets found.
Apr 13 16:23:50 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 16:23:50 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-d59a75f8-29c4-46fc-ab0e-5e914b270376 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 16:23:50 user nova-compute[71731]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 16:23:50 user nova-compute[71731]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71731) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 16:23:50 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-d59a75f8-29c4-46fc-ab0e-5e914b270376 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e962a4d5-41c9-4b3b-b78e-c25e451aa73f', 0)] {{(pid=71731) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 16:23:50 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:23:50 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:23:50 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[9735a9cd-fb00-4e47-babd-06df78b16c0b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0e3b49ec-80af-4c38-9689-f7277e495d21\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:23:50 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:23:50 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:23:50 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad9faed1-8822-4cad-b8ae-bd4f3000798f]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e3b49ec-80af-4c38-9689-f7277e495d21 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:23:50 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-d59a75f8-29c4-46fc-ab0e-5e914b270376 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e3b49ec-80af-4c38-9689-f7277e495d21 (non-flash)
Apr 13 16:23:50 user nova-compute[71731]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)
Apr 13 16:23:50 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 16:23:50 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-d59a75f8-29c4-46fc-ab0e-5e914b270376 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e3b49ec-80af-4c38-9689-f7277e495d21 (non-flash)
Apr 13 16:23:50 user nova-compute[71731]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)
Apr 13 16:23:50 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 16:23:50 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-d59a75f8-29c4-46fc-ab0e-5e914b270376 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8cff3652d0>, {}) {{(pid=71731) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 16:23:50 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-d59a75f8-29c4-46fc-ab0e-5e914b270376 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Disconnecting from: [] {{(pid=71731) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 16:23:50 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-d59a75f8-29c4-46fc-ab0e-5e914b270376 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.092s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 16:23:50 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-d59a75f8-29c4-46fc-ab0e-5e914b270376 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] <== disconnect_volume: return (94ms) None {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 16:23:50 user nova-compute[71731]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d59a75f8-29c4-46fc-ab0e-5e914b270376 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] [instance: 031c7939-a53c-4f7d-9f36-4ec1d06e2717] Disconnected iSCSI Volume {{(pid=71731) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 16:23:50 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-d59a75f8-29c4-46fc-ab0e-5e914b270376 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] [instance: 031c7939-a53c-4f7d-9f36-4ec1d06e2717] Deleting instance files /opt/stack/data/nova/instances/031c7939-a53c-4f7d-9f36-4ec1d06e2717_del
Apr 13 16:23:50 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-d59a75f8-29c4-46fc-ab0e-5e914b270376 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] [instance: 031c7939-a53c-4f7d-9f36-4ec1d06e2717] Deletion of /opt/stack/data/nova/instances/031c7939-a53c-4f7d-9f36-4ec1d06e2717_del complete
Apr 13 16:23:50 user nova-compute[71731]: INFO nova.compute.manager [None req-d59a75f8-29c4-46fc-ab0e-5e914b270376 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] [instance: 031c7939-a53c-4f7d-9f36-4ec1d06e2717] Took 1.02 seconds to destroy the instance on the hypervisor.
Apr 13 16:23:50 user nova-compute[71731]: DEBUG oslo.service.loopingcall [None req-d59a75f8-29c4-46fc-ab0e-5e914b270376 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71731) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 16:23:50 user nova-compute[71731]: DEBUG nova.compute.manager [-] [instance: 031c7939-a53c-4f7d-9f36-4ec1d06e2717] Deallocating network for instance {{(pid=71731) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 16:23:50 user nova-compute[71731]: DEBUG nova.network.neutron [-] [instance: 031c7939-a53c-4f7d-9f36-4ec1d06e2717] deallocate_for_instance() {{(pid=71731) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 16:23:51 user nova-compute[71731]: DEBUG nova.network.neutron [-] [instance: 031c7939-a53c-4f7d-9f36-4ec1d06e2717] Updating instance_info_cache with network_info: [] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:23:51 user nova-compute[71731]: DEBUG nova.compute.manager [req-e5822ccb-a590-4751-ac60-1947dfe1bf4c req-226cfa5a-c720-4a5e-b05c-a8079149a643 service nova] [instance: 031c7939-a53c-4f7d-9f36-4ec1d06e2717] Received event network-vif-deleted-a99b01f1-3495-45d6-a802-a1f740719c17 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:23:51 user nova-compute[71731]: INFO nova.compute.manager [req-e5822ccb-a590-4751-ac60-1947dfe1bf4c req-226cfa5a-c720-4a5e-b05c-a8079149a643 service nova] [instance: 031c7939-a53c-4f7d-9f36-4ec1d06e2717] Neutron deleted interface a99b01f1-3495-45d6-a802-a1f740719c17; detaching it from the instance and deleting it from the info cache
Apr 13 16:23:51 user nova-compute[71731]: DEBUG nova.network.neutron [req-e5822ccb-a590-4751-ac60-1947dfe1bf4c req-226cfa5a-c720-4a5e-b05c-a8079149a643 service nova] [instance: 031c7939-a53c-4f7d-9f36-4ec1d06e2717] Updating instance_info_cache with network_info: [] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:23:51 user nova-compute[71731]: INFO nova.compute.manager [-] [instance: 031c7939-a53c-4f7d-9f36-4ec1d06e2717] Took 0.69 seconds to deallocate network for instance.
Apr 13 16:23:51 user nova-compute[71731]: DEBUG nova.compute.manager [req-e5822ccb-a590-4751-ac60-1947dfe1bf4c req-226cfa5a-c720-4a5e-b05c-a8079149a643 service nova] [instance: 031c7939-a53c-4f7d-9f36-4ec1d06e2717] Detach interface failed, port_id=a99b01f1-3495-45d6-a802-a1f740719c17, reason: Instance 031c7939-a53c-4f7d-9f36-4ec1d06e2717 could not be found. {{(pid=71731) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 13 16:23:51 user nova-compute[71731]: WARNING nova.volume.cinder [None req-d59a75f8-29c4-46fc-ab0e-5e914b270376 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Attachment 7ca70fe2-eeb6-42b5-9565-83764a8035d0 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 7ca70fe2-eeb6-42b5-9565-83764a8035d0. (HTTP 404) (Request-ID: req-72ccab5b-c04d-42e8-ab62-7162ee8a8206)
Apr 13 16:23:51 user nova-compute[71731]: INFO nova.compute.manager [None req-d59a75f8-29c4-46fc-ab0e-5e914b270376 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] [instance: 031c7939-a53c-4f7d-9f36-4ec1d06e2717] Took 0.03 seconds to detach 1 volumes for instance.
Apr 13 16:23:51 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:23:51 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-d59a75f8-29c4-46fc-ab0e-5e914b270376 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:23:51 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-d59a75f8-29c4-46fc-ab0e-5e914b270376 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:23:51 user nova-compute[71731]: DEBUG nova.compute.provider_tree [None req-d59a75f8-29c4-46fc-ab0e-5e914b270376 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Inventory has not changed in ProviderTree for provider: cb6b1a64-0c24-4e2d-af1e-16576ca9165c {{(pid=71731) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 16:23:51 user nova-compute[71731]: DEBUG nova.scheduler.client.report [None req-d59a75f8-29c4-46fc-ab0e-5e914b270376 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Inventory has not changed for provider cb6b1a64-0c24-4e2d-af1e-16576ca9165c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71731) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 16:23:51 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-d59a75f8-29c4-46fc-ab0e-5e914b270376 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.373s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:23:51 user nova-compute[71731]: INFO nova.scheduler.client.report [None req-d59a75f8-29c4-46fc-ab0e-5e914b270376 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Deleted allocations for instance 031c7939-a53c-4f7d-9f36-4ec1d06e2717
Apr 13 16:23:51 user nova-compute[71731]: DEBUG nova.compute.manager [req-4fe3a936-3d1b-43a9-a2f5-c5ce3df6f976 req-0551f01d-8c82-4d59-bac6-64de4ffc096c service nova] [instance: 031c7939-a53c-4f7d-9f36-4ec1d06e2717] Received event network-vif-plugged-a99b01f1-3495-45d6-a802-a1f740719c17 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:23:51 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-4fe3a936-3d1b-43a9-a2f5-c5ce3df6f976 req-0551f01d-8c82-4d59-bac6-64de4ffc096c service nova] Acquiring lock "031c7939-a53c-4f7d-9f36-4ec1d06e2717-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:23:51 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-4fe3a936-3d1b-43a9-a2f5-c5ce3df6f976 req-0551f01d-8c82-4d59-bac6-64de4ffc096c service nova] Lock "031c7939-a53c-4f7d-9f36-4ec1d06e2717-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:23:51 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-4fe3a936-3d1b-43a9-a2f5-c5ce3df6f976 req-0551f01d-8c82-4d59-bac6-64de4ffc096c service nova] Lock "031c7939-a53c-4f7d-9f36-4ec1d06e2717-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:23:51 user nova-compute[71731]: DEBUG nova.compute.manager [req-4fe3a936-3d1b-43a9-a2f5-c5ce3df6f976 req-0551f01d-8c82-4d59-bac6-64de4ffc096c service nova] [instance: 031c7939-a53c-4f7d-9f36-4ec1d06e2717] No waiting events found dispatching network-vif-plugged-a99b01f1-3495-45d6-a802-a1f740719c17 {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:23:51 user nova-compute[71731]: WARNING nova.compute.manager [req-4fe3a936-3d1b-43a9-a2f5-c5ce3df6f976 req-0551f01d-8c82-4d59-bac6-64de4ffc096c service nova] [instance: 031c7939-a53c-4f7d-9f36-4ec1d06e2717] Received unexpected event network-vif-plugged-a99b01f1-3495-45d6-a802-a1f740719c17 for instance with vm_state deleted and task_state None.
Apr 13 16:23:51 user nova-compute[71731]: DEBUG nova.compute.manager [req-4fe3a936-3d1b-43a9-a2f5-c5ce3df6f976 req-0551f01d-8c82-4d59-bac6-64de4ffc096c service nova] [instance: 031c7939-a53c-4f7d-9f36-4ec1d06e2717] Received event network-vif-plugged-a99b01f1-3495-45d6-a802-a1f740719c17 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:23:51 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-4fe3a936-3d1b-43a9-a2f5-c5ce3df6f976 req-0551f01d-8c82-4d59-bac6-64de4ffc096c service nova] Acquiring lock "031c7939-a53c-4f7d-9f36-4ec1d06e2717-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:23:51 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-4fe3a936-3d1b-43a9-a2f5-c5ce3df6f976 req-0551f01d-8c82-4d59-bac6-64de4ffc096c service nova] Lock "031c7939-a53c-4f7d-9f36-4ec1d06e2717-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:23:51 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-4fe3a936-3d1b-43a9-a2f5-c5ce3df6f976 req-0551f01d-8c82-4d59-bac6-64de4ffc096c service nova] Lock "031c7939-a53c-4f7d-9f36-4ec1d06e2717-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:23:51 user nova-compute[71731]: DEBUG nova.compute.manager [req-4fe3a936-3d1b-43a9-a2f5-c5ce3df6f976 req-0551f01d-8c82-4d59-bac6-64de4ffc096c service nova] [instance: 031c7939-a53c-4f7d-9f36-4ec1d06e2717] No waiting events found dispatching network-vif-plugged-a99b01f1-3495-45d6-a802-a1f740719c17 {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:23:51 user nova-compute[71731]: WARNING nova.compute.manager [req-4fe3a936-3d1b-43a9-a2f5-c5ce3df6f976 req-0551f01d-8c82-4d59-bac6-64de4ffc096c service nova] [instance: 031c7939-a53c-4f7d-9f36-4ec1d06e2717] Received unexpected event network-vif-plugged-a99b01f1-3495-45d6-a802-a1f740719c17 for instance with vm_state deleted and task_state None.
Apr 13 16:23:51 user nova-compute[71731]: DEBUG nova.compute.manager [req-4fe3a936-3d1b-43a9-a2f5-c5ce3df6f976 req-0551f01d-8c82-4d59-bac6-64de4ffc096c service nova] [instance: 031c7939-a53c-4f7d-9f36-4ec1d06e2717] Received event network-vif-plugged-a99b01f1-3495-45d6-a802-a1f740719c17 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:23:51 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-4fe3a936-3d1b-43a9-a2f5-c5ce3df6f976 req-0551f01d-8c82-4d59-bac6-64de4ffc096c service nova] Acquiring lock "031c7939-a53c-4f7d-9f36-4ec1d06e2717-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:23:51 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-4fe3a936-3d1b-43a9-a2f5-c5ce3df6f976 req-0551f01d-8c82-4d59-bac6-64de4ffc096c service nova] Lock "031c7939-a53c-4f7d-9f36-4ec1d06e2717-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:23:51 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-4fe3a936-3d1b-43a9-a2f5-c5ce3df6f976 req-0551f01d-8c82-4d59-bac6-64de4ffc096c service nova] Lock "031c7939-a53c-4f7d-9f36-4ec1d06e2717-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:23:51 user nova-compute[71731]: DEBUG nova.compute.manager [req-4fe3a936-3d1b-43a9-a2f5-c5ce3df6f976 req-0551f01d-8c82-4d59-bac6-64de4ffc096c service nova] [instance: 031c7939-a53c-4f7d-9f36-4ec1d06e2717] No waiting events found dispatching network-vif-plugged-a99b01f1-3495-45d6-a802-a1f740719c17 {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:23:51 user nova-compute[71731]: WARNING nova.compute.manager [req-4fe3a936-3d1b-43a9-a2f5-c5ce3df6f976 req-0551f01d-8c82-4d59-bac6-64de4ffc096c service nova] [instance: 031c7939-a53c-4f7d-9f36-4ec1d06e2717] Received unexpected event network-vif-plugged-a99b01f1-3495-45d6-a802-a1f740719c17 for instance with vm_state deleted and task_state None.
Apr 13 16:23:51 user nova-compute[71731]: DEBUG nova.compute.manager [req-4fe3a936-3d1b-43a9-a2f5-c5ce3df6f976 req-0551f01d-8c82-4d59-bac6-64de4ffc096c service nova] [instance: 031c7939-a53c-4f7d-9f36-4ec1d06e2717] Received event network-vif-unplugged-a99b01f1-3495-45d6-a802-a1f740719c17 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:23:51 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-4fe3a936-3d1b-43a9-a2f5-c5ce3df6f976 req-0551f01d-8c82-4d59-bac6-64de4ffc096c service nova] Acquiring lock "031c7939-a53c-4f7d-9f36-4ec1d06e2717-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:23:51 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-4fe3a936-3d1b-43a9-a2f5-c5ce3df6f976 req-0551f01d-8c82-4d59-bac6-64de4ffc096c service nova] Lock "031c7939-a53c-4f7d-9f36-4ec1d06e2717-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:23:51 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-4fe3a936-3d1b-43a9-a2f5-c5ce3df6f976 req-0551f01d-8c82-4d59-bac6-64de4ffc096c service nova] Lock "031c7939-a53c-4f7d-9f36-4ec1d06e2717-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:23:51 user nova-compute[71731]: DEBUG nova.compute.manager [req-4fe3a936-3d1b-43a9-a2f5-c5ce3df6f976 req-0551f01d-8c82-4d59-bac6-64de4ffc096c service nova] [instance: 031c7939-a53c-4f7d-9f36-4ec1d06e2717] No waiting events found dispatching network-vif-unplugged-a99b01f1-3495-45d6-a802-a1f740719c17 {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:23:51 user nova-compute[71731]: WARNING nova.compute.manager [req-4fe3a936-3d1b-43a9-a2f5-c5ce3df6f976 req-0551f01d-8c82-4d59-bac6-64de4ffc096c service nova] [instance: 031c7939-a53c-4f7d-9f36-4ec1d06e2717] Received unexpected event network-vif-unplugged-a99b01f1-3495-45d6-a802-a1f740719c17 for instance with vm_state deleted and task_state None.
Apr 13 16:23:51 user nova-compute[71731]: DEBUG nova.compute.manager [req-4fe3a936-3d1b-43a9-a2f5-c5ce3df6f976 req-0551f01d-8c82-4d59-bac6-64de4ffc096c service nova] [instance: 031c7939-a53c-4f7d-9f36-4ec1d06e2717] Received event network-vif-plugged-a99b01f1-3495-45d6-a802-a1f740719c17 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:23:51 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-4fe3a936-3d1b-43a9-a2f5-c5ce3df6f976 req-0551f01d-8c82-4d59-bac6-64de4ffc096c service nova] Acquiring lock "031c7939-a53c-4f7d-9f36-4ec1d06e2717-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:23:51 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-4fe3a936-3d1b-43a9-a2f5-c5ce3df6f976 req-0551f01d-8c82-4d59-bac6-64de4ffc096c service nova] Lock "031c7939-a53c-4f7d-9f36-4ec1d06e2717-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:23:51 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-4fe3a936-3d1b-43a9-a2f5-c5ce3df6f976 req-0551f01d-8c82-4d59-bac6-64de4ffc096c service nova] Lock "031c7939-a53c-4f7d-9f36-4ec1d06e2717-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:23:51 user nova-compute[71731]: DEBUG nova.compute.manager [req-4fe3a936-3d1b-43a9-a2f5-c5ce3df6f976 req-0551f01d-8c82-4d59-bac6-64de4ffc096c service nova] [instance: 031c7939-a53c-4f7d-9f36-4ec1d06e2717] No waiting events found dispatching network-vif-plugged-a99b01f1-3495-45d6-a802-a1f740719c17 {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:23:51 user nova-compute[71731]: WARNING nova.compute.manager [req-4fe3a936-3d1b-43a9-a2f5-c5ce3df6f976 req-0551f01d-8c82-4d59-bac6-64de4ffc096c service nova] [instance: 031c7939-a53c-4f7d-9f36-4ec1d06e2717] Received unexpected event network-vif-plugged-a99b01f1-3495-45d6-a802-a1f740719c17 for instance with vm_state deleted and task_state None.
Apr 13 16:23:52 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-d59a75f8-29c4-46fc-ab0e-5e914b270376 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Lock "031c7939-a53c-4f7d-9f36-4ec1d06e2717" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.401s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:23:54 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:23:55 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:23:56 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-f6ac84ab-b8ed-49a4-9a7b-e93802271ff2 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Acquiring lock "0e731607-fce1-4f19-9e4b-5b892e760179" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:23:56 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-f6ac84ab-b8ed-49a4-9a7b-e93802271ff2 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Lock "0e731607-fce1-4f19-9e4b-5b892e760179" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:23:56 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-f6ac84ab-b8ed-49a4-9a7b-e93802271ff2 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Acquiring lock "0e731607-fce1-4f19-9e4b-5b892e760179-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:23:56 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-f6ac84ab-b8ed-49a4-9a7b-e93802271ff2 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Lock "0e731607-fce1-4f19-9e4b-5b892e760179-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:23:56 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-f6ac84ab-b8ed-49a4-9a7b-e93802271ff2 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Lock "0e731607-fce1-4f19-9e4b-5b892e760179-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:23:56 user nova-compute[71731]: INFO nova.compute.manager [None req-f6ac84ab-b8ed-49a4-9a7b-e93802271ff2 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] [instance: 0e731607-fce1-4f19-9e4b-5b892e760179] Terminating instance
Apr 13 16:23:56 user nova-compute[71731]: DEBUG nova.compute.manager [None req-f6ac84ab-b8ed-49a4-9a7b-e93802271ff2 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] [instance: 0e731607-fce1-4f19-9e4b-5b892e760179] Start destroying the instance on the hypervisor. {{(pid=71731) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 16:23:56 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:23:56 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:23:56 user nova-compute[71731]: DEBUG nova.compute.manager [req-edce7a7d-d3ba-4647-9a6e-c0c15dde32cb req-e9dd3ac7-785d-4150-b7e2-72837bb5c1ec service nova] [instance: 0e731607-fce1-4f19-9e4b-5b892e760179] Received event network-vif-unplugged-62eabc99-73ed-4669-a7ce-6fc646611ff1 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:23:56 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-edce7a7d-d3ba-4647-9a6e-c0c15dde32cb req-e9dd3ac7-785d-4150-b7e2-72837bb5c1ec service nova] Acquiring lock "0e731607-fce1-4f19-9e4b-5b892e760179-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:23:56 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-edce7a7d-d3ba-4647-9a6e-c0c15dde32cb req-e9dd3ac7-785d-4150-b7e2-72837bb5c1ec service nova] Lock "0e731607-fce1-4f19-9e4b-5b892e760179-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:23:56 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-edce7a7d-d3ba-4647-9a6e-c0c15dde32cb req-e9dd3ac7-785d-4150-b7e2-72837bb5c1ec service nova] Lock "0e731607-fce1-4f19-9e4b-5b892e760179-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:23:56 user nova-compute[71731]: DEBUG nova.compute.manager [req-edce7a7d-d3ba-4647-9a6e-c0c15dde32cb req-e9dd3ac7-785d-4150-b7e2-72837bb5c1ec service nova] [instance: 0e731607-fce1-4f19-9e4b-5b892e760179] No waiting events found dispatching network-vif-unplugged-62eabc99-73ed-4669-a7ce-6fc646611ff1 {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:23:56 user nova-compute[71731]: DEBUG nova.compute.manager [req-edce7a7d-d3ba-4647-9a6e-c0c15dde32cb req-e9dd3ac7-785d-4150-b7e2-72837bb5c1ec service nova] [instance: 0e731607-fce1-4f19-9e4b-5b892e760179] Received event network-vif-unplugged-62eabc99-73ed-4669-a7ce-6fc646611ff1 for instance with task_state deleting. {{(pid=71731) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 16:23:56 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:23:56 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:23:56 user nova-compute[71731]: INFO nova.virt.libvirt.driver [-] [instance: 0e731607-fce1-4f19-9e4b-5b892e760179] Instance destroyed successfully.
Apr 13 16:23:56 user nova-compute[71731]: DEBUG nova.objects.instance [None req-f6ac84ab-b8ed-49a4-9a7b-e93802271ff2 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Lazy-loading 'resources' on Instance uuid 0e731607-fce1-4f19-9e4b-5b892e760179 {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:23:56 user nova-compute[71731]: DEBUG nova.virt.libvirt.vif [None req-f6ac84ab-b8ed-49a4-9a7b-e93802271ff2 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T16:22:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1280800160',display_name='tempest-ServersNegativeTestJSON-server-1280800160',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1280800160',id=12,image_ref='708622a9-7465-4492-ade8-b827198f7e30',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-13T16:22:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5554aa7f1b4d471b8807a845ab1ea33f',ramdisk_id='',reservation_id='r-a6fgr3ml',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='708622a9-7465-4492-ade8-b827198f7e30',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1820659348',owner_user_name='tempest-ServersNegativeTestJSON-1820659348-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T16:22:15Z,user_data=None,user_id='4ddd547d240b43ccb213e9d459082309',uuid=0e731607-fce1-4f19-9e4b-5b892e760179,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "62eabc99-73ed-4669-a7ce-6fc646611ff1", "address": "fa:16:3e:46:a8:2e", "network": {"id": "ae7f770e-a460-4297-91b5-ed0b908a895a", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1175970469-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5554aa7f1b4d471b8807a845ab1ea33f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62eabc99-73", "ovs_interfaceid": "62eabc99-73ed-4669-a7ce-6fc646611ff1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 16:23:56 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-f6ac84ab-b8ed-49a4-9a7b-e93802271ff2 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Converting VIF {"id": "62eabc99-73ed-4669-a7ce-6fc646611ff1", "address": "fa:16:3e:46:a8:2e", "network": {"id": "ae7f770e-a460-4297-91b5-ed0b908a895a", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1175970469-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5554aa7f1b4d471b8807a845ab1ea33f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62eabc99-73", "ovs_interfaceid": "62eabc99-73ed-4669-a7ce-6fc646611ff1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 16:23:56 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-f6ac84ab-b8ed-49a4-9a7b-e93802271ff2 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:46:a8:2e,bridge_name='br-int',has_traffic_filtering=True,id=62eabc99-73ed-4669-a7ce-6fc646611ff1,network=Network(ae7f770e-a460-4297-91b5-ed0b908a895a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62eabc99-73') {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 16:23:56 user nova-compute[71731]: DEBUG os_vif [None req-f6ac84ab-b8ed-49a4-9a7b-e93802271ff2 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:a8:2e,bridge_name='br-int',has_traffic_filtering=True,id=62eabc99-73ed-4669-a7ce-6fc646611ff1,network=Network(ae7f770e-a460-4297-91b5-ed0b908a895a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62eabc99-73') {{(pid=71731) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 16:23:56 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:23:56 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap62eabc99-73, bridge=br-int, if_exists=True) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:23:56 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:23:56 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 16:23:56 user nova-compute[71731]: INFO os_vif [None req-f6ac84ab-b8ed-49a4-9a7b-e93802271ff2 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:a8:2e,bridge_name='br-int',has_traffic_filtering=True,id=62eabc99-73ed-4669-a7ce-6fc646611ff1,network=Network(ae7f770e-a460-4297-91b5-ed0b908a895a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62eabc99-73')
Apr 13 16:23:56 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-f6ac84ab-b8ed-49a4-9a7b-e93802271ff2 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] [instance: 0e731607-fce1-4f19-9e4b-5b892e760179] Deleting instance files /opt/stack/data/nova/instances/0e731607-fce1-4f19-9e4b-5b892e760179_del
Apr 13 16:23:56 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-f6ac84ab-b8ed-49a4-9a7b-e93802271ff2 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] [instance: 0e731607-fce1-4f19-9e4b-5b892e760179] Deletion of /opt/stack/data/nova/instances/0e731607-fce1-4f19-9e4b-5b892e760179_del complete
Apr 13 16:23:56 user nova-compute[71731]: INFO nova.compute.manager [None req-f6ac84ab-b8ed-49a4-9a7b-e93802271ff2 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] [instance: 0e731607-fce1-4f19-9e4b-5b892e760179] Took 0.75 seconds to destroy the instance on the hypervisor.
Apr 13 16:23:56 user nova-compute[71731]: DEBUG oslo.service.loopingcall [None req-f6ac84ab-b8ed-49a4-9a7b-e93802271ff2 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71731) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 16:23:56 user nova-compute[71731]: DEBUG nova.compute.manager [-] [instance: 0e731607-fce1-4f19-9e4b-5b892e760179] Deallocating network for instance {{(pid=71731) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 16:23:56 user nova-compute[71731]: DEBUG nova.network.neutron [-] [instance: 0e731607-fce1-4f19-9e4b-5b892e760179] deallocate_for_instance() {{(pid=71731) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 16:23:57 user nova-compute[71731]: DEBUG nova.network.neutron [-] [instance: 0e731607-fce1-4f19-9e4b-5b892e760179] Updating instance_info_cache with network_info: [] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:23:57 user nova-compute[71731]: DEBUG nova.compute.manager [req-3b21e0b2-1ddd-4f08-a5e1-ed2a294421ed req-c2a63ad3-2b56-4c6a-b986-ad7a4463eaa2 service nova] [instance: 0e731607-fce1-4f19-9e4b-5b892e760179] Received event network-vif-deleted-62eabc99-73ed-4669-a7ce-6fc646611ff1 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:23:57 user nova-compute[71731]: INFO nova.compute.manager [req-3b21e0b2-1ddd-4f08-a5e1-ed2a294421ed req-c2a63ad3-2b56-4c6a-b986-ad7a4463eaa2 service nova] [instance: 0e731607-fce1-4f19-9e4b-5b892e760179] Neutron deleted interface 62eabc99-73ed-4669-a7ce-6fc646611ff1; detaching it from the instance and deleting it from the info cache
Apr 13 16:23:57 user nova-compute[71731]: DEBUG nova.network.neutron [req-3b21e0b2-1ddd-4f08-a5e1-ed2a294421ed req-c2a63ad3-2b56-4c6a-b986-ad7a4463eaa2 service nova] [instance: 0e731607-fce1-4f19-9e4b-5b892e760179] Updating instance_info_cache with network_info: [] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:23:57 user nova-compute[71731]: INFO nova.compute.manager [-] [instance: 0e731607-fce1-4f19-9e4b-5b892e760179] Took 0.53 seconds to deallocate network for instance.
Apr 13 16:23:57 user nova-compute[71731]: DEBUG nova.compute.manager [req-3b21e0b2-1ddd-4f08-a5e1-ed2a294421ed req-c2a63ad3-2b56-4c6a-b986-ad7a4463eaa2 service nova] [instance: 0e731607-fce1-4f19-9e4b-5b892e760179] Detach interface failed, port_id=62eabc99-73ed-4669-a7ce-6fc646611ff1, reason: Instance 0e731607-fce1-4f19-9e4b-5b892e760179 could not be found. {{(pid=71731) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 13 16:23:57 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-f6ac84ab-b8ed-49a4-9a7b-e93802271ff2 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:23:57 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-f6ac84ab-b8ed-49a4-9a7b-e93802271ff2 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:23:57 user nova-compute[71731]: DEBUG nova.compute.provider_tree [None req-f6ac84ab-b8ed-49a4-9a7b-e93802271ff2 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Inventory has not changed in ProviderTree for provider: cb6b1a64-0c24-4e2d-af1e-16576ca9165c {{(pid=71731) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 16:23:57 user nova-compute[71731]: DEBUG nova.scheduler.client.report [None req-f6ac84ab-b8ed-49a4-9a7b-e93802271ff2 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Inventory has not changed for provider cb6b1a64-0c24-4e2d-af1e-16576ca9165c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71731) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 16:23:57 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-f6ac84ab-b8ed-49a4-9a7b-e93802271ff2 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.334s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:23:57 user nova-compute[71731]: INFO nova.scheduler.client.report [None req-f6ac84ab-b8ed-49a4-9a7b-e93802271ff2 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Deleted allocations for instance 0e731607-fce1-4f19-9e4b-5b892e760179
Apr 13 16:23:57 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:23:57 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-f6ac84ab-b8ed-49a4-9a7b-e93802271ff2 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Lock "0e731607-fce1-4f19-9e4b-5b892e760179" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.819s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:23:58 user nova-compute[71731]: DEBUG nova.compute.manager [req-f48e12e1-6e4a-4cc9-858d-c6214844785f req-f259246b-15ce-468a-9a56-a0908c2b6b49 service nova] [instance: 0e731607-fce1-4f19-9e4b-5b892e760179] Received event network-vif-plugged-62eabc99-73ed-4669-a7ce-6fc646611ff1 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:23:58 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-f48e12e1-6e4a-4cc9-858d-c6214844785f req-f259246b-15ce-468a-9a56-a0908c2b6b49 service nova] Acquiring lock "0e731607-fce1-4f19-9e4b-5b892e760179-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:23:58 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-f48e12e1-6e4a-4cc9-858d-c6214844785f req-f259246b-15ce-468a-9a56-a0908c2b6b49 service nova] Lock "0e731607-fce1-4f19-9e4b-5b892e760179-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:23:58 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-f48e12e1-6e4a-4cc9-858d-c6214844785f req-f259246b-15ce-468a-9a56-a0908c2b6b49 service nova] Lock "0e731607-fce1-4f19-9e4b-5b892e760179-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:23:58 user nova-compute[71731]: DEBUG nova.compute.manager [req-f48e12e1-6e4a-4cc9-858d-c6214844785f req-f259246b-15ce-468a-9a56-a0908c2b6b49 service nova] [instance: 0e731607-fce1-4f19-9e4b-5b892e760179] No waiting events found dispatching network-vif-plugged-62eabc99-73ed-4669-a7ce-6fc646611ff1 {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:23:58 user nova-compute[71731]: WARNING nova.compute.manager [req-f48e12e1-6e4a-4cc9-858d-c6214844785f req-f259246b-15ce-468a-9a56-a0908c2b6b49 service nova] [instance: 0e731607-fce1-4f19-9e4b-5b892e760179] Received unexpected event network-vif-plugged-62eabc99-73ed-4669-a7ce-6fc646611ff1 for instance with vm_state deleted and task_state None.
Apr 13 16:24:01 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:24:01 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:24:03 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:24:04 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-3f0ba656-5851-47eb-a26c-ef70b92f6885 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Acquiring lock "db65920b-7872-44c1-a68a-a696681d9d95" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:24:04 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-3f0ba656-5851-47eb-a26c-ef70b92f6885 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "db65920b-7872-44c1-a68a-a696681d9d95" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:24:04 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-3f0ba656-5851-47eb-a26c-ef70b92f6885 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Acquiring lock "db65920b-7872-44c1-a68a-a696681d9d95-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:24:04 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-3f0ba656-5851-47eb-a26c-ef70b92f6885 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "db65920b-7872-44c1-a68a-a696681d9d95-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:24:04 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-3f0ba656-5851-47eb-a26c-ef70b92f6885 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "db65920b-7872-44c1-a68a-a696681d9d95-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:24:04 user nova-compute[71731]: INFO nova.compute.manager [None req-3f0ba656-5851-47eb-a26c-ef70b92f6885 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: db65920b-7872-44c1-a68a-a696681d9d95] Terminating instance
Apr 13 16:24:04 user nova-compute[71731]: DEBUG nova.compute.manager [None req-3f0ba656-5851-47eb-a26c-ef70b92f6885 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: db65920b-7872-44c1-a68a-a696681d9d95] Start destroying the instance on the hypervisor. {{(pid=71731) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 16:24:04 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:24:04 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:24:04 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:24:04 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:24:04 user nova-compute[71731]: INFO nova.virt.libvirt.driver [-] [instance: db65920b-7872-44c1-a68a-a696681d9d95] Instance destroyed successfully.
Apr 13 16:24:04 user nova-compute[71731]: DEBUG nova.objects.instance [None req-3f0ba656-5851-47eb-a26c-ef70b92f6885 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lazy-loading 'resources' on Instance uuid db65920b-7872-44c1-a68a-a696681d9d95 {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:24:04 user nova-compute[71731]: DEBUG nova.compute.manager [req-a1e3594d-d928-41e3-a427-2d9a89e024b7 req-394b0fc3-6d14-4480-81ab-8fbbe5f373af service nova] [instance: db65920b-7872-44c1-a68a-a696681d9d95] Received event network-vif-unplugged-ba686724-ae8a-4e16-9918-d7b2fc64ff62 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:24:04 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-a1e3594d-d928-41e3-a427-2d9a89e024b7 req-394b0fc3-6d14-4480-81ab-8fbbe5f373af service nova] Acquiring lock "db65920b-7872-44c1-a68a-a696681d9d95-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:24:04 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-a1e3594d-d928-41e3-a427-2d9a89e024b7 req-394b0fc3-6d14-4480-81ab-8fbbe5f373af service nova] Lock "db65920b-7872-44c1-a68a-a696681d9d95-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:24:04 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-a1e3594d-d928-41e3-a427-2d9a89e024b7 req-394b0fc3-6d14-4480-81ab-8fbbe5f373af service nova] Lock "db65920b-7872-44c1-a68a-a696681d9d95-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:24:04 user nova-compute[71731]: DEBUG nova.compute.manager [req-a1e3594d-d928-41e3-a427-2d9a89e024b7 req-394b0fc3-6d14-4480-81ab-8fbbe5f373af service nova] [instance: db65920b-7872-44c1-a68a-a696681d9d95] No waiting events found dispatching network-vif-unplugged-ba686724-ae8a-4e16-9918-d7b2fc64ff62 {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:24:04 user nova-compute[71731]: DEBUG nova.compute.manager [req-a1e3594d-d928-41e3-a427-2d9a89e024b7 req-394b0fc3-6d14-4480-81ab-8fbbe5f373af service nova] [instance: db65920b-7872-44c1-a68a-a696681d9d95] Received event network-vif-unplugged-ba686724-ae8a-4e16-9918-d7b2fc64ff62 for instance with task_state deleting. {{(pid=71731) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 16:24:04 user nova-compute[71731]: DEBUG nova.virt.libvirt.vif [None req-3f0ba656-5851-47eb-a26c-ef70b92f6885 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T16:22:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-141352368',display_name='tempest-TestVolumeBootPattern-server-141352368',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-141352368',id=13,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-13T16:22:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8d451e0e239f486aa2b3abe9e273eab3',ramdisk_id='',reservation_id='r-sltzshdb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-438786227',owner_user_name='tempest-TestVolumeBootPattern-438786227-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T16:22:31Z,user_data=None,user_id='d70e10f63cdd49a9a1ebe1fe4c9de0a2',uuid=db65920b-7872-44c1-a68a-a696681d9d95,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ba686724-ae8a-4e16-9918-d7b2fc64ff62", "address": "fa:16:3e:87:f9:e7", "network": {"id": "d36bc206-f629-4d6e-8a3f-458061d7b525", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-893271134-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d451e0e239f486aa2b3abe9e273eab3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba686724-ae", "ovs_interfaceid": "ba686724-ae8a-4e16-9918-d7b2fc64ff62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 16:24:04 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-3f0ba656-5851-47eb-a26c-ef70b92f6885 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Converting VIF {"id": "ba686724-ae8a-4e16-9918-d7b2fc64ff62", "address": "fa:16:3e:87:f9:e7", "network": {"id": "d36bc206-f629-4d6e-8a3f-458061d7b525", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-893271134-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d451e0e239f486aa2b3abe9e273eab3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba686724-ae", "ovs_interfaceid": "ba686724-ae8a-4e16-9918-d7b2fc64ff62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 16:24:04 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-3f0ba656-5851-47eb-a26c-ef70b92f6885 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:87:f9:e7,bridge_name='br-int',has_traffic_filtering=True,id=ba686724-ae8a-4e16-9918-d7b2fc64ff62,network=Network(d36bc206-f629-4d6e-8a3f-458061d7b525),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba686724-ae') {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 16:24:04 user nova-compute[71731]: DEBUG os_vif [None req-3f0ba656-5851-47eb-a26c-ef70b92f6885 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:f9:e7,bridge_name='br-int',has_traffic_filtering=True,id=ba686724-ae8a-4e16-9918-d7b2fc64ff62,network=Network(d36bc206-f629-4d6e-8a3f-458061d7b525),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba686724-ae') {{(pid=71731) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 16:24:04 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:24:04 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapba686724-ae, bridge=br-int, if_exists=True) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:24:04 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:24:04 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 16:24:04 user nova-compute[71731]: INFO os_vif [None req-3f0ba656-5851-47eb-a26c-ef70b92f6885 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:f9:e7,bridge_name='br-int',has_traffic_filtering=True,id=ba686724-ae8a-4e16-9918-d7b2fc64ff62,network=Network(d36bc206-f629-4d6e-8a3f-458061d7b525),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba686724-ae')
Apr 13 16:24:04 user nova-compute[71731]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3f0ba656-5851-47eb-a26c-ef70b92f6885 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: db65920b-7872-44c1-a68a-a696681d9d95] calling os-brick to detach iSCSI Volume {{(pid=71731) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 16:24:04 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f0ba656-5851-47eb-a26c-ef70b92f6885 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8cf0118790>, {'target_iqn': 'iqn.2010-10.org.openstack:0e3b49ec-80af-4c38-9689-f7277e495d21', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IdMXZPYO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj': {}}" {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 16:24:04 user nova-compute[71731]: WARNING os_brick.initiator.connectors.base [None req-3f0ba656-5851-47eb-a26c-ef70b92f6885 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 16:24:04 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-3f0ba656-5851-47eb-a26c-ef70b92f6885 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 16:24:04 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-3f0ba656-5851-47eb-a26c-ef70b92f6885 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 16:24:04 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:24:04 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:24:04 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb19bdbc-7323-449f-9690-50a19b24fca6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0e3b49ec-80af-4c38-9689-f7277e495d21\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:24:04 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f0ba656-5851-47eb-a26c-ef70b92f6885 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 16:24:04 user nova-compute[71731]: No targets found.
Apr 13 16:24:04 user nova-compute[71731]: iSNS:
Apr 13 16:24:04 user nova-compute[71731]: No targets found.
Apr 13 16:24:04 user nova-compute[71731]: STATIC:
Apr 13 16:24:04 user nova-compute[71731]: Target: iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97
Apr 13 16:24:04 user nova-compute[71731]:         Portal: 172.16.0.220:3260,-1
Apr 13 16:24:04 user nova-compute[71731]:                 Iface Name: default
Apr 13 16:24:04 user nova-compute[71731]: Target: iqn.2010-10.org.openstack:0e3b49ec-80af-4c38-9689-f7277e495d21
Apr 13 16:24:04 user nova-compute[71731]:         Portal: 172.16.0.220:3260,-1
Apr 13 16:24:04 user nova-compute[71731]:                 Iface Name: default
Apr 13 16:24:04 user nova-compute[71731]: FIRMWARE:
Apr 13 16:24:04 user nova-compute[71731]: No targets found.
Apr 13 16:24:04 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 16:24:04 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f0ba656-5851-47eb-a26c-ef70b92f6885 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 16:24:04 user nova-compute[71731]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 16:24:04 user nova-compute[71731]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71731) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 16:24:04 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f0ba656-5851-47eb-a26c-ef70b92f6885 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0e3b49ec-80af-4c38-9689-f7277e495d21', 0)] {{(pid=71731) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 16:24:04 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:24:04 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:24:04 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d7d7e60-ab50-478c-b172-c5bd9a235080]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0e3b49ec-80af-4c38-9689-f7277e495d21\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:24:04 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:24:04 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:24:04 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[054ddb94-1025-47ad-8d8c-6f07c16f5bdd]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e3b49ec-80af-4c38-9689-f7277e495d21 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:24:04 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f0ba656-5851-47eb-a26c-ef70b92f6885 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e3b49ec-80af-4c38-9689-f7277e495d21 (non-flash)
Apr 13 16:24:04 user nova-compute[71731]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)
Apr 13 16:24:04 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 16:24:04 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f0ba656-5851-47eb-a26c-ef70b92f6885 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e3b49ec-80af-4c38-9689-f7277e495d21 (non-flash)
Apr 13 16:24:04 user nova-compute[71731]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)
Apr 13 16:24:04 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 16:24:04 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f0ba656-5851-47eb-a26c-ef70b92f6885 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8cf00e56c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0e3b49ec-80af-4c38-9689-f7277e495d21'): ({'sdj'}, set())}) {{(pid=71731) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 16:24:04 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-3f0ba656-5851-47eb-a26c-ef70b92f6885 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Removing single pathed devices sdj {{(pid=71731) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 16:24:04 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:24:05 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:24:05 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[63ffa2ad-a819-4f72-ae60-cf9672000afc]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:24:05 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdj {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:24:05 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdj" returned: 0 in 0.019s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:24:05 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[03f506b1-ef2a-42b3-8be8-acbecae4d422]: (4, ('ok\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:24:05 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-3f0ba656-5851-47eb-a26c-ef70b92f6885 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Flushing IO for device /dev/sdj {{(pid=71731) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 16:24:05 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdj {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:24:05 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdj" returned: 0 in 0.014s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:24:05 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[24493816-975c-4793-9c71-a4377d5de3c4]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:24:05 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-3f0ba656-5851-47eb-a26c-ef70b92f6885 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=71731) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 16:24:05 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdj/device/delete {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:24:05 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdj/device/delete" returned: 0 in 0.053s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:24:05 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[a98bf157-3d75-4167-af70-1bc0209f0412]: (4, ('1', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:24:05 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-3f0ba656-5851-47eb-a26c-ef70b92f6885 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Checking to see if SCSI volumes sdj have been removed. {{(pid=71731) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 16:24:05 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-3f0ba656-5851-47eb-a26c-ef70b92f6885 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] SCSI volumes sdj have been removed. {{(pid=71731) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 16:24:05 user nova-compute[71731]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23664333333336130', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_bdd99205', '/dev/disk/by-id/scsi-1SCST_BIObdd99205-6d3333a0e35469bc') {{(pid=81776) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Apr 13 16:24:05 user nova-compute[71731]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-23664333333336130
Apr 13 16:24:05 user nova-compute[71731]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_bdd99205
Apr 13 16:24:05 user nova-compute[71731]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIObdd99205-6d3333a0e35469bc
Apr 13 16:24:05 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc10d1e8-56cf-4fdd-8563-c0d5ce7a36ff]: (4, None) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:24:05 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f0ba656-5851-47eb-a26c-ef70b92f6885 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0e3b49ec-80af-4c38-9689-f7277e495d21')] {{(pid=71731) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 16:24:05 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e3b49ec-80af-4c38-9689-f7277e495d21 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:24:05 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e3b49ec-80af-4c38-9689-f7277e495d21 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:24:05 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[64155da1-82de-4272-8d6e-d94c70fc22fd]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:24:05 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f0ba656-5851-47eb-a26c-ef70b92f6885 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:24:05 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e3b49ec-80af-4c38-9689-f7277e495d21 -p 172.16.0.220:3260 --logout {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:24:05 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e3b49ec-80af-4c38-9689-f7277e495d21 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:24:05 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[c191513e-56ee-4d9b-84ae-119a85391b53]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:0e3b49ec-80af-4c38-9689-f7277e495d21, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:0e3b49ec-80af-4c38-9689-f7277e495d21, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:24:05 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f0ba656-5851-47eb-a26c-ef70b92f6885 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:0e3b49ec-80af-4c38-9689-f7277e495d21, portal: 172.16.0.220,3260]
Apr 13 16:24:05 user nova-compute[71731]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:0e3b49ec-80af-4c38-9689-f7277e495d21, portal: 172.16.0.220,3260] successful.
Apr 13 16:24:05 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:24:05 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e3b49ec-80af-4c38-9689-f7277e495d21 -p 172.16.0.220:3260 --op delete {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:24:05 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e3b49ec-80af-4c38-9689-f7277e495d21 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:24:05 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[e70b02d4-448c-469d-8854-7e0435e7f0da]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:24:05 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f0ba656-5851-47eb-a26c-ef70b92f6885 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:24:05 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-3f0ba656-5851-47eb-a26c-ef70b92f6885 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.344s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 16:24:05 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f0ba656-5851-47eb-a26c-ef70b92f6885 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] <== disconnect_volume: return (346ms) None {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 16:24:05 user nova-compute[71731]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3f0ba656-5851-47eb-a26c-ef70b92f6885 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: db65920b-7872-44c1-a68a-a696681d9d95] Disconnected iSCSI Volume {{(pid=71731) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 16:24:05 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-3f0ba656-5851-47eb-a26c-ef70b92f6885 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: db65920b-7872-44c1-a68a-a696681d9d95] Deleting instance files /opt/stack/data/nova/instances/db65920b-7872-44c1-a68a-a696681d9d95_del
Apr 13 16:24:05 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-3f0ba656-5851-47eb-a26c-ef70b92f6885 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: db65920b-7872-44c1-a68a-a696681d9d95] Deletion of /opt/stack/data/nova/instances/db65920b-7872-44c1-a68a-a696681d9d95_del complete
Apr 13 16:24:05 user nova-compute[71731]: INFO nova.compute.manager [None req-3f0ba656-5851-47eb-a26c-ef70b92f6885 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: db65920b-7872-44c1-a68a-a696681d9d95] Took 1.19 seconds to destroy the instance on the hypervisor.
Apr 13 16:24:05 user nova-compute[71731]: DEBUG oslo.service.loopingcall [None req-3f0ba656-5851-47eb-a26c-ef70b92f6885 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71731) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 16:24:05 user nova-compute[71731]: DEBUG nova.compute.manager [-] [instance: db65920b-7872-44c1-a68a-a696681d9d95] Deallocating network for instance {{(pid=71731) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 16:24:05 user nova-compute[71731]: DEBUG nova.network.neutron [-] [instance: db65920b-7872-44c1-a68a-a696681d9d95] deallocate_for_instance() {{(pid=71731) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 16:24:05 user nova-compute[71731]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681403030.3980927, 031c7939-a53c-4f7d-9f36-4ec1d06e2717 => Stopped> {{(pid=71731) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 16:24:05 user nova-compute[71731]: INFO nova.compute.manager [-] [instance: 031c7939-a53c-4f7d-9f36-4ec1d06e2717] VM Stopped (Lifecycle Event)
Apr 13 16:24:05 user nova-compute[71731]: DEBUG nova.compute.manager [None req-7737957e-5889-438a-b695-b39698f3c369 None None] [instance: 031c7939-a53c-4f7d-9f36-4ec1d06e2717] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:24:06 user nova-compute[71731]: DEBUG nova.network.neutron [-] [instance: db65920b-7872-44c1-a68a-a696681d9d95] Updating instance_info_cache with network_info: [] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:24:06 user nova-compute[71731]: INFO nova.compute.manager [-] [instance: db65920b-7872-44c1-a68a-a696681d9d95] Took 0.80 seconds to deallocate network for instance.
Apr 13 16:24:06 user nova-compute[71731]: DEBUG nova.compute.manager [req-36a398f5-4a05-4d85-96fb-5387b4439495 req-4cd6ba7e-f243-4c69-ad87-43e4f8287b24 service nova] [instance: db65920b-7872-44c1-a68a-a696681d9d95] Received event network-vif-deleted-ba686724-ae8a-4e16-9918-d7b2fc64ff62 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:24:06 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:24:06 user nova-compute[71731]: INFO nova.compute.manager [None req-3f0ba656-5851-47eb-a26c-ef70b92f6885 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: db65920b-7872-44c1-a68a-a696681d9d95] Took 0.79 seconds to detach 1 volumes for instance.
Apr 13 16:24:06 user nova-compute[71731]: DEBUG nova.compute.manager [None req-3f0ba656-5851-47eb-a26c-ef70b92f6885 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: db65920b-7872-44c1-a68a-a696681d9d95] Deleting volume: 0e3b49ec-80af-4c38-9689-f7277e495d21 {{(pid=71731) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3202}}
Apr 13 16:24:06 user nova-compute[71731]: DEBUG nova.compute.manager [req-b7551a9b-3bd6-4ca2-aa6a-9c09a4835123 req-1faea2d3-7ffe-42bc-967c-01f0f427d148 service nova] [instance: db65920b-7872-44c1-a68a-a696681d9d95] Received event network-vif-plugged-ba686724-ae8a-4e16-9918-d7b2fc64ff62 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:24:06 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-b7551a9b-3bd6-4ca2-aa6a-9c09a4835123 req-1faea2d3-7ffe-42bc-967c-01f0f427d148 service nova] Acquiring lock "db65920b-7872-44c1-a68a-a696681d9d95-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:24:06 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-b7551a9b-3bd6-4ca2-aa6a-9c09a4835123 req-1faea2d3-7ffe-42bc-967c-01f0f427d148 service nova] Lock "db65920b-7872-44c1-a68a-a696681d9d95-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:24:06 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-b7551a9b-3bd6-4ca2-aa6a-9c09a4835123 req-1faea2d3-7ffe-42bc-967c-01f0f427d148 service nova] Lock "db65920b-7872-44c1-a68a-a696681d9d95-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:24:06 user nova-compute[71731]: DEBUG nova.compute.manager [req-b7551a9b-3bd6-4ca2-aa6a-9c09a4835123 req-1faea2d3-7ffe-42bc-967c-01f0f427d148 service nova] [instance: db65920b-7872-44c1-a68a-a696681d9d95] No waiting events found dispatching network-vif-plugged-ba686724-ae8a-4e16-9918-d7b2fc64ff62 {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:24:06 user nova-compute[71731]: WARNING nova.compute.manager [req-b7551a9b-3bd6-4ca2-aa6a-9c09a4835123 req-1faea2d3-7ffe-42bc-967c-01f0f427d148 service nova] [instance: db65920b-7872-44c1-a68a-a696681d9d95] Received unexpected event network-vif-plugged-ba686724-ae8a-4e16-9918-d7b2fc64ff62 for instance with vm_state active and task_state deleting.
Apr 13 16:24:07 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager.update_available_resource {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:24:07 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:24:07 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:24:07 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:24:07 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Auditing locally available compute resources for user (node: user) {{(pid=71731) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 16:24:07 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-3f0ba656-5851-47eb-a26c-ef70b92f6885 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:24:07 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-3f0ba656-5851-47eb-a26c-ef70b92f6885 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:24:07 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:24:07 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a2b8c9-388d-454c-88a1-54d7a8506511/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:24:07 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a2b8c9-388d-454c-88a1-54d7a8506511/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:24:07 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a2b8c9-388d-454c-88a1-54d7a8506511/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:24:07 user nova-compute[71731]: DEBUG nova.compute.provider_tree [None req-3f0ba656-5851-47eb-a26c-ef70b92f6885 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Inventory has not changed in ProviderTree for provider: cb6b1a64-0c24-4e2d-af1e-16576ca9165c {{(pid=71731) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 16:24:07 user nova-compute[71731]: DEBUG nova.scheduler.client.report [None req-3f0ba656-5851-47eb-a26c-ef70b92f6885 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Inventory has not changed for provider cb6b1a64-0c24-4e2d-af1e-16576ca9165c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71731) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 16:24:07 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-3f0ba656-5851-47eb-a26c-ef70b92f6885 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.398s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:24:07 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a2b8c9-388d-454c-88a1-54d7a8506511/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:24:07 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acbcaee0-a47b-4fee-8765-9b1c9597d515/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:24:07 user nova-compute[71731]: INFO nova.scheduler.client.report [None req-3f0ba656-5851-47eb-a26c-ef70b92f6885 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Deleted allocations for instance db65920b-7872-44c1-a68a-a696681d9d95
Apr 13 16:24:07 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-3f0ba656-5851-47eb-a26c-ef70b92f6885 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "db65920b-7872-44c1-a68a-a696681d9d95" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.555s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:24:07 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acbcaee0-a47b-4fee-8765-9b1c9597d515/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:24:07 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acbcaee0-a47b-4fee-8765-9b1c9597d515/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:24:07 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acbcaee0-a47b-4fee-8765-9b1c9597d515/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:24:07 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7973e93b-6311-44ed-91ff-e861c32d0277/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:24:07 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7973e93b-6311-44ed-91ff-e861c32d0277/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:24:07 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7973e93b-6311-44ed-91ff-e861c32d0277/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:24:08 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7973e93b-6311-44ed-91ff-e861c32d0277/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:24:08 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66553f5-5e1b-4f1d-8c5a-63bc340f7586/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:24:08 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66553f5-5e1b-4f1d-8c5a-63bc340f7586/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:24:08 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66553f5-5e1b-4f1d-8c5a-63bc340f7586/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:24:08 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66553f5-5e1b-4f1d-8c5a-63bc340f7586/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:24:08 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbcccf4b-e861-4254-9be3-a491776214e9/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:24:08 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbcccf4b-e861-4254-9be3-a491776214e9/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:24:08 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbcccf4b-e861-4254-9be3-a491776214e9/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:24:08 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbcccf4b-e861-4254-9be3-a491776214e9/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:24:08 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71731) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 16:24:08 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5db1cb51-2e5a-46c9-8914-cba759a96a65/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:24:08 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5db1cb51-2e5a-46c9-8914-cba759a96a65/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:24:08 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5db1cb51-2e5a-46c9-8914-cba759a96a65/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:24:09 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5db1cb51-2e5a-46c9-8914-cba759a96a65/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:24:09 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c6d8096-853b-4091-ad82-6faf8ffc85fa/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:24:09 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c6d8096-853b-4091-ad82-6faf8ffc85fa/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:24:09 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c6d8096-853b-4091-ad82-6faf8ffc85fa/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:24:09 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c6d8096-853b-4091-ad82-6faf8ffc85fa/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:24:09 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:24:09 user nova-compute[71731]: WARNING nova.virt.libvirt.driver [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 16:24:09 user nova-compute[71731]: WARNING nova.virt.libvirt.driver [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 16:24:09 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Hypervisor/Node resource view: name=user free_ram=7770MB free_disk=26.391769409179688GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71731) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 16:24:09 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:24:09 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:24:10 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance 7973e93b-6311-44ed-91ff-e861c32d0277 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 16:24:10 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance f66553f5-5e1b-4f1d-8c5a-63bc340f7586 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 16:24:10 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance bbcccf4b-e861-4254-9be3-a491776214e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 16:24:10 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance 5db1cb51-2e5a-46c9-8914-cba759a96a65 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 16:24:10 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance 8c6d8096-853b-4091-ad82-6faf8ffc85fa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 16:24:10 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance 235f827c-7116-48e9-84c5-0c9761c18e1e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 16:24:10 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance 94a2b8c9-388d-454c-88a1-54d7a8506511 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 16:24:10 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance acbcaee0-a47b-4fee-8765-9b1c9597d515 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 16:24:10 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=71731) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 16:24:10 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Final resource view: name=user phys_ram=16023MB used_ram=1536MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=71731) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 16:24:10 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-9f9e25f5-a684-48b1-9aab-64ad24829115 tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] Acquiring lock "8c6d8096-853b-4091-ad82-6faf8ffc85fa" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:24:10 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-9f9e25f5-a684-48b1-9aab-64ad24829115 tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] Lock "8c6d8096-853b-4091-ad82-6faf8ffc85fa" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:24:10 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-9f9e25f5-a684-48b1-9aab-64ad24829115 tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] Acquiring lock "8c6d8096-853b-4091-ad82-6faf8ffc85fa-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:24:10 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-9f9e25f5-a684-48b1-9aab-64ad24829115 tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] Lock "8c6d8096-853b-4091-ad82-6faf8ffc85fa-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:24:10 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-9f9e25f5-a684-48b1-9aab-64ad24829115 tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] Lock "8c6d8096-853b-4091-ad82-6faf8ffc85fa-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:24:10 user nova-compute[71731]: INFO nova.compute.manager [None req-9f9e25f5-a684-48b1-9aab-64ad24829115 tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] [instance: 8c6d8096-853b-4091-ad82-6faf8ffc85fa] Terminating instance
Apr 13 16:24:10 user nova-compute[71731]: DEBUG nova.compute.manager [None req-9f9e25f5-a684-48b1-9aab-64ad24829115 tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] [instance: 8c6d8096-853b-4091-ad82-6faf8ffc85fa] Start destroying the instance on the hypervisor. {{(pid=71731) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 16:24:10 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:24:10 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:24:10 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:24:10 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:24:10 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:24:10 user nova-compute[71731]: DEBUG nova.compute.provider_tree [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Inventory has not changed in ProviderTree for provider: cb6b1a64-0c24-4e2d-af1e-16576ca9165c {{(pid=71731) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 16:24:10 user nova-compute[71731]: DEBUG nova.scheduler.client.report [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Inventory has not changed for provider cb6b1a64-0c24-4e2d-af1e-16576ca9165c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71731) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 16:24:10 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Compute_service record updated for user:user {{(pid=71731) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 16:24:10 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.504s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:24:10 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-cd45ef09-4353-465c-916c-11a3a2c2eb68 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Acquiring lock "eaae47b9-a059-49f6-9ae6-d7147003e2f2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:24:10 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-cd45ef09-4353-465c-916c-11a3a2c2eb68 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lock "eaae47b9-a059-49f6-9ae6-d7147003e2f2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:24:10 user nova-compute[71731]: DEBUG nova.compute.manager [None req-cd45ef09-4353-465c-916c-11a3a2c2eb68 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] [instance: eaae47b9-a059-49f6-9ae6-d7147003e2f2] Starting instance... {{(pid=71731) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 16:24:10 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-cd45ef09-4353-465c-916c-11a3a2c2eb68 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:24:10 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-cd45ef09-4353-465c-916c-11a3a2c2eb68 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:24:10 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-cd45ef09-4353-465c-916c-11a3a2c2eb68 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71731) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 16:24:10 user nova-compute[71731]: INFO nova.compute.claims [None req-cd45ef09-4353-465c-916c-11a3a2c2eb68 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] [instance: eaae47b9-a059-49f6-9ae6-d7147003e2f2] Claim successful on node user
Apr 13 16:24:10 user nova-compute[71731]: DEBUG nova.compute.manager [req-4b8922e3-78a5-48c5-9deb-a87e2af82409 req-7a9cb36d-8f08-4b05-a68b-7800c3ca4fd1 service nova] [instance: 8c6d8096-853b-4091-ad82-6faf8ffc85fa] Received event network-vif-unplugged-385dec44-4145-4606-b0af-30fbc721eb2c {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:24:10 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-4b8922e3-78a5-48c5-9deb-a87e2af82409 req-7a9cb36d-8f08-4b05-a68b-7800c3ca4fd1 service nova] Acquiring lock "8c6d8096-853b-4091-ad82-6faf8ffc85fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:24:10 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-4b8922e3-78a5-48c5-9deb-a87e2af82409 req-7a9cb36d-8f08-4b05-a68b-7800c3ca4fd1 service nova] Lock "8c6d8096-853b-4091-ad82-6faf8ffc85fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:24:10 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-4b8922e3-78a5-48c5-9deb-a87e2af82409 req-7a9cb36d-8f08-4b05-a68b-7800c3ca4fd1 service nova] Lock "8c6d8096-853b-4091-ad82-6faf8ffc85fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:24:10 user nova-compute[71731]: DEBUG nova.compute.manager [req-4b8922e3-78a5-48c5-9deb-a87e2af82409 req-7a9cb36d-8f08-4b05-a68b-7800c3ca4fd1 service nova] [instance: 8c6d8096-853b-4091-ad82-6faf8ffc85fa] No waiting events found dispatching network-vif-unplugged-385dec44-4145-4606-b0af-30fbc721eb2c {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:24:10 user nova-compute[71731]: DEBUG nova.compute.manager [req-4b8922e3-78a5-48c5-9deb-a87e2af82409 req-7a9cb36d-8f08-4b05-a68b-7800c3ca4fd1 service nova] [instance: 8c6d8096-853b-4091-ad82-6faf8ffc85fa] Received event network-vif-unplugged-385dec44-4145-4606-b0af-30fbc721eb2c for instance with task_state deleting. {{(pid=71731) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 16:24:10 user nova-compute[71731]: INFO nova.virt.libvirt.driver [-] [instance: 8c6d8096-853b-4091-ad82-6faf8ffc85fa] Instance destroyed successfully.
Apr 13 16:24:10 user nova-compute[71731]: DEBUG nova.objects.instance [None req-9f9e25f5-a684-48b1-9aab-64ad24829115 tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] Lazy-loading 'resources' on Instance uuid 8c6d8096-853b-4091-ad82-6faf8ffc85fa {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:24:11 user nova-compute[71731]: DEBUG nova.virt.libvirt.vif [None req-9f9e25f5-a684-48b1-9aab-64ad24829115 tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T16:20:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1610258271',display_name='tempest-TestVolumeSwap-server-1610258271',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1610258271',id=7,image_ref='708622a9-7465-4492-ade8-b827198f7e30',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBWY8/7V40qoMYXykoaVvCoJjrpmcKaWXZmsd/8+Lb8oyd/Yg0tsO1LpDqufWXWHL1gAGa6iD4duZNpIqxl7Bq6NQSSW0wh5DQqKcPrR1DjWUD1wKrr8S3Bqu6djvLW5dQ==',key_name='tempest-keypair-1417187439',keypairs=<?>,launch_index=0,launched_at=2023-04-13T16:21:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dc3e2169a6c44d05b2a2eedbe3a063cb',ramdisk_id='',reservation_id='r-45cbj23p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='708622a9-7465-4492-ade8-b827198f7e30',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-2131472698',owner_user_name='tempest-TestVolumeSwap-2131472698-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T16:21:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='25b5e87b35e0471cafe541fdf224b5bd',uuid=8c6d8096-853b-4091-ad82-6faf8ffc85fa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "385dec44-4145-4606-b0af-30fbc721eb2c", "address": "fa:16:3e:93:4c:5a", "network": {"id": "dcb487d2-a611-4040-903e-8e1c9c496e02", "bridge": "br-int", "label": "tempest-TestVolumeSwap-309336155-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.156", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc3e2169a6c44d05b2a2eedbe3a063cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap385dec44-41", "ovs_interfaceid": "385dec44-4145-4606-b0af-30fbc721eb2c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 16:24:11 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-9f9e25f5-a684-48b1-9aab-64ad24829115 tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] Converting VIF {"id": "385dec44-4145-4606-b0af-30fbc721eb2c", "address": "fa:16:3e:93:4c:5a", "network": {"id": "dcb487d2-a611-4040-903e-8e1c9c496e02", "bridge": "br-int", "label": "tempest-TestVolumeSwap-309336155-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.156", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc3e2169a6c44d05b2a2eedbe3a063cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap385dec44-41", "ovs_interfaceid": "385dec44-4145-4606-b0af-30fbc721eb2c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 16:24:11 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-9f9e25f5-a684-48b1-9aab-64ad24829115 tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:93:4c:5a,bridge_name='br-int',has_traffic_filtering=True,id=385dec44-4145-4606-b0af-30fbc721eb2c,network=Network(dcb487d2-a611-4040-903e-8e1c9c496e02),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap385dec44-41') {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 16:24:11 user nova-compute[71731]: DEBUG os_vif [None req-9f9e25f5-a684-48b1-9aab-64ad24829115 tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:93:4c:5a,bridge_name='br-int',has_traffic_filtering=True,id=385dec44-4145-4606-b0af-30fbc721eb2c,network=Network(dcb487d2-a611-4040-903e-8e1c9c496e02),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap385dec44-41') {{(pid=71731) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 16:24:11 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:24:11 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap385dec44-41, bridge=br-int, if_exists=True) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:24:11 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 16:24:11 user nova-compute[71731]: DEBUG nova.compute.provider_tree [None req-cd45ef09-4353-465c-916c-11a3a2c2eb68 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Inventory has not changed in ProviderTree for provider: cb6b1a64-0c24-4e2d-af1e-16576ca9165c {{(pid=71731) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 16:24:11 user nova-compute[71731]: INFO os_vif [None req-9f9e25f5-a684-48b1-9aab-64ad24829115 tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:93:4c:5a,bridge_name='br-int',has_traffic_filtering=True,id=385dec44-4145-4606-b0af-30fbc721eb2c,network=Network(dcb487d2-a611-4040-903e-8e1c9c496e02),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap385dec44-41')
Apr 13 16:24:11 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-9f9e25f5-a684-48b1-9aab-64ad24829115 tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] [instance: 8c6d8096-853b-4091-ad82-6faf8ffc85fa] Deleting instance files /opt/stack/data/nova/instances/8c6d8096-853b-4091-ad82-6faf8ffc85fa_del
Apr 13 16:24:11 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-9f9e25f5-a684-48b1-9aab-64ad24829115 tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] [instance: 8c6d8096-853b-4091-ad82-6faf8ffc85fa] Deletion of /opt/stack/data/nova/instances/8c6d8096-853b-4091-ad82-6faf8ffc85fa_del complete
Apr 13 16:24:11 user nova-compute[71731]: DEBUG nova.scheduler.client.report [None req-cd45ef09-4353-465c-916c-11a3a2c2eb68 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Inventory has not changed for provider cb6b1a64-0c24-4e2d-af1e-16576ca9165c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71731) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 16:24:11 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-cd45ef09-4353-465c-916c-11a3a2c2eb68 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.456s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:24:11 user nova-compute[71731]: DEBUG nova.compute.manager [None req-cd45ef09-4353-465c-916c-11a3a2c2eb68 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] [instance: eaae47b9-a059-49f6-9ae6-d7147003e2f2] Start building networks asynchronously for instance. {{(pid=71731) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 16:24:11 user nova-compute[71731]: INFO nova.compute.manager [None req-9f9e25f5-a684-48b1-9aab-64ad24829115 tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] [instance: 8c6d8096-853b-4091-ad82-6faf8ffc85fa] Took 0.92 seconds to destroy the instance on the hypervisor.
Apr 13 16:24:11 user nova-compute[71731]: DEBUG oslo.service.loopingcall [None req-9f9e25f5-a684-48b1-9aab-64ad24829115 tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71731) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 16:24:11 user nova-compute[71731]: DEBUG nova.compute.manager [-] [instance: 8c6d8096-853b-4091-ad82-6faf8ffc85fa] Deallocating network for instance {{(pid=71731) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 16:24:11 user nova-compute[71731]: DEBUG nova.network.neutron [-] [instance: 8c6d8096-853b-4091-ad82-6faf8ffc85fa] deallocate_for_instance() {{(pid=71731) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 16:24:11 user nova-compute[71731]: DEBUG nova.compute.manager [None req-cd45ef09-4353-465c-916c-11a3a2c2eb68 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] [instance: eaae47b9-a059-49f6-9ae6-d7147003e2f2] Allocating IP information in the background. {{(pid=71731) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 16:24:11 user nova-compute[71731]: DEBUG nova.network.neutron [None req-cd45ef09-4353-465c-916c-11a3a2c2eb68 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] [instance: eaae47b9-a059-49f6-9ae6-d7147003e2f2] allocate_for_instance() {{(pid=71731) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 16:24:11 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-cd45ef09-4353-465c-916c-11a3a2c2eb68 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] [instance: eaae47b9-a059-49f6-9ae6-d7147003e2f2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 16:24:11 user nova-compute[71731]: DEBUG nova.compute.manager [None req-cd45ef09-4353-465c-916c-11a3a2c2eb68 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] [instance: eaae47b9-a059-49f6-9ae6-d7147003e2f2] Start building block device mappings for instance. {{(pid=71731) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 16:24:11 user nova-compute[71731]: DEBUG nova.policy [None req-cd45ef09-4353-465c-916c-11a3a2c2eb68 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '47fab402fb794a5a9281cfb7fe188813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24904988cf334657b084fd726c7ecf8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71731) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 16:24:11 user nova-compute[71731]: DEBUG nova.compute.manager [None req-cd45ef09-4353-465c-916c-11a3a2c2eb68 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] [instance: eaae47b9-a059-49f6-9ae6-d7147003e2f2] Start spawning the instance on the hypervisor. {{(pid=71731) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 16:24:11 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-cd45ef09-4353-465c-916c-11a3a2c2eb68 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] [instance: eaae47b9-a059-49f6-9ae6-d7147003e2f2] Creating instance directory {{(pid=71731) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 16:24:11 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-cd45ef09-4353-465c-916c-11a3a2c2eb68 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] [instance: eaae47b9-a059-49f6-9ae6-d7147003e2f2] Creating image(s)
Apr 13 16:24:11 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-cd45ef09-4353-465c-916c-11a3a2c2eb68 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Acquiring lock "/opt/stack/data/nova/instances/eaae47b9-a059-49f6-9ae6-d7147003e2f2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:24:11 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-cd45ef09-4353-465c-916c-11a3a2c2eb68 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lock "/opt/stack/data/nova/instances/eaae47b9-a059-49f6-9ae6-d7147003e2f2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:24:11 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-cd45ef09-4353-465c-916c-11a3a2c2eb68 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lock "/opt/stack/data/nova/instances/eaae47b9-a059-49f6-9ae6-d7147003e2f2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:24:11 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-cd45ef09-4353-465c-916c-11a3a2c2eb68 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279 --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:24:11 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:24:11 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:24:11 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:24:11 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Starting heal instance info cache {{(pid=71731) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 16:24:11 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-cd45ef09-4353-465c-916c-11a3a2c2eb68 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279 --force-share --output=json" returned: 0 in 0.145s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:24:11 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-cd45ef09-4353-465c-916c-11a3a2c2eb68 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Acquiring lock "9524227dd898575c3099d3976f096cd935414279" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:24:11 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-cd45ef09-4353-465c-916c-11a3a2c2eb68 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lock "9524227dd898575c3099d3976f096cd935414279" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:24:11 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-cd45ef09-4353-465c-916c-11a3a2c2eb68 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279 --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:24:11 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Acquiring lock "refresh_cache-5db1cb51-2e5a-46c9-8914-cba759a96a65" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 16:24:11 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Acquired lock "refresh_cache-5db1cb51-2e5a-46c9-8914-cba759a96a65" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 16:24:11 user nova-compute[71731]: DEBUG nova.network.neutron [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] [instance: 5db1cb51-2e5a-46c9-8914-cba759a96a65] Forcefully refreshing network info cache for instance {{(pid=71731) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 16:24:11 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-cd45ef09-4353-465c-916c-11a3a2c2eb68 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279 --force-share --output=json" returned: 0 in 0.138s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:24:11 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-cd45ef09-4353-465c-916c-11a3a2c2eb68 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279,backing_fmt=raw /opt/stack/data/nova/instances/eaae47b9-a059-49f6-9ae6-d7147003e2f2/disk 1073741824 {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:24:11 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-cd45ef09-4353-465c-916c-11a3a2c2eb68 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279,backing_fmt=raw /opt/stack/data/nova/instances/eaae47b9-a059-49f6-9ae6-d7147003e2f2/disk 1073741824" returned: 0 in 0.051s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:24:11 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-cd45ef09-4353-465c-916c-11a3a2c2eb68 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lock "9524227dd898575c3099d3976f096cd935414279" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.196s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:24:11 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-cd45ef09-4353-465c-916c-11a3a2c2eb68 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279 --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:24:11 user nova-compute[71731]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681403036.7563372, 0e731607-fce1-4f19-9e4b-5b892e760179 => Stopped> {{(pid=71731) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 16:24:11 user nova-compute[71731]: INFO nova.compute.manager [-] [instance: 0e731607-fce1-4f19-9e4b-5b892e760179] VM Stopped (Lifecycle Event)
Apr 13 16:24:11 user nova-compute[71731]: DEBUG nova.compute.manager [None req-9f5318a0-aea7-4ed6-bd1e-bda4fc404b8e None None] [instance: 0e731607-fce1-4f19-9e4b-5b892e760179] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:24:11 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-cd45ef09-4353-465c-916c-11a3a2c2eb68 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279 --force-share --output=json" returned: 0 in 0.152s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:24:11 user nova-compute[71731]: DEBUG nova.virt.disk.api [None req-cd45ef09-4353-465c-916c-11a3a2c2eb68 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Checking if we can resize image /opt/stack/data/nova/instances/eaae47b9-a059-49f6-9ae6-d7147003e2f2/disk. size=1073741824 {{(pid=71731) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 16:24:11 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-cd45ef09-4353-465c-916c-11a3a2c2eb68 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eaae47b9-a059-49f6-9ae6-d7147003e2f2/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:24:11 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-cd45ef09-4353-465c-916c-11a3a2c2eb68 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eaae47b9-a059-49f6-9ae6-d7147003e2f2/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:24:11 user nova-compute[71731]: DEBUG nova.virt.disk.api [None req-cd45ef09-4353-465c-916c-11a3a2c2eb68 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Cannot resize image /opt/stack/data/nova/instances/eaae47b9-a059-49f6-9ae6-d7147003e2f2/disk to a smaller size. {{(pid=71731) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 16:24:11 user nova-compute[71731]: DEBUG nova.objects.instance [None req-cd45ef09-4353-465c-916c-11a3a2c2eb68 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lazy-loading 'migration_context' on Instance uuid eaae47b9-a059-49f6-9ae6-d7147003e2f2 {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:24:12 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-cd45ef09-4353-465c-916c-11a3a2c2eb68 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] [instance: eaae47b9-a059-49f6-9ae6-d7147003e2f2] Created local disks {{(pid=71731) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 16:24:12 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-cd45ef09-4353-465c-916c-11a3a2c2eb68 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] [instance: eaae47b9-a059-49f6-9ae6-d7147003e2f2] Ensure instance console log exists: /opt/stack/data/nova/instances/eaae47b9-a059-49f6-9ae6-d7147003e2f2/console.log {{(pid=71731) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 16:24:12 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-cd45ef09-4353-465c-916c-11a3a2c2eb68 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:24:12 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-cd45ef09-4353-465c-916c-11a3a2c2eb68 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:24:12 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-cd45ef09-4353-465c-916c-11a3a2c2eb68 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:24:12 user nova-compute[71731]: DEBUG nova.network.neutron [None req-cd45ef09-4353-465c-916c-11a3a2c2eb68 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] [instance: eaae47b9-a059-49f6-9ae6-d7147003e2f2] Successfully created port: e9b2fcaa-f77b-4e5c-ad3c-797ce804a9ae {{(pid=71731) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 16:24:12 user nova-compute[71731]: DEBUG nova.network.neutron [-] [instance: 8c6d8096-853b-4091-ad82-6faf8ffc85fa] Updating instance_info_cache with network_info: [] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:24:12 user nova-compute[71731]: INFO nova.compute.manager [-] [instance: 8c6d8096-853b-4091-ad82-6faf8ffc85fa] Took 1.69 seconds to deallocate network for instance.
Apr 13 16:24:12 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-9f9e25f5-a684-48b1-9aab-64ad24829115 tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:24:12 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-9f9e25f5-a684-48b1-9aab-64ad24829115 tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:24:12 user nova-compute[71731]: DEBUG nova.network.neutron [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] [instance: 5db1cb51-2e5a-46c9-8914-cba759a96a65] Updating instance_info_cache with network_info: [{"id": "628a1eb7-e3f1-4158-9f9e-1ae752c91c0b", "address": "fa:16:3e:fa:44:3c", "network": {"id": "fc7f5f86-d676-4a45-b0f4-c93f3eae043e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1421861184-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.129", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ded8a69b7e941f9bcdc502cfeed79db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap628a1eb7-e3", "ovs_interfaceid": "628a1eb7-e3f1-4158-9f9e-1ae752c91c0b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:24:12 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Releasing lock "refresh_cache-5db1cb51-2e5a-46c9-8914-cba759a96a65" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 16:24:12 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] [instance: 5db1cb51-2e5a-46c9-8914-cba759a96a65] Updated the network info_cache for instance {{(pid=71731) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 16:24:12 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:24:12 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:24:12 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:24:12 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:24:12 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:24:12 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:24:12 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71731) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 16:24:13 user nova-compute[71731]: DEBUG nova.compute.manager [req-63931994-bd38-48bc-92d0-bc5593969d2c req-45373634-1ecc-44f5-8787-215454a31626 service nova] [instance: 8c6d8096-853b-4091-ad82-6faf8ffc85fa] Received event network-vif-plugged-385dec44-4145-4606-b0af-30fbc721eb2c {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:24:13 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-63931994-bd38-48bc-92d0-bc5593969d2c req-45373634-1ecc-44f5-8787-215454a31626 service nova] Acquiring lock "8c6d8096-853b-4091-ad82-6faf8ffc85fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:24:13 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-63931994-bd38-48bc-92d0-bc5593969d2c req-45373634-1ecc-44f5-8787-215454a31626 service nova] Lock "8c6d8096-853b-4091-ad82-6faf8ffc85fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:24:13 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-63931994-bd38-48bc-92d0-bc5593969d2c req-45373634-1ecc-44f5-8787-215454a31626 service nova] Lock "8c6d8096-853b-4091-ad82-6faf8ffc85fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:24:13 user nova-compute[71731]: DEBUG nova.compute.manager [req-63931994-bd38-48bc-92d0-bc5593969d2c req-45373634-1ecc-44f5-8787-215454a31626 service nova] [instance: 8c6d8096-853b-4091-ad82-6faf8ffc85fa] No waiting events found dispatching network-vif-plugged-385dec44-4145-4606-b0af-30fbc721eb2c {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:24:13 user nova-compute[71731]: WARNING nova.compute.manager [req-63931994-bd38-48bc-92d0-bc5593969d2c req-45373634-1ecc-44f5-8787-215454a31626 service nova] [instance: 8c6d8096-853b-4091-ad82-6faf8ffc85fa] Received unexpected event network-vif-plugged-385dec44-4145-4606-b0af-30fbc721eb2c for instance with vm_state deleted and task_state None.
Apr 13 16:24:13 user nova-compute[71731]: DEBUG nova.compute.manager [req-63931994-bd38-48bc-92d0-bc5593969d2c req-45373634-1ecc-44f5-8787-215454a31626 service nova] [instance: 8c6d8096-853b-4091-ad82-6faf8ffc85fa] Received event network-vif-deleted-385dec44-4145-4606-b0af-30fbc721eb2c {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:24:13 user nova-compute[71731]: DEBUG nova.compute.provider_tree [None req-9f9e25f5-a684-48b1-9aab-64ad24829115 tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] Inventory has not changed in ProviderTree for provider: cb6b1a64-0c24-4e2d-af1e-16576ca9165c {{(pid=71731) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 16:24:13 user nova-compute[71731]: DEBUG nova.scheduler.client.report [None req-9f9e25f5-a684-48b1-9aab-64ad24829115 tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] Inventory has not changed for provider cb6b1a64-0c24-4e2d-af1e-16576ca9165c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71731) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 16:24:13 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-9f9e25f5-a684-48b1-9aab-64ad24829115 tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.320s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:24:13 user nova-compute[71731]: INFO nova.scheduler.client.report [None req-9f9e25f5-a684-48b1-9aab-64ad24829115 tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] Deleted allocations for instance 8c6d8096-853b-4091-ad82-6faf8ffc85fa
Apr 13 16:24:13 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-9f9e25f5-a684-48b1-9aab-64ad24829115 tempest-TestVolumeSwap-2131472698 tempest-TestVolumeSwap-2131472698-project-member] Lock "8c6d8096-853b-4091-ad82-6faf8ffc85fa" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.178s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:24:13 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:24:13 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-30b22484-126b-40b4-b414-458ea9c9b28b tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Acquiring lock "bbcccf4b-e861-4254-9be3-a491776214e9" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:24:13 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-30b22484-126b-40b4-b414-458ea9c9b28b tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Lock "bbcccf4b-e861-4254-9be3-a491776214e9" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:24:13 user nova-compute[71731]: DEBUG nova.objects.instance [None req-30b22484-126b-40b4-b414-458ea9c9b28b tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Lazy-loading 'flavor' on Instance uuid bbcccf4b-e861-4254-9be3-a491776214e9 {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:24:13 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-30b22484-126b-40b4-b414-458ea9c9b28b tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Lock "bbcccf4b-e861-4254-9be3-a491776214e9" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.066s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:24:13 user nova-compute[71731]: DEBUG nova.network.neutron [None req-cd45ef09-4353-465c-916c-11a3a2c2eb68 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] [instance: eaae47b9-a059-49f6-9ae6-d7147003e2f2] Successfully updated port: e9b2fcaa-f77b-4e5c-ad3c-797ce804a9ae {{(pid=71731) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 16:24:13 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-cd45ef09-4353-465c-916c-11a3a2c2eb68 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Acquiring lock "refresh_cache-eaae47b9-a059-49f6-9ae6-d7147003e2f2" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 16:24:13 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-cd45ef09-4353-465c-916c-11a3a2c2eb68 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Acquired lock "refresh_cache-eaae47b9-a059-49f6-9ae6-d7147003e2f2" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 16:24:13 user nova-compute[71731]: DEBUG nova.network.neutron [None req-cd45ef09-4353-465c-916c-11a3a2c2eb68 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] [instance: eaae47b9-a059-49f6-9ae6-d7147003e2f2] Building network info cache for instance {{(pid=71731) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 16:24:13 user nova-compute[71731]: DEBUG nova.compute.manager [req-f0135f9f-de65-4c94-a910-b1e7e567457f req-0462d9a4-b88a-4eac-bd0b-2f1e24aed93f service nova] [instance: eaae47b9-a059-49f6-9ae6-d7147003e2f2] Received event network-changed-e9b2fcaa-f77b-4e5c-ad3c-797ce804a9ae {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:24:13 user nova-compute[71731]: DEBUG nova.compute.manager [req-f0135f9f-de65-4c94-a910-b1e7e567457f req-0462d9a4-b88a-4eac-bd0b-2f1e24aed93f service nova] [instance: eaae47b9-a059-49f6-9ae6-d7147003e2f2] Refreshing instance network info cache due to event network-changed-e9b2fcaa-f77b-4e5c-ad3c-797ce804a9ae. {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 16:24:13 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-f0135f9f-de65-4c94-a910-b1e7e567457f req-0462d9a4-b88a-4eac-bd0b-2f1e24aed93f service nova] Acquiring lock "refresh_cache-eaae47b9-a059-49f6-9ae6-d7147003e2f2" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 16:24:13 user nova-compute[71731]: DEBUG nova.network.neutron [None req-cd45ef09-4353-465c-916c-11a3a2c2eb68 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] [instance: eaae47b9-a059-49f6-9ae6-d7147003e2f2] Instance cache missing network info. {{(pid=71731) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 16:24:13 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-30b22484-126b-40b4-b414-458ea9c9b28b tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Acquiring lock "bbcccf4b-e861-4254-9be3-a491776214e9" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:24:13 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-30b22484-126b-40b4-b414-458ea9c9b28b tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Lock "bbcccf4b-e861-4254-9be3-a491776214e9" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:24:13 user nova-compute[71731]: INFO nova.compute.manager [None req-30b22484-126b-40b4-b414-458ea9c9b28b tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] [instance: bbcccf4b-e861-4254-9be3-a491776214e9] Attaching volume dc7649d3-fc59-438d-b230-72c4ce61e722 to /dev/vdb
Apr 13 16:24:13 user nova-compute[71731]: DEBUG os_brick.utils [None req-30b22484-126b-40b4-b414-458ea9c9b28b tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 16:24:13 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:24:13 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:24:13 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[546a6b20-5aab-4162-8d4a-9cf5ce55a1fe]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:81501d91421\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:24:13 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:24:13 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:24:13 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[2991dd3c-7758-4650-ac08-00dfa9471559]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:24:13 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:24:13 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:24:13 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[47fd5cd9-007d-4006-a0a7-df54cc5a1f2a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:24:13 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ede90bb-93d7-490d-9f93-a9a6e6558f21]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:24:13 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-30b22484-126b-40b4-b414-458ea9c9b28b tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Running cmd (subprocess): nvme version {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:24:13 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-30b22484-126b-40b4-b414-458ea9c9b28b tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] 'nvme version' failed. Not Retrying. {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 16:24:13 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.nvmeof [None req-30b22484-126b-40b4-b414-458ea9c9b28b tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] nvme not present on system {{(pid=71731) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 16:24:13 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:24:13 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 16:24:13 user nova-compute[71731]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 16:24:13 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[45fb2287-dba9-44d1-86db-93100456a57e]: (4, '') {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:24:13 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.lightos [None req-30b22484-126b-40b4-b414-458ea9c9b28b tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71731) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 16:24:13 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.lightos [None req-30b22484-126b-40b4-b414-458ea9c9b28b tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71731) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 16:24:13 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.lightos [None req-30b22484-126b-40b4-b414-458ea9c9b28b tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] LIGHTOS: no hostnqn found. {{(pid=71731) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 16:24:13 user nova-compute[71731]: DEBUG os_brick.utils [None req-30b22484-126b-40b4-b414-458ea9c9b28b tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:81501d91421', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 16:24:13 user nova-compute[71731]: DEBUG nova.virt.block_device [None req-30b22484-126b-40b4-b414-458ea9c9b28b tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] [instance: bbcccf4b-e861-4254-9be3-a491776214e9] Updating existing volume attachment record: c607331b-ce14-4424-974c-268dcf3dc72f {{(pid=71731) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 16:24:14 user nova-compute[71731]: DEBUG nova.network.neutron [None req-cd45ef09-4353-465c-916c-11a3a2c2eb68 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] [instance: eaae47b9-a059-49f6-9ae6-d7147003e2f2] Updating instance_info_cache with network_info: [{"id": "e9b2fcaa-f77b-4e5c-ad3c-797ce804a9ae", "address": "fa:16:3e:ff:85:92", "network": {"id": "79e9ef20-b14d-4850-b298-9d3ed4d10b90", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1756253617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24904988cf334657b084fd726c7ecf8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9b2fcaa-f7", "ovs_interfaceid": "e9b2fcaa-f77b-4e5c-ad3c-797ce804a9ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:24:14 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-cd45ef09-4353-465c-916c-11a3a2c2eb68 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Releasing lock "refresh_cache-eaae47b9-a059-49f6-9ae6-d7147003e2f2" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 16:24:14 user nova-compute[71731]: DEBUG nova.compute.manager [None req-cd45ef09-4353-465c-916c-11a3a2c2eb68 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] [instance: eaae47b9-a059-49f6-9ae6-d7147003e2f2] Instance network_info: |[{"id": "e9b2fcaa-f77b-4e5c-ad3c-797ce804a9ae", "address": "fa:16:3e:ff:85:92", "network": {"id": "79e9ef20-b14d-4850-b298-9d3ed4d10b90", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1756253617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24904988cf334657b084fd726c7ecf8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9b2fcaa-f7", "ovs_interfaceid": "e9b2fcaa-f77b-4e5c-ad3c-797ce804a9ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71731) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 16:24:14 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-f0135f9f-de65-4c94-a910-b1e7e567457f req-0462d9a4-b88a-4eac-bd0b-2f1e24aed93f service nova] Acquired lock "refresh_cache-eaae47b9-a059-49f6-9ae6-d7147003e2f2" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 16:24:14 user nova-compute[71731]: DEBUG nova.network.neutron [req-f0135f9f-de65-4c94-a910-b1e7e567457f req-0462d9a4-b88a-4eac-bd0b-2f1e24aed93f service nova] [instance: eaae47b9-a059-49f6-9ae6-d7147003e2f2] Refreshing network info cache for port e9b2fcaa-f77b-4e5c-ad3c-797ce804a9ae {{(pid=71731) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 16:24:14 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-cd45ef09-4353-465c-916c-11a3a2c2eb68 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] [instance: eaae47b9-a059-49f6-9ae6-d7147003e2f2] Start _get_guest_xml network_info=[{"id": "e9b2fcaa-f77b-4e5c-ad3c-797ce804a9ae", "address": "fa:16:3e:ff:85:92", "network": {"id": "79e9ef20-b14d-4850-b298-9d3ed4d10b90", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1756253617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24904988cf334657b084fd726c7ecf8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9b2fcaa-f7", "ovs_interfaceid": "e9b2fcaa-f77b-4e5c-ad3c-797ce804a9ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T16:16:31Z,direct_url=<?>,disk_format='qcow2',id=708622a9-7465-4492-ade8-b827198f7e30,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='0b29a975c552465aba0ac7d6288434bd',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T16:16:33Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'device_type': 'disk', 'encrypted': False, 'disk_bus': 'virtio', 'guest_format': None, 'encryption_options': None, 'image_id': '708622a9-7465-4492-ade8-b827198f7e30'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71731) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 16:24:14 user nova-compute[71731]: WARNING nova.virt.libvirt.driver [None req-cd45ef09-4353-465c-916c-11a3a2c2eb68 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 16:24:14 user nova-compute[71731]: WARNING nova.virt.libvirt.driver [None req-cd45ef09-4353-465c-916c-11a3a2c2eb68 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 16:24:14 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-cd45ef09-4353-465c-916c-11a3a2c2eb68 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71731) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 16:24:14 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-cd45ef09-4353-465c-916c-11a3a2c2eb68 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T16:17:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T16:16:31Z,direct_url=<?>,disk_format='qcow2',id=708622a9-7465-4492-ade8-b827198f7e30,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='0b29a975c552465aba0ac7d6288434bd',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T16:16:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 16:24:14 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-cd45ef09-4353-465c-916c-11a3a2c2eb68 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Flavor limits 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 16:24:14 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-cd45ef09-4353-465c-916c-11a3a2c2eb68 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Image limits 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 16:24:14 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-cd45ef09-4353-465c-916c-11a3a2c2eb68 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Flavor pref 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 16:24:14 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-cd45ef09-4353-465c-916c-11a3a2c2eb68 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Image pref 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 16:24:14 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-cd45ef09-4353-465c-916c-11a3a2c2eb68 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 16:24:14 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-cd45ef09-4353-465c-916c-11a3a2c2eb68 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 16:24:14 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-cd45ef09-4353-465c-916c-11a3a2c2eb68 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71731) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 16:24:14 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-cd45ef09-4353-465c-916c-11a3a2c2eb68 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Got 1 possible topologies {{(pid=71731) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 16:24:14 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-cd45ef09-4353-465c-916c-11a3a2c2eb68 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 16:24:14 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-cd45ef09-4353-465c-916c-11a3a2c2eb68 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 16:24:14 user nova-compute[71731]: DEBUG nova.virt.libvirt.vif [None req-cd45ef09-4353-465c-916c-11a3a2c2eb68 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T16:24:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1335647489',display_name='tempest-AttachVolumeTestJSON-server-1335647489',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1335647489',id=17,image_ref='708622a9-7465-4492-ade8-b827198f7e30',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBWOy0oVQ9hC0pTOafixaz1QU1E5DFmqkYHL4O9l7OLTdaq0+Nt41+fxYUKgEMEMs0o2pxQBhqAzayIAyGV1IIb01ym4tkG3pd4D4/xbjIzoE586YH9dqYrXgxzYqNSiRA==',key_name='tempest-keypair-1534458766',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='24904988cf334657b084fd726c7ecf8f',ramdisk_id='',reservation_id='r-aer2ghdf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='708622a9-7465-4492-ade8-b827198f7e30',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-836650657',owner_user_name='tempest-AttachVolumeTestJSON-836650657-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T16:24:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='47fab402fb794a5a9281cfb7fe188813',uuid=eaae47b9-a059-49f6-9ae6-d7147003e2f2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e9b2fcaa-f77b-4e5c-ad3c-797ce804a9ae", "address": "fa:16:3e:ff:85:92", "network": {"id": "79e9ef20-b14d-4850-b298-9d3ed4d10b90", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1756253617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24904988cf334657b084fd726c7ecf8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9b2fcaa-f7", "ovs_interfaceid": "e9b2fcaa-f77b-4e5c-ad3c-797ce804a9ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71731) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 16:24:14 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-cd45ef09-4353-465c-916c-11a3a2c2eb68 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Converting VIF {"id": "e9b2fcaa-f77b-4e5c-ad3c-797ce804a9ae", "address": "fa:16:3e:ff:85:92", "network": {"id": "79e9ef20-b14d-4850-b298-9d3ed4d10b90", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1756253617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24904988cf334657b084fd726c7ecf8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9b2fcaa-f7", "ovs_interfaceid": "e9b2fcaa-f77b-4e5c-ad3c-797ce804a9ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 16:24:14 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-cd45ef09-4353-465c-916c-11a3a2c2eb68 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ff:85:92,bridge_name='br-int',has_traffic_filtering=True,id=e9b2fcaa-f77b-4e5c-ad3c-797ce804a9ae,network=Network(79e9ef20-b14d-4850-b298-9d3ed4d10b90),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9b2fcaa-f7') {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 16:24:14 user nova-compute[71731]: DEBUG nova.objects.instance [None req-cd45ef09-4353-465c-916c-11a3a2c2eb68 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lazy-loading 'pci_devices' on Instance uuid eaae47b9-a059-49f6-9ae6-d7147003e2f2 {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:24:14 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-cd45ef09-4353-465c-916c-11a3a2c2eb68 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] [instance: eaae47b9-a059-49f6-9ae6-d7147003e2f2] End _get_guest_xml xml=<domain type="kvm">
Apr 13 16:24:14 user nova-compute[71731]:   <uuid>eaae47b9-a059-49f6-9ae6-d7147003e2f2</uuid>
Apr 13 16:24:14 user nova-compute[71731]:   <name>instance-00000011</name>
Apr 13 16:24:14 user nova-compute[71731]:   <memory>131072</memory>
Apr 13 16:24:14 user nova-compute[71731]:   <vcpu>1</vcpu>
Apr 13 16:24:14 user nova-compute[71731]:   <metadata>
Apr 13 16:24:14 user nova-compute[71731]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 16:24:14 user nova-compute[71731]:       <nova:package version="0.0.0"/>
Apr 13 16:24:14 user nova-compute[71731]:       <nova:name>tempest-AttachVolumeTestJSON-server-1335647489</nova:name>
Apr 13 16:24:14 user nova-compute[71731]:       <nova:creationTime>2023-04-13 16:24:14</nova:creationTime>
Apr 13 16:24:14 user nova-compute[71731]:       <nova:flavor name="m1.nano">
Apr 13 16:24:14 user nova-compute[71731]:         <nova:memory>128</nova:memory>
Apr 13 16:24:14 user nova-compute[71731]:         <nova:disk>1</nova:disk>
Apr 13 16:24:14 user nova-compute[71731]:         <nova:swap>0</nova:swap>
Apr 13 16:24:14 user nova-compute[71731]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 16:24:14 user nova-compute[71731]:         <nova:vcpus>1</nova:vcpus>
Apr 13 16:24:14 user nova-compute[71731]:       </nova:flavor>
Apr 13 16:24:14 user nova-compute[71731]:       <nova:owner>
Apr 13 16:24:14 user nova-compute[71731]:         <nova:user uuid="47fab402fb794a5a9281cfb7fe188813">tempest-AttachVolumeTestJSON-836650657-project-member</nova:user>
Apr 13 16:24:14 user nova-compute[71731]:         <nova:project uuid="24904988cf334657b084fd726c7ecf8f">tempest-AttachVolumeTestJSON-836650657</nova:project>
Apr 13 16:24:14 user nova-compute[71731]:       </nova:owner>
Apr 13 16:24:14 user nova-compute[71731]:       <nova:root type="image" uuid="708622a9-7465-4492-ade8-b827198f7e30"/>
Apr 13 16:24:14 user nova-compute[71731]:       <nova:ports>
Apr 13 16:24:14 user nova-compute[71731]:         <nova:port uuid="e9b2fcaa-f77b-4e5c-ad3c-797ce804a9ae">
Apr 13 16:24:14 user nova-compute[71731]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Apr 13 16:24:14 user nova-compute[71731]:         </nova:port>
Apr 13 16:24:14 user nova-compute[71731]:       </nova:ports>
Apr 13 16:24:14 user nova-compute[71731]:     </nova:instance>
Apr 13 16:24:14 user nova-compute[71731]:   </metadata>
Apr 13 16:24:14 user nova-compute[71731]:   <sysinfo type="smbios">
Apr 13 16:24:14 user nova-compute[71731]:     <system>
Apr 13 16:24:14 user nova-compute[71731]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 16:24:14 user nova-compute[71731]:       <entry name="product">OpenStack Nova</entry>
Apr 13 16:24:14 user nova-compute[71731]:       <entry name="version">0.0.0</entry>
Apr 13 16:24:14 user nova-compute[71731]:       <entry name="serial">eaae47b9-a059-49f6-9ae6-d7147003e2f2</entry>
Apr 13 16:24:14 user nova-compute[71731]:       <entry name="uuid">eaae47b9-a059-49f6-9ae6-d7147003e2f2</entry>
Apr 13 16:24:14 user nova-compute[71731]:       <entry name="family">Virtual Machine</entry>
Apr 13 16:24:14 user nova-compute[71731]:     </system>
Apr 13 16:24:14 user nova-compute[71731]:   </sysinfo>
Apr 13 16:24:14 user nova-compute[71731]:   <os>
Apr 13 16:24:14 user nova-compute[71731]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 16:24:14 user nova-compute[71731]:     <boot dev="hd"/>
Apr 13 16:24:14 user nova-compute[71731]:     <smbios mode="sysinfo"/>
Apr 13 16:24:14 user nova-compute[71731]:   </os>
Apr 13 16:24:14 user nova-compute[71731]:   <features>
Apr 13 16:24:14 user nova-compute[71731]:     <acpi/>
Apr 13 16:24:14 user nova-compute[71731]:     <apic/>
Apr 13 16:24:14 user nova-compute[71731]:     <vmcoreinfo/>
Apr 13 16:24:14 user nova-compute[71731]:   </features>
Apr 13 16:24:14 user nova-compute[71731]:   <clock offset="utc">
Apr 13 16:24:14 user nova-compute[71731]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 16:24:14 user nova-compute[71731]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 16:24:14 user nova-compute[71731]:     <timer name="hpet" present="no"/>
Apr 13 16:24:14 user nova-compute[71731]:   </clock>
Apr 13 16:24:14 user nova-compute[71731]:   <cpu mode="custom" match="exact">
Apr 13 16:24:14 user nova-compute[71731]:     <model>Nehalem</model>
Apr 13 16:24:14 user nova-compute[71731]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 16:24:14 user nova-compute[71731]:   </cpu>
Apr 13 16:24:14 user nova-compute[71731]:   <devices>
Apr 13 16:24:14 user nova-compute[71731]:     <disk type="file" device="disk">
Apr 13 16:24:14 user nova-compute[71731]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 16:24:14 user nova-compute[71731]:       <source file="/opt/stack/data/nova/instances/eaae47b9-a059-49f6-9ae6-d7147003e2f2/disk"/>
Apr 13 16:24:14 user nova-compute[71731]:       <target dev="vda" bus="virtio"/>
Apr 13 16:24:14 user nova-compute[71731]:     </disk>
Apr 13 16:24:14 user nova-compute[71731]:     <interface type="ethernet">
Apr 13 16:24:14 user nova-compute[71731]:       <mac address="fa:16:3e:ff:85:92"/>
Apr 13 16:24:14 user nova-compute[71731]:       <model type="virtio"/>
Apr 13 16:24:14 user nova-compute[71731]:       <mtu size="1442"/>
Apr 13 16:24:14 user nova-compute[71731]:       <target dev="tape9b2fcaa-f7"/>
Apr 13 16:24:14 user nova-compute[71731]:     </interface>
Apr 13 16:24:14 user nova-compute[71731]:     <serial type="pty">
Apr 13 16:24:14 user nova-compute[71731]:       <log file="/opt/stack/data/nova/instances/eaae47b9-a059-49f6-9ae6-d7147003e2f2/console.log" append="off"/>
Apr 13 16:24:14 user nova-compute[71731]:     </serial>
Apr 13 16:24:14 user nova-compute[71731]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 16:24:14 user nova-compute[71731]:     <video>
Apr 13 16:24:14 user nova-compute[71731]:       <model type="virtio"/>
Apr 13 16:24:14 user nova-compute[71731]:     </video>
Apr 13 16:24:14 user nova-compute[71731]:     <rng model="virtio">
Apr 13 16:24:14 user nova-compute[71731]:       <backend model="random">/dev/urandom</backend>
Apr 13 16:24:14 user nova-compute[71731]:     </rng>
Apr 13 16:24:14 user nova-compute[71731]:     <controller type="usb" index="0" model="none"/>
Apr 13 16:24:14 user nova-compute[71731]:     <memballoon model="virtio">
Apr 13 16:24:14 user nova-compute[71731]:       <stats period="10"/>
Apr 13 16:24:14 user nova-compute[71731]:     </memballoon>
Apr 13 16:24:14 user nova-compute[71731]:   </devices>
Apr 13 16:24:14 user nova-compute[71731]: </domain>
Apr 13 16:24:14 user nova-compute[71731]:  {{(pid=71731) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 16:24:14 user nova-compute[71731]: DEBUG nova.virt.libvirt.vif [None req-cd45ef09-4353-465c-916c-11a3a2c2eb68 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T16:24:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1335647489',display_name='tempest-AttachVolumeTestJSON-server-1335647489',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1335647489',id=17,image_ref='708622a9-7465-4492-ade8-b827198f7e30',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBWOy0oVQ9hC0pTOafixaz1QU1E5DFmqkYHL4O9l7OLTdaq0+Nt41+fxYUKgEMEMs0o2pxQBhqAzayIAyGV1IIb01ym4tkG3pd4D4/xbjIzoE586YH9dqYrXgxzYqNSiRA==',key_name='tempest-keypair-1534458766',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='24904988cf334657b084fd726c7ecf8f',ramdisk_id='',reservation_id='r-aer2ghdf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='708622a9-7465-4492-ade8-b827198f7e30',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-836650657',owner_user_name='tempest-AttachVolumeTestJSON-836650657-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T16:24:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='47fab402fb794a5a9281cfb7fe188813',uuid=eaae47b9-a059-49f6-9ae6-d7147003e2f2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e9b2fcaa-f77b-4e5c-ad3c-797ce804a9ae", "address": "fa:16:3e:ff:85:92", "network": {"id": "79e9ef20-b14d-4850-b298-9d3ed4d10b90", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1756253617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24904988cf334657b084fd726c7ecf8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9b2fcaa-f7", "ovs_interfaceid": "e9b2fcaa-f77b-4e5c-ad3c-797ce804a9ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 16:24:14 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-cd45ef09-4353-465c-916c-11a3a2c2eb68 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Converting VIF {"id": "e9b2fcaa-f77b-4e5c-ad3c-797ce804a9ae", "address": "fa:16:3e:ff:85:92", "network": {"id": "79e9ef20-b14d-4850-b298-9d3ed4d10b90", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1756253617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24904988cf334657b084fd726c7ecf8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9b2fcaa-f7", "ovs_interfaceid": "e9b2fcaa-f77b-4e5c-ad3c-797ce804a9ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 16:24:14 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-cd45ef09-4353-465c-916c-11a3a2c2eb68 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ff:85:92,bridge_name='br-int',has_traffic_filtering=True,id=e9b2fcaa-f77b-4e5c-ad3c-797ce804a9ae,network=Network(79e9ef20-b14d-4850-b298-9d3ed4d10b90),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9b2fcaa-f7') {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 16:24:14 user nova-compute[71731]: DEBUG os_vif [None req-cd45ef09-4353-465c-916c-11a3a2c2eb68 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:85:92,bridge_name='br-int',has_traffic_filtering=True,id=e9b2fcaa-f77b-4e5c-ad3c-797ce804a9ae,network=Network(79e9ef20-b14d-4850-b298-9d3ed4d10b90),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9b2fcaa-f7') {{(pid=71731) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 16:24:14 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:24:14 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:24:14 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 16:24:14 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:24:14 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape9b2fcaa-f7, may_exist=True) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:24:14 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape9b2fcaa-f7, col_values=(('external_ids', {'iface-id': 'e9b2fcaa-f77b-4e5c-ad3c-797ce804a9ae', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ff:85:92', 'vm-uuid': 'eaae47b9-a059-49f6-9ae6-d7147003e2f2'}),)) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:24:14 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:24:14 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 16:24:14 user nova-compute[71731]: INFO os_vif [None req-cd45ef09-4353-465c-916c-11a3a2c2eb68 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:85:92,bridge_name='br-int',has_traffic_filtering=True,id=e9b2fcaa-f77b-4e5c-ad3c-797ce804a9ae,network=Network(79e9ef20-b14d-4850-b298-9d3ed4d10b90),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9b2fcaa-f7')
Apr 13 16:24:14 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-cd45ef09-4353-465c-916c-11a3a2c2eb68 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] No BDM found with device name vda, not building metadata. {{(pid=71731) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 16:24:14 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-cd45ef09-4353-465c-916c-11a3a2c2eb68 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] No VIF found with MAC fa:16:3e:ff:85:92, not building metadata {{(pid=71731) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 16:24:14 user nova-compute[71731]: DEBUG nova.network.neutron [req-f0135f9f-de65-4c94-a910-b1e7e567457f req-0462d9a4-b88a-4eac-bd0b-2f1e24aed93f service nova] [instance: eaae47b9-a059-49f6-9ae6-d7147003e2f2] Updated VIF entry in instance network info cache for port e9b2fcaa-f77b-4e5c-ad3c-797ce804a9ae. {{(pid=71731) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 16:24:14 user nova-compute[71731]: DEBUG nova.network.neutron [req-f0135f9f-de65-4c94-a910-b1e7e567457f req-0462d9a4-b88a-4eac-bd0b-2f1e24aed93f service nova] [instance: eaae47b9-a059-49f6-9ae6-d7147003e2f2] Updating instance_info_cache with network_info: [{"id": "e9b2fcaa-f77b-4e5c-ad3c-797ce804a9ae", "address": "fa:16:3e:ff:85:92", "network": {"id": "79e9ef20-b14d-4850-b298-9d3ed4d10b90", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1756253617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24904988cf334657b084fd726c7ecf8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9b2fcaa-f7", "ovs_interfaceid": "e9b2fcaa-f77b-4e5c-ad3c-797ce804a9ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:24:14 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-f0135f9f-de65-4c94-a910-b1e7e567457f req-0462d9a4-b88a-4eac-bd0b-2f1e24aed93f service nova] Releasing lock "refresh_cache-eaae47b9-a059-49f6-9ae6-d7147003e2f2" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 16:24:15 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:24:15 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:24:15 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:24:16 user nova-compute[71731]: DEBUG nova.compute.manager [req-c6ff5f66-089e-4e0a-94df-2532b16b6015 req-e240cdeb-b861-4638-832e-7df1c76c6054 service nova] [instance: eaae47b9-a059-49f6-9ae6-d7147003e2f2] Received event network-vif-plugged-e9b2fcaa-f77b-4e5c-ad3c-797ce804a9ae {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:24:16 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-c6ff5f66-089e-4e0a-94df-2532b16b6015 req-e240cdeb-b861-4638-832e-7df1c76c6054 service nova] Acquiring lock "eaae47b9-a059-49f6-9ae6-d7147003e2f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:24:16 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-c6ff5f66-089e-4e0a-94df-2532b16b6015 req-e240cdeb-b861-4638-832e-7df1c76c6054 service nova] Lock "eaae47b9-a059-49f6-9ae6-d7147003e2f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:24:16 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-c6ff5f66-089e-4e0a-94df-2532b16b6015 req-e240cdeb-b861-4638-832e-7df1c76c6054 service nova] Lock "eaae47b9-a059-49f6-9ae6-d7147003e2f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:24:16 user nova-compute[71731]: DEBUG nova.compute.manager [req-c6ff5f66-089e-4e0a-94df-2532b16b6015 req-e240cdeb-b861-4638-832e-7df1c76c6054 service nova] [instance: eaae47b9-a059-49f6-9ae6-d7147003e2f2] No waiting events found dispatching network-vif-plugged-e9b2fcaa-f77b-4e5c-ad3c-797ce804a9ae {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:24:16 user nova-compute[71731]: WARNING nova.compute.manager [req-c6ff5f66-089e-4e0a-94df-2532b16b6015 req-e240cdeb-b861-4638-832e-7df1c76c6054 service nova] [instance: eaae47b9-a059-49f6-9ae6-d7147003e2f2] Received unexpected event network-vif-plugged-e9b2fcaa-f77b-4e5c-ad3c-797ce804a9ae for instance with vm_state building and task_state spawning.
Apr 13 16:24:16 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:24:16 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:24:16 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:24:16 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:24:16 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:24:18 user nova-compute[71731]: DEBUG nova.compute.manager [req-3010c500-35e5-4308-b97f-1a7aa2460409 req-0f83497c-3aba-41da-a0f5-c85430440c88 service nova] [instance: eaae47b9-a059-49f6-9ae6-d7147003e2f2] Received event network-vif-plugged-e9b2fcaa-f77b-4e5c-ad3c-797ce804a9ae {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:24:18 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-3010c500-35e5-4308-b97f-1a7aa2460409 req-0f83497c-3aba-41da-a0f5-c85430440c88 service nova] Acquiring lock "eaae47b9-a059-49f6-9ae6-d7147003e2f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:24:18 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-3010c500-35e5-4308-b97f-1a7aa2460409 req-0f83497c-3aba-41da-a0f5-c85430440c88 service nova] Lock "eaae47b9-a059-49f6-9ae6-d7147003e2f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:24:18 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-3010c500-35e5-4308-b97f-1a7aa2460409 req-0f83497c-3aba-41da-a0f5-c85430440c88 service nova] Lock "eaae47b9-a059-49f6-9ae6-d7147003e2f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:24:18 user nova-compute[71731]: DEBUG nova.compute.manager [req-3010c500-35e5-4308-b97f-1a7aa2460409 req-0f83497c-3aba-41da-a0f5-c85430440c88 service nova] [instance: eaae47b9-a059-49f6-9ae6-d7147003e2f2] No waiting events found dispatching network-vif-plugged-e9b2fcaa-f77b-4e5c-ad3c-797ce804a9ae {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:24:18 user nova-compute[71731]: WARNING nova.compute.manager [req-3010c500-35e5-4308-b97f-1a7aa2460409 req-0f83497c-3aba-41da-a0f5-c85430440c88 service nova] [instance: eaae47b9-a059-49f6-9ae6-d7147003e2f2] Received unexpected event network-vif-plugged-e9b2fcaa-f77b-4e5c-ad3c-797ce804a9ae for instance with vm_state building and task_state spawning.
Apr 13 16:24:18 user nova-compute[71731]: DEBUG nova.compute.manager [None req-cd45ef09-4353-465c-916c-11a3a2c2eb68 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] [instance: eaae47b9-a059-49f6-9ae6-d7147003e2f2] Instance event wait completed in 0 seconds for  {{(pid=71731) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 16:24:18 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-cd45ef09-4353-465c-916c-11a3a2c2eb68 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] [instance: eaae47b9-a059-49f6-9ae6-d7147003e2f2] Guest created on hypervisor {{(pid=71731) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 16:24:18 user nova-compute[71731]: DEBUG nova.virt.driver [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Emitting event <LifecycleEvent: 1681403058.1659172, eaae47b9-a059-49f6-9ae6-d7147003e2f2 => Resumed> {{(pid=71731) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 16:24:18 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: eaae47b9-a059-49f6-9ae6-d7147003e2f2] VM Resumed (Lifecycle Event)
Apr 13 16:24:18 user nova-compute[71731]: INFO nova.virt.libvirt.driver [-] [instance: eaae47b9-a059-49f6-9ae6-d7147003e2f2] Instance spawned successfully.
Apr 13 16:24:18 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-cd45ef09-4353-465c-916c-11a3a2c2eb68 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] [instance: eaae47b9-a059-49f6-9ae6-d7147003e2f2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 16:24:18 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: eaae47b9-a059-49f6-9ae6-d7147003e2f2] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:24:18 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-cd45ef09-4353-465c-916c-11a3a2c2eb68 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] [instance: eaae47b9-a059-49f6-9ae6-d7147003e2f2] Found default for hw_cdrom_bus of ide {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:24:18 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-cd45ef09-4353-465c-916c-11a3a2c2eb68 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] [instance: eaae47b9-a059-49f6-9ae6-d7147003e2f2] Found default for hw_disk_bus of virtio {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:24:18 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-cd45ef09-4353-465c-916c-11a3a2c2eb68 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] [instance: eaae47b9-a059-49f6-9ae6-d7147003e2f2] Found default for hw_input_bus of None {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:24:18 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-cd45ef09-4353-465c-916c-11a3a2c2eb68 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] [instance: eaae47b9-a059-49f6-9ae6-d7147003e2f2] Found default for hw_pointer_model of None {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:24:18 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-cd45ef09-4353-465c-916c-11a3a2c2eb68 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] [instance: eaae47b9-a059-49f6-9ae6-d7147003e2f2] Found default for hw_video_model of virtio {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:24:18 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-cd45ef09-4353-465c-916c-11a3a2c2eb68 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] [instance: eaae47b9-a059-49f6-9ae6-d7147003e2f2] Found default for hw_vif_model of virtio {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:24:18 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: eaae47b9-a059-49f6-9ae6-d7147003e2f2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71731) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 16:24:18 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: eaae47b9-a059-49f6-9ae6-d7147003e2f2] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 16:24:18 user nova-compute[71731]: DEBUG nova.virt.driver [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Emitting event <LifecycleEvent: 1681403058.1696756, eaae47b9-a059-49f6-9ae6-d7147003e2f2 => Started> {{(pid=71731) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 16:24:18 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: eaae47b9-a059-49f6-9ae6-d7147003e2f2] VM Started (Lifecycle Event)
Apr 13 16:24:18 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: eaae47b9-a059-49f6-9ae6-d7147003e2f2] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:24:18 user nova-compute[71731]: INFO nova.compute.manager [None req-cd45ef09-4353-465c-916c-11a3a2c2eb68 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] [instance: eaae47b9-a059-49f6-9ae6-d7147003e2f2] Took 6.98 seconds to spawn the instance on the hypervisor.
Apr 13 16:24:18 user nova-compute[71731]: DEBUG nova.compute.manager [None req-cd45ef09-4353-465c-916c-11a3a2c2eb68 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] [instance: eaae47b9-a059-49f6-9ae6-d7147003e2f2] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:24:18 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: eaae47b9-a059-49f6-9ae6-d7147003e2f2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71731) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 16:24:18 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: eaae47b9-a059-49f6-9ae6-d7147003e2f2] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 16:24:18 user nova-compute[71731]: INFO nova.compute.manager [None req-cd45ef09-4353-465c-916c-11a3a2c2eb68 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] [instance: eaae47b9-a059-49f6-9ae6-d7147003e2f2] Took 7.79 seconds to build instance.
Apr 13 16:24:18 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-cd45ef09-4353-465c-916c-11a3a2c2eb68 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lock "eaae47b9-a059-49f6-9ae6-d7147003e2f2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.892s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:24:18 user nova-compute[71731]: DEBUG nova.virt.libvirt.volume.iscsi [None req-30b22484-126b-40b4-b414-458ea9c9b28b tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] [instance: bbcccf4b-e861-4254-9be3-a491776214e9] Calling os-brick to attach iSCSI Volume {{(pid=71731) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 16:24:18 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-30b22484-126b-40b4-b414-458ea9c9b28b tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8cf0118790>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:dc7649d3-fc59-438d-b230-72c4ce61e722', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RYfjcZaT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 16:24:18 user nova-compute[71731]: WARNING os_brick.initiator.connectors.base [None req-30b22484-126b-40b4-b414-458ea9c9b28b tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 16:24:18 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-30b22484-126b-40b4-b414-458ea9c9b28b tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 16:24:18 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-30b22484-126b-40b4-b414-458ea9c9b28b tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 16:24:18 user nova-compute[71731]: WARNING os_brick.initiator.connectors.base [None req-30b22484-126b-40b4-b414-458ea9c9b28b tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 16:24:18 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-30b22484-126b-40b4-b414-458ea9c9b28b tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dc7649d3-fc59-438d-b230-72c4ce61e722" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 16:24:18 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-30b22484-126b-40b4-b414-458ea9c9b28b tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dc7649d3-fc59-438d-b230-72c4ce61e722" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 16:24:18 user nova-compute[71731]: INFO os_brick.initiator.connectors.iscsi [None req-30b22484-126b-40b4-b414-458ea9c9b28b tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 16:24:18 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc7649d3-fc59-438d-b230-72c4ce61e722 -p 172.16.0.220:3260 {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:24:18 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc7649d3-fc59-438d-b230-72c4ce61e722 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:24:18 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a75fbe7-10bb-41f5-abf2-709ea3f06992]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:24:18 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-30b22484-126b-40b4-b414-458ea9c9b28b tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 16:24:18 user nova-compute[71731]:  {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:24:18 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc7649d3-fc59-438d-b230-72c4ce61e722 -p 172.16.0.220:3260 --interface default --op new {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:24:18 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc7649d3-fc59-438d-b230-72c4ce61e722 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:24:18 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[a19dfe7c-0215-4f32-916b-96da62726f48]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dc7649d3-fc59-438d-b230-72c4ce61e722] added\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:24:18 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-30b22484-126b-40b4-b414-458ea9c9b28b tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dc7649d3-fc59-438d-b230-72c4ce61e722] added
Apr 13 16:24:18 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:24:18 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc7649d3-fc59-438d-b230-72c4ce61e722 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:24:18 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc7649d3-fc59-438d-b230-72c4ce61e722 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:24:18 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[122cc64c-126b-447f-b5d7-b57cf1252e55]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:24:18 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-30b22484-126b-40b4-b414-458ea9c9b28b tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:24:18 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc7649d3-fc59-438d-b230-72c4ce61e722 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:24:18 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc7649d3-fc59-438d-b230-72c4ce61e722 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:24:18 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[be788392-c187-4795-9c8f-7218c52a1087]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:24:18 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-30b22484-126b-40b4-b414-458ea9c9b28b tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:24:18 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc7649d3-fc59-438d-b230-72c4ce61e722 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RYfjcZaT {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:24:18 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc7649d3-fc59-438d-b230-72c4ce61e722 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RYfjcZaT" returned: 0 in 0.017s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:24:18 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[04eee99b-6e40-4d86-a66b-169a5f100e7d]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:24:18 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-30b22484-126b-40b4-b414-458ea9c9b28b tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RYfjcZaT'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:24:18 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc7649d3-fc59-438d-b230-72c4ce61e722 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:24:18 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc7649d3-fc59-438d-b230-72c4ce61e722 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:24:18 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ac1e1b5-2cf9-4493-b0c2-b7880301c090]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:24:18 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-30b22484-126b-40b4-b414-458ea9c9b28b tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:24:18 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:24:18 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:24:18 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[29427a94-d4d2-4643-a786-bb6b064bebd8]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:24:18 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-30b22484-126b-40b4-b414-458ea9c9b28b tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)
Apr 13 16:24:18 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 16:24:18 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-30b22484-126b-40b4-b414-458ea9c9b28b tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)
Apr 13 16:24:18 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 16:24:18 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc7649d3-fc59-438d-b230-72c4ce61e722 -p 172.16.0.220:3260 --login {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:24:18 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc7649d3-fc59-438d-b230-72c4ce61e722 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:24:18 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d6de0ee-c125-468a-9ceb-409654c8bcd1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:dc7649d3-fc59-438d-b230-72c4ce61e722, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:dc7649d3-fc59-438d-b230-72c4ce61e722, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:24:18 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-30b22484-126b-40b4-b414-458ea9c9b28b tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:dc7649d3-fc59-438d-b230-72c4ce61e722, portal: 172.16.0.220,3260]
Apr 13 16:24:18 user nova-compute[71731]: Login to [iface: default, target: iqn.2010-10.org.openstack:dc7649d3-fc59-438d-b230-72c4ce61e722, portal: 172.16.0.220,3260] successful.
Apr 13 16:24:18 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:24:18 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc7649d3-fc59-438d-b230-72c4ce61e722 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:24:18 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc7649d3-fc59-438d-b230-72c4ce61e722 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:24:18 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[003270f2-01e9-4ecd-9c12-adc2b61aac4d]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:24:18 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-30b22484-126b-40b4-b414-458ea9c9b28b tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:24:18 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:24:18 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:24:18 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e351f8a-b015-4568-b662-36079b49ce87]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc7649d3-fc59-438d-b230-72c4ce61e722 (non-flash)\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:24:18 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-30b22484-126b-40b4-b414-458ea9c9b28b tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)
Apr 13 16:24:18 user nova-compute[71731]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc7649d3-fc59-438d-b230-72c4ce61e722 (non-flash)
Apr 13 16:24:18 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 16:24:18 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-30b22484-126b-40b4-b414-458ea9c9b28b tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)
Apr 13 16:24:18 user nova-compute[71731]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc7649d3-fc59-438d-b230-72c4ce61e722 (non-flash)
Apr 13 16:24:18 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 16:24:18 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-30b22484-126b-40b4-b414-458ea9c9b28b tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dc7649d3-fc59-438d-b230-72c4ce61e722" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.271s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 16:24:18 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-30b22484-126b-40b4-b414-458ea9c9b28b tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Connected to 172.16.0.220:3260 {{(pid=71731) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 16:24:18 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-30b22484-126b-40b4-b414-458ea9c9b28b tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] HCTL ('33', '-', '-', 0) found on session 18 with lun 0 {{(pid=71731) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 16:24:18 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-30b22484-126b-40b4-b414-458ea9c9b28b tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71731) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 16:24:18 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:24:18 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:24:18 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[65f93829-6804-440c-a93d-bac59d892572]: (4, ('- - 0', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:24:18 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-30b22484-126b-40b4-b414-458ea9c9b28b tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Searching for a device in session 18 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71731) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 16:24:18 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-30b22484-126b-40b4-b414-458ea9c9b28b tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:dc7649d3-fc59-438d-b230-72c4ce61e722', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RYfjcZaT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71731) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 16:24:19 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:24:19 user nova-compute[71731]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681403044.852492, db65920b-7872-44c1-a68a-a696681d9d95 => Stopped> {{(pid=71731) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 16:24:19 user nova-compute[71731]: INFO nova.compute.manager [-] [instance: db65920b-7872-44c1-a68a-a696681d9d95] VM Stopped (Lifecycle Event)
Apr 13 16:24:19 user nova-compute[71731]: DEBUG nova.compute.manager [None req-3752db73-55ea-4f3d-b2e0-b3c08c18d9c7 None None] [instance: db65920b-7872-44c1-a68a-a696681d9d95] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:24:19 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-30b22484-126b-40b4-b414-458ea9c9b28b tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.316s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 16:24:19 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-30b22484-126b-40b4-b414-458ea9c9b28b tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] <== connect_volume: return (1319ms) {'type': 'block', 'scsi_wwn': '23564346565386532', 'path': '/dev/sdb'} {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 16:24:19 user nova-compute[71731]: DEBUG nova.virt.libvirt.volume.iscsi [None req-30b22484-126b-40b4-b414-458ea9c9b28b tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] [instance: bbcccf4b-e861-4254-9be3-a491776214e9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23564346565386532', 'path': '/dev/sdb'} {{(pid=71731) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 16:24:19 user nova-compute[71731]: DEBUG nova.objects.instance [None req-30b22484-126b-40b4-b414-458ea9c9b28b tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Lazy-loading 'flavor' on Instance uuid bbcccf4b-e861-4254-9be3-a491776214e9 {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:24:20 user nova-compute[71731]: DEBUG nova.virt.libvirt.guest [None req-30b22484-126b-40b4-b414-458ea9c9b28b tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] attach device xml: <disk type="block" device="disk">
Apr 13 16:24:20 user nova-compute[71731]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 16:24:20 user nova-compute[71731]:   <source dev="/dev/sdb"/>
Apr 13 16:24:20 user nova-compute[71731]:   <target dev="vdb" bus="virtio"/>
Apr 13 16:24:20 user nova-compute[71731]:   <serial>dc7649d3-fc59-438d-b230-72c4ce61e722</serial>
Apr 13 16:24:20 user nova-compute[71731]: </disk>
Apr 13 16:24:20 user nova-compute[71731]:  {{(pid=71731) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 13 16:24:20 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-30b22484-126b-40b4-b414-458ea9c9b28b tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] No BDM found with device name vda, not building metadata. {{(pid=71731) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 16:24:20 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-30b22484-126b-40b4-b414-458ea9c9b28b tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71731) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 16:24:20 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-30b22484-126b-40b4-b414-458ea9c9b28b tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] No VIF found with MAC fa:16:3e:a3:40:f4, not building metadata {{(pid=71731) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 16:24:20 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-30b22484-126b-40b4-b414-458ea9c9b28b tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Lock "bbcccf4b-e861-4254-9be3-a491776214e9" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.840s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:24:21 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:24:21 user nova-compute[71731]: INFO nova.compute.manager [None req-c59aef75-fef8-4210-84c0-80f2cc4308a1 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] [instance: bbcccf4b-e861-4254-9be3-a491776214e9] Rescuing
Apr 13 16:24:21 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-c59aef75-fef8-4210-84c0-80f2cc4308a1 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Acquiring lock "refresh_cache-bbcccf4b-e861-4254-9be3-a491776214e9" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 16:24:21 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-c59aef75-fef8-4210-84c0-80f2cc4308a1 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Acquired lock "refresh_cache-bbcccf4b-e861-4254-9be3-a491776214e9" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 16:24:21 user nova-compute[71731]: DEBUG nova.network.neutron [None req-c59aef75-fef8-4210-84c0-80f2cc4308a1 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] [instance: bbcccf4b-e861-4254-9be3-a491776214e9] Building network info cache for instance {{(pid=71731) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 16:24:22 user nova-compute[71731]: DEBUG nova.network.neutron [None req-c59aef75-fef8-4210-84c0-80f2cc4308a1 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] [instance: bbcccf4b-e861-4254-9be3-a491776214e9] Updating instance_info_cache with network_info: [{"id": "dbb2bf27-5de3-499c-ba4d-87867912a143", "address": "fa:16:3e:a3:40:f4", "network": {"id": "5a4fe0b3-5f2f-4125-a17d-e2ff424bf01a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1835633180-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.81", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7061f2f041954ffe90b0c87b422890e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbb2bf27-5d", "ovs_interfaceid": "dbb2bf27-5de3-499c-ba4d-87867912a143", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:24:22 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-c59aef75-fef8-4210-84c0-80f2cc4308a1 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Releasing lock "refresh_cache-bbcccf4b-e861-4254-9be3-a491776214e9" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 16:24:22 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:24:22 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:24:22 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:24:22 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:24:22 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:24:22 user nova-compute[71731]: DEBUG nova.compute.manager [req-9fe30790-07da-4ff5-9e6c-69f187755605 req-f81a6b0d-76e2-42b2-a3d3-2c1fb64d7641 service nova] [instance: bbcccf4b-e861-4254-9be3-a491776214e9] Received event network-vif-unplugged-dbb2bf27-5de3-499c-ba4d-87867912a143 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:24:22 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-9fe30790-07da-4ff5-9e6c-69f187755605 req-f81a6b0d-76e2-42b2-a3d3-2c1fb64d7641 service nova] Acquiring lock "bbcccf4b-e861-4254-9be3-a491776214e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:24:22 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-9fe30790-07da-4ff5-9e6c-69f187755605 req-f81a6b0d-76e2-42b2-a3d3-2c1fb64d7641 service nova] Lock "bbcccf4b-e861-4254-9be3-a491776214e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:24:22 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-9fe30790-07da-4ff5-9e6c-69f187755605 req-f81a6b0d-76e2-42b2-a3d3-2c1fb64d7641 service nova] Lock "bbcccf4b-e861-4254-9be3-a491776214e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:24:22 user nova-compute[71731]: DEBUG nova.compute.manager [req-9fe30790-07da-4ff5-9e6c-69f187755605 req-f81a6b0d-76e2-42b2-a3d3-2c1fb64d7641 service nova] [instance: bbcccf4b-e861-4254-9be3-a491776214e9] No waiting events found dispatching network-vif-unplugged-dbb2bf27-5de3-499c-ba4d-87867912a143 {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:24:22 user nova-compute[71731]: WARNING nova.compute.manager [req-9fe30790-07da-4ff5-9e6c-69f187755605 req-f81a6b0d-76e2-42b2-a3d3-2c1fb64d7641 service nova] [instance: bbcccf4b-e861-4254-9be3-a491776214e9] Received unexpected event network-vif-unplugged-dbb2bf27-5de3-499c-ba4d-87867912a143 for instance with vm_state active and task_state rescuing.
Apr 13 16:24:23 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:24:23 user nova-compute[71731]: INFO nova.virt.libvirt.driver [-] [instance: bbcccf4b-e861-4254-9be3-a491776214e9] Instance destroyed successfully.
Apr 13 16:24:23 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-c59aef75-fef8-4210-84c0-80f2cc4308a1 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] [instance: bbcccf4b-e861-4254-9be3-a491776214e9] Attempting a stable device rescue
Apr 13 16:24:23 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-c59aef75-fef8-4210-84c0-80f2cc4308a1 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=71731) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4289}}
Apr 13 16:24:23 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-c59aef75-fef8-4210-84c0-80f2cc4308a1 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] [instance: bbcccf4b-e861-4254-9be3-a491776214e9] Instance directory exists: not creating {{(pid=71731) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 13 16:24:23 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-c59aef75-fef8-4210-84c0-80f2cc4308a1 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] [instance: bbcccf4b-e861-4254-9be3-a491776214e9] Creating image(s)
Apr 13 16:24:23 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-c59aef75-fef8-4210-84c0-80f2cc4308a1 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Acquiring lock "/opt/stack/data/nova/instances/bbcccf4b-e861-4254-9be3-a491776214e9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:24:23 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-c59aef75-fef8-4210-84c0-80f2cc4308a1 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Lock "/opt/stack/data/nova/instances/bbcccf4b-e861-4254-9be3-a491776214e9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:24:23 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-c59aef75-fef8-4210-84c0-80f2cc4308a1 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Lock "/opt/stack/data/nova/instances/bbcccf4b-e861-4254-9be3-a491776214e9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:24:23 user nova-compute[71731]: DEBUG nova.objects.instance [None req-c59aef75-fef8-4210-84c0-80f2cc4308a1 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Lazy-loading 'trusted_certs' on Instance uuid bbcccf4b-e861-4254-9be3-a491776214e9 {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:24:23 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-c59aef75-fef8-4210-84c0-80f2cc4308a1 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Acquiring lock "08557ca53db1a83b3e13823c8beddc4d0d9419cb" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:24:23 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-c59aef75-fef8-4210-84c0-80f2cc4308a1 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Lock "08557ca53db1a83b3e13823c8beddc4d0d9419cb" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:24:24 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-c59aef75-fef8-4210-84c0-80f2cc4308a1 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/08557ca53db1a83b3e13823c8beddc4d0d9419cb.part --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:24:24 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-c59aef75-fef8-4210-84c0-80f2cc4308a1 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/08557ca53db1a83b3e13823c8beddc4d0d9419cb.part --force-share --output=json" returned: 0 in 0.138s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:24:24 user nova-compute[71731]: DEBUG nova.virt.images [None req-c59aef75-fef8-4210-84c0-80f2cc4308a1 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] fe56253b-3d7f-43e5-9008-6d9c17385e97 was qcow2, converting to raw {{(pid=71731) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 13 16:24:24 user nova-compute[71731]: DEBUG nova.privsep.utils [None req-c59aef75-fef8-4210-84c0-80f2cc4308a1 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71731) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 13 16:24:24 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-c59aef75-fef8-4210-84c0-80f2cc4308a1 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/08557ca53db1a83b3e13823c8beddc4d0d9419cb.part /opt/stack/data/nova/instances/_base/08557ca53db1a83b3e13823c8beddc4d0d9419cb.converted {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:24:24 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:24:24 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-c59aef75-fef8-4210-84c0-80f2cc4308a1 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/08557ca53db1a83b3e13823c8beddc4d0d9419cb.part /opt/stack/data/nova/instances/_base/08557ca53db1a83b3e13823c8beddc4d0d9419cb.converted" returned: 0 in 0.142s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:24:24 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-c59aef75-fef8-4210-84c0-80f2cc4308a1 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/08557ca53db1a83b3e13823c8beddc4d0d9419cb.converted --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:24:24 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-c59aef75-fef8-4210-84c0-80f2cc4308a1 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/08557ca53db1a83b3e13823c8beddc4d0d9419cb.converted --force-share --output=json" returned: 0 in 0.149s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:24:24 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-c59aef75-fef8-4210-84c0-80f2cc4308a1 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Lock "08557ca53db1a83b3e13823c8beddc4d0d9419cb" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.153s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:24:24 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-c59aef75-fef8-4210-84c0-80f2cc4308a1 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Acquiring lock "08557ca53db1a83b3e13823c8beddc4d0d9419cb" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:24:24 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-c59aef75-fef8-4210-84c0-80f2cc4308a1 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Lock "08557ca53db1a83b3e13823c8beddc4d0d9419cb" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:24:24 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-c59aef75-fef8-4210-84c0-80f2cc4308a1 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/08557ca53db1a83b3e13823c8beddc4d0d9419cb --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:24:24 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-c59aef75-fef8-4210-84c0-80f2cc4308a1 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/08557ca53db1a83b3e13823c8beddc4d0d9419cb --force-share --output=json" returned: 0 in 0.152s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:24:24 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-c59aef75-fef8-4210-84c0-80f2cc4308a1 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/08557ca53db1a83b3e13823c8beddc4d0d9419cb,backing_fmt=raw /opt/stack/data/nova/instances/bbcccf4b-e861-4254-9be3-a491776214e9/disk.rescue {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:24:24 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-c59aef75-fef8-4210-84c0-80f2cc4308a1 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/08557ca53db1a83b3e13823c8beddc4d0d9419cb,backing_fmt=raw /opt/stack/data/nova/instances/bbcccf4b-e861-4254-9be3-a491776214e9/disk.rescue" returned: 0 in 0.092s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:24:24 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-c59aef75-fef8-4210-84c0-80f2cc4308a1 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Lock "08557ca53db1a83b3e13823c8beddc4d0d9419cb" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.252s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:24:24 user nova-compute[71731]: DEBUG nova.objects.instance [None req-c59aef75-fef8-4210-84c0-80f2cc4308a1 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Lazy-loading 'migration_context' on Instance uuid bbcccf4b-e861-4254-9be3-a491776214e9 {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:24:24 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-c59aef75-fef8-4210-84c0-80f2cc4308a1 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] [instance: bbcccf4b-e861-4254-9be3-a491776214e9] Created local disks {{(pid=71731) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 16:24:24 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-c59aef75-fef8-4210-84c0-80f2cc4308a1 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] [instance: bbcccf4b-e861-4254-9be3-a491776214e9] Start _get_guest_xml network_info=[{"id": "dbb2bf27-5de3-499c-ba4d-87867912a143", "address": "fa:16:3e:a3:40:f4", "network": {"id": "5a4fe0b3-5f2f-4125-a17d-e2ff424bf01a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1835633180-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.81", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1835633180-network", "vif_mac": "fa:16:3e:a3:40:f4"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7061f2f041954ffe90b0c87b422890e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbb2bf27-5d", "ovs_interfaceid": "dbb2bf27-5de3-499c-ba4d-87867912a143", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T16:16:31Z,direct_url=<?>,disk_format='qcow2',id=708622a9-7465-4492-ade8-b827198f7e30,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='0b29a975c552465aba0ac7d6288434bd',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T16:16:33Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'fe56253b-3d7f-43e5-9008-6d9c17385e97', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'device_type': 'disk', 'encrypted': False, 'disk_bus': 'virtio', 'guest_format': None, 'encryption_options': None, 'image_id': '708622a9-7465-4492-ade8-b827198f7e30'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'attachment_id': 'c607331b-ce14-4424-974c-268dcf3dc72f', 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:dc7649d3-fc59-438d-b230-72c4ce61e722', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RYfjcZaT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': 'bbcccf4b-e861-4254-9be3-a491776214e9', 'attached_at': '', 'detached_at': '', 'volume_id': 'dc7649d3-fc59-438d-b230-72c4ce61e722', 'serial': 'dc7649d3-fc59-438d-b230-72c4ce61e722'}, 'disk_bus': 'virtio', 'guest_format': None, 'volume_type': None} {{(pid=71731) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 16:24:24 user nova-compute[71731]: DEBUG nova.objects.instance [None req-c59aef75-fef8-4210-84c0-80f2cc4308a1 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Lazy-loading 'resources' on Instance uuid bbcccf4b-e861-4254-9be3-a491776214e9 {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:24:24 user nova-compute[71731]: DEBUG nova.objects.instance [None req-c59aef75-fef8-4210-84c0-80f2cc4308a1 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Lazy-loading 'numa_topology' on Instance uuid bbcccf4b-e861-4254-9be3-a491776214e9 {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:24:24 user nova-compute[71731]: DEBUG nova.compute.manager [req-bdd3a409-88f6-4d3c-b631-1f9c02bc4d39 req-6ba1115f-f3e0-4236-9f3e-061b7cf8f1f9 service nova] [instance: bbcccf4b-e861-4254-9be3-a491776214e9] Received event network-vif-plugged-dbb2bf27-5de3-499c-ba4d-87867912a143 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:24:24 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-bdd3a409-88f6-4d3c-b631-1f9c02bc4d39 req-6ba1115f-f3e0-4236-9f3e-061b7cf8f1f9 service nova] Acquiring lock "bbcccf4b-e861-4254-9be3-a491776214e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:24:24 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-bdd3a409-88f6-4d3c-b631-1f9c02bc4d39 req-6ba1115f-f3e0-4236-9f3e-061b7cf8f1f9 service nova] Lock "bbcccf4b-e861-4254-9be3-a491776214e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:24:24 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-bdd3a409-88f6-4d3c-b631-1f9c02bc4d39 req-6ba1115f-f3e0-4236-9f3e-061b7cf8f1f9 service nova] Lock "bbcccf4b-e861-4254-9be3-a491776214e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:24:24 user nova-compute[71731]: DEBUG nova.compute.manager [req-bdd3a409-88f6-4d3c-b631-1f9c02bc4d39 req-6ba1115f-f3e0-4236-9f3e-061b7cf8f1f9 service nova] [instance: bbcccf4b-e861-4254-9be3-a491776214e9] No waiting events found dispatching network-vif-plugged-dbb2bf27-5de3-499c-ba4d-87867912a143 {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:24:24 user nova-compute[71731]: WARNING nova.compute.manager [req-bdd3a409-88f6-4d3c-b631-1f9c02bc4d39 req-6ba1115f-f3e0-4236-9f3e-061b7cf8f1f9 service nova] [instance: bbcccf4b-e861-4254-9be3-a491776214e9] Received unexpected event network-vif-plugged-dbb2bf27-5de3-499c-ba4d-87867912a143 for instance with vm_state active and task_state rescuing.
Apr 13 16:24:24 user nova-compute[71731]: WARNING nova.virt.libvirt.driver [None req-c59aef75-fef8-4210-84c0-80f2cc4308a1 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 16:24:24 user nova-compute[71731]: WARNING nova.virt.libvirt.driver [None req-c59aef75-fef8-4210-84c0-80f2cc4308a1 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 16:24:24 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-c59aef75-fef8-4210-84c0-80f2cc4308a1 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71731) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 16:24:24 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-c59aef75-fef8-4210-84c0-80f2cc4308a1 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T16:17:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T16:16:31Z,direct_url=<?>,disk_format='qcow2',id=708622a9-7465-4492-ade8-b827198f7e30,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='0b29a975c552465aba0ac7d6288434bd',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T16:16:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 16:24:24 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-c59aef75-fef8-4210-84c0-80f2cc4308a1 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Flavor limits 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 16:24:24 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-c59aef75-fef8-4210-84c0-80f2cc4308a1 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Image limits 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 16:24:24 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-c59aef75-fef8-4210-84c0-80f2cc4308a1 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Flavor pref 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 16:24:24 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-c59aef75-fef8-4210-84c0-80f2cc4308a1 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Image pref 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 16:24:24 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-c59aef75-fef8-4210-84c0-80f2cc4308a1 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 16:24:24 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-c59aef75-fef8-4210-84c0-80f2cc4308a1 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 16:24:24 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-c59aef75-fef8-4210-84c0-80f2cc4308a1 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71731) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 16:24:24 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-c59aef75-fef8-4210-84c0-80f2cc4308a1 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Got 1 possible topologies {{(pid=71731) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 16:24:24 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-c59aef75-fef8-4210-84c0-80f2cc4308a1 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 16:24:24 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-c59aef75-fef8-4210-84c0-80f2cc4308a1 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 16:24:24 user nova-compute[71731]: DEBUG nova.objects.instance [None req-c59aef75-fef8-4210-84c0-80f2cc4308a1 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Lazy-loading 'vcpu_model' on Instance uuid bbcccf4b-e861-4254-9be3-a491776214e9 {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:24:24 user nova-compute[71731]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c59aef75-fef8-4210-84c0-80f2cc4308a1 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] [instance: bbcccf4b-e861-4254-9be3-a491776214e9] Calling os-brick to attach iSCSI Volume {{(pid=71731) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 16:24:24 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-c59aef75-fef8-4210-84c0-80f2cc4308a1 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8cf0118790>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:dc7649d3-fc59-438d-b230-72c4ce61e722', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RYfjcZaT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 16:24:24 user nova-compute[71731]: WARNING os_brick.initiator.connectors.base [None req-c59aef75-fef8-4210-84c0-80f2cc4308a1 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 16:24:24 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-c59aef75-fef8-4210-84c0-80f2cc4308a1 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 16:24:24 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-c59aef75-fef8-4210-84c0-80f2cc4308a1 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 16:24:24 user nova-compute[71731]: WARNING os_brick.initiator.connectors.base [None req-c59aef75-fef8-4210-84c0-80f2cc4308a1 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 16:24:24 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-c59aef75-fef8-4210-84c0-80f2cc4308a1 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dc7649d3-fc59-438d-b230-72c4ce61e722" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 16:24:24 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-c59aef75-fef8-4210-84c0-80f2cc4308a1 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dc7649d3-fc59-438d-b230-72c4ce61e722" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 16:24:24 user nova-compute[71731]: INFO os_brick.initiator.connectors.iscsi [None req-c59aef75-fef8-4210-84c0-80f2cc4308a1 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 16:24:24 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc7649d3-fc59-438d-b230-72c4ce61e722 -p 172.16.0.220:3260 {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:24:24 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc7649d3-fc59-438d-b230-72c4ce61e722 -p 172.16.0.220:3260" returned: 0 in 0.020s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:24:24 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4f048d3-cae0-4f77-93e7-9d4026b74ef3]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:dc7649d3-fc59-438d-b230-72c4ce61e722\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = RYfjcZaT\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:24:24 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-c59aef75-fef8-4210-84c0-80f2cc4308a1 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Apr 13 16:24:24 user nova-compute[71731]: node.name = iqn.2010-10.org.openstack:dc7649d3-fc59-438d-b230-72c4ce61e722
Apr 13 16:24:24 user nova-compute[71731]: node.tpgt = -1
Apr 13 16:24:24 user nova-compute[71731]: node.startup = automatic
Apr 13 16:24:24 user nova-compute[71731]: node.leading_login = No
Apr 13 16:24:24 user nova-compute[71731]: iface.iscsi_ifacename = default
Apr 13 16:24:24 user nova-compute[71731]: iface.net_ifacename = <empty>
Apr 13 16:24:24 user nova-compute[71731]: iface.ipaddress = <empty>
Apr 13 16:24:24 user nova-compute[71731]: iface.prefix_len = 0
Apr 13 16:24:24 user nova-compute[71731]: iface.hwaddress = <empty>
Apr 13 16:24:24 user nova-compute[71731]: iface.transport_name = tcp
Apr 13 16:24:24 user nova-compute[71731]: iface.initiatorname = <empty>
Apr 13 16:24:24 user nova-compute[71731]: iface.state = <empty>
Apr 13 16:24:24 user nova-compute[71731]: iface.vlan_id = 0
Apr 13 16:24:24 user nova-compute[71731]: iface.vlan_priority = 0
Apr 13 16:24:24 user nova-compute[71731]: iface.vlan_state = <empty>
Apr 13 16:24:24 user nova-compute[71731]: iface.iface_num = 0
Apr 13 16:24:24 user nova-compute[71731]: iface.mtu = 0
Apr 13 16:24:24 user nova-compute[71731]: iface.port = 0
Apr 13 16:24:24 user nova-compute[71731]: iface.bootproto = <empty>
Apr 13 16:24:24 user nova-compute[71731]: iface.subnet_mask = <empty>
Apr 13 16:24:24 user nova-compute[71731]: iface.gateway = <empty>
Apr 13 16:24:24 user nova-compute[71731]: iface.dhcp_alt_client_id_state = <empty>
Apr 13 16:24:24 user nova-compute[71731]: iface.dhcp_alt_client_id = <empty>
Apr 13 16:24:24 user nova-compute[71731]: iface.dhcp_dns = <empty>
Apr 13 16:24:24 user nova-compute[71731]: iface.dhcp_learn_iqn = <empty>
Apr 13 16:24:24 user nova-compute[71731]: iface.dhcp_req_vendor_id_state = <empty>
Apr 13 16:24:24 user nova-compute[71731]: iface.dhcp_vendor_id_state = <empty>
Apr 13 16:24:24 user nova-compute[71731]: iface.dhcp_vendor_id = <empty>
Apr 13 16:24:24 user nova-compute[71731]: iface.dhcp_slp_da = <empty>
Apr 13 16:24:24 user nova-compute[71731]: iface.fragmentation = <empty>
Apr 13 16:24:24 user nova-compute[71731]: iface.gratuitous_arp = <empty>
Apr 13 16:24:24 user nova-compute[71731]: iface.incoming_forwarding = <empty>
Apr 13 16:24:24 user nova-compute[71731]: iface.tos_state = <empty>
Apr 13 16:24:24 user nova-compute[71731]: iface.tos = 0
Apr 13 16:24:24 user nova-compute[71731]: iface.ttl = 0
Apr 13 16:24:24 user nova-compute[71731]: iface.delayed_ack = <empty>
Apr 13 16:24:24 user nova-compute[71731]: iface.tcp_nagle = <empty>
Apr 13 16:24:24 user nova-compute[71731]: iface.tcp_wsf_state = <empty>
Apr 13 16:24:24 user nova-compute[71731]: iface.tcp_wsf = 0
Apr 13 16:24:24 user nova-compute[71731]: iface.tcp_timer_scale = 0
Apr 13 16:24:24 user nova-compute[71731]: iface.tcp_timestamp = <empty>
Apr 13 16:24:24 user nova-compute[71731]: iface.redirect = <empty>
Apr 13 16:24:24 user nova-compute[71731]: iface.def_task_mgmt_timeout = 0
Apr 13 16:24:24 user nova-compute[71731]: iface.header_digest = <empty>
Apr 13 16:24:24 user nova-compute[71731]: iface.data_digest = <empty>
Apr 13 16:24:24 user nova-compute[71731]: iface.immediate_data = <empty>
Apr 13 16:24:24 user nova-compute[71731]: iface.initial_r2t = <empty>
Apr 13 16:24:24 user nova-compute[71731]: iface.data_seq_inorder = <empty>
Apr 13 16:24:24 user nova-compute[71731]: iface.data_pdu_inorder = <empty>
Apr 13 16:24:24 user nova-compute[71731]: iface.erl = 0
Apr 13 16:24:24 user nova-compute[71731]: iface.max_receive_data_len = 0
Apr 13 16:24:24 user nova-compute[71731]: iface.first_burst_len = 0
Apr 13 16:24:24 user nova-compute[71731]: iface.max_outstanding_r2t = 0
Apr 13 16:24:24 user nova-compute[71731]: iface.max_burst_len = 0
Apr 13 16:24:24 user nova-compute[71731]: iface.chap_auth = <empty>
Apr 13 16:24:24 user nova-compute[71731]: iface.bidi_chap = <empty>
Apr 13 16:24:24 user nova-compute[71731]: iface.strict_login_compliance = <empty>
Apr 13 16:24:24 user nova-compute[71731]: iface.discovery_auth = <empty>
Apr 13 16:24:24 user nova-compute[71731]: iface.discovery_logout = <empty>
Apr 13 16:24:24 user nova-compute[71731]: node.discovery_address = <empty>
Apr 13 16:24:24 user nova-compute[71731]: node.discovery_port = 0
Apr 13 16:24:24 user nova-compute[71731]: node.discovery_type = static
Apr 13 16:24:24 user nova-compute[71731]: node.session.initial_cmdsn = 0
Apr 13 16:24:24 user nova-compute[71731]: node.session.initial_login_retry_max = 8
Apr 13 16:24:24 user nova-compute[71731]: node.session.xmit_thread_priority = -20
Apr 13 16:24:24 user nova-compute[71731]: node.session.cmds_max = 128
Apr 13 16:24:24 user nova-compute[71731]: node.session.queue_depth = 32
Apr 13 16:24:24 user nova-compute[71731]: node.session.nr_sessions = 1
Apr 13 16:24:24 user nova-compute[71731]: node.session.auth.authmethod = CHAP
Apr 13 16:24:24 user nova-compute[71731]: node.session.auth.username = RYfjcZaT
Apr 13 16:24:24 user nova-compute[71731]: node.session.auth.password = ***
Apr 13 16:24:24 user nova-compute[71731]: node.session.auth.username_in = <empty>
Apr 13 16:24:24 user nova-compute[71731]: node.session.auth.password_in = <empty>
Apr 13 16:24:24 user nova-compute[71731]: node.session.auth.chap_algs = MD5
Apr 13 16:24:24 user nova-compute[71731]: node.session.timeo.replacement_timeout = 120
Apr 13 16:24:24 user nova-compute[71731]: node.session.err_timeo.abort_timeout = 15
Apr 13 16:24:24 user nova-compute[71731]: node.session.err_timeo.lu_reset_timeout = 30
Apr 13 16:24:24 user nova-compute[71731]: node.session.err_timeo.tgt_reset_timeout = 30
Apr 13 16:24:24 user nova-compute[71731]: node.session.err_timeo.host_reset_timeout = 60
Apr 13 16:24:24 user nova-compute[71731]: node.session.iscsi.FastAbort = Yes
Apr 13 16:24:24 user nova-compute[71731]: node.session.iscsi.InitialR2T = No
Apr 13 16:24:24 user nova-compute[71731]: node.session.iscsi.ImmediateData = Yes
Apr 13 16:24:24 user nova-compute[71731]: node.session.iscsi.FirstBurstLength = 262144
Apr 13 16:24:24 user nova-compute[71731]: node.session.iscsi.MaxBurstLength = 16776192
Apr 13 16:24:24 user nova-compute[71731]: node.session.iscsi.DefaultTime2Retain = 0
Apr 13 16:24:24 user nova-compute[71731]: node.session.iscsi.DefaultTime2Wait = 2
Apr 13 16:24:24 user nova-compute[71731]: node.session.iscsi.MaxConnections = 1
Apr 13 16:24:24 user nova-compute[71731]: node.session.iscsi.MaxOutstandingR2T = 1
Apr 13 16:24:24 user nova-compute[71731]: node.session.iscsi.ERL = 0
Apr 13 16:24:24 user nova-compute[71731]: node.session.scan = manual
Apr 13 16:24:24 user nova-compute[71731]: node.session.reopen_max = 0
Apr 13 16:24:24 user nova-compute[71731]: node.conn[0].address = 172.16.0.220
Apr 13 16:24:24 user nova-compute[71731]: node.conn[0].port = 3260
Apr 13 16:24:24 user nova-compute[71731]: node.conn[0].startup = manual
Apr 13 16:24:24 user nova-compute[71731]: node.conn[0].tcp.window_size = 524288
Apr 13 16:24:24 user nova-compute[71731]: node.conn[0].tcp.type_of_service = 0
Apr 13 16:24:24 user nova-compute[71731]: node.conn[0].timeo.logout_timeout = 15
Apr 13 16:24:24 user nova-compute[71731]: node.conn[0].timeo.login_timeout = 15
Apr 13 16:24:24 user nova-compute[71731]: node.conn[0].timeo.auth_timeout = 45
Apr 13 16:24:24 user nova-compute[71731]: node.conn[0].timeo.noop_out_interval = 5
Apr 13 16:24:24 user nova-compute[71731]: node.conn[0].timeo.noop_out_timeout = 5
Apr 13 16:24:24 user nova-compute[71731]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Apr 13 16:24:24 user nova-compute[71731]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Apr 13 16:24:24 user nova-compute[71731]: node.conn[0].iscsi.HeaderDigest = None
Apr 13 16:24:24 user nova-compute[71731]: node.conn[0].iscsi.DataDigest = None
Apr 13 16:24:24 user nova-compute[71731]: node.conn[0].iscsi.IFMarker = No
Apr 13 16:24:24 user nova-compute[71731]: node.conn[0].iscsi.OFMarker = No
Apr 13 16:24:24 user nova-compute[71731]: # END RECORD
Apr 13 16:24:24 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:24:24 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc7649d3-fc59-438d-b230-72c4ce61e722 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:24:24 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc7649d3-fc59-438d-b230-72c4ce61e722 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:24:24 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aa1776d-baac-43e0-8658-7d65a1699284]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:24:24 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-c59aef75-fef8-4210-84c0-80f2cc4308a1 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:24:24 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc7649d3-fc59-438d-b230-72c4ce61e722 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:24:24 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc7649d3-fc59-438d-b230-72c4ce61e722 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:24:24 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[a976927b-5153-4baf-b0e5-ee423b843334]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:24:24 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-c59aef75-fef8-4210-84c0-80f2cc4308a1 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:24:24 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc7649d3-fc59-438d-b230-72c4ce61e722 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RYfjcZaT {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:24:24 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc7649d3-fc59-438d-b230-72c4ce61e722 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RYfjcZaT" returned: 0 in 0.020s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:24:24 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa298756-b539-4e7e-bc96-ea62cd286e20]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:24:24 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-c59aef75-fef8-4210-84c0-80f2cc4308a1 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RYfjcZaT'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:24:24 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc7649d3-fc59-438d-b230-72c4ce61e722 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:24:25 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc7649d3-fc59-438d-b230-72c4ce61e722 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:24:25 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[86d40da2-6093-4bef-ac05-70cceb332d0b]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:24:25 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-c59aef75-fef8-4210-84c0-80f2cc4308a1 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:24:25 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:24:25 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:24:25 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce8411d6-e2a8-4e0b-80c0-17e7c3607031]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc7649d3-fc59-438d-b230-72c4ce61e722 (non-flash)\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:24:25 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-c59aef75-fef8-4210-84c0-80f2cc4308a1 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)
Apr 13 16:24:25 user nova-compute[71731]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc7649d3-fc59-438d-b230-72c4ce61e722 (non-flash)
Apr 13 16:24:25 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 16:24:25 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-c59aef75-fef8-4210-84c0-80f2cc4308a1 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)
Apr 13 16:24:25 user nova-compute[71731]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc7649d3-fc59-438d-b230-72c4ce61e722 (non-flash)
Apr 13 16:24:25 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 16:24:25 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-c59aef75-fef8-4210-84c0-80f2cc4308a1 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dc7649d3-fc59-438d-b230-72c4ce61e722" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.156s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 16:24:25 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-c59aef75-fef8-4210-84c0-80f2cc4308a1 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Connected to 172.16.0.220:3260 {{(pid=71731) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 16:24:25 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-c59aef75-fef8-4210-84c0-80f2cc4308a1 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] HCTL ('33', '0', '0', 0) found on session 18 with lun 0 {{(pid=71731) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 16:24:25 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-c59aef75-fef8-4210-84c0-80f2cc4308a1 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=71731) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 16:24:25 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:24:25 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.013s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:24:25 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1708c4a-e6c0-42b3-8f45-9f297b556480]: (4, ('0 0 0', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:24:25 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-c59aef75-fef8-4210-84c0-80f2cc4308a1 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Searching for a device in session 18 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=71731) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 16:24:25 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-c59aef75-fef8-4210-84c0-80f2cc4308a1 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:dc7649d3-fc59-438d-b230-72c4ce61e722', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RYfjcZaT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=71731) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 16:24:25 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-c59aef75-fef8-4210-84c0-80f2cc4308a1 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.178s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 16:24:25 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-c59aef75-fef8-4210-84c0-80f2cc4308a1 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] <== connect_volume: return (179ms) {'type': 'block', 'scsi_wwn': '23564346565386532', 'path': '/dev/sdb'} {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 16:24:25 user nova-compute[71731]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c59aef75-fef8-4210-84c0-80f2cc4308a1 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] [instance: bbcccf4b-e861-4254-9be3-a491776214e9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23564346565386532', 'path': '/dev/sdb'} {{(pid=71731) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 16:24:25 user nova-compute[71731]: DEBUG nova.virt.libvirt.vif [None req-c59aef75-fef8-4210-84c0-80f2cc4308a1 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T16:20:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1807441960',display_name='tempest-ServerStableDeviceRescueTest-server-1807441960',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1807441960',id=4,image_ref='708622a9-7465-4492-ade8-b827198f7e30',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBssL1q8UrRqcNBzubLNJC8k8DaqQcRK2ysRGrjAyXNJmaI+jOCwcCVXwOavhCNGPOMX3O9mQsDrY3mOGMrByAQWchmBUsGQlz9ppSMT6HadSQb/fuBY4fFJZdDXCx7D8g==',key_name='tempest-keypair-900897003',keypairs=<?>,launch_index=0,launched_at=2023-04-13T16:20:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7061f2f041954ffe90b0c87b422890e4',ramdisk_id='',reservation_id='r-zcqb1d1h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='708622a9-7465-4492-ade8-b827198f7e30',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1182397334',owner_user_name='tempest-ServerStableDeviceRescueTest-1182397334-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T16:22:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9bf19848229f45baad45c490cf539508',uuid=bbcccf4b-e861-4254-9be3-a491776214e9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dbb2bf27-5de3-499c-ba4d-87867912a143", "address": "fa:16:3e:a3:40:f4", "network": {"id": "5a4fe0b3-5f2f-4125-a17d-e2ff424bf01a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1835633180-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.81", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1835633180-network", "vif_mac": "fa:16:3e:a3:40:f4"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7061f2f041954ffe90b0c87b422890e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbb2bf27-5d", "ovs_interfaceid": "dbb2bf27-5de3-499c-ba4d-87867912a143", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71731) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 16:24:25 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-c59aef75-fef8-4210-84c0-80f2cc4308a1 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Converting VIF {"id": "dbb2bf27-5de3-499c-ba4d-87867912a143", "address": "fa:16:3e:a3:40:f4", "network": {"id": "5a4fe0b3-5f2f-4125-a17d-e2ff424bf01a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1835633180-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.81", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1835633180-network", "vif_mac": "fa:16:3e:a3:40:f4"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7061f2f041954ffe90b0c87b422890e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbb2bf27-5d", "ovs_interfaceid": "dbb2bf27-5de3-499c-ba4d-87867912a143", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 16:24:25 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-c59aef75-fef8-4210-84c0-80f2cc4308a1 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a3:40:f4,bridge_name='br-int',has_traffic_filtering=True,id=dbb2bf27-5de3-499c-ba4d-87867912a143,network=Network(5a4fe0b3-5f2f-4125-a17d-e2ff424bf01a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbb2bf27-5d') {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 16:24:25 user nova-compute[71731]: DEBUG nova.objects.instance [None req-c59aef75-fef8-4210-84c0-80f2cc4308a1 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Lazy-loading 'pci_devices' on Instance uuid bbcccf4b-e861-4254-9be3-a491776214e9 {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:24:25 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-c59aef75-fef8-4210-84c0-80f2cc4308a1 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] [instance: bbcccf4b-e861-4254-9be3-a491776214e9] End _get_guest_xml xml=<domain type="kvm">
Apr 13 16:24:25 user nova-compute[71731]:   <uuid>bbcccf4b-e861-4254-9be3-a491776214e9</uuid>
Apr 13 16:24:25 user nova-compute[71731]:   <name>instance-00000004</name>
Apr 13 16:24:25 user nova-compute[71731]:   <memory>131072</memory>
Apr 13 16:24:25 user nova-compute[71731]:   <vcpu>1</vcpu>
Apr 13 16:24:25 user nova-compute[71731]:   <metadata>
Apr 13 16:24:25 user nova-compute[71731]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 16:24:25 user nova-compute[71731]:       <nova:package version="0.0.0"/>
Apr 13 16:24:25 user nova-compute[71731]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1807441960</nova:name>
Apr 13 16:24:25 user nova-compute[71731]:       <nova:creationTime>2023-04-13 16:24:24</nova:creationTime>
Apr 13 16:24:25 user nova-compute[71731]:       <nova:flavor name="m1.nano">
Apr 13 16:24:25 user nova-compute[71731]:         <nova:memory>128</nova:memory>
Apr 13 16:24:25 user nova-compute[71731]:         <nova:disk>1</nova:disk>
Apr 13 16:24:25 user nova-compute[71731]:         <nova:swap>0</nova:swap>
Apr 13 16:24:25 user nova-compute[71731]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 16:24:25 user nova-compute[71731]:         <nova:vcpus>1</nova:vcpus>
Apr 13 16:24:25 user nova-compute[71731]:       </nova:flavor>
Apr 13 16:24:25 user nova-compute[71731]:       <nova:owner>
Apr 13 16:24:25 user nova-compute[71731]:         <nova:user uuid="9bf19848229f45baad45c490cf539508">tempest-ServerStableDeviceRescueTest-1182397334-project-member</nova:user>
Apr 13 16:24:25 user nova-compute[71731]:         <nova:project uuid="7061f2f041954ffe90b0c87b422890e4">tempest-ServerStableDeviceRescueTest-1182397334</nova:project>
Apr 13 16:24:25 user nova-compute[71731]:       </nova:owner>
Apr 13 16:24:25 user nova-compute[71731]:       <nova:root type="image" uuid="708622a9-7465-4492-ade8-b827198f7e30"/>
Apr 13 16:24:25 user nova-compute[71731]:       <nova:ports>
Apr 13 16:24:25 user nova-compute[71731]:         <nova:port uuid="dbb2bf27-5de3-499c-ba4d-87867912a143">
Apr 13 16:24:25 user nova-compute[71731]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Apr 13 16:24:25 user nova-compute[71731]:         </nova:port>
Apr 13 16:24:25 user nova-compute[71731]:       </nova:ports>
Apr 13 16:24:25 user nova-compute[71731]:     </nova:instance>
Apr 13 16:24:25 user nova-compute[71731]:   </metadata>
Apr 13 16:24:25 user nova-compute[71731]:   <sysinfo type="smbios">
Apr 13 16:24:25 user nova-compute[71731]:     <system>
Apr 13 16:24:25 user nova-compute[71731]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 16:24:25 user nova-compute[71731]:       <entry name="product">OpenStack Nova</entry>
Apr 13 16:24:25 user nova-compute[71731]:       <entry name="version">0.0.0</entry>
Apr 13 16:24:25 user nova-compute[71731]:       <entry name="serial">bbcccf4b-e861-4254-9be3-a491776214e9</entry>
Apr 13 16:24:25 user nova-compute[71731]:       <entry name="uuid">bbcccf4b-e861-4254-9be3-a491776214e9</entry>
Apr 13 16:24:25 user nova-compute[71731]:       <entry name="family">Virtual Machine</entry>
Apr 13 16:24:25 user nova-compute[71731]:     </system>
Apr 13 16:24:25 user nova-compute[71731]:   </sysinfo>
Apr 13 16:24:25 user nova-compute[71731]:   <os>
Apr 13 16:24:25 user nova-compute[71731]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 16:24:25 user nova-compute[71731]:     <smbios mode="sysinfo"/>
Apr 13 16:24:25 user nova-compute[71731]:   </os>
Apr 13 16:24:25 user nova-compute[71731]:   <features>
Apr 13 16:24:25 user nova-compute[71731]:     <acpi/>
Apr 13 16:24:25 user nova-compute[71731]:     <apic/>
Apr 13 16:24:25 user nova-compute[71731]:     <vmcoreinfo/>
Apr 13 16:24:25 user nova-compute[71731]:   </features>
Apr 13 16:24:25 user nova-compute[71731]:   <clock offset="utc">
Apr 13 16:24:25 user nova-compute[71731]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 16:24:25 user nova-compute[71731]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 16:24:25 user nova-compute[71731]:     <timer name="hpet" present="no"/>
Apr 13 16:24:25 user nova-compute[71731]:   </clock>
Apr 13 16:24:25 user nova-compute[71731]:   <cpu mode="custom" match="exact">
Apr 13 16:24:25 user nova-compute[71731]:     <model>Nehalem</model>
Apr 13 16:24:25 user nova-compute[71731]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 16:24:25 user nova-compute[71731]:   </cpu>
Apr 13 16:24:25 user nova-compute[71731]:   <devices>
Apr 13 16:24:25 user nova-compute[71731]:     <disk type="file" device="disk">
Apr 13 16:24:25 user nova-compute[71731]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 16:24:25 user nova-compute[71731]:       <source file="/opt/stack/data/nova/instances/bbcccf4b-e861-4254-9be3-a491776214e9/disk"/>
Apr 13 16:24:25 user nova-compute[71731]:       <target dev="vda" bus="virtio"/>
Apr 13 16:24:25 user nova-compute[71731]:     </disk>
Apr 13 16:24:25 user nova-compute[71731]:     <disk type="block" device="disk">
Apr 13 16:24:25 user nova-compute[71731]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 16:24:25 user nova-compute[71731]:       <source dev="/dev/sdb"/>
Apr 13 16:24:25 user nova-compute[71731]:       <target dev="vdb" bus="virtio"/>
Apr 13 16:24:25 user nova-compute[71731]:       <serial>dc7649d3-fc59-438d-b230-72c4ce61e722</serial>
Apr 13 16:24:25 user nova-compute[71731]:     </disk>
Apr 13 16:24:25 user nova-compute[71731]:     <disk type="file" device="disk">
Apr 13 16:24:25 user nova-compute[71731]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 16:24:25 user nova-compute[71731]:       <source file="/opt/stack/data/nova/instances/bbcccf4b-e861-4254-9be3-a491776214e9/disk.rescue"/>
Apr 13 16:24:25 user nova-compute[71731]:       <target dev="vdc" bus="virtio"/>
Apr 13 16:24:25 user nova-compute[71731]:       <boot order="1"/>
Apr 13 16:24:25 user nova-compute[71731]:     </disk>
Apr 13 16:24:25 user nova-compute[71731]:     <interface type="ethernet">
Apr 13 16:24:25 user nova-compute[71731]:       <mac address="fa:16:3e:a3:40:f4"/>
Apr 13 16:24:25 user nova-compute[71731]:       <model type="virtio"/>
Apr 13 16:24:25 user nova-compute[71731]:       <mtu size="1442"/>
Apr 13 16:24:25 user nova-compute[71731]:       <target dev="tapdbb2bf27-5d"/>
Apr 13 16:24:25 user nova-compute[71731]:     </interface>
Apr 13 16:24:25 user nova-compute[71731]:     <serial type="pty">
Apr 13 16:24:25 user nova-compute[71731]:       <log file="/opt/stack/data/nova/instances/bbcccf4b-e861-4254-9be3-a491776214e9/console.log" append="off"/>
Apr 13 16:24:25 user nova-compute[71731]:     </serial>
Apr 13 16:24:25 user nova-compute[71731]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 16:24:25 user nova-compute[71731]:     <video>
Apr 13 16:24:25 user nova-compute[71731]:       <model type="virtio"/>
Apr 13 16:24:25 user nova-compute[71731]:     </video>
Apr 13 16:24:25 user nova-compute[71731]:     <rng model="virtio">
Apr 13 16:24:25 user nova-compute[71731]:       <backend model="random">/dev/urandom</backend>
Apr 13 16:24:25 user nova-compute[71731]:     </rng>
Apr 13 16:24:25 user nova-compute[71731]:     <controller type="usb" index="0" model="none"/>
Apr 13 16:24:25 user nova-compute[71731]:     <memballoon model="virtio">
Apr 13 16:24:25 user nova-compute[71731]:       <stats period="10"/>
Apr 13 16:24:25 user nova-compute[71731]:     </memballoon>
Apr 13 16:24:25 user nova-compute[71731]:   </devices>
Apr 13 16:24:25 user nova-compute[71731]: </domain>
Apr 13 16:24:25 user nova-compute[71731]:  {{(pid=71731) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 16:24:25 user nova-compute[71731]: INFO nova.virt.libvirt.driver [-] [instance: bbcccf4b-e861-4254-9be3-a491776214e9] Instance destroyed successfully.
Apr 13 16:24:25 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-c59aef75-fef8-4210-84c0-80f2cc4308a1 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] No BDM found with device name vda, not building metadata. {{(pid=71731) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 16:24:25 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-c59aef75-fef8-4210-84c0-80f2cc4308a1 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71731) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 16:24:25 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-c59aef75-fef8-4210-84c0-80f2cc4308a1 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] No BDM found with device name vdc, not building metadata. {{(pid=71731) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 16:24:25 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-c59aef75-fef8-4210-84c0-80f2cc4308a1 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] No VIF found with MAC fa:16:3e:a3:40:f4, not building metadata {{(pid=71731) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 16:24:25 user nova-compute[71731]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681403050.988284, 8c6d8096-853b-4091-ad82-6faf8ffc85fa => Stopped> {{(pid=71731) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 16:24:25 user nova-compute[71731]: INFO nova.compute.manager [-] [instance: 8c6d8096-853b-4091-ad82-6faf8ffc85fa] VM Stopped (Lifecycle Event)
Apr 13 16:24:26 user nova-compute[71731]: DEBUG nova.compute.manager [None req-cd1c2b36-0aa7-404a-a08b-c0b3f80d22e7 None None] [instance: 8c6d8096-853b-4091-ad82-6faf8ffc85fa] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:24:26 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:24:26 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:24:26 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:24:26 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:24:26 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:24:26 user nova-compute[71731]: DEBUG nova.compute.manager [req-58dd711f-d3fe-4123-baeb-46c206a0dfe1 req-c0a161bd-cc9a-4d74-a753-4bbac26256df service nova] [instance: bbcccf4b-e861-4254-9be3-a491776214e9] Received event network-vif-plugged-dbb2bf27-5de3-499c-ba4d-87867912a143 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:24:26 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-58dd711f-d3fe-4123-baeb-46c206a0dfe1 req-c0a161bd-cc9a-4d74-a753-4bbac26256df service nova] Acquiring lock "bbcccf4b-e861-4254-9be3-a491776214e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:24:26 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-58dd711f-d3fe-4123-baeb-46c206a0dfe1 req-c0a161bd-cc9a-4d74-a753-4bbac26256df service nova] Lock "bbcccf4b-e861-4254-9be3-a491776214e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:24:26 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-58dd711f-d3fe-4123-baeb-46c206a0dfe1 req-c0a161bd-cc9a-4d74-a753-4bbac26256df service nova] Lock "bbcccf4b-e861-4254-9be3-a491776214e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:24:26 user nova-compute[71731]: DEBUG nova.compute.manager [req-58dd711f-d3fe-4123-baeb-46c206a0dfe1 req-c0a161bd-cc9a-4d74-a753-4bbac26256df service nova] [instance: bbcccf4b-e861-4254-9be3-a491776214e9] No waiting events found dispatching network-vif-plugged-dbb2bf27-5de3-499c-ba4d-87867912a143 {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:24:26 user nova-compute[71731]: WARNING nova.compute.manager [req-58dd711f-d3fe-4123-baeb-46c206a0dfe1 req-c0a161bd-cc9a-4d74-a753-4bbac26256df service nova] [instance: bbcccf4b-e861-4254-9be3-a491776214e9] Received unexpected event network-vif-plugged-dbb2bf27-5de3-499c-ba4d-87867912a143 for instance with vm_state active and task_state rescuing.
Apr 13 16:24:27 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:24:27 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:24:27 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:24:27 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:24:27 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:24:28 user nova-compute[71731]: DEBUG nova.virt.libvirt.host [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Removed pending event for bbcccf4b-e861-4254-9be3-a491776214e9 due to event {{(pid=71731) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 13 16:24:28 user nova-compute[71731]: DEBUG nova.virt.driver [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Emitting event <LifecycleEvent: 1681403068.8504744, bbcccf4b-e861-4254-9be3-a491776214e9 => Resumed> {{(pid=71731) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 16:24:28 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: bbcccf4b-e861-4254-9be3-a491776214e9] VM Resumed (Lifecycle Event)
Apr 13 16:24:28 user nova-compute[71731]: DEBUG nova.compute.manager [None req-c59aef75-fef8-4210-84c0-80f2cc4308a1 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] [instance: bbcccf4b-e861-4254-9be3-a491776214e9] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:24:28 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: bbcccf4b-e861-4254-9be3-a491776214e9] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:24:28 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: bbcccf4b-e861-4254-9be3-a491776214e9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71731) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 16:24:28 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: bbcccf4b-e861-4254-9be3-a491776214e9] During sync_power_state the instance has a pending task (rescuing). Skip.
Apr 13 16:24:28 user nova-compute[71731]: DEBUG nova.virt.driver [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Emitting event <LifecycleEvent: 1681403068.8509135, bbcccf4b-e861-4254-9be3-a491776214e9 => Started> {{(pid=71731) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 16:24:28 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: bbcccf4b-e861-4254-9be3-a491776214e9] VM Started (Lifecycle Event)
Apr 13 16:24:28 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: bbcccf4b-e861-4254-9be3-a491776214e9] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:24:28 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: bbcccf4b-e861-4254-9be3-a491776214e9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71731) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 16:24:29 user nova-compute[71731]: DEBUG nova.compute.manager [req-78491418-97db-40ed-a83f-34f3ca74139d req-eb4653ea-884a-4ace-9f43-eb92c6eac277 service nova] [instance: bbcccf4b-e861-4254-9be3-a491776214e9] Received event network-vif-plugged-dbb2bf27-5de3-499c-ba4d-87867912a143 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:24:29 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-78491418-97db-40ed-a83f-34f3ca74139d req-eb4653ea-884a-4ace-9f43-eb92c6eac277 service nova] Acquiring lock "bbcccf4b-e861-4254-9be3-a491776214e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:24:29 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-78491418-97db-40ed-a83f-34f3ca74139d req-eb4653ea-884a-4ace-9f43-eb92c6eac277 service nova] Lock "bbcccf4b-e861-4254-9be3-a491776214e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:24:29 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-78491418-97db-40ed-a83f-34f3ca74139d req-eb4653ea-884a-4ace-9f43-eb92c6eac277 service nova] Lock "bbcccf4b-e861-4254-9be3-a491776214e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:24:29 user nova-compute[71731]: DEBUG nova.compute.manager [req-78491418-97db-40ed-a83f-34f3ca74139d req-eb4653ea-884a-4ace-9f43-eb92c6eac277 service nova] [instance: bbcccf4b-e861-4254-9be3-a491776214e9] No waiting events found dispatching network-vif-plugged-dbb2bf27-5de3-499c-ba4d-87867912a143 {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:24:29 user nova-compute[71731]: WARNING nova.compute.manager [req-78491418-97db-40ed-a83f-34f3ca74139d req-eb4653ea-884a-4ace-9f43-eb92c6eac277 service nova] [instance: bbcccf4b-e861-4254-9be3-a491776214e9] Received unexpected event network-vif-plugged-dbb2bf27-5de3-499c-ba4d-87867912a143 for instance with vm_state rescued and task_state None.
Apr 13 16:24:29 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:24:30 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:24:30 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:24:31 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:24:34 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:24:36 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:24:39 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:24:44 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 16:24:44 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:24:44 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71731) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 16:24:44 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71731) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 16:24:44 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71731) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 16:24:44 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:24:46 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:24:48 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-b288e352-c9e2-4f5b-beb0-bb59284c59f7 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Acquiring lock "902e4077-e0d6-4b61-a861-883be253f1e0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:24:48 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-b288e352-c9e2-4f5b-beb0-bb59284c59f7 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Lock "902e4077-e0d6-4b61-a861-883be253f1e0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:24:48 user nova-compute[71731]: DEBUG nova.compute.manager [None req-b288e352-c9e2-4f5b-beb0-bb59284c59f7 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] [instance: 902e4077-e0d6-4b61-a861-883be253f1e0] Starting instance... {{(pid=71731) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 16:24:48 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-b288e352-c9e2-4f5b-beb0-bb59284c59f7 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:24:48 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-b288e352-c9e2-4f5b-beb0-bb59284c59f7 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:24:48 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-b288e352-c9e2-4f5b-beb0-bb59284c59f7 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71731) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 16:24:48 user nova-compute[71731]: INFO nova.compute.claims [None req-b288e352-c9e2-4f5b-beb0-bb59284c59f7 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] [instance: 902e4077-e0d6-4b61-a861-883be253f1e0] Claim successful on node user
Apr 13 16:24:48 user nova-compute[71731]: DEBUG nova.compute.provider_tree [None req-b288e352-c9e2-4f5b-beb0-bb59284c59f7 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Inventory has not changed in ProviderTree for provider: cb6b1a64-0c24-4e2d-af1e-16576ca9165c {{(pid=71731) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 16:24:48 user nova-compute[71731]: DEBUG nova.scheduler.client.report [None req-b288e352-c9e2-4f5b-beb0-bb59284c59f7 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Inventory has not changed for provider cb6b1a64-0c24-4e2d-af1e-16576ca9165c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71731) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 16:24:49 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-b288e352-c9e2-4f5b-beb0-bb59284c59f7 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.418s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:24:49 user nova-compute[71731]: DEBUG nova.compute.manager [None req-b288e352-c9e2-4f5b-beb0-bb59284c59f7 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] [instance: 902e4077-e0d6-4b61-a861-883be253f1e0] Start building networks asynchronously for instance. {{(pid=71731) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 16:24:49 user nova-compute[71731]: DEBUG nova.compute.manager [None req-b288e352-c9e2-4f5b-beb0-bb59284c59f7 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] [instance: 902e4077-e0d6-4b61-a861-883be253f1e0] Allocating IP information in the background. {{(pid=71731) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 16:24:49 user nova-compute[71731]: DEBUG nova.network.neutron [None req-b288e352-c9e2-4f5b-beb0-bb59284c59f7 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] [instance: 902e4077-e0d6-4b61-a861-883be253f1e0] allocate_for_instance() {{(pid=71731) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 16:24:49 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-b288e352-c9e2-4f5b-beb0-bb59284c59f7 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] [instance: 902e4077-e0d6-4b61-a861-883be253f1e0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 16:24:49 user nova-compute[71731]: DEBUG nova.compute.manager [None req-b288e352-c9e2-4f5b-beb0-bb59284c59f7 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] [instance: 902e4077-e0d6-4b61-a861-883be253f1e0] Start building block device mappings for instance. {{(pid=71731) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 16:24:49 user nova-compute[71731]: DEBUG nova.policy [None req-b288e352-c9e2-4f5b-beb0-bb59284c59f7 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9223a3efe4bc4e37946c8ed718100de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7395d2408a44cc88cf88eb49d5f8503', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71731) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 16:24:49 user nova-compute[71731]: DEBUG nova.compute.manager [None req-b288e352-c9e2-4f5b-beb0-bb59284c59f7 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] [instance: 902e4077-e0d6-4b61-a861-883be253f1e0] Start spawning the instance on the hypervisor. {{(pid=71731) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 16:24:49 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-b288e352-c9e2-4f5b-beb0-bb59284c59f7 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] [instance: 902e4077-e0d6-4b61-a861-883be253f1e0] Creating instance directory {{(pid=71731) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 16:24:49 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-b288e352-c9e2-4f5b-beb0-bb59284c59f7 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] [instance: 902e4077-e0d6-4b61-a861-883be253f1e0] Creating image(s)
Apr 13 16:24:49 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-b288e352-c9e2-4f5b-beb0-bb59284c59f7 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Acquiring lock "/opt/stack/data/nova/instances/902e4077-e0d6-4b61-a861-883be253f1e0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:24:49 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-b288e352-c9e2-4f5b-beb0-bb59284c59f7 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Lock "/opt/stack/data/nova/instances/902e4077-e0d6-4b61-a861-883be253f1e0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:24:49 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-b288e352-c9e2-4f5b-beb0-bb59284c59f7 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Lock "/opt/stack/data/nova/instances/902e4077-e0d6-4b61-a861-883be253f1e0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:24:49 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-b288e352-c9e2-4f5b-beb0-bb59284c59f7 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279 --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:24:49 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:24:49 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-b288e352-c9e2-4f5b-beb0-bb59284c59f7 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279 --force-share --output=json" returned: 0 in 0.140s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:24:49 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-b288e352-c9e2-4f5b-beb0-bb59284c59f7 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Acquiring lock "9524227dd898575c3099d3976f096cd935414279" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:24:49 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-b288e352-c9e2-4f5b-beb0-bb59284c59f7 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Lock "9524227dd898575c3099d3976f096cd935414279" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:24:49 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-b288e352-c9e2-4f5b-beb0-bb59284c59f7 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279 --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:24:49 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-b288e352-c9e2-4f5b-beb0-bb59284c59f7 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279 --force-share --output=json" returned: 0 in 0.146s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:24:49 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-b288e352-c9e2-4f5b-beb0-bb59284c59f7 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279,backing_fmt=raw /opt/stack/data/nova/instances/902e4077-e0d6-4b61-a861-883be253f1e0/disk 1073741824 {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:24:49 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-b288e352-c9e2-4f5b-beb0-bb59284c59f7 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279,backing_fmt=raw /opt/stack/data/nova/instances/902e4077-e0d6-4b61-a861-883be253f1e0/disk 1073741824" returned: 0 in 0.055s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:24:49 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-b288e352-c9e2-4f5b-beb0-bb59284c59f7 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Lock "9524227dd898575c3099d3976f096cd935414279" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.208s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:24:49 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-b288e352-c9e2-4f5b-beb0-bb59284c59f7 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279 --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:24:49 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-b288e352-c9e2-4f5b-beb0-bb59284c59f7 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279 --force-share --output=json" returned: 0 in 0.141s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:24:49 user nova-compute[71731]: DEBUG nova.virt.disk.api [None req-b288e352-c9e2-4f5b-beb0-bb59284c59f7 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Checking if we can resize image /opt/stack/data/nova/instances/902e4077-e0d6-4b61-a861-883be253f1e0/disk. size=1073741824 {{(pid=71731) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 16:24:49 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-b288e352-c9e2-4f5b-beb0-bb59284c59f7 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/902e4077-e0d6-4b61-a861-883be253f1e0/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:24:49 user nova-compute[71731]: DEBUG nova.network.neutron [None req-b288e352-c9e2-4f5b-beb0-bb59284c59f7 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] [instance: 902e4077-e0d6-4b61-a861-883be253f1e0] Successfully created port: 58b69a6e-8c04-42e5-931a-0947d9c0f78d {{(pid=71731) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 16:24:49 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-b288e352-c9e2-4f5b-beb0-bb59284c59f7 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/902e4077-e0d6-4b61-a861-883be253f1e0/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:24:49 user nova-compute[71731]: DEBUG nova.virt.disk.api [None req-b288e352-c9e2-4f5b-beb0-bb59284c59f7 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Cannot resize image /opt/stack/data/nova/instances/902e4077-e0d6-4b61-a861-883be253f1e0/disk to a smaller size. {{(pid=71731) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 16:24:49 user nova-compute[71731]: DEBUG nova.objects.instance [None req-b288e352-c9e2-4f5b-beb0-bb59284c59f7 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Lazy-loading 'migration_context' on Instance uuid 902e4077-e0d6-4b61-a861-883be253f1e0 {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:24:49 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-b288e352-c9e2-4f5b-beb0-bb59284c59f7 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] [instance: 902e4077-e0d6-4b61-a861-883be253f1e0] Created local disks {{(pid=71731) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 16:24:49 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-b288e352-c9e2-4f5b-beb0-bb59284c59f7 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] [instance: 902e4077-e0d6-4b61-a861-883be253f1e0] Ensure instance console log exists: /opt/stack/data/nova/instances/902e4077-e0d6-4b61-a861-883be253f1e0/console.log {{(pid=71731) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 16:24:49 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-b288e352-c9e2-4f5b-beb0-bb59284c59f7 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:24:49 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-b288e352-c9e2-4f5b-beb0-bb59284c59f7 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:24:49 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-b288e352-c9e2-4f5b-beb0-bb59284c59f7 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:24:50 user nova-compute[71731]: DEBUG nova.network.neutron [None req-b288e352-c9e2-4f5b-beb0-bb59284c59f7 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] [instance: 902e4077-e0d6-4b61-a861-883be253f1e0] Successfully updated port: 58b69a6e-8c04-42e5-931a-0947d9c0f78d {{(pid=71731) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 16:24:50 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-b288e352-c9e2-4f5b-beb0-bb59284c59f7 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Acquiring lock "refresh_cache-902e4077-e0d6-4b61-a861-883be253f1e0" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 16:24:50 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-b288e352-c9e2-4f5b-beb0-bb59284c59f7 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Acquired lock "refresh_cache-902e4077-e0d6-4b61-a861-883be253f1e0" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 16:24:50 user nova-compute[71731]: DEBUG nova.network.neutron [None req-b288e352-c9e2-4f5b-beb0-bb59284c59f7 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] [instance: 902e4077-e0d6-4b61-a861-883be253f1e0] Building network info cache for instance {{(pid=71731) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 16:24:50 user nova-compute[71731]: DEBUG nova.compute.manager [req-46b1d8ec-8d69-4d1d-8863-d660096f8303 req-f28916ac-e0d7-4a46-980b-675f8a0ff5b5 service nova] [instance: 902e4077-e0d6-4b61-a861-883be253f1e0] Received event network-changed-58b69a6e-8c04-42e5-931a-0947d9c0f78d {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:24:50 user nova-compute[71731]: DEBUG nova.compute.manager [req-46b1d8ec-8d69-4d1d-8863-d660096f8303 req-f28916ac-e0d7-4a46-980b-675f8a0ff5b5 service nova] [instance: 902e4077-e0d6-4b61-a861-883be253f1e0] Refreshing instance network info cache due to event network-changed-58b69a6e-8c04-42e5-931a-0947d9c0f78d. {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 16:24:50 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-46b1d8ec-8d69-4d1d-8863-d660096f8303 req-f28916ac-e0d7-4a46-980b-675f8a0ff5b5 service nova] Acquiring lock "refresh_cache-902e4077-e0d6-4b61-a861-883be253f1e0" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 16:24:50 user nova-compute[71731]: DEBUG nova.network.neutron [None req-b288e352-c9e2-4f5b-beb0-bb59284c59f7 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] [instance: 902e4077-e0d6-4b61-a861-883be253f1e0] Instance cache missing network info. {{(pid=71731) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 16:24:50 user nova-compute[71731]: DEBUG nova.network.neutron [None req-b288e352-c9e2-4f5b-beb0-bb59284c59f7 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] [instance: 902e4077-e0d6-4b61-a861-883be253f1e0] Updating instance_info_cache with network_info: [{"id": "58b69a6e-8c04-42e5-931a-0947d9c0f78d", "address": "fa:16:3e:38:29:d6", "network": {"id": "aa17b8d5-dffb-42ba-bb7e-8909e5894bfb", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-386731779-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "e7395d2408a44cc88cf88eb49d5f8503", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58b69a6e-8c", "ovs_interfaceid": "58b69a6e-8c04-42e5-931a-0947d9c0f78d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:24:51 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-b288e352-c9e2-4f5b-beb0-bb59284c59f7 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Releasing lock "refresh_cache-902e4077-e0d6-4b61-a861-883be253f1e0" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 16:24:51 user nova-compute[71731]: DEBUG nova.compute.manager [None req-b288e352-c9e2-4f5b-beb0-bb59284c59f7 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] [instance: 902e4077-e0d6-4b61-a861-883be253f1e0] Instance network_info: |[{"id": "58b69a6e-8c04-42e5-931a-0947d9c0f78d", "address": "fa:16:3e:38:29:d6", "network": {"id": "aa17b8d5-dffb-42ba-bb7e-8909e5894bfb", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-386731779-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "e7395d2408a44cc88cf88eb49d5f8503", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58b69a6e-8c", "ovs_interfaceid": "58b69a6e-8c04-42e5-931a-0947d9c0f78d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71731) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 16:24:51 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-46b1d8ec-8d69-4d1d-8863-d660096f8303 req-f28916ac-e0d7-4a46-980b-675f8a0ff5b5 service nova] Acquired lock "refresh_cache-902e4077-e0d6-4b61-a861-883be253f1e0" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 16:24:51 user nova-compute[71731]: DEBUG nova.network.neutron [req-46b1d8ec-8d69-4d1d-8863-d660096f8303 req-f28916ac-e0d7-4a46-980b-675f8a0ff5b5 service nova] [instance: 902e4077-e0d6-4b61-a861-883be253f1e0] Refreshing network info cache for port 58b69a6e-8c04-42e5-931a-0947d9c0f78d {{(pid=71731) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 16:24:51 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-b288e352-c9e2-4f5b-beb0-bb59284c59f7 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] [instance: 902e4077-e0d6-4b61-a861-883be253f1e0] Start _get_guest_xml network_info=[{"id": "58b69a6e-8c04-42e5-931a-0947d9c0f78d", "address": "fa:16:3e:38:29:d6", "network": {"id": "aa17b8d5-dffb-42ba-bb7e-8909e5894bfb", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-386731779-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "e7395d2408a44cc88cf88eb49d5f8503", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58b69a6e-8c", "ovs_interfaceid": "58b69a6e-8c04-42e5-931a-0947d9c0f78d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T16:16:31Z,direct_url=<?>,disk_format='qcow2',id=708622a9-7465-4492-ade8-b827198f7e30,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='0b29a975c552465aba0ac7d6288434bd',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T16:16:33Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'device_type': 'disk', 'encrypted': False, 'disk_bus': 'virtio', 'guest_format': None, 'encryption_options': None, 'image_id': '708622a9-7465-4492-ade8-b827198f7e30'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71731) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 16:24:51 user nova-compute[71731]: WARNING nova.virt.libvirt.driver [None req-b288e352-c9e2-4f5b-beb0-bb59284c59f7 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 16:24:51 user nova-compute[71731]: WARNING nova.virt.libvirt.driver [None req-b288e352-c9e2-4f5b-beb0-bb59284c59f7 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 16:24:51 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-b288e352-c9e2-4f5b-beb0-bb59284c59f7 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71731) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 16:24:51 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-b288e352-c9e2-4f5b-beb0-bb59284c59f7 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T16:17:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T16:16:31Z,direct_url=<?>,disk_format='qcow2',id=708622a9-7465-4492-ade8-b827198f7e30,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='0b29a975c552465aba0ac7d6288434bd',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T16:16:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 16:24:51 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-b288e352-c9e2-4f5b-beb0-bb59284c59f7 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Flavor limits 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 16:24:51 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-b288e352-c9e2-4f5b-beb0-bb59284c59f7 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Image limits 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 16:24:51 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-b288e352-c9e2-4f5b-beb0-bb59284c59f7 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Flavor pref 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 16:24:51 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-b288e352-c9e2-4f5b-beb0-bb59284c59f7 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Image pref 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 16:24:51 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-b288e352-c9e2-4f5b-beb0-bb59284c59f7 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 16:24:51 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-b288e352-c9e2-4f5b-beb0-bb59284c59f7 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 16:24:51 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-b288e352-c9e2-4f5b-beb0-bb59284c59f7 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71731) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 16:24:51 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-b288e352-c9e2-4f5b-beb0-bb59284c59f7 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Got 1 possible topologies {{(pid=71731) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 16:24:51 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-b288e352-c9e2-4f5b-beb0-bb59284c59f7 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 16:24:51 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-b288e352-c9e2-4f5b-beb0-bb59284c59f7 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 16:24:51 user nova-compute[71731]: DEBUG nova.virt.libvirt.vif [None req-b288e352-c9e2-4f5b-beb0-bb59284c59f7 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T16:24:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1443848210',display_name='tempest-VolumesSnapshotTestJSON-instance-1443848210',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1443848210',id=18,image_ref='708622a9-7465-4492-ade8-b827198f7e30',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e7395d2408a44cc88cf88eb49d5f8503',ramdisk_id='',reservation_id='r-vx64glx6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='708622a9-7465-4492-ade8-b827198f7e30',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1985397600',owner_user_name='tempest-VolumesSnapshotTestJSON-1985397600-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T16:24:49Z,user_data=None,user_id='9223a3efe4bc4e37946c8ed718100de4',uuid=902e4077-e0d6-4b61-a861-883be253f1e0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "58b69a6e-8c04-42e5-931a-0947d9c0f78d", "address": "fa:16:3e:38:29:d6", "network": {"id": "aa17b8d5-dffb-42ba-bb7e-8909e5894bfb", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-386731779-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "e7395d2408a44cc88cf88eb49d5f8503", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58b69a6e-8c", "ovs_interfaceid": "58b69a6e-8c04-42e5-931a-0947d9c0f78d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71731) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 16:24:51 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-b288e352-c9e2-4f5b-beb0-bb59284c59f7 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Converting VIF {"id": "58b69a6e-8c04-42e5-931a-0947d9c0f78d", "address": "fa:16:3e:38:29:d6", "network": {"id": "aa17b8d5-dffb-42ba-bb7e-8909e5894bfb", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-386731779-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "e7395d2408a44cc88cf88eb49d5f8503", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58b69a6e-8c", "ovs_interfaceid": "58b69a6e-8c04-42e5-931a-0947d9c0f78d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 16:24:51 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-b288e352-c9e2-4f5b-beb0-bb59284c59f7 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:38:29:d6,bridge_name='br-int',has_traffic_filtering=True,id=58b69a6e-8c04-42e5-931a-0947d9c0f78d,network=Network(aa17b8d5-dffb-42ba-bb7e-8909e5894bfb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58b69a6e-8c') {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 16:24:51 user nova-compute[71731]: DEBUG nova.objects.instance [None req-b288e352-c9e2-4f5b-beb0-bb59284c59f7 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Lazy-loading 'pci_devices' on Instance uuid 902e4077-e0d6-4b61-a861-883be253f1e0 {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:24:51 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-b288e352-c9e2-4f5b-beb0-bb59284c59f7 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] [instance: 902e4077-e0d6-4b61-a861-883be253f1e0] End _get_guest_xml xml=<domain type="kvm">
Apr 13 16:24:51 user nova-compute[71731]:   <uuid>902e4077-e0d6-4b61-a861-883be253f1e0</uuid>
Apr 13 16:24:51 user nova-compute[71731]:   <name>instance-00000012</name>
Apr 13 16:24:51 user nova-compute[71731]:   <memory>131072</memory>
Apr 13 16:24:51 user nova-compute[71731]:   <vcpu>1</vcpu>
Apr 13 16:24:51 user nova-compute[71731]:   <metadata>
Apr 13 16:24:51 user nova-compute[71731]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 16:24:51 user nova-compute[71731]:       <nova:package version="0.0.0"/>
Apr 13 16:24:51 user nova-compute[71731]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1443848210</nova:name>
Apr 13 16:24:51 user nova-compute[71731]:       <nova:creationTime>2023-04-13 16:24:51</nova:creationTime>
Apr 13 16:24:51 user nova-compute[71731]:       <nova:flavor name="m1.nano">
Apr 13 16:24:51 user nova-compute[71731]:         <nova:memory>128</nova:memory>
Apr 13 16:24:51 user nova-compute[71731]:         <nova:disk>1</nova:disk>
Apr 13 16:24:51 user nova-compute[71731]:         <nova:swap>0</nova:swap>
Apr 13 16:24:51 user nova-compute[71731]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 16:24:51 user nova-compute[71731]:         <nova:vcpus>1</nova:vcpus>
Apr 13 16:24:51 user nova-compute[71731]:       </nova:flavor>
Apr 13 16:24:51 user nova-compute[71731]:       <nova:owner>
Apr 13 16:24:51 user nova-compute[71731]:         <nova:user uuid="9223a3efe4bc4e37946c8ed718100de4">tempest-VolumesSnapshotTestJSON-1985397600-project-member</nova:user>
Apr 13 16:24:51 user nova-compute[71731]:         <nova:project uuid="e7395d2408a44cc88cf88eb49d5f8503">tempest-VolumesSnapshotTestJSON-1985397600</nova:project>
Apr 13 16:24:51 user nova-compute[71731]:       </nova:owner>
Apr 13 16:24:51 user nova-compute[71731]:       <nova:root type="image" uuid="708622a9-7465-4492-ade8-b827198f7e30"/>
Apr 13 16:24:51 user nova-compute[71731]:       <nova:ports>
Apr 13 16:24:51 user nova-compute[71731]:         <nova:port uuid="58b69a6e-8c04-42e5-931a-0947d9c0f78d">
Apr 13 16:24:51 user nova-compute[71731]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Apr 13 16:24:51 user nova-compute[71731]:         </nova:port>
Apr 13 16:24:51 user nova-compute[71731]:       </nova:ports>
Apr 13 16:24:51 user nova-compute[71731]:     </nova:instance>
Apr 13 16:24:51 user nova-compute[71731]:   </metadata>
Apr 13 16:24:51 user nova-compute[71731]:   <sysinfo type="smbios">
Apr 13 16:24:51 user nova-compute[71731]:     <system>
Apr 13 16:24:51 user nova-compute[71731]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 16:24:51 user nova-compute[71731]:       <entry name="product">OpenStack Nova</entry>
Apr 13 16:24:51 user nova-compute[71731]:       <entry name="version">0.0.0</entry>
Apr 13 16:24:51 user nova-compute[71731]:       <entry name="serial">902e4077-e0d6-4b61-a861-883be253f1e0</entry>
Apr 13 16:24:51 user nova-compute[71731]:       <entry name="uuid">902e4077-e0d6-4b61-a861-883be253f1e0</entry>
Apr 13 16:24:51 user nova-compute[71731]:       <entry name="family">Virtual Machine</entry>
Apr 13 16:24:51 user nova-compute[71731]:     </system>
Apr 13 16:24:51 user nova-compute[71731]:   </sysinfo>
Apr 13 16:24:51 user nova-compute[71731]:   <os>
Apr 13 16:24:51 user nova-compute[71731]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 16:24:51 user nova-compute[71731]:     <boot dev="hd"/>
Apr 13 16:24:51 user nova-compute[71731]:     <smbios mode="sysinfo"/>
Apr 13 16:24:51 user nova-compute[71731]:   </os>
Apr 13 16:24:51 user nova-compute[71731]:   <features>
Apr 13 16:24:51 user nova-compute[71731]:     <acpi/>
Apr 13 16:24:51 user nova-compute[71731]:     <apic/>
Apr 13 16:24:51 user nova-compute[71731]:     <vmcoreinfo/>
Apr 13 16:24:51 user nova-compute[71731]:   </features>
Apr 13 16:24:51 user nova-compute[71731]:   <clock offset="utc">
Apr 13 16:24:51 user nova-compute[71731]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 16:24:51 user nova-compute[71731]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 16:24:51 user nova-compute[71731]:     <timer name="hpet" present="no"/>
Apr 13 16:24:51 user nova-compute[71731]:   </clock>
Apr 13 16:24:51 user nova-compute[71731]:   <cpu mode="custom" match="exact">
Apr 13 16:24:51 user nova-compute[71731]:     <model>Nehalem</model>
Apr 13 16:24:51 user nova-compute[71731]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 16:24:51 user nova-compute[71731]:   </cpu>
Apr 13 16:24:51 user nova-compute[71731]:   <devices>
Apr 13 16:24:51 user nova-compute[71731]:     <disk type="file" device="disk">
Apr 13 16:24:51 user nova-compute[71731]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 16:24:51 user nova-compute[71731]:       <source file="/opt/stack/data/nova/instances/902e4077-e0d6-4b61-a861-883be253f1e0/disk"/>
Apr 13 16:24:51 user nova-compute[71731]:       <target dev="vda" bus="virtio"/>
Apr 13 16:24:51 user nova-compute[71731]:     </disk>
Apr 13 16:24:51 user nova-compute[71731]:     <interface type="ethernet">
Apr 13 16:24:51 user nova-compute[71731]:       <mac address="fa:16:3e:38:29:d6"/>
Apr 13 16:24:51 user nova-compute[71731]:       <model type="virtio"/>
Apr 13 16:24:51 user nova-compute[71731]:       <mtu size="1442"/>
Apr 13 16:24:51 user nova-compute[71731]:       <target dev="tap58b69a6e-8c"/>
Apr 13 16:24:51 user nova-compute[71731]:     </interface>
Apr 13 16:24:51 user nova-compute[71731]:     <serial type="pty">
Apr 13 16:24:51 user nova-compute[71731]:       <log file="/opt/stack/data/nova/instances/902e4077-e0d6-4b61-a861-883be253f1e0/console.log" append="off"/>
Apr 13 16:24:51 user nova-compute[71731]:     </serial>
Apr 13 16:24:51 user nova-compute[71731]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 16:24:51 user nova-compute[71731]:     <video>
Apr 13 16:24:51 user nova-compute[71731]:       <model type="virtio"/>
Apr 13 16:24:51 user nova-compute[71731]:     </video>
Apr 13 16:24:51 user nova-compute[71731]:     <rng model="virtio">
Apr 13 16:24:51 user nova-compute[71731]:       <backend model="random">/dev/urandom</backend>
Apr 13 16:24:51 user nova-compute[71731]:     </rng>
Apr 13 16:24:51 user nova-compute[71731]:     <controller type="usb" index="0" model="none"/>
Apr 13 16:24:51 user nova-compute[71731]:     <memballoon model="virtio">
Apr 13 16:24:51 user nova-compute[71731]:       <stats period="10"/>
Apr 13 16:24:51 user nova-compute[71731]:     </memballoon>
Apr 13 16:24:51 user nova-compute[71731]:   </devices>
Apr 13 16:24:51 user nova-compute[71731]: </domain>
Apr 13 16:24:51 user nova-compute[71731]:  {{(pid=71731) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 16:24:51 user nova-compute[71731]: DEBUG nova.virt.libvirt.vif [None req-b288e352-c9e2-4f5b-beb0-bb59284c59f7 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T16:24:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1443848210',display_name='tempest-VolumesSnapshotTestJSON-instance-1443848210',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1443848210',id=18,image_ref='708622a9-7465-4492-ade8-b827198f7e30',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e7395d2408a44cc88cf88eb49d5f8503',ramdisk_id='',reservation_id='r-vx64glx6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='708622a9-7465-4492-ade8-b827198f7e30',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1985397600',owner_user_name='tempest-VolumesSnapshotTestJSON-1985397600-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T16:24:49Z,user_data=None,user_id='9223a3efe4bc4e37946c8ed718100de4',uuid=902e4077-e0d6-4b61-a861-883be253f1e0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "58b69a6e-8c04-42e5-931a-0947d9c0f78d", "address": "fa:16:3e:38:29:d6", "network": {"id": "aa17b8d5-dffb-42ba-bb7e-8909e5894bfb", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-386731779-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "e7395d2408a44cc88cf88eb49d5f8503", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58b69a6e-8c", "ovs_interfaceid": "58b69a6e-8c04-42e5-931a-0947d9c0f78d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 16:24:51 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-b288e352-c9e2-4f5b-beb0-bb59284c59f7 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Converting VIF {"id": "58b69a6e-8c04-42e5-931a-0947d9c0f78d", "address": "fa:16:3e:38:29:d6", "network": {"id": "aa17b8d5-dffb-42ba-bb7e-8909e5894bfb", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-386731779-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "e7395d2408a44cc88cf88eb49d5f8503", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58b69a6e-8c", "ovs_interfaceid": "58b69a6e-8c04-42e5-931a-0947d9c0f78d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 16:24:51 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-b288e352-c9e2-4f5b-beb0-bb59284c59f7 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:38:29:d6,bridge_name='br-int',has_traffic_filtering=True,id=58b69a6e-8c04-42e5-931a-0947d9c0f78d,network=Network(aa17b8d5-dffb-42ba-bb7e-8909e5894bfb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58b69a6e-8c') {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 16:24:51 user nova-compute[71731]: DEBUG os_vif [None req-b288e352-c9e2-4f5b-beb0-bb59284c59f7 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:29:d6,bridge_name='br-int',has_traffic_filtering=True,id=58b69a6e-8c04-42e5-931a-0947d9c0f78d,network=Network(aa17b8d5-dffb-42ba-bb7e-8909e5894bfb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58b69a6e-8c') {{(pid=71731) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 16:24:51 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:24:51 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:24:51 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 16:24:51 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:24:51 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap58b69a6e-8c, may_exist=True) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:24:51 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap58b69a6e-8c, col_values=(('external_ids', {'iface-id': '58b69a6e-8c04-42e5-931a-0947d9c0f78d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:38:29:d6', 'vm-uuid': '902e4077-e0d6-4b61-a861-883be253f1e0'}),)) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:24:51 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:24:51 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 16:24:51 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:24:51 user nova-compute[71731]: INFO os_vif [None req-b288e352-c9e2-4f5b-beb0-bb59284c59f7 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:29:d6,bridge_name='br-int',has_traffic_filtering=True,id=58b69a6e-8c04-42e5-931a-0947d9c0f78d,network=Network(aa17b8d5-dffb-42ba-bb7e-8909e5894bfb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58b69a6e-8c')
Apr 13 16:24:51 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-b288e352-c9e2-4f5b-beb0-bb59284c59f7 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] No BDM found with device name vda, not building metadata. {{(pid=71731) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 16:24:51 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-b288e352-c9e2-4f5b-beb0-bb59284c59f7 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] No VIF found with MAC fa:16:3e:38:29:d6, not building metadata {{(pid=71731) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 16:24:51 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:24:51 user nova-compute[71731]: DEBUG nova.network.neutron [req-46b1d8ec-8d69-4d1d-8863-d660096f8303 req-f28916ac-e0d7-4a46-980b-675f8a0ff5b5 service nova] [instance: 902e4077-e0d6-4b61-a861-883be253f1e0] Updated VIF entry in instance network info cache for port 58b69a6e-8c04-42e5-931a-0947d9c0f78d. {{(pid=71731) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 16:24:51 user nova-compute[71731]: DEBUG nova.network.neutron [req-46b1d8ec-8d69-4d1d-8863-d660096f8303 req-f28916ac-e0d7-4a46-980b-675f8a0ff5b5 service nova] [instance: 902e4077-e0d6-4b61-a861-883be253f1e0] Updating instance_info_cache with network_info: [{"id": "58b69a6e-8c04-42e5-931a-0947d9c0f78d", "address": "fa:16:3e:38:29:d6", "network": {"id": "aa17b8d5-dffb-42ba-bb7e-8909e5894bfb", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-386731779-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "e7395d2408a44cc88cf88eb49d5f8503", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58b69a6e-8c", "ovs_interfaceid": "58b69a6e-8c04-42e5-931a-0947d9c0f78d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:24:51 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-46b1d8ec-8d69-4d1d-8863-d660096f8303 req-f28916ac-e0d7-4a46-980b-675f8a0ff5b5 service nova] Releasing lock "refresh_cache-902e4077-e0d6-4b61-a861-883be253f1e0" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 16:24:52 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:24:52 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:24:52 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:24:52 user nova-compute[71731]: DEBUG nova.compute.manager [req-a4e25b34-46f5-4624-bff7-166e3962be97 req-e7bb7d83-6184-472e-9465-5e36c87c5220 service nova] [instance: 902e4077-e0d6-4b61-a861-883be253f1e0] Received event network-vif-plugged-58b69a6e-8c04-42e5-931a-0947d9c0f78d {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:24:52 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-a4e25b34-46f5-4624-bff7-166e3962be97 req-e7bb7d83-6184-472e-9465-5e36c87c5220 service nova] Acquiring lock "902e4077-e0d6-4b61-a861-883be253f1e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:24:52 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-a4e25b34-46f5-4624-bff7-166e3962be97 req-e7bb7d83-6184-472e-9465-5e36c87c5220 service nova] Lock "902e4077-e0d6-4b61-a861-883be253f1e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:24:52 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-a4e25b34-46f5-4624-bff7-166e3962be97 req-e7bb7d83-6184-472e-9465-5e36c87c5220 service nova] Lock "902e4077-e0d6-4b61-a861-883be253f1e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:24:52 user nova-compute[71731]: DEBUG nova.compute.manager [req-a4e25b34-46f5-4624-bff7-166e3962be97 req-e7bb7d83-6184-472e-9465-5e36c87c5220 service nova] [instance: 902e4077-e0d6-4b61-a861-883be253f1e0] No waiting events found dispatching network-vif-plugged-58b69a6e-8c04-42e5-931a-0947d9c0f78d {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:24:52 user nova-compute[71731]: WARNING nova.compute.manager [req-a4e25b34-46f5-4624-bff7-166e3962be97 req-e7bb7d83-6184-472e-9465-5e36c87c5220 service nova] [instance: 902e4077-e0d6-4b61-a861-883be253f1e0] Received unexpected event network-vif-plugged-58b69a6e-8c04-42e5-931a-0947d9c0f78d for instance with vm_state building and task_state spawning.
Apr 13 16:24:54 user nova-compute[71731]: DEBUG nova.virt.driver [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Emitting event <LifecycleEvent: 1681403094.7485266, 902e4077-e0d6-4b61-a861-883be253f1e0 => Resumed> {{(pid=71731) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 16:24:54 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 902e4077-e0d6-4b61-a861-883be253f1e0] VM Resumed (Lifecycle Event)
Apr 13 16:24:54 user nova-compute[71731]: DEBUG nova.compute.manager [None req-b288e352-c9e2-4f5b-beb0-bb59284c59f7 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] [instance: 902e4077-e0d6-4b61-a861-883be253f1e0] Instance event wait completed in 0 seconds for  {{(pid=71731) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 16:24:54 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-b288e352-c9e2-4f5b-beb0-bb59284c59f7 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] [instance: 902e4077-e0d6-4b61-a861-883be253f1e0] Guest created on hypervisor {{(pid=71731) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 16:24:54 user nova-compute[71731]: INFO nova.virt.libvirt.driver [-] [instance: 902e4077-e0d6-4b61-a861-883be253f1e0] Instance spawned successfully.
Apr 13 16:24:54 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-b288e352-c9e2-4f5b-beb0-bb59284c59f7 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] [instance: 902e4077-e0d6-4b61-a861-883be253f1e0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 16:24:54 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 902e4077-e0d6-4b61-a861-883be253f1e0] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:24:54 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 902e4077-e0d6-4b61-a861-883be253f1e0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71731) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 16:24:54 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-b288e352-c9e2-4f5b-beb0-bb59284c59f7 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] [instance: 902e4077-e0d6-4b61-a861-883be253f1e0] Found default for hw_cdrom_bus of ide {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:24:54 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-b288e352-c9e2-4f5b-beb0-bb59284c59f7 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] [instance: 902e4077-e0d6-4b61-a861-883be253f1e0] Found default for hw_disk_bus of virtio {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:24:54 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-b288e352-c9e2-4f5b-beb0-bb59284c59f7 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] [instance: 902e4077-e0d6-4b61-a861-883be253f1e0] Found default for hw_input_bus of None {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:24:54 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-b288e352-c9e2-4f5b-beb0-bb59284c59f7 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] [instance: 902e4077-e0d6-4b61-a861-883be253f1e0] Found default for hw_pointer_model of None {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:24:54 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-b288e352-c9e2-4f5b-beb0-bb59284c59f7 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] [instance: 902e4077-e0d6-4b61-a861-883be253f1e0] Found default for hw_video_model of virtio {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:24:54 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-b288e352-c9e2-4f5b-beb0-bb59284c59f7 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] [instance: 902e4077-e0d6-4b61-a861-883be253f1e0] Found default for hw_vif_model of virtio {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:24:54 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 902e4077-e0d6-4b61-a861-883be253f1e0] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 16:24:54 user nova-compute[71731]: DEBUG nova.virt.driver [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Emitting event <LifecycleEvent: 1681403094.7530165, 902e4077-e0d6-4b61-a861-883be253f1e0 => Started> {{(pid=71731) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 16:24:54 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 902e4077-e0d6-4b61-a861-883be253f1e0] VM Started (Lifecycle Event)
Apr 13 16:24:54 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 902e4077-e0d6-4b61-a861-883be253f1e0] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:24:54 user nova-compute[71731]: DEBUG nova.compute.manager [req-c757016d-2799-4d0b-a2ee-99944ee64efc req-b75d7c90-0397-4fb3-a6e9-3b50188d6ed0 service nova] [instance: 902e4077-e0d6-4b61-a861-883be253f1e0] Received event network-vif-plugged-58b69a6e-8c04-42e5-931a-0947d9c0f78d {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:24:54 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-c757016d-2799-4d0b-a2ee-99944ee64efc req-b75d7c90-0397-4fb3-a6e9-3b50188d6ed0 service nova] Acquiring lock "902e4077-e0d6-4b61-a861-883be253f1e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:24:54 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-c757016d-2799-4d0b-a2ee-99944ee64efc req-b75d7c90-0397-4fb3-a6e9-3b50188d6ed0 service nova] Lock "902e4077-e0d6-4b61-a861-883be253f1e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:24:54 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-c757016d-2799-4d0b-a2ee-99944ee64efc req-b75d7c90-0397-4fb3-a6e9-3b50188d6ed0 service nova] Lock "902e4077-e0d6-4b61-a861-883be253f1e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:24:54 user nova-compute[71731]: DEBUG nova.compute.manager [req-c757016d-2799-4d0b-a2ee-99944ee64efc req-b75d7c90-0397-4fb3-a6e9-3b50188d6ed0 service nova] [instance: 902e4077-e0d6-4b61-a861-883be253f1e0] No waiting events found dispatching network-vif-plugged-58b69a6e-8c04-42e5-931a-0947d9c0f78d {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:24:54 user nova-compute[71731]: WARNING nova.compute.manager [req-c757016d-2799-4d0b-a2ee-99944ee64efc req-b75d7c90-0397-4fb3-a6e9-3b50188d6ed0 service nova] [instance: 902e4077-e0d6-4b61-a861-883be253f1e0] Received unexpected event network-vif-plugged-58b69a6e-8c04-42e5-931a-0947d9c0f78d for instance with vm_state building and task_state spawning.
Apr 13 16:24:54 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 902e4077-e0d6-4b61-a861-883be253f1e0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71731) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 16:24:54 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 902e4077-e0d6-4b61-a861-883be253f1e0] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 16:24:54 user nova-compute[71731]: INFO nova.compute.manager [None req-b288e352-c9e2-4f5b-beb0-bb59284c59f7 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] [instance: 902e4077-e0d6-4b61-a861-883be253f1e0] Took 5.66 seconds to spawn the instance on the hypervisor.
Apr 13 16:24:54 user nova-compute[71731]: DEBUG nova.compute.manager [None req-b288e352-c9e2-4f5b-beb0-bb59284c59f7 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] [instance: 902e4077-e0d6-4b61-a861-883be253f1e0] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:24:54 user nova-compute[71731]: INFO nova.compute.manager [None req-b288e352-c9e2-4f5b-beb0-bb59284c59f7 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] [instance: 902e4077-e0d6-4b61-a861-883be253f1e0] Took 6.40 seconds to build instance.
Apr 13 16:24:54 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-b288e352-c9e2-4f5b-beb0-bb59284c59f7 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Lock "902e4077-e0d6-4b61-a861-883be253f1e0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.508s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:24:56 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:24:56 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:25:01 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:25:01 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:25:04 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-ff8d934f-c58d-4bef-a206-c51e6e19922a tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Acquiring lock "5ea4ab6a-6501-4a2f-a8f7-04090024747d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:25:04 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-ff8d934f-c58d-4bef-a206-c51e6e19922a tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "5ea4ab6a-6501-4a2f-a8f7-04090024747d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:25:04 user nova-compute[71731]: DEBUG nova.compute.manager [None req-ff8d934f-c58d-4bef-a206-c51e6e19922a tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 5ea4ab6a-6501-4a2f-a8f7-04090024747d] Starting instance... {{(pid=71731) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 16:25:04 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-ff8d934f-c58d-4bef-a206-c51e6e19922a tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:25:04 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-ff8d934f-c58d-4bef-a206-c51e6e19922a tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:25:04 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-ff8d934f-c58d-4bef-a206-c51e6e19922a tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71731) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 16:25:04 user nova-compute[71731]: INFO nova.compute.claims [None req-ff8d934f-c58d-4bef-a206-c51e6e19922a tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 5ea4ab6a-6501-4a2f-a8f7-04090024747d] Claim successful on node user
Apr 13 16:25:04 user nova-compute[71731]: DEBUG nova.compute.provider_tree [None req-ff8d934f-c58d-4bef-a206-c51e6e19922a tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Inventory has not changed in ProviderTree for provider: cb6b1a64-0c24-4e2d-af1e-16576ca9165c {{(pid=71731) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 16:25:04 user nova-compute[71731]: DEBUG nova.scheduler.client.report [None req-ff8d934f-c58d-4bef-a206-c51e6e19922a tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Inventory has not changed for provider cb6b1a64-0c24-4e2d-af1e-16576ca9165c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71731) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 16:25:04 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-ff8d934f-c58d-4bef-a206-c51e6e19922a tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.462s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:25:04 user nova-compute[71731]: DEBUG nova.compute.manager [None req-ff8d934f-c58d-4bef-a206-c51e6e19922a tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 5ea4ab6a-6501-4a2f-a8f7-04090024747d] Start building networks asynchronously for instance. {{(pid=71731) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 16:25:04 user nova-compute[71731]: DEBUG nova.compute.manager [None req-ff8d934f-c58d-4bef-a206-c51e6e19922a tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 5ea4ab6a-6501-4a2f-a8f7-04090024747d] Allocating IP information in the background. {{(pid=71731) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 16:25:04 user nova-compute[71731]: DEBUG nova.network.neutron [None req-ff8d934f-c58d-4bef-a206-c51e6e19922a tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 5ea4ab6a-6501-4a2f-a8f7-04090024747d] allocate_for_instance() {{(pid=71731) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 16:25:04 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-ff8d934f-c58d-4bef-a206-c51e6e19922a tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 5ea4ab6a-6501-4a2f-a8f7-04090024747d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 16:25:04 user nova-compute[71731]: DEBUG nova.compute.manager [None req-ff8d934f-c58d-4bef-a206-c51e6e19922a tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 5ea4ab6a-6501-4a2f-a8f7-04090024747d] Start building block device mappings for instance. {{(pid=71731) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 16:25:04 user nova-compute[71731]: INFO nova.virt.block_device [None req-ff8d934f-c58d-4bef-a206-c51e6e19922a tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 5ea4ab6a-6501-4a2f-a8f7-04090024747d] Booting with volume e4317bfd-71c2-4c48-a0f0-e3c795f262a8 at /dev/vda
Apr 13 16:25:04 user nova-compute[71731]: DEBUG nova.policy [None req-ff8d934f-c58d-4bef-a206-c51e6e19922a tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd70e10f63cdd49a9a1ebe1fe4c9de0a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d451e0e239f486aa2b3abe9e273eab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71731) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 16:25:05 user nova-compute[71731]: DEBUG os_brick.utils [None req-ff8d934f-c58d-4bef-a206-c51e6e19922a tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 16:25:05 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:25:05 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:25:05 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7656924-fc57-42ec-b531-62ee3b0dbef4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:81501d91421\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:25:05 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:25:05 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:25:05 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[66ec30fd-0718-4a0b-a727-8adb4abe0f66]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:25:05 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:25:05 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.024s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:25:05 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[96ed7807-9438-4fa1-b5fe-cb960888cab3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:25:05 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[214bb372-8cfe-47e3-8ae4-0c03aeef19ae]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:25:05 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-ff8d934f-c58d-4bef-a206-c51e6e19922a tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Running cmd (subprocess): nvme version {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:25:05 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-ff8d934f-c58d-4bef-a206-c51e6e19922a tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] 'nvme version' failed. Not Retrying. {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 16:25:05 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ff8d934f-c58d-4bef-a206-c51e6e19922a tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] nvme not present on system {{(pid=71731) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 16:25:05 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:25:05 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 16:25:05 user nova-compute[71731]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 16:25:05 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[a31b9774-88dd-4556-aec0-95e4b3e351e7]: (4, '') {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:25:05 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.lightos [None req-ff8d934f-c58d-4bef-a206-c51e6e19922a tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71731) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 16:25:05 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.lightos [None req-ff8d934f-c58d-4bef-a206-c51e6e19922a tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71731) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 16:25:05 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.lightos [None req-ff8d934f-c58d-4bef-a206-c51e6e19922a tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] LIGHTOS: no hostnqn found. {{(pid=71731) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 16:25:05 user nova-compute[71731]: DEBUG os_brick.utils [None req-ff8d934f-c58d-4bef-a206-c51e6e19922a tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] <== get_connector_properties: return (154ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:81501d91421', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 16:25:05 user nova-compute[71731]: DEBUG nova.virt.block_device [None req-ff8d934f-c58d-4bef-a206-c51e6e19922a tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 5ea4ab6a-6501-4a2f-a8f7-04090024747d] Updating existing volume attachment record: b915f695-095e-4b26-84d9-e55852b2ddf1 {{(pid=71731) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 16:25:05 user nova-compute[71731]: DEBUG nova.network.neutron [None req-ff8d934f-c58d-4bef-a206-c51e6e19922a tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 5ea4ab6a-6501-4a2f-a8f7-04090024747d] Successfully created port: 8a5c66fa-4693-4162-b5a8-2c80b33cf979 {{(pid=71731) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 16:25:06 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:25:06 user nova-compute[71731]: INFO nova.compute.manager [None req-a82bcc4a-8f0d-440e-8e98-b31ad960faf4 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: 235f827c-7116-48e9-84c5-0c9761c18e1e] Rescuing
Apr 13 16:25:06 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-a82bcc4a-8f0d-440e-8e98-b31ad960faf4 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Acquiring lock "refresh_cache-235f827c-7116-48e9-84c5-0c9761c18e1e" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 16:25:06 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-a82bcc4a-8f0d-440e-8e98-b31ad960faf4 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Acquired lock "refresh_cache-235f827c-7116-48e9-84c5-0c9761c18e1e" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 16:25:06 user nova-compute[71731]: DEBUG nova.network.neutron [None req-a82bcc4a-8f0d-440e-8e98-b31ad960faf4 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: 235f827c-7116-48e9-84c5-0c9761c18e1e] Building network info cache for instance {{(pid=71731) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 16:25:06 user nova-compute[71731]: DEBUG nova.network.neutron [None req-ff8d934f-c58d-4bef-a206-c51e6e19922a tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 5ea4ab6a-6501-4a2f-a8f7-04090024747d] Successfully updated port: 8a5c66fa-4693-4162-b5a8-2c80b33cf979 {{(pid=71731) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 16:25:06 user nova-compute[71731]: DEBUG nova.compute.manager [req-07fe3e76-f4b0-46b5-b749-64cff9c77905 req-3c9144cf-dc30-4d14-9304-112a46d39aeb service nova] [instance: 5ea4ab6a-6501-4a2f-a8f7-04090024747d] Received event network-changed-8a5c66fa-4693-4162-b5a8-2c80b33cf979 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:25:06 user nova-compute[71731]: DEBUG nova.compute.manager [req-07fe3e76-f4b0-46b5-b749-64cff9c77905 req-3c9144cf-dc30-4d14-9304-112a46d39aeb service nova] [instance: 5ea4ab6a-6501-4a2f-a8f7-04090024747d] Refreshing instance network info cache due to event network-changed-8a5c66fa-4693-4162-b5a8-2c80b33cf979. {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 16:25:06 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-07fe3e76-f4b0-46b5-b749-64cff9c77905 req-3c9144cf-dc30-4d14-9304-112a46d39aeb service nova] Acquiring lock "refresh_cache-5ea4ab6a-6501-4a2f-a8f7-04090024747d" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 16:25:06 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-07fe3e76-f4b0-46b5-b749-64cff9c77905 req-3c9144cf-dc30-4d14-9304-112a46d39aeb service nova] Acquired lock "refresh_cache-5ea4ab6a-6501-4a2f-a8f7-04090024747d" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 16:25:06 user nova-compute[71731]: DEBUG nova.network.neutron [req-07fe3e76-f4b0-46b5-b749-64cff9c77905 req-3c9144cf-dc30-4d14-9304-112a46d39aeb service nova] [instance: 5ea4ab6a-6501-4a2f-a8f7-04090024747d] Refreshing network info cache for port 8a5c66fa-4693-4162-b5a8-2c80b33cf979 {{(pid=71731) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 16:25:06 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-ff8d934f-c58d-4bef-a206-c51e6e19922a tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Acquiring lock "refresh_cache-5ea4ab6a-6501-4a2f-a8f7-04090024747d" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 16:25:07 user nova-compute[71731]: DEBUG nova.network.neutron [req-07fe3e76-f4b0-46b5-b749-64cff9c77905 req-3c9144cf-dc30-4d14-9304-112a46d39aeb service nova] [instance: 5ea4ab6a-6501-4a2f-a8f7-04090024747d] Instance cache missing network info. {{(pid=71731) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 16:25:07 user nova-compute[71731]: DEBUG nova.network.neutron [req-07fe3e76-f4b0-46b5-b749-64cff9c77905 req-3c9144cf-dc30-4d14-9304-112a46d39aeb service nova] [instance: 5ea4ab6a-6501-4a2f-a8f7-04090024747d] Updating instance_info_cache with network_info: [] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:25:07 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-07fe3e76-f4b0-46b5-b749-64cff9c77905 req-3c9144cf-dc30-4d14-9304-112a46d39aeb service nova] Releasing lock "refresh_cache-5ea4ab6a-6501-4a2f-a8f7-04090024747d" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 16:25:07 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-ff8d934f-c58d-4bef-a206-c51e6e19922a tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Acquired lock "refresh_cache-5ea4ab6a-6501-4a2f-a8f7-04090024747d" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 16:25:07 user nova-compute[71731]: DEBUG nova.network.neutron [None req-ff8d934f-c58d-4bef-a206-c51e6e19922a tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 5ea4ab6a-6501-4a2f-a8f7-04090024747d] Building network info cache for instance {{(pid=71731) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 16:25:07 user nova-compute[71731]: DEBUG nova.network.neutron [None req-a82bcc4a-8f0d-440e-8e98-b31ad960faf4 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: 235f827c-7116-48e9-84c5-0c9761c18e1e] Updating instance_info_cache with network_info: [{"id": "b72a6c8b-7244-41c2-a4f7-6da43b4944b8", "address": "fa:16:3e:e3:62:b0", "network": {"id": "5a7877ff-8230-470b-90b5-e5dcfc8f0cee", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-779403873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2d09a74bf684a9fb1dd1e95d6c23f3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb72a6c8b-72", "ovs_interfaceid": "b72a6c8b-7244-41c2-a4f7-6da43b4944b8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:25:07 user nova-compute[71731]: DEBUG nova.network.neutron [None req-ff8d934f-c58d-4bef-a206-c51e6e19922a tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 5ea4ab6a-6501-4a2f-a8f7-04090024747d] Instance cache missing network info. {{(pid=71731) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 16:25:07 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-a82bcc4a-8f0d-440e-8e98-b31ad960faf4 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Releasing lock "refresh_cache-235f827c-7116-48e9-84c5-0c9761c18e1e" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 16:25:07 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:25:07 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:25:08 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:25:08 user nova-compute[71731]: DEBUG nova.compute.manager [req-f05bad11-245b-4ab0-8ee6-1eb2b9b4c115 req-67eb36d8-9a32-4b03-bf0b-fd4c2f76843f service nova] [instance: 235f827c-7116-48e9-84c5-0c9761c18e1e] Received event network-vif-unplugged-b72a6c8b-7244-41c2-a4f7-6da43b4944b8 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:25:08 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-f05bad11-245b-4ab0-8ee6-1eb2b9b4c115 req-67eb36d8-9a32-4b03-bf0b-fd4c2f76843f service nova] Acquiring lock "235f827c-7116-48e9-84c5-0c9761c18e1e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:25:08 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-f05bad11-245b-4ab0-8ee6-1eb2b9b4c115 req-67eb36d8-9a32-4b03-bf0b-fd4c2f76843f service nova] Lock "235f827c-7116-48e9-84c5-0c9761c18e1e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:25:08 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-f05bad11-245b-4ab0-8ee6-1eb2b9b4c115 req-67eb36d8-9a32-4b03-bf0b-fd4c2f76843f service nova] Lock "235f827c-7116-48e9-84c5-0c9761c18e1e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:25:08 user nova-compute[71731]: DEBUG nova.compute.manager [req-f05bad11-245b-4ab0-8ee6-1eb2b9b4c115 req-67eb36d8-9a32-4b03-bf0b-fd4c2f76843f service nova] [instance: 235f827c-7116-48e9-84c5-0c9761c18e1e] No waiting events found dispatching network-vif-unplugged-b72a6c8b-7244-41c2-a4f7-6da43b4944b8 {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:25:08 user nova-compute[71731]: WARNING nova.compute.manager [req-f05bad11-245b-4ab0-8ee6-1eb2b9b4c115 req-67eb36d8-9a32-4b03-bf0b-fd4c2f76843f service nova] [instance: 235f827c-7116-48e9-84c5-0c9761c18e1e] Received unexpected event network-vif-unplugged-b72a6c8b-7244-41c2-a4f7-6da43b4944b8 for instance with vm_state active and task_state rescuing.
Apr 13 16:25:08 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:25:08 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:25:08 user nova-compute[71731]: DEBUG nova.network.neutron [None req-ff8d934f-c58d-4bef-a206-c51e6e19922a tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 5ea4ab6a-6501-4a2f-a8f7-04090024747d] Updating instance_info_cache with network_info: [{"id": "8a5c66fa-4693-4162-b5a8-2c80b33cf979", "address": "fa:16:3e:78:06:8d", "network": {"id": "d36bc206-f629-4d6e-8a3f-458061d7b525", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-893271134-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d451e0e239f486aa2b3abe9e273eab3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a5c66fa-46", "ovs_interfaceid": "8a5c66fa-4693-4162-b5a8-2c80b33cf979", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:25:08 user nova-compute[71731]: INFO nova.virt.libvirt.driver [-] [instance: 235f827c-7116-48e9-84c5-0c9761c18e1e] Instance destroyed successfully.
Apr 13 16:25:08 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-a82bcc4a-8f0d-440e-8e98-b31ad960faf4 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: 235f827c-7116-48e9-84c5-0c9761c18e1e] Attempting a stable device rescue
Apr 13 16:25:08 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-ff8d934f-c58d-4bef-a206-c51e6e19922a tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Releasing lock "refresh_cache-5ea4ab6a-6501-4a2f-a8f7-04090024747d" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 16:25:08 user nova-compute[71731]: DEBUG nova.compute.manager [None req-ff8d934f-c58d-4bef-a206-c51e6e19922a tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 5ea4ab6a-6501-4a2f-a8f7-04090024747d] Instance network_info: |[{"id": "8a5c66fa-4693-4162-b5a8-2c80b33cf979", "address": "fa:16:3e:78:06:8d", "network": {"id": "d36bc206-f629-4d6e-8a3f-458061d7b525", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-893271134-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d451e0e239f486aa2b3abe9e273eab3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a5c66fa-46", "ovs_interfaceid": "8a5c66fa-4693-4162-b5a8-2c80b33cf979", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71731) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 16:25:08 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-a82bcc4a-8f0d-440e-8e98-b31ad960faf4 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=71731) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4289}}
Apr 13 16:25:08 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-a82bcc4a-8f0d-440e-8e98-b31ad960faf4 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: 235f827c-7116-48e9-84c5-0c9761c18e1e] Instance directory exists: not creating {{(pid=71731) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 13 16:25:08 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-a82bcc4a-8f0d-440e-8e98-b31ad960faf4 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: 235f827c-7116-48e9-84c5-0c9761c18e1e] Creating image(s)
Apr 13 16:25:08 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-a82bcc4a-8f0d-440e-8e98-b31ad960faf4 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Acquiring lock "/opt/stack/data/nova/instances/235f827c-7116-48e9-84c5-0c9761c18e1e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:25:08 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-a82bcc4a-8f0d-440e-8e98-b31ad960faf4 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lock "/opt/stack/data/nova/instances/235f827c-7116-48e9-84c5-0c9761c18e1e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:25:08 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-a82bcc4a-8f0d-440e-8e98-b31ad960faf4 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lock "/opt/stack/data/nova/instances/235f827c-7116-48e9-84c5-0c9761c18e1e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:25:08 user nova-compute[71731]: DEBUG nova.objects.instance [None req-a82bcc4a-8f0d-440e-8e98-b31ad960faf4 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lazy-loading 'trusted_certs' on Instance uuid 235f827c-7116-48e9-84c5-0c9761c18e1e {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:25:08 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-a82bcc4a-8f0d-440e-8e98-b31ad960faf4 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Acquiring lock "e8d789a49cc1d9cec552fc5ab9d54dbf5c5f2c83" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:25:08 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-a82bcc4a-8f0d-440e-8e98-b31ad960faf4 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lock "e8d789a49cc1d9cec552fc5ab9d54dbf5c5f2c83" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:25:09 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-a82bcc4a-8f0d-440e-8e98-b31ad960faf4 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e8d789a49cc1d9cec552fc5ab9d54dbf5c5f2c83.part --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:25:09 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:25:09 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager.update_available_resource {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:25:09 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:25:09 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:25:09 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:25:09 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Auditing locally available compute resources for user (node: user) {{(pid=71731) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 16:25:09 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-a82bcc4a-8f0d-440e-8e98-b31ad960faf4 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e8d789a49cc1d9cec552fc5ab9d54dbf5c5f2c83.part --force-share --output=json" returned: 0 in 0.186s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:25:09 user nova-compute[71731]: DEBUG nova.virt.images [None req-a82bcc4a-8f0d-440e-8e98-b31ad960faf4 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] 1471081c-1dcc-4e86-af15-c22b3918bd0a was qcow2, converting to raw {{(pid=71731) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 13 16:25:09 user nova-compute[71731]: DEBUG nova.privsep.utils [None req-a82bcc4a-8f0d-440e-8e98-b31ad960faf4 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71731) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 13 16:25:09 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-a82bcc4a-8f0d-440e-8e98-b31ad960faf4 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e8d789a49cc1d9cec552fc5ab9d54dbf5c5f2c83.part /opt/stack/data/nova/instances/_base/e8d789a49cc1d9cec552fc5ab9d54dbf5c5f2c83.converted {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:25:09 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a2b8c9-388d-454c-88a1-54d7a8506511/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:25:10 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-a82bcc4a-8f0d-440e-8e98-b31ad960faf4 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e8d789a49cc1d9cec552fc5ab9d54dbf5c5f2c83.part /opt/stack/data/nova/instances/_base/e8d789a49cc1d9cec552fc5ab9d54dbf5c5f2c83.converted" returned: 0 in 0.353s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:25:10 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-a82bcc4a-8f0d-440e-8e98-b31ad960faf4 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e8d789a49cc1d9cec552fc5ab9d54dbf5c5f2c83.converted --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:25:10 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a2b8c9-388d-454c-88a1-54d7a8506511/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:25:10 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a2b8c9-388d-454c-88a1-54d7a8506511/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:25:10 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-a82bcc4a-8f0d-440e-8e98-b31ad960faf4 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e8d789a49cc1d9cec552fc5ab9d54dbf5c5f2c83.converted --force-share --output=json" returned: 0 in 0.152s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:25:10 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-a82bcc4a-8f0d-440e-8e98-b31ad960faf4 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lock "e8d789a49cc1d9cec552fc5ab9d54dbf5c5f2c83" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.558s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:25:10 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-a82bcc4a-8f0d-440e-8e98-b31ad960faf4 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Acquiring lock "e8d789a49cc1d9cec552fc5ab9d54dbf5c5f2c83" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:25:10 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-a82bcc4a-8f0d-440e-8e98-b31ad960faf4 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lock "e8d789a49cc1d9cec552fc5ab9d54dbf5c5f2c83" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:25:10 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-a82bcc4a-8f0d-440e-8e98-b31ad960faf4 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e8d789a49cc1d9cec552fc5ab9d54dbf5c5f2c83 --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:25:10 user nova-compute[71731]: DEBUG nova.compute.manager [req-8f4c34b7-c789-4048-9ee3-2dfa4918dd13 req-ab7a3bd3-d39f-48da-b458-94a0b430b44a service nova] [instance: 235f827c-7116-48e9-84c5-0c9761c18e1e] Received event network-vif-plugged-b72a6c8b-7244-41c2-a4f7-6da43b4944b8 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:25:10 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-8f4c34b7-c789-4048-9ee3-2dfa4918dd13 req-ab7a3bd3-d39f-48da-b458-94a0b430b44a service nova] Acquiring lock "235f827c-7116-48e9-84c5-0c9761c18e1e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:25:10 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-8f4c34b7-c789-4048-9ee3-2dfa4918dd13 req-ab7a3bd3-d39f-48da-b458-94a0b430b44a service nova] Lock "235f827c-7116-48e9-84c5-0c9761c18e1e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:25:10 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-8f4c34b7-c789-4048-9ee3-2dfa4918dd13 req-ab7a3bd3-d39f-48da-b458-94a0b430b44a service nova] Lock "235f827c-7116-48e9-84c5-0c9761c18e1e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:25:10 user nova-compute[71731]: DEBUG nova.compute.manager [req-8f4c34b7-c789-4048-9ee3-2dfa4918dd13 req-ab7a3bd3-d39f-48da-b458-94a0b430b44a service nova] [instance: 235f827c-7116-48e9-84c5-0c9761c18e1e] No waiting events found dispatching network-vif-plugged-b72a6c8b-7244-41c2-a4f7-6da43b4944b8 {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:25:10 user nova-compute[71731]: WARNING nova.compute.manager [req-8f4c34b7-c789-4048-9ee3-2dfa4918dd13 req-ab7a3bd3-d39f-48da-b458-94a0b430b44a service nova] [instance: 235f827c-7116-48e9-84c5-0c9761c18e1e] Received unexpected event network-vif-plugged-b72a6c8b-7244-41c2-a4f7-6da43b4944b8 for instance with vm_state active and task_state rescuing.
Apr 13 16:25:10 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a2b8c9-388d-454c-88a1-54d7a8506511/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:25:10 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acbcaee0-a47b-4fee-8765-9b1c9597d515/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:25:10 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:25:10 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-a82bcc4a-8f0d-440e-8e98-b31ad960faf4 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e8d789a49cc1d9cec552fc5ab9d54dbf5c5f2c83 --force-share --output=json" returned: 0 in 0.158s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:25:10 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-a82bcc4a-8f0d-440e-8e98-b31ad960faf4 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e8d789a49cc1d9cec552fc5ab9d54dbf5c5f2c83,backing_fmt=raw /opt/stack/data/nova/instances/235f827c-7116-48e9-84c5-0c9761c18e1e/disk.rescue {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:25:10 user nova-compute[71731]: DEBUG nova.compute.manager [None req-ff8d934f-c58d-4bef-a206-c51e6e19922a tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 5ea4ab6a-6501-4a2f-a8f7-04090024747d] Start spawning the instance on the hypervisor. {{(pid=71731) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 16:25:10 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-ff8d934f-c58d-4bef-a206-c51e6e19922a tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 5ea4ab6a-6501-4a2f-a8f7-04090024747d] Creating instance directory {{(pid=71731) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 16:25:10 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-ff8d934f-c58d-4bef-a206-c51e6e19922a tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 5ea4ab6a-6501-4a2f-a8f7-04090024747d] Creating image(s)
Apr 13 16:25:10 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-ff8d934f-c58d-4bef-a206-c51e6e19922a tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 5ea4ab6a-6501-4a2f-a8f7-04090024747d] Did not create local disks {{(pid=71731) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 13 16:25:10 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-ff8d934f-c58d-4bef-a206-c51e6e19922a tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 5ea4ab6a-6501-4a2f-a8f7-04090024747d] Ensure instance console log exists: /opt/stack/data/nova/instances/5ea4ab6a-6501-4a2f-a8f7-04090024747d/console.log {{(pid=71731) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 16:25:10 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-ff8d934f-c58d-4bef-a206-c51e6e19922a tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:25:10 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-ff8d934f-c58d-4bef-a206-c51e6e19922a tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:25:10 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-ff8d934f-c58d-4bef-a206-c51e6e19922a tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:25:10 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-ff8d934f-c58d-4bef-a206-c51e6e19922a tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 5ea4ab6a-6501-4a2f-a8f7-04090024747d] Start _get_guest_xml network_info=[{"id": "8a5c66fa-4693-4162-b5a8-2c80b33cf979", "address": "fa:16:3e:78:06:8d", "network": {"id": "d36bc206-f629-4d6e-8a3f-458061d7b525", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-893271134-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d451e0e239f486aa2b3abe9e273eab3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a5c66fa-46", "ovs_interfaceid": "8a5c66fa-4693-4162-b5a8-2c80b33cf979", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'attachment_id': 'b915f695-095e-4b26-84d9-e55852b2ddf1', 'mount_device': '/dev/vda', 'delete_on_termination': True, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e4317bfd-71c2-4c48-a0f0-e3c795f262a8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tPRqdNic', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '5ea4ab6a-6501-4a2f-a8f7-04090024747d', 'attached_at': '', 'detached_at': '', 'volume_id': 'e4317bfd-71c2-4c48-a0f0-e3c795f262a8', 'serial': 'e4317bfd-71c2-4c48-a0f0-e3c795f262a8'}, 'disk_bus': 'virtio', 'guest_format': None, 'volume_type': None} {{(pid=71731) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 16:25:10 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-a82bcc4a-8f0d-440e-8e98-b31ad960faf4 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e8d789a49cc1d9cec552fc5ab9d54dbf5c5f2c83,backing_fmt=raw /opt/stack/data/nova/instances/235f827c-7116-48e9-84c5-0c9761c18e1e/disk.rescue" returned: 0 in 0.068s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:25:10 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-a82bcc4a-8f0d-440e-8e98-b31ad960faf4 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lock "e8d789a49cc1d9cec552fc5ab9d54dbf5c5f2c83" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.229s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:25:10 user nova-compute[71731]: DEBUG nova.objects.instance [None req-a82bcc4a-8f0d-440e-8e98-b31ad960faf4 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lazy-loading 'migration_context' on Instance uuid 235f827c-7116-48e9-84c5-0c9761c18e1e {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:25:10 user nova-compute[71731]: WARNING nova.virt.libvirt.driver [None req-ff8d934f-c58d-4bef-a206-c51e6e19922a tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 16:25:10 user nova-compute[71731]: WARNING nova.virt.libvirt.driver [None req-ff8d934f-c58d-4bef-a206-c51e6e19922a tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 16:25:10 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-ff8d934f-c58d-4bef-a206-c51e6e19922a tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71731) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 16:25:10 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-ff8d934f-c58d-4bef-a206-c51e6e19922a tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T16:17:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 16:25:10 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-ff8d934f-c58d-4bef-a206-c51e6e19922a tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Flavor limits 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 16:25:10 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-ff8d934f-c58d-4bef-a206-c51e6e19922a tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Image limits 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 16:25:10 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-ff8d934f-c58d-4bef-a206-c51e6e19922a tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Flavor pref 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 16:25:10 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-ff8d934f-c58d-4bef-a206-c51e6e19922a tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Image pref 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 16:25:10 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-ff8d934f-c58d-4bef-a206-c51e6e19922a tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 16:25:10 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-ff8d934f-c58d-4bef-a206-c51e6e19922a tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 16:25:10 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-ff8d934f-c58d-4bef-a206-c51e6e19922a tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71731) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 16:25:10 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-ff8d934f-c58d-4bef-a206-c51e6e19922a tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Got 1 possible topologies {{(pid=71731) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 16:25:10 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-ff8d934f-c58d-4bef-a206-c51e6e19922a tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 16:25:10 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-ff8d934f-c58d-4bef-a206-c51e6e19922a tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 16:25:10 user nova-compute[71731]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ff8d934f-c58d-4bef-a206-c51e6e19922a tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 5ea4ab6a-6501-4a2f-a8f7-04090024747d] Calling os-brick to attach iSCSI Volume {{(pid=71731) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 16:25:10 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff8d934f-c58d-4bef-a206-c51e6e19922a tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8cf0118790>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e4317bfd-71c2-4c48-a0f0-e3c795f262a8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tPRqdNic', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 16:25:10 user nova-compute[71731]: WARNING os_brick.initiator.connectors.base [None req-ff8d934f-c58d-4bef-a206-c51e6e19922a tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 16:25:10 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-ff8d934f-c58d-4bef-a206-c51e6e19922a tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 16:25:10 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-ff8d934f-c58d-4bef-a206-c51e6e19922a tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 16:25:10 user nova-compute[71731]: WARNING os_brick.initiator.connectors.base [None req-ff8d934f-c58d-4bef-a206-c51e6e19922a tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 16:25:10 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-ff8d934f-c58d-4bef-a206-c51e6e19922a tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e4317bfd-71c2-4c48-a0f0-e3c795f262a8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 16:25:10 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-ff8d934f-c58d-4bef-a206-c51e6e19922a tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e4317bfd-71c2-4c48-a0f0-e3c795f262a8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 16:25:10 user nova-compute[71731]: INFO os_brick.initiator.connectors.iscsi [None req-ff8d934f-c58d-4bef-a206-c51e6e19922a tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 16:25:10 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acbcaee0-a47b-4fee-8765-9b1c9597d515/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:25:10 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-a82bcc4a-8f0d-440e-8e98-b31ad960faf4 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: 235f827c-7116-48e9-84c5-0c9761c18e1e] Created local disks {{(pid=71731) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 16:25:10 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-a82bcc4a-8f0d-440e-8e98-b31ad960faf4 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: 235f827c-7116-48e9-84c5-0c9761c18e1e] Start _get_guest_xml network_info=[{"id": "b72a6c8b-7244-41c2-a4f7-6da43b4944b8", "address": "fa:16:3e:e3:62:b0", "network": {"id": "5a7877ff-8230-470b-90b5-e5dcfc8f0cee", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-779403873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-779403873-network", "vif_mac": "fa:16:3e:e3:62:b0"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2d09a74bf684a9fb1dd1e95d6c23f3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb72a6c8b-72", "ovs_interfaceid": "b72a6c8b-7244-41c2-a4f7-6da43b4944b8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T16:16:31Z,direct_url=<?>,disk_format='qcow2',id=708622a9-7465-4492-ade8-b827198f7e30,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='0b29a975c552465aba0ac7d6288434bd',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T16:16:33Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '1471081c-1dcc-4e86-af15-c22b3918bd0a', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'attachment_id': 'b8388986-c360-4397-bc94-4299e0fa216f', 'mount_device': '/dev/vda', 'delete_on_termination': False, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jqPGdnMb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': '235f827c-7116-48e9-84c5-0c9761c18e1e', 'attached_at': '', 'detached_at': '', 'volume_id': '417090c0-76a2-4277-9095-5c5095638b97', 'serial': '417090c0-76a2-4277-9095-5c5095638b97'}, 'disk_bus': 'virtio', 'guest_format': None, 'volume_type': None} {{(pid=71731) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 16:25:10 user nova-compute[71731]: DEBUG nova.objects.instance [None req-a82bcc4a-8f0d-440e-8e98-b31ad960faf4 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lazy-loading 'resources' on Instance uuid 235f827c-7116-48e9-84c5-0c9761c18e1e {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:25:10 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acbcaee0-a47b-4fee-8765-9b1c9597d515/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:25:10 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4317bfd-71c2-4c48-a0f0-e3c795f262a8 -p 172.16.0.220:3260 {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:25:10 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4317bfd-71c2-4c48-a0f0-e3c795f262a8 -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:25:10 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[488ab8eb-57b5-4c0d-bab3-d28059bcbbae]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:25:10 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff8d934f-c58d-4bef-a206-c51e6e19922a tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 16:25:10 user nova-compute[71731]:  {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:25:10 user nova-compute[71731]: DEBUG nova.objects.instance [None req-a82bcc4a-8f0d-440e-8e98-b31ad960faf4 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lazy-loading 'numa_topology' on Instance uuid 235f827c-7116-48e9-84c5-0c9761c18e1e {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:25:10 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4317bfd-71c2-4c48-a0f0-e3c795f262a8 -p 172.16.0.220:3260 --interface default --op new {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:25:10 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4317bfd-71c2-4c48-a0f0-e3c795f262a8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:25:10 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cbf8c85-5508-43fb-a24a-2add9c910344]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e4317bfd-71c2-4c48-a0f0-e3c795f262a8] added\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:25:10 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff8d934f-c58d-4bef-a206-c51e6e19922a tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e4317bfd-71c2-4c48-a0f0-e3c795f262a8] added
Apr 13 16:25:10 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:25:10 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4317bfd-71c2-4c48-a0f0-e3c795f262a8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:25:10 user nova-compute[71731]: WARNING nova.virt.libvirt.driver [None req-a82bcc4a-8f0d-440e-8e98-b31ad960faf4 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 16:25:10 user nova-compute[71731]: WARNING nova.virt.libvirt.driver [None req-a82bcc4a-8f0d-440e-8e98-b31ad960faf4 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 16:25:10 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-a82bcc4a-8f0d-440e-8e98-b31ad960faf4 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71731) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 16:25:10 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-a82bcc4a-8f0d-440e-8e98-b31ad960faf4 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T16:17:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T16:16:31Z,direct_url=<?>,disk_format='qcow2',id=708622a9-7465-4492-ade8-b827198f7e30,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='0b29a975c552465aba0ac7d6288434bd',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T16:16:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 16:25:10 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-a82bcc4a-8f0d-440e-8e98-b31ad960faf4 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Flavor limits 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 16:25:10 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-a82bcc4a-8f0d-440e-8e98-b31ad960faf4 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Image limits 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 16:25:10 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-a82bcc4a-8f0d-440e-8e98-b31ad960faf4 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Flavor pref 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 16:25:10 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-a82bcc4a-8f0d-440e-8e98-b31ad960faf4 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Image pref 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 16:25:10 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-a82bcc4a-8f0d-440e-8e98-b31ad960faf4 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 16:25:10 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-a82bcc4a-8f0d-440e-8e98-b31ad960faf4 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 16:25:10 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-a82bcc4a-8f0d-440e-8e98-b31ad960faf4 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71731) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 16:25:10 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-a82bcc4a-8f0d-440e-8e98-b31ad960faf4 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Got 1 possible topologies {{(pid=71731) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 16:25:10 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-a82bcc4a-8f0d-440e-8e98-b31ad960faf4 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 16:25:10 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-a82bcc4a-8f0d-440e-8e98-b31ad960faf4 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 16:25:10 user nova-compute[71731]: DEBUG nova.objects.instance [None req-a82bcc4a-8f0d-440e-8e98-b31ad960faf4 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lazy-loading 'vcpu_model' on Instance uuid 235f827c-7116-48e9-84c5-0c9761c18e1e {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:25:10 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4317bfd-71c2-4c48-a0f0-e3c795f262a8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:25:10 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfaac9ae-6299-4011-85e0-baa445a94b20]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:25:10 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff8d934f-c58d-4bef-a206-c51e6e19922a tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:25:10 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4317bfd-71c2-4c48-a0f0-e3c795f262a8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:25:10 user nova-compute[71731]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a82bcc4a-8f0d-440e-8e98-b31ad960faf4 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: 235f827c-7116-48e9-84c5-0c9761c18e1e] Calling os-brick to attach iSCSI Volume {{(pid=71731) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 16:25:10 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-a82bcc4a-8f0d-440e-8e98-b31ad960faf4 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8cf0118790>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jqPGdnMb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 16:25:10 user nova-compute[71731]: WARNING os_brick.initiator.connectors.base [None req-a82bcc4a-8f0d-440e-8e98-b31ad960faf4 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 16:25:10 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-a82bcc4a-8f0d-440e-8e98-b31ad960faf4 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 16:25:10 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4317bfd-71c2-4c48-a0f0-e3c795f262a8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:25:10 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5e23551-e86e-455e-84ae-0d30a6e0c96b]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:25:10 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff8d934f-c58d-4bef-a206-c51e6e19922a tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:25:10 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acbcaee0-a47b-4fee-8765-9b1c9597d515/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:25:10 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4317bfd-71c2-4c48-a0f0-e3c795f262a8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tPRqdNic {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:25:10 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7973e93b-6311-44ed-91ff-e861c32d0277/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:25:10 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4317bfd-71c2-4c48-a0f0-e3c795f262a8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tPRqdNic" returned: 0 in 0.018s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:25:10 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[635005ae-96b5-406f-981c-af385d5b5363]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:25:10 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff8d934f-c58d-4bef-a206-c51e6e19922a tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tPRqdNic'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:25:10 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4317bfd-71c2-4c48-a0f0-e3c795f262a8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:25:10 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4317bfd-71c2-4c48-a0f0-e3c795f262a8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:25:10 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4f87a92-c621-4cd3-977f-cd60df901891]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:25:10 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff8d934f-c58d-4bef-a206-c51e6e19922a tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:25:10 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:25:10 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:25:10 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd904c12-e05e-4697-ac0b-e19accc2070c]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc7649d3-fc59-438d-b230-72c4ce61e722 (non-flash)\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:25:10 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff8d934f-c58d-4bef-a206-c51e6e19922a tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)
Apr 13 16:25:10 user nova-compute[71731]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc7649d3-fc59-438d-b230-72c4ce61e722 (non-flash)
Apr 13 16:25:10 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 16:25:10 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff8d934f-c58d-4bef-a206-c51e6e19922a tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)
Apr 13 16:25:10 user nova-compute[71731]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc7649d3-fc59-438d-b230-72c4ce61e722 (non-flash)
Apr 13 16:25:10 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 16:25:10 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4317bfd-71c2-4c48-a0f0-e3c795f262a8 -p 172.16.0.220:3260 --login {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:25:10 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7973e93b-6311-44ed-91ff-e861c32d0277/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:25:10 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7973e93b-6311-44ed-91ff-e861c32d0277/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:25:10 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4317bfd-71c2-4c48-a0f0-e3c795f262a8 -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:25:10 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e268867-21e9-4e2a-b6df-94f97a1e010e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e4317bfd-71c2-4c48-a0f0-e3c795f262a8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e4317bfd-71c2-4c48-a0f0-e3c795f262a8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:25:10 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff8d934f-c58d-4bef-a206-c51e6e19922a tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e4317bfd-71c2-4c48-a0f0-e3c795f262a8, portal: 172.16.0.220,3260]
Apr 13 16:25:10 user nova-compute[71731]: Login to [iface: default, target: iqn.2010-10.org.openstack:e4317bfd-71c2-4c48-a0f0-e3c795f262a8, portal: 172.16.0.220,3260] successful.
Apr 13 16:25:10 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:25:10 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4317bfd-71c2-4c48-a0f0-e3c795f262a8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:25:10 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4317bfd-71c2-4c48-a0f0-e3c795f262a8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:25:10 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dc13cdf-4fbc-4db2-93fd-d4c433b3f36b]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:25:10 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff8d934f-c58d-4bef-a206-c51e6e19922a tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:25:10 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:25:10 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:25:10 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[e99d68ee-b465-4fe1-b7c2-3c27a8fc0a1e]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc7649d3-fc59-438d-b230-72c4ce61e722 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4317bfd-71c2-4c48-a0f0-e3c795f262a8 (non-flash)\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:25:10 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff8d934f-c58d-4bef-a206-c51e6e19922a tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)
Apr 13 16:25:10 user nova-compute[71731]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc7649d3-fc59-438d-b230-72c4ce61e722 (non-flash)
Apr 13 16:25:10 user nova-compute[71731]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4317bfd-71c2-4c48-a0f0-e3c795f262a8 (non-flash)
Apr 13 16:25:10 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 16:25:10 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff8d934f-c58d-4bef-a206-c51e6e19922a tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)
Apr 13 16:25:10 user nova-compute[71731]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc7649d3-fc59-438d-b230-72c4ce61e722 (non-flash)
Apr 13 16:25:10 user nova-compute[71731]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4317bfd-71c2-4c48-a0f0-e3c795f262a8 (non-flash)
Apr 13 16:25:10 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 16:25:10 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-ff8d934f-c58d-4bef-a206-c51e6e19922a tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e4317bfd-71c2-4c48-a0f0-e3c795f262a8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.408s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 16:25:10 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff8d934f-c58d-4bef-a206-c51e6e19922a tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Connected to 172.16.0.220:3260 {{(pid=71731) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 16:25:10 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-ff8d934f-c58d-4bef-a206-c51e6e19922a tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] HCTL ('35', '-', '-', 0) found on session 19 with lun 0 {{(pid=71731) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 16:25:10 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-ff8d934f-c58d-4bef-a206-c51e6e19922a tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=71731) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 16:25:10 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:25:10 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:25:10 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b443b34-15e1-4327-a77c-5a5295a9eac8]: (4, ('- - 0', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:25:10 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-ff8d934f-c58d-4bef-a206-c51e6e19922a tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Searching for a device in session 19 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=71731) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 16:25:10 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff8d934f-c58d-4bef-a206-c51e6e19922a tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:e4317bfd-71c2-4c48-a0f0-e3c795f262a8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tPRqdNic', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71731) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 16:25:11 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7973e93b-6311-44ed-91ff-e861c32d0277/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:25:11 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66553f5-5e1b-4f1d-8c5a-63bc340f7586/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:25:11 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:25:11 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66553f5-5e1b-4f1d-8c5a-63bc340f7586/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:25:11 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66553f5-5e1b-4f1d-8c5a-63bc340f7586/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:25:11 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66553f5-5e1b-4f1d-8c5a-63bc340f7586/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:25:11 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbcccf4b-e861-4254-9be3-a491776214e9/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:25:11 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbcccf4b-e861-4254-9be3-a491776214e9/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:25:11 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbcccf4b-e861-4254-9be3-a491776214e9/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:25:11 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:25:11 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbcccf4b-e861-4254-9be3-a491776214e9/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:25:11 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=71731) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 16:25:11 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbcccf4b-e861-4254-9be3-a491776214e9/disk.rescue --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:25:11 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbcccf4b-e861-4254-9be3-a491776214e9/disk.rescue --force-share --output=json" returned: 0 in 0.141s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:25:11 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbcccf4b-e861-4254-9be3-a491776214e9/disk.rescue --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:25:11 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbcccf4b-e861-4254-9be3-a491776214e9/disk.rescue --force-share --output=json" returned: 0 in 0.183s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:25:11 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-ff8d934f-c58d-4bef-a206-c51e6e19922a tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.445s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 16:25:11 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff8d934f-c58d-4bef-a206-c51e6e19922a tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] <== connect_volume: return (1447ms) {'type': 'block', 'scsi_wwn': '23161663938626437', 'path': '/dev/sdd'} {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 16:25:11 user nova-compute[71731]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ff8d934f-c58d-4bef-a206-c51e6e19922a tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 5ea4ab6a-6501-4a2f-a8f7-04090024747d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23161663938626437', 'path': '/dev/sdd'} {{(pid=71731) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 16:25:11 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-a82bcc4a-8f0d-440e-8e98-b31ad960faf4 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.293s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 16:25:12 user nova-compute[71731]: WARNING os_brick.initiator.connectors.base [None req-a82bcc4a-8f0d-440e-8e98-b31ad960faf4 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 16:25:12 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-a82bcc4a-8f0d-440e-8e98-b31ad960faf4 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 16:25:12 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-a82bcc4a-8f0d-440e-8e98-b31ad960faf4 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 16:25:12 user nova-compute[71731]: INFO os_brick.initiator.connectors.iscsi [None req-a82bcc4a-8f0d-440e-8e98-b31ad960faf4 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 16:25:12 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 -p 172.16.0.220:3260 {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:25:12 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eaae47b9-a059-49f6-9ae6-d7147003e2f2/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:25:12 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 -p 172.16.0.220:3260" returned: 0 in 0.022s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:25:12 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bf9aadf-be80-4298-a9ed-6100abc8f7f6]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = jqPGdnMb\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:25:12 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-a82bcc4a-8f0d-440e-8e98-b31ad960faf4 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Apr 13 16:25:12 user nova-compute[71731]: node.name = iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97
Apr 13 16:25:12 user nova-compute[71731]: node.tpgt = -1
Apr 13 16:25:12 user nova-compute[71731]: node.startup = automatic
Apr 13 16:25:12 user nova-compute[71731]: node.leading_login = No
Apr 13 16:25:12 user nova-compute[71731]: iface.iscsi_ifacename = default
Apr 13 16:25:12 user nova-compute[71731]: iface.net_ifacename = <empty>
Apr 13 16:25:12 user nova-compute[71731]: iface.ipaddress = <empty>
Apr 13 16:25:12 user nova-compute[71731]: iface.prefix_len = 0
Apr 13 16:25:12 user nova-compute[71731]: iface.hwaddress = <empty>
Apr 13 16:25:12 user nova-compute[71731]: iface.transport_name = tcp
Apr 13 16:25:12 user nova-compute[71731]: iface.initiatorname = <empty>
Apr 13 16:25:12 user nova-compute[71731]: iface.state = <empty>
Apr 13 16:25:12 user nova-compute[71731]: iface.vlan_id = 0
Apr 13 16:25:12 user nova-compute[71731]: iface.vlan_priority = 0
Apr 13 16:25:12 user nova-compute[71731]: iface.vlan_state = <empty>
Apr 13 16:25:12 user nova-compute[71731]: iface.iface_num = 0
Apr 13 16:25:12 user nova-compute[71731]: iface.mtu = 0
Apr 13 16:25:12 user nova-compute[71731]: iface.port = 0
Apr 13 16:25:12 user nova-compute[71731]: iface.bootproto = <empty>
Apr 13 16:25:12 user nova-compute[71731]: iface.subnet_mask = <empty>
Apr 13 16:25:12 user nova-compute[71731]: iface.gateway = <empty>
Apr 13 16:25:12 user nova-compute[71731]: iface.dhcp_alt_client_id_state = <empty>
Apr 13 16:25:12 user nova-compute[71731]: iface.dhcp_alt_client_id = <empty>
Apr 13 16:25:12 user nova-compute[71731]: iface.dhcp_dns = <empty>
Apr 13 16:25:12 user nova-compute[71731]: iface.dhcp_learn_iqn = <empty>
Apr 13 16:25:12 user nova-compute[71731]: iface.dhcp_req_vendor_id_state = <empty>
Apr 13 16:25:12 user nova-compute[71731]: iface.dhcp_vendor_id_state = <empty>
Apr 13 16:25:12 user nova-compute[71731]: iface.dhcp_vendor_id = <empty>
Apr 13 16:25:12 user nova-compute[71731]: iface.dhcp_slp_da = <empty>
Apr 13 16:25:12 user nova-compute[71731]: iface.fragmentation = <empty>
Apr 13 16:25:12 user nova-compute[71731]: iface.gratuitous_arp = <empty>
Apr 13 16:25:12 user nova-compute[71731]: iface.incoming_forwarding = <empty>
Apr 13 16:25:12 user nova-compute[71731]: iface.tos_state = <empty>
Apr 13 16:25:12 user nova-compute[71731]: iface.tos = 0
Apr 13 16:25:12 user nova-compute[71731]: iface.ttl = 0
Apr 13 16:25:12 user nova-compute[71731]: iface.delayed_ack = <empty>
Apr 13 16:25:12 user nova-compute[71731]: iface.tcp_nagle = <empty>
Apr 13 16:25:12 user nova-compute[71731]: iface.tcp_wsf_state = <empty>
Apr 13 16:25:12 user nova-compute[71731]: iface.tcp_wsf = 0
Apr 13 16:25:12 user nova-compute[71731]: iface.tcp_timer_scale = 0
Apr 13 16:25:12 user nova-compute[71731]: iface.tcp_timestamp = <empty>
Apr 13 16:25:12 user nova-compute[71731]: iface.redirect = <empty>
Apr 13 16:25:12 user nova-compute[71731]: iface.def_task_mgmt_timeout = 0
Apr 13 16:25:12 user nova-compute[71731]: iface.header_digest = <empty>
Apr 13 16:25:12 user nova-compute[71731]: iface.data_digest = <empty>
Apr 13 16:25:12 user nova-compute[71731]: iface.immediate_data = <empty>
Apr 13 16:25:12 user nova-compute[71731]: iface.initial_r2t = <empty>
Apr 13 16:25:12 user nova-compute[71731]: iface.data_seq_inorder = <empty>
Apr 13 16:25:12 user nova-compute[71731]: iface.data_pdu_inorder = <empty>
Apr 13 16:25:12 user nova-compute[71731]: iface.erl = 0
Apr 13 16:25:12 user nova-compute[71731]: iface.max_receive_data_len = 0
Apr 13 16:25:12 user nova-compute[71731]: iface.first_burst_len = 0
Apr 13 16:25:12 user nova-compute[71731]: iface.max_outstanding_r2t = 0
Apr 13 16:25:12 user nova-compute[71731]: iface.max_burst_len = 0
Apr 13 16:25:12 user nova-compute[71731]: iface.chap_auth = <empty>
Apr 13 16:25:12 user nova-compute[71731]: iface.bidi_chap = <empty>
Apr 13 16:25:12 user nova-compute[71731]: iface.strict_login_compliance = <empty>
Apr 13 16:25:12 user nova-compute[71731]: iface.discovery_auth = <empty>
Apr 13 16:25:12 user nova-compute[71731]: iface.discovery_logout = <empty>
Apr 13 16:25:12 user nova-compute[71731]: node.discovery_address = <empty>
Apr 13 16:25:12 user nova-compute[71731]: node.discovery_port = 0
Apr 13 16:25:12 user nova-compute[71731]: node.discovery_type = static
Apr 13 16:25:12 user nova-compute[71731]: node.session.initial_cmdsn = 0
Apr 13 16:25:12 user nova-compute[71731]: node.session.initial_login_retry_max = 8
Apr 13 16:25:12 user nova-compute[71731]: node.session.xmit_thread_priority = -20
Apr 13 16:25:12 user nova-compute[71731]: node.session.cmds_max = 128
Apr 13 16:25:12 user nova-compute[71731]: node.session.queue_depth = 32
Apr 13 16:25:12 user nova-compute[71731]: node.session.nr_sessions = 1
Apr 13 16:25:12 user nova-compute[71731]: node.session.auth.authmethod = CHAP
Apr 13 16:25:12 user nova-compute[71731]: node.session.auth.username = jqPGdnMb
Apr 13 16:25:12 user nova-compute[71731]: node.session.auth.password = ***
Apr 13 16:25:12 user nova-compute[71731]: node.session.auth.username_in = <empty>
Apr 13 16:25:12 user nova-compute[71731]: node.session.auth.password_in = <empty>
Apr 13 16:25:12 user nova-compute[71731]: node.session.auth.chap_algs = MD5
Apr 13 16:25:12 user nova-compute[71731]: node.session.timeo.replacement_timeout = 120
Apr 13 16:25:12 user nova-compute[71731]: node.session.err_timeo.abort_timeout = 15
Apr 13 16:25:12 user nova-compute[71731]: node.session.err_timeo.lu_reset_timeout = 30
Apr 13 16:25:12 user nova-compute[71731]: node.session.err_timeo.tgt_reset_timeout = 30
Apr 13 16:25:12 user nova-compute[71731]: node.session.err_timeo.host_reset_timeout = 60
Apr 13 16:25:12 user nova-compute[71731]: node.session.iscsi.FastAbort = Yes
Apr 13 16:25:12 user nova-compute[71731]: node.session.iscsi.InitialR2T = No
Apr 13 16:25:12 user nova-compute[71731]: node.session.iscsi.ImmediateData = Yes
Apr 13 16:25:12 user nova-compute[71731]: node.session.iscsi.FirstBurstLength = 262144
Apr 13 16:25:12 user nova-compute[71731]: node.session.iscsi.MaxBurstLength = 16776192
Apr 13 16:25:12 user nova-compute[71731]: node.session.iscsi.DefaultTime2Retain = 0
Apr 13 16:25:12 user nova-compute[71731]: node.session.iscsi.DefaultTime2Wait = 2
Apr 13 16:25:12 user nova-compute[71731]: node.session.iscsi.MaxConnections = 1
Apr 13 16:25:12 user nova-compute[71731]: node.session.iscsi.MaxOutstandingR2T = 1
Apr 13 16:25:12 user nova-compute[71731]: node.session.iscsi.ERL = 0
Apr 13 16:25:12 user nova-compute[71731]: node.session.scan = manual
Apr 13 16:25:12 user nova-compute[71731]: node.session.reopen_max = 0
Apr 13 16:25:12 user nova-compute[71731]: node.conn[0].address = 172.16.0.220
Apr 13 16:25:12 user nova-compute[71731]: node.conn[0].port = 3260
Apr 13 16:25:12 user nova-compute[71731]: node.conn[0].startup = manual
Apr 13 16:25:12 user nova-compute[71731]: node.conn[0].tcp.window_size = 524288
Apr 13 16:25:12 user nova-compute[71731]: node.conn[0].tcp.type_of_service = 0
Apr 13 16:25:12 user nova-compute[71731]: node.conn[0].timeo.logout_timeout = 15
Apr 13 16:25:12 user nova-compute[71731]: node.conn[0].timeo.login_timeout = 15
Apr 13 16:25:12 user nova-compute[71731]: node.conn[0].timeo.auth_timeout = 45
Apr 13 16:25:12 user nova-compute[71731]: node.conn[0].timeo.noop_out_interval = 5
Apr 13 16:25:12 user nova-compute[71731]: node.conn[0].timeo.noop_out_timeout = 5
Apr 13 16:25:12 user nova-compute[71731]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Apr 13 16:25:12 user nova-compute[71731]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Apr 13 16:25:12 user nova-compute[71731]: node.conn[0].iscsi.HeaderDigest = None
Apr 13 16:25:12 user nova-compute[71731]: node.conn[0].iscsi.DataDigest = None
Apr 13 16:25:12 user nova-compute[71731]: node.conn[0].iscsi.IFMarker = No
Apr 13 16:25:12 user nova-compute[71731]: node.conn[0].iscsi.OFMarker = No
Apr 13 16:25:12 user nova-compute[71731]: # END RECORD
Apr 13 16:25:12 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:25:12 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:25:12 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:25:12 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[48b3ec9e-85e8-48e0-b6ef-3e7786731dd6]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:25:12 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-a82bcc4a-8f0d-440e-8e98-b31ad960faf4 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:25:12 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:25:12 user nova-compute[71731]: DEBUG nova.virt.libvirt.vif [None req-ff8d934f-c58d-4bef-a206-c51e6e19922a tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T16:25:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1961905208',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1961905208',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1961905208',id=19,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8d451e0e239f486aa2b3abe9e273eab3',ramdisk_id='',reservation_id='r-o0bt6f2g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-438786227',owner_user_name='tempest-TestVolumeBootPattern-438786227-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T16:25:05Z,user_data=None,user_id='d70e10f63cdd49a9a1ebe1fe4c9de0a2',uuid=5ea4ab6a-6501-4a2f-a8f7-04090024747d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8a5c66fa-4693-4162-b5a8-2c80b33cf979", "address": "fa:16:3e:78:06:8d", "network": {"id": "d36bc206-f629-4d6e-8a3f-458061d7b525", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-893271134-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d451e0e239f486aa2b3abe9e273eab3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a5c66fa-46", "ovs_interfaceid": "8a5c66fa-4693-4162-b5a8-2c80b33cf979", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71731) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 16:25:12 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-ff8d934f-c58d-4bef-a206-c51e6e19922a tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Converting VIF {"id": "8a5c66fa-4693-4162-b5a8-2c80b33cf979", "address": "fa:16:3e:78:06:8d", "network": {"id": "d36bc206-f629-4d6e-8a3f-458061d7b525", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-893271134-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d451e0e239f486aa2b3abe9e273eab3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a5c66fa-46", "ovs_interfaceid": "8a5c66fa-4693-4162-b5a8-2c80b33cf979", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 16:25:12 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-ff8d934f-c58d-4bef-a206-c51e6e19922a tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:78:06:8d,bridge_name='br-int',has_traffic_filtering=True,id=8a5c66fa-4693-4162-b5a8-2c80b33cf979,network=Network(d36bc206-f629-4d6e-8a3f-458061d7b525),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a5c66fa-46') {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 16:25:12 user nova-compute[71731]: DEBUG nova.objects.instance [None req-ff8d934f-c58d-4bef-a206-c51e6e19922a tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lazy-loading 'pci_devices' on Instance uuid 5ea4ab6a-6501-4a2f-a8f7-04090024747d {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:25:12 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-ff8d934f-c58d-4bef-a206-c51e6e19922a tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 5ea4ab6a-6501-4a2f-a8f7-04090024747d] End _get_guest_xml xml=<domain type="kvm">
Apr 13 16:25:12 user nova-compute[71731]:   <uuid>5ea4ab6a-6501-4a2f-a8f7-04090024747d</uuid>
Apr 13 16:25:12 user nova-compute[71731]:   <name>instance-00000013</name>
Apr 13 16:25:12 user nova-compute[71731]:   <memory>131072</memory>
Apr 13 16:25:12 user nova-compute[71731]:   <vcpu>1</vcpu>
Apr 13 16:25:12 user nova-compute[71731]:   <metadata>
Apr 13 16:25:12 user nova-compute[71731]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 16:25:12 user nova-compute[71731]:       <nova:package version="0.0.0"/>
Apr 13 16:25:12 user nova-compute[71731]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-1961905208</nova:name>
Apr 13 16:25:12 user nova-compute[71731]:       <nova:creationTime>2023-04-13 16:25:10</nova:creationTime>
Apr 13 16:25:12 user nova-compute[71731]:       <nova:flavor name="m1.nano">
Apr 13 16:25:12 user nova-compute[71731]:         <nova:memory>128</nova:memory>
Apr 13 16:25:12 user nova-compute[71731]:         <nova:disk>1</nova:disk>
Apr 13 16:25:12 user nova-compute[71731]:         <nova:swap>0</nova:swap>
Apr 13 16:25:12 user nova-compute[71731]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 16:25:12 user nova-compute[71731]:         <nova:vcpus>1</nova:vcpus>
Apr 13 16:25:12 user nova-compute[71731]:       </nova:flavor>
Apr 13 16:25:12 user nova-compute[71731]:       <nova:owner>
Apr 13 16:25:12 user nova-compute[71731]:         <nova:user uuid="d70e10f63cdd49a9a1ebe1fe4c9de0a2">tempest-TestVolumeBootPattern-438786227-project-member</nova:user>
Apr 13 16:25:12 user nova-compute[71731]:         <nova:project uuid="8d451e0e239f486aa2b3abe9e273eab3">tempest-TestVolumeBootPattern-438786227</nova:project>
Apr 13 16:25:12 user nova-compute[71731]:       </nova:owner>
Apr 13 16:25:12 user nova-compute[71731]:       <nova:ports>
Apr 13 16:25:12 user nova-compute[71731]:         <nova:port uuid="8a5c66fa-4693-4162-b5a8-2c80b33cf979">
Apr 13 16:25:12 user nova-compute[71731]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Apr 13 16:25:12 user nova-compute[71731]:         </nova:port>
Apr 13 16:25:12 user nova-compute[71731]:       </nova:ports>
Apr 13 16:25:12 user nova-compute[71731]:     </nova:instance>
Apr 13 16:25:12 user nova-compute[71731]:   </metadata>
Apr 13 16:25:12 user nova-compute[71731]:   <sysinfo type="smbios">
Apr 13 16:25:12 user nova-compute[71731]:     <system>
Apr 13 16:25:12 user nova-compute[71731]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 16:25:12 user nova-compute[71731]:       <entry name="product">OpenStack Nova</entry>
Apr 13 16:25:12 user nova-compute[71731]:       <entry name="version">0.0.0</entry>
Apr 13 16:25:12 user nova-compute[71731]:       <entry name="serial">5ea4ab6a-6501-4a2f-a8f7-04090024747d</entry>
Apr 13 16:25:12 user nova-compute[71731]:       <entry name="uuid">5ea4ab6a-6501-4a2f-a8f7-04090024747d</entry>
Apr 13 16:25:12 user nova-compute[71731]:       <entry name="family">Virtual Machine</entry>
Apr 13 16:25:12 user nova-compute[71731]:     </system>
Apr 13 16:25:12 user nova-compute[71731]:   </sysinfo>
Apr 13 16:25:12 user nova-compute[71731]:   <os>
Apr 13 16:25:12 user nova-compute[71731]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 16:25:12 user nova-compute[71731]:     <boot dev="hd"/>
Apr 13 16:25:12 user nova-compute[71731]:     <smbios mode="sysinfo"/>
Apr 13 16:25:12 user nova-compute[71731]:   </os>
Apr 13 16:25:12 user nova-compute[71731]:   <features>
Apr 13 16:25:12 user nova-compute[71731]:     <acpi/>
Apr 13 16:25:12 user nova-compute[71731]:     <apic/>
Apr 13 16:25:12 user nova-compute[71731]:     <vmcoreinfo/>
Apr 13 16:25:12 user nova-compute[71731]:   </features>
Apr 13 16:25:12 user nova-compute[71731]:   <clock offset="utc">
Apr 13 16:25:12 user nova-compute[71731]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 16:25:12 user nova-compute[71731]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 16:25:12 user nova-compute[71731]:     <timer name="hpet" present="no"/>
Apr 13 16:25:12 user nova-compute[71731]:   </clock>
Apr 13 16:25:12 user nova-compute[71731]:   <cpu mode="custom" match="exact">
Apr 13 16:25:12 user nova-compute[71731]:     <model>Nehalem</model>
Apr 13 16:25:12 user nova-compute[71731]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 16:25:12 user nova-compute[71731]:   </cpu>
Apr 13 16:25:12 user nova-compute[71731]:   <devices>
Apr 13 16:25:12 user nova-compute[71731]:     <disk type="block" device="disk">
Apr 13 16:25:12 user nova-compute[71731]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 16:25:12 user nova-compute[71731]:       <source dev="/dev/sdd"/>
Apr 13 16:25:12 user nova-compute[71731]:       <target dev="vda" bus="virtio"/>
Apr 13 16:25:12 user nova-compute[71731]:       <serial>e4317bfd-71c2-4c48-a0f0-e3c795f262a8</serial>
Apr 13 16:25:12 user nova-compute[71731]:     </disk>
Apr 13 16:25:12 user nova-compute[71731]:     <interface type="ethernet">
Apr 13 16:25:12 user nova-compute[71731]:       <mac address="fa:16:3e:78:06:8d"/>
Apr 13 16:25:12 user nova-compute[71731]:       <model type="virtio"/>
Apr 13 16:25:12 user nova-compute[71731]:       <mtu size="1442"/>
Apr 13 16:25:12 user nova-compute[71731]:       <target dev="tap8a5c66fa-46"/>
Apr 13 16:25:12 user nova-compute[71731]:     </interface>
Apr 13 16:25:12 user nova-compute[71731]:     <serial type="pty">
Apr 13 16:25:12 user nova-compute[71731]:       <log file="/opt/stack/data/nova/instances/5ea4ab6a-6501-4a2f-a8f7-04090024747d/console.log" append="off"/>
Apr 13 16:25:12 user nova-compute[71731]:     </serial>
Apr 13 16:25:12 user nova-compute[71731]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 16:25:12 user nova-compute[71731]:     <video>
Apr 13 16:25:12 user nova-compute[71731]:       <model type="virtio"/>
Apr 13 16:25:12 user nova-compute[71731]:     </video>
Apr 13 16:25:12 user nova-compute[71731]:     <rng model="virtio">
Apr 13 16:25:12 user nova-compute[71731]:       <backend model="random">/dev/urandom</backend>
Apr 13 16:25:12 user nova-compute[71731]:     </rng>
Apr 13 16:25:12 user nova-compute[71731]:     <controller type="usb" index="0" model="none"/>
Apr 13 16:25:12 user nova-compute[71731]:     <memballoon model="virtio">
Apr 13 16:25:12 user nova-compute[71731]:       <stats period="10"/>
Apr 13 16:25:12 user nova-compute[71731]:     </memballoon>
Apr 13 16:25:12 user nova-compute[71731]:   </devices>
Apr 13 16:25:12 user nova-compute[71731]: </domain>
Apr 13 16:25:12 user nova-compute[71731]:  {{(pid=71731) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 16:25:12 user nova-compute[71731]: DEBUG nova.virt.libvirt.vif [None req-ff8d934f-c58d-4bef-a206-c51e6e19922a tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T16:25:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1961905208',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1961905208',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1961905208',id=19,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8d451e0e239f486aa2b3abe9e273eab3',ramdisk_id='',reservation_id='r-o0bt6f2g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-438786227',owner_user_name='tempest-TestVolumeBootPattern-438786227-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T16:25:05Z,user_data=None,user_id='d70e10f63cdd49a9a1ebe1fe4c9de0a2',uuid=5ea4ab6a-6501-4a2f-a8f7-04090024747d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8a5c66fa-4693-4162-b5a8-2c80b33cf979", "address": "fa:16:3e:78:06:8d", "network": {"id": "d36bc206-f629-4d6e-8a3f-458061d7b525", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-893271134-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d451e0e239f486aa2b3abe9e273eab3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a5c66fa-46", "ovs_interfaceid": "8a5c66fa-4693-4162-b5a8-2c80b33cf979", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 16:25:12 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-ff8d934f-c58d-4bef-a206-c51e6e19922a tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Converting VIF {"id": "8a5c66fa-4693-4162-b5a8-2c80b33cf979", "address": "fa:16:3e:78:06:8d", "network": {"id": "d36bc206-f629-4d6e-8a3f-458061d7b525", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-893271134-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d451e0e239f486aa2b3abe9e273eab3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a5c66fa-46", "ovs_interfaceid": "8a5c66fa-4693-4162-b5a8-2c80b33cf979", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 16:25:12 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-ff8d934f-c58d-4bef-a206-c51e6e19922a tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:78:06:8d,bridge_name='br-int',has_traffic_filtering=True,id=8a5c66fa-4693-4162-b5a8-2c80b33cf979,network=Network(d36bc206-f629-4d6e-8a3f-458061d7b525),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a5c66fa-46') {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 16:25:12 user nova-compute[71731]: DEBUG os_vif [None req-ff8d934f-c58d-4bef-a206-c51e6e19922a tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:78:06:8d,bridge_name='br-int',has_traffic_filtering=True,id=8a5c66fa-4693-4162-b5a8-2c80b33cf979,network=Network(d36bc206-f629-4d6e-8a3f-458061d7b525),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a5c66fa-46') {{(pid=71731) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 16:25:12 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:25:12 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:25:12 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 16:25:12 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:25:12 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[c890c600-62da-4723-be90-f7fc6767660b]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:25:12 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-a82bcc4a-8f0d-440e-8e98-b31ad960faf4 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:25:12 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:25:12 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8a5c66fa-46, may_exist=True) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:25:12 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8a5c66fa-46, col_values=(('external_ids', {'iface-id': '8a5c66fa-4693-4162-b5a8-2c80b33cf979', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:78:06:8d', 'vm-uuid': '5ea4ab6a-6501-4a2f-a8f7-04090024747d'}),)) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:25:12 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jqPGdnMb {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:25:12 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 16:25:12 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jqPGdnMb" returned: 0 in 0.026s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:25:12 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e9b6d90-fb33-46b2-8e57-dc8010a3dae5]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:25:12 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eaae47b9-a059-49f6-9ae6-d7147003e2f2/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:25:12 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-a82bcc4a-8f0d-440e-8e98-b31ad960faf4 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jqPGdnMb'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:25:12 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eaae47b9-a059-49f6-9ae6-d7147003e2f2/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:25:12 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:25:12 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:25:12 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:25:12 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[d61cde79-85e6-4ada-b814-c4bae006d34b]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:25:12 user nova-compute[71731]: INFO os_vif [None req-ff8d934f-c58d-4bef-a206-c51e6e19922a tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:78:06:8d,bridge_name='br-int',has_traffic_filtering=True,id=8a5c66fa-4693-4162-b5a8-2c80b33cf979,network=Network(d36bc206-f629-4d6e-8a3f-458061d7b525),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a5c66fa-46')
Apr 13 16:25:12 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-a82bcc4a-8f0d-440e-8e98-b31ad960faf4 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:25:12 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:25:12 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:25:12 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[15ff118e-791a-4837-9856-99b03f94d87a]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc7649d3-fc59-438d-b230-72c4ce61e722 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4317bfd-71c2-4c48-a0f0-e3c795f262a8 (non-flash)\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:25:12 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-a82bcc4a-8f0d-440e-8e98-b31ad960faf4 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)
Apr 13 16:25:12 user nova-compute[71731]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc7649d3-fc59-438d-b230-72c4ce61e722 (non-flash)
Apr 13 16:25:12 user nova-compute[71731]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4317bfd-71c2-4c48-a0f0-e3c795f262a8 (non-flash)
Apr 13 16:25:12 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 16:25:12 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-a82bcc4a-8f0d-440e-8e98-b31ad960faf4 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)
Apr 13 16:25:12 user nova-compute[71731]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc7649d3-fc59-438d-b230-72c4ce61e722 (non-flash)
Apr 13 16:25:12 user nova-compute[71731]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4317bfd-71c2-4c48-a0f0-e3c795f262a8 (non-flash)
Apr 13 16:25:12 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 16:25:12 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-a82bcc4a-8f0d-440e-8e98-b31ad960faf4 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.265s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 16:25:12 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-a82bcc4a-8f0d-440e-8e98-b31ad960faf4 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Connected to 172.16.0.220:3260 {{(pid=71731) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 16:25:12 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-a82bcc4a-8f0d-440e-8e98-b31ad960faf4 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] HCTL ('34', '0', '0', 0) found on session 16 with lun 0 {{(pid=71731) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 16:25:12 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-a82bcc4a-8f0d-440e-8e98-b31ad960faf4 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Scanning host 34 c: 0, t: 0, l: 0) {{(pid=71731) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 16:25:12 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:25:12 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-ff8d934f-c58d-4bef-a206-c51e6e19922a tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] No BDM found with device name vda, not building metadata. {{(pid=71731) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 16:25:12 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-ff8d934f-c58d-4bef-a206-c51e6e19922a tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] No VIF found with MAC fa:16:3e:78:06:8d, not building metadata {{(pid=71731) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 16:25:12 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:25:12 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[65d649c0-68d4-4f09-8b7a-6b44812689c6]: (4, ('0 0 0', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:25:12 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-a82bcc4a-8f0d-440e-8e98-b31ad960faf4 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Searching for a device in session 16 and hctl ('34', '0', '0', 0) yield: sdc {{(pid=71731) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 16:25:12 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-a82bcc4a-8f0d-440e-8e98-b31ad960faf4 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jqPGdnMb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=71731) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 16:25:12 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-a82bcc4a-8f0d-440e-8e98-b31ad960faf4 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.295s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 16:25:12 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-a82bcc4a-8f0d-440e-8e98-b31ad960faf4 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] <== connect_volume: return (1589ms) {'type': 'block', 'scsi_wwn': '26462393237386137', 'path': '/dev/sdc'} {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 16:25:12 user nova-compute[71731]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a82bcc4a-8f0d-440e-8e98-b31ad960faf4 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: 235f827c-7116-48e9-84c5-0c9761c18e1e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26462393237386137', 'path': '/dev/sdc'} {{(pid=71731) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 16:25:12 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eaae47b9-a059-49f6-9ae6-d7147003e2f2/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:25:12 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71731) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 16:25:12 user nova-compute[71731]: DEBUG nova.virt.libvirt.vif [None req-a82bcc4a-8f0d-440e-8e98-b31ad960faf4 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T16:23:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1447697852',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1447697852',id=14,image_ref='708622a9-7465-4492-ade8-b827198f7e30',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-13T16:23:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b2d09a74bf684a9fb1dd1e95d6c23f3c',ramdisk_id='',reservation_id='r-6nx0xd0y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='708622a9-7465-4492-ade8-b827198f7e30',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1960261099',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T16:23:34Z,user_data=None,user_id='e45a882dbafb4ea4976e4f45289eb2b8',uuid=235f827c-7116-48e9-84c5-0c9761c18e1e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b72a6c8b-7244-41c2-a4f7-6da43b4944b8", "address": "fa:16:3e:e3:62:b0", "network": {"id": "5a7877ff-8230-470b-90b5-e5dcfc8f0cee", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-779403873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-779403873-network", "vif_mac": "fa:16:3e:e3:62:b0"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2d09a74bf684a9fb1dd1e95d6c23f3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb72a6c8b-72", "ovs_interfaceid": "b72a6c8b-7244-41c2-a4f7-6da43b4944b8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71731) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 16:25:12 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-a82bcc4a-8f0d-440e-8e98-b31ad960faf4 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Converting VIF {"id": "b72a6c8b-7244-41c2-a4f7-6da43b4944b8", "address": "fa:16:3e:e3:62:b0", "network": {"id": "5a7877ff-8230-470b-90b5-e5dcfc8f0cee", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-779403873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-779403873-network", "vif_mac": "fa:16:3e:e3:62:b0"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2d09a74bf684a9fb1dd1e95d6c23f3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb72a6c8b-72", "ovs_interfaceid": "b72a6c8b-7244-41c2-a4f7-6da43b4944b8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 16:25:12 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-a82bcc4a-8f0d-440e-8e98-b31ad960faf4 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e3:62:b0,bridge_name='br-int',has_traffic_filtering=True,id=b72a6c8b-7244-41c2-a4f7-6da43b4944b8,network=Network(5a7877ff-8230-470b-90b5-e5dcfc8f0cee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb72a6c8b-72') {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 16:25:12 user nova-compute[71731]: DEBUG nova.objects.instance [None req-a82bcc4a-8f0d-440e-8e98-b31ad960faf4 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lazy-loading 'pci_devices' on Instance uuid 235f827c-7116-48e9-84c5-0c9761c18e1e {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:25:12 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5db1cb51-2e5a-46c9-8914-cba759a96a65/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:25:12 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-a82bcc4a-8f0d-440e-8e98-b31ad960faf4 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: 235f827c-7116-48e9-84c5-0c9761c18e1e] End _get_guest_xml xml=<domain type="kvm">
Apr 13 16:25:12 user nova-compute[71731]:   <uuid>235f827c-7116-48e9-84c5-0c9761c18e1e</uuid>
Apr 13 16:25:12 user nova-compute[71731]:   <name>instance-0000000e</name>
Apr 13 16:25:12 user nova-compute[71731]:   <memory>131072</memory>
Apr 13 16:25:12 user nova-compute[71731]:   <vcpu>1</vcpu>
Apr 13 16:25:12 user nova-compute[71731]:   <metadata>
Apr 13 16:25:12 user nova-compute[71731]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 16:25:12 user nova-compute[71731]:       <nova:package version="0.0.0"/>
Apr 13 16:25:12 user nova-compute[71731]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1447697852</nova:name>
Apr 13 16:25:12 user nova-compute[71731]:       <nova:creationTime>2023-04-13 16:25:10</nova:creationTime>
Apr 13 16:25:12 user nova-compute[71731]:       <nova:flavor name="m1.nano">
Apr 13 16:25:12 user nova-compute[71731]:         <nova:memory>128</nova:memory>
Apr 13 16:25:12 user nova-compute[71731]:         <nova:disk>1</nova:disk>
Apr 13 16:25:12 user nova-compute[71731]:         <nova:swap>0</nova:swap>
Apr 13 16:25:12 user nova-compute[71731]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 16:25:12 user nova-compute[71731]:         <nova:vcpus>1</nova:vcpus>
Apr 13 16:25:12 user nova-compute[71731]:       </nova:flavor>
Apr 13 16:25:12 user nova-compute[71731]:       <nova:owner>
Apr 13 16:25:12 user nova-compute[71731]:         <nova:user uuid="e45a882dbafb4ea4976e4f45289eb2b8">tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member</nova:user>
Apr 13 16:25:12 user nova-compute[71731]:         <nova:project uuid="b2d09a74bf684a9fb1dd1e95d6c23f3c">tempest-ServerBootFromVolumeStableRescueTest-1960261099</nova:project>
Apr 13 16:25:12 user nova-compute[71731]:       </nova:owner>
Apr 13 16:25:12 user nova-compute[71731]:       <nova:root type="image" uuid="708622a9-7465-4492-ade8-b827198f7e30"/>
Apr 13 16:25:12 user nova-compute[71731]:       <nova:ports>
Apr 13 16:25:12 user nova-compute[71731]:         <nova:port uuid="b72a6c8b-7244-41c2-a4f7-6da43b4944b8">
Apr 13 16:25:12 user nova-compute[71731]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Apr 13 16:25:12 user nova-compute[71731]:         </nova:port>
Apr 13 16:25:12 user nova-compute[71731]:       </nova:ports>
Apr 13 16:25:12 user nova-compute[71731]:     </nova:instance>
Apr 13 16:25:12 user nova-compute[71731]:   </metadata>
Apr 13 16:25:12 user nova-compute[71731]:   <sysinfo type="smbios">
Apr 13 16:25:12 user nova-compute[71731]:     <system>
Apr 13 16:25:12 user nova-compute[71731]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 16:25:12 user nova-compute[71731]:       <entry name="product">OpenStack Nova</entry>
Apr 13 16:25:12 user nova-compute[71731]:       <entry name="version">0.0.0</entry>
Apr 13 16:25:12 user nova-compute[71731]:       <entry name="serial">235f827c-7116-48e9-84c5-0c9761c18e1e</entry>
Apr 13 16:25:12 user nova-compute[71731]:       <entry name="uuid">235f827c-7116-48e9-84c5-0c9761c18e1e</entry>
Apr 13 16:25:12 user nova-compute[71731]:       <entry name="family">Virtual Machine</entry>
Apr 13 16:25:12 user nova-compute[71731]:     </system>
Apr 13 16:25:12 user nova-compute[71731]:   </sysinfo>
Apr 13 16:25:12 user nova-compute[71731]:   <os>
Apr 13 16:25:12 user nova-compute[71731]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 16:25:12 user nova-compute[71731]:     <smbios mode="sysinfo"/>
Apr 13 16:25:12 user nova-compute[71731]:   </os>
Apr 13 16:25:12 user nova-compute[71731]:   <features>
Apr 13 16:25:12 user nova-compute[71731]:     <acpi/>
Apr 13 16:25:12 user nova-compute[71731]:     <apic/>
Apr 13 16:25:12 user nova-compute[71731]:     <vmcoreinfo/>
Apr 13 16:25:12 user nova-compute[71731]:   </features>
Apr 13 16:25:12 user nova-compute[71731]:   <clock offset="utc">
Apr 13 16:25:12 user nova-compute[71731]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 16:25:12 user nova-compute[71731]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 16:25:12 user nova-compute[71731]:     <timer name="hpet" present="no"/>
Apr 13 16:25:12 user nova-compute[71731]:   </clock>
Apr 13 16:25:12 user nova-compute[71731]:   <cpu mode="custom" match="exact">
Apr 13 16:25:12 user nova-compute[71731]:     <model>Nehalem</model>
Apr 13 16:25:12 user nova-compute[71731]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 16:25:12 user nova-compute[71731]:   </cpu>
Apr 13 16:25:12 user nova-compute[71731]:   <devices>
Apr 13 16:25:12 user nova-compute[71731]:     <disk type="block" device="disk">
Apr 13 16:25:12 user nova-compute[71731]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 16:25:12 user nova-compute[71731]:       <source dev="/dev/sdc"/>
Apr 13 16:25:12 user nova-compute[71731]:       <target dev="vda" bus="virtio"/>
Apr 13 16:25:12 user nova-compute[71731]:       <serial>417090c0-76a2-4277-9095-5c5095638b97</serial>
Apr 13 16:25:12 user nova-compute[71731]:     </disk>
Apr 13 16:25:12 user nova-compute[71731]:     <disk type="file" device="disk">
Apr 13 16:25:12 user nova-compute[71731]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 16:25:12 user nova-compute[71731]:       <source file="/opt/stack/data/nova/instances/235f827c-7116-48e9-84c5-0c9761c18e1e/disk.rescue"/>
Apr 13 16:25:12 user nova-compute[71731]:       <target dev="vdb" bus="virtio"/>
Apr 13 16:25:12 user nova-compute[71731]:       <boot order="1"/>
Apr 13 16:25:12 user nova-compute[71731]:     </disk>
Apr 13 16:25:12 user nova-compute[71731]:     <interface type="ethernet">
Apr 13 16:25:12 user nova-compute[71731]:       <mac address="fa:16:3e:e3:62:b0"/>
Apr 13 16:25:12 user nova-compute[71731]:       <model type="virtio"/>
Apr 13 16:25:12 user nova-compute[71731]:       <mtu size="1442"/>
Apr 13 16:25:12 user nova-compute[71731]:       <target dev="tapb72a6c8b-72"/>
Apr 13 16:25:12 user nova-compute[71731]:     </interface>
Apr 13 16:25:12 user nova-compute[71731]:     <serial type="pty">
Apr 13 16:25:12 user nova-compute[71731]:       <log file="/opt/stack/data/nova/instances/235f827c-7116-48e9-84c5-0c9761c18e1e/console.log" append="off"/>
Apr 13 16:25:12 user nova-compute[71731]:     </serial>
Apr 13 16:25:12 user nova-compute[71731]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 16:25:12 user nova-compute[71731]:     <video>
Apr 13 16:25:12 user nova-compute[71731]:       <model type="virtio"/>
Apr 13 16:25:12 user nova-compute[71731]:     </video>
Apr 13 16:25:12 user nova-compute[71731]:     <rng model="virtio">
Apr 13 16:25:12 user nova-compute[71731]:       <backend model="random">/dev/urandom</backend>
Apr 13 16:25:12 user nova-compute[71731]:     </rng>
Apr 13 16:25:12 user nova-compute[71731]:     <controller type="usb" index="0" model="none"/>
Apr 13 16:25:12 user nova-compute[71731]:     <memballoon model="virtio">
Apr 13 16:25:12 user nova-compute[71731]:       <stats period="10"/>
Apr 13 16:25:12 user nova-compute[71731]:     </memballoon>
Apr 13 16:25:12 user nova-compute[71731]:   </devices>
Apr 13 16:25:12 user nova-compute[71731]: </domain>
Apr 13 16:25:12 user nova-compute[71731]:  {{(pid=71731) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 16:25:12 user nova-compute[71731]: INFO nova.virt.libvirt.driver [-] [instance: 235f827c-7116-48e9-84c5-0c9761c18e1e] Instance destroyed successfully.
Apr 13 16:25:12 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5db1cb51-2e5a-46c9-8914-cba759a96a65/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:25:12 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5db1cb51-2e5a-46c9-8914-cba759a96a65/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:25:12 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-a82bcc4a-8f0d-440e-8e98-b31ad960faf4 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] No BDM found with device name vda, not building metadata. {{(pid=71731) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 16:25:12 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-a82bcc4a-8f0d-440e-8e98-b31ad960faf4 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71731) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 16:25:12 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-a82bcc4a-8f0d-440e-8e98-b31ad960faf4 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] No VIF found with MAC fa:16:3e:e3:62:b0, not building metadata {{(pid=71731) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 16:25:12 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5db1cb51-2e5a-46c9-8914-cba759a96a65/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:25:12 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/902e4077-e0d6-4b61-a861-883be253f1e0/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:25:12 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/902e4077-e0d6-4b61-a861-883be253f1e0/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:25:12 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/902e4077-e0d6-4b61-a861-883be253f1e0/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:25:12 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/902e4077-e0d6-4b61-a861-883be253f1e0/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:25:18 user nova-compute[71731]: DEBUG nova.virt.driver [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Emitting event <LifecycleEvent: 1681403117.8038921, 5ea4ab6a-6501-4a2f-a8f7-04090024747d => Resumed> {{(pid=71731) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 16:25:18 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 5ea4ab6a-6501-4a2f-a8f7-04090024747d] VM Resumed (Lifecycle Event)
Apr 13 16:25:18 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:25:18 user nova-compute[71731]: DEBUG nova.compute.manager [req-d4df9bc1-5355-4984-95aa-43303a9466f4 req-ac93f023-ba39-4024-a5b5-0bfe54c6255d service nova] [instance: 5ea4ab6a-6501-4a2f-a8f7-04090024747d] Received event network-vif-plugged-8a5c66fa-4693-4162-b5a8-2c80b33cf979 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:25:18 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-d4df9bc1-5355-4984-95aa-43303a9466f4 req-ac93f023-ba39-4024-a5b5-0bfe54c6255d service nova] Acquiring lock "5ea4ab6a-6501-4a2f-a8f7-04090024747d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:25:18 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-d4df9bc1-5355-4984-95aa-43303a9466f4 req-ac93f023-ba39-4024-a5b5-0bfe54c6255d service nova] Lock "5ea4ab6a-6501-4a2f-a8f7-04090024747d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:25:18 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-d4df9bc1-5355-4984-95aa-43303a9466f4 req-ac93f023-ba39-4024-a5b5-0bfe54c6255d service nova] Lock "5ea4ab6a-6501-4a2f-a8f7-04090024747d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:25:18 user nova-compute[71731]: DEBUG nova.compute.manager [req-d4df9bc1-5355-4984-95aa-43303a9466f4 req-ac93f023-ba39-4024-a5b5-0bfe54c6255d service nova] [instance: 5ea4ab6a-6501-4a2f-a8f7-04090024747d] No waiting events found dispatching network-vif-plugged-8a5c66fa-4693-4162-b5a8-2c80b33cf979 {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:25:18 user nova-compute[71731]: WARNING nova.compute.manager [req-d4df9bc1-5355-4984-95aa-43303a9466f4 req-ac93f023-ba39-4024-a5b5-0bfe54c6255d service nova] [instance: 5ea4ab6a-6501-4a2f-a8f7-04090024747d] Received unexpected event network-vif-plugged-8a5c66fa-4693-4162-b5a8-2c80b33cf979 for instance with vm_state building and task_state spawning.
Apr 13 16:25:18 user nova-compute[71731]: DEBUG nova.compute.manager [req-d1fa7daf-2c83-45f8-9440-514f240110bf req-83817299-33c7-4e43-a6a1-4e32e658d062 service nova] [instance: 235f827c-7116-48e9-84c5-0c9761c18e1e] Received event network-vif-plugged-b72a6c8b-7244-41c2-a4f7-6da43b4944b8 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:25:18 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-d1fa7daf-2c83-45f8-9440-514f240110bf req-83817299-33c7-4e43-a6a1-4e32e658d062 service nova] Acquiring lock "235f827c-7116-48e9-84c5-0c9761c18e1e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:25:18 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-d1fa7daf-2c83-45f8-9440-514f240110bf req-83817299-33c7-4e43-a6a1-4e32e658d062 service nova] Lock "235f827c-7116-48e9-84c5-0c9761c18e1e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:25:18 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-d1fa7daf-2c83-45f8-9440-514f240110bf req-83817299-33c7-4e43-a6a1-4e32e658d062 service nova] Lock "235f827c-7116-48e9-84c5-0c9761c18e1e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:25:18 user nova-compute[71731]: DEBUG nova.compute.manager [req-d1fa7daf-2c83-45f8-9440-514f240110bf req-83817299-33c7-4e43-a6a1-4e32e658d062 service nova] [instance: 235f827c-7116-48e9-84c5-0c9761c18e1e] No waiting events found dispatching network-vif-plugged-b72a6c8b-7244-41c2-a4f7-6da43b4944b8 {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:25:18 user nova-compute[71731]: WARNING nova.compute.manager [req-d1fa7daf-2c83-45f8-9440-514f240110bf req-83817299-33c7-4e43-a6a1-4e32e658d062 service nova] [instance: 235f827c-7116-48e9-84c5-0c9761c18e1e] Received unexpected event network-vif-plugged-b72a6c8b-7244-41c2-a4f7-6da43b4944b8 for instance with vm_state active and task_state rescuing.
Apr 13 16:25:18 user nova-compute[71731]: DEBUG nova.compute.manager [req-1ec2b6d2-7bad-470f-8220-9d2ed18b1679 req-a9b84f87-4e4f-4a71-b7a2-f2d132398039 service nova] [instance: 5ea4ab6a-6501-4a2f-a8f7-04090024747d] Received event network-vif-plugged-8a5c66fa-4693-4162-b5a8-2c80b33cf979 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:25:18 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-1ec2b6d2-7bad-470f-8220-9d2ed18b1679 req-a9b84f87-4e4f-4a71-b7a2-f2d132398039 service nova] Acquiring lock "5ea4ab6a-6501-4a2f-a8f7-04090024747d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:25:18 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-1ec2b6d2-7bad-470f-8220-9d2ed18b1679 req-a9b84f87-4e4f-4a71-b7a2-f2d132398039 service nova] Lock "5ea4ab6a-6501-4a2f-a8f7-04090024747d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:25:18 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-1ec2b6d2-7bad-470f-8220-9d2ed18b1679 req-a9b84f87-4e4f-4a71-b7a2-f2d132398039 service nova] Lock "5ea4ab6a-6501-4a2f-a8f7-04090024747d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:25:18 user nova-compute[71731]: DEBUG nova.compute.manager [req-1ec2b6d2-7bad-470f-8220-9d2ed18b1679 req-a9b84f87-4e4f-4a71-b7a2-f2d132398039 service nova] [instance: 5ea4ab6a-6501-4a2f-a8f7-04090024747d] No waiting events found dispatching network-vif-plugged-8a5c66fa-4693-4162-b5a8-2c80b33cf979 {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:25:18 user nova-compute[71731]: WARNING nova.compute.manager [req-1ec2b6d2-7bad-470f-8220-9d2ed18b1679 req-a9b84f87-4e4f-4a71-b7a2-f2d132398039 service nova] [instance: 5ea4ab6a-6501-4a2f-a8f7-04090024747d] Received unexpected event network-vif-plugged-8a5c66fa-4693-4162-b5a8-2c80b33cf979 for instance with vm_state building and task_state spawning.
Apr 13 16:25:18 user nova-compute[71731]: DEBUG nova.compute.manager [req-bf47f78b-0883-42e0-a228-1f8d150d18c4 req-7ddb176b-c4a2-42b2-800c-c76756a7d487 service nova] [instance: 235f827c-7116-48e9-84c5-0c9761c18e1e] Received event network-vif-plugged-b72a6c8b-7244-41c2-a4f7-6da43b4944b8 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:25:18 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-bf47f78b-0883-42e0-a228-1f8d150d18c4 req-7ddb176b-c4a2-42b2-800c-c76756a7d487 service nova] Acquiring lock "235f827c-7116-48e9-84c5-0c9761c18e1e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:25:18 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-bf47f78b-0883-42e0-a228-1f8d150d18c4 req-7ddb176b-c4a2-42b2-800c-c76756a7d487 service nova] Lock "235f827c-7116-48e9-84c5-0c9761c18e1e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:25:18 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-bf47f78b-0883-42e0-a228-1f8d150d18c4 req-7ddb176b-c4a2-42b2-800c-c76756a7d487 service nova] Lock "235f827c-7116-48e9-84c5-0c9761c18e1e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:25:18 user nova-compute[71731]: DEBUG nova.compute.manager [req-bf47f78b-0883-42e0-a228-1f8d150d18c4 req-7ddb176b-c4a2-42b2-800c-c76756a7d487 service nova] [instance: 235f827c-7116-48e9-84c5-0c9761c18e1e] No waiting events found dispatching network-vif-plugged-b72a6c8b-7244-41c2-a4f7-6da43b4944b8 {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:25:18 user nova-compute[71731]: WARNING nova.compute.manager [req-bf47f78b-0883-42e0-a228-1f8d150d18c4 req-7ddb176b-c4a2-42b2-800c-c76756a7d487 service nova] [instance: 235f827c-7116-48e9-84c5-0c9761c18e1e] Received unexpected event network-vif-plugged-b72a6c8b-7244-41c2-a4f7-6da43b4944b8 for instance with vm_state active and task_state rescuing.
Apr 13 16:25:18 user nova-compute[71731]: DEBUG nova.compute.manager [None req-ff8d934f-c58d-4bef-a206-c51e6e19922a tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 5ea4ab6a-6501-4a2f-a8f7-04090024747d] Instance event wait completed in 0 seconds for  {{(pid=71731) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 16:25:18 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-ff8d934f-c58d-4bef-a206-c51e6e19922a tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 5ea4ab6a-6501-4a2f-a8f7-04090024747d] Guest created on hypervisor {{(pid=71731) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 16:25:18 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 5ea4ab6a-6501-4a2f-a8f7-04090024747d] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:25:18 user nova-compute[71731]: DEBUG nova.compute.manager [None req-a82bcc4a-8f0d-440e-8e98-b31ad960faf4 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: 235f827c-7116-48e9-84c5-0c9761c18e1e] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:25:18 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 5ea4ab6a-6501-4a2f-a8f7-04090024747d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71731) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 16:25:18 user nova-compute[71731]: WARNING nova.virt.libvirt.driver [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 16:25:18 user nova-compute[71731]: WARNING nova.virt.libvirt.driver [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 16:25:18 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Hypervisor/Node resource view: name=user free_ram=7616MB free_disk=26.21441650390625GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71731) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 16:25:18 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:25:18 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:25:18 user nova-compute[71731]: INFO nova.virt.libvirt.driver [-] [instance: 5ea4ab6a-6501-4a2f-a8f7-04090024747d] Instance spawned successfully.
Apr 13 16:25:18 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-ff8d934f-c58d-4bef-a206-c51e6e19922a tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 5ea4ab6a-6501-4a2f-a8f7-04090024747d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 16:25:18 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 5ea4ab6a-6501-4a2f-a8f7-04090024747d] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 16:25:18 user nova-compute[71731]: DEBUG nova.virt.driver [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Emitting event <LifecycleEvent: 1681403117.8072634, 5ea4ab6a-6501-4a2f-a8f7-04090024747d => Started> {{(pid=71731) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 16:25:18 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 5ea4ab6a-6501-4a2f-a8f7-04090024747d] VM Started (Lifecycle Event)
Apr 13 16:25:18 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-ff8d934f-c58d-4bef-a206-c51e6e19922a tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 5ea4ab6a-6501-4a2f-a8f7-04090024747d] Found default for hw_cdrom_bus of ide {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:25:18 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-ff8d934f-c58d-4bef-a206-c51e6e19922a tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 5ea4ab6a-6501-4a2f-a8f7-04090024747d] Found default for hw_disk_bus of virtio {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:25:18 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-ff8d934f-c58d-4bef-a206-c51e6e19922a tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 5ea4ab6a-6501-4a2f-a8f7-04090024747d] Found default for hw_input_bus of None {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:25:18 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-ff8d934f-c58d-4bef-a206-c51e6e19922a tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 5ea4ab6a-6501-4a2f-a8f7-04090024747d] Found default for hw_pointer_model of None {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:25:18 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-ff8d934f-c58d-4bef-a206-c51e6e19922a tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 5ea4ab6a-6501-4a2f-a8f7-04090024747d] Found default for hw_video_model of virtio {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:25:18 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-ff8d934f-c58d-4bef-a206-c51e6e19922a tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 5ea4ab6a-6501-4a2f-a8f7-04090024747d] Found default for hw_vif_model of virtio {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:25:18 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 5ea4ab6a-6501-4a2f-a8f7-04090024747d] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:25:18 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 5ea4ab6a-6501-4a2f-a8f7-04090024747d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71731) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 16:25:18 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 5ea4ab6a-6501-4a2f-a8f7-04090024747d] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 16:25:18 user nova-compute[71731]: DEBUG nova.virt.libvirt.host [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Removed pending event for 235f827c-7116-48e9-84c5-0c9761c18e1e due to event {{(pid=71731) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 13 16:25:18 user nova-compute[71731]: DEBUG nova.virt.driver [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Emitting event <LifecycleEvent: 1681403117.997105, 235f827c-7116-48e9-84c5-0c9761c18e1e => Resumed> {{(pid=71731) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 16:25:18 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 235f827c-7116-48e9-84c5-0c9761c18e1e] VM Resumed (Lifecycle Event)
Apr 13 16:25:18 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 235f827c-7116-48e9-84c5-0c9761c18e1e] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:25:18 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 235f827c-7116-48e9-84c5-0c9761c18e1e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71731) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 16:25:18 user nova-compute[71731]: DEBUG nova.virt.driver [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Emitting event <LifecycleEvent: 1681403118.0079243, 235f827c-7116-48e9-84c5-0c9761c18e1e => Started> {{(pid=71731) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 16:25:18 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 235f827c-7116-48e9-84c5-0c9761c18e1e] VM Started (Lifecycle Event)
Apr 13 16:25:18 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 235f827c-7116-48e9-84c5-0c9761c18e1e] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:25:18 user nova-compute[71731]: INFO nova.compute.manager [None req-ff8d934f-c58d-4bef-a206-c51e6e19922a tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 5ea4ab6a-6501-4a2f-a8f7-04090024747d] Took 8.06 seconds to spawn the instance on the hypervisor.
Apr 13 16:25:18 user nova-compute[71731]: DEBUG nova.compute.manager [None req-ff8d934f-c58d-4bef-a206-c51e6e19922a tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 5ea4ab6a-6501-4a2f-a8f7-04090024747d] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:25:18 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance 7973e93b-6311-44ed-91ff-e861c32d0277 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 16:25:18 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance f66553f5-5e1b-4f1d-8c5a-63bc340f7586 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 16:25:18 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance bbcccf4b-e861-4254-9be3-a491776214e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 16:25:18 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance 5db1cb51-2e5a-46c9-8914-cba759a96a65 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 16:25:18 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance 235f827c-7116-48e9-84c5-0c9761c18e1e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 16:25:18 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance 94a2b8c9-388d-454c-88a1-54d7a8506511 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 16:25:18 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance acbcaee0-a47b-4fee-8765-9b1c9597d515 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 16:25:18 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance eaae47b9-a059-49f6-9ae6-d7147003e2f2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 16:25:18 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance 902e4077-e0d6-4b61-a861-883be253f1e0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 16:25:18 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance 5ea4ab6a-6501-4a2f-a8f7-04090024747d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 16:25:18 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=71731) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 16:25:18 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Final resource view: name=user phys_ram=16023MB used_ram=1792MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=71731) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 16:25:18 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 235f827c-7116-48e9-84c5-0c9761c18e1e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=71731) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 16:25:18 user nova-compute[71731]: INFO nova.compute.manager [None req-ff8d934f-c58d-4bef-a206-c51e6e19922a tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 5ea4ab6a-6501-4a2f-a8f7-04090024747d] Took 14.42 seconds to build instance.
Apr 13 16:25:18 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-ff8d934f-c58d-4bef-a206-c51e6e19922a tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "5ea4ab6a-6501-4a2f-a8f7-04090024747d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.524s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:25:18 user nova-compute[71731]: DEBUG nova.compute.provider_tree [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Inventory has not changed in ProviderTree for provider: cb6b1a64-0c24-4e2d-af1e-16576ca9165c {{(pid=71731) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 16:25:18 user nova-compute[71731]: DEBUG nova.scheduler.client.report [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Inventory has not changed for provider cb6b1a64-0c24-4e2d-af1e-16576ca9165c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71731) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 16:25:18 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Compute_service record updated for user:user {{(pid=71731) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 16:25:18 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.589s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:25:19 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:25:19 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:25:19 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Starting heal instance info cache {{(pid=71731) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 16:25:19 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Didn't find any instances for network info cache update. {{(pid=71731) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 13 16:25:19 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:25:19 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:25:19 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:25:19 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:25:19 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71731) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 16:25:21 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:25:21 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-becb7a59-9b09-4ba6-b7f8-c164468f847d tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Acquiring lock "bf350da4-9cc2-4900-adf0-506e44984b42" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:25:21 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-becb7a59-9b09-4ba6-b7f8-c164468f847d tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Lock "bf350da4-9cc2-4900-adf0-506e44984b42" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:25:21 user nova-compute[71731]: INFO nova.compute.manager [None req-becb7a59-9b09-4ba6-b7f8-c164468f847d tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] [instance: bf350da4-9cc2-4900-adf0-506e44984b42] Unshelving
Apr 13 16:25:22 user nova-compute[71731]: INFO nova.virt.block_device [None req-becb7a59-9b09-4ba6-b7f8-c164468f847d tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] [instance: bf350da4-9cc2-4900-adf0-506e44984b42] Booting with volume 1ac31388-2626-48e4-a711-54683ef66984 at /dev/vda
Apr 13 16:25:22 user nova-compute[71731]: DEBUG os_brick.utils [None req-becb7a59-9b09-4ba6-b7f8-c164468f847d tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 16:25:22 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:25:22 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.021s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:25:22 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[e45ededd-80d9-4f97-8cbe-ff198bdd8729]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:81501d91421\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:25:22 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:25:22 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:25:22 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[b22ae4ea-1f62-45d2-b52d-98b28af65ab6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:25:22 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:25:22 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:25:22 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[148a96e8-9a9c-49f1-9eef-0d18086ab26e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:25:22 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[dec29380-a4ab-430f-887f-1a8343835439]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:25:22 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-becb7a59-9b09-4ba6-b7f8-c164468f847d tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Running cmd (subprocess): nvme version {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:25:22 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-becb7a59-9b09-4ba6-b7f8-c164468f847d tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] 'nvme version' failed. Not Retrying. {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 16:25:22 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.nvmeof [None req-becb7a59-9b09-4ba6-b7f8-c164468f847d tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] nvme not present on system {{(pid=71731) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 16:25:22 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:25:22 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 16:25:22 user nova-compute[71731]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 16:25:22 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[a26b5794-8feb-46c2-920b-3f5315ee54d6]: (4, '') {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:25:22 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.lightos [None req-becb7a59-9b09-4ba6-b7f8-c164468f847d tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71731) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 16:25:22 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.lightos [None req-becb7a59-9b09-4ba6-b7f8-c164468f847d tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71731) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 16:25:22 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.lightos [None req-becb7a59-9b09-4ba6-b7f8-c164468f847d tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] LIGHTOS: no hostnqn found. {{(pid=71731) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 16:25:22 user nova-compute[71731]: DEBUG os_brick.utils [None req-becb7a59-9b09-4ba6-b7f8-c164468f847d tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] <== get_connector_properties: return (179ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:81501d91421', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 16:25:22 user nova-compute[71731]: DEBUG nova.virt.block_device [None req-becb7a59-9b09-4ba6-b7f8-c164468f847d tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] [instance: bf350da4-9cc2-4900-adf0-506e44984b42] Updating existing volume attachment record: 2cdfc841-7b2f-42f7-9a17-e99c653e38dc {{(pid=71731) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 16:25:23 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:25:26 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:25:27 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:25:27 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-becb7a59-9b09-4ba6-b7f8-c164468f847d tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:25:27 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-becb7a59-9b09-4ba6-b7f8-c164468f847d tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:25:27 user nova-compute[71731]: DEBUG nova.objects.instance [None req-becb7a59-9b09-4ba6-b7f8-c164468f847d tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Lazy-loading 'pci_requests' on Instance uuid bf350da4-9cc2-4900-adf0-506e44984b42 {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:25:27 user nova-compute[71731]: DEBUG nova.objects.instance [None req-becb7a59-9b09-4ba6-b7f8-c164468f847d tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Lazy-loading 'numa_topology' on Instance uuid bf350da4-9cc2-4900-adf0-506e44984b42 {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:25:27 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-becb7a59-9b09-4ba6-b7f8-c164468f847d tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71731) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 16:25:27 user nova-compute[71731]: INFO nova.compute.claims [None req-becb7a59-9b09-4ba6-b7f8-c164468f847d tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] [instance: bf350da4-9cc2-4900-adf0-506e44984b42] Claim successful on node user
Apr 13 16:25:28 user nova-compute[71731]: DEBUG nova.compute.provider_tree [None req-becb7a59-9b09-4ba6-b7f8-c164468f847d tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Inventory has not changed in ProviderTree for provider: cb6b1a64-0c24-4e2d-af1e-16576ca9165c {{(pid=71731) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 16:25:28 user nova-compute[71731]: DEBUG nova.scheduler.client.report [None req-becb7a59-9b09-4ba6-b7f8-c164468f847d tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Inventory has not changed for provider cb6b1a64-0c24-4e2d-af1e-16576ca9165c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71731) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 16:25:28 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-becb7a59-9b09-4ba6-b7f8-c164468f847d tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.535s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:25:28 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:25:28 user nova-compute[71731]: INFO nova.network.neutron [None req-becb7a59-9b09-4ba6-b7f8-c164468f847d tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] [instance: bf350da4-9cc2-4900-adf0-506e44984b42] Updating port 1a737bae-3b9b-43b4-8a89-0eb98fdf2ec8 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Apr 13 16:25:29 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-becb7a59-9b09-4ba6-b7f8-c164468f847d tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Acquiring lock "refresh_cache-bf350da4-9cc2-4900-adf0-506e44984b42" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 16:25:29 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-becb7a59-9b09-4ba6-b7f8-c164468f847d tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Acquired lock "refresh_cache-bf350da4-9cc2-4900-adf0-506e44984b42" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 16:25:29 user nova-compute[71731]: DEBUG nova.network.neutron [None req-becb7a59-9b09-4ba6-b7f8-c164468f847d tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] [instance: bf350da4-9cc2-4900-adf0-506e44984b42] Building network info cache for instance {{(pid=71731) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 16:25:29 user nova-compute[71731]: DEBUG nova.compute.manager [req-bd6cd2cc-9255-4260-8275-a9069efabccd req-c937a042-0e05-4d1b-baeb-d68e0db713e2 service nova] [instance: bf350da4-9cc2-4900-adf0-506e44984b42] Received event network-changed-1a737bae-3b9b-43b4-8a89-0eb98fdf2ec8 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:25:29 user nova-compute[71731]: DEBUG nova.compute.manager [req-bd6cd2cc-9255-4260-8275-a9069efabccd req-c937a042-0e05-4d1b-baeb-d68e0db713e2 service nova] [instance: bf350da4-9cc2-4900-adf0-506e44984b42] Refreshing instance network info cache due to event network-changed-1a737bae-3b9b-43b4-8a89-0eb98fdf2ec8. {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 16:25:29 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-bd6cd2cc-9255-4260-8275-a9069efabccd req-c937a042-0e05-4d1b-baeb-d68e0db713e2 service nova] Acquiring lock "refresh_cache-bf350da4-9cc2-4900-adf0-506e44984b42" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 16:25:30 user nova-compute[71731]: DEBUG nova.network.neutron [None req-becb7a59-9b09-4ba6-b7f8-c164468f847d tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] [instance: bf350da4-9cc2-4900-adf0-506e44984b42] Updating instance_info_cache with network_info: [{"id": "1a737bae-3b9b-43b4-8a89-0eb98fdf2ec8", "address": "fa:16:3e:18:7d:11", "network": {"id": "c06f107f-4fa0-46dc-8766-3c882c401851", "bridge": "br-int", "label": "tempest-TestShelveInstance-1490339676-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed94fa5d89c2486b8e2951e608e6630f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a737bae-3b", "ovs_interfaceid": "1a737bae-3b9b-43b4-8a89-0eb98fdf2ec8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:25:30 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-becb7a59-9b09-4ba6-b7f8-c164468f847d tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Releasing lock "refresh_cache-bf350da4-9cc2-4900-adf0-506e44984b42" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 16:25:30 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-becb7a59-9b09-4ba6-b7f8-c164468f847d tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] [instance: bf350da4-9cc2-4900-adf0-506e44984b42] Creating instance directory {{(pid=71731) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 16:25:30 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-becb7a59-9b09-4ba6-b7f8-c164468f847d tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] [instance: bf350da4-9cc2-4900-adf0-506e44984b42] Creating image(s)
Apr 13 16:25:30 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-becb7a59-9b09-4ba6-b7f8-c164468f847d tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] [instance: bf350da4-9cc2-4900-adf0-506e44984b42] Did not create local disks {{(pid=71731) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 13 16:25:30 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-becb7a59-9b09-4ba6-b7f8-c164468f847d tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] [instance: bf350da4-9cc2-4900-adf0-506e44984b42] Ensure instance console log exists: /opt/stack/data/nova/instances/bf350da4-9cc2-4900-adf0-506e44984b42/console.log {{(pid=71731) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 16:25:30 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-becb7a59-9b09-4ba6-b7f8-c164468f847d tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:25:30 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-becb7a59-9b09-4ba6-b7f8-c164468f847d tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:25:30 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-becb7a59-9b09-4ba6-b7f8-c164468f847d tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:25:30 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-becb7a59-9b09-4ba6-b7f8-c164468f847d tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] [instance: bf350da4-9cc2-4900-adf0-506e44984b42] Start _get_guest_xml network_info=[{"id": "1a737bae-3b9b-43b4-8a89-0eb98fdf2ec8", "address": "fa:16:3e:18:7d:11", "network": {"id": "c06f107f-4fa0-46dc-8766-3c882c401851", "bridge": "br-int", "label": "tempest-TestShelveInstance-1490339676-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed94fa5d89c2486b8e2951e608e6630f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a737bae-3b", "ovs_interfaceid": "1a737bae-3b9b-43b4-8a89-0eb98fdf2ec8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'attachment_id': '2cdfc841-7b2f-42f7-9a17-e99c653e38dc', 'mount_device': '/dev/vda', 'delete_on_termination': True, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KoxklySD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'bf350da4-9cc2-4900-adf0-506e44984b42', 'attached_at': '', 'detached_at': '', 'volume_id': '1ac31388-2626-48e4-a711-54683ef66984', 'serial': '1ac31388-2626-48e4-a711-54683ef66984'}, 'disk_bus': 'virtio', 'guest_format': None, 'volume_type': None} {{(pid=71731) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 16:25:30 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-bd6cd2cc-9255-4260-8275-a9069efabccd req-c937a042-0e05-4d1b-baeb-d68e0db713e2 service nova] Acquired lock "refresh_cache-bf350da4-9cc2-4900-adf0-506e44984b42" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 16:25:30 user nova-compute[71731]: DEBUG nova.network.neutron [req-bd6cd2cc-9255-4260-8275-a9069efabccd req-c937a042-0e05-4d1b-baeb-d68e0db713e2 service nova] [instance: bf350da4-9cc2-4900-adf0-506e44984b42] Refreshing network info cache for port 1a737bae-3b9b-43b4-8a89-0eb98fdf2ec8 {{(pid=71731) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 16:25:30 user nova-compute[71731]: WARNING nova.virt.libvirt.driver [None req-becb7a59-9b09-4ba6-b7f8-c164468f847d tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 16:25:30 user nova-compute[71731]: WARNING nova.virt.libvirt.driver [None req-becb7a59-9b09-4ba6-b7f8-c164468f847d tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 16:25:30 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-becb7a59-9b09-4ba6-b7f8-c164468f847d tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71731) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 16:25:30 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-becb7a59-9b09-4ba6-b7f8-c164468f847d tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T16:17:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 16:25:30 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-becb7a59-9b09-4ba6-b7f8-c164468f847d tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Flavor limits 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 16:25:30 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-becb7a59-9b09-4ba6-b7f8-c164468f847d tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Image limits 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 16:25:30 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-becb7a59-9b09-4ba6-b7f8-c164468f847d tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Flavor pref 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 16:25:30 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-becb7a59-9b09-4ba6-b7f8-c164468f847d tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Image pref 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 16:25:30 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-becb7a59-9b09-4ba6-b7f8-c164468f847d tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 16:25:30 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-becb7a59-9b09-4ba6-b7f8-c164468f847d tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 16:25:30 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-becb7a59-9b09-4ba6-b7f8-c164468f847d tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71731) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 16:25:30 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-becb7a59-9b09-4ba6-b7f8-c164468f847d tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Got 1 possible topologies {{(pid=71731) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 16:25:30 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-becb7a59-9b09-4ba6-b7f8-c164468f847d tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 16:25:30 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-becb7a59-9b09-4ba6-b7f8-c164468f847d tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 16:25:30 user nova-compute[71731]: DEBUG nova.objects.instance [None req-becb7a59-9b09-4ba6-b7f8-c164468f847d tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Lazy-loading 'vcpu_model' on Instance uuid bf350da4-9cc2-4900-adf0-506e44984b42 {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:25:30 user nova-compute[71731]: DEBUG nova.virt.libvirt.volume.iscsi [None req-becb7a59-9b09-4ba6-b7f8-c164468f847d tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] [instance: bf350da4-9cc2-4900-adf0-506e44984b42] Calling os-brick to attach iSCSI Volume {{(pid=71731) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 16:25:30 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-becb7a59-9b09-4ba6-b7f8-c164468f847d tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8cf0118790>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KoxklySD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 16:25:30 user nova-compute[71731]: WARNING os_brick.initiator.connectors.base [None req-becb7a59-9b09-4ba6-b7f8-c164468f847d tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 16:25:30 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-becb7a59-9b09-4ba6-b7f8-c164468f847d tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 16:25:30 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-becb7a59-9b09-4ba6-b7f8-c164468f847d tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 16:25:30 user nova-compute[71731]: WARNING os_brick.initiator.connectors.base [None req-becb7a59-9b09-4ba6-b7f8-c164468f847d tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 16:25:30 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-becb7a59-9b09-4ba6-b7f8-c164468f847d tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 16:25:30 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-becb7a59-9b09-4ba6-b7f8-c164468f847d tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 16:25:30 user nova-compute[71731]: INFO os_brick.initiator.connectors.iscsi [None req-becb7a59-9b09-4ba6-b7f8-c164468f847d tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 16:25:30 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984 -p 172.16.0.220:3260 {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:25:30 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984 -p 172.16.0.220:3260" returned: 21 in 0.028s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:25:30 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dd7f3f2-707a-44a7-8c47-e62022e3e0ea]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:25:30 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-becb7a59-9b09-4ba6-b7f8-c164468f847d tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 16:25:30 user nova-compute[71731]:  {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:25:30 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984 -p 172.16.0.220:3260 --interface default --op new {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:25:30 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.036s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:25:30 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b5a5b58-3c11-43b7-b068-c9db25209e52]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984] added\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:25:30 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-becb7a59-9b09-4ba6-b7f8-c164468f847d tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984] added
Apr 13 16:25:30 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:25:30 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:25:30 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.040s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:25:30 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb675d0a-5dbd-4e2a-ae6b-c60db05a1303]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:25:30 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-becb7a59-9b09-4ba6-b7f8-c164468f847d tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:25:30 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:25:30 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:25:30 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[91aa7cf7-7c17-4fda-91d4-79ce4633bff6]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:25:30 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-becb7a59-9b09-4ba6-b7f8-c164468f847d tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:25:30 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KoxklySD {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:25:30 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KoxklySD" returned: 0 in 0.028s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:25:30 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[54686e0c-478f-4400-b16b-f742b6e2a175]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:25:30 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-becb7a59-9b09-4ba6-b7f8-c164468f847d tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KoxklySD'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:25:30 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:25:30 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.034s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:25:30 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[10b134ad-de50-4709-b475-759fe2e68caa]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:25:30 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-becb7a59-9b09-4ba6-b7f8-c164468f847d tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:25:30 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:25:30 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:25:30 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3b37168-1ace-4869-89a1-bd5e17490281]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc7649d3-fc59-438d-b230-72c4ce61e722 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4317bfd-71c2-4c48-a0f0-e3c795f262a8 (non-flash)\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:25:30 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-becb7a59-9b09-4ba6-b7f8-c164468f847d tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)
Apr 13 16:25:30 user nova-compute[71731]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc7649d3-fc59-438d-b230-72c4ce61e722 (non-flash)
Apr 13 16:25:30 user nova-compute[71731]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4317bfd-71c2-4c48-a0f0-e3c795f262a8 (non-flash)
Apr 13 16:25:30 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 16:25:30 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-becb7a59-9b09-4ba6-b7f8-c164468f847d tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)
Apr 13 16:25:30 user nova-compute[71731]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc7649d3-fc59-438d-b230-72c4ce61e722 (non-flash)
Apr 13 16:25:30 user nova-compute[71731]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4317bfd-71c2-4c48-a0f0-e3c795f262a8 (non-flash)
Apr 13 16:25:30 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 16:25:30 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984 -p 172.16.0.220:3260 --login {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:25:30 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984 -p 172.16.0.220:3260 --login" returned: 0 in 0.084s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:25:30 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4f3d36a-33f9-4089-a2c2-5ff7ff734f59]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:25:30 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-becb7a59-9b09-4ba6-b7f8-c164468f847d tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984, portal: 172.16.0.220,3260]
Apr 13 16:25:30 user nova-compute[71731]: Login to [iface: default, target: iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984, portal: 172.16.0.220,3260] successful.
Apr 13 16:25:30 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:25:30 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:25:30 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.036s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:25:30 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce44221a-236c-4844-8b71-383cd17b2042]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:25:30 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-becb7a59-9b09-4ba6-b7f8-c164468f847d tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:25:30 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:25:30 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:25:30 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0d97bb4-9067-4d0d-aa3b-dd496417db1d]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc7649d3-fc59-438d-b230-72c4ce61e722 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4317bfd-71c2-4c48-a0f0-e3c795f262a8 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984 (non-flash)\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:25:30 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-becb7a59-9b09-4ba6-b7f8-c164468f847d tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)
Apr 13 16:25:30 user nova-compute[71731]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc7649d3-fc59-438d-b230-72c4ce61e722 (non-flash)
Apr 13 16:25:30 user nova-compute[71731]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4317bfd-71c2-4c48-a0f0-e3c795f262a8 (non-flash)
Apr 13 16:25:30 user nova-compute[71731]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984 (non-flash)
Apr 13 16:25:30 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 16:25:30 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-becb7a59-9b09-4ba6-b7f8-c164468f847d tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)
Apr 13 16:25:30 user nova-compute[71731]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc7649d3-fc59-438d-b230-72c4ce61e722 (non-flash)
Apr 13 16:25:30 user nova-compute[71731]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4317bfd-71c2-4c48-a0f0-e3c795f262a8 (non-flash)
Apr 13 16:25:30 user nova-compute[71731]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984 (non-flash)
Apr 13 16:25:30 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 16:25:30 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-becb7a59-9b09-4ba6-b7f8-c164468f847d tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.448s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 16:25:30 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-becb7a59-9b09-4ba6-b7f8-c164468f847d tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Connected to 172.16.0.220:3260 {{(pid=71731) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 16:25:30 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-becb7a59-9b09-4ba6-b7f8-c164468f847d tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] HCTL ('36', '-', '-', 0) found on session 20 with lun 0 {{(pid=71731) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 16:25:30 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-becb7a59-9b09-4ba6-b7f8-c164468f847d tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=71731) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 16:25:30 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:25:30 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.023s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:25:30 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f05133d-bc80-4086-93b8-61fe7e718f66]: (4, ('- - 0', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:25:30 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-becb7a59-9b09-4ba6-b7f8-c164468f847d tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Searching for a device in session 20 and hctl ['36', '*', '*', 0] yield: None {{(pid=71731) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 16:25:31 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-3346e234-3b5b-45f4-b20c-a7ad822e67db tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Acquiring lock "94a2b8c9-388d-454c-88a1-54d7a8506511" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:25:31 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-3346e234-3b5b-45f4-b20c-a7ad822e67db tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Lock "94a2b8c9-388d-454c-88a1-54d7a8506511" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:25:31 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-3346e234-3b5b-45f4-b20c-a7ad822e67db tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Acquiring lock "94a2b8c9-388d-454c-88a1-54d7a8506511-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:25:31 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-3346e234-3b5b-45f4-b20c-a7ad822e67db tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Lock "94a2b8c9-388d-454c-88a1-54d7a8506511-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:25:31 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-3346e234-3b5b-45f4-b20c-a7ad822e67db tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Lock "94a2b8c9-388d-454c-88a1-54d7a8506511-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:25:31 user nova-compute[71731]: INFO nova.compute.manager [None req-3346e234-3b5b-45f4-b20c-a7ad822e67db tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] [instance: 94a2b8c9-388d-454c-88a1-54d7a8506511] Terminating instance
Apr 13 16:25:31 user nova-compute[71731]: DEBUG nova.compute.manager [None req-3346e234-3b5b-45f4-b20c-a7ad822e67db tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] [instance: 94a2b8c9-388d-454c-88a1-54d7a8506511] Start destroying the instance on the hypervisor. {{(pid=71731) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 16:25:31 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:25:31 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:25:31 user nova-compute[71731]: DEBUG nova.network.neutron [req-bd6cd2cc-9255-4260-8275-a9069efabccd req-c937a042-0e05-4d1b-baeb-d68e0db713e2 service nova] [instance: bf350da4-9cc2-4900-adf0-506e44984b42] Updated VIF entry in instance network info cache for port 1a737bae-3b9b-43b4-8a89-0eb98fdf2ec8. {{(pid=71731) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 16:25:31 user nova-compute[71731]: DEBUG nova.network.neutron [req-bd6cd2cc-9255-4260-8275-a9069efabccd req-c937a042-0e05-4d1b-baeb-d68e0db713e2 service nova] [instance: bf350da4-9cc2-4900-adf0-506e44984b42] Updating instance_info_cache with network_info: [{"id": "1a737bae-3b9b-43b4-8a89-0eb98fdf2ec8", "address": "fa:16:3e:18:7d:11", "network": {"id": "c06f107f-4fa0-46dc-8766-3c882c401851", "bridge": "br-int", "label": "tempest-TestShelveInstance-1490339676-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed94fa5d89c2486b8e2951e608e6630f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a737bae-3b", "ovs_interfaceid": "1a737bae-3b9b-43b4-8a89-0eb98fdf2ec8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:25:31 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-bd6cd2cc-9255-4260-8275-a9069efabccd req-c937a042-0e05-4d1b-baeb-d68e0db713e2 service nova] Releasing lock "refresh_cache-bf350da4-9cc2-4900-adf0-506e44984b42" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 16:25:31 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:25:31 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:25:31 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-becb7a59-9b09-4ba6-b7f8-c164468f847d tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Searching for a device in session 20 and hctl ['36', '*', '*', 0] yield: sde {{(pid=71731) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 16:25:31 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-becb7a59-9b09-4ba6-b7f8-c164468f847d tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KoxklySD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71731) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 16:25:31 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-becb7a59-9b09-4ba6-b7f8-c164468f847d tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.511s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 16:25:31 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-becb7a59-9b09-4ba6-b7f8-c164468f847d tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] <== connect_volume: return (1514ms) {'type': 'block', 'scsi_wwn': '23736643634636337', 'path': '/dev/sde'} {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 16:25:31 user nova-compute[71731]: DEBUG nova.virt.libvirt.volume.iscsi [None req-becb7a59-9b09-4ba6-b7f8-c164468f847d tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] [instance: bf350da4-9cc2-4900-adf0-506e44984b42] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23736643634636337', 'path': '/dev/sde'} {{(pid=71731) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 16:25:32 user nova-compute[71731]: DEBUG nova.virt.libvirt.vif [None req-becb7a59-9b09-4ba6-b7f8-c164468f847d tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-13T16:21:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1925968525',display_name='tempest-TestShelveInstance-server-1925968525',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1925968525',id=11,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-2029240993',keypairs=<?>,launch_index=0,launched_at=2023-04-13T16:21:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='ed94fa5d89c2486b8e2951e608e6630f',ramdisk_id='',reservation_id='r-dy6iwcv2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1159741724',owner_user_name='tempest-TestShelveInstance-1159741724-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T16:25:22Z,user_data=None,user_id='fe6a4bf1a7794af2958c3d53ea1e19c6',uuid=bf350da4-9cc2-4900-adf0-506e44984b42,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "1a737bae-3b9b-43b4-8a89-0eb98fdf2ec8", "address": "fa:16:3e:18:7d:11", "network": {"id": "c06f107f-4fa0-46dc-8766-3c882c401851", "bridge": "br-int", "label": "tempest-TestShelveInstance-1490339676-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed94fa5d89c2486b8e2951e608e6630f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a737bae-3b", "ovs_interfaceid": "1a737bae-3b9b-43b4-8a89-0eb98fdf2ec8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71731) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 16:25:32 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-becb7a59-9b09-4ba6-b7f8-c164468f847d tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Converting VIF {"id": "1a737bae-3b9b-43b4-8a89-0eb98fdf2ec8", "address": "fa:16:3e:18:7d:11", "network": {"id": "c06f107f-4fa0-46dc-8766-3c882c401851", "bridge": "br-int", "label": "tempest-TestShelveInstance-1490339676-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed94fa5d89c2486b8e2951e608e6630f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a737bae-3b", "ovs_interfaceid": "1a737bae-3b9b-43b4-8a89-0eb98fdf2ec8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 16:25:32 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-becb7a59-9b09-4ba6-b7f8-c164468f847d tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:18:7d:11,bridge_name='br-int',has_traffic_filtering=True,id=1a737bae-3b9b-43b4-8a89-0eb98fdf2ec8,network=Network(c06f107f-4fa0-46dc-8766-3c882c401851),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a737bae-3b') {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 16:25:32 user nova-compute[71731]: DEBUG nova.objects.instance [None req-becb7a59-9b09-4ba6-b7f8-c164468f847d tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Lazy-loading 'pci_devices' on Instance uuid bf350da4-9cc2-4900-adf0-506e44984b42 {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:25:32 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-becb7a59-9b09-4ba6-b7f8-c164468f847d tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] [instance: bf350da4-9cc2-4900-adf0-506e44984b42] End _get_guest_xml xml=<domain type="kvm">
Apr 13 16:25:32 user nova-compute[71731]:   <uuid>bf350da4-9cc2-4900-adf0-506e44984b42</uuid>
Apr 13 16:25:32 user nova-compute[71731]:   <name>instance-0000000b</name>
Apr 13 16:25:32 user nova-compute[71731]:   <memory>131072</memory>
Apr 13 16:25:32 user nova-compute[71731]:   <vcpu>1</vcpu>
Apr 13 16:25:32 user nova-compute[71731]:   <metadata>
Apr 13 16:25:32 user nova-compute[71731]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 16:25:32 user nova-compute[71731]:       <nova:package version="0.0.0"/>
Apr 13 16:25:32 user nova-compute[71731]:       <nova:name>tempest-TestShelveInstance-server-1925968525</nova:name>
Apr 13 16:25:32 user nova-compute[71731]:       <nova:creationTime>2023-04-13 16:25:30</nova:creationTime>
Apr 13 16:25:32 user nova-compute[71731]:       <nova:flavor name="m1.nano">
Apr 13 16:25:32 user nova-compute[71731]:         <nova:memory>128</nova:memory>
Apr 13 16:25:32 user nova-compute[71731]:         <nova:disk>1</nova:disk>
Apr 13 16:25:32 user nova-compute[71731]:         <nova:swap>0</nova:swap>
Apr 13 16:25:32 user nova-compute[71731]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 16:25:32 user nova-compute[71731]:         <nova:vcpus>1</nova:vcpus>
Apr 13 16:25:32 user nova-compute[71731]:       </nova:flavor>
Apr 13 16:25:32 user nova-compute[71731]:       <nova:owner>
Apr 13 16:25:32 user nova-compute[71731]:         <nova:user uuid="fe6a4bf1a7794af2958c3d53ea1e19c6">tempest-TestShelveInstance-1159741724-project-member</nova:user>
Apr 13 16:25:32 user nova-compute[71731]:         <nova:project uuid="ed94fa5d89c2486b8e2951e608e6630f">tempest-TestShelveInstance-1159741724</nova:project>
Apr 13 16:25:32 user nova-compute[71731]:       </nova:owner>
Apr 13 16:25:32 user nova-compute[71731]:       <nova:ports>
Apr 13 16:25:32 user nova-compute[71731]:         <nova:port uuid="1a737bae-3b9b-43b4-8a89-0eb98fdf2ec8">
Apr 13 16:25:32 user nova-compute[71731]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Apr 13 16:25:32 user nova-compute[71731]:         </nova:port>
Apr 13 16:25:32 user nova-compute[71731]:       </nova:ports>
Apr 13 16:25:32 user nova-compute[71731]:     </nova:instance>
Apr 13 16:25:32 user nova-compute[71731]:   </metadata>
Apr 13 16:25:32 user nova-compute[71731]:   <sysinfo type="smbios">
Apr 13 16:25:32 user nova-compute[71731]:     <system>
Apr 13 16:25:32 user nova-compute[71731]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 16:25:32 user nova-compute[71731]:       <entry name="product">OpenStack Nova</entry>
Apr 13 16:25:32 user nova-compute[71731]:       <entry name="version">0.0.0</entry>
Apr 13 16:25:32 user nova-compute[71731]:       <entry name="serial">bf350da4-9cc2-4900-adf0-506e44984b42</entry>
Apr 13 16:25:32 user nova-compute[71731]:       <entry name="uuid">bf350da4-9cc2-4900-adf0-506e44984b42</entry>
Apr 13 16:25:32 user nova-compute[71731]:       <entry name="family">Virtual Machine</entry>
Apr 13 16:25:32 user nova-compute[71731]:     </system>
Apr 13 16:25:32 user nova-compute[71731]:   </sysinfo>
Apr 13 16:25:32 user nova-compute[71731]:   <os>
Apr 13 16:25:32 user nova-compute[71731]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 16:25:32 user nova-compute[71731]:     <boot dev="hd"/>
Apr 13 16:25:32 user nova-compute[71731]:     <smbios mode="sysinfo"/>
Apr 13 16:25:32 user nova-compute[71731]:   </os>
Apr 13 16:25:32 user nova-compute[71731]:   <features>
Apr 13 16:25:32 user nova-compute[71731]:     <acpi/>
Apr 13 16:25:32 user nova-compute[71731]:     <apic/>
Apr 13 16:25:32 user nova-compute[71731]:     <vmcoreinfo/>
Apr 13 16:25:32 user nova-compute[71731]:   </features>
Apr 13 16:25:32 user nova-compute[71731]:   <clock offset="utc">
Apr 13 16:25:32 user nova-compute[71731]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 16:25:32 user nova-compute[71731]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 16:25:32 user nova-compute[71731]:     <timer name="hpet" present="no"/>
Apr 13 16:25:32 user nova-compute[71731]:   </clock>
Apr 13 16:25:32 user nova-compute[71731]:   <cpu mode="custom" match="exact">
Apr 13 16:25:32 user nova-compute[71731]:     <model>Nehalem</model>
Apr 13 16:25:32 user nova-compute[71731]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 16:25:32 user nova-compute[71731]:   </cpu>
Apr 13 16:25:32 user nova-compute[71731]:   <devices>
Apr 13 16:25:32 user nova-compute[71731]:     <disk type="block" device="disk">
Apr 13 16:25:32 user nova-compute[71731]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 16:25:32 user nova-compute[71731]:       <source dev="/dev/sde"/>
Apr 13 16:25:32 user nova-compute[71731]:       <target dev="vda" bus="virtio"/>
Apr 13 16:25:32 user nova-compute[71731]:       <serial>1ac31388-2626-48e4-a711-54683ef66984</serial>
Apr 13 16:25:32 user nova-compute[71731]:     </disk>
Apr 13 16:25:32 user nova-compute[71731]:     <interface type="ethernet">
Apr 13 16:25:32 user nova-compute[71731]:       <mac address="fa:16:3e:18:7d:11"/>
Apr 13 16:25:32 user nova-compute[71731]:       <model type="virtio"/>
Apr 13 16:25:32 user nova-compute[71731]:       <mtu size="1442"/>
Apr 13 16:25:32 user nova-compute[71731]:       <target dev="tap1a737bae-3b"/>
Apr 13 16:25:32 user nova-compute[71731]:     </interface>
Apr 13 16:25:32 user nova-compute[71731]:     <serial type="pty">
Apr 13 16:25:32 user nova-compute[71731]:       <log file="/opt/stack/data/nova/instances/bf350da4-9cc2-4900-adf0-506e44984b42/console.log" append="off"/>
Apr 13 16:25:32 user nova-compute[71731]:     </serial>
Apr 13 16:25:32 user nova-compute[71731]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 16:25:32 user nova-compute[71731]:     <video>
Apr 13 16:25:32 user nova-compute[71731]:       <model type="virtio"/>
Apr 13 16:25:32 user nova-compute[71731]:     </video>
Apr 13 16:25:32 user nova-compute[71731]:     <rng model="virtio">
Apr 13 16:25:32 user nova-compute[71731]:       <backend model="random">/dev/urandom</backend>
Apr 13 16:25:32 user nova-compute[71731]:     </rng>
Apr 13 16:25:32 user nova-compute[71731]:     <controller type="usb" index="0" model="none"/>
Apr 13 16:25:32 user nova-compute[71731]:     <memballoon model="virtio">
Apr 13 16:25:32 user nova-compute[71731]:       <stats period="10"/>
Apr 13 16:25:32 user nova-compute[71731]:     </memballoon>
Apr 13 16:25:32 user nova-compute[71731]:   </devices>
Apr 13 16:25:32 user nova-compute[71731]: </domain>
Apr 13 16:25:32 user nova-compute[71731]:  {{(pid=71731) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 16:25:32 user nova-compute[71731]: DEBUG nova.virt.libvirt.vif [None req-becb7a59-9b09-4ba6-b7f8-c164468f847d tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-13T16:21:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1925968525',display_name='tempest-TestShelveInstance-server-1925968525',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1925968525',id=11,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-2029240993',keypairs=<?>,launch_index=0,launched_at=2023-04-13T16:21:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='ed94fa5d89c2486b8e2951e608e6630f',ramdisk_id='',reservation_id='r-dy6iwcv2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1159741724',owner_user_name='tempest-TestShelveInstance-1159741724-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T16:25:22Z,user_data=None,user_id='fe6a4bf1a7794af2958c3d53ea1e19c6',uuid=bf350da4-9cc2-4900-adf0-506e44984b42,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "1a737bae-3b9b-43b4-8a89-0eb98fdf2ec8", "address": "fa:16:3e:18:7d:11", "network": {"id": "c06f107f-4fa0-46dc-8766-3c882c401851", "bridge": "br-int", "label": "tempest-TestShelveInstance-1490339676-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed94fa5d89c2486b8e2951e608e6630f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a737bae-3b", "ovs_interfaceid": "1a737bae-3b9b-43b4-8a89-0eb98fdf2ec8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 16:25:32 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-becb7a59-9b09-4ba6-b7f8-c164468f847d tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Converting VIF {"id": "1a737bae-3b9b-43b4-8a89-0eb98fdf2ec8", "address": "fa:16:3e:18:7d:11", "network": {"id": "c06f107f-4fa0-46dc-8766-3c882c401851", "bridge": "br-int", "label": "tempest-TestShelveInstance-1490339676-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed94fa5d89c2486b8e2951e608e6630f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a737bae-3b", "ovs_interfaceid": "1a737bae-3b9b-43b4-8a89-0eb98fdf2ec8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 16:25:32 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-becb7a59-9b09-4ba6-b7f8-c164468f847d tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:18:7d:11,bridge_name='br-int',has_traffic_filtering=True,id=1a737bae-3b9b-43b4-8a89-0eb98fdf2ec8,network=Network(c06f107f-4fa0-46dc-8766-3c882c401851),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a737bae-3b') {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 16:25:32 user nova-compute[71731]: DEBUG os_vif [None req-becb7a59-9b09-4ba6-b7f8-c164468f847d tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:7d:11,bridge_name='br-int',has_traffic_filtering=True,id=1a737bae-3b9b-43b4-8a89-0eb98fdf2ec8,network=Network(c06f107f-4fa0-46dc-8766-3c882c401851),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a737bae-3b') {{(pid=71731) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 16:25:32 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:25:32 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:25:32 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 16:25:32 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:25:32 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1a737bae-3b, may_exist=True) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:25:32 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1a737bae-3b, col_values=(('external_ids', {'iface-id': '1a737bae-3b9b-43b4-8a89-0eb98fdf2ec8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:18:7d:11', 'vm-uuid': 'bf350da4-9cc2-4900-adf0-506e44984b42'}),)) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:25:32 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:25:32 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 16:25:32 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:25:32 user nova-compute[71731]: INFO os_vif [None req-becb7a59-9b09-4ba6-b7f8-c164468f847d tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:7d:11,bridge_name='br-int',has_traffic_filtering=True,id=1a737bae-3b9b-43b4-8a89-0eb98fdf2ec8,network=Network(c06f107f-4fa0-46dc-8766-3c882c401851),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a737bae-3b')
Apr 13 16:25:32 user nova-compute[71731]: INFO nova.virt.libvirt.driver [-] [instance: 94a2b8c9-388d-454c-88a1-54d7a8506511] Instance destroyed successfully.
Apr 13 16:25:32 user nova-compute[71731]: DEBUG nova.objects.instance [None req-3346e234-3b5b-45f4-b20c-a7ad822e67db tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Lazy-loading 'resources' on Instance uuid 94a2b8c9-388d-454c-88a1-54d7a8506511 {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:25:32 user nova-compute[71731]: DEBUG nova.virt.libvirt.vif [None req-3346e234-3b5b-45f4-b20c-a7ad822e67db tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T16:23:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1338821197',display_name='tempest-VolumesAdminNegativeTest-server-1338821197',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1338821197',id=15,image_ref='708622a9-7465-4492-ade8-b827198f7e30',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-13T16:23:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5ded8a69b7e941f9bcdc502cfeed79db',ramdisk_id='',reservation_id='r-gqgs7b89',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='708622a9-7465-4492-ade8-b827198f7e30',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-694044578',owner_user_name='tempest-VolumesAdminNegativeTest-694044578-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T16:23:42Z,user_data=None,user_id='62cf399757f544649fed18ee5a31d50c',uuid=94a2b8c9-388d-454c-88a1-54d7a8506511,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8731e8dd-3e93-4fa1-b8e6-f1d2d10271f7", "address": "fa:16:3e:fb:19:75", "network": {"id": "fc7f5f86-d676-4a45-b0f4-c93f3eae043e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1421861184-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ded8a69b7e941f9bcdc502cfeed79db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8731e8dd-3e", "ovs_interfaceid": "8731e8dd-3e93-4fa1-b8e6-f1d2d10271f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 16:25:32 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-3346e234-3b5b-45f4-b20c-a7ad822e67db tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Converting VIF {"id": "8731e8dd-3e93-4fa1-b8e6-f1d2d10271f7", "address": "fa:16:3e:fb:19:75", "network": {"id": "fc7f5f86-d676-4a45-b0f4-c93f3eae043e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1421861184-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ded8a69b7e941f9bcdc502cfeed79db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8731e8dd-3e", "ovs_interfaceid": "8731e8dd-3e93-4fa1-b8e6-f1d2d10271f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 16:25:32 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-3346e234-3b5b-45f4-b20c-a7ad822e67db tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fb:19:75,bridge_name='br-int',has_traffic_filtering=True,id=8731e8dd-3e93-4fa1-b8e6-f1d2d10271f7,network=Network(fc7f5f86-d676-4a45-b0f4-c93f3eae043e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8731e8dd-3e') {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 16:25:32 user nova-compute[71731]: DEBUG os_vif [None req-3346e234-3b5b-45f4-b20c-a7ad822e67db tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:19:75,bridge_name='br-int',has_traffic_filtering=True,id=8731e8dd-3e93-4fa1-b8e6-f1d2d10271f7,network=Network(fc7f5f86-d676-4a45-b0f4-c93f3eae043e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8731e8dd-3e') {{(pid=71731) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 16:25:32 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:25:32 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8731e8dd-3e, bridge=br-int, if_exists=True) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:25:32 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:25:32 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 16:25:32 user nova-compute[71731]: DEBUG nova.compute.manager [req-a838f36a-27f3-427a-80c1-aaa56f7ca5c8 req-a958c7f2-875f-46c3-a988-c9e4822c7d4f service nova] [instance: 94a2b8c9-388d-454c-88a1-54d7a8506511] Received event network-vif-unplugged-8731e8dd-3e93-4fa1-b8e6-f1d2d10271f7 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:25:32 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-a838f36a-27f3-427a-80c1-aaa56f7ca5c8 req-a958c7f2-875f-46c3-a988-c9e4822c7d4f service nova] Acquiring lock "94a2b8c9-388d-454c-88a1-54d7a8506511-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:25:32 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-a838f36a-27f3-427a-80c1-aaa56f7ca5c8 req-a958c7f2-875f-46c3-a988-c9e4822c7d4f service nova] Lock "94a2b8c9-388d-454c-88a1-54d7a8506511-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:25:32 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-a838f36a-27f3-427a-80c1-aaa56f7ca5c8 req-a958c7f2-875f-46c3-a988-c9e4822c7d4f service nova] Lock "94a2b8c9-388d-454c-88a1-54d7a8506511-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:25:32 user nova-compute[71731]: DEBUG nova.compute.manager [req-a838f36a-27f3-427a-80c1-aaa56f7ca5c8 req-a958c7f2-875f-46c3-a988-c9e4822c7d4f service nova] [instance: 94a2b8c9-388d-454c-88a1-54d7a8506511] No waiting events found dispatching network-vif-unplugged-8731e8dd-3e93-4fa1-b8e6-f1d2d10271f7 {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:25:32 user nova-compute[71731]: DEBUG nova.compute.manager [req-a838f36a-27f3-427a-80c1-aaa56f7ca5c8 req-a958c7f2-875f-46c3-a988-c9e4822c7d4f service nova] [instance: 94a2b8c9-388d-454c-88a1-54d7a8506511] Received event network-vif-unplugged-8731e8dd-3e93-4fa1-b8e6-f1d2d10271f7 for instance with task_state deleting. {{(pid=71731) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 16:25:32 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-becb7a59-9b09-4ba6-b7f8-c164468f847d tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] No BDM found with device name vda, not building metadata. {{(pid=71731) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 16:25:32 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-becb7a59-9b09-4ba6-b7f8-c164468f847d tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] No VIF found with MAC fa:16:3e:18:7d:11, not building metadata {{(pid=71731) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 16:25:32 user nova-compute[71731]: INFO os_vif [None req-3346e234-3b5b-45f4-b20c-a7ad822e67db tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:19:75,bridge_name='br-int',has_traffic_filtering=True,id=8731e8dd-3e93-4fa1-b8e6-f1d2d10271f7,network=Network(fc7f5f86-d676-4a45-b0f4-c93f3eae043e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8731e8dd-3e')
Apr 13 16:25:32 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-3346e234-3b5b-45f4-b20c-a7ad822e67db tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] [instance: 94a2b8c9-388d-454c-88a1-54d7a8506511] Deleting instance files /opt/stack/data/nova/instances/94a2b8c9-388d-454c-88a1-54d7a8506511_del
Apr 13 16:25:32 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-3346e234-3b5b-45f4-b20c-a7ad822e67db tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] [instance: 94a2b8c9-388d-454c-88a1-54d7a8506511] Deletion of /opt/stack/data/nova/instances/94a2b8c9-388d-454c-88a1-54d7a8506511_del complete
Apr 13 16:25:32 user nova-compute[71731]: INFO nova.compute.manager [None req-3346e234-3b5b-45f4-b20c-a7ad822e67db tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] [instance: 94a2b8c9-388d-454c-88a1-54d7a8506511] Took 1.15 seconds to destroy the instance on the hypervisor.
Apr 13 16:25:32 user nova-compute[71731]: DEBUG oslo.service.loopingcall [None req-3346e234-3b5b-45f4-b20c-a7ad822e67db tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71731) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 16:25:32 user nova-compute[71731]: DEBUG nova.compute.manager [-] [instance: 94a2b8c9-388d-454c-88a1-54d7a8506511] Deallocating network for instance {{(pid=71731) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 16:25:32 user nova-compute[71731]: DEBUG nova.network.neutron [-] [instance: 94a2b8c9-388d-454c-88a1-54d7a8506511] deallocate_for_instance() {{(pid=71731) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 16:25:33 user nova-compute[71731]: DEBUG nova.network.neutron [-] [instance: 94a2b8c9-388d-454c-88a1-54d7a8506511] Updating instance_info_cache with network_info: [] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:25:33 user nova-compute[71731]: INFO nova.compute.manager [-] [instance: 94a2b8c9-388d-454c-88a1-54d7a8506511] Took 1.05 seconds to deallocate network for instance.
Apr 13 16:25:33 user nova-compute[71731]: DEBUG nova.compute.manager [req-19226414-a360-45e3-a572-d2ac7f700bd5 req-2f1d6db0-ebfc-40c9-94ad-22acb327cf77 service nova] [instance: 94a2b8c9-388d-454c-88a1-54d7a8506511] Received event network-vif-deleted-8731e8dd-3e93-4fa1-b8e6-f1d2d10271f7 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:25:33 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-3346e234-3b5b-45f4-b20c-a7ad822e67db tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:25:33 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-3346e234-3b5b-45f4-b20c-a7ad822e67db tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:25:33 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:25:33 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:25:33 user nova-compute[71731]: DEBUG nova.compute.provider_tree [None req-3346e234-3b5b-45f4-b20c-a7ad822e67db tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Inventory has not changed in ProviderTree for provider: cb6b1a64-0c24-4e2d-af1e-16576ca9165c {{(pid=71731) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 16:25:34 user nova-compute[71731]: DEBUG nova.scheduler.client.report [None req-3346e234-3b5b-45f4-b20c-a7ad822e67db tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Inventory has not changed for provider cb6b1a64-0c24-4e2d-af1e-16576ca9165c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71731) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 16:25:34 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-3346e234-3b5b-45f4-b20c-a7ad822e67db tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.665s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:25:34 user nova-compute[71731]: INFO nova.scheduler.client.report [None req-3346e234-3b5b-45f4-b20c-a7ad822e67db tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Deleted allocations for instance 94a2b8c9-388d-454c-88a1-54d7a8506511
Apr 13 16:25:34 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-3346e234-3b5b-45f4-b20c-a7ad822e67db tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Lock "94a2b8c9-388d-454c-88a1-54d7a8506511" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.104s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:25:34 user nova-compute[71731]: DEBUG nova.compute.manager [req-07003adf-15a6-4473-a526-629b1f221613 req-59cd048b-06ba-459d-9425-0e1d161e8e60 service nova] [instance: 94a2b8c9-388d-454c-88a1-54d7a8506511] Received event network-vif-plugged-8731e8dd-3e93-4fa1-b8e6-f1d2d10271f7 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:25:34 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-07003adf-15a6-4473-a526-629b1f221613 req-59cd048b-06ba-459d-9425-0e1d161e8e60 service nova] Acquiring lock "94a2b8c9-388d-454c-88a1-54d7a8506511-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:25:34 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-07003adf-15a6-4473-a526-629b1f221613 req-59cd048b-06ba-459d-9425-0e1d161e8e60 service nova] Lock "94a2b8c9-388d-454c-88a1-54d7a8506511-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:25:34 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-07003adf-15a6-4473-a526-629b1f221613 req-59cd048b-06ba-459d-9425-0e1d161e8e60 service nova] Lock "94a2b8c9-388d-454c-88a1-54d7a8506511-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:25:34 user nova-compute[71731]: DEBUG nova.compute.manager [req-07003adf-15a6-4473-a526-629b1f221613 req-59cd048b-06ba-459d-9425-0e1d161e8e60 service nova] [instance: 94a2b8c9-388d-454c-88a1-54d7a8506511] No waiting events found dispatching network-vif-plugged-8731e8dd-3e93-4fa1-b8e6-f1d2d10271f7 {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:25:34 user nova-compute[71731]: WARNING nova.compute.manager [req-07003adf-15a6-4473-a526-629b1f221613 req-59cd048b-06ba-459d-9425-0e1d161e8e60 service nova] [instance: 94a2b8c9-388d-454c-88a1-54d7a8506511] Received unexpected event network-vif-plugged-8731e8dd-3e93-4fa1-b8e6-f1d2d10271f7 for instance with vm_state deleted and task_state None.
Apr 13 16:25:34 user nova-compute[71731]: DEBUG nova.compute.manager [req-07003adf-15a6-4473-a526-629b1f221613 req-59cd048b-06ba-459d-9425-0e1d161e8e60 service nova] [instance: bf350da4-9cc2-4900-adf0-506e44984b42] Received event network-vif-plugged-1a737bae-3b9b-43b4-8a89-0eb98fdf2ec8 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:25:34 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-07003adf-15a6-4473-a526-629b1f221613 req-59cd048b-06ba-459d-9425-0e1d161e8e60 service nova] Acquiring lock "bf350da4-9cc2-4900-adf0-506e44984b42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:25:34 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-07003adf-15a6-4473-a526-629b1f221613 req-59cd048b-06ba-459d-9425-0e1d161e8e60 service nova] Lock "bf350da4-9cc2-4900-adf0-506e44984b42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:25:34 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-07003adf-15a6-4473-a526-629b1f221613 req-59cd048b-06ba-459d-9425-0e1d161e8e60 service nova] Lock "bf350da4-9cc2-4900-adf0-506e44984b42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:25:34 user nova-compute[71731]: DEBUG nova.compute.manager [req-07003adf-15a6-4473-a526-629b1f221613 req-59cd048b-06ba-459d-9425-0e1d161e8e60 service nova] [instance: bf350da4-9cc2-4900-adf0-506e44984b42] No waiting events found dispatching network-vif-plugged-1a737bae-3b9b-43b4-8a89-0eb98fdf2ec8 {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:25:34 user nova-compute[71731]: WARNING nova.compute.manager [req-07003adf-15a6-4473-a526-629b1f221613 req-59cd048b-06ba-459d-9425-0e1d161e8e60 service nova] [instance: bf350da4-9cc2-4900-adf0-506e44984b42] Received unexpected event network-vif-plugged-1a737bae-3b9b-43b4-8a89-0eb98fdf2ec8 for instance with vm_state shelved_offloaded and task_state spawning.
Apr 13 16:25:34 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:25:34 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:25:34 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:25:35 user nova-compute[71731]: DEBUG nova.compute.manager [req-785df8d1-5c03-46c5-8268-6d4667025ba5 req-8613a40d-165c-4c93-a734-a9fb2bf0561b service nova] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] Received event network-changed-13471516-9514-4b85-938f-69657c2990e5 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:25:35 user nova-compute[71731]: DEBUG nova.compute.manager [req-785df8d1-5c03-46c5-8268-6d4667025ba5 req-8613a40d-165c-4c93-a734-a9fb2bf0561b service nova] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] Refreshing instance network info cache due to event network-changed-13471516-9514-4b85-938f-69657c2990e5. {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 16:25:35 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-785df8d1-5c03-46c5-8268-6d4667025ba5 req-8613a40d-165c-4c93-a734-a9fb2bf0561b service nova] Acquiring lock "refresh_cache-acbcaee0-a47b-4fee-8765-9b1c9597d515" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 16:25:35 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-785df8d1-5c03-46c5-8268-6d4667025ba5 req-8613a40d-165c-4c93-a734-a9fb2bf0561b service nova] Acquired lock "refresh_cache-acbcaee0-a47b-4fee-8765-9b1c9597d515" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 16:25:35 user nova-compute[71731]: DEBUG nova.network.neutron [req-785df8d1-5c03-46c5-8268-6d4667025ba5 req-8613a40d-165c-4c93-a734-a9fb2bf0561b service nova] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] Refreshing network info cache for port 13471516-9514-4b85-938f-69657c2990e5 {{(pid=71731) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 16:25:36 user nova-compute[71731]: DEBUG nova.network.neutron [req-785df8d1-5c03-46c5-8268-6d4667025ba5 req-8613a40d-165c-4c93-a734-a9fb2bf0561b service nova] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] Updated VIF entry in instance network info cache for port 13471516-9514-4b85-938f-69657c2990e5. {{(pid=71731) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 16:25:36 user nova-compute[71731]: DEBUG nova.network.neutron [req-785df8d1-5c03-46c5-8268-6d4667025ba5 req-8613a40d-165c-4c93-a734-a9fb2bf0561b service nova] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] Updating instance_info_cache with network_info: [{"id": "13471516-9514-4b85-938f-69657c2990e5", "address": "fa:16:3e:62:32:7f", "network": {"id": "cf1fef97-9ef1-449f-a302-b38110024547", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1138167711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "980559734a504574a83224deb7423c77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13471516-95", "ovs_interfaceid": "13471516-9514-4b85-938f-69657c2990e5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:25:36 user nova-compute[71731]: DEBUG nova.virt.driver [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Emitting event <LifecycleEvent: 1681403136.0591671, bf350da4-9cc2-4900-adf0-506e44984b42 => Resumed> {{(pid=71731) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 16:25:36 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: bf350da4-9cc2-4900-adf0-506e44984b42] VM Resumed (Lifecycle Event)
Apr 13 16:25:36 user nova-compute[71731]: DEBUG nova.compute.manager [None req-becb7a59-9b09-4ba6-b7f8-c164468f847d tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] [instance: bf350da4-9cc2-4900-adf0-506e44984b42] Instance event wait completed in 0 seconds for  {{(pid=71731) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 16:25:36 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-becb7a59-9b09-4ba6-b7f8-c164468f847d tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] [instance: bf350da4-9cc2-4900-adf0-506e44984b42] Guest created on hypervisor {{(pid=71731) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 16:25:36 user nova-compute[71731]: INFO nova.virt.libvirt.driver [-] [instance: bf350da4-9cc2-4900-adf0-506e44984b42] Instance spawned successfully.
Apr 13 16:25:36 user nova-compute[71731]: DEBUG nova.compute.manager [None req-becb7a59-9b09-4ba6-b7f8-c164468f847d tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] [instance: bf350da4-9cc2-4900-adf0-506e44984b42] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:25:36 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-785df8d1-5c03-46c5-8268-6d4667025ba5 req-8613a40d-165c-4c93-a734-a9fb2bf0561b service nova] Releasing lock "refresh_cache-acbcaee0-a47b-4fee-8765-9b1c9597d515" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 16:25:36 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: bf350da4-9cc2-4900-adf0-506e44984b42] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:25:36 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: bf350da4-9cc2-4900-adf0-506e44984b42] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=71731) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 16:25:36 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: bf350da4-9cc2-4900-adf0-506e44984b42] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 16:25:36 user nova-compute[71731]: DEBUG nova.virt.driver [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Emitting event <LifecycleEvent: 1681403136.1041298, bf350da4-9cc2-4900-adf0-506e44984b42 => Started> {{(pid=71731) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 16:25:36 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: bf350da4-9cc2-4900-adf0-506e44984b42] VM Started (Lifecycle Event)
Apr 13 16:25:36 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: bf350da4-9cc2-4900-adf0-506e44984b42] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:25:36 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-becb7a59-9b09-4ba6-b7f8-c164468f847d tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Lock "bf350da4-9cc2-4900-adf0-506e44984b42" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 14.284s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:25:36 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: bf350da4-9cc2-4900-adf0-506e44984b42] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=71731) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 16:25:36 user nova-compute[71731]: DEBUG nova.compute.manager [req-d931615d-3eb0-4475-aa5b-870137410cdb req-1674aca4-09b6-415f-8022-92d830bfefca service nova] [instance: bf350da4-9cc2-4900-adf0-506e44984b42] Received event network-vif-plugged-1a737bae-3b9b-43b4-8a89-0eb98fdf2ec8 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:25:36 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-d931615d-3eb0-4475-aa5b-870137410cdb req-1674aca4-09b6-415f-8022-92d830bfefca service nova] Acquiring lock "bf350da4-9cc2-4900-adf0-506e44984b42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:25:36 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-d931615d-3eb0-4475-aa5b-870137410cdb req-1674aca4-09b6-415f-8022-92d830bfefca service nova] Lock "bf350da4-9cc2-4900-adf0-506e44984b42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.005s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:25:36 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-d931615d-3eb0-4475-aa5b-870137410cdb req-1674aca4-09b6-415f-8022-92d830bfefca service nova] Lock "bf350da4-9cc2-4900-adf0-506e44984b42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:25:36 user nova-compute[71731]: DEBUG nova.compute.manager [req-d931615d-3eb0-4475-aa5b-870137410cdb req-1674aca4-09b6-415f-8022-92d830bfefca service nova] [instance: bf350da4-9cc2-4900-adf0-506e44984b42] No waiting events found dispatching network-vif-plugged-1a737bae-3b9b-43b4-8a89-0eb98fdf2ec8 {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:25:36 user nova-compute[71731]: WARNING nova.compute.manager [req-d931615d-3eb0-4475-aa5b-870137410cdb req-1674aca4-09b6-415f-8022-92d830bfefca service nova] [instance: bf350da4-9cc2-4900-adf0-506e44984b42] Received unexpected event network-vif-plugged-1a737bae-3b9b-43b4-8a89-0eb98fdf2ec8 for instance with vm_state active and task_state None.
Apr 13 16:25:36 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:25:37 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:25:41 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:25:42 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:25:46 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:25:47 user nova-compute[71731]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681403132.2016797, 94a2b8c9-388d-454c-88a1-54d7a8506511 => Stopped> {{(pid=71731) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 16:25:47 user nova-compute[71731]: INFO nova.compute.manager [-] [instance: 94a2b8c9-388d-454c-88a1-54d7a8506511] VM Stopped (Lifecycle Event)
Apr 13 16:25:47 user nova-compute[71731]: DEBUG nova.compute.manager [None req-62646a81-bf7e-4587-94d4-19b6fd57a4b5 None None] [instance: 94a2b8c9-388d-454c-88a1-54d7a8506511] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:25:47 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:25:51 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:25:52 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:25:56 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:25:57 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:26:01 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:26:01 user nova-compute[71731]: DEBUG nova.compute.manager [req-4a8ce099-874e-4f1d-94a8-8609f30a720c req-9284b0c0-d67b-4c8d-9ecc-e5d620e8a387 service nova] [instance: eaae47b9-a059-49f6-9ae6-d7147003e2f2] Received event network-changed-e9b2fcaa-f77b-4e5c-ad3c-797ce804a9ae {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:26:01 user nova-compute[71731]: DEBUG nova.compute.manager [req-4a8ce099-874e-4f1d-94a8-8609f30a720c req-9284b0c0-d67b-4c8d-9ecc-e5d620e8a387 service nova] [instance: eaae47b9-a059-49f6-9ae6-d7147003e2f2] Refreshing instance network info cache due to event network-changed-e9b2fcaa-f77b-4e5c-ad3c-797ce804a9ae. {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 16:26:01 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-4a8ce099-874e-4f1d-94a8-8609f30a720c req-9284b0c0-d67b-4c8d-9ecc-e5d620e8a387 service nova] Acquiring lock "refresh_cache-eaae47b9-a059-49f6-9ae6-d7147003e2f2" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 16:26:01 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-4a8ce099-874e-4f1d-94a8-8609f30a720c req-9284b0c0-d67b-4c8d-9ecc-e5d620e8a387 service nova] Acquired lock "refresh_cache-eaae47b9-a059-49f6-9ae6-d7147003e2f2" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 16:26:01 user nova-compute[71731]: DEBUG nova.network.neutron [req-4a8ce099-874e-4f1d-94a8-8609f30a720c req-9284b0c0-d67b-4c8d-9ecc-e5d620e8a387 service nova] [instance: eaae47b9-a059-49f6-9ae6-d7147003e2f2] Refreshing network info cache for port e9b2fcaa-f77b-4e5c-ad3c-797ce804a9ae {{(pid=71731) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 16:26:02 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:26:02 user nova-compute[71731]: DEBUG nova.network.neutron [req-4a8ce099-874e-4f1d-94a8-8609f30a720c req-9284b0c0-d67b-4c8d-9ecc-e5d620e8a387 service nova] [instance: eaae47b9-a059-49f6-9ae6-d7147003e2f2] Updated VIF entry in instance network info cache for port e9b2fcaa-f77b-4e5c-ad3c-797ce804a9ae. {{(pid=71731) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 16:26:02 user nova-compute[71731]: DEBUG nova.network.neutron [req-4a8ce099-874e-4f1d-94a8-8609f30a720c req-9284b0c0-d67b-4c8d-9ecc-e5d620e8a387 service nova] [instance: eaae47b9-a059-49f6-9ae6-d7147003e2f2] Updating instance_info_cache with network_info: [{"id": "e9b2fcaa-f77b-4e5c-ad3c-797ce804a9ae", "address": "fa:16:3e:ff:85:92", "network": {"id": "79e9ef20-b14d-4850-b298-9d3ed4d10b90", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1756253617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24904988cf334657b084fd726c7ecf8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9b2fcaa-f7", "ovs_interfaceid": "e9b2fcaa-f77b-4e5c-ad3c-797ce804a9ae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:26:02 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-4a8ce099-874e-4f1d-94a8-8609f30a720c req-9284b0c0-d67b-4c8d-9ecc-e5d620e8a387 service nova] Releasing lock "refresh_cache-eaae47b9-a059-49f6-9ae6-d7147003e2f2" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 16:26:03 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:26:03 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Cleaning up deleted instances {{(pid=71731) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 13 16:26:03 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] There are 0 instances to clean {{(pid=71731) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 13 16:26:04 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-97043357-b1f7-43b4-9364-c4cc8a068800 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Acquiring lock "eaae47b9-a059-49f6-9ae6-d7147003e2f2" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:26:04 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-97043357-b1f7-43b4-9364-c4cc8a068800 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lock "eaae47b9-a059-49f6-9ae6-d7147003e2f2" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:26:04 user nova-compute[71731]: DEBUG nova.objects.instance [None req-97043357-b1f7-43b4-9364-c4cc8a068800 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lazy-loading 'flavor' on Instance uuid eaae47b9-a059-49f6-9ae6-d7147003e2f2 {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:26:04 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-97043357-b1f7-43b4-9364-c4cc8a068800 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lock "eaae47b9-a059-49f6-9ae6-d7147003e2f2" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:26:04 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-97043357-b1f7-43b4-9364-c4cc8a068800 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Acquiring lock "eaae47b9-a059-49f6-9ae6-d7147003e2f2" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:26:04 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-97043357-b1f7-43b4-9364-c4cc8a068800 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lock "eaae47b9-a059-49f6-9ae6-d7147003e2f2" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:26:04 user nova-compute[71731]: INFO nova.compute.manager [None req-97043357-b1f7-43b4-9364-c4cc8a068800 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] [instance: eaae47b9-a059-49f6-9ae6-d7147003e2f2] Attaching volume eb2c60ec-fb52-436f-a98a-dfe15d1e3aa6 to /dev/vdb
Apr 13 16:26:04 user nova-compute[71731]: DEBUG os_brick.utils [None req-97043357-b1f7-43b4-9364-c4cc8a068800 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 16:26:04 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:26:04 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:26:04 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e573aa4-7016-4bce-a5e9-cade809973d0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:81501d91421\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:26:04 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:26:04 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:26:04 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[28ae3896-5c72-4c51-a7cf-7d6c295f6d13]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:26:04 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:26:04 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:26:04 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[63c359b7-404d-426f-b7d2-c3be257cd641]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:26:04 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9b29883-9586-4185-a970-14aded6e6c29]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:26:04 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-97043357-b1f7-43b4-9364-c4cc8a068800 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Running cmd (subprocess): nvme version {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:26:04 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-97043357-b1f7-43b4-9364-c4cc8a068800 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] 'nvme version' failed. Not Retrying. {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 16:26:04 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.nvmeof [None req-97043357-b1f7-43b4-9364-c4cc8a068800 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] nvme not present on system {{(pid=71731) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 16:26:04 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:26:04 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 16:26:04 user nova-compute[71731]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 16:26:04 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[e595697d-7421-4dc4-9d98-47bae5f39da9]: (4, '') {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:26:04 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.lightos [None req-97043357-b1f7-43b4-9364-c4cc8a068800 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71731) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 16:26:04 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.lightos [None req-97043357-b1f7-43b4-9364-c4cc8a068800 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71731) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 16:26:04 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.lightos [None req-97043357-b1f7-43b4-9364-c4cc8a068800 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] LIGHTOS: no hostnqn found. {{(pid=71731) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 16:26:04 user nova-compute[71731]: DEBUG os_brick.utils [None req-97043357-b1f7-43b4-9364-c4cc8a068800 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:81501d91421', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 16:26:04 user nova-compute[71731]: DEBUG nova.virt.block_device [None req-97043357-b1f7-43b4-9364-c4cc8a068800 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] [instance: eaae47b9-a059-49f6-9ae6-d7147003e2f2] Updating existing volume attachment record: 0b7b1ced-6895-44e2-9696-28cfbd8d0062 {{(pid=71731) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 16:26:06 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:26:07 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:26:08 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:26:09 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:26:09 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager.update_available_resource {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:26:09 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:26:09 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:26:09 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:26:09 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Auditing locally available compute resources for user (node: user) {{(pid=71731) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 16:26:09 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=71731) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 16:26:09 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acbcaee0-a47b-4fee-8765-9b1c9597d515/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:26:09 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acbcaee0-a47b-4fee-8765-9b1c9597d515/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:26:09 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acbcaee0-a47b-4fee-8765-9b1c9597d515/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:26:09 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acbcaee0-a47b-4fee-8765-9b1c9597d515/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:26:09 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7973e93b-6311-44ed-91ff-e861c32d0277/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:26:09 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7973e93b-6311-44ed-91ff-e861c32d0277/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:26:09 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7973e93b-6311-44ed-91ff-e861c32d0277/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:26:09 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7973e93b-6311-44ed-91ff-e861c32d0277/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:26:09 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=71731) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 16:26:09 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66553f5-5e1b-4f1d-8c5a-63bc340f7586/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:26:10 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66553f5-5e1b-4f1d-8c5a-63bc340f7586/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:26:10 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66553f5-5e1b-4f1d-8c5a-63bc340f7586/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:26:10 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66553f5-5e1b-4f1d-8c5a-63bc340f7586/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:26:10 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbcccf4b-e861-4254-9be3-a491776214e9/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:26:10 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbcccf4b-e861-4254-9be3-a491776214e9/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:26:10 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbcccf4b-e861-4254-9be3-a491776214e9/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:26:10 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbcccf4b-e861-4254-9be3-a491776214e9/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:26:10 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=71731) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 16:26:10 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbcccf4b-e861-4254-9be3-a491776214e9/disk.rescue --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:26:10 user nova-compute[71731]: DEBUG nova.virt.libvirt.volume.iscsi [None req-97043357-b1f7-43b4-9364-c4cc8a068800 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] [instance: eaae47b9-a059-49f6-9ae6-d7147003e2f2] Calling os-brick to attach iSCSI Volume {{(pid=71731) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 16:26:10 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-97043357-b1f7-43b4-9364-c4cc8a068800 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8cf0118790>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:eb2c60ec-fb52-436f-a98a-dfe15d1e3aa6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gzcNiTHC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 16:26:10 user nova-compute[71731]: WARNING os_brick.initiator.connectors.base [None req-97043357-b1f7-43b4-9364-c4cc8a068800 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 16:26:10 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-97043357-b1f7-43b4-9364-c4cc8a068800 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 16:26:10 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-97043357-b1f7-43b4-9364-c4cc8a068800 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 16:26:10 user nova-compute[71731]: WARNING os_brick.initiator.connectors.base [None req-97043357-b1f7-43b4-9364-c4cc8a068800 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 16:26:10 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-97043357-b1f7-43b4-9364-c4cc8a068800 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eb2c60ec-fb52-436f-a98a-dfe15d1e3aa6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 16:26:10 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-97043357-b1f7-43b4-9364-c4cc8a068800 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eb2c60ec-fb52-436f-a98a-dfe15d1e3aa6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 16:26:10 user nova-compute[71731]: INFO os_brick.initiator.connectors.iscsi [None req-97043357-b1f7-43b4-9364-c4cc8a068800 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 16:26:10 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbcccf4b-e861-4254-9be3-a491776214e9/disk.rescue --force-share --output=json" returned: 0 in 0.155s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:26:10 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbcccf4b-e861-4254-9be3-a491776214e9/disk.rescue --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:26:10 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb2c60ec-fb52-436f-a98a-dfe15d1e3aa6 -p 172.16.0.220:3260 {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:26:10 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb2c60ec-fb52-436f-a98a-dfe15d1e3aa6 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:26:10 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[88e5ff1a-a575-462f-9916-fc7362708766]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:26:10 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-97043357-b1f7-43b4-9364-c4cc8a068800 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 16:26:10 user nova-compute[71731]:  {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:26:10 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb2c60ec-fb52-436f-a98a-dfe15d1e3aa6 -p 172.16.0.220:3260 --interface default --op new {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:26:10 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb2c60ec-fb52-436f-a98a-dfe15d1e3aa6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:26:10 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[29361c38-efa3-4083-a376-afd893dff224]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:eb2c60ec-fb52-436f-a98a-dfe15d1e3aa6] added\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:26:10 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-97043357-b1f7-43b4-9364-c4cc8a068800 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:eb2c60ec-fb52-436f-a98a-dfe15d1e3aa6] added
Apr 13 16:26:10 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:26:10 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb2c60ec-fb52-436f-a98a-dfe15d1e3aa6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:26:10 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb2c60ec-fb52-436f-a98a-dfe15d1e3aa6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:26:10 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[09e49994-fb36-46b7-824b-a4dbc03e9a18]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:26:10 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-97043357-b1f7-43b4-9364-c4cc8a068800 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:26:10 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb2c60ec-fb52-436f-a98a-dfe15d1e3aa6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:26:10 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb2c60ec-fb52-436f-a98a-dfe15d1e3aa6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:26:10 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[636b3805-ffb4-422e-954e-ea083c55eb7a]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:26:10 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-97043357-b1f7-43b4-9364-c4cc8a068800 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:26:10 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb2c60ec-fb52-436f-a98a-dfe15d1e3aa6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gzcNiTHC {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:26:10 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb2c60ec-fb52-436f-a98a-dfe15d1e3aa6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gzcNiTHC" returned: 0 in 0.021s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:26:10 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[328f4cd1-dd2e-465e-8d25-09437123743d]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:26:10 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-97043357-b1f7-43b4-9364-c4cc8a068800 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gzcNiTHC'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:26:10 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb2c60ec-fb52-436f-a98a-dfe15d1e3aa6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:26:10 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbcccf4b-e861-4254-9be3-a491776214e9/disk.rescue --force-share --output=json" returned: 0 in 0.143s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:26:10 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eaae47b9-a059-49f6-9ae6-d7147003e2f2/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:26:10 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb2c60ec-fb52-436f-a98a-dfe15d1e3aa6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:26:10 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[17ac5497-dfa9-4aa0-9f74-71176be3ab36]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:26:10 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-97043357-b1f7-43b4-9364-c4cc8a068800 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:26:10 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:26:10 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:26:10 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[84c86aed-d4f5-4af1-8fd4-0da501a51d95]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc7649d3-fc59-438d-b230-72c4ce61e722 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4317bfd-71c2-4c48-a0f0-e3c795f262a8 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984 (non-flash)\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:26:10 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-97043357-b1f7-43b4-9364-c4cc8a068800 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)
Apr 13 16:26:10 user nova-compute[71731]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc7649d3-fc59-438d-b230-72c4ce61e722 (non-flash)
Apr 13 16:26:10 user nova-compute[71731]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4317bfd-71c2-4c48-a0f0-e3c795f262a8 (non-flash)
Apr 13 16:26:10 user nova-compute[71731]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984 (non-flash)
Apr 13 16:26:10 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 16:26:10 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-97043357-b1f7-43b4-9364-c4cc8a068800 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)
Apr 13 16:26:10 user nova-compute[71731]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc7649d3-fc59-438d-b230-72c4ce61e722 (non-flash)
Apr 13 16:26:10 user nova-compute[71731]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4317bfd-71c2-4c48-a0f0-e3c795f262a8 (non-flash)
Apr 13 16:26:10 user nova-compute[71731]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984 (non-flash)
Apr 13 16:26:10 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 16:26:10 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb2c60ec-fb52-436f-a98a-dfe15d1e3aa6 -p 172.16.0.220:3260 --login {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:26:10 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb2c60ec-fb52-436f-a98a-dfe15d1e3aa6 -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:26:10 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc1a1336-628b-4143-aa2b-2b52288c867b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:eb2c60ec-fb52-436f-a98a-dfe15d1e3aa6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:eb2c60ec-fb52-436f-a98a-dfe15d1e3aa6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:26:10 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-97043357-b1f7-43b4-9364-c4cc8a068800 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:eb2c60ec-fb52-436f-a98a-dfe15d1e3aa6, portal: 172.16.0.220,3260]
Apr 13 16:26:10 user nova-compute[71731]: Login to [iface: default, target: iqn.2010-10.org.openstack:eb2c60ec-fb52-436f-a98a-dfe15d1e3aa6, portal: 172.16.0.220,3260] successful.
Apr 13 16:26:10 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:26:10 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eaae47b9-a059-49f6-9ae6-d7147003e2f2/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:26:10 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eaae47b9-a059-49f6-9ae6-d7147003e2f2/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:26:10 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb2c60ec-fb52-436f-a98a-dfe15d1e3aa6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:26:10 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb2c60ec-fb52-436f-a98a-dfe15d1e3aa6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:26:11 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[08c8c43f-7879-4937-981d-c123229c16a4]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:26:11 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-97043357-b1f7-43b4-9364-c4cc8a068800 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:26:11 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:26:11 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:26:11 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2f29334-78bc-47d1-93d8-06b14420a707]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc7649d3-fc59-438d-b230-72c4ce61e722 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4317bfd-71c2-4c48-a0f0-e3c795f262a8 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb2c60ec-fb52-436f-a98a-dfe15d1e3aa6 (non-flash)\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:26:11 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-97043357-b1f7-43b4-9364-c4cc8a068800 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)
Apr 13 16:26:11 user nova-compute[71731]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc7649d3-fc59-438d-b230-72c4ce61e722 (non-flash)
Apr 13 16:26:11 user nova-compute[71731]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4317bfd-71c2-4c48-a0f0-e3c795f262a8 (non-flash)
Apr 13 16:26:11 user nova-compute[71731]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984 (non-flash)
Apr 13 16:26:11 user nova-compute[71731]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb2c60ec-fb52-436f-a98a-dfe15d1e3aa6 (non-flash)
Apr 13 16:26:11 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 16:26:11 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-97043357-b1f7-43b4-9364-c4cc8a068800 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)
Apr 13 16:26:11 user nova-compute[71731]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc7649d3-fc59-438d-b230-72c4ce61e722 (non-flash)
Apr 13 16:26:11 user nova-compute[71731]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4317bfd-71c2-4c48-a0f0-e3c795f262a8 (non-flash)
Apr 13 16:26:11 user nova-compute[71731]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984 (non-flash)
Apr 13 16:26:11 user nova-compute[71731]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb2c60ec-fb52-436f-a98a-dfe15d1e3aa6 (non-flash)
Apr 13 16:26:11 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 16:26:11 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-97043357-b1f7-43b4-9364-c4cc8a068800 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eb2c60ec-fb52-436f-a98a-dfe15d1e3aa6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.366s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 16:26:11 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-97043357-b1f7-43b4-9364-c4cc8a068800 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Connected to 172.16.0.220:3260 {{(pid=71731) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 16:26:11 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-97043357-b1f7-43b4-9364-c4cc8a068800 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] HCTL ('37', '-', '-', 0) found on session 21 with lun 0 {{(pid=71731) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 16:26:11 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-97043357-b1f7-43b4-9364-c4cc8a068800 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=71731) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 16:26:11 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:26:11 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.020s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:26:11 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5646276-fd67-488a-b673-b624f374a6b5]: (4, ('- - 0', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:26:11 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-97043357-b1f7-43b4-9364-c4cc8a068800 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Searching for a device in session 21 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=71731) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 16:26:11 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-97043357-b1f7-43b4-9364-c4cc8a068800 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:eb2c60ec-fb52-436f-a98a-dfe15d1e3aa6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gzcNiTHC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71731) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 16:26:11 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eaae47b9-a059-49f6-9ae6-d7147003e2f2/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:26:11 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71731) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 16:26:11 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/235f827c-7116-48e9-84c5-0c9761c18e1e/disk.rescue --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:26:11 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/235f827c-7116-48e9-84c5-0c9761c18e1e/disk.rescue --force-share --output=json" returned: 0 in 0.135s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:26:11 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/235f827c-7116-48e9-84c5-0c9761c18e1e/disk.rescue --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:26:11 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/235f827c-7116-48e9-84c5-0c9761c18e1e/disk.rescue --force-share --output=json" returned: 0 in 0.138s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:26:11 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5db1cb51-2e5a-46c9-8914-cba759a96a65/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:26:11 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:26:11 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5db1cb51-2e5a-46c9-8914-cba759a96a65/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:26:11 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5db1cb51-2e5a-46c9-8914-cba759a96a65/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:26:11 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5db1cb51-2e5a-46c9-8914-cba759a96a65/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:26:11 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/902e4077-e0d6-4b61-a861-883be253f1e0/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:26:11 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/902e4077-e0d6-4b61-a861-883be253f1e0/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:26:11 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/902e4077-e0d6-4b61-a861-883be253f1e0/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:26:12 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/902e4077-e0d6-4b61-a861-883be253f1e0/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:26:12 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:26:12 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-97043357-b1f7-43b4-9364-c4cc8a068800 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.807s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 16:26:12 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-97043357-b1f7-43b4-9364-c4cc8a068800 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] <== connect_volume: return (1809ms) {'type': 'block', 'scsi_wwn': '23533306532666562', 'path': '/dev/sdf'} {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 16:26:12 user nova-compute[71731]: DEBUG nova.virt.libvirt.volume.iscsi [None req-97043357-b1f7-43b4-9364-c4cc8a068800 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] [instance: eaae47b9-a059-49f6-9ae6-d7147003e2f2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23533306532666562', 'path': '/dev/sdf'} {{(pid=71731) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 16:26:12 user nova-compute[71731]: WARNING nova.virt.libvirt.driver [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 16:26:12 user nova-compute[71731]: WARNING nova.virt.libvirt.driver [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 16:26:12 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Hypervisor/Node resource view: name=user free_ram=7421MB free_disk=26.201602935791016GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71731) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 16:26:12 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:26:12 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:26:12 user nova-compute[71731]: DEBUG nova.objects.instance [None req-97043357-b1f7-43b4-9364-c4cc8a068800 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lazy-loading 'flavor' on Instance uuid eaae47b9-a059-49f6-9ae6-d7147003e2f2 {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:26:12 user nova-compute[71731]: DEBUG nova.virt.libvirt.guest [None req-97043357-b1f7-43b4-9364-c4cc8a068800 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] attach device xml: <disk type="block" device="disk">
Apr 13 16:26:12 user nova-compute[71731]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 16:26:12 user nova-compute[71731]:   <source dev="/dev/sdf"/>
Apr 13 16:26:12 user nova-compute[71731]:   <target dev="vdb" bus="virtio"/>
Apr 13 16:26:12 user nova-compute[71731]:   <serial>eb2c60ec-fb52-436f-a98a-dfe15d1e3aa6</serial>
Apr 13 16:26:12 user nova-compute[71731]: </disk>
Apr 13 16:26:12 user nova-compute[71731]:  {{(pid=71731) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 13 16:26:12 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance 7973e93b-6311-44ed-91ff-e861c32d0277 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 16:26:12 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance f66553f5-5e1b-4f1d-8c5a-63bc340f7586 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 16:26:12 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance bbcccf4b-e861-4254-9be3-a491776214e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 16:26:12 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance 5db1cb51-2e5a-46c9-8914-cba759a96a65 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 16:26:12 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance 235f827c-7116-48e9-84c5-0c9761c18e1e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 16:26:12 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance acbcaee0-a47b-4fee-8765-9b1c9597d515 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 16:26:12 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance eaae47b9-a059-49f6-9ae6-d7147003e2f2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 16:26:12 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance 902e4077-e0d6-4b61-a861-883be253f1e0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 16:26:12 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance 5ea4ab6a-6501-4a2f-a8f7-04090024747d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 16:26:12 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance bf350da4-9cc2-4900-adf0-506e44984b42 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 16:26:12 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=71731) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 16:26:12 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Final resource view: name=user phys_ram=16023MB used_ram=1792MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=71731) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 16:26:12 user nova-compute[71731]: INFO nova.compute.manager [None req-e83afce1-3de8-4fe3-8a8f-7caf8fcca63a tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] [instance: bbcccf4b-e861-4254-9be3-a491776214e9] Unrescuing
Apr 13 16:26:12 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-e83afce1-3de8-4fe3-8a8f-7caf8fcca63a tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Acquiring lock "refresh_cache-bbcccf4b-e861-4254-9be3-a491776214e9" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 16:26:12 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-e83afce1-3de8-4fe3-8a8f-7caf8fcca63a tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Acquired lock "refresh_cache-bbcccf4b-e861-4254-9be3-a491776214e9" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 16:26:12 user nova-compute[71731]: DEBUG nova.network.neutron [None req-e83afce1-3de8-4fe3-8a8f-7caf8fcca63a tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] [instance: bbcccf4b-e861-4254-9be3-a491776214e9] Building network info cache for instance {{(pid=71731) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 16:26:12 user nova-compute[71731]: DEBUG nova.compute.provider_tree [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Inventory has not changed in ProviderTree for provider: cb6b1a64-0c24-4e2d-af1e-16576ca9165c {{(pid=71731) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 16:26:12 user nova-compute[71731]: DEBUG nova.scheduler.client.report [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Inventory has not changed for provider cb6b1a64-0c24-4e2d-af1e-16576ca9165c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71731) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 16:26:12 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-97043357-b1f7-43b4-9364-c4cc8a068800 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] No BDM found with device name vda, not building metadata. {{(pid=71731) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 16:26:12 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-97043357-b1f7-43b4-9364-c4cc8a068800 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71731) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 16:26:12 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-97043357-b1f7-43b4-9364-c4cc8a068800 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] No VIF found with MAC fa:16:3e:ff:85:92, not building metadata {{(pid=71731) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 16:26:13 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Compute_service record updated for user:user {{(pid=71731) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 16:26:13 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.515s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:26:13 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-97043357-b1f7-43b4-9364-c4cc8a068800 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lock "eaae47b9-a059-49f6-9ae6-d7147003e2f2" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.412s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:26:13 user nova-compute[71731]: DEBUG nova.network.neutron [None req-e83afce1-3de8-4fe3-8a8f-7caf8fcca63a tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] [instance: bbcccf4b-e861-4254-9be3-a491776214e9] Updating instance_info_cache with network_info: [{"id": "dbb2bf27-5de3-499c-ba4d-87867912a143", "address": "fa:16:3e:a3:40:f4", "network": {"id": "5a4fe0b3-5f2f-4125-a17d-e2ff424bf01a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1835633180-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.81", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7061f2f041954ffe90b0c87b422890e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbb2bf27-5d", "ovs_interfaceid": "dbb2bf27-5de3-499c-ba4d-87867912a143", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:26:13 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-e83afce1-3de8-4fe3-8a8f-7caf8fcca63a tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Releasing lock "refresh_cache-bbcccf4b-e861-4254-9be3-a491776214e9" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 16:26:13 user nova-compute[71731]: DEBUG nova.objects.instance [None req-e83afce1-3de8-4fe3-8a8f-7caf8fcca63a tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Lazy-loading 'flavor' on Instance uuid bbcccf4b-e861-4254-9be3-a491776214e9 {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:26:13 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:26:13 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:26:13 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:26:13 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:26:13 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:26:13 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-0b82c558-eb2f-48eb-a53e-8c3dc2924275 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Acquiring lock "eaae47b9-a059-49f6-9ae6-d7147003e2f2" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:26:13 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-0b82c558-eb2f-48eb-a53e-8c3dc2924275 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lock "eaae47b9-a059-49f6-9ae6-d7147003e2f2" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:26:13 user nova-compute[71731]: DEBUG nova.compute.manager [None req-0b82c558-eb2f-48eb-a53e-8c3dc2924275 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] [instance: eaae47b9-a059-49f6-9ae6-d7147003e2f2] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:26:13 user nova-compute[71731]: DEBUG nova.compute.manager [None req-0b82c558-eb2f-48eb-a53e-8c3dc2924275 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] [instance: eaae47b9-a059-49f6-9ae6-d7147003e2f2] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=71731) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3323}}
Apr 13 16:26:13 user nova-compute[71731]: DEBUG nova.objects.instance [None req-0b82c558-eb2f-48eb-a53e-8c3dc2924275 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lazy-loading 'flavor' on Instance uuid eaae47b9-a059-49f6-9ae6-d7147003e2f2 {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:26:13 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:26:13 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:26:13 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:26:13 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:26:13 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:26:14 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:26:14 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:26:14 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Starting heal instance info cache {{(pid=71731) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 16:26:14 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Rebuilding the list of instances to heal {{(pid=71731) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 13 16:26:14 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Acquiring lock "refresh_cache-7973e93b-6311-44ed-91ff-e861c32d0277" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 16:26:14 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Acquired lock "refresh_cache-7973e93b-6311-44ed-91ff-e861c32d0277" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 16:26:14 user nova-compute[71731]: DEBUG nova.network.neutron [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] [instance: 7973e93b-6311-44ed-91ff-e861c32d0277] Forcefully refreshing network info cache for instance {{(pid=71731) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 16:26:14 user nova-compute[71731]: DEBUG nova.objects.instance [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lazy-loading 'info_cache' on Instance uuid 7973e93b-6311-44ed-91ff-e861c32d0277 {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:26:14 user nova-compute[71731]: DEBUG nova.compute.manager [req-278d08ad-8196-4cc1-a061-af62e30485e7 req-7a37c9b5-77ff-4d8e-8f4d-9a2d654e5dbd service nova] [instance: bbcccf4b-e861-4254-9be3-a491776214e9] Received event network-vif-unplugged-dbb2bf27-5de3-499c-ba4d-87867912a143 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:26:14 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-278d08ad-8196-4cc1-a061-af62e30485e7 req-7a37c9b5-77ff-4d8e-8f4d-9a2d654e5dbd service nova] Acquiring lock "bbcccf4b-e861-4254-9be3-a491776214e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:26:14 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-278d08ad-8196-4cc1-a061-af62e30485e7 req-7a37c9b5-77ff-4d8e-8f4d-9a2d654e5dbd service nova] Lock "bbcccf4b-e861-4254-9be3-a491776214e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:26:14 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-278d08ad-8196-4cc1-a061-af62e30485e7 req-7a37c9b5-77ff-4d8e-8f4d-9a2d654e5dbd service nova] Lock "bbcccf4b-e861-4254-9be3-a491776214e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:26:14 user nova-compute[71731]: DEBUG nova.compute.manager [req-278d08ad-8196-4cc1-a061-af62e30485e7 req-7a37c9b5-77ff-4d8e-8f4d-9a2d654e5dbd service nova] [instance: bbcccf4b-e861-4254-9be3-a491776214e9] No waiting events found dispatching network-vif-unplugged-dbb2bf27-5de3-499c-ba4d-87867912a143 {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:26:14 user nova-compute[71731]: WARNING nova.compute.manager [req-278d08ad-8196-4cc1-a061-af62e30485e7 req-7a37c9b5-77ff-4d8e-8f4d-9a2d654e5dbd service nova] [instance: bbcccf4b-e861-4254-9be3-a491776214e9] Received unexpected event network-vif-unplugged-dbb2bf27-5de3-499c-ba4d-87867912a143 for instance with vm_state rescued and task_state unrescuing.
Apr 13 16:26:14 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:26:14 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:26:14 user nova-compute[71731]: INFO nova.virt.libvirt.driver [-] [instance: bbcccf4b-e861-4254-9be3-a491776214e9] Instance destroyed successfully.
Apr 13 16:26:14 user nova-compute[71731]: INFO nova.virt.libvirt.driver [-] [instance: eaae47b9-a059-49f6-9ae6-d7147003e2f2] Instance destroyed successfully.
Apr 13 16:26:14 user nova-compute[71731]: DEBUG nova.compute.manager [None req-0b82c558-eb2f-48eb-a53e-8c3dc2924275 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] [instance: eaae47b9-a059-49f6-9ae6-d7147003e2f2] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:26:14 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-0b82c558-eb2f-48eb-a53e-8c3dc2924275 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lock "eaae47b9-a059-49f6-9ae6-d7147003e2f2" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 1.141s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:26:14 user nova-compute[71731]: DEBUG nova.network.neutron [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] [instance: 7973e93b-6311-44ed-91ff-e861c32d0277] Updating instance_info_cache with network_info: [{"id": "8ae83a6c-4fc7-4e2c-8f83-7aece5c239cd", "address": "fa:16:3e:db:b9:e8", "network": {"id": "ae7f770e-a460-4297-91b5-ed0b908a895a", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1175970469-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5554aa7f1b4d471b8807a845ab1ea33f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ae83a6c-4f", "ovs_interfaceid": "8ae83a6c-4fc7-4e2c-8f83-7aece5c239cd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:26:14 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Releasing lock "refresh_cache-7973e93b-6311-44ed-91ff-e861c32d0277" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 16:26:14 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] [instance: 7973e93b-6311-44ed-91ff-e861c32d0277] Updated the network info_cache for instance {{(pid=71731) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 16:26:14 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:26:14 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:26:14 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:26:14 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:26:14 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71731) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 16:26:15 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:26:15 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:26:15 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:26:15 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:26:15 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:26:16 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:26:16 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:26:16 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:26:16 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Cleaning up deleted instances with incomplete migration  {{(pid=71731) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 13 16:26:16 user nova-compute[71731]: DEBUG nova.compute.manager [req-1c5a23d8-b721-46d6-9214-f0013c0ec9e2 req-251c27a3-11e4-4870-80fd-c0645c1238da service nova] [instance: bbcccf4b-e861-4254-9be3-a491776214e9] Received event network-changed-dbb2bf27-5de3-499c-ba4d-87867912a143 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:26:16 user nova-compute[71731]: DEBUG nova.compute.manager [req-1c5a23d8-b721-46d6-9214-f0013c0ec9e2 req-251c27a3-11e4-4870-80fd-c0645c1238da service nova] [instance: bbcccf4b-e861-4254-9be3-a491776214e9] Refreshing instance network info cache due to event network-changed-dbb2bf27-5de3-499c-ba4d-87867912a143. {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 16:26:16 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-1c5a23d8-b721-46d6-9214-f0013c0ec9e2 req-251c27a3-11e4-4870-80fd-c0645c1238da service nova] Acquiring lock "refresh_cache-bbcccf4b-e861-4254-9be3-a491776214e9" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 16:26:16 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-1c5a23d8-b721-46d6-9214-f0013c0ec9e2 req-251c27a3-11e4-4870-80fd-c0645c1238da service nova] Acquired lock "refresh_cache-bbcccf4b-e861-4254-9be3-a491776214e9" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 16:26:16 user nova-compute[71731]: DEBUG nova.network.neutron [req-1c5a23d8-b721-46d6-9214-f0013c0ec9e2 req-251c27a3-11e4-4870-80fd-c0645c1238da service nova] [instance: bbcccf4b-e861-4254-9be3-a491776214e9] Refreshing network info cache for port dbb2bf27-5de3-499c-ba4d-87867912a143 {{(pid=71731) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 16:26:16 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:26:16 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:26:16 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:26:16 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:26:17 user nova-compute[71731]: DEBUG nova.network.neutron [req-1c5a23d8-b721-46d6-9214-f0013c0ec9e2 req-251c27a3-11e4-4870-80fd-c0645c1238da service nova] [instance: bbcccf4b-e861-4254-9be3-a491776214e9] Updated VIF entry in instance network info cache for port dbb2bf27-5de3-499c-ba4d-87867912a143. {{(pid=71731) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 16:26:17 user nova-compute[71731]: DEBUG nova.network.neutron [req-1c5a23d8-b721-46d6-9214-f0013c0ec9e2 req-251c27a3-11e4-4870-80fd-c0645c1238da service nova] [instance: bbcccf4b-e861-4254-9be3-a491776214e9] Updating instance_info_cache with network_info: [{"id": "dbb2bf27-5de3-499c-ba4d-87867912a143", "address": "fa:16:3e:a3:40:f4", "network": {"id": "5a4fe0b3-5f2f-4125-a17d-e2ff424bf01a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1835633180-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.81", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7061f2f041954ffe90b0c87b422890e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbb2bf27-5d", "ovs_interfaceid": "dbb2bf27-5de3-499c-ba4d-87867912a143", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:26:17 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-1c5a23d8-b721-46d6-9214-f0013c0ec9e2 req-251c27a3-11e4-4870-80fd-c0645c1238da service nova] Releasing lock "refresh_cache-bbcccf4b-e861-4254-9be3-a491776214e9" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 16:26:17 user nova-compute[71731]: DEBUG nova.compute.manager [req-1c5a23d8-b721-46d6-9214-f0013c0ec9e2 req-251c27a3-11e4-4870-80fd-c0645c1238da service nova] [instance: bbcccf4b-e861-4254-9be3-a491776214e9] Received event network-vif-plugged-dbb2bf27-5de3-499c-ba4d-87867912a143 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:26:17 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-1c5a23d8-b721-46d6-9214-f0013c0ec9e2 req-251c27a3-11e4-4870-80fd-c0645c1238da service nova] Acquiring lock "bbcccf4b-e861-4254-9be3-a491776214e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:26:17 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-1c5a23d8-b721-46d6-9214-f0013c0ec9e2 req-251c27a3-11e4-4870-80fd-c0645c1238da service nova] Lock "bbcccf4b-e861-4254-9be3-a491776214e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:26:17 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-1c5a23d8-b721-46d6-9214-f0013c0ec9e2 req-251c27a3-11e4-4870-80fd-c0645c1238da service nova] Lock "bbcccf4b-e861-4254-9be3-a491776214e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:26:17 user nova-compute[71731]: DEBUG nova.compute.manager [req-1c5a23d8-b721-46d6-9214-f0013c0ec9e2 req-251c27a3-11e4-4870-80fd-c0645c1238da service nova] [instance: bbcccf4b-e861-4254-9be3-a491776214e9] No waiting events found dispatching network-vif-plugged-dbb2bf27-5de3-499c-ba4d-87867912a143 {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:26:17 user nova-compute[71731]: WARNING nova.compute.manager [req-1c5a23d8-b721-46d6-9214-f0013c0ec9e2 req-251c27a3-11e4-4870-80fd-c0645c1238da service nova] [instance: bbcccf4b-e861-4254-9be3-a491776214e9] Received unexpected event network-vif-plugged-dbb2bf27-5de3-499c-ba4d-87867912a143 for instance with vm_state rescued and task_state unrescuing.
Apr 13 16:26:17 user nova-compute[71731]: DEBUG nova.compute.manager [req-1c5a23d8-b721-46d6-9214-f0013c0ec9e2 req-251c27a3-11e4-4870-80fd-c0645c1238da service nova] [instance: bbcccf4b-e861-4254-9be3-a491776214e9] Received event network-changed-dbb2bf27-5de3-499c-ba4d-87867912a143 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:26:17 user nova-compute[71731]: DEBUG nova.compute.manager [req-1c5a23d8-b721-46d6-9214-f0013c0ec9e2 req-251c27a3-11e4-4870-80fd-c0645c1238da service nova] [instance: bbcccf4b-e861-4254-9be3-a491776214e9] Refreshing instance network info cache due to event network-changed-dbb2bf27-5de3-499c-ba4d-87867912a143. {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 16:26:17 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-1c5a23d8-b721-46d6-9214-f0013c0ec9e2 req-251c27a3-11e4-4870-80fd-c0645c1238da service nova] Acquiring lock "refresh_cache-bbcccf4b-e861-4254-9be3-a491776214e9" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 16:26:17 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-1c5a23d8-b721-46d6-9214-f0013c0ec9e2 req-251c27a3-11e4-4870-80fd-c0645c1238da service nova] Acquired lock "refresh_cache-bbcccf4b-e861-4254-9be3-a491776214e9" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 16:26:17 user nova-compute[71731]: DEBUG nova.network.neutron [req-1c5a23d8-b721-46d6-9214-f0013c0ec9e2 req-251c27a3-11e4-4870-80fd-c0645c1238da service nova] [instance: bbcccf4b-e861-4254-9be3-a491776214e9] Refreshing network info cache for port dbb2bf27-5de3-499c-ba4d-87867912a143 {{(pid=71731) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 16:26:17 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:26:17 user nova-compute[71731]: DEBUG nova.network.neutron [req-1c5a23d8-b721-46d6-9214-f0013c0ec9e2 req-251c27a3-11e4-4870-80fd-c0645c1238da service nova] [instance: bbcccf4b-e861-4254-9be3-a491776214e9] Updated VIF entry in instance network info cache for port dbb2bf27-5de3-499c-ba4d-87867912a143. {{(pid=71731) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 16:26:17 user nova-compute[71731]: DEBUG nova.network.neutron [req-1c5a23d8-b721-46d6-9214-f0013c0ec9e2 req-251c27a3-11e4-4870-80fd-c0645c1238da service nova] [instance: bbcccf4b-e861-4254-9be3-a491776214e9] Updating instance_info_cache with network_info: [{"id": "dbb2bf27-5de3-499c-ba4d-87867912a143", "address": "fa:16:3e:a3:40:f4", "network": {"id": "5a4fe0b3-5f2f-4125-a17d-e2ff424bf01a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1835633180-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.81", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7061f2f041954ffe90b0c87b422890e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbb2bf27-5d", "ovs_interfaceid": "dbb2bf27-5de3-499c-ba4d-87867912a143", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:26:17 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-1c5a23d8-b721-46d6-9214-f0013c0ec9e2 req-251c27a3-11e4-4870-80fd-c0645c1238da service nova] Releasing lock "refresh_cache-bbcccf4b-e861-4254-9be3-a491776214e9" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 16:26:17 user nova-compute[71731]: DEBUG nova.compute.manager [req-1c5a23d8-b721-46d6-9214-f0013c0ec9e2 req-251c27a3-11e4-4870-80fd-c0645c1238da service nova] [instance: eaae47b9-a059-49f6-9ae6-d7147003e2f2] Received event network-vif-unplugged-e9b2fcaa-f77b-4e5c-ad3c-797ce804a9ae {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:26:17 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-1c5a23d8-b721-46d6-9214-f0013c0ec9e2 req-251c27a3-11e4-4870-80fd-c0645c1238da service nova] Acquiring lock "eaae47b9-a059-49f6-9ae6-d7147003e2f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:26:17 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-1c5a23d8-b721-46d6-9214-f0013c0ec9e2 req-251c27a3-11e4-4870-80fd-c0645c1238da service nova] Lock "eaae47b9-a059-49f6-9ae6-d7147003e2f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:26:17 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-1c5a23d8-b721-46d6-9214-f0013c0ec9e2 req-251c27a3-11e4-4870-80fd-c0645c1238da service nova] Lock "eaae47b9-a059-49f6-9ae6-d7147003e2f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:26:17 user nova-compute[71731]: DEBUG nova.compute.manager [req-1c5a23d8-b721-46d6-9214-f0013c0ec9e2 req-251c27a3-11e4-4870-80fd-c0645c1238da service nova] [instance: eaae47b9-a059-49f6-9ae6-d7147003e2f2] No waiting events found dispatching network-vif-unplugged-e9b2fcaa-f77b-4e5c-ad3c-797ce804a9ae {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:26:17 user nova-compute[71731]: WARNING nova.compute.manager [req-1c5a23d8-b721-46d6-9214-f0013c0ec9e2 req-251c27a3-11e4-4870-80fd-c0645c1238da service nova] [instance: eaae47b9-a059-49f6-9ae6-d7147003e2f2] Received unexpected event network-vif-unplugged-e9b2fcaa-f77b-4e5c-ad3c-797ce804a9ae for instance with vm_state stopped and task_state None.
Apr 13 16:26:17 user nova-compute[71731]: DEBUG nova.compute.manager [req-1c5a23d8-b721-46d6-9214-f0013c0ec9e2 req-251c27a3-11e4-4870-80fd-c0645c1238da service nova] [instance: eaae47b9-a059-49f6-9ae6-d7147003e2f2] Received event network-vif-plugged-e9b2fcaa-f77b-4e5c-ad3c-797ce804a9ae {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:26:17 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-1c5a23d8-b721-46d6-9214-f0013c0ec9e2 req-251c27a3-11e4-4870-80fd-c0645c1238da service nova] Acquiring lock "eaae47b9-a059-49f6-9ae6-d7147003e2f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:26:17 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-1c5a23d8-b721-46d6-9214-f0013c0ec9e2 req-251c27a3-11e4-4870-80fd-c0645c1238da service nova] Lock "eaae47b9-a059-49f6-9ae6-d7147003e2f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:26:17 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-1c5a23d8-b721-46d6-9214-f0013c0ec9e2 req-251c27a3-11e4-4870-80fd-c0645c1238da service nova] Lock "eaae47b9-a059-49f6-9ae6-d7147003e2f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:26:17 user nova-compute[71731]: DEBUG nova.compute.manager [req-1c5a23d8-b721-46d6-9214-f0013c0ec9e2 req-251c27a3-11e4-4870-80fd-c0645c1238da service nova] [instance: eaae47b9-a059-49f6-9ae6-d7147003e2f2] No waiting events found dispatching network-vif-plugged-e9b2fcaa-f77b-4e5c-ad3c-797ce804a9ae {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:26:17 user nova-compute[71731]: WARNING nova.compute.manager [req-1c5a23d8-b721-46d6-9214-f0013c0ec9e2 req-251c27a3-11e4-4870-80fd-c0645c1238da service nova] [instance: eaae47b9-a059-49f6-9ae6-d7147003e2f2] Received unexpected event network-vif-plugged-e9b2fcaa-f77b-4e5c-ad3c-797ce804a9ae for instance with vm_state stopped and task_state None.
Apr 13 16:26:17 user nova-compute[71731]: DEBUG nova.compute.manager [req-1c5a23d8-b721-46d6-9214-f0013c0ec9e2 req-251c27a3-11e4-4870-80fd-c0645c1238da service nova] [instance: bbcccf4b-e861-4254-9be3-a491776214e9] Received event network-vif-plugged-dbb2bf27-5de3-499c-ba4d-87867912a143 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:26:17 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-1c5a23d8-b721-46d6-9214-f0013c0ec9e2 req-251c27a3-11e4-4870-80fd-c0645c1238da service nova] Acquiring lock "bbcccf4b-e861-4254-9be3-a491776214e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:26:17 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-1c5a23d8-b721-46d6-9214-f0013c0ec9e2 req-251c27a3-11e4-4870-80fd-c0645c1238da service nova] Lock "bbcccf4b-e861-4254-9be3-a491776214e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:26:17 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-1c5a23d8-b721-46d6-9214-f0013c0ec9e2 req-251c27a3-11e4-4870-80fd-c0645c1238da service nova] Lock "bbcccf4b-e861-4254-9be3-a491776214e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:26:17 user nova-compute[71731]: DEBUG nova.compute.manager [req-1c5a23d8-b721-46d6-9214-f0013c0ec9e2 req-251c27a3-11e4-4870-80fd-c0645c1238da service nova] [instance: bbcccf4b-e861-4254-9be3-a491776214e9] No waiting events found dispatching network-vif-plugged-dbb2bf27-5de3-499c-ba4d-87867912a143 {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:26:17 user nova-compute[71731]: WARNING nova.compute.manager [req-1c5a23d8-b721-46d6-9214-f0013c0ec9e2 req-251c27a3-11e4-4870-80fd-c0645c1238da service nova] [instance: bbcccf4b-e861-4254-9be3-a491776214e9] Received unexpected event network-vif-plugged-dbb2bf27-5de3-499c-ba4d-87867912a143 for instance with vm_state rescued and task_state unrescuing.
Apr 13 16:26:18 user nova-compute[71731]: DEBUG nova.virt.libvirt.host [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Removed pending event for bbcccf4b-e861-4254-9be3-a491776214e9 due to event {{(pid=71731) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 13 16:26:18 user nova-compute[71731]: DEBUG nova.virt.driver [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Emitting event <LifecycleEvent: 1681403178.2329779, bbcccf4b-e861-4254-9be3-a491776214e9 => Resumed> {{(pid=71731) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 16:26:18 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: bbcccf4b-e861-4254-9be3-a491776214e9] VM Resumed (Lifecycle Event)
Apr 13 16:26:18 user nova-compute[71731]: DEBUG nova.compute.manager [None req-e83afce1-3de8-4fe3-8a8f-7caf8fcca63a tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] [instance: bbcccf4b-e861-4254-9be3-a491776214e9] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:26:18 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: bbcccf4b-e861-4254-9be3-a491776214e9] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:26:18 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: bbcccf4b-e861-4254-9be3-a491776214e9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71731) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 16:26:18 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: bbcccf4b-e861-4254-9be3-a491776214e9] During sync_power_state the instance has a pending task (unrescuing). Skip.
Apr 13 16:26:18 user nova-compute[71731]: DEBUG nova.virt.driver [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Emitting event <LifecycleEvent: 1681403178.235743, bbcccf4b-e861-4254-9be3-a491776214e9 => Started> {{(pid=71731) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 16:26:18 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: bbcccf4b-e861-4254-9be3-a491776214e9] VM Started (Lifecycle Event)
Apr 13 16:26:18 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: bbcccf4b-e861-4254-9be3-a491776214e9] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:26:18 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: bbcccf4b-e861-4254-9be3-a491776214e9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71731) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 16:26:18 user nova-compute[71731]: DEBUG nova.compute.manager [req-d9503520-f61f-4c78-8b44-752fac669b2d req-c62d80f2-3141-4bbd-8d12-8229f2e5263f service nova] [instance: bbcccf4b-e861-4254-9be3-a491776214e9] Received event network-vif-plugged-dbb2bf27-5de3-499c-ba4d-87867912a143 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:26:18 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-d9503520-f61f-4c78-8b44-752fac669b2d req-c62d80f2-3141-4bbd-8d12-8229f2e5263f service nova] Acquiring lock "bbcccf4b-e861-4254-9be3-a491776214e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:26:18 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-d9503520-f61f-4c78-8b44-752fac669b2d req-c62d80f2-3141-4bbd-8d12-8229f2e5263f service nova] Lock "bbcccf4b-e861-4254-9be3-a491776214e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:26:18 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-d9503520-f61f-4c78-8b44-752fac669b2d req-c62d80f2-3141-4bbd-8d12-8229f2e5263f service nova] Lock "bbcccf4b-e861-4254-9be3-a491776214e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:26:18 user nova-compute[71731]: DEBUG nova.compute.manager [req-d9503520-f61f-4c78-8b44-752fac669b2d req-c62d80f2-3141-4bbd-8d12-8229f2e5263f service nova] [instance: bbcccf4b-e861-4254-9be3-a491776214e9] No waiting events found dispatching network-vif-plugged-dbb2bf27-5de3-499c-ba4d-87867912a143 {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:26:18 user nova-compute[71731]: WARNING nova.compute.manager [req-d9503520-f61f-4c78-8b44-752fac669b2d req-c62d80f2-3141-4bbd-8d12-8229f2e5263f service nova] [instance: bbcccf4b-e861-4254-9be3-a491776214e9] Received unexpected event network-vif-plugged-dbb2bf27-5de3-499c-ba4d-87867912a143 for instance with vm_state rescued and task_state unrescuing.
Apr 13 16:26:21 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:26:22 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:26:24 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-f332ec71-46c6-43db-b9da-d15aeb8e5dd9 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Acquiring lock "5db1cb51-2e5a-46c9-8914-cba759a96a65" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:26:24 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-f332ec71-46c6-43db-b9da-d15aeb8e5dd9 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Lock "5db1cb51-2e5a-46c9-8914-cba759a96a65" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:26:24 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-f332ec71-46c6-43db-b9da-d15aeb8e5dd9 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Acquiring lock "5db1cb51-2e5a-46c9-8914-cba759a96a65-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:26:24 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-f332ec71-46c6-43db-b9da-d15aeb8e5dd9 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Lock "5db1cb51-2e5a-46c9-8914-cba759a96a65-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:26:24 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-f332ec71-46c6-43db-b9da-d15aeb8e5dd9 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Lock "5db1cb51-2e5a-46c9-8914-cba759a96a65-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:26:24 user nova-compute[71731]: INFO nova.compute.manager [None req-f332ec71-46c6-43db-b9da-d15aeb8e5dd9 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] [instance: 5db1cb51-2e5a-46c9-8914-cba759a96a65] Terminating instance
Apr 13 16:26:24 user nova-compute[71731]: DEBUG nova.compute.manager [None req-f332ec71-46c6-43db-b9da-d15aeb8e5dd9 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] [instance: 5db1cb51-2e5a-46c9-8914-cba759a96a65] Start destroying the instance on the hypervisor. {{(pid=71731) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 16:26:24 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:26:24 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:26:24 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:26:24 user nova-compute[71731]: DEBUG nova.compute.manager [req-f01ff4e2-daca-4ccf-9ef3-6fed951f0663 req-87111191-dfc9-4aad-815f-8db5b30a9394 service nova] [instance: 5db1cb51-2e5a-46c9-8914-cba759a96a65] Received event network-vif-unplugged-628a1eb7-e3f1-4158-9f9e-1ae752c91c0b {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:26:24 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-f01ff4e2-daca-4ccf-9ef3-6fed951f0663 req-87111191-dfc9-4aad-815f-8db5b30a9394 service nova] Acquiring lock "5db1cb51-2e5a-46c9-8914-cba759a96a65-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:26:24 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-f01ff4e2-daca-4ccf-9ef3-6fed951f0663 req-87111191-dfc9-4aad-815f-8db5b30a9394 service nova] Lock "5db1cb51-2e5a-46c9-8914-cba759a96a65-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:26:24 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-f01ff4e2-daca-4ccf-9ef3-6fed951f0663 req-87111191-dfc9-4aad-815f-8db5b30a9394 service nova] Lock "5db1cb51-2e5a-46c9-8914-cba759a96a65-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:26:24 user nova-compute[71731]: DEBUG nova.compute.manager [req-f01ff4e2-daca-4ccf-9ef3-6fed951f0663 req-87111191-dfc9-4aad-815f-8db5b30a9394 service nova] [instance: 5db1cb51-2e5a-46c9-8914-cba759a96a65] No waiting events found dispatching network-vif-unplugged-628a1eb7-e3f1-4158-9f9e-1ae752c91c0b {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:26:24 user nova-compute[71731]: DEBUG nova.compute.manager [req-f01ff4e2-daca-4ccf-9ef3-6fed951f0663 req-87111191-dfc9-4aad-815f-8db5b30a9394 service nova] [instance: 5db1cb51-2e5a-46c9-8914-cba759a96a65] Received event network-vif-unplugged-628a1eb7-e3f1-4158-9f9e-1ae752c91c0b for instance with task_state deleting. {{(pid=71731) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 16:26:24 user nova-compute[71731]: INFO nova.virt.libvirt.driver [-] [instance: 5db1cb51-2e5a-46c9-8914-cba759a96a65] Instance destroyed successfully.
Apr 13 16:26:24 user nova-compute[71731]: DEBUG nova.objects.instance [None req-f332ec71-46c6-43db-b9da-d15aeb8e5dd9 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Lazy-loading 'resources' on Instance uuid 5db1cb51-2e5a-46c9-8914-cba759a96a65 {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:26:24 user nova-compute[71731]: DEBUG nova.virt.libvirt.vif [None req-f332ec71-46c6-43db-b9da-d15aeb8e5dd9 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T16:20:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1388049835',display_name='tempest-VolumesAdminNegativeTest-server-1388049835',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1388049835',id=5,image_ref='708622a9-7465-4492-ade8-b827198f7e30',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAcOvpOD5XjPPEJeFEcW6dxrI654P1ODhBXDII4jBiB5VjoxGbdzMtmJtJGe2JCrSo8EqpecX3xdXT+1+dP2nisICumUhzMVEIQe7hihwBIVzLzKia+yvR9Rz6xcYWfvCw==',key_name='tempest-keypair-16668737',keypairs=<?>,launch_index=0,launched_at=2023-04-13T16:20:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5ded8a69b7e941f9bcdc502cfeed79db',ramdisk_id='',reservation_id='r-83vneq2g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='708622a9-7465-4492-ade8-b827198f7e30',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-694044578',owner_user_name='tempest-VolumesAdminNegativeTest-694044578-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T16:20:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='62cf399757f544649fed18ee5a31d50c',uuid=5db1cb51-2e5a-46c9-8914-cba759a96a65,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "628a1eb7-e3f1-4158-9f9e-1ae752c91c0b", "address": "fa:16:3e:fa:44:3c", "network": {"id": "fc7f5f86-d676-4a45-b0f4-c93f3eae043e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1421861184-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.129", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ded8a69b7e941f9bcdc502cfeed79db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap628a1eb7-e3", "ovs_interfaceid": "628a1eb7-e3f1-4158-9f9e-1ae752c91c0b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 16:26:24 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-f332ec71-46c6-43db-b9da-d15aeb8e5dd9 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Converting VIF {"id": "628a1eb7-e3f1-4158-9f9e-1ae752c91c0b", "address": "fa:16:3e:fa:44:3c", "network": {"id": "fc7f5f86-d676-4a45-b0f4-c93f3eae043e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1421861184-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.129", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ded8a69b7e941f9bcdc502cfeed79db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap628a1eb7-e3", "ovs_interfaceid": "628a1eb7-e3f1-4158-9f9e-1ae752c91c0b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 16:26:24 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-f332ec71-46c6-43db-b9da-d15aeb8e5dd9 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fa:44:3c,bridge_name='br-int',has_traffic_filtering=True,id=628a1eb7-e3f1-4158-9f9e-1ae752c91c0b,network=Network(fc7f5f86-d676-4a45-b0f4-c93f3eae043e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap628a1eb7-e3') {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 16:26:24 user nova-compute[71731]: DEBUG os_vif [None req-f332ec71-46c6-43db-b9da-d15aeb8e5dd9 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fa:44:3c,bridge_name='br-int',has_traffic_filtering=True,id=628a1eb7-e3f1-4158-9f9e-1ae752c91c0b,network=Network(fc7f5f86-d676-4a45-b0f4-c93f3eae043e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap628a1eb7-e3') {{(pid=71731) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 16:26:24 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:26:24 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap628a1eb7-e3, bridge=br-int, if_exists=True) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:26:24 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:26:24 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 16:26:24 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:26:24 user nova-compute[71731]: INFO os_vif [None req-f332ec71-46c6-43db-b9da-d15aeb8e5dd9 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fa:44:3c,bridge_name='br-int',has_traffic_filtering=True,id=628a1eb7-e3f1-4158-9f9e-1ae752c91c0b,network=Network(fc7f5f86-d676-4a45-b0f4-c93f3eae043e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap628a1eb7-e3')
Apr 13 16:26:24 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-f332ec71-46c6-43db-b9da-d15aeb8e5dd9 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] [instance: 5db1cb51-2e5a-46c9-8914-cba759a96a65] Deleting instance files /opt/stack/data/nova/instances/5db1cb51-2e5a-46c9-8914-cba759a96a65_del
Apr 13 16:26:24 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-f332ec71-46c6-43db-b9da-d15aeb8e5dd9 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] [instance: 5db1cb51-2e5a-46c9-8914-cba759a96a65] Deletion of /opt/stack/data/nova/instances/5db1cb51-2e5a-46c9-8914-cba759a96a65_del complete
Apr 13 16:26:25 user nova-compute[71731]: INFO nova.compute.manager [None req-f332ec71-46c6-43db-b9da-d15aeb8e5dd9 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] [instance: 5db1cb51-2e5a-46c9-8914-cba759a96a65] Took 0.89 seconds to destroy the instance on the hypervisor.
Apr 13 16:26:25 user nova-compute[71731]: DEBUG oslo.service.loopingcall [None req-f332ec71-46c6-43db-b9da-d15aeb8e5dd9 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71731) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 16:26:25 user nova-compute[71731]: DEBUG nova.compute.manager [-] [instance: 5db1cb51-2e5a-46c9-8914-cba759a96a65] Deallocating network for instance {{(pid=71731) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 16:26:25 user nova-compute[71731]: DEBUG nova.network.neutron [-] [instance: 5db1cb51-2e5a-46c9-8914-cba759a96a65] deallocate_for_instance() {{(pid=71731) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 16:26:25 user nova-compute[71731]: DEBUG nova.network.neutron [-] [instance: 5db1cb51-2e5a-46c9-8914-cba759a96a65] Updating instance_info_cache with network_info: [] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:26:25 user nova-compute[71731]: INFO nova.compute.manager [-] [instance: 5db1cb51-2e5a-46c9-8914-cba759a96a65] Took 0.86 seconds to deallocate network for instance.
Apr 13 16:26:25 user nova-compute[71731]: DEBUG nova.compute.manager [req-1b692761-54ba-44e1-9e2c-18312dad749f req-1b1489ed-f110-4906-9ad6-752125cfe3ea service nova] [instance: 5db1cb51-2e5a-46c9-8914-cba759a96a65] Received event network-vif-deleted-628a1eb7-e3f1-4158-9f9e-1ae752c91c0b {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:26:25 user nova-compute[71731]: INFO nova.compute.manager [req-1b692761-54ba-44e1-9e2c-18312dad749f req-1b1489ed-f110-4906-9ad6-752125cfe3ea service nova] [instance: 5db1cb51-2e5a-46c9-8914-cba759a96a65] Neutron deleted interface 628a1eb7-e3f1-4158-9f9e-1ae752c91c0b; detaching it from the instance and deleting it from the info cache
Apr 13 16:26:25 user nova-compute[71731]: DEBUG nova.network.neutron [req-1b692761-54ba-44e1-9e2c-18312dad749f req-1b1489ed-f110-4906-9ad6-752125cfe3ea service nova] [instance: 5db1cb51-2e5a-46c9-8914-cba759a96a65] Updating instance_info_cache with network_info: [] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:26:25 user nova-compute[71731]: DEBUG nova.compute.manager [req-1b692761-54ba-44e1-9e2c-18312dad749f req-1b1489ed-f110-4906-9ad6-752125cfe3ea service nova] [instance: 5db1cb51-2e5a-46c9-8914-cba759a96a65] Detach interface failed, port_id=628a1eb7-e3f1-4158-9f9e-1ae752c91c0b, reason: Instance 5db1cb51-2e5a-46c9-8914-cba759a96a65 could not be found. {{(pid=71731) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 13 16:26:25 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-f332ec71-46c6-43db-b9da-d15aeb8e5dd9 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:26:25 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-f332ec71-46c6-43db-b9da-d15aeb8e5dd9 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:26:26 user nova-compute[71731]: DEBUG nova.scheduler.client.report [None req-f332ec71-46c6-43db-b9da-d15aeb8e5dd9 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Refreshing inventories for resource provider cb6b1a64-0c24-4e2d-af1e-16576ca9165c {{(pid=71731) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 13 16:26:26 user nova-compute[71731]: DEBUG nova.scheduler.client.report [None req-f332ec71-46c6-43db-b9da-d15aeb8e5dd9 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Updating ProviderTree inventory for provider cb6b1a64-0c24-4e2d-af1e-16576ca9165c from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71731) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 13 16:26:26 user nova-compute[71731]: DEBUG nova.compute.provider_tree [None req-f332ec71-46c6-43db-b9da-d15aeb8e5dd9 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Updating inventory in ProviderTree for provider cb6b1a64-0c24-4e2d-af1e-16576ca9165c with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71731) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 13 16:26:26 user nova-compute[71731]: DEBUG nova.scheduler.client.report [None req-f332ec71-46c6-43db-b9da-d15aeb8e5dd9 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Refreshing aggregate associations for resource provider cb6b1a64-0c24-4e2d-af1e-16576ca9165c, aggregates: None {{(pid=71731) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 13 16:26:26 user nova-compute[71731]: DEBUG nova.scheduler.client.report [None req-f332ec71-46c6-43db-b9da-d15aeb8e5dd9 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Refreshing trait associations for resource provider cb6b1a64-0c24-4e2d-af1e-16576ca9165c, traits: COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSSE3,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_SATA,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_SSE,COMPUTE_RESCUE_BFV,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE41,HW_CPU_X86_MMX,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_RAW {{(pid=71731) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 13 16:26:26 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:26:26 user nova-compute[71731]: DEBUG nova.compute.manager [req-c567d334-5254-4f72-86b6-cf7f5642a631 req-cf0349a5-82c3-4b0f-a309-111b94b65371 service nova] [instance: 5db1cb51-2e5a-46c9-8914-cba759a96a65] Received event network-vif-plugged-628a1eb7-e3f1-4158-9f9e-1ae752c91c0b {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:26:26 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-c567d334-5254-4f72-86b6-cf7f5642a631 req-cf0349a5-82c3-4b0f-a309-111b94b65371 service nova] Acquiring lock "5db1cb51-2e5a-46c9-8914-cba759a96a65-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:26:26 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-c567d334-5254-4f72-86b6-cf7f5642a631 req-cf0349a5-82c3-4b0f-a309-111b94b65371 service nova] Lock "5db1cb51-2e5a-46c9-8914-cba759a96a65-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:26:26 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-c567d334-5254-4f72-86b6-cf7f5642a631 req-cf0349a5-82c3-4b0f-a309-111b94b65371 service nova] Lock "5db1cb51-2e5a-46c9-8914-cba759a96a65-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:26:26 user nova-compute[71731]: DEBUG nova.compute.manager [req-c567d334-5254-4f72-86b6-cf7f5642a631 req-cf0349a5-82c3-4b0f-a309-111b94b65371 service nova] [instance: 5db1cb51-2e5a-46c9-8914-cba759a96a65] No waiting events found dispatching network-vif-plugged-628a1eb7-e3f1-4158-9f9e-1ae752c91c0b {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:26:26 user nova-compute[71731]: WARNING nova.compute.manager [req-c567d334-5254-4f72-86b6-cf7f5642a631 req-cf0349a5-82c3-4b0f-a309-111b94b65371 service nova] [instance: 5db1cb51-2e5a-46c9-8914-cba759a96a65] Received unexpected event network-vif-plugged-628a1eb7-e3f1-4158-9f9e-1ae752c91c0b for instance with vm_state deleted and task_state None.
Apr 13 16:26:26 user nova-compute[71731]: DEBUG nova.compute.provider_tree [None req-f332ec71-46c6-43db-b9da-d15aeb8e5dd9 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Inventory has not changed in ProviderTree for provider: cb6b1a64-0c24-4e2d-af1e-16576ca9165c {{(pid=71731) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 16:26:26 user nova-compute[71731]: DEBUG nova.scheduler.client.report [None req-f332ec71-46c6-43db-b9da-d15aeb8e5dd9 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Inventory has not changed for provider cb6b1a64-0c24-4e2d-af1e-16576ca9165c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71731) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 16:26:26 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-f332ec71-46c6-43db-b9da-d15aeb8e5dd9 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.921s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:26:26 user nova-compute[71731]: INFO nova.scheduler.client.report [None req-f332ec71-46c6-43db-b9da-d15aeb8e5dd9 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Deleted allocations for instance 5db1cb51-2e5a-46c9-8914-cba759a96a65
Apr 13 16:26:27 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-f332ec71-46c6-43db-b9da-d15aeb8e5dd9 tempest-VolumesAdminNegativeTest-694044578 tempest-VolumesAdminNegativeTest-694044578-project-member] Lock "5db1cb51-2e5a-46c9-8914-cba759a96a65" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.925s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:26:29 user nova-compute[71731]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681403174.519475, eaae47b9-a059-49f6-9ae6-d7147003e2f2 => Stopped> {{(pid=71731) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 16:26:29 user nova-compute[71731]: INFO nova.compute.manager [-] [instance: eaae47b9-a059-49f6-9ae6-d7147003e2f2] VM Stopped (Lifecycle Event)
Apr 13 16:26:29 user nova-compute[71731]: DEBUG nova.compute.manager [None req-3d1d3f14-d9d3-4146-afae-e373ce1976ae None None] [instance: eaae47b9-a059-49f6-9ae6-d7147003e2f2] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:26:29 user nova-compute[71731]: DEBUG nova.compute.manager [None req-3d1d3f14-d9d3-4146-afae-e373ce1976ae None None] [instance: eaae47b9-a059-49f6-9ae6-d7147003e2f2] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=71731) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 16:26:29 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:26:31 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:26:34 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:26:36 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:26:38 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-057b9909-be17-4316-bb87-fe0f40a3042d tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Acquiring lock "902e4077-e0d6-4b61-a861-883be253f1e0" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:26:38 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-057b9909-be17-4316-bb87-fe0f40a3042d tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Lock "902e4077-e0d6-4b61-a861-883be253f1e0" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:26:38 user nova-compute[71731]: DEBUG nova.objects.instance [None req-057b9909-be17-4316-bb87-fe0f40a3042d tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Lazy-loading 'flavor' on Instance uuid 902e4077-e0d6-4b61-a861-883be253f1e0 {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:26:38 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-057b9909-be17-4316-bb87-fe0f40a3042d tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] [instance: 902e4077-e0d6-4b61-a861-883be253f1e0] Ignoring supplied device name: /dev/vdb
Apr 13 16:26:38 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-057b9909-be17-4316-bb87-fe0f40a3042d tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Lock "902e4077-e0d6-4b61-a861-883be253f1e0" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:26:39 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-057b9909-be17-4316-bb87-fe0f40a3042d tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Acquiring lock "902e4077-e0d6-4b61-a861-883be253f1e0" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:26:39 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-057b9909-be17-4316-bb87-fe0f40a3042d tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Lock "902e4077-e0d6-4b61-a861-883be253f1e0" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:26:39 user nova-compute[71731]: INFO nova.compute.manager [None req-057b9909-be17-4316-bb87-fe0f40a3042d tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] [instance: 902e4077-e0d6-4b61-a861-883be253f1e0] Attaching volume 6c64d091-303e-4a8b-bc23-ec85ca668f40 to /dev/vdb
Apr 13 16:26:39 user nova-compute[71731]: DEBUG os_brick.utils [None req-057b9909-be17-4316-bb87-fe0f40a3042d tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 16:26:39 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:26:39 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:26:39 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[596d4862-ff7d-4e9c-bf22-c438e2b48143]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:81501d91421\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:26:39 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:26:39 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:26:39 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[0089751b-66fa-4ee8-9fd7-9449992a78a6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:26:39 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:26:39 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:26:39 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[938d74a9-e736-45ba-adef-6f26b8be284a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:26:39 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a6e1c53-961b-408f-9a0d-72567ed6ae9e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:26:39 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-057b9909-be17-4316-bb87-fe0f40a3042d tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Running cmd (subprocess): nvme version {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:26:39 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-057b9909-be17-4316-bb87-fe0f40a3042d tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] 'nvme version' failed. Not Retrying. {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 16:26:39 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.nvmeof [None req-057b9909-be17-4316-bb87-fe0f40a3042d tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] nvme not present on system {{(pid=71731) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 16:26:39 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:26:39 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 16:26:39 user nova-compute[71731]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 16:26:39 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[a31c78b9-092f-4f2b-b0f1-4fe17bf2a2f3]: (4, '') {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:26:39 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.lightos [None req-057b9909-be17-4316-bb87-fe0f40a3042d tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71731) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 16:26:39 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.lightos [None req-057b9909-be17-4316-bb87-fe0f40a3042d tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71731) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 16:26:39 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.lightos [None req-057b9909-be17-4316-bb87-fe0f40a3042d tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] LIGHTOS: no hostnqn found. {{(pid=71731) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 16:26:39 user nova-compute[71731]: DEBUG os_brick.utils [None req-057b9909-be17-4316-bb87-fe0f40a3042d tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:81501d91421', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 16:26:39 user nova-compute[71731]: DEBUG nova.virt.block_device [None req-057b9909-be17-4316-bb87-fe0f40a3042d tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] [instance: 902e4077-e0d6-4b61-a861-883be253f1e0] Updating existing volume attachment record: a1e1a71b-2444-48b8-ae94-c8f47a540dc2 {{(pid=71731) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 16:26:39 user nova-compute[71731]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681403184.8820298, 5db1cb51-2e5a-46c9-8914-cba759a96a65 => Stopped> {{(pid=71731) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 16:26:39 user nova-compute[71731]: INFO nova.compute.manager [-] [instance: 5db1cb51-2e5a-46c9-8914-cba759a96a65] VM Stopped (Lifecycle Event)
Apr 13 16:26:39 user nova-compute[71731]: DEBUG nova.compute.manager [None req-7a32affc-87b4-49ee-842d-3764ec170d91 None None] [instance: 5db1cb51-2e5a-46c9-8914-cba759a96a65] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:26:39 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:26:43 user nova-compute[71731]: DEBUG nova.virt.libvirt.volume.iscsi [None req-057b9909-be17-4316-bb87-fe0f40a3042d tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] [instance: 902e4077-e0d6-4b61-a861-883be253f1e0] Calling os-brick to attach iSCSI Volume {{(pid=71731) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 16:26:43 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-057b9909-be17-4316-bb87-fe0f40a3042d tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8cf0118790>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6c64d091-303e-4a8b-bc23-ec85ca668f40', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bCLpiQET', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 16:26:43 user nova-compute[71731]: WARNING os_brick.initiator.connectors.base [None req-057b9909-be17-4316-bb87-fe0f40a3042d tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 16:26:43 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-057b9909-be17-4316-bb87-fe0f40a3042d tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 16:26:43 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-057b9909-be17-4316-bb87-fe0f40a3042d tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 16:26:43 user nova-compute[71731]: WARNING os_brick.initiator.connectors.base [None req-057b9909-be17-4316-bb87-fe0f40a3042d tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 16:26:43 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-057b9909-be17-4316-bb87-fe0f40a3042d tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6c64d091-303e-4a8b-bc23-ec85ca668f40" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 16:26:43 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-057b9909-be17-4316-bb87-fe0f40a3042d tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6c64d091-303e-4a8b-bc23-ec85ca668f40" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 16:26:43 user nova-compute[71731]: INFO os_brick.initiator.connectors.iscsi [None req-057b9909-be17-4316-bb87-fe0f40a3042d tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 16:26:43 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c64d091-303e-4a8b-bc23-ec85ca668f40 -p 172.16.0.220:3260 {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:26:43 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c64d091-303e-4a8b-bc23-ec85ca668f40 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:26:43 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[65c7010a-2e67-4482-a2fd-8d59e9bb0954]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:26:43 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-057b9909-be17-4316-bb87-fe0f40a3042d tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 16:26:43 user nova-compute[71731]:  {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:26:43 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c64d091-303e-4a8b-bc23-ec85ca668f40 -p 172.16.0.220:3260 --interface default --op new {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:26:43 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c64d091-303e-4a8b-bc23-ec85ca668f40 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:26:43 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[03f44dae-0150-4486-b691-827d22613f6b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6c64d091-303e-4a8b-bc23-ec85ca668f40] added\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:26:43 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-057b9909-be17-4316-bb87-fe0f40a3042d tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6c64d091-303e-4a8b-bc23-ec85ca668f40] added
Apr 13 16:26:43 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:26:43 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c64d091-303e-4a8b-bc23-ec85ca668f40 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:26:43 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c64d091-303e-4a8b-bc23-ec85ca668f40 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:26:43 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd2bbb15-0a08-4675-bbb5-47329ad83ba1]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:26:43 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-057b9909-be17-4316-bb87-fe0f40a3042d tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:26:43 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c64d091-303e-4a8b-bc23-ec85ca668f40 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:26:43 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c64d091-303e-4a8b-bc23-ec85ca668f40 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:26:43 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c4b545f-d079-4898-882e-cbb8ce99553e]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:26:43 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-057b9909-be17-4316-bb87-fe0f40a3042d tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:26:43 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c64d091-303e-4a8b-bc23-ec85ca668f40 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bCLpiQET {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:26:43 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c64d091-303e-4a8b-bc23-ec85ca668f40 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bCLpiQET" returned: 0 in 0.030s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:26:43 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcd588f7-a4b8-4a04-8214-75ab4a8c1915]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:26:43 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-057b9909-be17-4316-bb87-fe0f40a3042d tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bCLpiQET'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:26:43 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c64d091-303e-4a8b-bc23-ec85ca668f40 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:26:43 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c64d091-303e-4a8b-bc23-ec85ca668f40 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:26:43 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0970680-0efd-43b8-9e69-7991dd36c63d]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:26:43 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-057b9909-be17-4316-bb87-fe0f40a3042d tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:26:43 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:26:43 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:26:43 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[80057b77-a03a-40ce-8ed3-27ee7c961798]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc7649d3-fc59-438d-b230-72c4ce61e722 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4317bfd-71c2-4c48-a0f0-e3c795f262a8 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb2c60ec-fb52-436f-a98a-dfe15d1e3aa6 (non-flash)\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:26:43 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-057b9909-be17-4316-bb87-fe0f40a3042d tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)
Apr 13 16:26:43 user nova-compute[71731]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc7649d3-fc59-438d-b230-72c4ce61e722 (non-flash)
Apr 13 16:26:43 user nova-compute[71731]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4317bfd-71c2-4c48-a0f0-e3c795f262a8 (non-flash)
Apr 13 16:26:43 user nova-compute[71731]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984 (non-flash)
Apr 13 16:26:43 user nova-compute[71731]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb2c60ec-fb52-436f-a98a-dfe15d1e3aa6 (non-flash)
Apr 13 16:26:43 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 16:26:43 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-057b9909-be17-4316-bb87-fe0f40a3042d tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)
Apr 13 16:26:43 user nova-compute[71731]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc7649d3-fc59-438d-b230-72c4ce61e722 (non-flash)
Apr 13 16:26:43 user nova-compute[71731]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4317bfd-71c2-4c48-a0f0-e3c795f262a8 (non-flash)
Apr 13 16:26:43 user nova-compute[71731]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984 (non-flash)
Apr 13 16:26:43 user nova-compute[71731]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb2c60ec-fb52-436f-a98a-dfe15d1e3aa6 (non-flash)
Apr 13 16:26:43 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 16:26:43 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c64d091-303e-4a8b-bc23-ec85ca668f40 -p 172.16.0.220:3260 --login {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:26:43 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c64d091-303e-4a8b-bc23-ec85ca668f40 -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:26:43 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[78206df2-46d4-4635-a1c8-48f7fea4b04a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6c64d091-303e-4a8b-bc23-ec85ca668f40, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6c64d091-303e-4a8b-bc23-ec85ca668f40, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:26:43 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-057b9909-be17-4316-bb87-fe0f40a3042d tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6c64d091-303e-4a8b-bc23-ec85ca668f40, portal: 172.16.0.220,3260]
Apr 13 16:26:43 user nova-compute[71731]: Login to [iface: default, target: iqn.2010-10.org.openstack:6c64d091-303e-4a8b-bc23-ec85ca668f40, portal: 172.16.0.220,3260] successful.
Apr 13 16:26:43 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:26:43 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c64d091-303e-4a8b-bc23-ec85ca668f40 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:26:43 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c64d091-303e-4a8b-bc23-ec85ca668f40 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:26:43 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[08486888-df59-49cc-a449-7ac06d51db98]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:26:43 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-057b9909-be17-4316-bb87-fe0f40a3042d tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:26:43 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:26:43 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:26:43 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc9c851b-00fd-432a-a63b-1b2b31844be8]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc7649d3-fc59-438d-b230-72c4ce61e722 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4317bfd-71c2-4c48-a0f0-e3c795f262a8 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb2c60ec-fb52-436f-a98a-dfe15d1e3aa6 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c64d091-303e-4a8b-bc23-ec85ca668f40 (non-flash)\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:26:43 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-057b9909-be17-4316-bb87-fe0f40a3042d tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)
Apr 13 16:26:43 user nova-compute[71731]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc7649d3-fc59-438d-b230-72c4ce61e722 (non-flash)
Apr 13 16:26:43 user nova-compute[71731]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4317bfd-71c2-4c48-a0f0-e3c795f262a8 (non-flash)
Apr 13 16:26:43 user nova-compute[71731]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984 (non-flash)
Apr 13 16:26:43 user nova-compute[71731]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb2c60ec-fb52-436f-a98a-dfe15d1e3aa6 (non-flash)
Apr 13 16:26:43 user nova-compute[71731]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c64d091-303e-4a8b-bc23-ec85ca668f40 (non-flash)
Apr 13 16:26:43 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 16:26:43 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-057b9909-be17-4316-bb87-fe0f40a3042d tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)
Apr 13 16:26:43 user nova-compute[71731]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc7649d3-fc59-438d-b230-72c4ce61e722 (non-flash)
Apr 13 16:26:43 user nova-compute[71731]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4317bfd-71c2-4c48-a0f0-e3c795f262a8 (non-flash)
Apr 13 16:26:43 user nova-compute[71731]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984 (non-flash)
Apr 13 16:26:43 user nova-compute[71731]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb2c60ec-fb52-436f-a98a-dfe15d1e3aa6 (non-flash)
Apr 13 16:26:43 user nova-compute[71731]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c64d091-303e-4a8b-bc23-ec85ca668f40 (non-flash)
Apr 13 16:26:43 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 16:26:43 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-057b9909-be17-4316-bb87-fe0f40a3042d tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6c64d091-303e-4a8b-bc23-ec85ca668f40" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.322s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 16:26:43 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-057b9909-be17-4316-bb87-fe0f40a3042d tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Connected to 172.16.0.220:3260 {{(pid=71731) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 16:26:43 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-057b9909-be17-4316-bb87-fe0f40a3042d tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] HCTL ('38', '-', '-', 0) found on session 22 with lun 0 {{(pid=71731) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 16:26:43 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-057b9909-be17-4316-bb87-fe0f40a3042d tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=71731) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 16:26:43 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:26:43 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.016s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:26:43 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[46f50703-3000-4471-80e6-6d3bc6be1d41]: (4, ('- - 0', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:26:43 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-057b9909-be17-4316-bb87-fe0f40a3042d tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Searching for a device in session 22 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=71731) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 16:26:43 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-057b9909-be17-4316-bb87-fe0f40a3042d tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:6c64d091-303e-4a8b-bc23-ec85ca668f40', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bCLpiQET', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71731) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 16:26:44 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-057b9909-be17-4316-bb87-fe0f40a3042d tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.354s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 16:26:44 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-057b9909-be17-4316-bb87-fe0f40a3042d tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] <== connect_volume: return (1356ms) {'type': 'block', 'scsi_wwn': '23939626634373539', 'path': '/dev/sdg'} {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 16:26:44 user nova-compute[71731]: DEBUG nova.virt.libvirt.volume.iscsi [None req-057b9909-be17-4316-bb87-fe0f40a3042d tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] [instance: 902e4077-e0d6-4b61-a861-883be253f1e0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23939626634373539', 'path': '/dev/sdg'} {{(pid=71731) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 16:26:44 user nova-compute[71731]: DEBUG nova.objects.instance [None req-057b9909-be17-4316-bb87-fe0f40a3042d tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Lazy-loading 'flavor' on Instance uuid 902e4077-e0d6-4b61-a861-883be253f1e0 {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:26:44 user nova-compute[71731]: DEBUG nova.virt.libvirt.guest [None req-057b9909-be17-4316-bb87-fe0f40a3042d tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] attach device xml: <disk type="block" device="disk">
Apr 13 16:26:44 user nova-compute[71731]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 16:26:44 user nova-compute[71731]:   <source dev="/dev/sdg"/>
Apr 13 16:26:44 user nova-compute[71731]:   <target dev="vdb" bus="virtio"/>
Apr 13 16:26:44 user nova-compute[71731]:   <serial>6c64d091-303e-4a8b-bc23-ec85ca668f40</serial>
Apr 13 16:26:44 user nova-compute[71731]: </disk>
Apr 13 16:26:44 user nova-compute[71731]:  {{(pid=71731) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 13 16:26:44 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 16:26:44 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:26:44 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71731) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 16:26:44 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71731) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 16:26:44 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71731) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 16:26:44 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:26:44 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:26:45 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-057b9909-be17-4316-bb87-fe0f40a3042d tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] No BDM found with device name vda, not building metadata. {{(pid=71731) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 16:26:45 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-057b9909-be17-4316-bb87-fe0f40a3042d tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71731) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 16:26:45 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-057b9909-be17-4316-bb87-fe0f40a3042d tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] No VIF found with MAC fa:16:3e:38:29:d6, not building metadata {{(pid=71731) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 16:26:45 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-057b9909-be17-4316-bb87-fe0f40a3042d tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Lock "902e4077-e0d6-4b61-a861-883be253f1e0" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.504s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:26:46 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-01cde371-b17c-40e7-b1fa-f59638ae537b tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Acquiring lock "bbcccf4b-e861-4254-9be3-a491776214e9" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:26:46 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-01cde371-b17c-40e7-b1fa-f59638ae537b tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Lock "bbcccf4b-e861-4254-9be3-a491776214e9" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:26:46 user nova-compute[71731]: INFO nova.compute.manager [None req-01cde371-b17c-40e7-b1fa-f59638ae537b tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] [instance: bbcccf4b-e861-4254-9be3-a491776214e9] Detaching volume dc7649d3-fc59-438d-b230-72c4ce61e722
Apr 13 16:26:46 user nova-compute[71731]: INFO nova.virt.block_device [None req-01cde371-b17c-40e7-b1fa-f59638ae537b tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] [instance: bbcccf4b-e861-4254-9be3-a491776214e9] Attempting to driver detach volume dc7649d3-fc59-438d-b230-72c4ce61e722 from mountpoint /dev/vdb
Apr 13 16:26:46 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-01cde371-b17c-40e7-b1fa-f59638ae537b tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Attempting to detach device vdb from instance bbcccf4b-e861-4254-9be3-a491776214e9 from the persistent domain config. {{(pid=71731) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 13 16:26:46 user nova-compute[71731]: DEBUG nova.virt.libvirt.guest [None req-01cde371-b17c-40e7-b1fa-f59638ae537b tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 16:26:46 user nova-compute[71731]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 16:26:46 user nova-compute[71731]:   <source dev="/dev/sdb"/>
Apr 13 16:26:46 user nova-compute[71731]:   <target dev="vdb" bus="virtio"/>
Apr 13 16:26:46 user nova-compute[71731]:   <serial>dc7649d3-fc59-438d-b230-72c4ce61e722</serial>
Apr 13 16:26:46 user nova-compute[71731]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 13 16:26:46 user nova-compute[71731]: </disk>
Apr 13 16:26:46 user nova-compute[71731]:  {{(pid=71731) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 16:26:46 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-01cde371-b17c-40e7-b1fa-f59638ae537b tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Successfully detached device vdb from instance bbcccf4b-e861-4254-9be3-a491776214e9 from the persistent domain config.
Apr 13 16:26:46 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-01cde371-b17c-40e7-b1fa-f59638ae537b tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance bbcccf4b-e861-4254-9be3-a491776214e9 from the live domain config. {{(pid=71731) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 13 16:26:46 user nova-compute[71731]: DEBUG nova.virt.libvirt.guest [None req-01cde371-b17c-40e7-b1fa-f59638ae537b tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 16:26:46 user nova-compute[71731]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 16:26:46 user nova-compute[71731]:   <source dev="/dev/sdb"/>
Apr 13 16:26:46 user nova-compute[71731]:   <target dev="vdb" bus="virtio"/>
Apr 13 16:26:46 user nova-compute[71731]:   <serial>dc7649d3-fc59-438d-b230-72c4ce61e722</serial>
Apr 13 16:26:46 user nova-compute[71731]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 13 16:26:46 user nova-compute[71731]: </disk>
Apr 13 16:26:46 user nova-compute[71731]:  {{(pid=71731) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 16:26:46 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:26:46 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Received event <DeviceRemovedEvent: 1681403206.8118591, bbcccf4b-e861-4254-9be3-a491776214e9 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71731) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 13 16:26:46 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-01cde371-b17c-40e7-b1fa-f59638ae537b tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance bbcccf4b-e861-4254-9be3-a491776214e9 {{(pid=71731) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 13 16:26:46 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-01cde371-b17c-40e7-b1fa-f59638ae537b tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Successfully detached device vdb from instance bbcccf4b-e861-4254-9be3-a491776214e9 from the live domain config.
Apr 13 16:26:46 user nova-compute[71731]: DEBUG nova.virt.libvirt.volume.iscsi [None req-01cde371-b17c-40e7-b1fa-f59638ae537b tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] [instance: bbcccf4b-e861-4254-9be3-a491776214e9] calling os-brick to detach iSCSI Volume {{(pid=71731) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 16:26:46 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-01cde371-b17c-40e7-b1fa-f59638ae537b tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8cf0118790>, {'target_iqn': 'iqn.2010-10.org.openstack:dc7649d3-fc59-438d-b230-72c4ce61e722', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RYfjcZaT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 16:26:46 user nova-compute[71731]: WARNING os_brick.initiator.connectors.base [None req-01cde371-b17c-40e7-b1fa-f59638ae537b tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 16:26:46 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-01cde371-b17c-40e7-b1fa-f59638ae537b tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 16:26:46 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-01cde371-b17c-40e7-b1fa-f59638ae537b tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 16:26:46 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:26:46 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:26:46 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[90b36739-4706-46e8-894e-53c2fcc78874]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e4317bfd-71c2-4c48-a0f0-e3c795f262a8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6c64d091-303e-4a8b-bc23-ec85ca668f40\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dc7649d3-fc59-438d-b230-72c4ce61e722\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:eb2c60ec-fb52-436f-a98a-dfe15d1e3aa6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:26:46 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-01cde371-b17c-40e7-b1fa-f59638ae537b tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 16:26:46 user nova-compute[71731]: No targets found.
Apr 13 16:26:46 user nova-compute[71731]: iSNS:
Apr 13 16:26:46 user nova-compute[71731]: No targets found.
Apr 13 16:26:46 user nova-compute[71731]: STATIC:
Apr 13 16:26:46 user nova-compute[71731]: Target: iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97
Apr 13 16:26:46 user nova-compute[71731]:         Portal: 172.16.0.220:3260,-1
Apr 13 16:26:46 user nova-compute[71731]:                 Iface Name: default
Apr 13 16:26:46 user nova-compute[71731]: Target: iqn.2010-10.org.openstack:e4317bfd-71c2-4c48-a0f0-e3c795f262a8
Apr 13 16:26:46 user nova-compute[71731]:         Portal: 172.16.0.220:3260,-1
Apr 13 16:26:46 user nova-compute[71731]:                 Iface Name: default
Apr 13 16:26:46 user nova-compute[71731]: Target: iqn.2010-10.org.openstack:6c64d091-303e-4a8b-bc23-ec85ca668f40
Apr 13 16:26:46 user nova-compute[71731]:         Portal: 172.16.0.220:3260,-1
Apr 13 16:26:46 user nova-compute[71731]:                 Iface Name: default
Apr 13 16:26:46 user nova-compute[71731]: Target: iqn.2010-10.org.openstack:dc7649d3-fc59-438d-b230-72c4ce61e722
Apr 13 16:26:46 user nova-compute[71731]:         Portal: 172.16.0.220:3260,-1
Apr 13 16:26:46 user nova-compute[71731]:                 Iface Name: default
Apr 13 16:26:46 user nova-compute[71731]: Target: iqn.2010-10.org.openstack:eb2c60ec-fb52-436f-a98a-dfe15d1e3aa6
Apr 13 16:26:46 user nova-compute[71731]:         Portal: 172.16.0.220:3260,-1
Apr 13 16:26:46 user nova-compute[71731]:                 Iface Name: default
Apr 13 16:26:46 user nova-compute[71731]: Target: iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984
Apr 13 16:26:46 user nova-compute[71731]:         Portal: 172.16.0.220:3260,-1
Apr 13 16:26:46 user nova-compute[71731]:                 Iface Name: default
Apr 13 16:26:46 user nova-compute[71731]: FIRMWARE:
Apr 13 16:26:46 user nova-compute[71731]: No targets found.
Apr 13 16:26:46 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 16:26:46 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-01cde371-b17c-40e7-b1fa-f59638ae537b tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 16:26:46 user nova-compute[71731]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 16:26:46 user nova-compute[71731]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71731) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 16:26:46 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-01cde371-b17c-40e7-b1fa-f59638ae537b tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dc7649d3-fc59-438d-b230-72c4ce61e722', 0)] {{(pid=71731) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 16:26:46 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:26:46 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:26:46 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f50968c-c0fc-40d0-aba4-12640149c51e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6c64d091-303e-4a8b-bc23-ec85ca668f40\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dc7649d3-fc59-438d-b230-72c4ce61e722\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e4317bfd-71c2-4c48-a0f0-e3c795f262a8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eb2c60ec-fb52-436f-a98a-dfe15d1e3aa6\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:26:46 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:26:46 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:26:46 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[237ca921-103f-4006-8eb1-b0a49358ae42]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc7649d3-fc59-438d-b230-72c4ce61e722 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4317bfd-71c2-4c48-a0f0-e3c795f262a8 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb2c60ec-fb52-436f-a98a-dfe15d1e3aa6 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c64d091-303e-4a8b-bc23-ec85ca668f40 (non-flash)\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:26:46 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-01cde371-b17c-40e7-b1fa-f59638ae537b tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)
Apr 13 16:26:46 user nova-compute[71731]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc7649d3-fc59-438d-b230-72c4ce61e722 (non-flash)
Apr 13 16:26:46 user nova-compute[71731]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4317bfd-71c2-4c48-a0f0-e3c795f262a8 (non-flash)
Apr 13 16:26:46 user nova-compute[71731]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984 (non-flash)
Apr 13 16:26:46 user nova-compute[71731]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb2c60ec-fb52-436f-a98a-dfe15d1e3aa6 (non-flash)
Apr 13 16:26:46 user nova-compute[71731]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c64d091-303e-4a8b-bc23-ec85ca668f40 (non-flash)
Apr 13 16:26:46 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 16:26:46 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-01cde371-b17c-40e7-b1fa-f59638ae537b tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)
Apr 13 16:26:46 user nova-compute[71731]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc7649d3-fc59-438d-b230-72c4ce61e722 (non-flash)
Apr 13 16:26:46 user nova-compute[71731]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4317bfd-71c2-4c48-a0f0-e3c795f262a8 (non-flash)
Apr 13 16:26:46 user nova-compute[71731]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984 (non-flash)
Apr 13 16:26:46 user nova-compute[71731]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb2c60ec-fb52-436f-a98a-dfe15d1e3aa6 (non-flash)
Apr 13 16:26:46 user nova-compute[71731]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c64d091-303e-4a8b-bc23-ec85ca668f40 (non-flash)
Apr 13 16:26:46 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 16:26:46 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-01cde371-b17c-40e7-b1fa-f59638ae537b tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8cd023fe20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dc7649d3-fc59-438d-b230-72c4ce61e722'): ({'sdb'}, set())}) {{(pid=71731) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 16:26:46 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-01cde371-b17c-40e7-b1fa-f59638ae537b tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Removing single pathed devices sdb {{(pid=71731) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 16:26:46 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:26:46 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:26:46 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[e93a6f92-6ddf-4db2-a8e9-40faf32d0c66]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:26:46 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:26:46 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:26:46 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed1dd356-1847-4d1f-9a3e-c366b26a2353]: (4, ('ok\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:26:46 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-01cde371-b17c-40e7-b1fa-f59638ae537b tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Flushing IO for device /dev/sdb {{(pid=71731) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 16:26:46 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:26:46 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:26:46 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[006cbb10-158e-4144-87a0-e0660cb18b1d]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:26:46 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-01cde371-b17c-40e7-b1fa-f59638ae537b tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71731) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 16:26:46 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:26:47 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.040s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:26:47 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1f20404-5414-4ece-ac84-0d551359b0ba]: (4, ('1', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:26:47 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-01cde371-b17c-40e7-b1fa-f59638ae537b tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71731) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 16:26:47 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-01cde371-b17c-40e7-b1fa-f59638ae537b tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] SCSI volumes sdb have been removed. {{(pid=71731) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 16:26:47 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-01cde371-b17c-40e7-b1fa-f59638ae537b tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dc7649d3-fc59-438d-b230-72c4ce61e722')] {{(pid=71731) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 16:26:47 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc7649d3-fc59-438d-b230-72c4ce61e722 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:26:47 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc7649d3-fc59-438d-b230-72c4ce61e722 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:26:47 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab35e13b-241a-433c-bfa1-0d4d169e28f8]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:26:47 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-01cde371-b17c-40e7-b1fa-f59638ae537b tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:26:47 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc7649d3-fc59-438d-b230-72c4ce61e722 -p 172.16.0.220:3260 --logout {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:26:47 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc7649d3-fc59-438d-b230-72c4ce61e722 -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:26:47 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cb88c89-a2cf-4983-9cd2-f9237aab1d68]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:dc7649d3-fc59-438d-b230-72c4ce61e722, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:dc7649d3-fc59-438d-b230-72c4ce61e722, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:26:47 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-01cde371-b17c-40e7-b1fa-f59638ae537b tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:dc7649d3-fc59-438d-b230-72c4ce61e722, portal: 172.16.0.220,3260]
Apr 13 16:26:47 user nova-compute[71731]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:dc7649d3-fc59-438d-b230-72c4ce61e722, portal: 172.16.0.220,3260] successful.
Apr 13 16:26:47 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:26:47 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc7649d3-fc59-438d-b230-72c4ce61e722 -p 172.16.0.220:3260 --op delete {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:26:47 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc7649d3-fc59-438d-b230-72c4ce61e722 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:26:47 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b5af214-bba0-4dd6-87b2-a3ce8f9665f3]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:26:47 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-01cde371-b17c-40e7-b1fa-f59638ae537b tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:26:47 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-01cde371-b17c-40e7-b1fa-f59638ae537b tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.333s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 16:26:47 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-01cde371-b17c-40e7-b1fa-f59638ae537b tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] <== disconnect_volume: return (334ms) None {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 16:26:47 user nova-compute[71731]: DEBUG nova.virt.libvirt.volume.iscsi [None req-01cde371-b17c-40e7-b1fa-f59638ae537b tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] [instance: bbcccf4b-e861-4254-9be3-a491776214e9] Disconnected iSCSI Volume {{(pid=71731) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 16:26:47 user nova-compute[71731]: DEBUG nova.objects.instance [None req-01cde371-b17c-40e7-b1fa-f59638ae537b tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Lazy-loading 'flavor' on Instance uuid bbcccf4b-e861-4254-9be3-a491776214e9 {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:26:47 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-01cde371-b17c-40e7-b1fa-f59638ae537b tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Lock "bbcccf4b-e861-4254-9be3-a491776214e9" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.697s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:26:49 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:26:54 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 16:26:56 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-f6948a5f-d016-468a-a94d-752f539b3ca4 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Acquiring lock "902e4077-e0d6-4b61-a861-883be253f1e0" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:26:56 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-f6948a5f-d016-468a-a94d-752f539b3ca4 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Lock "902e4077-e0d6-4b61-a861-883be253f1e0" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:26:56 user nova-compute[71731]: INFO nova.compute.manager [None req-f6948a5f-d016-468a-a94d-752f539b3ca4 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] [instance: 902e4077-e0d6-4b61-a861-883be253f1e0] Detaching volume 6c64d091-303e-4a8b-bc23-ec85ca668f40
Apr 13 16:26:56 user nova-compute[71731]: INFO nova.virt.block_device [None req-f6948a5f-d016-468a-a94d-752f539b3ca4 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] [instance: 902e4077-e0d6-4b61-a861-883be253f1e0] Attempting to driver detach volume 6c64d091-303e-4a8b-bc23-ec85ca668f40 from mountpoint /dev/vdb
Apr 13 16:26:56 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-f6948a5f-d016-468a-a94d-752f539b3ca4 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Attempting to detach device vdb from instance 902e4077-e0d6-4b61-a861-883be253f1e0 from the persistent domain config. {{(pid=71731) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 13 16:26:56 user nova-compute[71731]: DEBUG nova.virt.libvirt.guest [None req-f6948a5f-d016-468a-a94d-752f539b3ca4 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 16:26:56 user nova-compute[71731]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 16:26:56 user nova-compute[71731]:   <source dev="/dev/sdg"/>
Apr 13 16:26:56 user nova-compute[71731]:   <target dev="vdb" bus="virtio"/>
Apr 13 16:26:56 user nova-compute[71731]:   <serial>6c64d091-303e-4a8b-bc23-ec85ca668f40</serial>
Apr 13 16:26:56 user nova-compute[71731]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 13 16:26:56 user nova-compute[71731]: </disk>
Apr 13 16:26:56 user nova-compute[71731]:  {{(pid=71731) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 16:26:56 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-f6948a5f-d016-468a-a94d-752f539b3ca4 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Successfully detached device vdb from instance 902e4077-e0d6-4b61-a861-883be253f1e0 from the persistent domain config.
Apr 13 16:26:56 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-f6948a5f-d016-468a-a94d-752f539b3ca4 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 902e4077-e0d6-4b61-a861-883be253f1e0 from the live domain config. {{(pid=71731) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 13 16:26:56 user nova-compute[71731]: DEBUG nova.virt.libvirt.guest [None req-f6948a5f-d016-468a-a94d-752f539b3ca4 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 16:26:56 user nova-compute[71731]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 16:26:56 user nova-compute[71731]:   <source dev="/dev/sdg"/>
Apr 13 16:26:56 user nova-compute[71731]:   <target dev="vdb" bus="virtio"/>
Apr 13 16:26:56 user nova-compute[71731]:   <serial>6c64d091-303e-4a8b-bc23-ec85ca668f40</serial>
Apr 13 16:26:56 user nova-compute[71731]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 13 16:26:56 user nova-compute[71731]: </disk>
Apr 13 16:26:56 user nova-compute[71731]:  {{(pid=71731) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 16:26:56 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-fadc2ade-5256-4641-ac83-c5c7d7c64dd3 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Acquiring lock "902e4077-e0d6-4b61-a861-883be253f1e0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:26:57 user nova-compute[71731]: INFO nova.compute.manager [None req-0e88a05e-c4ef-4adc-8c74-1e9f3b628392 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: 235f827c-7116-48e9-84c5-0c9761c18e1e] Unrescuing
Apr 13 16:26:57 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-0e88a05e-c4ef-4adc-8c74-1e9f3b628392 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Acquiring lock "refresh_cache-235f827c-7116-48e9-84c5-0c9761c18e1e" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 16:26:57 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-0e88a05e-c4ef-4adc-8c74-1e9f3b628392 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Acquired lock "refresh_cache-235f827c-7116-48e9-84c5-0c9761c18e1e" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 16:26:57 user nova-compute[71731]: DEBUG nova.network.neutron [None req-0e88a05e-c4ef-4adc-8c74-1e9f3b628392 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: 235f827c-7116-48e9-84c5-0c9761c18e1e] Building network info cache for instance {{(pid=71731) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 16:26:57 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Received event <DeviceRemovedEvent: 1681403217.4027894, 902e4077-e0d6-4b61-a861-883be253f1e0 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71731) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 13 16:26:57 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-f6948a5f-d016-468a-a94d-752f539b3ca4 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 902e4077-e0d6-4b61-a861-883be253f1e0 {{(pid=71731) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 13 16:26:57 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-f6948a5f-d016-468a-a94d-752f539b3ca4 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Successfully detached device vdb from instance 902e4077-e0d6-4b61-a861-883be253f1e0 from the live domain config.
Apr 13 16:26:57 user nova-compute[71731]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f6948a5f-d016-468a-a94d-752f539b3ca4 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] [instance: 902e4077-e0d6-4b61-a861-883be253f1e0] calling os-brick to detach iSCSI Volume {{(pid=71731) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 16:26:57 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6948a5f-d016-468a-a94d-752f539b3ca4 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8cf0118790>, {'target_iqn': 'iqn.2010-10.org.openstack:6c64d091-303e-4a8b-bc23-ec85ca668f40', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bCLpiQET', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg': {}}" {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 16:26:57 user nova-compute[71731]: WARNING os_brick.initiator.connectors.base [None req-f6948a5f-d016-468a-a94d-752f539b3ca4 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 16:26:57 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-f6948a5f-d016-468a-a94d-752f539b3ca4 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 16:26:57 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-f6948a5f-d016-468a-a94d-752f539b3ca4 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 16:26:57 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:26:57 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:26:57 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[c18686c5-244f-4ef4-b515-703b2f86b7a4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e4317bfd-71c2-4c48-a0f0-e3c795f262a8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6c64d091-303e-4a8b-bc23-ec85ca668f40\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:eb2c60ec-fb52-436f-a98a-dfe15d1e3aa6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:26:57 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6948a5f-d016-468a-a94d-752f539b3ca4 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 16:26:57 user nova-compute[71731]: No targets found.
Apr 13 16:26:57 user nova-compute[71731]: iSNS:
Apr 13 16:26:57 user nova-compute[71731]: No targets found.
Apr 13 16:26:57 user nova-compute[71731]: STATIC:
Apr 13 16:26:57 user nova-compute[71731]: Target: iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97
Apr 13 16:26:57 user nova-compute[71731]:         Portal: 172.16.0.220:3260,-1
Apr 13 16:26:57 user nova-compute[71731]:                 Iface Name: default
Apr 13 16:26:57 user nova-compute[71731]: Target: iqn.2010-10.org.openstack:e4317bfd-71c2-4c48-a0f0-e3c795f262a8
Apr 13 16:26:57 user nova-compute[71731]:         Portal: 172.16.0.220:3260,-1
Apr 13 16:26:57 user nova-compute[71731]:                 Iface Name: default
Apr 13 16:26:57 user nova-compute[71731]: Target: iqn.2010-10.org.openstack:6c64d091-303e-4a8b-bc23-ec85ca668f40
Apr 13 16:26:57 user nova-compute[71731]:         Portal: 172.16.0.220:3260,-1
Apr 13 16:26:57 user nova-compute[71731]:                 Iface Name: default
Apr 13 16:26:57 user nova-compute[71731]: Target: iqn.2010-10.org.openstack:eb2c60ec-fb52-436f-a98a-dfe15d1e3aa6
Apr 13 16:26:57 user nova-compute[71731]:         Portal: 172.16.0.220:3260,-1
Apr 13 16:26:57 user nova-compute[71731]:                 Iface Name: default
Apr 13 16:26:57 user nova-compute[71731]: Target: iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984
Apr 13 16:26:57 user nova-compute[71731]:         Portal: 172.16.0.220:3260,-1
Apr 13 16:26:57 user nova-compute[71731]:                 Iface Name: default
Apr 13 16:26:57 user nova-compute[71731]: FIRMWARE:
Apr 13 16:26:57 user nova-compute[71731]: No targets found.
Apr 13 16:26:57 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 16:26:57 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6948a5f-d016-468a-a94d-752f539b3ca4 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 16:26:57 user nova-compute[71731]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 16:26:57 user nova-compute[71731]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71731) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 16:26:57 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6948a5f-d016-468a-a94d-752f539b3ca4 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6c64d091-303e-4a8b-bc23-ec85ca668f40', 0)] {{(pid=71731) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 16:26:57 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:26:57 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:26:57 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d3e13cf-9e27-4d4b-880d-9577118d5501]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6c64d091-303e-4a8b-bc23-ec85ca668f40\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e4317bfd-71c2-4c48-a0f0-e3c795f262a8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eb2c60ec-fb52-436f-a98a-dfe15d1e3aa6\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:26:57 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:26:57 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:26:57 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b7cae8b-9be7-4a2e-85a1-bdbe30c7eaf0]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4317bfd-71c2-4c48-a0f0-e3c795f262a8 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb2c60ec-fb52-436f-a98a-dfe15d1e3aa6 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c64d091-303e-4a8b-bc23-ec85ca668f40 (non-flash)\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:26:57 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._sync_power_states {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:26:57 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6948a5f-d016-468a-a94d-752f539b3ca4 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)
Apr 13 16:26:57 user nova-compute[71731]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4317bfd-71c2-4c48-a0f0-e3c795f262a8 (non-flash)
Apr 13 16:26:57 user nova-compute[71731]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984 (non-flash)
Apr 13 16:26:57 user nova-compute[71731]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb2c60ec-fb52-436f-a98a-dfe15d1e3aa6 (non-flash)
Apr 13 16:26:57 user nova-compute[71731]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c64d091-303e-4a8b-bc23-ec85ca668f40 (non-flash)
Apr 13 16:26:57 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 16:26:57 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6948a5f-d016-468a-a94d-752f539b3ca4 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)
Apr 13 16:26:57 user nova-compute[71731]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4317bfd-71c2-4c48-a0f0-e3c795f262a8 (non-flash)
Apr 13 16:26:57 user nova-compute[71731]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984 (non-flash)
Apr 13 16:26:57 user nova-compute[71731]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb2c60ec-fb52-436f-a98a-dfe15d1e3aa6 (non-flash)
Apr 13 16:26:57 user nova-compute[71731]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c64d091-303e-4a8b-bc23-ec85ca668f40 (non-flash)
Apr 13 16:26:57 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 16:26:57 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6948a5f-d016-468a-a94d-752f539b3ca4 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8cff4d9f30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6c64d091-303e-4a8b-bc23-ec85ca668f40'): ({'sdg'}, set())}) {{(pid=71731) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 16:26:57 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-f6948a5f-d016-468a-a94d-752f539b3ca4 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Removing single pathed devices sdg {{(pid=71731) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 16:26:57 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:26:57 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:26:57 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fd84b44-f880-48f6-a214-25d1c9ab6060]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:26:57 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:26:57 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Triggering sync for uuid 7973e93b-6311-44ed-91ff-e861c32d0277 {{(pid=71731) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 13 16:26:57 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Triggering sync for uuid f66553f5-5e1b-4f1d-8c5a-63bc340f7586 {{(pid=71731) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 13 16:26:57 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Triggering sync for uuid bbcccf4b-e861-4254-9be3-a491776214e9 {{(pid=71731) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 13 16:26:57 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Triggering sync for uuid bf350da4-9cc2-4900-adf0-506e44984b42 {{(pid=71731) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 13 16:26:57 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Triggering sync for uuid 235f827c-7116-48e9-84c5-0c9761c18e1e {{(pid=71731) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 13 16:26:57 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Triggering sync for uuid acbcaee0-a47b-4fee-8765-9b1c9597d515 {{(pid=71731) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 13 16:26:57 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Triggering sync for uuid eaae47b9-a059-49f6-9ae6-d7147003e2f2 {{(pid=71731) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 13 16:26:57 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Triggering sync for uuid 902e4077-e0d6-4b61-a861-883be253f1e0 {{(pid=71731) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 13 16:26:57 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Triggering sync for uuid 5ea4ab6a-6501-4a2f-a8f7-04090024747d {{(pid=71731) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 13 16:26:57 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.021s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:26:57 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[18557cf6-3030-4473-8150-dd219bf3c6ee]: (4, ('ok\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:26:57 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Acquiring lock "7973e93b-6311-44ed-91ff-e861c32d0277" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:26:57 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "7973e93b-6311-44ed-91ff-e861c32d0277" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:26:57 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Acquiring lock "f66553f5-5e1b-4f1d-8c5a-63bc340f7586" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:26:57 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "f66553f5-5e1b-4f1d-8c5a-63bc340f7586" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:26:57 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Acquiring lock "bbcccf4b-e861-4254-9be3-a491776214e9" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:26:57 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "bbcccf4b-e861-4254-9be3-a491776214e9" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:26:57 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Acquiring lock "bf350da4-9cc2-4900-adf0-506e44984b42" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:26:57 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "bf350da4-9cc2-4900-adf0-506e44984b42" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:26:57 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Acquiring lock "235f827c-7116-48e9-84c5-0c9761c18e1e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:26:57 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "235f827c-7116-48e9-84c5-0c9761c18e1e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:26:57 user nova-compute[71731]: INFO nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] [instance: 235f827c-7116-48e9-84c5-0c9761c18e1e] During sync_power_state the instance has a pending task (unrescuing). Skip.
Apr 13 16:26:57 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "235f827c-7116-48e9-84c5-0c9761c18e1e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:26:57 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Acquiring lock "acbcaee0-a47b-4fee-8765-9b1c9597d515" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:26:57 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "acbcaee0-a47b-4fee-8765-9b1c9597d515" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:26:57 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Acquiring lock "eaae47b9-a059-49f6-9ae6-d7147003e2f2" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:26:57 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "eaae47b9-a059-49f6-9ae6-d7147003e2f2" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:26:57 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Acquiring lock "902e4077-e0d6-4b61-a861-883be253f1e0" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:26:57 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Acquiring lock "5ea4ab6a-6501-4a2f-a8f7-04090024747d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:26:57 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "5ea4ab6a-6501-4a2f-a8f7-04090024747d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:26:57 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-f6948a5f-d016-468a-a94d-752f539b3ca4 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Flushing IO for device /dev/sdg {{(pid=71731) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 16:26:57 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:26:57 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.014s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:26:57 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[84030cac-dc80-4c84-889d-3d7aff5d6662]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:26:57 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-f6948a5f-d016-468a-a94d-752f539b3ca4 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=71731) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 16:26:57 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:26:57 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "f66553f5-5e1b-4f1d-8c5a-63bc340f7586" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.067s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:26:57 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "acbcaee0-a47b-4fee-8765-9b1c9597d515" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.071s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:26:57 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "bbcccf4b-e861-4254-9be3-a491776214e9" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.081s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:26:57 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.048s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:26:57 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[5041b830-d368-40fd-98e1-8326c996943a]: (4, ('1', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:26:57 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-f6948a5f-d016-468a-a94d-752f539b3ca4 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=71731) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 16:26:57 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-f6948a5f-d016-468a-a94d-752f539b3ca4 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] SCSI volumes sdg have been removed. {{(pid=71731) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 16:26:57 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6948a5f-d016-468a-a94d-752f539b3ca4 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6c64d091-303e-4a8b-bc23-ec85ca668f40')] {{(pid=71731) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 16:26:57 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c64d091-303e-4a8b-bc23-ec85ca668f40 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:26:57 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "eaae47b9-a059-49f6-9ae6-d7147003e2f2" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.085s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:26:57 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c64d091-303e-4a8b-bc23-ec85ca668f40 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:26:57 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb9e7bab-ad09-4086-9c11-92f267476258]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:26:57 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6948a5f-d016-468a-a94d-752f539b3ca4 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:26:57 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c64d091-303e-4a8b-bc23-ec85ca668f40 -p 172.16.0.220:3260 --logout {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:26:57 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "7973e93b-6311-44ed-91ff-e861c32d0277" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.159s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:26:57 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "bf350da4-9cc2-4900-adf0-506e44984b42" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.163s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:26:57 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "5ea4ab6a-6501-4a2f-a8f7-04090024747d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.165s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:26:57 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c64d091-303e-4a8b-bc23-ec85ca668f40 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:26:57 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[708ca223-d4c0-46d5-8137-c13981cf876b]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:6c64d091-303e-4a8b-bc23-ec85ca668f40, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:6c64d091-303e-4a8b-bc23-ec85ca668f40, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:26:57 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6948a5f-d016-468a-a94d-752f539b3ca4 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:6c64d091-303e-4a8b-bc23-ec85ca668f40, portal: 172.16.0.220,3260]
Apr 13 16:26:57 user nova-compute[71731]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:6c64d091-303e-4a8b-bc23-ec85ca668f40, portal: 172.16.0.220,3260] successful.
Apr 13 16:26:57 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:26:57 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c64d091-303e-4a8b-bc23-ec85ca668f40 -p 172.16.0.220:3260 --op delete {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:26:57 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c64d091-303e-4a8b-bc23-ec85ca668f40 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:26:57 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[bea46cd8-db11-4cad-a06e-71f7fcc29b55]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:26:57 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6948a5f-d016-468a-a94d-752f539b3ca4 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:26:57 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-f6948a5f-d016-468a-a94d-752f539b3ca4 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.352s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 16:26:57 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6948a5f-d016-468a-a94d-752f539b3ca4 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] <== disconnect_volume: return (354ms) None {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 16:26:57 user nova-compute[71731]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f6948a5f-d016-468a-a94d-752f539b3ca4 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] [instance: 902e4077-e0d6-4b61-a861-883be253f1e0] Disconnected iSCSI Volume {{(pid=71731) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 16:26:57 user nova-compute[71731]: DEBUG nova.network.neutron [None req-0e88a05e-c4ef-4adc-8c74-1e9f3b628392 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: 235f827c-7116-48e9-84c5-0c9761c18e1e] Updating instance_info_cache with network_info: [{"id": "b72a6c8b-7244-41c2-a4f7-6da43b4944b8", "address": "fa:16:3e:e3:62:b0", "network": {"id": "5a7877ff-8230-470b-90b5-e5dcfc8f0cee", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-779403873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2d09a74bf684a9fb1dd1e95d6c23f3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb72a6c8b-72", "ovs_interfaceid": "b72a6c8b-7244-41c2-a4f7-6da43b4944b8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:26:57 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-0e88a05e-c4ef-4adc-8c74-1e9f3b628392 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Releasing lock "refresh_cache-235f827c-7116-48e9-84c5-0c9761c18e1e" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 16:26:57 user nova-compute[71731]: DEBUG nova.objects.instance [None req-0e88a05e-c4ef-4adc-8c74-1e9f3b628392 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lazy-loading 'flavor' on Instance uuid 235f827c-7116-48e9-84c5-0c9761c18e1e {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:26:57 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:26:57 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:26:58 user nova-compute[71731]: DEBUG nova.compute.manager [req-5c02551e-e775-48e1-a1b5-3d23be849132 req-61c22c69-ca97-4450-8e59-03bbedec1367 service nova] [instance: 235f827c-7116-48e9-84c5-0c9761c18e1e] Received event network-vif-unplugged-b72a6c8b-7244-41c2-a4f7-6da43b4944b8 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:26:58 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-5c02551e-e775-48e1-a1b5-3d23be849132 req-61c22c69-ca97-4450-8e59-03bbedec1367 service nova] Acquiring lock "235f827c-7116-48e9-84c5-0c9761c18e1e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:26:58 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-5c02551e-e775-48e1-a1b5-3d23be849132 req-61c22c69-ca97-4450-8e59-03bbedec1367 service nova] Lock "235f827c-7116-48e9-84c5-0c9761c18e1e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:26:58 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-5c02551e-e775-48e1-a1b5-3d23be849132 req-61c22c69-ca97-4450-8e59-03bbedec1367 service nova] Lock "235f827c-7116-48e9-84c5-0c9761c18e1e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:26:58 user nova-compute[71731]: DEBUG nova.compute.manager [req-5c02551e-e775-48e1-a1b5-3d23be849132 req-61c22c69-ca97-4450-8e59-03bbedec1367 service nova] [instance: 235f827c-7116-48e9-84c5-0c9761c18e1e] No waiting events found dispatching network-vif-unplugged-b72a6c8b-7244-41c2-a4f7-6da43b4944b8 {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:26:58 user nova-compute[71731]: WARNING nova.compute.manager [req-5c02551e-e775-48e1-a1b5-3d23be849132 req-61c22c69-ca97-4450-8e59-03bbedec1367 service nova] [instance: 235f827c-7116-48e9-84c5-0c9761c18e1e] Received unexpected event network-vif-unplugged-b72a6c8b-7244-41c2-a4f7-6da43b4944b8 for instance with vm_state rescued and task_state unrescuing.
Apr 13 16:26:58 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:26:58 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:26:58 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-be1f0e44-4d7f-4429-a718-bf4c73c90fe4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Acquiring lock "0f52d9e3-921c-4f79-9cdb-7d73500c8c35" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:26:58 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-be1f0e44-4d7f-4429-a718-bf4c73c90fe4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "0f52d9e3-921c-4f79-9cdb-7d73500c8c35" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:26:58 user nova-compute[71731]: DEBUG nova.compute.manager [None req-be1f0e44-4d7f-4429-a718-bf4c73c90fe4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 0f52d9e3-921c-4f79-9cdb-7d73500c8c35] Starting instance... {{(pid=71731) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 16:26:58 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-be1f0e44-4d7f-4429-a718-bf4c73c90fe4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:26:58 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-be1f0e44-4d7f-4429-a718-bf4c73c90fe4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:26:58 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-be1f0e44-4d7f-4429-a718-bf4c73c90fe4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71731) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 16:26:58 user nova-compute[71731]: INFO nova.compute.claims [None req-be1f0e44-4d7f-4429-a718-bf4c73c90fe4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 0f52d9e3-921c-4f79-9cdb-7d73500c8c35] Claim successful on node user
Apr 13 16:26:58 user nova-compute[71731]: INFO nova.virt.libvirt.driver [-] [instance: 235f827c-7116-48e9-84c5-0c9761c18e1e] Instance destroyed successfully.
Apr 13 16:26:58 user nova-compute[71731]: DEBUG nova.objects.instance [None req-f6948a5f-d016-468a-a94d-752f539b3ca4 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Lazy-loading 'flavor' on Instance uuid 902e4077-e0d6-4b61-a861-883be253f1e0 {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:26:58 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-f6948a5f-d016-468a-a94d-752f539b3ca4 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Lock "902e4077-e0d6-4b61-a861-883be253f1e0" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.953s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:26:58 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-fadc2ade-5256-4641-ac83-c5c7d7c64dd3 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Lock "902e4077-e0d6-4b61-a861-883be253f1e0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 1.829s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:26:58 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-fadc2ade-5256-4641-ac83-c5c7d7c64dd3 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Acquiring lock "902e4077-e0d6-4b61-a861-883be253f1e0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:26:58 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-fadc2ade-5256-4641-ac83-c5c7d7c64dd3 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Lock "902e4077-e0d6-4b61-a861-883be253f1e0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.003s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:26:58 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-fadc2ade-5256-4641-ac83-c5c7d7c64dd3 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Lock "902e4077-e0d6-4b61-a861-883be253f1e0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:26:58 user nova-compute[71731]: INFO nova.compute.manager [None req-fadc2ade-5256-4641-ac83-c5c7d7c64dd3 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] [instance: 902e4077-e0d6-4b61-a861-883be253f1e0] Terminating instance
Apr 13 16:26:58 user nova-compute[71731]: DEBUG nova.compute.manager [None req-fadc2ade-5256-4641-ac83-c5c7d7c64dd3 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] [instance: 902e4077-e0d6-4b61-a861-883be253f1e0] Start destroying the instance on the hypervisor. {{(pid=71731) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 16:26:58 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:26:58 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:26:59 user nova-compute[71731]: DEBUG nova.compute.provider_tree [None req-be1f0e44-4d7f-4429-a718-bf4c73c90fe4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Inventory has not changed in ProviderTree for provider: cb6b1a64-0c24-4e2d-af1e-16576ca9165c {{(pid=71731) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 16:26:59 user nova-compute[71731]: DEBUG nova.scheduler.client.report [None req-be1f0e44-4d7f-4429-a718-bf4c73c90fe4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Inventory has not changed for provider cb6b1a64-0c24-4e2d-af1e-16576ca9165c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71731) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 16:26:59 user nova-compute[71731]: DEBUG nova.compute.manager [req-9b91a7e7-42cd-43aa-a138-eff9e7da7046 req-29d3e9e0-1fb8-4e1e-80c7-acd7db95f139 service nova] [instance: 902e4077-e0d6-4b61-a861-883be253f1e0] Received event network-vif-unplugged-58b69a6e-8c04-42e5-931a-0947d9c0f78d {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:26:59 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-9b91a7e7-42cd-43aa-a138-eff9e7da7046 req-29d3e9e0-1fb8-4e1e-80c7-acd7db95f139 service nova] Acquiring lock "902e4077-e0d6-4b61-a861-883be253f1e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:26:59 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-9b91a7e7-42cd-43aa-a138-eff9e7da7046 req-29d3e9e0-1fb8-4e1e-80c7-acd7db95f139 service nova] Lock "902e4077-e0d6-4b61-a861-883be253f1e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:26:59 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-9b91a7e7-42cd-43aa-a138-eff9e7da7046 req-29d3e9e0-1fb8-4e1e-80c7-acd7db95f139 service nova] Lock "902e4077-e0d6-4b61-a861-883be253f1e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:26:59 user nova-compute[71731]: DEBUG nova.compute.manager [req-9b91a7e7-42cd-43aa-a138-eff9e7da7046 req-29d3e9e0-1fb8-4e1e-80c7-acd7db95f139 service nova] [instance: 902e4077-e0d6-4b61-a861-883be253f1e0] No waiting events found dispatching network-vif-unplugged-58b69a6e-8c04-42e5-931a-0947d9c0f78d {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:26:59 user nova-compute[71731]: DEBUG nova.compute.manager [req-9b91a7e7-42cd-43aa-a138-eff9e7da7046 req-29d3e9e0-1fb8-4e1e-80c7-acd7db95f139 service nova] [instance: 902e4077-e0d6-4b61-a861-883be253f1e0] Received event network-vif-unplugged-58b69a6e-8c04-42e5-931a-0947d9c0f78d for instance with task_state deleting. {{(pid=71731) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 16:26:59 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-be1f0e44-4d7f-4429-a718-bf4c73c90fe4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.511s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:26:59 user nova-compute[71731]: DEBUG nova.compute.manager [None req-be1f0e44-4d7f-4429-a718-bf4c73c90fe4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 0f52d9e3-921c-4f79-9cdb-7d73500c8c35] Start building networks asynchronously for instance. {{(pid=71731) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 16:26:59 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-be1f0e44-4d7f-4429-a718-bf4c73c90fe4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 0f52d9e3-921c-4f79-9cdb-7d73500c8c35] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 16:26:59 user nova-compute[71731]: DEBUG nova.compute.manager [None req-be1f0e44-4d7f-4429-a718-bf4c73c90fe4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 0f52d9e3-921c-4f79-9cdb-7d73500c8c35] Allocating IP information in the background. {{(pid=71731) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 16:26:59 user nova-compute[71731]: DEBUG nova.network.neutron [None req-be1f0e44-4d7f-4429-a718-bf4c73c90fe4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 0f52d9e3-921c-4f79-9cdb-7d73500c8c35] allocate_for_instance() {{(pid=71731) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 16:26:59 user nova-compute[71731]: DEBUG nova.compute.manager [None req-be1f0e44-4d7f-4429-a718-bf4c73c90fe4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 0f52d9e3-921c-4f79-9cdb-7d73500c8c35] Start building block device mappings for instance. {{(pid=71731) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 16:26:59 user nova-compute[71731]: INFO nova.virt.block_device [None req-be1f0e44-4d7f-4429-a718-bf4c73c90fe4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 0f52d9e3-921c-4f79-9cdb-7d73500c8c35] Booting with volume snapshot 4e1ba122-cfbe-44c9-a5b3-770ea148cbb8 at /dev/vda
Apr 13 16:26:59 user nova-compute[71731]: DEBUG nova.policy [None req-be1f0e44-4d7f-4429-a718-bf4c73c90fe4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd70e10f63cdd49a9a1ebe1fe4c9de0a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d451e0e239f486aa2b3abe9e273eab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71731) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 16:26:59 user nova-compute[71731]: INFO nova.virt.libvirt.driver [-] [instance: 902e4077-e0d6-4b61-a861-883be253f1e0] Instance destroyed successfully.
Apr 13 16:26:59 user nova-compute[71731]: DEBUG nova.objects.instance [None req-fadc2ade-5256-4641-ac83-c5c7d7c64dd3 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Lazy-loading 'resources' on Instance uuid 902e4077-e0d6-4b61-a861-883be253f1e0 {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:26:59 user nova-compute[71731]: DEBUG nova.virt.libvirt.vif [None req-fadc2ade-5256-4641-ac83-c5c7d7c64dd3 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T16:24:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1443848210',display_name='tempest-VolumesSnapshotTestJSON-instance-1443848210',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1443848210',id=18,image_ref='708622a9-7465-4492-ade8-b827198f7e30',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-13T16:24:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e7395d2408a44cc88cf88eb49d5f8503',ramdisk_id='',reservation_id='r-vx64glx6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='708622a9-7465-4492-ade8-b827198f7e30',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1985397600',owner_user_name='tempest-VolumesSnapshotTestJSON-1985397600-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T16:24:55Z,user_data=None,user_id='9223a3efe4bc4e37946c8ed718100de4',uuid=902e4077-e0d6-4b61-a861-883be253f1e0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "58b69a6e-8c04-42e5-931a-0947d9c0f78d", "address": "fa:16:3e:38:29:d6", "network": {"id": "aa17b8d5-dffb-42ba-bb7e-8909e5894bfb", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-386731779-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "e7395d2408a44cc88cf88eb49d5f8503", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58b69a6e-8c", "ovs_interfaceid": "58b69a6e-8c04-42e5-931a-0947d9c0f78d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 16:26:59 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-fadc2ade-5256-4641-ac83-c5c7d7c64dd3 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Converting VIF {"id": "58b69a6e-8c04-42e5-931a-0947d9c0f78d", "address": "fa:16:3e:38:29:d6", "network": {"id": "aa17b8d5-dffb-42ba-bb7e-8909e5894bfb", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-386731779-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "e7395d2408a44cc88cf88eb49d5f8503", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58b69a6e-8c", "ovs_interfaceid": "58b69a6e-8c04-42e5-931a-0947d9c0f78d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 16:26:59 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-fadc2ade-5256-4641-ac83-c5c7d7c64dd3 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:38:29:d6,bridge_name='br-int',has_traffic_filtering=True,id=58b69a6e-8c04-42e5-931a-0947d9c0f78d,network=Network(aa17b8d5-dffb-42ba-bb7e-8909e5894bfb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58b69a6e-8c') {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 16:26:59 user nova-compute[71731]: DEBUG os_vif [None req-fadc2ade-5256-4641-ac83-c5c7d7c64dd3 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:29:d6,bridge_name='br-int',has_traffic_filtering=True,id=58b69a6e-8c04-42e5-931a-0947d9c0f78d,network=Network(aa17b8d5-dffb-42ba-bb7e-8909e5894bfb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58b69a6e-8c') {{(pid=71731) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 16:26:59 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:26:59 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:26:59 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap58b69a6e-8c, bridge=br-int, if_exists=True) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:26:59 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:26:59 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 16:26:59 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:26:59 user nova-compute[71731]: INFO os_vif [None req-fadc2ade-5256-4641-ac83-c5c7d7c64dd3 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:29:d6,bridge_name='br-int',has_traffic_filtering=True,id=58b69a6e-8c04-42e5-931a-0947d9c0f78d,network=Network(aa17b8d5-dffb-42ba-bb7e-8909e5894bfb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58b69a6e-8c')
Apr 13 16:26:59 user nova-compute[71731]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fadc2ade-5256-4641-ac83-c5c7d7c64dd3 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] [instance: 902e4077-e0d6-4b61-a861-883be253f1e0] calling os-brick to detach iSCSI Volume {{(pid=71731) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 16:26:59 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-fadc2ade-5256-4641-ac83-c5c7d7c64dd3 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8cf0118790>, {'target_iqn': 'iqn.2010-10.org.openstack:6c64d091-303e-4a8b-bc23-ec85ca668f40', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bCLpiQET', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg': {}}" {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 16:26:59 user nova-compute[71731]: WARNING os_brick.initiator.connectors.base [None req-fadc2ade-5256-4641-ac83-c5c7d7c64dd3 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 16:26:59 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-fadc2ade-5256-4641-ac83-c5c7d7c64dd3 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 16:26:59 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-fadc2ade-5256-4641-ac83-c5c7d7c64dd3 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 16:26:59 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:26:59 user nova-compute[71731]: DEBUG nova.network.neutron [None req-be1f0e44-4d7f-4429-a718-bf4c73c90fe4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 0f52d9e3-921c-4f79-9cdb-7d73500c8c35] Successfully created port: d68dc4c7-5e6e-4d7f-8143-62eeb1816486 {{(pid=71731) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 16:27:00 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:27:00 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[2eb5acd1-2cff-4a0e-9733-8e54b3186ab6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e4317bfd-71c2-4c48-a0f0-e3c795f262a8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:eb2c60ec-fb52-436f-a98a-dfe15d1e3aa6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:27:00 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-fadc2ade-5256-4641-ac83-c5c7d7c64dd3 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 16:27:00 user nova-compute[71731]: No targets found.
Apr 13 16:27:00 user nova-compute[71731]: iSNS:
Apr 13 16:27:00 user nova-compute[71731]: No targets found.
Apr 13 16:27:00 user nova-compute[71731]: STATIC:
Apr 13 16:27:00 user nova-compute[71731]: Target: iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97
Apr 13 16:27:00 user nova-compute[71731]:         Portal: 172.16.0.220:3260,-1
Apr 13 16:27:00 user nova-compute[71731]:                 Iface Name: default
Apr 13 16:27:00 user nova-compute[71731]: Target: iqn.2010-10.org.openstack:e4317bfd-71c2-4c48-a0f0-e3c795f262a8
Apr 13 16:27:00 user nova-compute[71731]:         Portal: 172.16.0.220:3260,-1
Apr 13 16:27:00 user nova-compute[71731]:                 Iface Name: default
Apr 13 16:27:00 user nova-compute[71731]: Target: iqn.2010-10.org.openstack:eb2c60ec-fb52-436f-a98a-dfe15d1e3aa6
Apr 13 16:27:00 user nova-compute[71731]:         Portal: 172.16.0.220:3260,-1
Apr 13 16:27:00 user nova-compute[71731]:                 Iface Name: default
Apr 13 16:27:00 user nova-compute[71731]: Target: iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984
Apr 13 16:27:00 user nova-compute[71731]:         Portal: 172.16.0.220:3260,-1
Apr 13 16:27:00 user nova-compute[71731]:                 Iface Name: default
Apr 13 16:27:00 user nova-compute[71731]: FIRMWARE:
Apr 13 16:27:00 user nova-compute[71731]: No targets found.
Apr 13 16:27:00 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 16:27:00 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-fadc2ade-5256-4641-ac83-c5c7d7c64dd3 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 16:27:00 user nova-compute[71731]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 16:27:00 user nova-compute[71731]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71731) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 16:27:00 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-fadc2ade-5256-4641-ac83-c5c7d7c64dd3 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6c64d091-303e-4a8b-bc23-ec85ca668f40', 0)] {{(pid=71731) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 16:27:00 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:27:00 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:27:00 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[5404ffd4-5804-4aa8-b05e-42534ec747fb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e4317bfd-71c2-4c48-a0f0-e3c795f262a8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eb2c60ec-fb52-436f-a98a-dfe15d1e3aa6\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:27:00 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:27:00 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:27:00 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[3314b220-523c-4244-8a17-44b06dd75695]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4317bfd-71c2-4c48-a0f0-e3c795f262a8 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb2c60ec-fb52-436f-a98a-dfe15d1e3aa6 (non-flash)\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:27:00 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-fadc2ade-5256-4641-ac83-c5c7d7c64dd3 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)
Apr 13 16:27:00 user nova-compute[71731]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4317bfd-71c2-4c48-a0f0-e3c795f262a8 (non-flash)
Apr 13 16:27:00 user nova-compute[71731]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984 (non-flash)
Apr 13 16:27:00 user nova-compute[71731]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb2c60ec-fb52-436f-a98a-dfe15d1e3aa6 (non-flash)
Apr 13 16:27:00 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 16:27:00 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-fadc2ade-5256-4641-ac83-c5c7d7c64dd3 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)
Apr 13 16:27:00 user nova-compute[71731]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4317bfd-71c2-4c48-a0f0-e3c795f262a8 (non-flash)
Apr 13 16:27:00 user nova-compute[71731]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984 (non-flash)
Apr 13 16:27:00 user nova-compute[71731]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb2c60ec-fb52-436f-a98a-dfe15d1e3aa6 (non-flash)
Apr 13 16:27:00 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 16:27:00 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-fadc2ade-5256-4641-ac83-c5c7d7c64dd3 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8cf3fcc4c0>, {}) {{(pid=71731) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 16:27:00 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-fadc2ade-5256-4641-ac83-c5c7d7c64dd3 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Disconnecting from: [] {{(pid=71731) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 16:27:00 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-fadc2ade-5256-4641-ac83-c5c7d7c64dd3 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.087s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 16:27:00 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-fadc2ade-5256-4641-ac83-c5c7d7c64dd3 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] <== disconnect_volume: return (88ms) None {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 16:27:00 user nova-compute[71731]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fadc2ade-5256-4641-ac83-c5c7d7c64dd3 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] [instance: 902e4077-e0d6-4b61-a861-883be253f1e0] Disconnected iSCSI Volume {{(pid=71731) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 16:27:00 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-fadc2ade-5256-4641-ac83-c5c7d7c64dd3 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] [instance: 902e4077-e0d6-4b61-a861-883be253f1e0] Deleting instance files /opt/stack/data/nova/instances/902e4077-e0d6-4b61-a861-883be253f1e0_del
Apr 13 16:27:00 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-fadc2ade-5256-4641-ac83-c5c7d7c64dd3 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] [instance: 902e4077-e0d6-4b61-a861-883be253f1e0] Deletion of /opt/stack/data/nova/instances/902e4077-e0d6-4b61-a861-883be253f1e0_del complete
Apr 13 16:27:00 user nova-compute[71731]: INFO nova.compute.manager [None req-fadc2ade-5256-4641-ac83-c5c7d7c64dd3 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] [instance: 902e4077-e0d6-4b61-a861-883be253f1e0] Took 1.37 seconds to destroy the instance on the hypervisor.
Apr 13 16:27:00 user nova-compute[71731]: DEBUG oslo.service.loopingcall [None req-fadc2ade-5256-4641-ac83-c5c7d7c64dd3 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71731) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 16:27:00 user nova-compute[71731]: DEBUG nova.compute.manager [-] [instance: 902e4077-e0d6-4b61-a861-883be253f1e0] Deallocating network for instance {{(pid=71731) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 16:27:00 user nova-compute[71731]: DEBUG nova.network.neutron [-] [instance: 902e4077-e0d6-4b61-a861-883be253f1e0] deallocate_for_instance() {{(pid=71731) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 16:27:00 user nova-compute[71731]: DEBUG nova.compute.manager [req-f2a2353e-2261-44a2-be1b-982085958fa6 req-0913720f-d400-4f6e-a390-655a1a7fcf54 service nova] [instance: 235f827c-7116-48e9-84c5-0c9761c18e1e] Received event network-vif-plugged-b72a6c8b-7244-41c2-a4f7-6da43b4944b8 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:27:00 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-f2a2353e-2261-44a2-be1b-982085958fa6 req-0913720f-d400-4f6e-a390-655a1a7fcf54 service nova] Acquiring lock "235f827c-7116-48e9-84c5-0c9761c18e1e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:27:00 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-f2a2353e-2261-44a2-be1b-982085958fa6 req-0913720f-d400-4f6e-a390-655a1a7fcf54 service nova] Lock "235f827c-7116-48e9-84c5-0c9761c18e1e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:27:00 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-f2a2353e-2261-44a2-be1b-982085958fa6 req-0913720f-d400-4f6e-a390-655a1a7fcf54 service nova] Lock "235f827c-7116-48e9-84c5-0c9761c18e1e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:27:00 user nova-compute[71731]: DEBUG nova.compute.manager [req-f2a2353e-2261-44a2-be1b-982085958fa6 req-0913720f-d400-4f6e-a390-655a1a7fcf54 service nova] [instance: 235f827c-7116-48e9-84c5-0c9761c18e1e] No waiting events found dispatching network-vif-plugged-b72a6c8b-7244-41c2-a4f7-6da43b4944b8 {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:27:00 user nova-compute[71731]: WARNING nova.compute.manager [req-f2a2353e-2261-44a2-be1b-982085958fa6 req-0913720f-d400-4f6e-a390-655a1a7fcf54 service nova] [instance: 235f827c-7116-48e9-84c5-0c9761c18e1e] Received unexpected event network-vif-plugged-b72a6c8b-7244-41c2-a4f7-6da43b4944b8 for instance with vm_state rescued and task_state unrescuing.
Apr 13 16:27:00 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:27:00 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:27:00 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:27:00 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:27:00 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:27:00 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:27:00 user nova-compute[71731]: DEBUG nova.network.neutron [-] [instance: 902e4077-e0d6-4b61-a861-883be253f1e0] Updating instance_info_cache with network_info: [] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:27:00 user nova-compute[71731]: INFO nova.compute.manager [-] [instance: 902e4077-e0d6-4b61-a861-883be253f1e0] Took 0.79 seconds to deallocate network for instance.
Apr 13 16:27:00 user nova-compute[71731]: WARNING nova.volume.cinder [None req-fadc2ade-5256-4641-ac83-c5c7d7c64dd3 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Attachment a1e1a71b-2444-48b8-ae94-c8f47a540dc2 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = a1e1a71b-2444-48b8-ae94-c8f47a540dc2. (HTTP 404) (Request-ID: req-7f760504-73a5-468d-a3d5-9cc7004fb8be)
Apr 13 16:27:00 user nova-compute[71731]: INFO nova.compute.manager [None req-fadc2ade-5256-4641-ac83-c5c7d7c64dd3 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] [instance: 902e4077-e0d6-4b61-a861-883be253f1e0] Took 0.03 seconds to detach 1 volumes for instance.
Apr 13 16:27:01 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-fadc2ade-5256-4641-ac83-c5c7d7c64dd3 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:27:01 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-fadc2ade-5256-4641-ac83-c5c7d7c64dd3 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:27:01 user nova-compute[71731]: DEBUG nova.compute.manager [req-97e5f2ad-e377-4378-b794-7a3e49fbb72a req-3b07f85e-15c0-444b-a677-8511d2fbfdfd service nova] [instance: 902e4077-e0d6-4b61-a861-883be253f1e0] Received event network-vif-plugged-58b69a6e-8c04-42e5-931a-0947d9c0f78d {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:27:01 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-97e5f2ad-e377-4378-b794-7a3e49fbb72a req-3b07f85e-15c0-444b-a677-8511d2fbfdfd service nova] Acquiring lock "902e4077-e0d6-4b61-a861-883be253f1e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:27:01 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-97e5f2ad-e377-4378-b794-7a3e49fbb72a req-3b07f85e-15c0-444b-a677-8511d2fbfdfd service nova] Lock "902e4077-e0d6-4b61-a861-883be253f1e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:27:01 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-97e5f2ad-e377-4378-b794-7a3e49fbb72a req-3b07f85e-15c0-444b-a677-8511d2fbfdfd service nova] Lock "902e4077-e0d6-4b61-a861-883be253f1e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:27:01 user nova-compute[71731]: DEBUG nova.compute.manager [req-97e5f2ad-e377-4378-b794-7a3e49fbb72a req-3b07f85e-15c0-444b-a677-8511d2fbfdfd service nova] [instance: 902e4077-e0d6-4b61-a861-883be253f1e0] No waiting events found dispatching network-vif-plugged-58b69a6e-8c04-42e5-931a-0947d9c0f78d {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:27:01 user nova-compute[71731]: WARNING nova.compute.manager [req-97e5f2ad-e377-4378-b794-7a3e49fbb72a req-3b07f85e-15c0-444b-a677-8511d2fbfdfd service nova] [instance: 902e4077-e0d6-4b61-a861-883be253f1e0] Received unexpected event network-vif-plugged-58b69a6e-8c04-42e5-931a-0947d9c0f78d for instance with vm_state deleted and task_state None.
Apr 13 16:27:01 user nova-compute[71731]: DEBUG nova.compute.manager [req-97e5f2ad-e377-4378-b794-7a3e49fbb72a req-3b07f85e-15c0-444b-a677-8511d2fbfdfd service nova] [instance: 902e4077-e0d6-4b61-a861-883be253f1e0] Received event network-vif-deleted-58b69a6e-8c04-42e5-931a-0947d9c0f78d {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:27:01 user nova-compute[71731]: DEBUG nova.network.neutron [None req-be1f0e44-4d7f-4429-a718-bf4c73c90fe4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 0f52d9e3-921c-4f79-9cdb-7d73500c8c35] Successfully updated port: d68dc4c7-5e6e-4d7f-8143-62eeb1816486 {{(pid=71731) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 16:27:01 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-be1f0e44-4d7f-4429-a718-bf4c73c90fe4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Acquiring lock "refresh_cache-0f52d9e3-921c-4f79-9cdb-7d73500c8c35" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 16:27:01 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-be1f0e44-4d7f-4429-a718-bf4c73c90fe4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Acquired lock "refresh_cache-0f52d9e3-921c-4f79-9cdb-7d73500c8c35" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 16:27:01 user nova-compute[71731]: DEBUG nova.network.neutron [None req-be1f0e44-4d7f-4429-a718-bf4c73c90fe4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 0f52d9e3-921c-4f79-9cdb-7d73500c8c35] Building network info cache for instance {{(pid=71731) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 16:27:01 user nova-compute[71731]: DEBUG nova.network.neutron [None req-be1f0e44-4d7f-4429-a718-bf4c73c90fe4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 0f52d9e3-921c-4f79-9cdb-7d73500c8c35] Instance cache missing network info. {{(pid=71731) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 16:27:01 user nova-compute[71731]: DEBUG nova.compute.provider_tree [None req-fadc2ade-5256-4641-ac83-c5c7d7c64dd3 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Inventory has not changed in ProviderTree for provider: cb6b1a64-0c24-4e2d-af1e-16576ca9165c {{(pid=71731) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 16:27:01 user nova-compute[71731]: DEBUG nova.scheduler.client.report [None req-fadc2ade-5256-4641-ac83-c5c7d7c64dd3 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Inventory has not changed for provider cb6b1a64-0c24-4e2d-af1e-16576ca9165c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71731) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 16:27:01 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-fadc2ade-5256-4641-ac83-c5c7d7c64dd3 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.343s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:27:01 user nova-compute[71731]: INFO nova.scheduler.client.report [None req-fadc2ade-5256-4641-ac83-c5c7d7c64dd3 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Deleted allocations for instance 902e4077-e0d6-4b61-a861-883be253f1e0
Apr 13 16:27:01 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-fadc2ade-5256-4641-ac83-c5c7d7c64dd3 tempest-VolumesSnapshotTestJSON-1985397600 tempest-VolumesSnapshotTestJSON-1985397600-project-member] Lock "902e4077-e0d6-4b61-a861-883be253f1e0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.729s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:27:01 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "902e4077-e0d6-4b61-a861-883be253f1e0" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 3.930s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:27:01 user nova-compute[71731]: INFO nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] [instance: 902e4077-e0d6-4b61-a861-883be253f1e0] During sync_power_state the instance has a pending task (deleting). Skip.
Apr 13 16:27:01 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "902e4077-e0d6-4b61-a861-883be253f1e0" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:27:01 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:27:01 user nova-compute[71731]: DEBUG nova.network.neutron [None req-be1f0e44-4d7f-4429-a718-bf4c73c90fe4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 0f52d9e3-921c-4f79-9cdb-7d73500c8c35] Updating instance_info_cache with network_info: [{"id": "d68dc4c7-5e6e-4d7f-8143-62eeb1816486", "address": "fa:16:3e:38:ee:28", "network": {"id": "d36bc206-f629-4d6e-8a3f-458061d7b525", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-893271134-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d451e0e239f486aa2b3abe9e273eab3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd68dc4c7-5e", "ovs_interfaceid": "d68dc4c7-5e6e-4d7f-8143-62eeb1816486", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:27:01 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-be1f0e44-4d7f-4429-a718-bf4c73c90fe4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Releasing lock "refresh_cache-0f52d9e3-921c-4f79-9cdb-7d73500c8c35" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 16:27:01 user nova-compute[71731]: DEBUG nova.compute.manager [None req-be1f0e44-4d7f-4429-a718-bf4c73c90fe4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 0f52d9e3-921c-4f79-9cdb-7d73500c8c35] Instance network_info: |[{"id": "d68dc4c7-5e6e-4d7f-8143-62eeb1816486", "address": "fa:16:3e:38:ee:28", "network": {"id": "d36bc206-f629-4d6e-8a3f-458061d7b525", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-893271134-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d451e0e239f486aa2b3abe9e273eab3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd68dc4c7-5e", "ovs_interfaceid": "d68dc4c7-5e6e-4d7f-8143-62eeb1816486", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71731) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 16:27:02 user nova-compute[71731]: DEBUG nova.compute.manager [req-a6ae7682-5970-4e12-9e32-d498bce97ae0 req-84e0b9c0-a13a-45cd-b69b-b9fc28478843 service nova] [instance: 235f827c-7116-48e9-84c5-0c9761c18e1e] Received event network-vif-plugged-b72a6c8b-7244-41c2-a4f7-6da43b4944b8 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:27:02 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-a6ae7682-5970-4e12-9e32-d498bce97ae0 req-84e0b9c0-a13a-45cd-b69b-b9fc28478843 service nova] Acquiring lock "235f827c-7116-48e9-84c5-0c9761c18e1e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:27:02 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-a6ae7682-5970-4e12-9e32-d498bce97ae0 req-84e0b9c0-a13a-45cd-b69b-b9fc28478843 service nova] Lock "235f827c-7116-48e9-84c5-0c9761c18e1e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:27:02 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-a6ae7682-5970-4e12-9e32-d498bce97ae0 req-84e0b9c0-a13a-45cd-b69b-b9fc28478843 service nova] Lock "235f827c-7116-48e9-84c5-0c9761c18e1e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:27:02 user nova-compute[71731]: DEBUG nova.compute.manager [req-a6ae7682-5970-4e12-9e32-d498bce97ae0 req-84e0b9c0-a13a-45cd-b69b-b9fc28478843 service nova] [instance: 235f827c-7116-48e9-84c5-0c9761c18e1e] No waiting events found dispatching network-vif-plugged-b72a6c8b-7244-41c2-a4f7-6da43b4944b8 {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:27:02 user nova-compute[71731]: WARNING nova.compute.manager [req-a6ae7682-5970-4e12-9e32-d498bce97ae0 req-84e0b9c0-a13a-45cd-b69b-b9fc28478843 service nova] [instance: 235f827c-7116-48e9-84c5-0c9761c18e1e] Received unexpected event network-vif-plugged-b72a6c8b-7244-41c2-a4f7-6da43b4944b8 for instance with vm_state rescued and task_state unrescuing.
Apr 13 16:27:02 user nova-compute[71731]: DEBUG nova.compute.manager [req-a6ae7682-5970-4e12-9e32-d498bce97ae0 req-84e0b9c0-a13a-45cd-b69b-b9fc28478843 service nova] [instance: 235f827c-7116-48e9-84c5-0c9761c18e1e] Received event network-vif-plugged-b72a6c8b-7244-41c2-a4f7-6da43b4944b8 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:27:02 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-a6ae7682-5970-4e12-9e32-d498bce97ae0 req-84e0b9c0-a13a-45cd-b69b-b9fc28478843 service nova] Acquiring lock "235f827c-7116-48e9-84c5-0c9761c18e1e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:27:02 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-a6ae7682-5970-4e12-9e32-d498bce97ae0 req-84e0b9c0-a13a-45cd-b69b-b9fc28478843 service nova] Lock "235f827c-7116-48e9-84c5-0c9761c18e1e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:27:02 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-a6ae7682-5970-4e12-9e32-d498bce97ae0 req-84e0b9c0-a13a-45cd-b69b-b9fc28478843 service nova] Lock "235f827c-7116-48e9-84c5-0c9761c18e1e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:27:02 user nova-compute[71731]: DEBUG nova.compute.manager [req-a6ae7682-5970-4e12-9e32-d498bce97ae0 req-84e0b9c0-a13a-45cd-b69b-b9fc28478843 service nova] [instance: 235f827c-7116-48e9-84c5-0c9761c18e1e] No waiting events found dispatching network-vif-plugged-b72a6c8b-7244-41c2-a4f7-6da43b4944b8 {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:27:02 user nova-compute[71731]: WARNING nova.compute.manager [req-a6ae7682-5970-4e12-9e32-d498bce97ae0 req-84e0b9c0-a13a-45cd-b69b-b9fc28478843 service nova] [instance: 235f827c-7116-48e9-84c5-0c9761c18e1e] Received unexpected event network-vif-plugged-b72a6c8b-7244-41c2-a4f7-6da43b4944b8 for instance with vm_state rescued and task_state unrescuing.
Apr 13 16:27:02 user nova-compute[71731]: DEBUG nova.virt.libvirt.host [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Removed pending event for 235f827c-7116-48e9-84c5-0c9761c18e1e due to event {{(pid=71731) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 13 16:27:02 user nova-compute[71731]: DEBUG nova.virt.driver [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Emitting event <LifecycleEvent: 1681403222.503486, 235f827c-7116-48e9-84c5-0c9761c18e1e => Resumed> {{(pid=71731) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 16:27:02 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 235f827c-7116-48e9-84c5-0c9761c18e1e] VM Resumed (Lifecycle Event)
Apr 13 16:27:02 user nova-compute[71731]: DEBUG nova.compute.manager [None req-0e88a05e-c4ef-4adc-8c74-1e9f3b628392 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: 235f827c-7116-48e9-84c5-0c9761c18e1e] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:27:02 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 235f827c-7116-48e9-84c5-0c9761c18e1e] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:27:02 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 235f827c-7116-48e9-84c5-0c9761c18e1e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71731) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 16:27:02 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 235f827c-7116-48e9-84c5-0c9761c18e1e] During sync_power_state the instance has a pending task (unrescuing). Skip.
Apr 13 16:27:02 user nova-compute[71731]: DEBUG nova.virt.driver [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Emitting event <LifecycleEvent: 1681403222.5051942, 235f827c-7116-48e9-84c5-0c9761c18e1e => Started> {{(pid=71731) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 16:27:02 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 235f827c-7116-48e9-84c5-0c9761c18e1e] VM Started (Lifecycle Event)
Apr 13 16:27:02 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 235f827c-7116-48e9-84c5-0c9761c18e1e] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:27:02 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 235f827c-7116-48e9-84c5-0c9761c18e1e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71731) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 16:27:03 user nova-compute[71731]: DEBUG nova.compute.manager [req-8fdee42c-fc23-42b2-8683-e8ae5e901b3b req-84d6669d-90d3-4a50-b4e1-d2fa9a11e426 service nova] [instance: 0f52d9e3-921c-4f79-9cdb-7d73500c8c35] Received event network-changed-d68dc4c7-5e6e-4d7f-8143-62eeb1816486 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:27:03 user nova-compute[71731]: DEBUG nova.compute.manager [req-8fdee42c-fc23-42b2-8683-e8ae5e901b3b req-84d6669d-90d3-4a50-b4e1-d2fa9a11e426 service nova] [instance: 0f52d9e3-921c-4f79-9cdb-7d73500c8c35] Refreshing instance network info cache due to event network-changed-d68dc4c7-5e6e-4d7f-8143-62eeb1816486. {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 16:27:03 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-8fdee42c-fc23-42b2-8683-e8ae5e901b3b req-84d6669d-90d3-4a50-b4e1-d2fa9a11e426 service nova] Acquiring lock "refresh_cache-0f52d9e3-921c-4f79-9cdb-7d73500c8c35" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 16:27:03 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-8fdee42c-fc23-42b2-8683-e8ae5e901b3b req-84d6669d-90d3-4a50-b4e1-d2fa9a11e426 service nova] Acquired lock "refresh_cache-0f52d9e3-921c-4f79-9cdb-7d73500c8c35" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 16:27:03 user nova-compute[71731]: DEBUG nova.network.neutron [req-8fdee42c-fc23-42b2-8683-e8ae5e901b3b req-84d6669d-90d3-4a50-b4e1-d2fa9a11e426 service nova] [instance: 0f52d9e3-921c-4f79-9cdb-7d73500c8c35] Refreshing network info cache for port d68dc4c7-5e6e-4d7f-8143-62eeb1816486 {{(pid=71731) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 16:27:03 user nova-compute[71731]: DEBUG nova.network.neutron [req-8fdee42c-fc23-42b2-8683-e8ae5e901b3b req-84d6669d-90d3-4a50-b4e1-d2fa9a11e426 service nova] [instance: 0f52d9e3-921c-4f79-9cdb-7d73500c8c35] Updated VIF entry in instance network info cache for port d68dc4c7-5e6e-4d7f-8143-62eeb1816486. {{(pid=71731) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 16:27:03 user nova-compute[71731]: DEBUG nova.network.neutron [req-8fdee42c-fc23-42b2-8683-e8ae5e901b3b req-84d6669d-90d3-4a50-b4e1-d2fa9a11e426 service nova] [instance: 0f52d9e3-921c-4f79-9cdb-7d73500c8c35] Updating instance_info_cache with network_info: [{"id": "d68dc4c7-5e6e-4d7f-8143-62eeb1816486", "address": "fa:16:3e:38:ee:28", "network": {"id": "d36bc206-f629-4d6e-8a3f-458061d7b525", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-893271134-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d451e0e239f486aa2b3abe9e273eab3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd68dc4c7-5e", "ovs_interfaceid": "d68dc4c7-5e6e-4d7f-8143-62eeb1816486", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:27:03 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-8fdee42c-fc23-42b2-8683-e8ae5e901b3b req-84d6669d-90d3-4a50-b4e1-d2fa9a11e426 service nova] Releasing lock "refresh_cache-0f52d9e3-921c-4f79-9cdb-7d73500c8c35" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 16:27:04 user nova-compute[71731]: DEBUG os_brick.utils [None req-be1f0e44-4d7f-4429-a718-bf4c73c90fe4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 16:27:04 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:27:04 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:27:04 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebb1c574-ec13-4b20-9db3-f48b82809206]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:81501d91421\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:27:04 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:27:04 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:27:04 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[c262de18-41c2-44c1-9d45-87cce0937dc3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:27:04 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:27:04 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:27:04 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:27:04 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[4866384d-4f2d-475b-9a24-d5d74b4f40d3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:27:04 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[d15e2a96-fcd4-4ab9-8588-42099f774488]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:27:04 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-be1f0e44-4d7f-4429-a718-bf4c73c90fe4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Running cmd (subprocess): nvme version {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:27:04 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-be1f0e44-4d7f-4429-a718-bf4c73c90fe4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] 'nvme version' failed. Not Retrying. {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 16:27:04 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.nvmeof [None req-be1f0e44-4d7f-4429-a718-bf4c73c90fe4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] nvme not present on system {{(pid=71731) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 16:27:05 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:27:05 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 16:27:05 user nova-compute[71731]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 16:27:05 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[39fa710a-d3c6-445c-8082-809d657ac464]: (4, '') {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:27:05 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.lightos [None req-be1f0e44-4d7f-4429-a718-bf4c73c90fe4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71731) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 16:27:05 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.lightos [None req-be1f0e44-4d7f-4429-a718-bf4c73c90fe4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71731) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 16:27:05 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.lightos [None req-be1f0e44-4d7f-4429-a718-bf4c73c90fe4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] LIGHTOS: no hostnqn found. {{(pid=71731) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 16:27:05 user nova-compute[71731]: DEBUG os_brick.utils [None req-be1f0e44-4d7f-4429-a718-bf4c73c90fe4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:81501d91421', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 16:27:05 user nova-compute[71731]: DEBUG nova.virt.block_device [None req-be1f0e44-4d7f-4429-a718-bf4c73c90fe4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 0f52d9e3-921c-4f79-9cdb-7d73500c8c35] Updating existing volume attachment record: c32f719e-5731-4935-9f6b-d8102b510989 {{(pid=71731) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 16:27:09 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:27:09 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager.update_available_resource {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:27:09 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:27:09 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:27:09 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:27:09 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Auditing locally available compute resources for user (node: user) {{(pid=71731) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 16:27:09 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=71731) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 16:27:09 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acbcaee0-a47b-4fee-8765-9b1c9597d515/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:27:09 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acbcaee0-a47b-4fee-8765-9b1c9597d515/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:27:09 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acbcaee0-a47b-4fee-8765-9b1c9597d515/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:27:09 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acbcaee0-a47b-4fee-8765-9b1c9597d515/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:27:09 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7973e93b-6311-44ed-91ff-e861c32d0277/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:27:09 user nova-compute[71731]: DEBUG nova.compute.manager [None req-be1f0e44-4d7f-4429-a718-bf4c73c90fe4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 0f52d9e3-921c-4f79-9cdb-7d73500c8c35] Start spawning the instance on the hypervisor. {{(pid=71731) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 16:27:09 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-be1f0e44-4d7f-4429-a718-bf4c73c90fe4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 0f52d9e3-921c-4f79-9cdb-7d73500c8c35] Creating instance directory {{(pid=71731) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 16:27:09 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-be1f0e44-4d7f-4429-a718-bf4c73c90fe4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 0f52d9e3-921c-4f79-9cdb-7d73500c8c35] Creating image(s)
Apr 13 16:27:09 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-be1f0e44-4d7f-4429-a718-bf4c73c90fe4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 0f52d9e3-921c-4f79-9cdb-7d73500c8c35] Did not create local disks {{(pid=71731) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 13 16:27:09 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-be1f0e44-4d7f-4429-a718-bf4c73c90fe4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 0f52d9e3-921c-4f79-9cdb-7d73500c8c35] Ensure instance console log exists: /opt/stack/data/nova/instances/0f52d9e3-921c-4f79-9cdb-7d73500c8c35/console.log {{(pid=71731) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 16:27:09 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-be1f0e44-4d7f-4429-a718-bf4c73c90fe4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:27:09 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-be1f0e44-4d7f-4429-a718-bf4c73c90fe4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:27:09 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-be1f0e44-4d7f-4429-a718-bf4c73c90fe4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:27:09 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-be1f0e44-4d7f-4429-a718-bf4c73c90fe4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 0f52d9e3-921c-4f79-9cdb-7d73500c8c35] Start _get_guest_xml network_info=[{"id": "d68dc4c7-5e6e-4d7f-8143-62eeb1816486", "address": "fa:16:3e:38:ee:28", "network": {"id": "d36bc206-f629-4d6e-8a3f-458061d7b525", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-893271134-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d451e0e239f486aa2b3abe9e273eab3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd68dc4c7-5e", "ovs_interfaceid": "d68dc4c7-5e6e-4d7f-8143-62eeb1816486", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-04-13T16:26:56Z,direct_url=<?>,disk_format='qcow2',id=02551df5-2d31-40a8-8d99-40af9cae089b,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-417163356',owner='8d451e0e239f486aa2b3abe9e273eab3',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-04-13T16:26:57Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'attachment_id': 'c32f719e-5731-4935-9f6b-d8102b510989', 'mount_device': '/dev/vda', 'delete_on_termination': True, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:f45c196f-e69b-4a40-8a72-2e5a3b2dbe82', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DSrgohBL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '0f52d9e3-921c-4f79-9cdb-7d73500c8c35', 'attached_at': '', 'detached_at': '', 'volume_id': 'f45c196f-e69b-4a40-8a72-2e5a3b2dbe82', 'serial': 'f45c196f-e69b-4a40-8a72-2e5a3b2dbe82'}, 'disk_bus': 'virtio', 'guest_format': None, 'volume_type': None} {{(pid=71731) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 16:27:09 user nova-compute[71731]: WARNING nova.virt.libvirt.driver [None req-be1f0e44-4d7f-4429-a718-bf4c73c90fe4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 16:27:09 user nova-compute[71731]: WARNING nova.virt.libvirt.driver [None req-be1f0e44-4d7f-4429-a718-bf4c73c90fe4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 16:27:09 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-be1f0e44-4d7f-4429-a718-bf4c73c90fe4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71731) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 16:27:09 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-be1f0e44-4d7f-4429-a718-bf4c73c90fe4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T16:17:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-04-13T16:26:56Z,direct_url=<?>,disk_format='qcow2',id=02551df5-2d31-40a8-8d99-40af9cae089b,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-417163356',owner='8d451e0e239f486aa2b3abe9e273eab3',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-04-13T16:26:57Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 16:27:09 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-be1f0e44-4d7f-4429-a718-bf4c73c90fe4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Flavor limits 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 16:27:09 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-be1f0e44-4d7f-4429-a718-bf4c73c90fe4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Image limits 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 16:27:09 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-be1f0e44-4d7f-4429-a718-bf4c73c90fe4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Flavor pref 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 16:27:09 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-be1f0e44-4d7f-4429-a718-bf4c73c90fe4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Image pref 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 16:27:09 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-be1f0e44-4d7f-4429-a718-bf4c73c90fe4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 16:27:09 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-be1f0e44-4d7f-4429-a718-bf4c73c90fe4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 16:27:09 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-be1f0e44-4d7f-4429-a718-bf4c73c90fe4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71731) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 16:27:09 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-be1f0e44-4d7f-4429-a718-bf4c73c90fe4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Got 1 possible topologies {{(pid=71731) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 16:27:09 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-be1f0e44-4d7f-4429-a718-bf4c73c90fe4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 16:27:09 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-be1f0e44-4d7f-4429-a718-bf4c73c90fe4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 16:27:09 user nova-compute[71731]: DEBUG nova.virt.libvirt.volume.iscsi [None req-be1f0e44-4d7f-4429-a718-bf4c73c90fe4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 0f52d9e3-921c-4f79-9cdb-7d73500c8c35] Calling os-brick to attach iSCSI Volume {{(pid=71731) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 16:27:09 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-be1f0e44-4d7f-4429-a718-bf4c73c90fe4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8cf0118790>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f45c196f-e69b-4a40-8a72-2e5a3b2dbe82', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DSrgohBL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 16:27:09 user nova-compute[71731]: WARNING os_brick.initiator.connectors.base [None req-be1f0e44-4d7f-4429-a718-bf4c73c90fe4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 16:27:09 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-be1f0e44-4d7f-4429-a718-bf4c73c90fe4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 16:27:09 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-be1f0e44-4d7f-4429-a718-bf4c73c90fe4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 16:27:09 user nova-compute[71731]: WARNING os_brick.initiator.connectors.base [None req-be1f0e44-4d7f-4429-a718-bf4c73c90fe4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 16:27:09 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-be1f0e44-4d7f-4429-a718-bf4c73c90fe4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f45c196f-e69b-4a40-8a72-2e5a3b2dbe82" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 16:27:09 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-be1f0e44-4d7f-4429-a718-bf4c73c90fe4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f45c196f-e69b-4a40-8a72-2e5a3b2dbe82" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 16:27:09 user nova-compute[71731]: INFO os_brick.initiator.connectors.iscsi [None req-be1f0e44-4d7f-4429-a718-bf4c73c90fe4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 16:27:09 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f45c196f-e69b-4a40-8a72-2e5a3b2dbe82 -p 172.16.0.220:3260 {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:27:09 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7973e93b-6311-44ed-91ff-e861c32d0277/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:27:09 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7973e93b-6311-44ed-91ff-e861c32d0277/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:27:09 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f45c196f-e69b-4a40-8a72-2e5a3b2dbe82 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:27:09 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[4999c232-3d7d-4aa1-9ccc-2e42207efdd0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:27:09 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-be1f0e44-4d7f-4429-a718-bf4c73c90fe4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 16:27:09 user nova-compute[71731]:  {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:27:09 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f45c196f-e69b-4a40-8a72-2e5a3b2dbe82 -p 172.16.0.220:3260 --interface default --op new {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:27:09 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f45c196f-e69b-4a40-8a72-2e5a3b2dbe82 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:27:09 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae8ecbe1-94bd-455b-bea4-72d30d1b3697]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f45c196f-e69b-4a40-8a72-2e5a3b2dbe82] added\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:27:09 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-be1f0e44-4d7f-4429-a718-bf4c73c90fe4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f45c196f-e69b-4a40-8a72-2e5a3b2dbe82] added
Apr 13 16:27:09 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:27:09 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f45c196f-e69b-4a40-8a72-2e5a3b2dbe82 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:27:09 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f45c196f-e69b-4a40-8a72-2e5a3b2dbe82 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:27:09 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[abbb6997-6b01-4586-859d-63bdd801b2f6]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:27:09 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-be1f0e44-4d7f-4429-a718-bf4c73c90fe4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:27:09 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f45c196f-e69b-4a40-8a72-2e5a3b2dbe82 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:27:09 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f45c196f-e69b-4a40-8a72-2e5a3b2dbe82 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:27:09 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[03517c08-5273-4334-b542-40fe47c7916d]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:27:09 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-be1f0e44-4d7f-4429-a718-bf4c73c90fe4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:27:09 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f45c196f-e69b-4a40-8a72-2e5a3b2dbe82 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DSrgohBL {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:27:09 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f45c196f-e69b-4a40-8a72-2e5a3b2dbe82 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DSrgohBL" returned: 0 in 0.019s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:27:09 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[58a84845-14b2-4a7e-9a08-8eeaefc3a040]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:27:09 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-be1f0e44-4d7f-4429-a718-bf4c73c90fe4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DSrgohBL'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:27:09 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f45c196f-e69b-4a40-8a72-2e5a3b2dbe82 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:27:09 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7973e93b-6311-44ed-91ff-e861c32d0277/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:27:09 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f45c196f-e69b-4a40-8a72-2e5a3b2dbe82 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:27:09 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[9277d2cb-0e76-4716-aca9-f90ee1bd0592]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:27:09 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-be1f0e44-4d7f-4429-a718-bf4c73c90fe4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:27:09 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:27:09 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=71731) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 16:27:09 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66553f5-5e1b-4f1d-8c5a-63bc340f7586/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:27:09 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:27:09 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[0caae690-6d8e-410b-b912-ed6b891742b8]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4317bfd-71c2-4c48-a0f0-e3c795f262a8 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb2c60ec-fb52-436f-a98a-dfe15d1e3aa6 (non-flash)\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:27:09 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-be1f0e44-4d7f-4429-a718-bf4c73c90fe4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)
Apr 13 16:27:09 user nova-compute[71731]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4317bfd-71c2-4c48-a0f0-e3c795f262a8 (non-flash)
Apr 13 16:27:09 user nova-compute[71731]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984 (non-flash)
Apr 13 16:27:09 user nova-compute[71731]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb2c60ec-fb52-436f-a98a-dfe15d1e3aa6 (non-flash)
Apr 13 16:27:09 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 16:27:09 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-be1f0e44-4d7f-4429-a718-bf4c73c90fe4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)
Apr 13 16:27:09 user nova-compute[71731]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4317bfd-71c2-4c48-a0f0-e3c795f262a8 (non-flash)
Apr 13 16:27:09 user nova-compute[71731]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984 (non-flash)
Apr 13 16:27:09 user nova-compute[71731]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb2c60ec-fb52-436f-a98a-dfe15d1e3aa6 (non-flash)
Apr 13 16:27:09 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 16:27:09 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f45c196f-e69b-4a40-8a72-2e5a3b2dbe82 -p 172.16.0.220:3260 --login {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:27:09 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f45c196f-e69b-4a40-8a72-2e5a3b2dbe82 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:27:09 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[45a0e75b-4c23-4840-8a5f-993f6b3ea109]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f45c196f-e69b-4a40-8a72-2e5a3b2dbe82, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f45c196f-e69b-4a40-8a72-2e5a3b2dbe82, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:27:09 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-be1f0e44-4d7f-4429-a718-bf4c73c90fe4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f45c196f-e69b-4a40-8a72-2e5a3b2dbe82, portal: 172.16.0.220,3260]
Apr 13 16:27:09 user nova-compute[71731]: Login to [iface: default, target: iqn.2010-10.org.openstack:f45c196f-e69b-4a40-8a72-2e5a3b2dbe82, portal: 172.16.0.220,3260] successful.
Apr 13 16:27:09 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:27:09 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f45c196f-e69b-4a40-8a72-2e5a3b2dbe82 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:27:09 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f45c196f-e69b-4a40-8a72-2e5a3b2dbe82 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:27:09 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[a10546a5-5a3d-45df-9918-28470d05b464]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:27:09 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-be1f0e44-4d7f-4429-a718-bf4c73c90fe4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:27:09 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:27:09 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:27:09 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:27:09 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[be79e87a-2b08-4d8a-a40e-2e8978cdd3f4]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4317bfd-71c2-4c48-a0f0-e3c795f262a8 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb2c60ec-fb52-436f-a98a-dfe15d1e3aa6 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f45c196f-e69b-4a40-8a72-2e5a3b2dbe82 (non-flash)\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:27:09 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-be1f0e44-4d7f-4429-a718-bf4c73c90fe4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)
Apr 13 16:27:09 user nova-compute[71731]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4317bfd-71c2-4c48-a0f0-e3c795f262a8 (non-flash)
Apr 13 16:27:09 user nova-compute[71731]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984 (non-flash)
Apr 13 16:27:09 user nova-compute[71731]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb2c60ec-fb52-436f-a98a-dfe15d1e3aa6 (non-flash)
Apr 13 16:27:09 user nova-compute[71731]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f45c196f-e69b-4a40-8a72-2e5a3b2dbe82 (non-flash)
Apr 13 16:27:09 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 16:27:09 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-be1f0e44-4d7f-4429-a718-bf4c73c90fe4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)
Apr 13 16:27:09 user nova-compute[71731]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4317bfd-71c2-4c48-a0f0-e3c795f262a8 (non-flash)
Apr 13 16:27:09 user nova-compute[71731]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984 (non-flash)
Apr 13 16:27:09 user nova-compute[71731]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb2c60ec-fb52-436f-a98a-dfe15d1e3aa6 (non-flash)
Apr 13 16:27:09 user nova-compute[71731]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f45c196f-e69b-4a40-8a72-2e5a3b2dbe82 (non-flash)
Apr 13 16:27:09 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 16:27:09 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-be1f0e44-4d7f-4429-a718-bf4c73c90fe4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f45c196f-e69b-4a40-8a72-2e5a3b2dbe82" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.341s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 16:27:09 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-be1f0e44-4d7f-4429-a718-bf4c73c90fe4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Connected to 172.16.0.220:3260 {{(pid=71731) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 16:27:09 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-be1f0e44-4d7f-4429-a718-bf4c73c90fe4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] HCTL ('33', '-', '-', 0) found on session 23 with lun 0 {{(pid=71731) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 16:27:09 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-be1f0e44-4d7f-4429-a718-bf4c73c90fe4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71731) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 16:27:09 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66553f5-5e1b-4f1d-8c5a-63bc340f7586/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:27:09 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66553f5-5e1b-4f1d-8c5a-63bc340f7586/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:27:10 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:27:10 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:27:10 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7384fb2-889d-4541-b1bb-c869ead2f651]: (4, ('- - 0', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:27:10 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-be1f0e44-4d7f-4429-a718-bf4c73c90fe4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Searching for a device in session 23 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71731) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 16:27:10 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-be1f0e44-4d7f-4429-a718-bf4c73c90fe4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:f45c196f-e69b-4a40-8a72-2e5a3b2dbe82', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DSrgohBL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71731) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 16:27:10 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66553f5-5e1b-4f1d-8c5a-63bc340f7586/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:27:10 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbcccf4b-e861-4254-9be3-a491776214e9/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:27:10 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbcccf4b-e861-4254-9be3-a491776214e9/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:27:10 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbcccf4b-e861-4254-9be3-a491776214e9/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:27:10 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbcccf4b-e861-4254-9be3-a491776214e9/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:27:10 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eaae47b9-a059-49f6-9ae6-d7147003e2f2/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:27:10 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eaae47b9-a059-49f6-9ae6-d7147003e2f2/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:27:10 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eaae47b9-a059-49f6-9ae6-d7147003e2f2/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:27:10 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eaae47b9-a059-49f6-9ae6-d7147003e2f2/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:27:10 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=71731) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 16:27:10 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71731) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 16:27:11 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-be1f0e44-4d7f-4429-a718-bf4c73c90fe4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.487s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 16:27:11 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-be1f0e44-4d7f-4429-a718-bf4c73c90fe4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] <== connect_volume: return (1488ms) {'type': 'block', 'scsi_wwn': '23333373064656435', 'path': '/dev/sdb'} {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 16:27:11 user nova-compute[71731]: DEBUG nova.virt.libvirt.volume.iscsi [None req-be1f0e44-4d7f-4429-a718-bf4c73c90fe4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 0f52d9e3-921c-4f79-9cdb-7d73500c8c35] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23333373064656435', 'path': '/dev/sdb'} {{(pid=71731) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 16:27:11 user nova-compute[71731]: WARNING nova.virt.libvirt.driver [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 16:27:11 user nova-compute[71731]: WARNING nova.virt.libvirt.driver [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 16:27:11 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Hypervisor/Node resource view: name=user free_ram=7931MB free_disk=26.227882385253906GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71731) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 16:27:11 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:27:11 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:27:11 user nova-compute[71731]: DEBUG nova.virt.libvirt.vif [None req-be1f0e44-4d7f-4429-a718-bf4c73c90fe4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T16:26:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1605197208',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1605197208',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1605197208',id=20,image_ref='02551df5-2d31-40a8-8d99-40af9cae089b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8d451e0e239f486aa2b3abe9e273eab3',ramdisk_id='',reservation_id='r-crrodjqz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-438786227',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-438786227-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-438786227',owner_user_name='tempest-TestVolumeBootPattern-438786227-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T16:26:59Z,user_data=None,user_id='d70e10f63cdd49a9a1ebe1fe4c9de0a2',uuid=0f52d9e3-921c-4f79-9cdb-7d73500c8c35,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d68dc4c7-5e6e-4d7f-8143-62eeb1816486", "address": "fa:16:3e:38:ee:28", "network": {"id": "d36bc206-f629-4d6e-8a3f-458061d7b525", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-893271134-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d451e0e239f486aa2b3abe9e273eab3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd68dc4c7-5e", "ovs_interfaceid": "d68dc4c7-5e6e-4d7f-8143-62eeb1816486", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71731) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 16:27:11 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-be1f0e44-4d7f-4429-a718-bf4c73c90fe4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Converting VIF {"id": "d68dc4c7-5e6e-4d7f-8143-62eeb1816486", "address": "fa:16:3e:38:ee:28", "network": {"id": "d36bc206-f629-4d6e-8a3f-458061d7b525", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-893271134-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d451e0e239f486aa2b3abe9e273eab3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd68dc4c7-5e", "ovs_interfaceid": "d68dc4c7-5e6e-4d7f-8143-62eeb1816486", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 16:27:11 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-be1f0e44-4d7f-4429-a718-bf4c73c90fe4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:38:ee:28,bridge_name='br-int',has_traffic_filtering=True,id=d68dc4c7-5e6e-4d7f-8143-62eeb1816486,network=Network(d36bc206-f629-4d6e-8a3f-458061d7b525),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd68dc4c7-5e') {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 16:27:11 user nova-compute[71731]: DEBUG nova.objects.instance [None req-be1f0e44-4d7f-4429-a718-bf4c73c90fe4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lazy-loading 'pci_devices' on Instance uuid 0f52d9e3-921c-4f79-9cdb-7d73500c8c35 {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:27:11 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-be1f0e44-4d7f-4429-a718-bf4c73c90fe4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 0f52d9e3-921c-4f79-9cdb-7d73500c8c35] End _get_guest_xml xml=<domain type="kvm">
Apr 13 16:27:11 user nova-compute[71731]:   <uuid>0f52d9e3-921c-4f79-9cdb-7d73500c8c35</uuid>
Apr 13 16:27:11 user nova-compute[71731]:   <name>instance-00000014</name>
Apr 13 16:27:11 user nova-compute[71731]:   <memory>131072</memory>
Apr 13 16:27:11 user nova-compute[71731]:   <vcpu>1</vcpu>
Apr 13 16:27:11 user nova-compute[71731]:   <metadata>
Apr 13 16:27:11 user nova-compute[71731]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 16:27:11 user nova-compute[71731]:       <nova:package version="0.0.0"/>
Apr 13 16:27:11 user nova-compute[71731]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-1605197208</nova:name>
Apr 13 16:27:11 user nova-compute[71731]:       <nova:creationTime>2023-04-13 16:27:09</nova:creationTime>
Apr 13 16:27:11 user nova-compute[71731]:       <nova:flavor name="m1.nano">
Apr 13 16:27:11 user nova-compute[71731]:         <nova:memory>128</nova:memory>
Apr 13 16:27:11 user nova-compute[71731]:         <nova:disk>1</nova:disk>
Apr 13 16:27:11 user nova-compute[71731]:         <nova:swap>0</nova:swap>
Apr 13 16:27:11 user nova-compute[71731]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 16:27:11 user nova-compute[71731]:         <nova:vcpus>1</nova:vcpus>
Apr 13 16:27:11 user nova-compute[71731]:       </nova:flavor>
Apr 13 16:27:11 user nova-compute[71731]:       <nova:owner>
Apr 13 16:27:11 user nova-compute[71731]:         <nova:user uuid="d70e10f63cdd49a9a1ebe1fe4c9de0a2">tempest-TestVolumeBootPattern-438786227-project-member</nova:user>
Apr 13 16:27:11 user nova-compute[71731]:         <nova:project uuid="8d451e0e239f486aa2b3abe9e273eab3">tempest-TestVolumeBootPattern-438786227</nova:project>
Apr 13 16:27:11 user nova-compute[71731]:       </nova:owner>
Apr 13 16:27:11 user nova-compute[71731]:       <nova:root type="image" uuid="02551df5-2d31-40a8-8d99-40af9cae089b"/>
Apr 13 16:27:11 user nova-compute[71731]:       <nova:ports>
Apr 13 16:27:11 user nova-compute[71731]:         <nova:port uuid="d68dc4c7-5e6e-4d7f-8143-62eeb1816486">
Apr 13 16:27:11 user nova-compute[71731]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Apr 13 16:27:11 user nova-compute[71731]:         </nova:port>
Apr 13 16:27:11 user nova-compute[71731]:       </nova:ports>
Apr 13 16:27:11 user nova-compute[71731]:     </nova:instance>
Apr 13 16:27:11 user nova-compute[71731]:   </metadata>
Apr 13 16:27:11 user nova-compute[71731]:   <sysinfo type="smbios">
Apr 13 16:27:11 user nova-compute[71731]:     <system>
Apr 13 16:27:11 user nova-compute[71731]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 16:27:11 user nova-compute[71731]:       <entry name="product">OpenStack Nova</entry>
Apr 13 16:27:11 user nova-compute[71731]:       <entry name="version">0.0.0</entry>
Apr 13 16:27:11 user nova-compute[71731]:       <entry name="serial">0f52d9e3-921c-4f79-9cdb-7d73500c8c35</entry>
Apr 13 16:27:11 user nova-compute[71731]:       <entry name="uuid">0f52d9e3-921c-4f79-9cdb-7d73500c8c35</entry>
Apr 13 16:27:11 user nova-compute[71731]:       <entry name="family">Virtual Machine</entry>
Apr 13 16:27:11 user nova-compute[71731]:     </system>
Apr 13 16:27:11 user nova-compute[71731]:   </sysinfo>
Apr 13 16:27:11 user nova-compute[71731]:   <os>
Apr 13 16:27:11 user nova-compute[71731]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 16:27:11 user nova-compute[71731]:     <boot dev="hd"/>
Apr 13 16:27:11 user nova-compute[71731]:     <smbios mode="sysinfo"/>
Apr 13 16:27:11 user nova-compute[71731]:   </os>
Apr 13 16:27:11 user nova-compute[71731]:   <features>
Apr 13 16:27:11 user nova-compute[71731]:     <acpi/>
Apr 13 16:27:11 user nova-compute[71731]:     <apic/>
Apr 13 16:27:11 user nova-compute[71731]:     <vmcoreinfo/>
Apr 13 16:27:11 user nova-compute[71731]:   </features>
Apr 13 16:27:11 user nova-compute[71731]:   <clock offset="utc">
Apr 13 16:27:11 user nova-compute[71731]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 16:27:11 user nova-compute[71731]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 16:27:11 user nova-compute[71731]:     <timer name="hpet" present="no"/>
Apr 13 16:27:11 user nova-compute[71731]:   </clock>
Apr 13 16:27:11 user nova-compute[71731]:   <cpu mode="custom" match="exact">
Apr 13 16:27:11 user nova-compute[71731]:     <model>Nehalem</model>
Apr 13 16:27:11 user nova-compute[71731]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 16:27:11 user nova-compute[71731]:   </cpu>
Apr 13 16:27:11 user nova-compute[71731]:   <devices>
Apr 13 16:27:11 user nova-compute[71731]:     <disk type="block" device="disk">
Apr 13 16:27:11 user nova-compute[71731]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 16:27:11 user nova-compute[71731]:       <source dev="/dev/sdb"/>
Apr 13 16:27:11 user nova-compute[71731]:       <target dev="vda" bus="virtio"/>
Apr 13 16:27:11 user nova-compute[71731]:       <serial>f45c196f-e69b-4a40-8a72-2e5a3b2dbe82</serial>
Apr 13 16:27:11 user nova-compute[71731]:     </disk>
Apr 13 16:27:11 user nova-compute[71731]:     <interface type="ethernet">
Apr 13 16:27:11 user nova-compute[71731]:       <mac address="fa:16:3e:38:ee:28"/>
Apr 13 16:27:11 user nova-compute[71731]:       <model type="virtio"/>
Apr 13 16:27:11 user nova-compute[71731]:       <mtu size="1442"/>
Apr 13 16:27:11 user nova-compute[71731]:       <target dev="tapd68dc4c7-5e"/>
Apr 13 16:27:11 user nova-compute[71731]:     </interface>
Apr 13 16:27:11 user nova-compute[71731]:     <serial type="pty">
Apr 13 16:27:11 user nova-compute[71731]:       <log file="/opt/stack/data/nova/instances/0f52d9e3-921c-4f79-9cdb-7d73500c8c35/console.log" append="off"/>
Apr 13 16:27:11 user nova-compute[71731]:     </serial>
Apr 13 16:27:11 user nova-compute[71731]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 16:27:11 user nova-compute[71731]:     <video>
Apr 13 16:27:11 user nova-compute[71731]:       <model type="virtio"/>
Apr 13 16:27:11 user nova-compute[71731]:     </video>
Apr 13 16:27:11 user nova-compute[71731]:     <rng model="virtio">
Apr 13 16:27:11 user nova-compute[71731]:       <backend model="random">/dev/urandom</backend>
Apr 13 16:27:11 user nova-compute[71731]:     </rng>
Apr 13 16:27:11 user nova-compute[71731]:     <controller type="usb" index="0" model="none"/>
Apr 13 16:27:11 user nova-compute[71731]:     <memballoon model="virtio">
Apr 13 16:27:11 user nova-compute[71731]:       <stats period="10"/>
Apr 13 16:27:11 user nova-compute[71731]:     </memballoon>
Apr 13 16:27:11 user nova-compute[71731]:   </devices>
Apr 13 16:27:11 user nova-compute[71731]: </domain>
Apr 13 16:27:11 user nova-compute[71731]:  {{(pid=71731) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 16:27:11 user nova-compute[71731]: DEBUG nova.virt.libvirt.vif [None req-be1f0e44-4d7f-4429-a718-bf4c73c90fe4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T16:26:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1605197208',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1605197208',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1605197208',id=20,image_ref='02551df5-2d31-40a8-8d99-40af9cae089b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8d451e0e239f486aa2b3abe9e273eab3',ramdisk_id='',reservation_id='r-crrodjqz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-438786227',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-438786227-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-438786227',owner_user_name='tempest-TestVolumeBootPattern-438786227-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T16:26:59Z,user_data=None,user_id='d70e10f63cdd49a9a1ebe1fe4c9de0a2',uuid=0f52d9e3-921c-4f79-9cdb-7d73500c8c35,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d68dc4c7-5e6e-4d7f-8143-62eeb1816486", "address": "fa:16:3e:38:ee:28", "network": {"id": "d36bc206-f629-4d6e-8a3f-458061d7b525", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-893271134-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d451e0e239f486aa2b3abe9e273eab3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd68dc4c7-5e", "ovs_interfaceid": "d68dc4c7-5e6e-4d7f-8143-62eeb1816486", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 16:27:11 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-be1f0e44-4d7f-4429-a718-bf4c73c90fe4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Converting VIF {"id": "d68dc4c7-5e6e-4d7f-8143-62eeb1816486", "address": "fa:16:3e:38:ee:28", "network": {"id": "d36bc206-f629-4d6e-8a3f-458061d7b525", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-893271134-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d451e0e239f486aa2b3abe9e273eab3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd68dc4c7-5e", "ovs_interfaceid": "d68dc4c7-5e6e-4d7f-8143-62eeb1816486", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 16:27:11 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-be1f0e44-4d7f-4429-a718-bf4c73c90fe4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:38:ee:28,bridge_name='br-int',has_traffic_filtering=True,id=d68dc4c7-5e6e-4d7f-8143-62eeb1816486,network=Network(d36bc206-f629-4d6e-8a3f-458061d7b525),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd68dc4c7-5e') {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 16:27:11 user nova-compute[71731]: DEBUG os_vif [None req-be1f0e44-4d7f-4429-a718-bf4c73c90fe4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:ee:28,bridge_name='br-int',has_traffic_filtering=True,id=d68dc4c7-5e6e-4d7f-8143-62eeb1816486,network=Network(d36bc206-f629-4d6e-8a3f-458061d7b525),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd68dc4c7-5e') {{(pid=71731) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 16:27:11 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:27:11 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:27:11 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 16:27:11 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:27:11 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd68dc4c7-5e, may_exist=True) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:27:11 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd68dc4c7-5e, col_values=(('external_ids', {'iface-id': 'd68dc4c7-5e6e-4d7f-8143-62eeb1816486', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:38:ee:28', 'vm-uuid': '0f52d9e3-921c-4f79-9cdb-7d73500c8c35'}),)) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:27:11 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:27:11 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 16:27:11 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:27:11 user nova-compute[71731]: INFO os_vif [None req-be1f0e44-4d7f-4429-a718-bf4c73c90fe4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:ee:28,bridge_name='br-int',has_traffic_filtering=True,id=d68dc4c7-5e6e-4d7f-8143-62eeb1816486,network=Network(d36bc206-f629-4d6e-8a3f-458061d7b525),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd68dc4c7-5e')
Apr 13 16:27:11 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-be1f0e44-4d7f-4429-a718-bf4c73c90fe4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] No BDM found with device name vda, not building metadata. {{(pid=71731) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 16:27:11 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-be1f0e44-4d7f-4429-a718-bf4c73c90fe4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] No VIF found with MAC fa:16:3e:38:ee:28, not building metadata {{(pid=71731) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 16:27:11 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance 7973e93b-6311-44ed-91ff-e861c32d0277 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 16:27:11 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance f66553f5-5e1b-4f1d-8c5a-63bc340f7586 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 16:27:11 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance bbcccf4b-e861-4254-9be3-a491776214e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 16:27:11 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance 235f827c-7116-48e9-84c5-0c9761c18e1e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 16:27:11 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance acbcaee0-a47b-4fee-8765-9b1c9597d515 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 16:27:11 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance eaae47b9-a059-49f6-9ae6-d7147003e2f2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 16:27:11 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance 5ea4ab6a-6501-4a2f-a8f7-04090024747d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 16:27:11 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance bf350da4-9cc2-4900-adf0-506e44984b42 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 16:27:11 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance 0f52d9e3-921c-4f79-9cdb-7d73500c8c35 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 16:27:11 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=71731) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 16:27:11 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Final resource view: name=user phys_ram=16023MB used_ram=1664MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=71731) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 16:27:11 user nova-compute[71731]: DEBUG nova.compute.provider_tree [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Inventory has not changed in ProviderTree for provider: cb6b1a64-0c24-4e2d-af1e-16576ca9165c {{(pid=71731) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 16:27:11 user nova-compute[71731]: DEBUG nova.scheduler.client.report [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Inventory has not changed for provider cb6b1a64-0c24-4e2d-af1e-16576ca9165c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71731) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 16:27:11 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Compute_service record updated for user:user {{(pid=71731) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 16:27:11 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.631s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:27:12 user nova-compute[71731]: DEBUG nova.compute.manager [req-09a265a8-335e-4637-8084-afa225f4f65a req-c13d3cf1-cded-45ce-8ee8-d90907b7f2de service nova] [instance: bf350da4-9cc2-4900-adf0-506e44984b42] Received event network-changed-1a737bae-3b9b-43b4-8a89-0eb98fdf2ec8 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:27:12 user nova-compute[71731]: DEBUG nova.compute.manager [req-09a265a8-335e-4637-8084-afa225f4f65a req-c13d3cf1-cded-45ce-8ee8-d90907b7f2de service nova] [instance: bf350da4-9cc2-4900-adf0-506e44984b42] Refreshing instance network info cache due to event network-changed-1a737bae-3b9b-43b4-8a89-0eb98fdf2ec8. {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 16:27:12 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-09a265a8-335e-4637-8084-afa225f4f65a req-c13d3cf1-cded-45ce-8ee8-d90907b7f2de service nova] Acquiring lock "refresh_cache-bf350da4-9cc2-4900-adf0-506e44984b42" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 16:27:12 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-09a265a8-335e-4637-8084-afa225f4f65a req-c13d3cf1-cded-45ce-8ee8-d90907b7f2de service nova] Acquired lock "refresh_cache-bf350da4-9cc2-4900-adf0-506e44984b42" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 16:27:12 user nova-compute[71731]: DEBUG nova.network.neutron [req-09a265a8-335e-4637-8084-afa225f4f65a req-c13d3cf1-cded-45ce-8ee8-d90907b7f2de service nova] [instance: bf350da4-9cc2-4900-adf0-506e44984b42] Refreshing network info cache for port 1a737bae-3b9b-43b4-8a89-0eb98fdf2ec8 {{(pid=71731) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 16:27:12 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-5f3566b0-cecc-492c-89bd-07e42b3d3b37 tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Acquiring lock "bf350da4-9cc2-4900-adf0-506e44984b42" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:27:12 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-5f3566b0-cecc-492c-89bd-07e42b3d3b37 tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Lock "bf350da4-9cc2-4900-adf0-506e44984b42" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:27:12 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-5f3566b0-cecc-492c-89bd-07e42b3d3b37 tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Acquiring lock "bf350da4-9cc2-4900-adf0-506e44984b42-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:27:12 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-5f3566b0-cecc-492c-89bd-07e42b3d3b37 tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Lock "bf350da4-9cc2-4900-adf0-506e44984b42-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:27:12 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-5f3566b0-cecc-492c-89bd-07e42b3d3b37 tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Lock "bf350da4-9cc2-4900-adf0-506e44984b42-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:27:12 user nova-compute[71731]: INFO nova.compute.manager [None req-5f3566b0-cecc-492c-89bd-07e42b3d3b37 tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] [instance: bf350da4-9cc2-4900-adf0-506e44984b42] Terminating instance
Apr 13 16:27:12 user nova-compute[71731]: DEBUG nova.compute.manager [None req-5f3566b0-cecc-492c-89bd-07e42b3d3b37 tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] [instance: bf350da4-9cc2-4900-adf0-506e44984b42] Start destroying the instance on the hypervisor. {{(pid=71731) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 16:27:12 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:27:12 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:27:12 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:27:12 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:27:12 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:27:12 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Starting heal instance info cache {{(pid=71731) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 16:27:12 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Acquiring lock "refresh_cache-f66553f5-5e1b-4f1d-8c5a-63bc340f7586" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 16:27:12 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Acquired lock "refresh_cache-f66553f5-5e1b-4f1d-8c5a-63bc340f7586" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 16:27:12 user nova-compute[71731]: DEBUG nova.network.neutron [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] [instance: f66553f5-5e1b-4f1d-8c5a-63bc340f7586] Forcefully refreshing network info cache for instance {{(pid=71731) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 16:27:12 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:27:12 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:27:12 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:27:12 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:27:12 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:27:12 user nova-compute[71731]: DEBUG nova.compute.manager [req-2a8a5cdd-2fba-449f-aaae-2be4500fc6f7 req-9332f2fd-f7c1-4982-a1a1-806b2adb5206 service nova] [instance: bf350da4-9cc2-4900-adf0-506e44984b42] Received event network-vif-unplugged-1a737bae-3b9b-43b4-8a89-0eb98fdf2ec8 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:27:12 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-2a8a5cdd-2fba-449f-aaae-2be4500fc6f7 req-9332f2fd-f7c1-4982-a1a1-806b2adb5206 service nova] Acquiring lock "bf350da4-9cc2-4900-adf0-506e44984b42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:27:12 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-2a8a5cdd-2fba-449f-aaae-2be4500fc6f7 req-9332f2fd-f7c1-4982-a1a1-806b2adb5206 service nova] Lock "bf350da4-9cc2-4900-adf0-506e44984b42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:27:12 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-2a8a5cdd-2fba-449f-aaae-2be4500fc6f7 req-9332f2fd-f7c1-4982-a1a1-806b2adb5206 service nova] Lock "bf350da4-9cc2-4900-adf0-506e44984b42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:27:12 user nova-compute[71731]: DEBUG nova.compute.manager [req-2a8a5cdd-2fba-449f-aaae-2be4500fc6f7 req-9332f2fd-f7c1-4982-a1a1-806b2adb5206 service nova] [instance: bf350da4-9cc2-4900-adf0-506e44984b42] No waiting events found dispatching network-vif-unplugged-1a737bae-3b9b-43b4-8a89-0eb98fdf2ec8 {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:27:12 user nova-compute[71731]: DEBUG nova.compute.manager [req-2a8a5cdd-2fba-449f-aaae-2be4500fc6f7 req-9332f2fd-f7c1-4982-a1a1-806b2adb5206 service nova] [instance: bf350da4-9cc2-4900-adf0-506e44984b42] Received event network-vif-unplugged-1a737bae-3b9b-43b4-8a89-0eb98fdf2ec8 for instance with task_state deleting. {{(pid=71731) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 16:27:13 user nova-compute[71731]: DEBUG nova.network.neutron [req-09a265a8-335e-4637-8084-afa225f4f65a req-c13d3cf1-cded-45ce-8ee8-d90907b7f2de service nova] [instance: bf350da4-9cc2-4900-adf0-506e44984b42] Updated VIF entry in instance network info cache for port 1a737bae-3b9b-43b4-8a89-0eb98fdf2ec8. {{(pid=71731) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 16:27:13 user nova-compute[71731]: DEBUG nova.network.neutron [req-09a265a8-335e-4637-8084-afa225f4f65a req-c13d3cf1-cded-45ce-8ee8-d90907b7f2de service nova] [instance: bf350da4-9cc2-4900-adf0-506e44984b42] Updating instance_info_cache with network_info: [{"id": "1a737bae-3b9b-43b4-8a89-0eb98fdf2ec8", "address": "fa:16:3e:18:7d:11", "network": {"id": "c06f107f-4fa0-46dc-8766-3c882c401851", "bridge": "br-int", "label": "tempest-TestShelveInstance-1490339676-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed94fa5d89c2486b8e2951e608e6630f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a737bae-3b", "ovs_interfaceid": "1a737bae-3b9b-43b4-8a89-0eb98fdf2ec8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:27:13 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-09a265a8-335e-4637-8084-afa225f4f65a req-c13d3cf1-cded-45ce-8ee8-d90907b7f2de service nova] Releasing lock "refresh_cache-bf350da4-9cc2-4900-adf0-506e44984b42" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 16:27:13 user nova-compute[71731]: INFO nova.virt.libvirt.driver [-] [instance: bf350da4-9cc2-4900-adf0-506e44984b42] Instance destroyed successfully.
Apr 13 16:27:13 user nova-compute[71731]: DEBUG nova.objects.instance [None req-5f3566b0-cecc-492c-89bd-07e42b3d3b37 tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Lazy-loading 'resources' on Instance uuid bf350da4-9cc2-4900-adf0-506e44984b42 {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:27:13 user nova-compute[71731]: DEBUG nova.virt.libvirt.vif [None req-5f3566b0-cecc-492c-89bd-07e42b3d3b37 tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-13T16:21:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1925968525',display_name='tempest-TestShelveInstance-server-1925968525',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1925968525',id=11,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDyAJlgxv64OYVoDx7VUkbgPL/6uJGmronkd0R5CCODRVVo/i2lNlZVafBS/KDfrnkMj0B1mexq0GfoaJ06IYh54z6OmormUG7yLrIuZRcmrCeKwYmEEqzhVcYWIYdAQ0Q==',key_name='tempest-TestShelveInstance-2029240993',keypairs=<?>,launch_index=0,launched_at=2023-04-13T16:25:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ed94fa5d89c2486b8e2951e608e6630f',ramdisk_id='',reservation_id='r-dy6iwcv2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1159741724',owner_user_name='tempest-TestShelveInstance-1159741724-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T16:25:36Z,user_data=None,user_id='fe6a4bf1a7794af2958c3d53ea1e19c6',uuid=bf350da4-9cc2-4900-adf0-506e44984b42,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1a737bae-3b9b-43b4-8a89-0eb98fdf2ec8", "address": "fa:16:3e:18:7d:11", "network": {"id": "c06f107f-4fa0-46dc-8766-3c882c401851", "bridge": "br-int", "label": "tempest-TestShelveInstance-1490339676-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed94fa5d89c2486b8e2951e608e6630f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a737bae-3b", "ovs_interfaceid": "1a737bae-3b9b-43b4-8a89-0eb98fdf2ec8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 16:27:13 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-5f3566b0-cecc-492c-89bd-07e42b3d3b37 tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Converting VIF {"id": "1a737bae-3b9b-43b4-8a89-0eb98fdf2ec8", "address": "fa:16:3e:18:7d:11", "network": {"id": "c06f107f-4fa0-46dc-8766-3c882c401851", "bridge": "br-int", "label": "tempest-TestShelveInstance-1490339676-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed94fa5d89c2486b8e2951e608e6630f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a737bae-3b", "ovs_interfaceid": "1a737bae-3b9b-43b4-8a89-0eb98fdf2ec8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 16:27:13 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-5f3566b0-cecc-492c-89bd-07e42b3d3b37 tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:18:7d:11,bridge_name='br-int',has_traffic_filtering=True,id=1a737bae-3b9b-43b4-8a89-0eb98fdf2ec8,network=Network(c06f107f-4fa0-46dc-8766-3c882c401851),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a737bae-3b') {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 16:27:13 user nova-compute[71731]: DEBUG os_vif [None req-5f3566b0-cecc-492c-89bd-07e42b3d3b37 tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:7d:11,bridge_name='br-int',has_traffic_filtering=True,id=1a737bae-3b9b-43b4-8a89-0eb98fdf2ec8,network=Network(c06f107f-4fa0-46dc-8766-3c882c401851),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a737bae-3b') {{(pid=71731) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 16:27:13 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:27:13 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1a737bae-3b, bridge=br-int, if_exists=True) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:27:13 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:27:13 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 16:27:13 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:27:13 user nova-compute[71731]: INFO os_vif [None req-5f3566b0-cecc-492c-89bd-07e42b3d3b37 tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:7d:11,bridge_name='br-int',has_traffic_filtering=True,id=1a737bae-3b9b-43b4-8a89-0eb98fdf2ec8,network=Network(c06f107f-4fa0-46dc-8766-3c882c401851),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a737bae-3b')
Apr 13 16:27:13 user nova-compute[71731]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5f3566b0-cecc-492c-89bd-07e42b3d3b37 tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] [instance: bf350da4-9cc2-4900-adf0-506e44984b42] calling os-brick to detach iSCSI Volume {{(pid=71731) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 16:27:13 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f3566b0-cecc-492c-89bd-07e42b3d3b37 tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8cf0118790>, {'target_iqn': 'iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KoxklySD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde': {}}" {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 16:27:13 user nova-compute[71731]: WARNING os_brick.initiator.connectors.base [None req-5f3566b0-cecc-492c-89bd-07e42b3d3b37 tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 16:27:13 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-5f3566b0-cecc-492c-89bd-07e42b3d3b37 tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 16:27:13 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-5f3566b0-cecc-492c-89bd-07e42b3d3b37 tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 16:27:13 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:27:13 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:27:13 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[67fb4e31-05eb-44e1-9d41-bdf3caf72d5f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e4317bfd-71c2-4c48-a0f0-e3c795f262a8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:eb2c60ec-fb52-436f-a98a-dfe15d1e3aa6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f45c196f-e69b-4a40-8a72-2e5a3b2dbe82\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:27:13 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f3566b0-cecc-492c-89bd-07e42b3d3b37 tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 16:27:13 user nova-compute[71731]: No targets found.
Apr 13 16:27:13 user nova-compute[71731]: iSNS:
Apr 13 16:27:13 user nova-compute[71731]: No targets found.
Apr 13 16:27:13 user nova-compute[71731]: STATIC:
Apr 13 16:27:13 user nova-compute[71731]: Target: iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97
Apr 13 16:27:13 user nova-compute[71731]:         Portal: 172.16.0.220:3260,-1
Apr 13 16:27:13 user nova-compute[71731]:                 Iface Name: default
Apr 13 16:27:13 user nova-compute[71731]: Target: iqn.2010-10.org.openstack:e4317bfd-71c2-4c48-a0f0-e3c795f262a8
Apr 13 16:27:13 user nova-compute[71731]:         Portal: 172.16.0.220:3260,-1
Apr 13 16:27:13 user nova-compute[71731]:                 Iface Name: default
Apr 13 16:27:13 user nova-compute[71731]: Target: iqn.2010-10.org.openstack:eb2c60ec-fb52-436f-a98a-dfe15d1e3aa6
Apr 13 16:27:13 user nova-compute[71731]:         Portal: 172.16.0.220:3260,-1
Apr 13 16:27:13 user nova-compute[71731]:                 Iface Name: default
Apr 13 16:27:13 user nova-compute[71731]: Target: iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984
Apr 13 16:27:13 user nova-compute[71731]:         Portal: 172.16.0.220:3260,-1
Apr 13 16:27:13 user nova-compute[71731]:                 Iface Name: default
Apr 13 16:27:13 user nova-compute[71731]: Target: iqn.2010-10.org.openstack:f45c196f-e69b-4a40-8a72-2e5a3b2dbe82
Apr 13 16:27:13 user nova-compute[71731]:         Portal: 172.16.0.220:3260,-1
Apr 13 16:27:13 user nova-compute[71731]:                 Iface Name: default
Apr 13 16:27:13 user nova-compute[71731]: FIRMWARE:
Apr 13 16:27:13 user nova-compute[71731]: No targets found.
Apr 13 16:27:13 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 16:27:13 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f3566b0-cecc-492c-89bd-07e42b3d3b37 tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 16:27:13 user nova-compute[71731]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 16:27:13 user nova-compute[71731]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71731) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 16:27:13 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f3566b0-cecc-492c-89bd-07e42b3d3b37 tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984', 0)] {{(pid=71731) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 16:27:13 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:27:13 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:27:13 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[b976e015-ad3d-4c8b-b1ca-84a5b3ab6bd5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e4317bfd-71c2-4c48-a0f0-e3c795f262a8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eb2c60ec-fb52-436f-a98a-dfe15d1e3aa6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f45c196f-e69b-4a40-8a72-2e5a3b2dbe82\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:27:13 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:27:13 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:27:13 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[c268c75d-7dd1-47fd-bc66-d92b67e3c795]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4317bfd-71c2-4c48-a0f0-e3c795f262a8 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb2c60ec-fb52-436f-a98a-dfe15d1e3aa6 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f45c196f-e69b-4a40-8a72-2e5a3b2dbe82 (non-flash)\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:27:13 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f3566b0-cecc-492c-89bd-07e42b3d3b37 tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)
Apr 13 16:27:13 user nova-compute[71731]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4317bfd-71c2-4c48-a0f0-e3c795f262a8 (non-flash)
Apr 13 16:27:13 user nova-compute[71731]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984 (non-flash)
Apr 13 16:27:13 user nova-compute[71731]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb2c60ec-fb52-436f-a98a-dfe15d1e3aa6 (non-flash)
Apr 13 16:27:13 user nova-compute[71731]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f45c196f-e69b-4a40-8a72-2e5a3b2dbe82 (non-flash)
Apr 13 16:27:13 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 16:27:13 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f3566b0-cecc-492c-89bd-07e42b3d3b37 tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)
Apr 13 16:27:13 user nova-compute[71731]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4317bfd-71c2-4c48-a0f0-e3c795f262a8 (non-flash)
Apr 13 16:27:13 user nova-compute[71731]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984 (non-flash)
Apr 13 16:27:13 user nova-compute[71731]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb2c60ec-fb52-436f-a98a-dfe15d1e3aa6 (non-flash)
Apr 13 16:27:13 user nova-compute[71731]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f45c196f-e69b-4a40-8a72-2e5a3b2dbe82 (non-flash)
Apr 13 16:27:13 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 16:27:13 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f3566b0-cecc-492c-89bd-07e42b3d3b37 tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8cff4cd3f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984'): ({'sde'}, set())}) {{(pid=71731) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 16:27:13 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-5f3566b0-cecc-492c-89bd-07e42b3d3b37 tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Removing single pathed devices sde {{(pid=71731) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 16:27:13 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:27:13 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:27:13 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fa6fb84-0f9c-4fae-a778-81ff4c7dc69f]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:27:13 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:27:13 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:27:13 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d1e2d80-eb88-425b-952c-fcc099a7716c]: (4, ('ok\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:27:13 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-5f3566b0-cecc-492c-89bd-07e42b3d3b37 tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Flushing IO for device /dev/sde {{(pid=71731) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 16:27:13 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:27:13 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.022s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:27:13 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd61b98d-6038-4279-8669-c2759cc8c659]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:27:13 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-5f3566b0-cecc-492c-89bd-07e42b3d3b37 tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=71731) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 16:27:13 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:27:13 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.039s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:27:13 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[74298ebe-a3de-451f-be09-330814e6f771]: (4, ('1', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:27:13 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-5f3566b0-cecc-492c-89bd-07e42b3d3b37 tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=71731) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 16:27:13 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-5f3566b0-cecc-492c-89bd-07e42b3d3b37 tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] SCSI volumes sde have been removed. {{(pid=71731) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 16:27:13 user nova-compute[71731]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_31e61e43', '/dev/disk/by-id/scsi-23736643634636337', '/dev/disk/by-id/scsi-1SCST_BIO31e61e43-76d64cc7c17b2a65') {{(pid=81776) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Apr 13 16:27:13 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8840f27-8848-4728-89ff-54a51d468cbe]: (4, None) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:27:13 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f3566b0-cecc-492c-89bd-07e42b3d3b37 tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984')] {{(pid=71731) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 16:27:13 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:27:13 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:27:13 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[a357899f-d458-4d59-9c14-a0624c00576c]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:27:13 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f3566b0-cecc-492c-89bd-07e42b3d3b37 tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:27:13 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984 -p 172.16.0.220:3260 --logout {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:27:13 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984 -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:27:13 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[b03fb593-bcb2-4876-a3ba-1795af7e9f0b]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:27:13 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f3566b0-cecc-492c-89bd-07e42b3d3b37 tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984, portal: 172.16.0.220,3260]
Apr 13 16:27:13 user nova-compute[71731]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984, portal: 172.16.0.220,3260] successful.
Apr 13 16:27:13 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:27:13 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984 -p 172.16.0.220:3260 --op delete {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:27:13 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ac31388-2626-48e4-a711-54683ef66984 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:27:13 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[3add6ed7-d858-426d-ba26-24cc704bd6b5]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:27:13 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f3566b0-cecc-492c-89bd-07e42b3d3b37 tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:27:13 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-5f3566b0-cecc-492c-89bd-07e42b3d3b37 tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.340s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 16:27:13 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f3566b0-cecc-492c-89bd-07e42b3d3b37 tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] <== disconnect_volume: return (341ms) None {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 16:27:13 user nova-compute[71731]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5f3566b0-cecc-492c-89bd-07e42b3d3b37 tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] [instance: bf350da4-9cc2-4900-adf0-506e44984b42] Disconnected iSCSI Volume {{(pid=71731) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 16:27:13 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-5f3566b0-cecc-492c-89bd-07e42b3d3b37 tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] [instance: bf350da4-9cc2-4900-adf0-506e44984b42] Deleting instance files /opt/stack/data/nova/instances/bf350da4-9cc2-4900-adf0-506e44984b42_del
Apr 13 16:27:13 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-5f3566b0-cecc-492c-89bd-07e42b3d3b37 tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] [instance: bf350da4-9cc2-4900-adf0-506e44984b42] Deletion of /opt/stack/data/nova/instances/bf350da4-9cc2-4900-adf0-506e44984b42_del complete
Apr 13 16:27:13 user nova-compute[71731]: INFO nova.compute.manager [None req-5f3566b0-cecc-492c-89bd-07e42b3d3b37 tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] [instance: bf350da4-9cc2-4900-adf0-506e44984b42] Took 1.26 seconds to destroy the instance on the hypervisor.
Apr 13 16:27:13 user nova-compute[71731]: DEBUG oslo.service.loopingcall [None req-5f3566b0-cecc-492c-89bd-07e42b3d3b37 tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71731) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 16:27:13 user nova-compute[71731]: DEBUG nova.compute.manager [-] [instance: bf350da4-9cc2-4900-adf0-506e44984b42] Deallocating network for instance {{(pid=71731) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 16:27:13 user nova-compute[71731]: DEBUG nova.network.neutron [-] [instance: bf350da4-9cc2-4900-adf0-506e44984b42] deallocate_for_instance() {{(pid=71731) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 16:27:13 user nova-compute[71731]: DEBUG nova.network.neutron [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] [instance: f66553f5-5e1b-4f1d-8c5a-63bc340f7586] Updating instance_info_cache with network_info: [{"id": "27d05b76-8556-4365-9050-6bf871e85502", "address": "fa:16:3e:0d:13:8a", "network": {"id": "5a7877ff-8230-470b-90b5-e5dcfc8f0cee", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-779403873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2d09a74bf684a9fb1dd1e95d6c23f3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27d05b76-85", "ovs_interfaceid": "27d05b76-8556-4365-9050-6bf871e85502", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:27:13 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Releasing lock "refresh_cache-f66553f5-5e1b-4f1d-8c5a-63bc340f7586" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 16:27:13 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] [instance: f66553f5-5e1b-4f1d-8c5a-63bc340f7586] Updated the network info_cache for instance {{(pid=71731) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 16:27:13 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:27:13 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:27:13 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:27:14 user nova-compute[71731]: DEBUG nova.network.neutron [-] [instance: bf350da4-9cc2-4900-adf0-506e44984b42] Updating instance_info_cache with network_info: [] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:27:14 user nova-compute[71731]: INFO nova.compute.manager [-] [instance: bf350da4-9cc2-4900-adf0-506e44984b42] Took 0.47 seconds to deallocate network for instance.
Apr 13 16:27:14 user nova-compute[71731]: DEBUG nova.compute.manager [req-eba62087-4a10-490d-a29f-faf10d3a0459 req-c71e52f4-dc95-4b7c-b341-db461cf52dbf service nova] [instance: bf350da4-9cc2-4900-adf0-506e44984b42] Received event network-vif-deleted-1a737bae-3b9b-43b4-8a89-0eb98fdf2ec8 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:27:14 user nova-compute[71731]: INFO nova.compute.manager [req-eba62087-4a10-490d-a29f-faf10d3a0459 req-c71e52f4-dc95-4b7c-b341-db461cf52dbf service nova] [instance: bf350da4-9cc2-4900-adf0-506e44984b42] Neutron deleted interface 1a737bae-3b9b-43b4-8a89-0eb98fdf2ec8; detaching it from the instance and deleting it from the info cache
Apr 13 16:27:14 user nova-compute[71731]: DEBUG nova.network.neutron [req-eba62087-4a10-490d-a29f-faf10d3a0459 req-c71e52f4-dc95-4b7c-b341-db461cf52dbf service nova] [instance: bf350da4-9cc2-4900-adf0-506e44984b42] Updating instance_info_cache with network_info: [] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:27:14 user nova-compute[71731]: DEBUG nova.compute.manager [req-eba62087-4a10-490d-a29f-faf10d3a0459 req-c71e52f4-dc95-4b7c-b341-db461cf52dbf service nova] [instance: bf350da4-9cc2-4900-adf0-506e44984b42] Detach interface failed, port_id=1a737bae-3b9b-43b4-8a89-0eb98fdf2ec8, reason: Instance bf350da4-9cc2-4900-adf0-506e44984b42 could not be found. {{(pid=71731) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 13 16:27:14 user nova-compute[71731]: DEBUG nova.compute.manager [req-8ec6875c-673a-490a-b514-2aa3084b87ca req-8ce214ce-b3d3-4638-924b-a797bf996636 service nova] [instance: 0f52d9e3-921c-4f79-9cdb-7d73500c8c35] Received event network-vif-plugged-d68dc4c7-5e6e-4d7f-8143-62eeb1816486 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:27:14 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-8ec6875c-673a-490a-b514-2aa3084b87ca req-8ce214ce-b3d3-4638-924b-a797bf996636 service nova] Acquiring lock "0f52d9e3-921c-4f79-9cdb-7d73500c8c35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:27:14 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-8ec6875c-673a-490a-b514-2aa3084b87ca req-8ce214ce-b3d3-4638-924b-a797bf996636 service nova] Lock "0f52d9e3-921c-4f79-9cdb-7d73500c8c35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:27:14 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-8ec6875c-673a-490a-b514-2aa3084b87ca req-8ce214ce-b3d3-4638-924b-a797bf996636 service nova] Lock "0f52d9e3-921c-4f79-9cdb-7d73500c8c35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:27:14 user nova-compute[71731]: DEBUG nova.compute.manager [req-8ec6875c-673a-490a-b514-2aa3084b87ca req-8ce214ce-b3d3-4638-924b-a797bf996636 service nova] [instance: 0f52d9e3-921c-4f79-9cdb-7d73500c8c35] No waiting events found dispatching network-vif-plugged-d68dc4c7-5e6e-4d7f-8143-62eeb1816486 {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:27:14 user nova-compute[71731]: WARNING nova.compute.manager [req-8ec6875c-673a-490a-b514-2aa3084b87ca req-8ce214ce-b3d3-4638-924b-a797bf996636 service nova] [instance: 0f52d9e3-921c-4f79-9cdb-7d73500c8c35] Received unexpected event network-vif-plugged-d68dc4c7-5e6e-4d7f-8143-62eeb1816486 for instance with vm_state building and task_state spawning.
Apr 13 16:27:14 user nova-compute[71731]: DEBUG nova.compute.manager [req-8ec6875c-673a-490a-b514-2aa3084b87ca req-8ce214ce-b3d3-4638-924b-a797bf996636 service nova] [instance: 0f52d9e3-921c-4f79-9cdb-7d73500c8c35] Received event network-vif-plugged-d68dc4c7-5e6e-4d7f-8143-62eeb1816486 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:27:14 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-8ec6875c-673a-490a-b514-2aa3084b87ca req-8ce214ce-b3d3-4638-924b-a797bf996636 service nova] Acquiring lock "0f52d9e3-921c-4f79-9cdb-7d73500c8c35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:27:14 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-8ec6875c-673a-490a-b514-2aa3084b87ca req-8ce214ce-b3d3-4638-924b-a797bf996636 service nova] Lock "0f52d9e3-921c-4f79-9cdb-7d73500c8c35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:27:14 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-8ec6875c-673a-490a-b514-2aa3084b87ca req-8ce214ce-b3d3-4638-924b-a797bf996636 service nova] Lock "0f52d9e3-921c-4f79-9cdb-7d73500c8c35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:27:14 user nova-compute[71731]: DEBUG nova.compute.manager [req-8ec6875c-673a-490a-b514-2aa3084b87ca req-8ce214ce-b3d3-4638-924b-a797bf996636 service nova] [instance: 0f52d9e3-921c-4f79-9cdb-7d73500c8c35] No waiting events found dispatching network-vif-plugged-d68dc4c7-5e6e-4d7f-8143-62eeb1816486 {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:27:14 user nova-compute[71731]: WARNING nova.compute.manager [req-8ec6875c-673a-490a-b514-2aa3084b87ca req-8ce214ce-b3d3-4638-924b-a797bf996636 service nova] [instance: 0f52d9e3-921c-4f79-9cdb-7d73500c8c35] Received unexpected event network-vif-plugged-d68dc4c7-5e6e-4d7f-8143-62eeb1816486 for instance with vm_state building and task_state spawning.
Apr 13 16:27:14 user nova-compute[71731]: DEBUG nova.virt.driver [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Emitting event <LifecycleEvent: 1681403234.7976089, 0f52d9e3-921c-4f79-9cdb-7d73500c8c35 => Resumed> {{(pid=71731) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 16:27:14 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 0f52d9e3-921c-4f79-9cdb-7d73500c8c35] VM Resumed (Lifecycle Event)
Apr 13 16:27:14 user nova-compute[71731]: DEBUG nova.compute.manager [None req-be1f0e44-4d7f-4429-a718-bf4c73c90fe4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 0f52d9e3-921c-4f79-9cdb-7d73500c8c35] Instance event wait completed in 0 seconds for  {{(pid=71731) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 16:27:14 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-be1f0e44-4d7f-4429-a718-bf4c73c90fe4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 0f52d9e3-921c-4f79-9cdb-7d73500c8c35] Guest created on hypervisor {{(pid=71731) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 16:27:14 user nova-compute[71731]: INFO nova.virt.libvirt.driver [-] [instance: 0f52d9e3-921c-4f79-9cdb-7d73500c8c35] Instance spawned successfully.
Apr 13 16:27:14 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-be1f0e44-4d7f-4429-a718-bf4c73c90fe4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 0f52d9e3-921c-4f79-9cdb-7d73500c8c35] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 16:27:14 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-be1f0e44-4d7f-4429-a718-bf4c73c90fe4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 0f52d9e3-921c-4f79-9cdb-7d73500c8c35] Found default for hw_input_bus of None {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:27:14 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-be1f0e44-4d7f-4429-a718-bf4c73c90fe4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 0f52d9e3-921c-4f79-9cdb-7d73500c8c35] Found default for hw_pointer_model of None {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:27:14 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 0f52d9e3-921c-4f79-9cdb-7d73500c8c35] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:27:14 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 0f52d9e3-921c-4f79-9cdb-7d73500c8c35] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71731) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 16:27:14 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 0f52d9e3-921c-4f79-9cdb-7d73500c8c35] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 16:27:14 user nova-compute[71731]: DEBUG nova.virt.driver [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Emitting event <LifecycleEvent: 1681403234.7988358, 0f52d9e3-921c-4f79-9cdb-7d73500c8c35 => Started> {{(pid=71731) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 16:27:14 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 0f52d9e3-921c-4f79-9cdb-7d73500c8c35] VM Started (Lifecycle Event)
Apr 13 16:27:14 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 0f52d9e3-921c-4f79-9cdb-7d73500c8c35] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:27:14 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 0f52d9e3-921c-4f79-9cdb-7d73500c8c35] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71731) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 16:27:14 user nova-compute[71731]: INFO nova.compute.manager [None req-be1f0e44-4d7f-4429-a718-bf4c73c90fe4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 0f52d9e3-921c-4f79-9cdb-7d73500c8c35] Took 5.32 seconds to spawn the instance on the hypervisor.
Apr 13 16:27:14 user nova-compute[71731]: DEBUG nova.compute.manager [None req-be1f0e44-4d7f-4429-a718-bf4c73c90fe4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 0f52d9e3-921c-4f79-9cdb-7d73500c8c35] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:27:14 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 0f52d9e3-921c-4f79-9cdb-7d73500c8c35] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 16:27:14 user nova-compute[71731]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681403219.91013, 902e4077-e0d6-4b61-a861-883be253f1e0 => Stopped> {{(pid=71731) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 16:27:14 user nova-compute[71731]: INFO nova.compute.manager [-] [instance: 902e4077-e0d6-4b61-a861-883be253f1e0] VM Stopped (Lifecycle Event)
Apr 13 16:27:14 user nova-compute[71731]: DEBUG nova.compute.manager [None req-2da76a5c-7942-4f29-9fc6-1aef27ea5310 None None] [instance: 902e4077-e0d6-4b61-a861-883be253f1e0] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:27:14 user nova-compute[71731]: INFO nova.compute.manager [None req-be1f0e44-4d7f-4429-a718-bf4c73c90fe4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 0f52d9e3-921c-4f79-9cdb-7d73500c8c35] Took 16.43 seconds to build instance.
Apr 13 16:27:14 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-be1f0e44-4d7f-4429-a718-bf4c73c90fe4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "0f52d9e3-921c-4f79-9cdb-7d73500c8c35" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.545s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:27:15 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:27:15 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:27:15 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71731) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 16:27:15 user nova-compute[71731]: DEBUG nova.compute.manager [req-f84df35e-a415-4a9e-b470-c42cb68fe0cb req-ea63b2d2-b103-4656-bf2f-f642b0eb7db8 service nova] [instance: bf350da4-9cc2-4900-adf0-506e44984b42] Received event network-vif-plugged-1a737bae-3b9b-43b4-8a89-0eb98fdf2ec8 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:27:15 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-f84df35e-a415-4a9e-b470-c42cb68fe0cb req-ea63b2d2-b103-4656-bf2f-f642b0eb7db8 service nova] Acquiring lock "bf350da4-9cc2-4900-adf0-506e44984b42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:27:15 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-f84df35e-a415-4a9e-b470-c42cb68fe0cb req-ea63b2d2-b103-4656-bf2f-f642b0eb7db8 service nova] Lock "bf350da4-9cc2-4900-adf0-506e44984b42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:27:15 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-f84df35e-a415-4a9e-b470-c42cb68fe0cb req-ea63b2d2-b103-4656-bf2f-f642b0eb7db8 service nova] Lock "bf350da4-9cc2-4900-adf0-506e44984b42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:27:15 user nova-compute[71731]: DEBUG nova.compute.manager [req-f84df35e-a415-4a9e-b470-c42cb68fe0cb req-ea63b2d2-b103-4656-bf2f-f642b0eb7db8 service nova] [instance: bf350da4-9cc2-4900-adf0-506e44984b42] No waiting events found dispatching network-vif-plugged-1a737bae-3b9b-43b4-8a89-0eb98fdf2ec8 {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:27:15 user nova-compute[71731]: WARNING nova.compute.manager [req-f84df35e-a415-4a9e-b470-c42cb68fe0cb req-ea63b2d2-b103-4656-bf2f-f642b0eb7db8 service nova] [instance: bf350da4-9cc2-4900-adf0-506e44984b42] Received unexpected event network-vif-plugged-1a737bae-3b9b-43b4-8a89-0eb98fdf2ec8 for instance with vm_state active and task_state deleting.
Apr 13 16:27:15 user nova-compute[71731]: INFO nova.compute.manager [None req-5f3566b0-cecc-492c-89bd-07e42b3d3b37 tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] [instance: bf350da4-9cc2-4900-adf0-506e44984b42] Took 0.86 seconds to detach 1 volumes for instance.
Apr 13 16:27:15 user nova-compute[71731]: DEBUG nova.compute.manager [None req-5f3566b0-cecc-492c-89bd-07e42b3d3b37 tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] [instance: bf350da4-9cc2-4900-adf0-506e44984b42] Deleting volume: 1ac31388-2626-48e4-a711-54683ef66984 {{(pid=71731) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3202}}
Apr 13 16:27:15 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-5f3566b0-cecc-492c-89bd-07e42b3d3b37 tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:27:15 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-5f3566b0-cecc-492c-89bd-07e42b3d3b37 tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:27:15 user nova-compute[71731]: DEBUG nova.compute.provider_tree [None req-5f3566b0-cecc-492c-89bd-07e42b3d3b37 tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Inventory has not changed in ProviderTree for provider: cb6b1a64-0c24-4e2d-af1e-16576ca9165c {{(pid=71731) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 16:27:15 user nova-compute[71731]: DEBUG nova.scheduler.client.report [None req-5f3566b0-cecc-492c-89bd-07e42b3d3b37 tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Inventory has not changed for provider cb6b1a64-0c24-4e2d-af1e-16576ca9165c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71731) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 16:27:15 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-5f3566b0-cecc-492c-89bd-07e42b3d3b37 tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.308s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:27:15 user nova-compute[71731]: INFO nova.scheduler.client.report [None req-5f3566b0-cecc-492c-89bd-07e42b3d3b37 tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Deleted allocations for instance bf350da4-9cc2-4900-adf0-506e44984b42
Apr 13 16:27:15 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-5f3566b0-cecc-492c-89bd-07e42b3d3b37 tempest-TestShelveInstance-1159741724 tempest-TestShelveInstance-1159741724-project-member] Lock "bf350da4-9cc2-4900-adf0-506e44984b42" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.147s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:27:16 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:27:18 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:27:18 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:27:18 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:27:20 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:27:23 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:27:26 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:27:26 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-8badd565-8407-452f-817c-467e3fd3e81a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Acquiring lock "acbcaee0-a47b-4fee-8765-9b1c9597d515" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:27:26 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-8badd565-8407-452f-817c-467e3fd3e81a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "acbcaee0-a47b-4fee-8765-9b1c9597d515" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:27:26 user nova-compute[71731]: DEBUG nova.objects.instance [None req-8badd565-8407-452f-817c-467e3fd3e81a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lazy-loading 'flavor' on Instance uuid acbcaee0-a47b-4fee-8765-9b1c9597d515 {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:27:26 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-8badd565-8407-452f-817c-467e3fd3e81a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "acbcaee0-a47b-4fee-8765-9b1c9597d515" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:27:26 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-8badd565-8407-452f-817c-467e3fd3e81a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Acquiring lock "acbcaee0-a47b-4fee-8765-9b1c9597d515" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:27:26 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-8badd565-8407-452f-817c-467e3fd3e81a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "acbcaee0-a47b-4fee-8765-9b1c9597d515" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:27:26 user nova-compute[71731]: INFO nova.compute.manager [None req-8badd565-8407-452f-817c-467e3fd3e81a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] Attaching volume d53e720e-a9ca-499b-aacd-aad1a169a874 to /dev/vdb
Apr 13 16:27:26 user nova-compute[71731]: DEBUG os_brick.utils [None req-8badd565-8407-452f-817c-467e3fd3e81a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 16:27:26 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:27:26 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:27:26 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[e54c0388-6b58-4980-9206-a09b0b736c41]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:81501d91421\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:27:26 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:27:27 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:27:27 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[df320848-305d-4608-87ca-c5ac9acee023]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:27:27 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:27:27 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:27:27 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3a6bd85-37e6-479b-9b67-c623c655efde]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:27:27 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8d2b7e1-9bdd-493a-af7a-3560ce16ba87]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:27:27 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-8badd565-8407-452f-817c-467e3fd3e81a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Running cmd (subprocess): nvme version {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:27:27 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-8badd565-8407-452f-817c-467e3fd3e81a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] 'nvme version' failed. Not Retrying. {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 16:27:27 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8badd565-8407-452f-817c-467e3fd3e81a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] nvme not present on system {{(pid=71731) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 16:27:27 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:27:27 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 16:27:27 user nova-compute[71731]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 16:27:27 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d8a9904-7408-4a1c-bf45-896b5698cc39]: (4, '') {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:27:27 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.lightos [None req-8badd565-8407-452f-817c-467e3fd3e81a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71731) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 16:27:27 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.lightos [None req-8badd565-8407-452f-817c-467e3fd3e81a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71731) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 16:27:27 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.lightos [None req-8badd565-8407-452f-817c-467e3fd3e81a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] LIGHTOS: no hostnqn found. {{(pid=71731) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 16:27:27 user nova-compute[71731]: DEBUG os_brick.utils [None req-8badd565-8407-452f-817c-467e3fd3e81a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:81501d91421', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 16:27:27 user nova-compute[71731]: DEBUG nova.virt.block_device [None req-8badd565-8407-452f-817c-467e3fd3e81a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] Updating existing volume attachment record: 1c54ea9d-ccb1-4939-a1eb-797da401db9b {{(pid=71731) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 16:27:27 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:27:28 user nova-compute[71731]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681403233.3568223, bf350da4-9cc2-4900-adf0-506e44984b42 => Stopped> {{(pid=71731) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 16:27:28 user nova-compute[71731]: INFO nova.compute.manager [-] [instance: bf350da4-9cc2-4900-adf0-506e44984b42] VM Stopped (Lifecycle Event)
Apr 13 16:27:28 user nova-compute[71731]: DEBUG nova.compute.manager [None req-4bdc4478-b0df-4544-afe7-6d865a41fe97 None None] [instance: bf350da4-9cc2-4900-adf0-506e44984b42] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:27:28 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:27:29 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:27:31 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:27:31 user nova-compute[71731]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8badd565-8407-452f-817c-467e3fd3e81a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] Calling os-brick to attach iSCSI Volume {{(pid=71731) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 16:27:31 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-8badd565-8407-452f-817c-467e3fd3e81a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8cf0118790>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d53e720e-a9ca-499b-aacd-aad1a169a874', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZTozqKwG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 16:27:31 user nova-compute[71731]: WARNING os_brick.initiator.connectors.base [None req-8badd565-8407-452f-817c-467e3fd3e81a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 16:27:31 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-8badd565-8407-452f-817c-467e3fd3e81a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 16:27:31 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-8badd565-8407-452f-817c-467e3fd3e81a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 16:27:31 user nova-compute[71731]: WARNING os_brick.initiator.connectors.base [None req-8badd565-8407-452f-817c-467e3fd3e81a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 16:27:31 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-8badd565-8407-452f-817c-467e3fd3e81a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d53e720e-a9ca-499b-aacd-aad1a169a874" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 16:27:31 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-8badd565-8407-452f-817c-467e3fd3e81a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d53e720e-a9ca-499b-aacd-aad1a169a874" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 16:27:31 user nova-compute[71731]: INFO os_brick.initiator.connectors.iscsi [None req-8badd565-8407-452f-817c-467e3fd3e81a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 16:27:31 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d53e720e-a9ca-499b-aacd-aad1a169a874 -p 172.16.0.220:3260 {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:27:31 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d53e720e-a9ca-499b-aacd-aad1a169a874 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:27:31 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[837113e4-9167-4c6b-a942-a87bd342c825]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:27:31 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-8badd565-8407-452f-817c-467e3fd3e81a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 16:27:31 user nova-compute[71731]:  {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:27:31 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d53e720e-a9ca-499b-aacd-aad1a169a874 -p 172.16.0.220:3260 --interface default --op new {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:27:31 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d53e720e-a9ca-499b-aacd-aad1a169a874 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:27:31 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0a58a27-206e-4af2-8c73-417390b6ccd5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d53e720e-a9ca-499b-aacd-aad1a169a874] added\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:27:31 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-8badd565-8407-452f-817c-467e3fd3e81a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d53e720e-a9ca-499b-aacd-aad1a169a874] added
Apr 13 16:27:31 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:27:31 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d53e720e-a9ca-499b-aacd-aad1a169a874 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:27:31 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d53e720e-a9ca-499b-aacd-aad1a169a874 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:27:31 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[818f3ff7-32a1-4635-8486-443489228f7b]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:27:31 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-8badd565-8407-452f-817c-467e3fd3e81a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:27:31 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d53e720e-a9ca-499b-aacd-aad1a169a874 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:27:31 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d53e720e-a9ca-499b-aacd-aad1a169a874 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:27:31 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[26d31aef-5a40-42b4-b84e-750254f5e4d0]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:27:31 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-8badd565-8407-452f-817c-467e3fd3e81a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:27:31 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d53e720e-a9ca-499b-aacd-aad1a169a874 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZTozqKwG {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:27:31 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d53e720e-a9ca-499b-aacd-aad1a169a874 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZTozqKwG" returned: 0 in 0.024s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:27:31 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[95311ec4-4495-4ce5-9344-2505a3ee8be1]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:27:31 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-8badd565-8407-452f-817c-467e3fd3e81a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZTozqKwG'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:27:31 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d53e720e-a9ca-499b-aacd-aad1a169a874 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:27:31 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d53e720e-a9ca-499b-aacd-aad1a169a874 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:27:31 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[17001dce-f29b-4d3e-8e17-d66fee39c9c1]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:27:31 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-8badd565-8407-452f-817c-467e3fd3e81a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:27:31 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:27:31 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:27:31 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[d37cda1d-5b4a-49da-a558-cbcc1ca9d50d]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4317bfd-71c2-4c48-a0f0-e3c795f262a8 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb2c60ec-fb52-436f-a98a-dfe15d1e3aa6 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f45c196f-e69b-4a40-8a72-2e5a3b2dbe82 (non-flash)\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:27:31 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-8badd565-8407-452f-817c-467e3fd3e81a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)
Apr 13 16:27:31 user nova-compute[71731]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4317bfd-71c2-4c48-a0f0-e3c795f262a8 (non-flash)
Apr 13 16:27:31 user nova-compute[71731]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb2c60ec-fb52-436f-a98a-dfe15d1e3aa6 (non-flash)
Apr 13 16:27:31 user nova-compute[71731]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f45c196f-e69b-4a40-8a72-2e5a3b2dbe82 (non-flash)
Apr 13 16:27:31 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 16:27:31 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-8badd565-8407-452f-817c-467e3fd3e81a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)
Apr 13 16:27:31 user nova-compute[71731]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4317bfd-71c2-4c48-a0f0-e3c795f262a8 (non-flash)
Apr 13 16:27:31 user nova-compute[71731]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb2c60ec-fb52-436f-a98a-dfe15d1e3aa6 (non-flash)
Apr 13 16:27:31 user nova-compute[71731]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f45c196f-e69b-4a40-8a72-2e5a3b2dbe82 (non-flash)
Apr 13 16:27:31 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 16:27:31 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d53e720e-a9ca-499b-aacd-aad1a169a874 -p 172.16.0.220:3260 --login {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:27:32 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d53e720e-a9ca-499b-aacd-aad1a169a874 -p 172.16.0.220:3260 --login" returned: 0 in 0.081s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:27:32 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[0471f004-0806-4e86-a25e-f13bf4d88372]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d53e720e-a9ca-499b-aacd-aad1a169a874, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d53e720e-a9ca-499b-aacd-aad1a169a874, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:27:32 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-8badd565-8407-452f-817c-467e3fd3e81a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d53e720e-a9ca-499b-aacd-aad1a169a874, portal: 172.16.0.220,3260]
Apr 13 16:27:32 user nova-compute[71731]: Login to [iface: default, target: iqn.2010-10.org.openstack:d53e720e-a9ca-499b-aacd-aad1a169a874, portal: 172.16.0.220,3260] successful.
Apr 13 16:27:32 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:27:32 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d53e720e-a9ca-499b-aacd-aad1a169a874 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:27:32 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d53e720e-a9ca-499b-aacd-aad1a169a874 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:27:32 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[65725403-8b7e-4a43-9f0e-3dfa38dadea2]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:27:32 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-8badd565-8407-452f-817c-467e3fd3e81a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:27:32 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:27:32 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:27:32 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7e63780-c4d0-41cd-a13f-0313e628ce2e]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4317bfd-71c2-4c48-a0f0-e3c795f262a8 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb2c60ec-fb52-436f-a98a-dfe15d1e3aa6 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f45c196f-e69b-4a40-8a72-2e5a3b2dbe82 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d53e720e-a9ca-499b-aacd-aad1a169a874 (non-flash)\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:27:32 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-8badd565-8407-452f-817c-467e3fd3e81a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)
Apr 13 16:27:32 user nova-compute[71731]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4317bfd-71c2-4c48-a0f0-e3c795f262a8 (non-flash)
Apr 13 16:27:32 user nova-compute[71731]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb2c60ec-fb52-436f-a98a-dfe15d1e3aa6 (non-flash)
Apr 13 16:27:32 user nova-compute[71731]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f45c196f-e69b-4a40-8a72-2e5a3b2dbe82 (non-flash)
Apr 13 16:27:32 user nova-compute[71731]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d53e720e-a9ca-499b-aacd-aad1a169a874 (non-flash)
Apr 13 16:27:32 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 16:27:32 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-8badd565-8407-452f-817c-467e3fd3e81a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)
Apr 13 16:27:32 user nova-compute[71731]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4317bfd-71c2-4c48-a0f0-e3c795f262a8 (non-flash)
Apr 13 16:27:32 user nova-compute[71731]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb2c60ec-fb52-436f-a98a-dfe15d1e3aa6 (non-flash)
Apr 13 16:27:32 user nova-compute[71731]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f45c196f-e69b-4a40-8a72-2e5a3b2dbe82 (non-flash)
Apr 13 16:27:32 user nova-compute[71731]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d53e720e-a9ca-499b-aacd-aad1a169a874 (non-flash)
Apr 13 16:27:32 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 16:27:32 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-8badd565-8407-452f-817c-467e3fd3e81a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d53e720e-a9ca-499b-aacd-aad1a169a874" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.347s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 16:27:32 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-8badd565-8407-452f-817c-467e3fd3e81a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Connected to 172.16.0.220:3260 {{(pid=71731) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 16:27:32 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-8badd565-8407-452f-817c-467e3fd3e81a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] HCTL ('36', '-', '-', 0) found on session 24 with lun 0 {{(pid=71731) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 16:27:32 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-8badd565-8407-452f-817c-467e3fd3e81a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=71731) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 16:27:32 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:27:32 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.021s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:27:32 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[314ec537-0e50-424f-b1ee-918a441498b3]: (4, ('- - 0', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:27:32 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-8badd565-8407-452f-817c-467e3fd3e81a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Searching for a device in session 24 and hctl ['36', '*', '*', 0] yield: sde {{(pid=71731) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 16:27:32 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-8badd565-8407-452f-817c-467e3fd3e81a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:d53e720e-a9ca-499b-aacd-aad1a169a874', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZTozqKwG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71731) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 16:27:33 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-8badd565-8407-452f-817c-467e3fd3e81a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.388s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 16:27:33 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-8badd565-8407-452f-817c-467e3fd3e81a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] <== connect_volume: return (1390ms) {'type': 'block', 'scsi_wwn': '26166623035356333', 'path': '/dev/sde'} {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 16:27:33 user nova-compute[71731]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8badd565-8407-452f-817c-467e3fd3e81a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26166623035356333', 'path': '/dev/sde'} {{(pid=71731) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 16:27:33 user nova-compute[71731]: DEBUG nova.objects.instance [None req-8badd565-8407-452f-817c-467e3fd3e81a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lazy-loading 'flavor' on Instance uuid acbcaee0-a47b-4fee-8765-9b1c9597d515 {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:27:33 user nova-compute[71731]: DEBUG nova.virt.libvirt.guest [None req-8badd565-8407-452f-817c-467e3fd3e81a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] attach device xml: <disk type="block" device="disk">
Apr 13 16:27:33 user nova-compute[71731]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 16:27:33 user nova-compute[71731]:   <source dev="/dev/sde"/>
Apr 13 16:27:33 user nova-compute[71731]:   <target dev="vdb" bus="virtio"/>
Apr 13 16:27:33 user nova-compute[71731]:   <serial>d53e720e-a9ca-499b-aacd-aad1a169a874</serial>
Apr 13 16:27:33 user nova-compute[71731]: </disk>
Apr 13 16:27:33 user nova-compute[71731]:  {{(pid=71731) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 13 16:27:33 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:27:33 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-8badd565-8407-452f-817c-467e3fd3e81a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] No BDM found with device name vda, not building metadata. {{(pid=71731) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 16:27:33 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-8badd565-8407-452f-817c-467e3fd3e81a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71731) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 16:27:33 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-8badd565-8407-452f-817c-467e3fd3e81a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] No VIF found with MAC fa:16:3e:62:32:7f, not building metadata {{(pid=71731) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 16:27:33 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-8badd565-8407-452f-817c-467e3fd3e81a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "acbcaee0-a47b-4fee-8765-9b1c9597d515" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.829s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:27:34 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:27:35 user nova-compute[71731]: INFO nova.compute.manager [None req-2d6f81d4-0d08-42dc-97bf-24b652475a52 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] Rebuilding instance
Apr 13 16:27:35 user nova-compute[71731]: DEBUG nova.objects.instance [None req-2d6f81d4-0d08-42dc-97bf-24b652475a52 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lazy-loading 'trusted_certs' on Instance uuid acbcaee0-a47b-4fee-8765-9b1c9597d515 {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:27:35 user nova-compute[71731]: DEBUG nova.compute.manager [None req-2d6f81d4-0d08-42dc-97bf-24b652475a52 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:27:35 user nova-compute[71731]: DEBUG nova.objects.instance [None req-2d6f81d4-0d08-42dc-97bf-24b652475a52 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lazy-loading 'pci_requests' on Instance uuid acbcaee0-a47b-4fee-8765-9b1c9597d515 {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:27:35 user nova-compute[71731]: DEBUG nova.objects.instance [None req-2d6f81d4-0d08-42dc-97bf-24b652475a52 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lazy-loading 'pci_devices' on Instance uuid acbcaee0-a47b-4fee-8765-9b1c9597d515 {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:27:35 user nova-compute[71731]: DEBUG nova.objects.instance [None req-2d6f81d4-0d08-42dc-97bf-24b652475a52 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lazy-loading 'resources' on Instance uuid acbcaee0-a47b-4fee-8765-9b1c9597d515 {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:27:35 user nova-compute[71731]: DEBUG nova.objects.instance [None req-2d6f81d4-0d08-42dc-97bf-24b652475a52 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lazy-loading 'migration_context' on Instance uuid acbcaee0-a47b-4fee-8765-9b1c9597d515 {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:27:35 user nova-compute[71731]: DEBUG nova.objects.instance [None req-2d6f81d4-0d08-42dc-97bf-24b652475a52 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] Trying to apply a migration context that does not seem to be set for this instance {{(pid=71731) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1032}}
Apr 13 16:27:35 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:27:35 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:27:35 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:27:35 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:27:35 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:27:35 user nova-compute[71731]: DEBUG nova.compute.manager [req-a84754a8-e677-4b43-8a8f-22920050986e req-2b679f21-a4ec-42f3-920b-4198ec94944d service nova] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] Received event network-vif-unplugged-13471516-9514-4b85-938f-69657c2990e5 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:27:35 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-a84754a8-e677-4b43-8a8f-22920050986e req-2b679f21-a4ec-42f3-920b-4198ec94944d service nova] Acquiring lock "acbcaee0-a47b-4fee-8765-9b1c9597d515-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:27:35 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-a84754a8-e677-4b43-8a8f-22920050986e req-2b679f21-a4ec-42f3-920b-4198ec94944d service nova] Lock "acbcaee0-a47b-4fee-8765-9b1c9597d515-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:27:35 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-a84754a8-e677-4b43-8a8f-22920050986e req-2b679f21-a4ec-42f3-920b-4198ec94944d service nova] Lock "acbcaee0-a47b-4fee-8765-9b1c9597d515-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:27:35 user nova-compute[71731]: DEBUG nova.compute.manager [req-a84754a8-e677-4b43-8a8f-22920050986e req-2b679f21-a4ec-42f3-920b-4198ec94944d service nova] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] No waiting events found dispatching network-vif-unplugged-13471516-9514-4b85-938f-69657c2990e5 {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:27:35 user nova-compute[71731]: WARNING nova.compute.manager [req-a84754a8-e677-4b43-8a8f-22920050986e req-2b679f21-a4ec-42f3-920b-4198ec94944d service nova] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] Received unexpected event network-vif-unplugged-13471516-9514-4b85-938f-69657c2990e5 for instance with vm_state active and task_state rebuilding.
Apr 13 16:27:36 user nova-compute[71731]: INFO nova.virt.libvirt.driver [-] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] Instance destroyed successfully.
Apr 13 16:27:36 user nova-compute[71731]: INFO nova.compute.manager [None req-2d6f81d4-0d08-42dc-97bf-24b652475a52 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] Detaching volume d53e720e-a9ca-499b-aacd-aad1a169a874
Apr 13 16:27:36 user nova-compute[71731]: INFO nova.virt.block_device [None req-2d6f81d4-0d08-42dc-97bf-24b652475a52 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] Attempting to driver detach volume d53e720e-a9ca-499b-aacd-aad1a169a874 from mountpoint /dev/vdb
Apr 13 16:27:36 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-2d6f81d4-0d08-42dc-97bf-24b652475a52 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Attempting to detach device vdb from instance acbcaee0-a47b-4fee-8765-9b1c9597d515 from the persistent domain config. {{(pid=71731) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 13 16:27:36 user nova-compute[71731]: DEBUG nova.virt.libvirt.guest [None req-2d6f81d4-0d08-42dc-97bf-24b652475a52 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 16:27:36 user nova-compute[71731]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 16:27:36 user nova-compute[71731]:   <source dev="/dev/sde"/>
Apr 13 16:27:36 user nova-compute[71731]:   <target dev="vdb" bus="virtio"/>
Apr 13 16:27:36 user nova-compute[71731]:   <serial>d53e720e-a9ca-499b-aacd-aad1a169a874</serial>
Apr 13 16:27:36 user nova-compute[71731]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 13 16:27:36 user nova-compute[71731]: </disk>
Apr 13 16:27:36 user nova-compute[71731]:  {{(pid=71731) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 16:27:36 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-2d6f81d4-0d08-42dc-97bf-24b652475a52 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Successfully detached device vdb from instance acbcaee0-a47b-4fee-8765-9b1c9597d515 from the persistent domain config.
Apr 13 16:27:36 user nova-compute[71731]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2d6f81d4-0d08-42dc-97bf-24b652475a52 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] calling os-brick to detach iSCSI Volume {{(pid=71731) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 16:27:36 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d6f81d4-0d08-42dc-97bf-24b652475a52 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8cf0118790>, {'target_iqn': 'iqn.2010-10.org.openstack:d53e720e-a9ca-499b-aacd-aad1a169a874', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZTozqKwG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde': {}}" {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 16:27:36 user nova-compute[71731]: WARNING os_brick.initiator.connectors.base [None req-2d6f81d4-0d08-42dc-97bf-24b652475a52 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Apr 13 16:27:36 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-2d6f81d4-0d08-42dc-97bf-24b652475a52 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 16:27:36 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-2d6f81d4-0d08-42dc-97bf-24b652475a52 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 16:27:36 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:27:36 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:27:36 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[be4d946a-c922-4776-84ce-e696ae7c1d6a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e4317bfd-71c2-4c48-a0f0-e3c795f262a8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:eb2c60ec-fb52-436f-a98a-dfe15d1e3aa6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d53e720e-a9ca-499b-aacd-aad1a169a874\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f45c196f-e69b-4a40-8a72-2e5a3b2dbe82\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:27:36 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d6f81d4-0d08-42dc-97bf-24b652475a52 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 16:27:36 user nova-compute[71731]: No targets found.
Apr 13 16:27:36 user nova-compute[71731]: iSNS:
Apr 13 16:27:36 user nova-compute[71731]: No targets found.
Apr 13 16:27:36 user nova-compute[71731]: STATIC:
Apr 13 16:27:36 user nova-compute[71731]: Target: iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97
Apr 13 16:27:36 user nova-compute[71731]:         Portal: 172.16.0.220:3260,-1
Apr 13 16:27:36 user nova-compute[71731]:                 Iface Name: default
Apr 13 16:27:36 user nova-compute[71731]: Target: iqn.2010-10.org.openstack:e4317bfd-71c2-4c48-a0f0-e3c795f262a8
Apr 13 16:27:36 user nova-compute[71731]:         Portal: 172.16.0.220:3260,-1
Apr 13 16:27:36 user nova-compute[71731]:                 Iface Name: default
Apr 13 16:27:36 user nova-compute[71731]: Target: iqn.2010-10.org.openstack:eb2c60ec-fb52-436f-a98a-dfe15d1e3aa6
Apr 13 16:27:36 user nova-compute[71731]:         Portal: 172.16.0.220:3260,-1
Apr 13 16:27:36 user nova-compute[71731]:                 Iface Name: default
Apr 13 16:27:36 user nova-compute[71731]: Target: iqn.2010-10.org.openstack:d53e720e-a9ca-499b-aacd-aad1a169a874
Apr 13 16:27:36 user nova-compute[71731]:         Portal: 172.16.0.220:3260,-1
Apr 13 16:27:36 user nova-compute[71731]:                 Iface Name: default
Apr 13 16:27:36 user nova-compute[71731]: Target: iqn.2010-10.org.openstack:f45c196f-e69b-4a40-8a72-2e5a3b2dbe82
Apr 13 16:27:36 user nova-compute[71731]:         Portal: 172.16.0.220:3260,-1
Apr 13 16:27:36 user nova-compute[71731]:                 Iface Name: default
Apr 13 16:27:36 user nova-compute[71731]: FIRMWARE:
Apr 13 16:27:36 user nova-compute[71731]: No targets found.
Apr 13 16:27:36 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 16:27:36 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d6f81d4-0d08-42dc-97bf-24b652475a52 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 16:27:36 user nova-compute[71731]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 16:27:36 user nova-compute[71731]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71731) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 16:27:36 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d6f81d4-0d08-42dc-97bf-24b652475a52 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d53e720e-a9ca-499b-aacd-aad1a169a874', 0)] {{(pid=71731) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 16:27:36 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:27:36 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:27:36 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eb212b9-8f22-46e5-928b-4053a59700d6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d53e720e-a9ca-499b-aacd-aad1a169a874\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e4317bfd-71c2-4c48-a0f0-e3c795f262a8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eb2c60ec-fb52-436f-a98a-dfe15d1e3aa6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f45c196f-e69b-4a40-8a72-2e5a3b2dbe82\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:27:36 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:27:36 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:27:36 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[819fc948-90ef-411a-bc70-de4ba201c168]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4317bfd-71c2-4c48-a0f0-e3c795f262a8 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb2c60ec-fb52-436f-a98a-dfe15d1e3aa6 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f45c196f-e69b-4a40-8a72-2e5a3b2dbe82 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d53e720e-a9ca-499b-aacd-aad1a169a874 (non-flash)\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:27:36 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d6f81d4-0d08-42dc-97bf-24b652475a52 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)
Apr 13 16:27:36 user nova-compute[71731]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4317bfd-71c2-4c48-a0f0-e3c795f262a8 (non-flash)
Apr 13 16:27:36 user nova-compute[71731]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb2c60ec-fb52-436f-a98a-dfe15d1e3aa6 (non-flash)
Apr 13 16:27:36 user nova-compute[71731]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f45c196f-e69b-4a40-8a72-2e5a3b2dbe82 (non-flash)
Apr 13 16:27:36 user nova-compute[71731]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d53e720e-a9ca-499b-aacd-aad1a169a874 (non-flash)
Apr 13 16:27:36 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 16:27:36 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d6f81d4-0d08-42dc-97bf-24b652475a52 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)
Apr 13 16:27:36 user nova-compute[71731]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4317bfd-71c2-4c48-a0f0-e3c795f262a8 (non-flash)
Apr 13 16:27:36 user nova-compute[71731]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb2c60ec-fb52-436f-a98a-dfe15d1e3aa6 (non-flash)
Apr 13 16:27:36 user nova-compute[71731]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f45c196f-e69b-4a40-8a72-2e5a3b2dbe82 (non-flash)
Apr 13 16:27:36 user nova-compute[71731]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d53e720e-a9ca-499b-aacd-aad1a169a874 (non-flash)
Apr 13 16:27:36 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 16:27:36 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d6f81d4-0d08-42dc-97bf-24b652475a52 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8cff3f40d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d53e720e-a9ca-499b-aacd-aad1a169a874'): ({'sde'}, set())}) {{(pid=71731) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 16:27:36 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-2d6f81d4-0d08-42dc-97bf-24b652475a52 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Removing single pathed devices sde {{(pid=71731) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 16:27:36 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:27:36 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:27:36 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:27:36 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[99ca206b-2030-42aa-b267-fd9f944e64ce]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:27:36 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:27:36 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.026s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:27:36 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ee22178-8845-4ce7-acd6-ddeee4bb14ac]: (4, ('ok\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:27:36 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-2d6f81d4-0d08-42dc-97bf-24b652475a52 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Flushing IO for device /dev/sde {{(pid=71731) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 16:27:36 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:27:36 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:27:36 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb2e8f3f-3925-46c3-b153-f5690dac7237]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:27:36 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-2d6f81d4-0d08-42dc-97bf-24b652475a52 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=71731) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 16:27:36 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:27:36 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.041s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:27:36 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e5a22a2-9671-468d-9b7e-675ee1af9e89]: (4, ('1', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:27:36 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-2d6f81d4-0d08-42dc-97bf-24b652475a52 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=71731) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 16:27:36 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-2d6f81d4-0d08-42dc-97bf-24b652475a52 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] SCSI volumes sde have been removed. {{(pid=71731) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 16:27:36 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d6f81d4-0d08-42dc-97bf-24b652475a52 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d53e720e-a9ca-499b-aacd-aad1a169a874')] {{(pid=71731) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 16:27:36 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d53e720e-a9ca-499b-aacd-aad1a169a874 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:27:36 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d53e720e-a9ca-499b-aacd-aad1a169a874 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:27:36 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed25ddd6-db7f-4097-ac31-9e13e919fad1]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:27:36 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d6f81d4-0d08-42dc-97bf-24b652475a52 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:27:36 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d53e720e-a9ca-499b-aacd-aad1a169a874 -p 172.16.0.220:3260 --logout {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:27:36 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d53e720e-a9ca-499b-aacd-aad1a169a874 -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:27:36 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[1be442a5-9adc-4c39-a7d1-75814d561bcb]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:d53e720e-a9ca-499b-aacd-aad1a169a874, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:d53e720e-a9ca-499b-aacd-aad1a169a874, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:27:36 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d6f81d4-0d08-42dc-97bf-24b652475a52 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:d53e720e-a9ca-499b-aacd-aad1a169a874, portal: 172.16.0.220,3260]
Apr 13 16:27:36 user nova-compute[71731]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:d53e720e-a9ca-499b-aacd-aad1a169a874, portal: 172.16.0.220,3260] successful.
Apr 13 16:27:36 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:27:36 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d53e720e-a9ca-499b-aacd-aad1a169a874 -p 172.16.0.220:3260 --op delete {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:27:36 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d53e720e-a9ca-499b-aacd-aad1a169a874 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:27:36 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[efb068b2-bb87-4e81-8b20-c60e09c9dffd]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:27:36 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d6f81d4-0d08-42dc-97bf-24b652475a52 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:27:36 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-2d6f81d4-0d08-42dc-97bf-24b652475a52 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.350s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 16:27:36 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d6f81d4-0d08-42dc-97bf-24b652475a52 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] <== disconnect_volume: return (351ms) None {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 16:27:36 user nova-compute[71731]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2d6f81d4-0d08-42dc-97bf-24b652475a52 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] Disconnected iSCSI Volume {{(pid=71731) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 16:27:36 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:27:37 user nova-compute[71731]: INFO nova.virt.libvirt.driver [-] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] Instance destroyed successfully.
Apr 13 16:27:37 user nova-compute[71731]: DEBUG nova.virt.libvirt.vif [None req-2d6f81d4-0d08-42dc-97bf-24b652475a52 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T16:23:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1986504733',display_name='tempest-ServerActionsTestJSON-server-376598631',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1986504733',id=16,image_ref='708622a9-7465-4492-ade8-b827198f7e30',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPaDda4gTmMbkxKfok8i4i1XcNLza5lOVYjCPDEGVTF1JRQKderq80DnIN4GAkaZiBV5U44gvdu3wadL/M5wOH7VDSuEghHchow1mC9TB1xgdo8GoXeM279SVAyu08uhIQ==',key_name='tempest-keypair-1700037342',keypairs=<?>,launch_index=0,launched_at=2023-04-13T16:23:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='980559734a504574a83224deb7423c77',ramdisk_id='',reservation_id='r-3vv5sptg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='708622a9-7465-4492-ade8-b827198f7e30',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestJSON-713402718',owner_user_name='tempest-ServerActionsTestJSON-713402718-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T16:27:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1b3df1c5c5d441819bcef89ed6966815',uuid=acbcaee0-a47b-4fee-8765-9b1c9597d515,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "13471516-9514-4b85-938f-69657c2990e5", "address": "fa:16:3e:62:32:7f", "network": {"id": "cf1fef97-9ef1-449f-a302-b38110024547", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1138167711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "980559734a504574a83224deb7423c77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13471516-95", "ovs_interfaceid": "13471516-9514-4b85-938f-69657c2990e5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 16:27:37 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-2d6f81d4-0d08-42dc-97bf-24b652475a52 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Converting VIF {"id": "13471516-9514-4b85-938f-69657c2990e5", "address": "fa:16:3e:62:32:7f", "network": {"id": "cf1fef97-9ef1-449f-a302-b38110024547", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1138167711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "980559734a504574a83224deb7423c77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13471516-95", "ovs_interfaceid": "13471516-9514-4b85-938f-69657c2990e5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 16:27:37 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-2d6f81d4-0d08-42dc-97bf-24b652475a52 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:62:32:7f,bridge_name='br-int',has_traffic_filtering=True,id=13471516-9514-4b85-938f-69657c2990e5,network=Network(cf1fef97-9ef1-449f-a302-b38110024547),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13471516-95') {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 16:27:37 user nova-compute[71731]: DEBUG os_vif [None req-2d6f81d4-0d08-42dc-97bf-24b652475a52 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:62:32:7f,bridge_name='br-int',has_traffic_filtering=True,id=13471516-9514-4b85-938f-69657c2990e5,network=Network(cf1fef97-9ef1-449f-a302-b38110024547),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13471516-95') {{(pid=71731) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 16:27:37 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:27:37 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap13471516-95, bridge=br-int, if_exists=True) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:27:37 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:27:37 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 16:27:37 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:27:37 user nova-compute[71731]: INFO os_vif [None req-2d6f81d4-0d08-42dc-97bf-24b652475a52 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:62:32:7f,bridge_name='br-int',has_traffic_filtering=True,id=13471516-9514-4b85-938f-69657c2990e5,network=Network(cf1fef97-9ef1-449f-a302-b38110024547),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13471516-95')
Apr 13 16:27:37 user nova-compute[71731]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2d6f81d4-0d08-42dc-97bf-24b652475a52 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] calling os-brick to detach iSCSI Volume {{(pid=71731) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 16:27:37 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d6f81d4-0d08-42dc-97bf-24b652475a52 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8cf0118790>, {'target_iqn': 'iqn.2010-10.org.openstack:d53e720e-a9ca-499b-aacd-aad1a169a874', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZTozqKwG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde': {}}" {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 16:27:37 user nova-compute[71731]: WARNING os_brick.initiator.connectors.base [None req-2d6f81d4-0d08-42dc-97bf-24b652475a52 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Apr 13 16:27:37 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-2d6f81d4-0d08-42dc-97bf-24b652475a52 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 16:27:37 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-2d6f81d4-0d08-42dc-97bf-24b652475a52 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 16:27:37 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:27:37 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:27:37 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d6fcc37-6a5c-4983-9312-a96cc8484e7b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e4317bfd-71c2-4c48-a0f0-e3c795f262a8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:eb2c60ec-fb52-436f-a98a-dfe15d1e3aa6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f45c196f-e69b-4a40-8a72-2e5a3b2dbe82\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:27:37 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d6f81d4-0d08-42dc-97bf-24b652475a52 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 16:27:37 user nova-compute[71731]: No targets found.
Apr 13 16:27:37 user nova-compute[71731]: iSNS:
Apr 13 16:27:37 user nova-compute[71731]: No targets found.
Apr 13 16:27:37 user nova-compute[71731]: STATIC:
Apr 13 16:27:37 user nova-compute[71731]: Target: iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97
Apr 13 16:27:37 user nova-compute[71731]:         Portal: 172.16.0.220:3260,-1
Apr 13 16:27:37 user nova-compute[71731]:                 Iface Name: default
Apr 13 16:27:37 user nova-compute[71731]: Target: iqn.2010-10.org.openstack:e4317bfd-71c2-4c48-a0f0-e3c795f262a8
Apr 13 16:27:37 user nova-compute[71731]:         Portal: 172.16.0.220:3260,-1
Apr 13 16:27:37 user nova-compute[71731]:                 Iface Name: default
Apr 13 16:27:37 user nova-compute[71731]: Target: iqn.2010-10.org.openstack:eb2c60ec-fb52-436f-a98a-dfe15d1e3aa6
Apr 13 16:27:37 user nova-compute[71731]:         Portal: 172.16.0.220:3260,-1
Apr 13 16:27:37 user nova-compute[71731]:                 Iface Name: default
Apr 13 16:27:37 user nova-compute[71731]: Target: iqn.2010-10.org.openstack:f45c196f-e69b-4a40-8a72-2e5a3b2dbe82
Apr 13 16:27:37 user nova-compute[71731]:         Portal: 172.16.0.220:3260,-1
Apr 13 16:27:37 user nova-compute[71731]:                 Iface Name: default
Apr 13 16:27:37 user nova-compute[71731]: FIRMWARE:
Apr 13 16:27:37 user nova-compute[71731]: No targets found.
Apr 13 16:27:37 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 16:27:37 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d6f81d4-0d08-42dc-97bf-24b652475a52 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 16:27:37 user nova-compute[71731]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 16:27:37 user nova-compute[71731]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71731) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 16:27:37 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d6f81d4-0d08-42dc-97bf-24b652475a52 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d53e720e-a9ca-499b-aacd-aad1a169a874', 0)] {{(pid=71731) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 16:27:37 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:27:37 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:27:37 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fc8a71a-17cc-4e2e-94cf-12f65b25e44f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e4317bfd-71c2-4c48-a0f0-e3c795f262a8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eb2c60ec-fb52-436f-a98a-dfe15d1e3aa6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f45c196f-e69b-4a40-8a72-2e5a3b2dbe82\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:27:37 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:27:37 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:27:37 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[768c3d3f-4e9f-480d-8e32-4f8788e49026]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4317bfd-71c2-4c48-a0f0-e3c795f262a8 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb2c60ec-fb52-436f-a98a-dfe15d1e3aa6 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f45c196f-e69b-4a40-8a72-2e5a3b2dbe82 (non-flash)\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:27:37 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d6f81d4-0d08-42dc-97bf-24b652475a52 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)
Apr 13 16:27:37 user nova-compute[71731]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4317bfd-71c2-4c48-a0f0-e3c795f262a8 (non-flash)
Apr 13 16:27:37 user nova-compute[71731]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb2c60ec-fb52-436f-a98a-dfe15d1e3aa6 (non-flash)
Apr 13 16:27:37 user nova-compute[71731]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f45c196f-e69b-4a40-8a72-2e5a3b2dbe82 (non-flash)
Apr 13 16:27:37 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 16:27:37 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d6f81d4-0d08-42dc-97bf-24b652475a52 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)
Apr 13 16:27:37 user nova-compute[71731]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4317bfd-71c2-4c48-a0f0-e3c795f262a8 (non-flash)
Apr 13 16:27:37 user nova-compute[71731]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb2c60ec-fb52-436f-a98a-dfe15d1e3aa6 (non-flash)
Apr 13 16:27:37 user nova-compute[71731]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f45c196f-e69b-4a40-8a72-2e5a3b2dbe82 (non-flash)
Apr 13 16:27:37 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 16:27:37 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d6f81d4-0d08-42dc-97bf-24b652475a52 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8cf00e4790>, {}) {{(pid=71731) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 16:27:37 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d6f81d4-0d08-42dc-97bf-24b652475a52 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Disconnecting from: [] {{(pid=71731) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 16:27:37 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-2d6f81d4-0d08-42dc-97bf-24b652475a52 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.083s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 16:27:37 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d6f81d4-0d08-42dc-97bf-24b652475a52 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] <== disconnect_volume: return (84ms) None {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 16:27:37 user nova-compute[71731]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2d6f81d4-0d08-42dc-97bf-24b652475a52 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] Disconnected iSCSI Volume {{(pid=71731) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 16:27:37 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-2d6f81d4-0d08-42dc-97bf-24b652475a52 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] Deleting instance files /opt/stack/data/nova/instances/acbcaee0-a47b-4fee-8765-9b1c9597d515_del
Apr 13 16:27:37 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-2d6f81d4-0d08-42dc-97bf-24b652475a52 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] Deletion of /opt/stack/data/nova/instances/acbcaee0-a47b-4fee-8765-9b1c9597d515_del complete
Apr 13 16:27:37 user nova-compute[71731]: DEBUG nova.compute.manager [req-14111b02-068e-4353-9f11-f2d64383b954 req-70ece200-9a4f-433c-9e69-8e5a76e58b1a service nova] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] Received event network-vif-plugged-13471516-9514-4b85-938f-69657c2990e5 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:27:37 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-14111b02-068e-4353-9f11-f2d64383b954 req-70ece200-9a4f-433c-9e69-8e5a76e58b1a service nova] Acquiring lock "acbcaee0-a47b-4fee-8765-9b1c9597d515-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:27:37 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-14111b02-068e-4353-9f11-f2d64383b954 req-70ece200-9a4f-433c-9e69-8e5a76e58b1a service nova] Lock "acbcaee0-a47b-4fee-8765-9b1c9597d515-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:27:37 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-14111b02-068e-4353-9f11-f2d64383b954 req-70ece200-9a4f-433c-9e69-8e5a76e58b1a service nova] Lock "acbcaee0-a47b-4fee-8765-9b1c9597d515-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:27:37 user nova-compute[71731]: DEBUG nova.compute.manager [req-14111b02-068e-4353-9f11-f2d64383b954 req-70ece200-9a4f-433c-9e69-8e5a76e58b1a service nova] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] No waiting events found dispatching network-vif-plugged-13471516-9514-4b85-938f-69657c2990e5 {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:27:37 user nova-compute[71731]: WARNING nova.compute.manager [req-14111b02-068e-4353-9f11-f2d64383b954 req-70ece200-9a4f-433c-9e69-8e5a76e58b1a service nova] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] Received unexpected event network-vif-plugged-13471516-9514-4b85-938f-69657c2990e5 for instance with vm_state active and task_state rebuilding.
Apr 13 16:27:37 user nova-compute[71731]: INFO nova.virt.block_device [None req-2d6f81d4-0d08-42dc-97bf-24b652475a52 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] Booting with volume d53e720e-a9ca-499b-aacd-aad1a169a874 at /dev/vdb
Apr 13 16:27:37 user nova-compute[71731]: DEBUG os_brick.utils [None req-2d6f81d4-0d08-42dc-97bf-24b652475a52 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 16:27:37 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:27:37 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:27:37 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[95c4aba4-1da2-4609-83af-44a37df43eef]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:81501d91421\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:27:38 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:27:38 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:27:38 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[9614af45-403a-441f-bd71-e51931b10b8b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:27:38 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:27:38 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:27:38 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c18ce9c-87e9-46c3-b1c3-f98c5f94b538]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:27:38 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[a656bdf4-6e72-4069-8e47-0ce43ccca866]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:27:38 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-2d6f81d4-0d08-42dc-97bf-24b652475a52 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Running cmd (subprocess): nvme version {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:27:38 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-2d6f81d4-0d08-42dc-97bf-24b652475a52 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] 'nvme version' failed. Not Retrying. {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 16:27:38 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2d6f81d4-0d08-42dc-97bf-24b652475a52 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] nvme not present on system {{(pid=71731) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 16:27:38 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:27:38 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 16:27:38 user nova-compute[71731]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 16:27:38 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd195f33-f6bf-4b3e-9f62-6cdaa323250d]: (4, '') {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:27:38 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.lightos [None req-2d6f81d4-0d08-42dc-97bf-24b652475a52 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71731) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 16:27:38 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.lightos [None req-2d6f81d4-0d08-42dc-97bf-24b652475a52 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71731) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 16:27:38 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.lightos [None req-2d6f81d4-0d08-42dc-97bf-24b652475a52 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] LIGHTOS: no hostnqn found. {{(pid=71731) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 16:27:38 user nova-compute[71731]: DEBUG os_brick.utils [None req-2d6f81d4-0d08-42dc-97bf-24b652475a52 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:81501d91421', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 16:27:38 user nova-compute[71731]: DEBUG nova.virt.block_device [None req-2d6f81d4-0d08-42dc-97bf-24b652475a52 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] Updating existing volume attachment record: 58be9763-68ba-46d9-9085-f9fb2e7e4b44 {{(pid=71731) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 16:27:39 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-b45dc4f4-c905-4c9d-867c-6cd83c761081 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Acquiring lock "bbcccf4b-e861-4254-9be3-a491776214e9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:27:39 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-b45dc4f4-c905-4c9d-867c-6cd83c761081 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Lock "bbcccf4b-e861-4254-9be3-a491776214e9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:27:39 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-b45dc4f4-c905-4c9d-867c-6cd83c761081 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Acquiring lock "bbcccf4b-e861-4254-9be3-a491776214e9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:27:39 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-b45dc4f4-c905-4c9d-867c-6cd83c761081 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Lock "bbcccf4b-e861-4254-9be3-a491776214e9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:27:39 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-b45dc4f4-c905-4c9d-867c-6cd83c761081 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Lock "bbcccf4b-e861-4254-9be3-a491776214e9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:27:39 user nova-compute[71731]: INFO nova.compute.manager [None req-b45dc4f4-c905-4c9d-867c-6cd83c761081 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] [instance: bbcccf4b-e861-4254-9be3-a491776214e9] Terminating instance
Apr 13 16:27:39 user nova-compute[71731]: DEBUG nova.compute.manager [None req-b45dc4f4-c905-4c9d-867c-6cd83c761081 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] [instance: bbcccf4b-e861-4254-9be3-a491776214e9] Start destroying the instance on the hypervisor. {{(pid=71731) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 16:27:39 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:27:39 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:27:39 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:27:39 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:27:39 user nova-compute[71731]: DEBUG nova.compute.manager [req-9c1f2b7e-6110-4e91-96bd-f6432bb7e80e req-e6c7b681-833c-43c6-8542-0d925501fd50 service nova] [instance: bbcccf4b-e861-4254-9be3-a491776214e9] Received event network-vif-unplugged-dbb2bf27-5de3-499c-ba4d-87867912a143 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:27:39 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-9c1f2b7e-6110-4e91-96bd-f6432bb7e80e req-e6c7b681-833c-43c6-8542-0d925501fd50 service nova] Acquiring lock "bbcccf4b-e861-4254-9be3-a491776214e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:27:39 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-9c1f2b7e-6110-4e91-96bd-f6432bb7e80e req-e6c7b681-833c-43c6-8542-0d925501fd50 service nova] Lock "bbcccf4b-e861-4254-9be3-a491776214e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:27:39 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-9c1f2b7e-6110-4e91-96bd-f6432bb7e80e req-e6c7b681-833c-43c6-8542-0d925501fd50 service nova] Lock "bbcccf4b-e861-4254-9be3-a491776214e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:27:39 user nova-compute[71731]: DEBUG nova.compute.manager [req-9c1f2b7e-6110-4e91-96bd-f6432bb7e80e req-e6c7b681-833c-43c6-8542-0d925501fd50 service nova] [instance: bbcccf4b-e861-4254-9be3-a491776214e9] No waiting events found dispatching network-vif-unplugged-dbb2bf27-5de3-499c-ba4d-87867912a143 {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:27:39 user nova-compute[71731]: DEBUG nova.compute.manager [req-9c1f2b7e-6110-4e91-96bd-f6432bb7e80e req-e6c7b681-833c-43c6-8542-0d925501fd50 service nova] [instance: bbcccf4b-e861-4254-9be3-a491776214e9] Received event network-vif-unplugged-dbb2bf27-5de3-499c-ba4d-87867912a143 for instance with task_state deleting. {{(pid=71731) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 16:27:40 user nova-compute[71731]: INFO nova.virt.libvirt.driver [-] [instance: bbcccf4b-e861-4254-9be3-a491776214e9] Instance destroyed successfully.
Apr 13 16:27:40 user nova-compute[71731]: DEBUG nova.objects.instance [None req-b45dc4f4-c905-4c9d-867c-6cd83c761081 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Lazy-loading 'resources' on Instance uuid bbcccf4b-e861-4254-9be3-a491776214e9 {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:27:40 user nova-compute[71731]: DEBUG nova.virt.libvirt.vif [None req-b45dc4f4-c905-4c9d-867c-6cd83c761081 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T16:20:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1807441960',display_name='tempest-ServerStableDeviceRescueTest-server-1807441960',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1807441960',id=4,image_ref='708622a9-7465-4492-ade8-b827198f7e30',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBssL1q8UrRqcNBzubLNJC8k8DaqQcRK2ysRGrjAyXNJmaI+jOCwcCVXwOavhCNGPOMX3O9mQsDrY3mOGMrByAQWchmBUsGQlz9ppSMT6HadSQb/fuBY4fFJZdDXCx7D8g==',key_name='tempest-keypair-900897003',keypairs=<?>,launch_index=0,launched_at=2023-04-13T16:24:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7061f2f041954ffe90b0c87b422890e4',ramdisk_id='',reservation_id='r-zcqb1d1h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='708622a9-7465-4492-ade8-b827198f7e30',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1182397334',owner_user_name='tempest-ServerStableDeviceRescueTest-1182397334-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T16:26:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9bf19848229f45baad45c490cf539508',uuid=bbcccf4b-e861-4254-9be3-a491776214e9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dbb2bf27-5de3-499c-ba4d-87867912a143", "address": "fa:16:3e:a3:40:f4", "network": {"id": "5a4fe0b3-5f2f-4125-a17d-e2ff424bf01a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1835633180-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.81", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7061f2f041954ffe90b0c87b422890e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbb2bf27-5d", "ovs_interfaceid": "dbb2bf27-5de3-499c-ba4d-87867912a143", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 16:27:40 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-b45dc4f4-c905-4c9d-867c-6cd83c761081 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Converting VIF {"id": "dbb2bf27-5de3-499c-ba4d-87867912a143", "address": "fa:16:3e:a3:40:f4", "network": {"id": "5a4fe0b3-5f2f-4125-a17d-e2ff424bf01a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1835633180-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.81", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7061f2f041954ffe90b0c87b422890e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbb2bf27-5d", "ovs_interfaceid": "dbb2bf27-5de3-499c-ba4d-87867912a143", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 16:27:40 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-b45dc4f4-c905-4c9d-867c-6cd83c761081 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a3:40:f4,bridge_name='br-int',has_traffic_filtering=True,id=dbb2bf27-5de3-499c-ba4d-87867912a143,network=Network(5a4fe0b3-5f2f-4125-a17d-e2ff424bf01a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbb2bf27-5d') {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 16:27:40 user nova-compute[71731]: DEBUG os_vif [None req-b45dc4f4-c905-4c9d-867c-6cd83c761081 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a3:40:f4,bridge_name='br-int',has_traffic_filtering=True,id=dbb2bf27-5de3-499c-ba4d-87867912a143,network=Network(5a4fe0b3-5f2f-4125-a17d-e2ff424bf01a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbb2bf27-5d') {{(pid=71731) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 16:27:40 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:27:40 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdbb2bf27-5d, bridge=br-int, if_exists=True) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:27:40 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:27:40 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 16:27:40 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:27:40 user nova-compute[71731]: INFO os_vif [None req-b45dc4f4-c905-4c9d-867c-6cd83c761081 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a3:40:f4,bridge_name='br-int',has_traffic_filtering=True,id=dbb2bf27-5de3-499c-ba4d-87867912a143,network=Network(5a4fe0b3-5f2f-4125-a17d-e2ff424bf01a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbb2bf27-5d')
Apr 13 16:27:40 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-b45dc4f4-c905-4c9d-867c-6cd83c761081 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] [instance: bbcccf4b-e861-4254-9be3-a491776214e9] Deleting instance files /opt/stack/data/nova/instances/bbcccf4b-e861-4254-9be3-a491776214e9_del
Apr 13 16:27:40 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-b45dc4f4-c905-4c9d-867c-6cd83c761081 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] [instance: bbcccf4b-e861-4254-9be3-a491776214e9] Deletion of /opt/stack/data/nova/instances/bbcccf4b-e861-4254-9be3-a491776214e9_del complete
Apr 13 16:27:40 user nova-compute[71731]: INFO nova.compute.manager [None req-b45dc4f4-c905-4c9d-867c-6cd83c761081 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] [instance: bbcccf4b-e861-4254-9be3-a491776214e9] Took 1.02 seconds to destroy the instance on the hypervisor.
Apr 13 16:27:40 user nova-compute[71731]: DEBUG oslo.service.loopingcall [None req-b45dc4f4-c905-4c9d-867c-6cd83c761081 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71731) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 16:27:40 user nova-compute[71731]: DEBUG nova.compute.manager [-] [instance: bbcccf4b-e861-4254-9be3-a491776214e9] Deallocating network for instance {{(pid=71731) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 16:27:40 user nova-compute[71731]: DEBUG nova.network.neutron [-] [instance: bbcccf4b-e861-4254-9be3-a491776214e9] deallocate_for_instance() {{(pid=71731) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 16:27:40 user nova-compute[71731]: DEBUG nova.network.neutron [-] [instance: bbcccf4b-e861-4254-9be3-a491776214e9] Updating instance_info_cache with network_info: [] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:27:40 user nova-compute[71731]: INFO nova.compute.manager [-] [instance: bbcccf4b-e861-4254-9be3-a491776214e9] Took 0.81 seconds to deallocate network for instance.
Apr 13 16:27:41 user nova-compute[71731]: DEBUG nova.compute.manager [req-5a55b725-7aea-41e0-8191-22f6eea30879 req-75c44ba9-ef52-4063-9ca4-fc0d21b3a903 service nova] [instance: bbcccf4b-e861-4254-9be3-a491776214e9] Received event network-vif-deleted-dbb2bf27-5de3-499c-ba4d-87867912a143 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:27:41 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-b45dc4f4-c905-4c9d-867c-6cd83c761081 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:27:41 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-b45dc4f4-c905-4c9d-867c-6cd83c761081 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:27:41 user nova-compute[71731]: DEBUG nova.compute.provider_tree [None req-b45dc4f4-c905-4c9d-867c-6cd83c761081 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Inventory has not changed in ProviderTree for provider: cb6b1a64-0c24-4e2d-af1e-16576ca9165c {{(pid=71731) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 16:27:41 user nova-compute[71731]: DEBUG nova.scheduler.client.report [None req-b45dc4f4-c905-4c9d-867c-6cd83c761081 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Inventory has not changed for provider cb6b1a64-0c24-4e2d-af1e-16576ca9165c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71731) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 16:27:41 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-b45dc4f4-c905-4c9d-867c-6cd83c761081 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.287s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:27:41 user nova-compute[71731]: INFO nova.scheduler.client.report [None req-b45dc4f4-c905-4c9d-867c-6cd83c761081 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Deleted allocations for instance bbcccf4b-e861-4254-9be3-a491776214e9
Apr 13 16:27:41 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-b45dc4f4-c905-4c9d-867c-6cd83c761081 tempest-ServerStableDeviceRescueTest-1182397334 tempest-ServerStableDeviceRescueTest-1182397334-project-member] Lock "bbcccf4b-e861-4254-9be3-a491776214e9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.304s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:27:41 user nova-compute[71731]: DEBUG nova.compute.manager [req-435abe30-c6e9-4252-9652-15181fddca9b req-ed3b687f-64a5-4290-bd62-a5ad6edc3567 service nova] [instance: bbcccf4b-e861-4254-9be3-a491776214e9] Received event network-vif-plugged-dbb2bf27-5de3-499c-ba4d-87867912a143 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:27:41 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-435abe30-c6e9-4252-9652-15181fddca9b req-ed3b687f-64a5-4290-bd62-a5ad6edc3567 service nova] Acquiring lock "bbcccf4b-e861-4254-9be3-a491776214e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:27:41 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-435abe30-c6e9-4252-9652-15181fddca9b req-ed3b687f-64a5-4290-bd62-a5ad6edc3567 service nova] Lock "bbcccf4b-e861-4254-9be3-a491776214e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:27:41 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-435abe30-c6e9-4252-9652-15181fddca9b req-ed3b687f-64a5-4290-bd62-a5ad6edc3567 service nova] Lock "bbcccf4b-e861-4254-9be3-a491776214e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:27:41 user nova-compute[71731]: DEBUG nova.compute.manager [req-435abe30-c6e9-4252-9652-15181fddca9b req-ed3b687f-64a5-4290-bd62-a5ad6edc3567 service nova] [instance: bbcccf4b-e861-4254-9be3-a491776214e9] No waiting events found dispatching network-vif-plugged-dbb2bf27-5de3-499c-ba4d-87867912a143 {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:27:41 user nova-compute[71731]: WARNING nova.compute.manager [req-435abe30-c6e9-4252-9652-15181fddca9b req-ed3b687f-64a5-4290-bd62-a5ad6edc3567 service nova] [instance: bbcccf4b-e861-4254-9be3-a491776214e9] Received unexpected event network-vif-plugged-dbb2bf27-5de3-499c-ba4d-87867912a143 for instance with vm_state deleted and task_state None.
Apr 13 16:27:41 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:27:42 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-2d6f81d4-0d08-42dc-97bf-24b652475a52 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] Creating instance directory {{(pid=71731) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 16:27:42 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-2d6f81d4-0d08-42dc-97bf-24b652475a52 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] Creating image(s)
Apr 13 16:27:42 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-2d6f81d4-0d08-42dc-97bf-24b652475a52 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Acquiring lock "/opt/stack/data/nova/instances/acbcaee0-a47b-4fee-8765-9b1c9597d515/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:27:42 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-2d6f81d4-0d08-42dc-97bf-24b652475a52 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "/opt/stack/data/nova/instances/acbcaee0-a47b-4fee-8765-9b1c9597d515/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:27:42 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-2d6f81d4-0d08-42dc-97bf-24b652475a52 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "/opt/stack/data/nova/instances/acbcaee0-a47b-4fee-8765-9b1c9597d515/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:27:42 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-2d6f81d4-0d08-42dc-97bf-24b652475a52 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279 --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:27:42 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-2d6f81d4-0d08-42dc-97bf-24b652475a52 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279 --force-share --output=json" returned: 0 in 0.128s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:27:42 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-2d6f81d4-0d08-42dc-97bf-24b652475a52 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Acquiring lock "9524227dd898575c3099d3976f096cd935414279" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:27:42 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-2d6f81d4-0d08-42dc-97bf-24b652475a52 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "9524227dd898575c3099d3976f096cd935414279" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:27:42 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-2d6f81d4-0d08-42dc-97bf-24b652475a52 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279 --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:27:42 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-2d6f81d4-0d08-42dc-97bf-24b652475a52 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279 --force-share --output=json" returned: 0 in 0.129s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:27:42 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-2d6f81d4-0d08-42dc-97bf-24b652475a52 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279,backing_fmt=raw /opt/stack/data/nova/instances/acbcaee0-a47b-4fee-8765-9b1c9597d515/disk 1073741824 {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:27:42 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-2d6f81d4-0d08-42dc-97bf-24b652475a52 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279,backing_fmt=raw /opt/stack/data/nova/instances/acbcaee0-a47b-4fee-8765-9b1c9597d515/disk 1073741824" returned: 0 in 0.046s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:27:42 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-2d6f81d4-0d08-42dc-97bf-24b652475a52 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "9524227dd898575c3099d3976f096cd935414279" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.183s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:27:42 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-2d6f81d4-0d08-42dc-97bf-24b652475a52 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279 --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:27:43 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-2d6f81d4-0d08-42dc-97bf-24b652475a52 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279 --force-share --output=json" returned: 0 in 0.131s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:27:43 user nova-compute[71731]: DEBUG nova.virt.disk.api [None req-2d6f81d4-0d08-42dc-97bf-24b652475a52 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Checking if we can resize image /opt/stack/data/nova/instances/acbcaee0-a47b-4fee-8765-9b1c9597d515/disk. size=1073741824 {{(pid=71731) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 16:27:43 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-2d6f81d4-0d08-42dc-97bf-24b652475a52 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acbcaee0-a47b-4fee-8765-9b1c9597d515/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:27:43 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-2d6f81d4-0d08-42dc-97bf-24b652475a52 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acbcaee0-a47b-4fee-8765-9b1c9597d515/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:27:43 user nova-compute[71731]: DEBUG nova.virt.disk.api [None req-2d6f81d4-0d08-42dc-97bf-24b652475a52 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Cannot resize image /opt/stack/data/nova/instances/acbcaee0-a47b-4fee-8765-9b1c9597d515/disk to a smaller size. {{(pid=71731) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 16:27:43 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-2d6f81d4-0d08-42dc-97bf-24b652475a52 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] Created local disks {{(pid=71731) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 16:27:43 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-2d6f81d4-0d08-42dc-97bf-24b652475a52 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] Ensure instance console log exists: /opt/stack/data/nova/instances/acbcaee0-a47b-4fee-8765-9b1c9597d515/console.log {{(pid=71731) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 16:27:43 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-2d6f81d4-0d08-42dc-97bf-24b652475a52 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:27:43 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-2d6f81d4-0d08-42dc-97bf-24b652475a52 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:27:43 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-2d6f81d4-0d08-42dc-97bf-24b652475a52 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:27:43 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-2d6f81d4-0d08-42dc-97bf-24b652475a52 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] Start _get_guest_xml network_info=[{"id": "13471516-9514-4b85-938f-69657c2990e5", "address": "fa:16:3e:62:32:7f", "network": {"id": "cf1fef97-9ef1-449f-a302-b38110024547", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1138167711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "980559734a504574a83224deb7423c77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13471516-95", "ovs_interfaceid": "13471516-9514-4b85-938f-69657c2990e5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T16:16:31Z,direct_url=<?>,disk_format='qcow2',id=708622a9-7465-4492-ade8-b827198f7e30,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='0b29a975c552465aba0ac7d6288434bd',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T16:16:33Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'device_type': 'disk', 'encrypted': False, 'disk_bus': 'virtio', 'guest_format': None, 'encryption_options': None, 'image_id': '708622a9-7465-4492-ade8-b827198f7e30'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'attachment_id': '58be9763-68ba-46d9-9085-f9fb2e7e4b44', 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d53e720e-a9ca-499b-aacd-aad1a169a874', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZTozqKwG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'acbcaee0-a47b-4fee-8765-9b1c9597d515', 'attached_at': '', 'detached_at': '', 'volume_id': 'd53e720e-a9ca-499b-aacd-aad1a169a874', 'serial': 'd53e720e-a9ca-499b-aacd-aad1a169a874'}, 'disk_bus': 'virtio', 'guest_format': None, 'volume_type': None} {{(pid=71731) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 16:27:43 user nova-compute[71731]: WARNING nova.virt.libvirt.driver [None req-2d6f81d4-0d08-42dc-97bf-24b652475a52 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Apr 13 16:27:43 user nova-compute[71731]: WARNING nova.virt.libvirt.driver [None req-2d6f81d4-0d08-42dc-97bf-24b652475a52 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Apr 13 16:27:43 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-2d6f81d4-0d08-42dc-97bf-24b652475a52 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71731) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 16:27:43 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-2d6f81d4-0d08-42dc-97bf-24b652475a52 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T16:17:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T16:16:31Z,direct_url=<?>,disk_format='qcow2',id=708622a9-7465-4492-ade8-b827198f7e30,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='0b29a975c552465aba0ac7d6288434bd',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T16:16:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 16:27:43 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-2d6f81d4-0d08-42dc-97bf-24b652475a52 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Flavor limits 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 16:27:43 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-2d6f81d4-0d08-42dc-97bf-24b652475a52 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Image limits 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 16:27:43 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-2d6f81d4-0d08-42dc-97bf-24b652475a52 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Flavor pref 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 16:27:43 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-2d6f81d4-0d08-42dc-97bf-24b652475a52 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Image pref 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 16:27:43 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-2d6f81d4-0d08-42dc-97bf-24b652475a52 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 16:27:43 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-2d6f81d4-0d08-42dc-97bf-24b652475a52 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 16:27:43 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-2d6f81d4-0d08-42dc-97bf-24b652475a52 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71731) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 16:27:43 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-2d6f81d4-0d08-42dc-97bf-24b652475a52 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Got 1 possible topologies {{(pid=71731) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 16:27:43 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-2d6f81d4-0d08-42dc-97bf-24b652475a52 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 16:27:43 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-2d6f81d4-0d08-42dc-97bf-24b652475a52 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 16:27:43 user nova-compute[71731]: DEBUG nova.objects.instance [None req-2d6f81d4-0d08-42dc-97bf-24b652475a52 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lazy-loading 'vcpu_model' on Instance uuid acbcaee0-a47b-4fee-8765-9b1c9597d515 {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:27:43 user nova-compute[71731]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2d6f81d4-0d08-42dc-97bf-24b652475a52 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] Calling os-brick to attach iSCSI Volume {{(pid=71731) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 16:27:43 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d6f81d4-0d08-42dc-97bf-24b652475a52 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8cf0118790>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d53e720e-a9ca-499b-aacd-aad1a169a874', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZTozqKwG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 16:27:43 user nova-compute[71731]: WARNING os_brick.initiator.connectors.base [None req-2d6f81d4-0d08-42dc-97bf-24b652475a52 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Apr 13 16:27:43 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-2d6f81d4-0d08-42dc-97bf-24b652475a52 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 16:27:43 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-2d6f81d4-0d08-42dc-97bf-24b652475a52 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 16:27:43 user nova-compute[71731]: WARNING os_brick.initiator.connectors.base [None req-2d6f81d4-0d08-42dc-97bf-24b652475a52 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Apr 13 16:27:43 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-2d6f81d4-0d08-42dc-97bf-24b652475a52 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d53e720e-a9ca-499b-aacd-aad1a169a874" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 16:27:43 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-2d6f81d4-0d08-42dc-97bf-24b652475a52 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d53e720e-a9ca-499b-aacd-aad1a169a874" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 16:27:43 user nova-compute[71731]: INFO os_brick.initiator.connectors.iscsi [None req-2d6f81d4-0d08-42dc-97bf-24b652475a52 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 16:27:43 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d53e720e-a9ca-499b-aacd-aad1a169a874 -p 172.16.0.220:3260 {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:27:43 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d53e720e-a9ca-499b-aacd-aad1a169a874 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:27:43 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f1d33a3-680b-4fe6-8c3c-018c443431b9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:27:43 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d6f81d4-0d08-42dc-97bf-24b652475a52 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 16:27:43 user nova-compute[71731]:  {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:27:43 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d53e720e-a9ca-499b-aacd-aad1a169a874 -p 172.16.0.220:3260 --interface default --op new {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:27:43 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d53e720e-a9ca-499b-aacd-aad1a169a874 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:27:43 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[a13cbd3b-ecef-4bad-9f58-0e8e2b5e0dc8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d53e720e-a9ca-499b-aacd-aad1a169a874] added\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:27:43 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d6f81d4-0d08-42dc-97bf-24b652475a52 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d53e720e-a9ca-499b-aacd-aad1a169a874] added
Apr 13 16:27:43 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:27:43 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d53e720e-a9ca-499b-aacd-aad1a169a874 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:27:43 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d53e720e-a9ca-499b-aacd-aad1a169a874 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:27:43 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a00cf32-7d2e-4e75-b6ab-0baccaa9e965]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:27:43 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d6f81d4-0d08-42dc-97bf-24b652475a52 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:27:43 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d53e720e-a9ca-499b-aacd-aad1a169a874 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:27:43 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d53e720e-a9ca-499b-aacd-aad1a169a874 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:27:43 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[db147206-d482-4226-8e06-8521a887522f]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:27:43 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d6f81d4-0d08-42dc-97bf-24b652475a52 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:27:43 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d53e720e-a9ca-499b-aacd-aad1a169a874 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZTozqKwG {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:27:43 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d53e720e-a9ca-499b-aacd-aad1a169a874 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZTozqKwG" returned: 0 in 0.020s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:27:43 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[76e588e4-50ff-41e0-aff7-a202f2746c15]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:27:43 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d6f81d4-0d08-42dc-97bf-24b652475a52 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZTozqKwG'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:27:43 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d53e720e-a9ca-499b-aacd-aad1a169a874 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:27:43 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d53e720e-a9ca-499b-aacd-aad1a169a874 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:27:43 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[6af49518-c1e9-4d80-950b-8b122d43c293]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:27:43 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d6f81d4-0d08-42dc-97bf-24b652475a52 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:27:43 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:27:43 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:27:43 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[e09ec397-e807-4271-83cb-691b61405db2]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4317bfd-71c2-4c48-a0f0-e3c795f262a8 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb2c60ec-fb52-436f-a98a-dfe15d1e3aa6 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f45c196f-e69b-4a40-8a72-2e5a3b2dbe82 (non-flash)\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:27:43 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d6f81d4-0d08-42dc-97bf-24b652475a52 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)
Apr 13 16:27:43 user nova-compute[71731]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4317bfd-71c2-4c48-a0f0-e3c795f262a8 (non-flash)
Apr 13 16:27:43 user nova-compute[71731]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb2c60ec-fb52-436f-a98a-dfe15d1e3aa6 (non-flash)
Apr 13 16:27:43 user nova-compute[71731]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f45c196f-e69b-4a40-8a72-2e5a3b2dbe82 (non-flash)
Apr 13 16:27:43 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 16:27:43 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d6f81d4-0d08-42dc-97bf-24b652475a52 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)
Apr 13 16:27:43 user nova-compute[71731]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4317bfd-71c2-4c48-a0f0-e3c795f262a8 (non-flash)
Apr 13 16:27:43 user nova-compute[71731]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb2c60ec-fb52-436f-a98a-dfe15d1e3aa6 (non-flash)
Apr 13 16:27:43 user nova-compute[71731]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f45c196f-e69b-4a40-8a72-2e5a3b2dbe82 (non-flash)
Apr 13 16:27:43 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 16:27:43 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d53e720e-a9ca-499b-aacd-aad1a169a874 -p 172.16.0.220:3260 --login {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:27:43 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-33bedf23-5a3c-4c5a-99e0-72c1af3a225e tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Acquiring lock "5d50f597-3a29-4335-8166-6ab8e8149376" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:27:43 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-33bedf23-5a3c-4c5a-99e0-72c1af3a225e tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Lock "5d50f597-3a29-4335-8166-6ab8e8149376" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:27:43 user nova-compute[71731]: DEBUG nova.compute.manager [None req-33bedf23-5a3c-4c5a-99e0-72c1af3a225e tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] [instance: 5d50f597-3a29-4335-8166-6ab8e8149376] Starting instance... {{(pid=71731) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 16:27:43 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d53e720e-a9ca-499b-aacd-aad1a169a874 -p 172.16.0.220:3260 --login" returned: 0 in 0.075s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:27:43 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b3cfc6b-ecde-4cef-a8ef-e7562932d7a8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d53e720e-a9ca-499b-aacd-aad1a169a874, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d53e720e-a9ca-499b-aacd-aad1a169a874, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:27:43 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d6f81d4-0d08-42dc-97bf-24b652475a52 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d53e720e-a9ca-499b-aacd-aad1a169a874, portal: 172.16.0.220,3260]
Apr 13 16:27:43 user nova-compute[71731]: Login to [iface: default, target: iqn.2010-10.org.openstack:d53e720e-a9ca-499b-aacd-aad1a169a874, portal: 172.16.0.220,3260] successful.
Apr 13 16:27:43 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:27:43 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d53e720e-a9ca-499b-aacd-aad1a169a874 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:27:43 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d53e720e-a9ca-499b-aacd-aad1a169a874 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:27:43 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[e169fb49-5a41-41da-ba15-ffa935343ca9]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:27:43 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d6f81d4-0d08-42dc-97bf-24b652475a52 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:27:43 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:27:43 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:27:43 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9411ab1-eb40-4d99-92eb-ec9b3642e281]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4317bfd-71c2-4c48-a0f0-e3c795f262a8 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb2c60ec-fb52-436f-a98a-dfe15d1e3aa6 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f45c196f-e69b-4a40-8a72-2e5a3b2dbe82 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d53e720e-a9ca-499b-aacd-aad1a169a874 (non-flash)\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:27:43 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d6f81d4-0d08-42dc-97bf-24b652475a52 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)
Apr 13 16:27:43 user nova-compute[71731]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4317bfd-71c2-4c48-a0f0-e3c795f262a8 (non-flash)
Apr 13 16:27:43 user nova-compute[71731]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb2c60ec-fb52-436f-a98a-dfe15d1e3aa6 (non-flash)
Apr 13 16:27:43 user nova-compute[71731]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f45c196f-e69b-4a40-8a72-2e5a3b2dbe82 (non-flash)
Apr 13 16:27:43 user nova-compute[71731]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d53e720e-a9ca-499b-aacd-aad1a169a874 (non-flash)
Apr 13 16:27:43 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 16:27:43 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d6f81d4-0d08-42dc-97bf-24b652475a52 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)
Apr 13 16:27:43 user nova-compute[71731]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4317bfd-71c2-4c48-a0f0-e3c795f262a8 (non-flash)
Apr 13 16:27:43 user nova-compute[71731]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb2c60ec-fb52-436f-a98a-dfe15d1e3aa6 (non-flash)
Apr 13 16:27:43 user nova-compute[71731]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f45c196f-e69b-4a40-8a72-2e5a3b2dbe82 (non-flash)
Apr 13 16:27:43 user nova-compute[71731]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d53e720e-a9ca-499b-aacd-aad1a169a874 (non-flash)
Apr 13 16:27:43 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 16:27:43 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-2d6f81d4-0d08-42dc-97bf-24b652475a52 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d53e720e-a9ca-499b-aacd-aad1a169a874" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.305s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 16:27:43 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d6f81d4-0d08-42dc-97bf-24b652475a52 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Connected to 172.16.0.220:3260 {{(pid=71731) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 16:27:43 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-2d6f81d4-0d08-42dc-97bf-24b652475a52 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] HCTL ('36', '-', '-', 0) found on session 25 with lun 0 {{(pid=71731) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 16:27:43 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-2d6f81d4-0d08-42dc-97bf-24b652475a52 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=71731) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 16:27:43 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:27:43 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:27:43 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[00fa84c1-8608-4ec4-b73e-757e7e5246b5]: (4, ('- - 0', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:27:43 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-2d6f81d4-0d08-42dc-97bf-24b652475a52 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Searching for a device in session 25 and hctl ['36', '*', '*', 0] yield: None {{(pid=71731) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 16:27:43 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-33bedf23-5a3c-4c5a-99e0-72c1af3a225e tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:27:43 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-33bedf23-5a3c-4c5a-99e0-72c1af3a225e tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:27:43 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-33bedf23-5a3c-4c5a-99e0-72c1af3a225e tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71731) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 16:27:43 user nova-compute[71731]: INFO nova.compute.claims [None req-33bedf23-5a3c-4c5a-99e0-72c1af3a225e tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] [instance: 5d50f597-3a29-4335-8166-6ab8e8149376] Claim successful on node user
Apr 13 16:27:43 user nova-compute[71731]: DEBUG nova.compute.provider_tree [None req-33bedf23-5a3c-4c5a-99e0-72c1af3a225e tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Inventory has not changed in ProviderTree for provider: cb6b1a64-0c24-4e2d-af1e-16576ca9165c {{(pid=71731) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 16:27:43 user nova-compute[71731]: DEBUG nova.scheduler.client.report [None req-33bedf23-5a3c-4c5a-99e0-72c1af3a225e tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Inventory has not changed for provider cb6b1a64-0c24-4e2d-af1e-16576ca9165c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71731) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 16:27:43 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-33bedf23-5a3c-4c5a-99e0-72c1af3a225e tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.337s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:27:43 user nova-compute[71731]: DEBUG nova.compute.manager [None req-33bedf23-5a3c-4c5a-99e0-72c1af3a225e tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] [instance: 5d50f597-3a29-4335-8166-6ab8e8149376] Start building networks asynchronously for instance. {{(pid=71731) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 16:27:44 user nova-compute[71731]: DEBUG nova.compute.manager [None req-33bedf23-5a3c-4c5a-99e0-72c1af3a225e tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] [instance: 5d50f597-3a29-4335-8166-6ab8e8149376] Allocating IP information in the background. {{(pid=71731) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 16:27:44 user nova-compute[71731]: DEBUG nova.network.neutron [None req-33bedf23-5a3c-4c5a-99e0-72c1af3a225e tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] [instance: 5d50f597-3a29-4335-8166-6ab8e8149376] allocate_for_instance() {{(pid=71731) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 16:27:44 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-33bedf23-5a3c-4c5a-99e0-72c1af3a225e tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] [instance: 5d50f597-3a29-4335-8166-6ab8e8149376] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 16:27:44 user nova-compute[71731]: DEBUG nova.compute.manager [None req-33bedf23-5a3c-4c5a-99e0-72c1af3a225e tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] [instance: 5d50f597-3a29-4335-8166-6ab8e8149376] Start building block device mappings for instance. {{(pid=71731) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 16:27:44 user nova-compute[71731]: DEBUG nova.policy [None req-33bedf23-5a3c-4c5a-99e0-72c1af3a225e tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fa66202e2e5547d1b6e792557b335d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c33fd5889ce4d0b983f529767005267', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71731) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 16:27:44 user nova-compute[71731]: DEBUG nova.compute.manager [None req-33bedf23-5a3c-4c5a-99e0-72c1af3a225e tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] [instance: 5d50f597-3a29-4335-8166-6ab8e8149376] Start spawning the instance on the hypervisor. {{(pid=71731) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 16:27:44 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-33bedf23-5a3c-4c5a-99e0-72c1af3a225e tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] [instance: 5d50f597-3a29-4335-8166-6ab8e8149376] Creating instance directory {{(pid=71731) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 16:27:44 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-33bedf23-5a3c-4c5a-99e0-72c1af3a225e tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] [instance: 5d50f597-3a29-4335-8166-6ab8e8149376] Creating image(s)
Apr 13 16:27:44 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-33bedf23-5a3c-4c5a-99e0-72c1af3a225e tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Acquiring lock "/opt/stack/data/nova/instances/5d50f597-3a29-4335-8166-6ab8e8149376/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:27:44 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-33bedf23-5a3c-4c5a-99e0-72c1af3a225e tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Lock "/opt/stack/data/nova/instances/5d50f597-3a29-4335-8166-6ab8e8149376/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:27:44 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-33bedf23-5a3c-4c5a-99e0-72c1af3a225e tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Lock "/opt/stack/data/nova/instances/5d50f597-3a29-4335-8166-6ab8e8149376/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:27:44 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-33bedf23-5a3c-4c5a-99e0-72c1af3a225e tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279 --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:27:44 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-33bedf23-5a3c-4c5a-99e0-72c1af3a225e tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279 --force-share --output=json" returned: 0 in 0.133s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:27:44 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-33bedf23-5a3c-4c5a-99e0-72c1af3a225e tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Acquiring lock "9524227dd898575c3099d3976f096cd935414279" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:27:44 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-33bedf23-5a3c-4c5a-99e0-72c1af3a225e tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Lock "9524227dd898575c3099d3976f096cd935414279" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:27:44 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-33bedf23-5a3c-4c5a-99e0-72c1af3a225e tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279 --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:27:44 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-33bedf23-5a3c-4c5a-99e0-72c1af3a225e tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279 --force-share --output=json" returned: 0 in 0.135s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:27:44 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-33bedf23-5a3c-4c5a-99e0-72c1af3a225e tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279,backing_fmt=raw /opt/stack/data/nova/instances/5d50f597-3a29-4335-8166-6ab8e8149376/disk 1073741824 {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:27:44 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-33bedf23-5a3c-4c5a-99e0-72c1af3a225e tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279,backing_fmt=raw /opt/stack/data/nova/instances/5d50f597-3a29-4335-8166-6ab8e8149376/disk 1073741824" returned: 0 in 0.050s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:27:44 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-33bedf23-5a3c-4c5a-99e0-72c1af3a225e tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Lock "9524227dd898575c3099d3976f096cd935414279" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.192s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:27:44 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-33bedf23-5a3c-4c5a-99e0-72c1af3a225e tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279 --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:27:44 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-2d6f81d4-0d08-42dc-97bf-24b652475a52 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Searching for a device in session 25 and hctl ['36', '*', '*', 0] yield: sde {{(pid=71731) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 16:27:44 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d6f81d4-0d08-42dc-97bf-24b652475a52 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:d53e720e-a9ca-499b-aacd-aad1a169a874', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZTozqKwG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71731) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 16:27:44 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-2d6f81d4-0d08-42dc-97bf-24b652475a52 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.339s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 16:27:44 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d6f81d4-0d08-42dc-97bf-24b652475a52 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] <== connect_volume: return (1341ms) {'type': 'block', 'scsi_wwn': '26166623035356333', 'path': '/dev/sde'} {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 16:27:44 user nova-compute[71731]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2d6f81d4-0d08-42dc-97bf-24b652475a52 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26166623035356333', 'path': '/dev/sde'} {{(pid=71731) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 16:27:44 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-33bedf23-5a3c-4c5a-99e0-72c1af3a225e tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279 --force-share --output=json" returned: 0 in 0.135s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:27:44 user nova-compute[71731]: DEBUG nova.virt.disk.api [None req-33bedf23-5a3c-4c5a-99e0-72c1af3a225e tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5d50f597-3a29-4335-8166-6ab8e8149376/disk. size=1073741824 {{(pid=71731) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 16:27:44 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-33bedf23-5a3c-4c5a-99e0-72c1af3a225e tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d50f597-3a29-4335-8166-6ab8e8149376/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:27:44 user nova-compute[71731]: DEBUG nova.virt.libvirt.vif [None req-2d6f81d4-0d08-42dc-97bf-24b652475a52 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-13T16:23:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1986504733',display_name='tempest-ServerActionsTestJSON-server-376598631',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1986504733',id=16,image_ref='708622a9-7465-4492-ade8-b827198f7e30',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPaDda4gTmMbkxKfok8i4i1XcNLza5lOVYjCPDEGVTF1JRQKderq80DnIN4GAkaZiBV5U44gvdu3wadL/M5wOH7VDSuEghHchow1mC9TB1xgdo8GoXeM279SVAyu08uhIQ==',key_name='tempest-keypair-1700037342',keypairs=<?>,launch_index=0,launched_at=2023-04-13T16:23:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='980559734a504574a83224deb7423c77',ramdisk_id='',reservation_id='r-3vv5sptg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='708622a9-7465-4492-ade8-b827198f7e30',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestJSON-713402718',owner_user_name='tempest-ServerActionsTestJSON-713402718-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T16:27:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1b3df1c5c5d441819bcef89ed6966815',uuid=acbcaee0-a47b-4fee-8765-9b1c9597d515,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "13471516-9514-4b85-938f-69657c2990e5", "address": "fa:16:3e:62:32:7f", "network": {"id": "cf1fef97-9ef1-449f-a302-b38110024547", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1138167711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "980559734a504574a83224deb7423c77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13471516-95", "ovs_interfaceid": "13471516-9514-4b85-938f-69657c2990e5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71731) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 16:27:44 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-2d6f81d4-0d08-42dc-97bf-24b652475a52 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Converting VIF {"id": "13471516-9514-4b85-938f-69657c2990e5", "address": "fa:16:3e:62:32:7f", "network": {"id": "cf1fef97-9ef1-449f-a302-b38110024547", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1138167711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "980559734a504574a83224deb7423c77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13471516-95", "ovs_interfaceid": "13471516-9514-4b85-938f-69657c2990e5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 16:27:44 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-2d6f81d4-0d08-42dc-97bf-24b652475a52 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:62:32:7f,bridge_name='br-int',has_traffic_filtering=True,id=13471516-9514-4b85-938f-69657c2990e5,network=Network(cf1fef97-9ef1-449f-a302-b38110024547),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13471516-95') {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 16:27:44 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-2d6f81d4-0d08-42dc-97bf-24b652475a52 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] End _get_guest_xml xml=<domain type="kvm">
Apr 13 16:27:44 user nova-compute[71731]:   <uuid>acbcaee0-a47b-4fee-8765-9b1c9597d515</uuid>
Apr 13 16:27:44 user nova-compute[71731]:   <name>instance-00000010</name>
Apr 13 16:27:44 user nova-compute[71731]:   <memory>131072</memory>
Apr 13 16:27:44 user nova-compute[71731]:   <vcpu>1</vcpu>
Apr 13 16:27:44 user nova-compute[71731]:   <metadata>
Apr 13 16:27:44 user nova-compute[71731]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 16:27:44 user nova-compute[71731]:       <nova:package version="0.0.0"/>
Apr 13 16:27:44 user nova-compute[71731]:       <nova:name>tempest-ServerActionsTestJSON-server-376598631</nova:name>
Apr 13 16:27:44 user nova-compute[71731]:       <nova:creationTime>2023-04-13 16:27:43</nova:creationTime>
Apr 13 16:27:44 user nova-compute[71731]:       <nova:flavor name="m1.nano">
Apr 13 16:27:44 user nova-compute[71731]:         <nova:memory>128</nova:memory>
Apr 13 16:27:44 user nova-compute[71731]:         <nova:disk>1</nova:disk>
Apr 13 16:27:44 user nova-compute[71731]:         <nova:swap>0</nova:swap>
Apr 13 16:27:44 user nova-compute[71731]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 16:27:44 user nova-compute[71731]:         <nova:vcpus>1</nova:vcpus>
Apr 13 16:27:44 user nova-compute[71731]:       </nova:flavor>
Apr 13 16:27:44 user nova-compute[71731]:       <nova:owner>
Apr 13 16:27:44 user nova-compute[71731]:         <nova:user uuid="1b3df1c5c5d441819bcef89ed6966815">tempest-ServerActionsTestJSON-713402718-project-member</nova:user>
Apr 13 16:27:44 user nova-compute[71731]:         <nova:project uuid="980559734a504574a83224deb7423c77">tempest-ServerActionsTestJSON-713402718</nova:project>
Apr 13 16:27:44 user nova-compute[71731]:       </nova:owner>
Apr 13 16:27:44 user nova-compute[71731]:       <nova:root type="image" uuid="708622a9-7465-4492-ade8-b827198f7e30"/>
Apr 13 16:27:44 user nova-compute[71731]:       <nova:ports>
Apr 13 16:27:44 user nova-compute[71731]:         <nova:port uuid="13471516-9514-4b85-938f-69657c2990e5">
Apr 13 16:27:44 user nova-compute[71731]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Apr 13 16:27:44 user nova-compute[71731]:         </nova:port>
Apr 13 16:27:44 user nova-compute[71731]:       </nova:ports>
Apr 13 16:27:44 user nova-compute[71731]:     </nova:instance>
Apr 13 16:27:44 user nova-compute[71731]:   </metadata>
Apr 13 16:27:44 user nova-compute[71731]:   <sysinfo type="smbios">
Apr 13 16:27:44 user nova-compute[71731]:     <system>
Apr 13 16:27:44 user nova-compute[71731]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 16:27:44 user nova-compute[71731]:       <entry name="product">OpenStack Nova</entry>
Apr 13 16:27:44 user nova-compute[71731]:       <entry name="version">0.0.0</entry>
Apr 13 16:27:44 user nova-compute[71731]:       <entry name="serial">acbcaee0-a47b-4fee-8765-9b1c9597d515</entry>
Apr 13 16:27:44 user nova-compute[71731]:       <entry name="uuid">acbcaee0-a47b-4fee-8765-9b1c9597d515</entry>
Apr 13 16:27:44 user nova-compute[71731]:       <entry name="family">Virtual Machine</entry>
Apr 13 16:27:44 user nova-compute[71731]:     </system>
Apr 13 16:27:44 user nova-compute[71731]:   </sysinfo>
Apr 13 16:27:44 user nova-compute[71731]:   <os>
Apr 13 16:27:44 user nova-compute[71731]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 16:27:44 user nova-compute[71731]:     <boot dev="hd"/>
Apr 13 16:27:44 user nova-compute[71731]:     <smbios mode="sysinfo"/>
Apr 13 16:27:44 user nova-compute[71731]:   </os>
Apr 13 16:27:44 user nova-compute[71731]:   <features>
Apr 13 16:27:44 user nova-compute[71731]:     <acpi/>
Apr 13 16:27:44 user nova-compute[71731]:     <apic/>
Apr 13 16:27:44 user nova-compute[71731]:     <vmcoreinfo/>
Apr 13 16:27:44 user nova-compute[71731]:   </features>
Apr 13 16:27:44 user nova-compute[71731]:   <clock offset="utc">
Apr 13 16:27:44 user nova-compute[71731]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 16:27:44 user nova-compute[71731]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 16:27:44 user nova-compute[71731]:     <timer name="hpet" present="no"/>
Apr 13 16:27:44 user nova-compute[71731]:   </clock>
Apr 13 16:27:44 user nova-compute[71731]:   <cpu mode="custom" match="exact">
Apr 13 16:27:44 user nova-compute[71731]:     <model>Nehalem</model>
Apr 13 16:27:44 user nova-compute[71731]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 16:27:44 user nova-compute[71731]:   </cpu>
Apr 13 16:27:44 user nova-compute[71731]:   <devices>
Apr 13 16:27:44 user nova-compute[71731]:     <disk type="file" device="disk">
Apr 13 16:27:44 user nova-compute[71731]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 16:27:44 user nova-compute[71731]:       <source file="/opt/stack/data/nova/instances/acbcaee0-a47b-4fee-8765-9b1c9597d515/disk"/>
Apr 13 16:27:44 user nova-compute[71731]:       <target dev="vda" bus="virtio"/>
Apr 13 16:27:44 user nova-compute[71731]:     </disk>
Apr 13 16:27:44 user nova-compute[71731]:     <disk type="block" device="disk">
Apr 13 16:27:44 user nova-compute[71731]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 16:27:44 user nova-compute[71731]:       <source dev="/dev/sde"/>
Apr 13 16:27:44 user nova-compute[71731]:       <target dev="vdb" bus="virtio"/>
Apr 13 16:27:44 user nova-compute[71731]:       <serial>d53e720e-a9ca-499b-aacd-aad1a169a874</serial>
Apr 13 16:27:44 user nova-compute[71731]:     </disk>
Apr 13 16:27:44 user nova-compute[71731]:     <interface type="ethernet">
Apr 13 16:27:44 user nova-compute[71731]:       <mac address="fa:16:3e:62:32:7f"/>
Apr 13 16:27:44 user nova-compute[71731]:       <model type="virtio"/>
Apr 13 16:27:44 user nova-compute[71731]:       <mtu size="1442"/>
Apr 13 16:27:44 user nova-compute[71731]:       <target dev="tap13471516-95"/>
Apr 13 16:27:44 user nova-compute[71731]:     </interface>
Apr 13 16:27:44 user nova-compute[71731]:     <serial type="pty">
Apr 13 16:27:44 user nova-compute[71731]:       <log file="/opt/stack/data/nova/instances/acbcaee0-a47b-4fee-8765-9b1c9597d515/console.log" append="off"/>
Apr 13 16:27:44 user nova-compute[71731]:     </serial>
Apr 13 16:27:44 user nova-compute[71731]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 16:27:44 user nova-compute[71731]:     <video>
Apr 13 16:27:44 user nova-compute[71731]:       <model type="virtio"/>
Apr 13 16:27:44 user nova-compute[71731]:     </video>
Apr 13 16:27:44 user nova-compute[71731]:     <rng model="virtio">
Apr 13 16:27:44 user nova-compute[71731]:       <backend model="random">/dev/urandom</backend>
Apr 13 16:27:44 user nova-compute[71731]:     </rng>
Apr 13 16:27:44 user nova-compute[71731]:     <controller type="usb" index="0" model="none"/>
Apr 13 16:27:44 user nova-compute[71731]:     <memballoon model="virtio">
Apr 13 16:27:44 user nova-compute[71731]:       <stats period="10"/>
Apr 13 16:27:44 user nova-compute[71731]:     </memballoon>
Apr 13 16:27:44 user nova-compute[71731]:   </devices>
Apr 13 16:27:44 user nova-compute[71731]: </domain>
Apr 13 16:27:44 user nova-compute[71731]:  {{(pid=71731) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 16:27:44 user nova-compute[71731]: DEBUG nova.virt.libvirt.vif [None req-2d6f81d4-0d08-42dc-97bf-24b652475a52 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-13T16:23:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1986504733',display_name='tempest-ServerActionsTestJSON-server-376598631',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1986504733',id=16,image_ref='708622a9-7465-4492-ade8-b827198f7e30',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPaDda4gTmMbkxKfok8i4i1XcNLza5lOVYjCPDEGVTF1JRQKderq80DnIN4GAkaZiBV5U44gvdu3wadL/M5wOH7VDSuEghHchow1mC9TB1xgdo8GoXeM279SVAyu08uhIQ==',key_name='tempest-keypair-1700037342',keypairs=<?>,launch_index=0,launched_at=2023-04-13T16:23:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='980559734a504574a83224deb7423c77',ramdisk_id='',reservation_id='r-3vv5sptg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='708622a9-7465-4492-ade8-b827198f7e30',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestJSON-713402718',owner_user_name='tempest-ServerActionsTestJSON-713402718-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T16:27:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1b3df1c5c5d441819bcef89ed6966815',uuid=acbcaee0-a47b-4fee-8765-9b1c9597d515,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "13471516-9514-4b85-938f-69657c2990e5", "address": "fa:16:3e:62:32:7f", "network": {"id": "cf1fef97-9ef1-449f-a302-b38110024547", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1138167711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "980559734a504574a83224deb7423c77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13471516-95", "ovs_interfaceid": "13471516-9514-4b85-938f-69657c2990e5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 16:27:44 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-2d6f81d4-0d08-42dc-97bf-24b652475a52 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Converting VIF {"id": "13471516-9514-4b85-938f-69657c2990e5", "address": "fa:16:3e:62:32:7f", "network": {"id": "cf1fef97-9ef1-449f-a302-b38110024547", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1138167711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "980559734a504574a83224deb7423c77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13471516-95", "ovs_interfaceid": "13471516-9514-4b85-938f-69657c2990e5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 16:27:44 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-2d6f81d4-0d08-42dc-97bf-24b652475a52 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:62:32:7f,bridge_name='br-int',has_traffic_filtering=True,id=13471516-9514-4b85-938f-69657c2990e5,network=Network(cf1fef97-9ef1-449f-a302-b38110024547),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13471516-95') {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 16:27:44 user nova-compute[71731]: DEBUG os_vif [None req-2d6f81d4-0d08-42dc-97bf-24b652475a52 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:62:32:7f,bridge_name='br-int',has_traffic_filtering=True,id=13471516-9514-4b85-938f-69657c2990e5,network=Network(cf1fef97-9ef1-449f-a302-b38110024547),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13471516-95') {{(pid=71731) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 16:27:44 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:27:44 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:27:44 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 16:27:44 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:27:44 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap13471516-95, may_exist=True) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:27:44 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap13471516-95, col_values=(('external_ids', {'iface-id': '13471516-9514-4b85-938f-69657c2990e5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:62:32:7f', 'vm-uuid': 'acbcaee0-a47b-4fee-8765-9b1c9597d515'}),)) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:27:44 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 16:27:44 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:27:44 user nova-compute[71731]: INFO os_vif [None req-2d6f81d4-0d08-42dc-97bf-24b652475a52 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:62:32:7f,bridge_name='br-int',has_traffic_filtering=True,id=13471516-9514-4b85-938f-69657c2990e5,network=Network(cf1fef97-9ef1-449f-a302-b38110024547),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13471516-95')
Apr 13 16:27:44 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-33bedf23-5a3c-4c5a-99e0-72c1af3a225e tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d50f597-3a29-4335-8166-6ab8e8149376/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:27:44 user nova-compute[71731]: DEBUG nova.virt.disk.api [None req-33bedf23-5a3c-4c5a-99e0-72c1af3a225e tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Cannot resize image /opt/stack/data/nova/instances/5d50f597-3a29-4335-8166-6ab8e8149376/disk to a smaller size. {{(pid=71731) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 16:27:44 user nova-compute[71731]: DEBUG nova.objects.instance [None req-33bedf23-5a3c-4c5a-99e0-72c1af3a225e tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Lazy-loading 'migration_context' on Instance uuid 5d50f597-3a29-4335-8166-6ab8e8149376 {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:27:44 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-2d6f81d4-0d08-42dc-97bf-24b652475a52 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] No BDM found with device name vda, not building metadata. {{(pid=71731) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 16:27:44 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-2d6f81d4-0d08-42dc-97bf-24b652475a52 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71731) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 16:27:44 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-2d6f81d4-0d08-42dc-97bf-24b652475a52 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] No VIF found with MAC fa:16:3e:62:32:7f, not building metadata {{(pid=71731) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 16:27:44 user nova-compute[71731]: DEBUG nova.network.neutron [None req-33bedf23-5a3c-4c5a-99e0-72c1af3a225e tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] [instance: 5d50f597-3a29-4335-8166-6ab8e8149376] Successfully created port: cde3b0f9-9ed1-4eba-8560-d5fa05166b2e {{(pid=71731) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 16:27:44 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-33bedf23-5a3c-4c5a-99e0-72c1af3a225e tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] [instance: 5d50f597-3a29-4335-8166-6ab8e8149376] Created local disks {{(pid=71731) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 16:27:44 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-33bedf23-5a3c-4c5a-99e0-72c1af3a225e tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] [instance: 5d50f597-3a29-4335-8166-6ab8e8149376] Ensure instance console log exists: /opt/stack/data/nova/instances/5d50f597-3a29-4335-8166-6ab8e8149376/console.log {{(pid=71731) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 16:27:44 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-33bedf23-5a3c-4c5a-99e0-72c1af3a225e tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:27:44 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-33bedf23-5a3c-4c5a-99e0-72c1af3a225e tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:27:44 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-33bedf23-5a3c-4c5a-99e0-72c1af3a225e tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:27:45 user nova-compute[71731]: DEBUG nova.network.neutron [None req-33bedf23-5a3c-4c5a-99e0-72c1af3a225e tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] [instance: 5d50f597-3a29-4335-8166-6ab8e8149376] Successfully updated port: cde3b0f9-9ed1-4eba-8560-d5fa05166b2e {{(pid=71731) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 16:27:45 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-33bedf23-5a3c-4c5a-99e0-72c1af3a225e tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Acquiring lock "refresh_cache-5d50f597-3a29-4335-8166-6ab8e8149376" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 16:27:45 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-33bedf23-5a3c-4c5a-99e0-72c1af3a225e tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Acquired lock "refresh_cache-5d50f597-3a29-4335-8166-6ab8e8149376" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 16:27:45 user nova-compute[71731]: DEBUG nova.network.neutron [None req-33bedf23-5a3c-4c5a-99e0-72c1af3a225e tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] [instance: 5d50f597-3a29-4335-8166-6ab8e8149376] Building network info cache for instance {{(pid=71731) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 16:27:45 user nova-compute[71731]: DEBUG nova.compute.manager [req-426a1811-7f22-4865-bde4-2f0a1cff207b req-1672b3e6-1b30-44e2-9683-e876827cf359 service nova] [instance: 5d50f597-3a29-4335-8166-6ab8e8149376] Received event network-changed-cde3b0f9-9ed1-4eba-8560-d5fa05166b2e {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:27:45 user nova-compute[71731]: DEBUG nova.compute.manager [req-426a1811-7f22-4865-bde4-2f0a1cff207b req-1672b3e6-1b30-44e2-9683-e876827cf359 service nova] [instance: 5d50f597-3a29-4335-8166-6ab8e8149376] Refreshing instance network info cache due to event network-changed-cde3b0f9-9ed1-4eba-8560-d5fa05166b2e. {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 16:27:45 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-426a1811-7f22-4865-bde4-2f0a1cff207b req-1672b3e6-1b30-44e2-9683-e876827cf359 service nova] Acquiring lock "refresh_cache-5d50f597-3a29-4335-8166-6ab8e8149376" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 16:27:45 user nova-compute[71731]: DEBUG nova.network.neutron [None req-33bedf23-5a3c-4c5a-99e0-72c1af3a225e tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] [instance: 5d50f597-3a29-4335-8166-6ab8e8149376] Instance cache missing network info. {{(pid=71731) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 16:27:45 user nova-compute[71731]: DEBUG nova.network.neutron [None req-33bedf23-5a3c-4c5a-99e0-72c1af3a225e tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] [instance: 5d50f597-3a29-4335-8166-6ab8e8149376] Updating instance_info_cache with network_info: [{"id": "cde3b0f9-9ed1-4eba-8560-d5fa05166b2e", "address": "fa:16:3e:9d:e7:97", "network": {"id": "c790aafd-fad0-4403-bfad-05bbf49d23b2", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1464281989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c33fd5889ce4d0b983f529767005267", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcde3b0f9-9e", "ovs_interfaceid": "cde3b0f9-9ed1-4eba-8560-d5fa05166b2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:27:45 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-33bedf23-5a3c-4c5a-99e0-72c1af3a225e tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Releasing lock "refresh_cache-5d50f597-3a29-4335-8166-6ab8e8149376" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 16:27:45 user nova-compute[71731]: DEBUG nova.compute.manager [None req-33bedf23-5a3c-4c5a-99e0-72c1af3a225e tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] [instance: 5d50f597-3a29-4335-8166-6ab8e8149376] Instance network_info: |[{"id": "cde3b0f9-9ed1-4eba-8560-d5fa05166b2e", "address": "fa:16:3e:9d:e7:97", "network": {"id": "c790aafd-fad0-4403-bfad-05bbf49d23b2", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1464281989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c33fd5889ce4d0b983f529767005267", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcde3b0f9-9e", "ovs_interfaceid": "cde3b0f9-9ed1-4eba-8560-d5fa05166b2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71731) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 16:27:45 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-426a1811-7f22-4865-bde4-2f0a1cff207b req-1672b3e6-1b30-44e2-9683-e876827cf359 service nova] Acquired lock "refresh_cache-5d50f597-3a29-4335-8166-6ab8e8149376" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 16:27:45 user nova-compute[71731]: DEBUG nova.network.neutron [req-426a1811-7f22-4865-bde4-2f0a1cff207b req-1672b3e6-1b30-44e2-9683-e876827cf359 service nova] [instance: 5d50f597-3a29-4335-8166-6ab8e8149376] Refreshing network info cache for port cde3b0f9-9ed1-4eba-8560-d5fa05166b2e {{(pid=71731) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 16:27:45 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-33bedf23-5a3c-4c5a-99e0-72c1af3a225e tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] [instance: 5d50f597-3a29-4335-8166-6ab8e8149376] Start _get_guest_xml network_info=[{"id": "cde3b0f9-9ed1-4eba-8560-d5fa05166b2e", "address": "fa:16:3e:9d:e7:97", "network": {"id": "c790aafd-fad0-4403-bfad-05bbf49d23b2", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1464281989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c33fd5889ce4d0b983f529767005267", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcde3b0f9-9e", "ovs_interfaceid": "cde3b0f9-9ed1-4eba-8560-d5fa05166b2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T16:16:31Z,direct_url=<?>,disk_format='qcow2',id=708622a9-7465-4492-ade8-b827198f7e30,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='0b29a975c552465aba0ac7d6288434bd',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T16:16:33Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'device_type': 'disk', 'encrypted': False, 'disk_bus': 'virtio', 'guest_format': None, 'encryption_options': None, 'image_id': '708622a9-7465-4492-ade8-b827198f7e30'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71731) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 16:27:45 user nova-compute[71731]: WARNING nova.virt.libvirt.driver [None req-33bedf23-5a3c-4c5a-99e0-72c1af3a225e tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 16:27:45 user nova-compute[71731]: WARNING nova.virt.libvirt.driver [None req-33bedf23-5a3c-4c5a-99e0-72c1af3a225e tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 16:27:45 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-33bedf23-5a3c-4c5a-99e0-72c1af3a225e tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71731) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 16:27:45 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-33bedf23-5a3c-4c5a-99e0-72c1af3a225e tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T16:17:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T16:16:31Z,direct_url=<?>,disk_format='qcow2',id=708622a9-7465-4492-ade8-b827198f7e30,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='0b29a975c552465aba0ac7d6288434bd',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T16:16:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 16:27:45 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-33bedf23-5a3c-4c5a-99e0-72c1af3a225e tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Flavor limits 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 16:27:45 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-33bedf23-5a3c-4c5a-99e0-72c1af3a225e tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Image limits 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 16:27:45 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-33bedf23-5a3c-4c5a-99e0-72c1af3a225e tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Flavor pref 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 16:27:45 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-33bedf23-5a3c-4c5a-99e0-72c1af3a225e tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Image pref 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 16:27:45 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-33bedf23-5a3c-4c5a-99e0-72c1af3a225e tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 16:27:45 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-33bedf23-5a3c-4c5a-99e0-72c1af3a225e tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 16:27:45 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-33bedf23-5a3c-4c5a-99e0-72c1af3a225e tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71731) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 16:27:45 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-33bedf23-5a3c-4c5a-99e0-72c1af3a225e tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Got 1 possible topologies {{(pid=71731) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 16:27:45 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-33bedf23-5a3c-4c5a-99e0-72c1af3a225e tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 16:27:45 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-33bedf23-5a3c-4c5a-99e0-72c1af3a225e tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 16:27:45 user nova-compute[71731]: DEBUG nova.virt.libvirt.vif [None req-33bedf23-5a3c-4c5a-99e0-72c1af3a225e tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T16:27:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2052401344',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-2052401344',id=21,image_ref='708622a9-7465-4492-ade8-b827198f7e30',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAENxxbnK5TO5rrhClGAK4OGBjRSl2WhguyF+uaJMZFTdQImhP15imwNCemvjwOF1cJdEvHpeqOmPATUZWcFezxU2vmY8dwhasInHSqB5TQd2r6SmgLKfFX1fag2EbRN/A==',key_name='tempest-keypair-1469740557',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3c33fd5889ce4d0b983f529767005267',ramdisk_id='',reservation_id='r-99cwosbm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='708622a9-7465-4492-ade8-b827198f7e30',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1979050233',owner_user_name='tempest-TaggedAttachmentsTest-1979050233-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T16:27:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fa66202e2e5547d1b6e792557b335d0f',uuid=5d50f597-3a29-4335-8166-6ab8e8149376,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cde3b0f9-9ed1-4eba-8560-d5fa05166b2e", "address": "fa:16:3e:9d:e7:97", "network": {"id": "c790aafd-fad0-4403-bfad-05bbf49d23b2", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1464281989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c33fd5889ce4d0b983f529767005267", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcde3b0f9-9e", "ovs_interfaceid": "cde3b0f9-9ed1-4eba-8560-d5fa05166b2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71731) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 16:27:45 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-33bedf23-5a3c-4c5a-99e0-72c1af3a225e tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Converting VIF {"id": "cde3b0f9-9ed1-4eba-8560-d5fa05166b2e", "address": "fa:16:3e:9d:e7:97", "network": {"id": "c790aafd-fad0-4403-bfad-05bbf49d23b2", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1464281989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c33fd5889ce4d0b983f529767005267", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcde3b0f9-9e", "ovs_interfaceid": "cde3b0f9-9ed1-4eba-8560-d5fa05166b2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 16:27:45 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-33bedf23-5a3c-4c5a-99e0-72c1af3a225e tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9d:e7:97,bridge_name='br-int',has_traffic_filtering=True,id=cde3b0f9-9ed1-4eba-8560-d5fa05166b2e,network=Network(c790aafd-fad0-4403-bfad-05bbf49d23b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcde3b0f9-9e') {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 16:27:45 user nova-compute[71731]: DEBUG nova.objects.instance [None req-33bedf23-5a3c-4c5a-99e0-72c1af3a225e tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Lazy-loading 'pci_devices' on Instance uuid 5d50f597-3a29-4335-8166-6ab8e8149376 {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:27:45 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-33bedf23-5a3c-4c5a-99e0-72c1af3a225e tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] [instance: 5d50f597-3a29-4335-8166-6ab8e8149376] End _get_guest_xml xml=<domain type="kvm">
Apr 13 16:27:45 user nova-compute[71731]:   <uuid>5d50f597-3a29-4335-8166-6ab8e8149376</uuid>
Apr 13 16:27:45 user nova-compute[71731]:   <name>instance-00000015</name>
Apr 13 16:27:45 user nova-compute[71731]:   <memory>131072</memory>
Apr 13 16:27:45 user nova-compute[71731]:   <vcpu>1</vcpu>
Apr 13 16:27:45 user nova-compute[71731]:   <metadata>
Apr 13 16:27:45 user nova-compute[71731]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 16:27:45 user nova-compute[71731]:       <nova:package version="0.0.0"/>
Apr 13 16:27:45 user nova-compute[71731]:       <nova:name>tempest-device-tagging-server-2052401344</nova:name>
Apr 13 16:27:45 user nova-compute[71731]:       <nova:creationTime>2023-04-13 16:27:45</nova:creationTime>
Apr 13 16:27:45 user nova-compute[71731]:       <nova:flavor name="m1.nano">
Apr 13 16:27:45 user nova-compute[71731]:         <nova:memory>128</nova:memory>
Apr 13 16:27:45 user nova-compute[71731]:         <nova:disk>1</nova:disk>
Apr 13 16:27:45 user nova-compute[71731]:         <nova:swap>0</nova:swap>
Apr 13 16:27:45 user nova-compute[71731]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 16:27:45 user nova-compute[71731]:         <nova:vcpus>1</nova:vcpus>
Apr 13 16:27:45 user nova-compute[71731]:       </nova:flavor>
Apr 13 16:27:45 user nova-compute[71731]:       <nova:owner>
Apr 13 16:27:45 user nova-compute[71731]:         <nova:user uuid="fa66202e2e5547d1b6e792557b335d0f">tempest-TaggedAttachmentsTest-1979050233-project-member</nova:user>
Apr 13 16:27:45 user nova-compute[71731]:         <nova:project uuid="3c33fd5889ce4d0b983f529767005267">tempest-TaggedAttachmentsTest-1979050233</nova:project>
Apr 13 16:27:45 user nova-compute[71731]:       </nova:owner>
Apr 13 16:27:45 user nova-compute[71731]:       <nova:root type="image" uuid="708622a9-7465-4492-ade8-b827198f7e30"/>
Apr 13 16:27:45 user nova-compute[71731]:       <nova:ports>
Apr 13 16:27:45 user nova-compute[71731]:         <nova:port uuid="cde3b0f9-9ed1-4eba-8560-d5fa05166b2e">
Apr 13 16:27:45 user nova-compute[71731]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Apr 13 16:27:45 user nova-compute[71731]:         </nova:port>
Apr 13 16:27:45 user nova-compute[71731]:       </nova:ports>
Apr 13 16:27:45 user nova-compute[71731]:     </nova:instance>
Apr 13 16:27:45 user nova-compute[71731]:   </metadata>
Apr 13 16:27:45 user nova-compute[71731]:   <sysinfo type="smbios">
Apr 13 16:27:45 user nova-compute[71731]:     <system>
Apr 13 16:27:45 user nova-compute[71731]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 16:27:45 user nova-compute[71731]:       <entry name="product">OpenStack Nova</entry>
Apr 13 16:27:45 user nova-compute[71731]:       <entry name="version">0.0.0</entry>
Apr 13 16:27:45 user nova-compute[71731]:       <entry name="serial">5d50f597-3a29-4335-8166-6ab8e8149376</entry>
Apr 13 16:27:45 user nova-compute[71731]:       <entry name="uuid">5d50f597-3a29-4335-8166-6ab8e8149376</entry>
Apr 13 16:27:45 user nova-compute[71731]:       <entry name="family">Virtual Machine</entry>
Apr 13 16:27:45 user nova-compute[71731]:     </system>
Apr 13 16:27:45 user nova-compute[71731]:   </sysinfo>
Apr 13 16:27:45 user nova-compute[71731]:   <os>
Apr 13 16:27:45 user nova-compute[71731]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 16:27:45 user nova-compute[71731]:     <boot dev="hd"/>
Apr 13 16:27:45 user nova-compute[71731]:     <smbios mode="sysinfo"/>
Apr 13 16:27:45 user nova-compute[71731]:   </os>
Apr 13 16:27:45 user nova-compute[71731]:   <features>
Apr 13 16:27:45 user nova-compute[71731]:     <acpi/>
Apr 13 16:27:45 user nova-compute[71731]:     <apic/>
Apr 13 16:27:45 user nova-compute[71731]:     <vmcoreinfo/>
Apr 13 16:27:45 user nova-compute[71731]:   </features>
Apr 13 16:27:45 user nova-compute[71731]:   <clock offset="utc">
Apr 13 16:27:45 user nova-compute[71731]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 16:27:45 user nova-compute[71731]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 16:27:45 user nova-compute[71731]:     <timer name="hpet" present="no"/>
Apr 13 16:27:45 user nova-compute[71731]:   </clock>
Apr 13 16:27:45 user nova-compute[71731]:   <cpu mode="custom" match="exact">
Apr 13 16:27:45 user nova-compute[71731]:     <model>Nehalem</model>
Apr 13 16:27:45 user nova-compute[71731]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 16:27:45 user nova-compute[71731]:   </cpu>
Apr 13 16:27:45 user nova-compute[71731]:   <devices>
Apr 13 16:27:45 user nova-compute[71731]:     <disk type="file" device="disk">
Apr 13 16:27:45 user nova-compute[71731]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 16:27:45 user nova-compute[71731]:       <source file="/opt/stack/data/nova/instances/5d50f597-3a29-4335-8166-6ab8e8149376/disk"/>
Apr 13 16:27:45 user nova-compute[71731]:       <target dev="vda" bus="virtio"/>
Apr 13 16:27:45 user nova-compute[71731]:     </disk>
Apr 13 16:27:45 user nova-compute[71731]:     <disk type="file" device="cdrom">
Apr 13 16:27:45 user nova-compute[71731]:       <driver name="qemu" type="raw" cache="none"/>
Apr 13 16:27:45 user nova-compute[71731]:       <source file="/opt/stack/data/nova/instances/5d50f597-3a29-4335-8166-6ab8e8149376/disk.config"/>
Apr 13 16:27:45 user nova-compute[71731]:       <target dev="hda" bus="ide"/>
Apr 13 16:27:45 user nova-compute[71731]:     </disk>
Apr 13 16:27:45 user nova-compute[71731]:     <interface type="ethernet">
Apr 13 16:27:45 user nova-compute[71731]:       <mac address="fa:16:3e:9d:e7:97"/>
Apr 13 16:27:45 user nova-compute[71731]:       <model type="virtio"/>
Apr 13 16:27:45 user nova-compute[71731]:       <mtu size="1442"/>
Apr 13 16:27:45 user nova-compute[71731]:       <target dev="tapcde3b0f9-9e"/>
Apr 13 16:27:45 user nova-compute[71731]:     </interface>
Apr 13 16:27:45 user nova-compute[71731]:     <serial type="pty">
Apr 13 16:27:45 user nova-compute[71731]:       <log file="/opt/stack/data/nova/instances/5d50f597-3a29-4335-8166-6ab8e8149376/console.log" append="off"/>
Apr 13 16:27:45 user nova-compute[71731]:     </serial>
Apr 13 16:27:45 user nova-compute[71731]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 16:27:45 user nova-compute[71731]:     <video>
Apr 13 16:27:45 user nova-compute[71731]:       <model type="virtio"/>
Apr 13 16:27:45 user nova-compute[71731]:     </video>
Apr 13 16:27:45 user nova-compute[71731]:     <rng model="virtio">
Apr 13 16:27:45 user nova-compute[71731]:       <backend model="random">/dev/urandom</backend>
Apr 13 16:27:45 user nova-compute[71731]:     </rng>
Apr 13 16:27:45 user nova-compute[71731]:     <controller type="usb" index="0" model="none"/>
Apr 13 16:27:45 user nova-compute[71731]:     <memballoon model="virtio">
Apr 13 16:27:45 user nova-compute[71731]:       <stats period="10"/>
Apr 13 16:27:45 user nova-compute[71731]:     </memballoon>
Apr 13 16:27:45 user nova-compute[71731]:   </devices>
Apr 13 16:27:45 user nova-compute[71731]: </domain>
Apr 13 16:27:45 user nova-compute[71731]:  {{(pid=71731) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 16:27:45 user nova-compute[71731]: DEBUG nova.virt.libvirt.vif [None req-33bedf23-5a3c-4c5a-99e0-72c1af3a225e tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T16:27:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2052401344',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-2052401344',id=21,image_ref='708622a9-7465-4492-ade8-b827198f7e30',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAENxxbnK5TO5rrhClGAK4OGBjRSl2WhguyF+uaJMZFTdQImhP15imwNCemvjwOF1cJdEvHpeqOmPATUZWcFezxU2vmY8dwhasInHSqB5TQd2r6SmgLKfFX1fag2EbRN/A==',key_name='tempest-keypair-1469740557',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3c33fd5889ce4d0b983f529767005267',ramdisk_id='',reservation_id='r-99cwosbm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='708622a9-7465-4492-ade8-b827198f7e30',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1979050233',owner_user_name='tempest-TaggedAttachmentsTest-1979050233-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T16:27:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fa66202e2e5547d1b6e792557b335d0f',uuid=5d50f597-3a29-4335-8166-6ab8e8149376,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cde3b0f9-9ed1-4eba-8560-d5fa05166b2e", "address": "fa:16:3e:9d:e7:97", "network": {"id": "c790aafd-fad0-4403-bfad-05bbf49d23b2", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1464281989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c33fd5889ce4d0b983f529767005267", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcde3b0f9-9e", "ovs_interfaceid": "cde3b0f9-9ed1-4eba-8560-d5fa05166b2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 16:27:45 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-33bedf23-5a3c-4c5a-99e0-72c1af3a225e tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Converting VIF {"id": "cde3b0f9-9ed1-4eba-8560-d5fa05166b2e", "address": "fa:16:3e:9d:e7:97", "network": {"id": "c790aafd-fad0-4403-bfad-05bbf49d23b2", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1464281989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c33fd5889ce4d0b983f529767005267", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcde3b0f9-9e", "ovs_interfaceid": "cde3b0f9-9ed1-4eba-8560-d5fa05166b2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 16:27:45 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-33bedf23-5a3c-4c5a-99e0-72c1af3a225e tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9d:e7:97,bridge_name='br-int',has_traffic_filtering=True,id=cde3b0f9-9ed1-4eba-8560-d5fa05166b2e,network=Network(c790aafd-fad0-4403-bfad-05bbf49d23b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcde3b0f9-9e') {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 16:27:45 user nova-compute[71731]: DEBUG os_vif [None req-33bedf23-5a3c-4c5a-99e0-72c1af3a225e tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9d:e7:97,bridge_name='br-int',has_traffic_filtering=True,id=cde3b0f9-9ed1-4eba-8560-d5fa05166b2e,network=Network(c790aafd-fad0-4403-bfad-05bbf49d23b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcde3b0f9-9e') {{(pid=71731) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 16:27:45 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:27:45 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:27:45 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 16:27:46 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:27:46 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcde3b0f9-9e, may_exist=True) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:27:46 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapcde3b0f9-9e, col_values=(('external_ids', {'iface-id': 'cde3b0f9-9ed1-4eba-8560-d5fa05166b2e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9d:e7:97', 'vm-uuid': '5d50f597-3a29-4335-8166-6ab8e8149376'}),)) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:27:46 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:27:46 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 16:27:46 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:27:46 user nova-compute[71731]: INFO os_vif [None req-33bedf23-5a3c-4c5a-99e0-72c1af3a225e tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9d:e7:97,bridge_name='br-int',has_traffic_filtering=True,id=cde3b0f9-9ed1-4eba-8560-d5fa05166b2e,network=Network(c790aafd-fad0-4403-bfad-05bbf49d23b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcde3b0f9-9e')
Apr 13 16:27:46 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-33bedf23-5a3c-4c5a-99e0-72c1af3a225e tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] No BDM found with device name vda, not building metadata. {{(pid=71731) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 16:27:46 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-33bedf23-5a3c-4c5a-99e0-72c1af3a225e tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] No BDM found with device name hda, not building metadata. {{(pid=71731) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 16:27:46 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-33bedf23-5a3c-4c5a-99e0-72c1af3a225e tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] No VIF found with MAC fa:16:3e:9d:e7:97, not building metadata {{(pid=71731) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 16:27:46 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-33bedf23-5a3c-4c5a-99e0-72c1af3a225e tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] [instance: 5d50f597-3a29-4335-8166-6ab8e8149376] Using config drive
Apr 13 16:27:46 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:27:46 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:27:46 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:27:46 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:27:46 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-33bedf23-5a3c-4c5a-99e0-72c1af3a225e tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] [instance: 5d50f597-3a29-4335-8166-6ab8e8149376] Creating config drive at /opt/stack/data/nova/instances/5d50f597-3a29-4335-8166-6ab8e8149376/disk.config
Apr 13 16:27:46 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-33bedf23-5a3c-4c5a-99e0-72c1af3a225e tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/5d50f597-3a29-4335-8166-6ab8e8149376/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmppz2fi8zp {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:27:46 user nova-compute[71731]: DEBUG nova.compute.manager [req-e784c2ad-b07f-4a1a-8354-574d0917ac53 req-9693de78-b9e0-4fb7-af35-e51cc127311e service nova] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] Received event network-vif-plugged-13471516-9514-4b85-938f-69657c2990e5 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:27:46 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-e784c2ad-b07f-4a1a-8354-574d0917ac53 req-9693de78-b9e0-4fb7-af35-e51cc127311e service nova] Acquiring lock "acbcaee0-a47b-4fee-8765-9b1c9597d515-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:27:46 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-e784c2ad-b07f-4a1a-8354-574d0917ac53 req-9693de78-b9e0-4fb7-af35-e51cc127311e service nova] Lock "acbcaee0-a47b-4fee-8765-9b1c9597d515-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:27:46 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-e784c2ad-b07f-4a1a-8354-574d0917ac53 req-9693de78-b9e0-4fb7-af35-e51cc127311e service nova] Lock "acbcaee0-a47b-4fee-8765-9b1c9597d515-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:27:46 user nova-compute[71731]: DEBUG nova.compute.manager [req-e784c2ad-b07f-4a1a-8354-574d0917ac53 req-9693de78-b9e0-4fb7-af35-e51cc127311e service nova] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] No waiting events found dispatching network-vif-plugged-13471516-9514-4b85-938f-69657c2990e5 {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:27:46 user nova-compute[71731]: WARNING nova.compute.manager [req-e784c2ad-b07f-4a1a-8354-574d0917ac53 req-9693de78-b9e0-4fb7-af35-e51cc127311e service nova] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] Received unexpected event network-vif-plugged-13471516-9514-4b85-938f-69657c2990e5 for instance with vm_state active and task_state rebuild_spawning.
Apr 13 16:27:46 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-33bedf23-5a3c-4c5a-99e0-72c1af3a225e tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/5d50f597-3a29-4335-8166-6ab8e8149376/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmppz2fi8zp" returned: 0 in 0.062s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:27:46 user nova-compute[71731]: DEBUG nova.network.neutron [req-426a1811-7f22-4865-bde4-2f0a1cff207b req-1672b3e6-1b30-44e2-9683-e876827cf359 service nova] [instance: 5d50f597-3a29-4335-8166-6ab8e8149376] Updated VIF entry in instance network info cache for port cde3b0f9-9ed1-4eba-8560-d5fa05166b2e. {{(pid=71731) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 16:27:46 user nova-compute[71731]: DEBUG nova.network.neutron [req-426a1811-7f22-4865-bde4-2f0a1cff207b req-1672b3e6-1b30-44e2-9683-e876827cf359 service nova] [instance: 5d50f597-3a29-4335-8166-6ab8e8149376] Updating instance_info_cache with network_info: [{"id": "cde3b0f9-9ed1-4eba-8560-d5fa05166b2e", "address": "fa:16:3e:9d:e7:97", "network": {"id": "c790aafd-fad0-4403-bfad-05bbf49d23b2", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1464281989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c33fd5889ce4d0b983f529767005267", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcde3b0f9-9e", "ovs_interfaceid": "cde3b0f9-9ed1-4eba-8560-d5fa05166b2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:27:46 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-426a1811-7f22-4865-bde4-2f0a1cff207b req-1672b3e6-1b30-44e2-9683-e876827cf359 service nova] Releasing lock "refresh_cache-5d50f597-3a29-4335-8166-6ab8e8149376" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 16:27:46 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:27:46 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:27:46 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:27:46 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:27:46 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:27:46 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:27:47 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:27:47 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:27:47 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:27:48 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:27:48 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:27:48 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:27:48 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:27:48 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:27:48 user nova-compute[71731]: DEBUG nova.compute.manager [req-71f61b74-8b1d-4d6b-888f-a0b394c9bb62 req-96870251-80ac-46df-8b79-77686bad87a5 service nova] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] Received event network-vif-plugged-13471516-9514-4b85-938f-69657c2990e5 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:27:48 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-71f61b74-8b1d-4d6b-888f-a0b394c9bb62 req-96870251-80ac-46df-8b79-77686bad87a5 service nova] Acquiring lock "acbcaee0-a47b-4fee-8765-9b1c9597d515-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:27:48 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-71f61b74-8b1d-4d6b-888f-a0b394c9bb62 req-96870251-80ac-46df-8b79-77686bad87a5 service nova] Lock "acbcaee0-a47b-4fee-8765-9b1c9597d515-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:27:48 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-71f61b74-8b1d-4d6b-888f-a0b394c9bb62 req-96870251-80ac-46df-8b79-77686bad87a5 service nova] Lock "acbcaee0-a47b-4fee-8765-9b1c9597d515-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:27:48 user nova-compute[71731]: DEBUG nova.compute.manager [req-71f61b74-8b1d-4d6b-888f-a0b394c9bb62 req-96870251-80ac-46df-8b79-77686bad87a5 service nova] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] No waiting events found dispatching network-vif-plugged-13471516-9514-4b85-938f-69657c2990e5 {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:27:48 user nova-compute[71731]: WARNING nova.compute.manager [req-71f61b74-8b1d-4d6b-888f-a0b394c9bb62 req-96870251-80ac-46df-8b79-77686bad87a5 service nova] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] Received unexpected event network-vif-plugged-13471516-9514-4b85-938f-69657c2990e5 for instance with vm_state active and task_state rebuild_spawning.
Apr 13 16:27:48 user nova-compute[71731]: DEBUG nova.compute.manager [req-71f61b74-8b1d-4d6b-888f-a0b394c9bb62 req-96870251-80ac-46df-8b79-77686bad87a5 service nova] [instance: 5d50f597-3a29-4335-8166-6ab8e8149376] Received event network-vif-plugged-cde3b0f9-9ed1-4eba-8560-d5fa05166b2e {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:27:48 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-71f61b74-8b1d-4d6b-888f-a0b394c9bb62 req-96870251-80ac-46df-8b79-77686bad87a5 service nova] Acquiring lock "5d50f597-3a29-4335-8166-6ab8e8149376-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:27:48 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-71f61b74-8b1d-4d6b-888f-a0b394c9bb62 req-96870251-80ac-46df-8b79-77686bad87a5 service nova] Lock "5d50f597-3a29-4335-8166-6ab8e8149376-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:27:48 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-71f61b74-8b1d-4d6b-888f-a0b394c9bb62 req-96870251-80ac-46df-8b79-77686bad87a5 service nova] Lock "5d50f597-3a29-4335-8166-6ab8e8149376-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:27:48 user nova-compute[71731]: DEBUG nova.compute.manager [req-71f61b74-8b1d-4d6b-888f-a0b394c9bb62 req-96870251-80ac-46df-8b79-77686bad87a5 service nova] [instance: 5d50f597-3a29-4335-8166-6ab8e8149376] No waiting events found dispatching network-vif-plugged-cde3b0f9-9ed1-4eba-8560-d5fa05166b2e {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:27:48 user nova-compute[71731]: WARNING nova.compute.manager [req-71f61b74-8b1d-4d6b-888f-a0b394c9bb62 req-96870251-80ac-46df-8b79-77686bad87a5 service nova] [instance: 5d50f597-3a29-4335-8166-6ab8e8149376] Received unexpected event network-vif-plugged-cde3b0f9-9ed1-4eba-8560-d5fa05166b2e for instance with vm_state building and task_state spawning.
Apr 13 16:27:48 user nova-compute[71731]: DEBUG nova.compute.manager [req-71f61b74-8b1d-4d6b-888f-a0b394c9bb62 req-96870251-80ac-46df-8b79-77686bad87a5 service nova] [instance: 5d50f597-3a29-4335-8166-6ab8e8149376] Received event network-vif-plugged-cde3b0f9-9ed1-4eba-8560-d5fa05166b2e {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:27:48 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-71f61b74-8b1d-4d6b-888f-a0b394c9bb62 req-96870251-80ac-46df-8b79-77686bad87a5 service nova] Acquiring lock "5d50f597-3a29-4335-8166-6ab8e8149376-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:27:48 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-71f61b74-8b1d-4d6b-888f-a0b394c9bb62 req-96870251-80ac-46df-8b79-77686bad87a5 service nova] Lock "5d50f597-3a29-4335-8166-6ab8e8149376-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:27:48 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-71f61b74-8b1d-4d6b-888f-a0b394c9bb62 req-96870251-80ac-46df-8b79-77686bad87a5 service nova] Lock "5d50f597-3a29-4335-8166-6ab8e8149376-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:27:48 user nova-compute[71731]: DEBUG nova.compute.manager [req-71f61b74-8b1d-4d6b-888f-a0b394c9bb62 req-96870251-80ac-46df-8b79-77686bad87a5 service nova] [instance: 5d50f597-3a29-4335-8166-6ab8e8149376] No waiting events found dispatching network-vif-plugged-cde3b0f9-9ed1-4eba-8560-d5fa05166b2e {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:27:48 user nova-compute[71731]: WARNING nova.compute.manager [req-71f61b74-8b1d-4d6b-888f-a0b394c9bb62 req-96870251-80ac-46df-8b79-77686bad87a5 service nova] [instance: 5d50f597-3a29-4335-8166-6ab8e8149376] Received unexpected event network-vif-plugged-cde3b0f9-9ed1-4eba-8560-d5fa05166b2e for instance with vm_state building and task_state spawning.
Apr 13 16:27:49 user nova-compute[71731]: DEBUG nova.virt.libvirt.host [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Removed pending event for acbcaee0-a47b-4fee-8765-9b1c9597d515 due to event {{(pid=71731) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 13 16:27:49 user nova-compute[71731]: DEBUG nova.virt.driver [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Emitting event <LifecycleEvent: 1681403269.0767245, acbcaee0-a47b-4fee-8765-9b1c9597d515 => Resumed> {{(pid=71731) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 16:27:49 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] VM Resumed (Lifecycle Event)
Apr 13 16:27:49 user nova-compute[71731]: DEBUG nova.compute.manager [None req-2d6f81d4-0d08-42dc-97bf-24b652475a52 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] Instance event wait completed in 0 seconds for  {{(pid=71731) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 16:27:49 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-2d6f81d4-0d08-42dc-97bf-24b652475a52 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] Guest created on hypervisor {{(pid=71731) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 16:27:49 user nova-compute[71731]: INFO nova.virt.libvirt.driver [-] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] Instance spawned successfully.
Apr 13 16:27:49 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-2d6f81d4-0d08-42dc-97bf-24b652475a52 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 16:27:49 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:27:49 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=71731) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 16:27:49 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-2d6f81d4-0d08-42dc-97bf-24b652475a52 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] Found default for hw_cdrom_bus of ide {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:27:49 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-2d6f81d4-0d08-42dc-97bf-24b652475a52 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] Found default for hw_disk_bus of virtio {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:27:49 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-2d6f81d4-0d08-42dc-97bf-24b652475a52 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] Found default for hw_input_bus of None {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:27:49 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-2d6f81d4-0d08-42dc-97bf-24b652475a52 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] Found default for hw_pointer_model of None {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:27:49 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-2d6f81d4-0d08-42dc-97bf-24b652475a52 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] Found default for hw_video_model of virtio {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:27:49 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-2d6f81d4-0d08-42dc-97bf-24b652475a52 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] Found default for hw_vif_model of virtio {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:27:49 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Apr 13 16:27:49 user nova-compute[71731]: DEBUG nova.virt.driver [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Emitting event <LifecycleEvent: 1681403269.0812676, acbcaee0-a47b-4fee-8765-9b1c9597d515 => Started> {{(pid=71731) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 16:27:49 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] VM Started (Lifecycle Event)
Apr 13 16:27:49 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:27:49 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=71731) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 16:27:49 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Apr 13 16:27:49 user nova-compute[71731]: DEBUG nova.compute.manager [None req-2d6f81d4-0d08-42dc-97bf-24b652475a52 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:27:49 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-2d6f81d4-0d08-42dc-97bf-24b652475a52 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:27:49 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-2d6f81d4-0d08-42dc-97bf-24b652475a52 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:27:49 user nova-compute[71731]: DEBUG nova.objects.instance [None req-2d6f81d4-0d08-42dc-97bf-24b652475a52 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] Trying to apply a migration context that does not seem to be set for this instance {{(pid=71731) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1032}}
Apr 13 16:27:49 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-2d6f81d4-0d08-42dc-97bf-24b652475a52 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.068s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:27:49 user nova-compute[71731]: DEBUG nova.virt.driver [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Emitting event <LifecycleEvent: 1681403269.920858, 5d50f597-3a29-4335-8166-6ab8e8149376 => Resumed> {{(pid=71731) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 16:27:49 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 5d50f597-3a29-4335-8166-6ab8e8149376] VM Resumed (Lifecycle Event)
Apr 13 16:27:49 user nova-compute[71731]: DEBUG nova.compute.manager [None req-33bedf23-5a3c-4c5a-99e0-72c1af3a225e tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] [instance: 5d50f597-3a29-4335-8166-6ab8e8149376] Instance event wait completed in 0 seconds for  {{(pid=71731) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 16:27:49 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-33bedf23-5a3c-4c5a-99e0-72c1af3a225e tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] [instance: 5d50f597-3a29-4335-8166-6ab8e8149376] Guest created on hypervisor {{(pid=71731) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 16:27:49 user nova-compute[71731]: INFO nova.virt.libvirt.driver [-] [instance: 5d50f597-3a29-4335-8166-6ab8e8149376] Instance spawned successfully.
Apr 13 16:27:49 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-33bedf23-5a3c-4c5a-99e0-72c1af3a225e tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] [instance: 5d50f597-3a29-4335-8166-6ab8e8149376] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 16:27:49 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 5d50f597-3a29-4335-8166-6ab8e8149376] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:27:49 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 5d50f597-3a29-4335-8166-6ab8e8149376] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71731) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 16:27:49 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-33bedf23-5a3c-4c5a-99e0-72c1af3a225e tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] [instance: 5d50f597-3a29-4335-8166-6ab8e8149376] Found default for hw_cdrom_bus of ide {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:27:49 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-33bedf23-5a3c-4c5a-99e0-72c1af3a225e tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] [instance: 5d50f597-3a29-4335-8166-6ab8e8149376] Found default for hw_disk_bus of virtio {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:27:49 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-33bedf23-5a3c-4c5a-99e0-72c1af3a225e tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] [instance: 5d50f597-3a29-4335-8166-6ab8e8149376] Found default for hw_input_bus of None {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:27:49 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-33bedf23-5a3c-4c5a-99e0-72c1af3a225e tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] [instance: 5d50f597-3a29-4335-8166-6ab8e8149376] Found default for hw_pointer_model of None {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:27:49 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-33bedf23-5a3c-4c5a-99e0-72c1af3a225e tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] [instance: 5d50f597-3a29-4335-8166-6ab8e8149376] Found default for hw_video_model of virtio {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:27:49 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-33bedf23-5a3c-4c5a-99e0-72c1af3a225e tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] [instance: 5d50f597-3a29-4335-8166-6ab8e8149376] Found default for hw_vif_model of virtio {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:27:49 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 5d50f597-3a29-4335-8166-6ab8e8149376] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 16:27:49 user nova-compute[71731]: DEBUG nova.virt.driver [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Emitting event <LifecycleEvent: 1681403269.9223018, 5d50f597-3a29-4335-8166-6ab8e8149376 => Started> {{(pid=71731) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 16:27:49 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 5d50f597-3a29-4335-8166-6ab8e8149376] VM Started (Lifecycle Event)
Apr 13 16:27:49 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 5d50f597-3a29-4335-8166-6ab8e8149376] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:27:49 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 5d50f597-3a29-4335-8166-6ab8e8149376] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71731) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 16:27:50 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 5d50f597-3a29-4335-8166-6ab8e8149376] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 16:27:50 user nova-compute[71731]: INFO nova.compute.manager [None req-33bedf23-5a3c-4c5a-99e0-72c1af3a225e tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] [instance: 5d50f597-3a29-4335-8166-6ab8e8149376] Took 5.88 seconds to spawn the instance on the hypervisor.
Apr 13 16:27:50 user nova-compute[71731]: DEBUG nova.compute.manager [None req-33bedf23-5a3c-4c5a-99e0-72c1af3a225e tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] [instance: 5d50f597-3a29-4335-8166-6ab8e8149376] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:27:50 user nova-compute[71731]: INFO nova.compute.manager [None req-33bedf23-5a3c-4c5a-99e0-72c1af3a225e tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] [instance: 5d50f597-3a29-4335-8166-6ab8e8149376] Took 6.53 seconds to build instance.
Apr 13 16:27:50 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-33bedf23-5a3c-4c5a-99e0-72c1af3a225e tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Lock "5d50f597-3a29-4335-8166-6ab8e8149376" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.640s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:27:51 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:27:51 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:27:55 user nova-compute[71731]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681403260.0585995, bbcccf4b-e861-4254-9be3-a491776214e9 => Stopped> {{(pid=71731) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 16:27:55 user nova-compute[71731]: INFO nova.compute.manager [-] [instance: bbcccf4b-e861-4254-9be3-a491776214e9] VM Stopped (Lifecycle Event)
Apr 13 16:27:55 user nova-compute[71731]: DEBUG nova.compute.manager [None req-9c26a920-abd8-4165-9257-ba496c5297bf None None] [instance: bbcccf4b-e861-4254-9be3-a491776214e9] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:27:56 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:28:01 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 16:28:01 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:28:01 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71731) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 16:28:01 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71731) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 16:28:01 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71731) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 16:28:01 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:28:01 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:28:04 user nova-compute[71731]: DEBUG nova.objects.instance [None req-5c366176-05bf-425c-9dc3-7ec1952fdbb0 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lazy-loading 'flavor' on Instance uuid eaae47b9-a059-49f6-9ae6-d7147003e2f2 {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:28:04 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-5c366176-05bf-425c-9dc3-7ec1952fdbb0 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Acquiring lock "refresh_cache-eaae47b9-a059-49f6-9ae6-d7147003e2f2" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 16:28:04 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-5c366176-05bf-425c-9dc3-7ec1952fdbb0 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Acquired lock "refresh_cache-eaae47b9-a059-49f6-9ae6-d7147003e2f2" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 16:28:04 user nova-compute[71731]: DEBUG nova.network.neutron [None req-5c366176-05bf-425c-9dc3-7ec1952fdbb0 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] [instance: eaae47b9-a059-49f6-9ae6-d7147003e2f2] Building network info cache for instance {{(pid=71731) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 16:28:04 user nova-compute[71731]: DEBUG nova.objects.instance [None req-5c366176-05bf-425c-9dc3-7ec1952fdbb0 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lazy-loading 'info_cache' on Instance uuid eaae47b9-a059-49f6-9ae6-d7147003e2f2 {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:28:04 user nova-compute[71731]: DEBUG nova.network.neutron [None req-5c366176-05bf-425c-9dc3-7ec1952fdbb0 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] [instance: eaae47b9-a059-49f6-9ae6-d7147003e2f2] Updating instance_info_cache with network_info: [{"id": "e9b2fcaa-f77b-4e5c-ad3c-797ce804a9ae", "address": "fa:16:3e:ff:85:92", "network": {"id": "79e9ef20-b14d-4850-b298-9d3ed4d10b90", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1756253617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24904988cf334657b084fd726c7ecf8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9b2fcaa-f7", "ovs_interfaceid": "e9b2fcaa-f77b-4e5c-ad3c-797ce804a9ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:28:04 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-5c366176-05bf-425c-9dc3-7ec1952fdbb0 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Releasing lock "refresh_cache-eaae47b9-a059-49f6-9ae6-d7147003e2f2" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 16:28:04 user nova-compute[71731]: INFO nova.virt.libvirt.driver [-] [instance: eaae47b9-a059-49f6-9ae6-d7147003e2f2] Instance destroyed successfully.
Apr 13 16:28:04 user nova-compute[71731]: DEBUG nova.objects.instance [None req-5c366176-05bf-425c-9dc3-7ec1952fdbb0 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lazy-loading 'resources' on Instance uuid eaae47b9-a059-49f6-9ae6-d7147003e2f2 {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:28:04 user nova-compute[71731]: DEBUG nova.virt.libvirt.vif [None req-5c366176-05bf-425c-9dc3-7ec1952fdbb0 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T16:24:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1335647489',display_name='tempest-AttachVolumeTestJSON-server-1335647489',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1335647489',id=17,image_ref='708622a9-7465-4492-ade8-b827198f7e30',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBWOy0oVQ9hC0pTOafixaz1QU1E5DFmqkYHL4O9l7OLTdaq0+Nt41+fxYUKgEMEMs0o2pxQBhqAzayIAyGV1IIb01ym4tkG3pd4D4/xbjIzoE586YH9dqYrXgxzYqNSiRA==',key_name='tempest-keypair-1534458766',keypairs=<?>,launch_index=0,launched_at=2023-04-13T16:24:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='24904988cf334657b084fd726c7ecf8f',ramdisk_id='',reservation_id='r-aer2ghdf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='708622a9-7465-4492-ade8-b827198f7e30',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-836650657',owner_user_name='tempest-AttachVolumeTestJSON-836650657-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T16:26:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='47fab402fb794a5a9281cfb7fe188813',uuid=eaae47b9-a059-49f6-9ae6-d7147003e2f2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "e9b2fcaa-f77b-4e5c-ad3c-797ce804a9ae", "address": "fa:16:3e:ff:85:92", "network": {"id": "79e9ef20-b14d-4850-b298-9d3ed4d10b90", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1756253617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24904988cf334657b084fd726c7ecf8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9b2fcaa-f7", "ovs_interfaceid": "e9b2fcaa-f77b-4e5c-ad3c-797ce804a9ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 16:28:04 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-5c366176-05bf-425c-9dc3-7ec1952fdbb0 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Converting VIF {"id": "e9b2fcaa-f77b-4e5c-ad3c-797ce804a9ae", "address": "fa:16:3e:ff:85:92", "network": {"id": "79e9ef20-b14d-4850-b298-9d3ed4d10b90", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1756253617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24904988cf334657b084fd726c7ecf8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9b2fcaa-f7", "ovs_interfaceid": "e9b2fcaa-f77b-4e5c-ad3c-797ce804a9ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 16:28:04 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-5c366176-05bf-425c-9dc3-7ec1952fdbb0 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ff:85:92,bridge_name='br-int',has_traffic_filtering=True,id=e9b2fcaa-f77b-4e5c-ad3c-797ce804a9ae,network=Network(79e9ef20-b14d-4850-b298-9d3ed4d10b90),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9b2fcaa-f7') {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 16:28:04 user nova-compute[71731]: DEBUG os_vif [None req-5c366176-05bf-425c-9dc3-7ec1952fdbb0 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:85:92,bridge_name='br-int',has_traffic_filtering=True,id=e9b2fcaa-f77b-4e5c-ad3c-797ce804a9ae,network=Network(79e9ef20-b14d-4850-b298-9d3ed4d10b90),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9b2fcaa-f7') {{(pid=71731) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 16:28:04 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:28:04 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape9b2fcaa-f7, bridge=br-int, if_exists=True) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:28:04 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:28:04 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 16:28:04 user nova-compute[71731]: INFO os_vif [None req-5c366176-05bf-425c-9dc3-7ec1952fdbb0 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:85:92,bridge_name='br-int',has_traffic_filtering=True,id=e9b2fcaa-f77b-4e5c-ad3c-797ce804a9ae,network=Network(79e9ef20-b14d-4850-b298-9d3ed4d10b90),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9b2fcaa-f7')
Apr 13 16:28:04 user nova-compute[71731]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5c366176-05bf-425c-9dc3-7ec1952fdbb0 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] [instance: eaae47b9-a059-49f6-9ae6-d7147003e2f2] calling os-brick to detach iSCSI Volume {{(pid=71731) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 16:28:04 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c366176-05bf-425c-9dc3-7ec1952fdbb0 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8cf0118790>, {'target_iqn': 'iqn.2010-10.org.openstack:eb2c60ec-fb52-436f-a98a-dfe15d1e3aa6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gzcNiTHC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf': {}}" {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 16:28:04 user nova-compute[71731]: WARNING os_brick.initiator.connectors.base [None req-5c366176-05bf-425c-9dc3-7ec1952fdbb0 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 16:28:04 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-5c366176-05bf-425c-9dc3-7ec1952fdbb0 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 16:28:04 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-5c366176-05bf-425c-9dc3-7ec1952fdbb0 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 16:28:04 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:28:04 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:28:04 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[446a3d62-d9da-4527-9ea6-e5f518a1495d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e4317bfd-71c2-4c48-a0f0-e3c795f262a8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:eb2c60ec-fb52-436f-a98a-dfe15d1e3aa6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d53e720e-a9ca-499b-aacd-aad1a169a874\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f45c196f-e69b-4a40-8a72-2e5a3b2dbe82\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:28:04 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c366176-05bf-425c-9dc3-7ec1952fdbb0 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 16:28:04 user nova-compute[71731]: No targets found.
Apr 13 16:28:04 user nova-compute[71731]: iSNS:
Apr 13 16:28:04 user nova-compute[71731]: No targets found.
Apr 13 16:28:04 user nova-compute[71731]: STATIC:
Apr 13 16:28:04 user nova-compute[71731]: Target: iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97
Apr 13 16:28:04 user nova-compute[71731]:         Portal: 172.16.0.220:3260,-1
Apr 13 16:28:04 user nova-compute[71731]:                 Iface Name: default
Apr 13 16:28:04 user nova-compute[71731]: Target: iqn.2010-10.org.openstack:e4317bfd-71c2-4c48-a0f0-e3c795f262a8
Apr 13 16:28:04 user nova-compute[71731]:         Portal: 172.16.0.220:3260,-1
Apr 13 16:28:04 user nova-compute[71731]:                 Iface Name: default
Apr 13 16:28:04 user nova-compute[71731]: Target: iqn.2010-10.org.openstack:eb2c60ec-fb52-436f-a98a-dfe15d1e3aa6
Apr 13 16:28:04 user nova-compute[71731]:         Portal: 172.16.0.220:3260,-1
Apr 13 16:28:04 user nova-compute[71731]:                 Iface Name: default
Apr 13 16:28:04 user nova-compute[71731]: Target: iqn.2010-10.org.openstack:d53e720e-a9ca-499b-aacd-aad1a169a874
Apr 13 16:28:04 user nova-compute[71731]:         Portal: 172.16.0.220:3260,-1
Apr 13 16:28:04 user nova-compute[71731]:                 Iface Name: default
Apr 13 16:28:04 user nova-compute[71731]: Target: iqn.2010-10.org.openstack:f45c196f-e69b-4a40-8a72-2e5a3b2dbe82
Apr 13 16:28:04 user nova-compute[71731]:         Portal: 172.16.0.220:3260,-1
Apr 13 16:28:04 user nova-compute[71731]:                 Iface Name: default
Apr 13 16:28:04 user nova-compute[71731]: FIRMWARE:
Apr 13 16:28:04 user nova-compute[71731]: No targets found.
Apr 13 16:28:04 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 16:28:04 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c366176-05bf-425c-9dc3-7ec1952fdbb0 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 16:28:04 user nova-compute[71731]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 16:28:04 user nova-compute[71731]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71731) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 16:28:04 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c366176-05bf-425c-9dc3-7ec1952fdbb0 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eb2c60ec-fb52-436f-a98a-dfe15d1e3aa6', 0)] {{(pid=71731) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 16:28:04 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:28:04 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:28:04 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[decc5ed5-468f-4e55-b6c6-d810a2a67b69]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d53e720e-a9ca-499b-aacd-aad1a169a874\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e4317bfd-71c2-4c48-a0f0-e3c795f262a8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eb2c60ec-fb52-436f-a98a-dfe15d1e3aa6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f45c196f-e69b-4a40-8a72-2e5a3b2dbe82\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:28:04 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:28:04 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:28:04 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[55c462c0-4e73-408e-9ad0-56fd89a710b4]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4317bfd-71c2-4c48-a0f0-e3c795f262a8 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb2c60ec-fb52-436f-a98a-dfe15d1e3aa6 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f45c196f-e69b-4a40-8a72-2e5a3b2dbe82 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d53e720e-a9ca-499b-aacd-aad1a169a874 (non-flash)\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:28:04 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c366176-05bf-425c-9dc3-7ec1952fdbb0 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)
Apr 13 16:28:04 user nova-compute[71731]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4317bfd-71c2-4c48-a0f0-e3c795f262a8 (non-flash)
Apr 13 16:28:04 user nova-compute[71731]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb2c60ec-fb52-436f-a98a-dfe15d1e3aa6 (non-flash)
Apr 13 16:28:04 user nova-compute[71731]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f45c196f-e69b-4a40-8a72-2e5a3b2dbe82 (non-flash)
Apr 13 16:28:04 user nova-compute[71731]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d53e720e-a9ca-499b-aacd-aad1a169a874 (non-flash)
Apr 13 16:28:04 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 16:28:04 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c366176-05bf-425c-9dc3-7ec1952fdbb0 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)
Apr 13 16:28:04 user nova-compute[71731]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4317bfd-71c2-4c48-a0f0-e3c795f262a8 (non-flash)
Apr 13 16:28:04 user nova-compute[71731]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb2c60ec-fb52-436f-a98a-dfe15d1e3aa6 (non-flash)
Apr 13 16:28:04 user nova-compute[71731]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f45c196f-e69b-4a40-8a72-2e5a3b2dbe82 (non-flash)
Apr 13 16:28:04 user nova-compute[71731]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d53e720e-a9ca-499b-aacd-aad1a169a874 (non-flash)
Apr 13 16:28:04 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 16:28:04 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c366176-05bf-425c-9dc3-7ec1952fdbb0 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8cff4cedd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eb2c60ec-fb52-436f-a98a-dfe15d1e3aa6'): ({'sdf'}, set())}) {{(pid=71731) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 16:28:04 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-5c366176-05bf-425c-9dc3-7ec1952fdbb0 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Removing single pathed devices sdf {{(pid=71731) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 16:28:04 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:28:04 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:28:04 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc5ef64b-76e3-4080-9e4e-6ba9ba685ee7]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:28:04 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:28:04 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.020s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:28:04 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5e1b224-448b-4883-9583-75229fa2481a]: (4, ('ok\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:28:04 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-5c366176-05bf-425c-9dc3-7ec1952fdbb0 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Flushing IO for device /dev/sdf {{(pid=71731) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 16:28:04 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:28:04 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.016s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:28:04 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[24c4286a-01a4-4ea9-88d5-cad9e308528f]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:28:04 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-5c366176-05bf-425c-9dc3-7ec1952fdbb0 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=71731) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 16:28:04 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:28:05 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.047s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:28:05 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff0035d0-64e5-4325-b937-6f0b4af0406d]: (4, ('1', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:28:05 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-5c366176-05bf-425c-9dc3-7ec1952fdbb0 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=71731) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 16:28:05 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-5c366176-05bf-425c-9dc3-7ec1952fdbb0 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] SCSI volumes sdf have been removed. {{(pid=71731) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 16:28:05 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c366176-05bf-425c-9dc3-7ec1952fdbb0 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eb2c60ec-fb52-436f-a98a-dfe15d1e3aa6')] {{(pid=71731) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 16:28:05 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb2c60ec-fb52-436f-a98a-dfe15d1e3aa6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:28:05 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb2c60ec-fb52-436f-a98a-dfe15d1e3aa6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:28:05 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[38cbf76a-838f-48b9-8ba2-df66b5fc7d8c]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:28:05 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c366176-05bf-425c-9dc3-7ec1952fdbb0 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:28:05 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb2c60ec-fb52-436f-a98a-dfe15d1e3aa6 -p 172.16.0.220:3260 --logout {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:28:05 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb2c60ec-fb52-436f-a98a-dfe15d1e3aa6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:28:05 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[2305b4a6-7983-4bdf-9189-f48918214eac]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:eb2c60ec-fb52-436f-a98a-dfe15d1e3aa6, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:eb2c60ec-fb52-436f-a98a-dfe15d1e3aa6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:28:05 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c366176-05bf-425c-9dc3-7ec1952fdbb0 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:eb2c60ec-fb52-436f-a98a-dfe15d1e3aa6, portal: 172.16.0.220,3260]
Apr 13 16:28:05 user nova-compute[71731]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:eb2c60ec-fb52-436f-a98a-dfe15d1e3aa6, portal: 172.16.0.220,3260] successful.
Apr 13 16:28:05 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:28:05 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb2c60ec-fb52-436f-a98a-dfe15d1e3aa6 -p 172.16.0.220:3260 --op delete {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:28:05 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb2c60ec-fb52-436f-a98a-dfe15d1e3aa6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.210s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:28:05 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f482b60-c5e5-4867-b2ca-e66644010b01]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:28:05 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c366176-05bf-425c-9dc3-7ec1952fdbb0 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:28:05 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-5c366176-05bf-425c-9dc3-7ec1952fdbb0 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.522s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 16:28:05 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c366176-05bf-425c-9dc3-7ec1952fdbb0 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] <== disconnect_volume: return (523ms) None {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 16:28:05 user nova-compute[71731]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5c366176-05bf-425c-9dc3-7ec1952fdbb0 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] [instance: eaae47b9-a059-49f6-9ae6-d7147003e2f2] Disconnected iSCSI Volume {{(pid=71731) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 16:28:05 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-5c366176-05bf-425c-9dc3-7ec1952fdbb0 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] [instance: eaae47b9-a059-49f6-9ae6-d7147003e2f2] Start _get_guest_xml network_info=[{"id": "e9b2fcaa-f77b-4e5c-ad3c-797ce804a9ae", "address": "fa:16:3e:ff:85:92", "network": {"id": "79e9ef20-b14d-4850-b298-9d3ed4d10b90", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1756253617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24904988cf334657b084fd726c7ecf8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9b2fcaa-f7", "ovs_interfaceid": "e9b2fcaa-f77b-4e5c-ad3c-797ce804a9ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=708622a9-7465-4492-ade8-b827198f7e30,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'device_type': 'disk', 'encrypted': False, 'disk_bus': 'virtio', 'guest_format': None, 'encryption_options': None, 'image_id': '708622a9-7465-4492-ade8-b827198f7e30'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'attachment_id': '0b7b1ced-6895-44e2-9696-28cfbd8d0062', 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:eb2c60ec-fb52-436f-a98a-dfe15d1e3aa6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gzcNiTHC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, 'status': 'reserved', 'instance': 'eaae47b9-a059-49f6-9ae6-d7147003e2f2', 'attached_at': '', 'detached_at': '', 'volume_id': 'eb2c60ec-fb52-436f-a98a-dfe15d1e3aa6', 'serial': 'eb2c60ec-fb52-436f-a98a-dfe15d1e3aa6'}, 'disk_bus': 'virtio', 'guest_format': None, 'volume_type': None} {{(pid=71731) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 16:28:05 user nova-compute[71731]: DEBUG nova.objects.instance [None req-5c366176-05bf-425c-9dc3-7ec1952fdbb0 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lazy-loading 'numa_topology' on Instance uuid eaae47b9-a059-49f6-9ae6-d7147003e2f2 {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:28:05 user nova-compute[71731]: WARNING nova.virt.libvirt.driver [None req-5c366176-05bf-425c-9dc3-7ec1952fdbb0 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 16:28:05 user nova-compute[71731]: WARNING nova.virt.libvirt.driver [None req-5c366176-05bf-425c-9dc3-7ec1952fdbb0 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 16:28:05 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-5c366176-05bf-425c-9dc3-7ec1952fdbb0 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71731) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 16:28:05 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-5c366176-05bf-425c-9dc3-7ec1952fdbb0 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T16:17:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=708622a9-7465-4492-ade8-b827198f7e30,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 16:28:05 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-5c366176-05bf-425c-9dc3-7ec1952fdbb0 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Flavor limits 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 16:28:05 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-5c366176-05bf-425c-9dc3-7ec1952fdbb0 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Image limits 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 16:28:05 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-5c366176-05bf-425c-9dc3-7ec1952fdbb0 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Flavor pref 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 16:28:05 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-5c366176-05bf-425c-9dc3-7ec1952fdbb0 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Image pref 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 16:28:05 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-5c366176-05bf-425c-9dc3-7ec1952fdbb0 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 16:28:05 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-5c366176-05bf-425c-9dc3-7ec1952fdbb0 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 16:28:05 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-5c366176-05bf-425c-9dc3-7ec1952fdbb0 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71731) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 16:28:05 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-5c366176-05bf-425c-9dc3-7ec1952fdbb0 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Got 1 possible topologies {{(pid=71731) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 16:28:05 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-5c366176-05bf-425c-9dc3-7ec1952fdbb0 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 16:28:05 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-5c366176-05bf-425c-9dc3-7ec1952fdbb0 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 16:28:05 user nova-compute[71731]: DEBUG nova.objects.instance [None req-5c366176-05bf-425c-9dc3-7ec1952fdbb0 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lazy-loading 'vcpu_model' on Instance uuid eaae47b9-a059-49f6-9ae6-d7147003e2f2 {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:28:05 user nova-compute[71731]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5c366176-05bf-425c-9dc3-7ec1952fdbb0 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] [instance: eaae47b9-a059-49f6-9ae6-d7147003e2f2] Calling os-brick to attach iSCSI Volume {{(pid=71731) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 16:28:05 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c366176-05bf-425c-9dc3-7ec1952fdbb0 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8cf0118790>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:eb2c60ec-fb52-436f-a98a-dfe15d1e3aa6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gzcNiTHC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 16:28:05 user nova-compute[71731]: WARNING os_brick.initiator.connectors.base [None req-5c366176-05bf-425c-9dc3-7ec1952fdbb0 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 16:28:05 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-5c366176-05bf-425c-9dc3-7ec1952fdbb0 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 16:28:05 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-5c366176-05bf-425c-9dc3-7ec1952fdbb0 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 16:28:05 user nova-compute[71731]: WARNING os_brick.initiator.connectors.base [None req-5c366176-05bf-425c-9dc3-7ec1952fdbb0 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 16:28:05 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-5c366176-05bf-425c-9dc3-7ec1952fdbb0 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eb2c60ec-fb52-436f-a98a-dfe15d1e3aa6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 16:28:05 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-5c366176-05bf-425c-9dc3-7ec1952fdbb0 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eb2c60ec-fb52-436f-a98a-dfe15d1e3aa6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 16:28:05 user nova-compute[71731]: INFO os_brick.initiator.connectors.iscsi [None req-5c366176-05bf-425c-9dc3-7ec1952fdbb0 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 16:28:05 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb2c60ec-fb52-436f-a98a-dfe15d1e3aa6 -p 172.16.0.220:3260 {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:28:05 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb2c60ec-fb52-436f-a98a-dfe15d1e3aa6 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:28:05 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a120369-51e2-4d49-b687-6bee05705681]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:28:05 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c366176-05bf-425c-9dc3-7ec1952fdbb0 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 16:28:05 user nova-compute[71731]:  {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:28:05 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb2c60ec-fb52-436f-a98a-dfe15d1e3aa6 -p 172.16.0.220:3260 --interface default --op new {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:28:05 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb2c60ec-fb52-436f-a98a-dfe15d1e3aa6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:28:05 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[f321efa1-b0cb-4c07-90cd-04535bdcc366]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:eb2c60ec-fb52-436f-a98a-dfe15d1e3aa6] added\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:28:05 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c366176-05bf-425c-9dc3-7ec1952fdbb0 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:eb2c60ec-fb52-436f-a98a-dfe15d1e3aa6] added
Apr 13 16:28:05 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:28:05 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb2c60ec-fb52-436f-a98a-dfe15d1e3aa6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:28:05 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb2c60ec-fb52-436f-a98a-dfe15d1e3aa6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:28:05 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[725b4428-8b43-4e06-89b0-4fa2bc1bb061]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:28:05 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c366176-05bf-425c-9dc3-7ec1952fdbb0 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:28:05 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb2c60ec-fb52-436f-a98a-dfe15d1e3aa6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:28:05 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb2c60ec-fb52-436f-a98a-dfe15d1e3aa6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:28:05 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[922e6bcf-c81c-4df7-a66c-3a2e31ae084b]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:28:05 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c366176-05bf-425c-9dc3-7ec1952fdbb0 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:28:05 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb2c60ec-fb52-436f-a98a-dfe15d1e3aa6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gzcNiTHC {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:28:05 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb2c60ec-fb52-436f-a98a-dfe15d1e3aa6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gzcNiTHC" returned: 0 in 0.021s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:28:05 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[517e3e93-f7ae-4b18-9028-368ea503c2ec]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:28:05 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c366176-05bf-425c-9dc3-7ec1952fdbb0 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gzcNiTHC'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:28:05 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb2c60ec-fb52-436f-a98a-dfe15d1e3aa6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:28:05 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb2c60ec-fb52-436f-a98a-dfe15d1e3aa6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:28:05 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a2dcf86-c13d-4941-8235-8d6e263edc4d]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:28:05 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c366176-05bf-425c-9dc3-7ec1952fdbb0 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:28:05 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:28:05 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:28:05 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[45b4f2dc-6e95-4527-85d4-7840340d32e7]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4317bfd-71c2-4c48-a0f0-e3c795f262a8 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f45c196f-e69b-4a40-8a72-2e5a3b2dbe82 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d53e720e-a9ca-499b-aacd-aad1a169a874 (non-flash)\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:28:05 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c366176-05bf-425c-9dc3-7ec1952fdbb0 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)
Apr 13 16:28:05 user nova-compute[71731]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4317bfd-71c2-4c48-a0f0-e3c795f262a8 (non-flash)
Apr 13 16:28:05 user nova-compute[71731]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f45c196f-e69b-4a40-8a72-2e5a3b2dbe82 (non-flash)
Apr 13 16:28:05 user nova-compute[71731]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d53e720e-a9ca-499b-aacd-aad1a169a874 (non-flash)
Apr 13 16:28:05 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 16:28:05 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c366176-05bf-425c-9dc3-7ec1952fdbb0 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)
Apr 13 16:28:05 user nova-compute[71731]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4317bfd-71c2-4c48-a0f0-e3c795f262a8 (non-flash)
Apr 13 16:28:05 user nova-compute[71731]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f45c196f-e69b-4a40-8a72-2e5a3b2dbe82 (non-flash)
Apr 13 16:28:05 user nova-compute[71731]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d53e720e-a9ca-499b-aacd-aad1a169a874 (non-flash)
Apr 13 16:28:05 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 16:28:05 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb2c60ec-fb52-436f-a98a-dfe15d1e3aa6 -p 172.16.0.220:3260 --login {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:28:05 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb2c60ec-fb52-436f-a98a-dfe15d1e3aa6 -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:28:05 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e5225a6-ad4a-4c19-ad63-f29f01ac7cb9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:eb2c60ec-fb52-436f-a98a-dfe15d1e3aa6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:eb2c60ec-fb52-436f-a98a-dfe15d1e3aa6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:28:05 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c366176-05bf-425c-9dc3-7ec1952fdbb0 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:eb2c60ec-fb52-436f-a98a-dfe15d1e3aa6, portal: 172.16.0.220,3260]
Apr 13 16:28:05 user nova-compute[71731]: Login to [iface: default, target: iqn.2010-10.org.openstack:eb2c60ec-fb52-436f-a98a-dfe15d1e3aa6, portal: 172.16.0.220,3260] successful.
Apr 13 16:28:05 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:28:05 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb2c60ec-fb52-436f-a98a-dfe15d1e3aa6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:28:05 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb2c60ec-fb52-436f-a98a-dfe15d1e3aa6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:28:05 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[70cd6ae0-f1e9-4ad5-a376-3c6f21a3715e]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:28:05 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c366176-05bf-425c-9dc3-7ec1952fdbb0 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:28:05 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:28:05 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:28:05 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[187bda85-3d67-40a0-b54b-7b9686ef230c]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4317bfd-71c2-4c48-a0f0-e3c795f262a8 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f45c196f-e69b-4a40-8a72-2e5a3b2dbe82 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d53e720e-a9ca-499b-aacd-aad1a169a874 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb2c60ec-fb52-436f-a98a-dfe15d1e3aa6 (non-flash)\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:28:05 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c366176-05bf-425c-9dc3-7ec1952fdbb0 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)
Apr 13 16:28:05 user nova-compute[71731]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4317bfd-71c2-4c48-a0f0-e3c795f262a8 (non-flash)
Apr 13 16:28:05 user nova-compute[71731]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f45c196f-e69b-4a40-8a72-2e5a3b2dbe82 (non-flash)
Apr 13 16:28:05 user nova-compute[71731]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d53e720e-a9ca-499b-aacd-aad1a169a874 (non-flash)
Apr 13 16:28:05 user nova-compute[71731]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb2c60ec-fb52-436f-a98a-dfe15d1e3aa6 (non-flash)
Apr 13 16:28:05 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 16:28:05 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c366176-05bf-425c-9dc3-7ec1952fdbb0 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)
Apr 13 16:28:05 user nova-compute[71731]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4317bfd-71c2-4c48-a0f0-e3c795f262a8 (non-flash)
Apr 13 16:28:05 user nova-compute[71731]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f45c196f-e69b-4a40-8a72-2e5a3b2dbe82 (non-flash)
Apr 13 16:28:05 user nova-compute[71731]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d53e720e-a9ca-499b-aacd-aad1a169a874 (non-flash)
Apr 13 16:28:05 user nova-compute[71731]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb2c60ec-fb52-436f-a98a-dfe15d1e3aa6 (non-flash)
Apr 13 16:28:05 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 16:28:05 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-5c366176-05bf-425c-9dc3-7ec1952fdbb0 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eb2c60ec-fb52-436f-a98a-dfe15d1e3aa6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.310s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 16:28:05 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c366176-05bf-425c-9dc3-7ec1952fdbb0 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Connected to 172.16.0.220:3260 {{(pid=71731) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 16:28:05 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-5c366176-05bf-425c-9dc3-7ec1952fdbb0 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] HCTL ('37', '-', '-', 0) found on session 26 with lun 0 {{(pid=71731) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 16:28:05 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-5c366176-05bf-425c-9dc3-7ec1952fdbb0 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=71731) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 16:28:05 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:28:05 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.016s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:28:05 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[766009fa-d510-45b7-8840-08a683857659]: (4, ('- - 0', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:28:05 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-5c366176-05bf-425c-9dc3-7ec1952fdbb0 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Searching for a device in session 26 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=71731) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 16:28:05 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c366176-05bf-425c-9dc3-7ec1952fdbb0 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:eb2c60ec-fb52-436f-a98a-dfe15d1e3aa6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gzcNiTHC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=71731) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 16:28:06 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:28:06 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:28:06 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-5c366176-05bf-425c-9dc3-7ec1952fdbb0 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.342s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 16:28:06 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c366176-05bf-425c-9dc3-7ec1952fdbb0 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] <== connect_volume: return (1345ms) {'type': 'block', 'scsi_wwn': '23533306532666562', 'path': '/dev/sdf'} {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 16:28:06 user nova-compute[71731]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5c366176-05bf-425c-9dc3-7ec1952fdbb0 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] [instance: eaae47b9-a059-49f6-9ae6-d7147003e2f2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23533306532666562', 'path': '/dev/sdf'} {{(pid=71731) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 16:28:06 user nova-compute[71731]: DEBUG nova.virt.libvirt.vif [None req-5c366176-05bf-425c-9dc3-7ec1952fdbb0 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T16:24:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1335647489',display_name='tempest-AttachVolumeTestJSON-server-1335647489',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1335647489',id=17,image_ref='708622a9-7465-4492-ade8-b827198f7e30',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBWOy0oVQ9hC0pTOafixaz1QU1E5DFmqkYHL4O9l7OLTdaq0+Nt41+fxYUKgEMEMs0o2pxQBhqAzayIAyGV1IIb01ym4tkG3pd4D4/xbjIzoE586YH9dqYrXgxzYqNSiRA==',key_name='tempest-keypair-1534458766',keypairs=<?>,launch_index=0,launched_at=2023-04-13T16:24:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='24904988cf334657b084fd726c7ecf8f',ramdisk_id='',reservation_id='r-aer2ghdf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='708622a9-7465-4492-ade8-b827198f7e30',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-836650657',owner_user_name='tempest-AttachVolumeTestJSON-836650657-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T16:26:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='47fab402fb794a5a9281cfb7fe188813',uuid=eaae47b9-a059-49f6-9ae6-d7147003e2f2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "e9b2fcaa-f77b-4e5c-ad3c-797ce804a9ae", "address": "fa:16:3e:ff:85:92", "network": {"id": "79e9ef20-b14d-4850-b298-9d3ed4d10b90", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1756253617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24904988cf334657b084fd726c7ecf8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9b2fcaa-f7", "ovs_interfaceid": "e9b2fcaa-f77b-4e5c-ad3c-797ce804a9ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71731) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 16:28:06 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-5c366176-05bf-425c-9dc3-7ec1952fdbb0 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Converting VIF {"id": "e9b2fcaa-f77b-4e5c-ad3c-797ce804a9ae", "address": "fa:16:3e:ff:85:92", "network": {"id": "79e9ef20-b14d-4850-b298-9d3ed4d10b90", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1756253617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24904988cf334657b084fd726c7ecf8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9b2fcaa-f7", "ovs_interfaceid": "e9b2fcaa-f77b-4e5c-ad3c-797ce804a9ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 16:28:06 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-5c366176-05bf-425c-9dc3-7ec1952fdbb0 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ff:85:92,bridge_name='br-int',has_traffic_filtering=True,id=e9b2fcaa-f77b-4e5c-ad3c-797ce804a9ae,network=Network(79e9ef20-b14d-4850-b298-9d3ed4d10b90),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9b2fcaa-f7') {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 16:28:06 user nova-compute[71731]: DEBUG nova.objects.instance [None req-5c366176-05bf-425c-9dc3-7ec1952fdbb0 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lazy-loading 'pci_devices' on Instance uuid eaae47b9-a059-49f6-9ae6-d7147003e2f2 {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:28:06 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-5c366176-05bf-425c-9dc3-7ec1952fdbb0 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] [instance: eaae47b9-a059-49f6-9ae6-d7147003e2f2] End _get_guest_xml xml=<domain type="kvm">
Apr 13 16:28:06 user nova-compute[71731]:   <uuid>eaae47b9-a059-49f6-9ae6-d7147003e2f2</uuid>
Apr 13 16:28:06 user nova-compute[71731]:   <name>instance-00000011</name>
Apr 13 16:28:06 user nova-compute[71731]:   <memory>131072</memory>
Apr 13 16:28:06 user nova-compute[71731]:   <vcpu>1</vcpu>
Apr 13 16:28:06 user nova-compute[71731]:   <metadata>
Apr 13 16:28:06 user nova-compute[71731]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 16:28:06 user nova-compute[71731]:       <nova:package version="0.0.0"/>
Apr 13 16:28:06 user nova-compute[71731]:       <nova:name>tempest-AttachVolumeTestJSON-server-1335647489</nova:name>
Apr 13 16:28:06 user nova-compute[71731]:       <nova:creationTime>2023-04-13 16:28:05</nova:creationTime>
Apr 13 16:28:06 user nova-compute[71731]:       <nova:flavor name="m1.nano">
Apr 13 16:28:06 user nova-compute[71731]:         <nova:memory>128</nova:memory>
Apr 13 16:28:06 user nova-compute[71731]:         <nova:disk>1</nova:disk>
Apr 13 16:28:06 user nova-compute[71731]:         <nova:swap>0</nova:swap>
Apr 13 16:28:06 user nova-compute[71731]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 16:28:06 user nova-compute[71731]:         <nova:vcpus>1</nova:vcpus>
Apr 13 16:28:06 user nova-compute[71731]:       </nova:flavor>
Apr 13 16:28:06 user nova-compute[71731]:       <nova:owner>
Apr 13 16:28:06 user nova-compute[71731]:         <nova:user uuid="47fab402fb794a5a9281cfb7fe188813">tempest-AttachVolumeTestJSON-836650657-project-member</nova:user>
Apr 13 16:28:06 user nova-compute[71731]:         <nova:project uuid="24904988cf334657b084fd726c7ecf8f">tempest-AttachVolumeTestJSON-836650657</nova:project>
Apr 13 16:28:06 user nova-compute[71731]:       </nova:owner>
Apr 13 16:28:06 user nova-compute[71731]:       <nova:root type="image" uuid="708622a9-7465-4492-ade8-b827198f7e30"/>
Apr 13 16:28:06 user nova-compute[71731]:       <nova:ports>
Apr 13 16:28:06 user nova-compute[71731]:         <nova:port uuid="e9b2fcaa-f77b-4e5c-ad3c-797ce804a9ae">
Apr 13 16:28:06 user nova-compute[71731]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Apr 13 16:28:06 user nova-compute[71731]:         </nova:port>
Apr 13 16:28:06 user nova-compute[71731]:       </nova:ports>
Apr 13 16:28:06 user nova-compute[71731]:     </nova:instance>
Apr 13 16:28:06 user nova-compute[71731]:   </metadata>
Apr 13 16:28:06 user nova-compute[71731]:   <sysinfo type="smbios">
Apr 13 16:28:06 user nova-compute[71731]:     <system>
Apr 13 16:28:06 user nova-compute[71731]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 16:28:06 user nova-compute[71731]:       <entry name="product">OpenStack Nova</entry>
Apr 13 16:28:06 user nova-compute[71731]:       <entry name="version">0.0.0</entry>
Apr 13 16:28:06 user nova-compute[71731]:       <entry name="serial">eaae47b9-a059-49f6-9ae6-d7147003e2f2</entry>
Apr 13 16:28:06 user nova-compute[71731]:       <entry name="uuid">eaae47b9-a059-49f6-9ae6-d7147003e2f2</entry>
Apr 13 16:28:06 user nova-compute[71731]:       <entry name="family">Virtual Machine</entry>
Apr 13 16:28:06 user nova-compute[71731]:     </system>
Apr 13 16:28:06 user nova-compute[71731]:   </sysinfo>
Apr 13 16:28:06 user nova-compute[71731]:   <os>
Apr 13 16:28:06 user nova-compute[71731]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 16:28:06 user nova-compute[71731]:     <boot dev="hd"/>
Apr 13 16:28:06 user nova-compute[71731]:     <smbios mode="sysinfo"/>
Apr 13 16:28:06 user nova-compute[71731]:   </os>
Apr 13 16:28:06 user nova-compute[71731]:   <features>
Apr 13 16:28:06 user nova-compute[71731]:     <acpi/>
Apr 13 16:28:06 user nova-compute[71731]:     <apic/>
Apr 13 16:28:06 user nova-compute[71731]:     <vmcoreinfo/>
Apr 13 16:28:06 user nova-compute[71731]:   </features>
Apr 13 16:28:06 user nova-compute[71731]:   <clock offset="utc">
Apr 13 16:28:06 user nova-compute[71731]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 16:28:06 user nova-compute[71731]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 16:28:06 user nova-compute[71731]:     <timer name="hpet" present="no"/>
Apr 13 16:28:06 user nova-compute[71731]:   </clock>
Apr 13 16:28:06 user nova-compute[71731]:   <cpu mode="custom" match="exact">
Apr 13 16:28:06 user nova-compute[71731]:     <model>Nehalem</model>
Apr 13 16:28:06 user nova-compute[71731]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 16:28:06 user nova-compute[71731]:   </cpu>
Apr 13 16:28:06 user nova-compute[71731]:   <devices>
Apr 13 16:28:06 user nova-compute[71731]:     <disk type="file" device="disk">
Apr 13 16:28:06 user nova-compute[71731]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 16:28:06 user nova-compute[71731]:       <source file="/opt/stack/data/nova/instances/eaae47b9-a059-49f6-9ae6-d7147003e2f2/disk"/>
Apr 13 16:28:06 user nova-compute[71731]:       <target dev="vda" bus="virtio"/>
Apr 13 16:28:06 user nova-compute[71731]:     </disk>
Apr 13 16:28:06 user nova-compute[71731]:     <disk type="block" device="disk">
Apr 13 16:28:06 user nova-compute[71731]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 16:28:06 user nova-compute[71731]:       <source dev="/dev/sdf"/>
Apr 13 16:28:06 user nova-compute[71731]:       <target dev="vdb" bus="virtio"/>
Apr 13 16:28:06 user nova-compute[71731]:       <serial>eb2c60ec-fb52-436f-a98a-dfe15d1e3aa6</serial>
Apr 13 16:28:06 user nova-compute[71731]:     </disk>
Apr 13 16:28:06 user nova-compute[71731]:     <interface type="ethernet">
Apr 13 16:28:06 user nova-compute[71731]:       <mac address="fa:16:3e:ff:85:92"/>
Apr 13 16:28:06 user nova-compute[71731]:       <model type="virtio"/>
Apr 13 16:28:06 user nova-compute[71731]:       <mtu size="1442"/>
Apr 13 16:28:06 user nova-compute[71731]:       <target dev="tape9b2fcaa-f7"/>
Apr 13 16:28:06 user nova-compute[71731]:     </interface>
Apr 13 16:28:06 user nova-compute[71731]:     <serial type="pty">
Apr 13 16:28:06 user nova-compute[71731]:       <log file="/opt/stack/data/nova/instances/eaae47b9-a059-49f6-9ae6-d7147003e2f2/console.log" append="off"/>
Apr 13 16:28:06 user nova-compute[71731]:     </serial>
Apr 13 16:28:06 user nova-compute[71731]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 16:28:06 user nova-compute[71731]:     <video>
Apr 13 16:28:06 user nova-compute[71731]:       <model type="virtio"/>
Apr 13 16:28:06 user nova-compute[71731]:     </video>
Apr 13 16:28:06 user nova-compute[71731]:     <rng model="virtio">
Apr 13 16:28:06 user nova-compute[71731]:       <backend model="random">/dev/urandom</backend>
Apr 13 16:28:06 user nova-compute[71731]:     </rng>
Apr 13 16:28:06 user nova-compute[71731]:     <controller type="usb" index="0" model="none"/>
Apr 13 16:28:06 user nova-compute[71731]:     <memballoon model="virtio">
Apr 13 16:28:06 user nova-compute[71731]:       <stats period="10"/>
Apr 13 16:28:06 user nova-compute[71731]:     </memballoon>
Apr 13 16:28:06 user nova-compute[71731]:   </devices>
Apr 13 16:28:06 user nova-compute[71731]: </domain>
Apr 13 16:28:06 user nova-compute[71731]:  {{(pid=71731) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 16:28:06 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-5c366176-05bf-425c-9dc3-7ec1952fdbb0 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eaae47b9-a059-49f6-9ae6-d7147003e2f2/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:28:06 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-5c366176-05bf-425c-9dc3-7ec1952fdbb0 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eaae47b9-a059-49f6-9ae6-d7147003e2f2/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:28:06 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-5c366176-05bf-425c-9dc3-7ec1952fdbb0 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eaae47b9-a059-49f6-9ae6-d7147003e2f2/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:28:07 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-5c366176-05bf-425c-9dc3-7ec1952fdbb0 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eaae47b9-a059-49f6-9ae6-d7147003e2f2/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:28:07 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-5c366176-05bf-425c-9dc3-7ec1952fdbb0 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=71731) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 16:28:07 user nova-compute[71731]: DEBUG nova.objects.instance [None req-5c366176-05bf-425c-9dc3-7ec1952fdbb0 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lazy-loading 'trusted_certs' on Instance uuid eaae47b9-a059-49f6-9ae6-d7147003e2f2 {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:28:07 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-5c366176-05bf-425c-9dc3-7ec1952fdbb0 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279 --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:28:07 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-5c366176-05bf-425c-9dc3-7ec1952fdbb0 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279 --force-share --output=json" returned: 0 in 0.169s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:28:07 user nova-compute[71731]: DEBUG nova.virt.disk.api [None req-5c366176-05bf-425c-9dc3-7ec1952fdbb0 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Checking if we can resize image /opt/stack/data/nova/instances/eaae47b9-a059-49f6-9ae6-d7147003e2f2/disk. size=1073741824 {{(pid=71731) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 16:28:07 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-5c366176-05bf-425c-9dc3-7ec1952fdbb0 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eaae47b9-a059-49f6-9ae6-d7147003e2f2/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:28:07 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-5c366176-05bf-425c-9dc3-7ec1952fdbb0 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eaae47b9-a059-49f6-9ae6-d7147003e2f2/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:28:07 user nova-compute[71731]: DEBUG nova.virt.disk.api [None req-5c366176-05bf-425c-9dc3-7ec1952fdbb0 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Cannot resize image /opt/stack/data/nova/instances/eaae47b9-a059-49f6-9ae6-d7147003e2f2/disk to a smaller size. {{(pid=71731) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 16:28:07 user nova-compute[71731]: DEBUG nova.objects.instance [None req-5c366176-05bf-425c-9dc3-7ec1952fdbb0 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lazy-loading 'migration_context' on Instance uuid eaae47b9-a059-49f6-9ae6-d7147003e2f2 {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:28:07 user nova-compute[71731]: DEBUG nova.virt.libvirt.vif [None req-5c366176-05bf-425c-9dc3-7ec1952fdbb0 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T16:24:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1335647489',display_name='tempest-AttachVolumeTestJSON-server-1335647489',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1335647489',id=17,image_ref='708622a9-7465-4492-ade8-b827198f7e30',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBWOy0oVQ9hC0pTOafixaz1QU1E5DFmqkYHL4O9l7OLTdaq0+Nt41+fxYUKgEMEMs0o2pxQBhqAzayIAyGV1IIb01ym4tkG3pd4D4/xbjIzoE586YH9dqYrXgxzYqNSiRA==',key_name='tempest-keypair-1534458766',keypairs=<?>,launch_index=0,launched_at=2023-04-13T16:24:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='24904988cf334657b084fd726c7ecf8f',ramdisk_id='',reservation_id='r-aer2ghdf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='708622a9-7465-4492-ade8-b827198f7e30',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-836650657',owner_user_name='tempest-AttachVolumeTestJSON-836650657-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T16:26:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='47fab402fb794a5a9281cfb7fe188813',uuid=eaae47b9-a059-49f6-9ae6-d7147003e2f2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "e9b2fcaa-f77b-4e5c-ad3c-797ce804a9ae", "address": "fa:16:3e:ff:85:92", "network": {"id": "79e9ef20-b14d-4850-b298-9d3ed4d10b90", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1756253617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24904988cf334657b084fd726c7ecf8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9b2fcaa-f7", "ovs_interfaceid": "e9b2fcaa-f77b-4e5c-ad3c-797ce804a9ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 16:28:07 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-5c366176-05bf-425c-9dc3-7ec1952fdbb0 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Converting VIF {"id": "e9b2fcaa-f77b-4e5c-ad3c-797ce804a9ae", "address": "fa:16:3e:ff:85:92", "network": {"id": "79e9ef20-b14d-4850-b298-9d3ed4d10b90", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1756253617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24904988cf334657b084fd726c7ecf8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9b2fcaa-f7", "ovs_interfaceid": "e9b2fcaa-f77b-4e5c-ad3c-797ce804a9ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 16:28:07 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-5c366176-05bf-425c-9dc3-7ec1952fdbb0 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ff:85:92,bridge_name='br-int',has_traffic_filtering=True,id=e9b2fcaa-f77b-4e5c-ad3c-797ce804a9ae,network=Network(79e9ef20-b14d-4850-b298-9d3ed4d10b90),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9b2fcaa-f7') {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 16:28:07 user nova-compute[71731]: DEBUG os_vif [None req-5c366176-05bf-425c-9dc3-7ec1952fdbb0 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:85:92,bridge_name='br-int',has_traffic_filtering=True,id=e9b2fcaa-f77b-4e5c-ad3c-797ce804a9ae,network=Network(79e9ef20-b14d-4850-b298-9d3ed4d10b90),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9b2fcaa-f7') {{(pid=71731) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 16:28:07 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:28:07 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:28:07 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 16:28:07 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:28:07 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape9b2fcaa-f7, may_exist=True) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:28:07 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape9b2fcaa-f7, col_values=(('external_ids', {'iface-id': 'e9b2fcaa-f77b-4e5c-ad3c-797ce804a9ae', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ff:85:92', 'vm-uuid': 'eaae47b9-a059-49f6-9ae6-d7147003e2f2'}),)) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:28:07 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:28:07 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 16:28:07 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:28:07 user nova-compute[71731]: INFO os_vif [None req-5c366176-05bf-425c-9dc3-7ec1952fdbb0 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:85:92,bridge_name='br-int',has_traffic_filtering=True,id=e9b2fcaa-f77b-4e5c-ad3c-797ce804a9ae,network=Network(79e9ef20-b14d-4850-b298-9d3ed4d10b90),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9b2fcaa-f7')
Apr 13 16:28:08 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:28:08 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:28:08 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:28:08 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:28:09 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager.update_available_resource {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:28:09 user nova-compute[71731]: DEBUG nova.compute.manager [req-2e76b57f-8030-4762-801d-0b680d7c5900 req-87bdc26a-8840-45e0-8f66-3c9cc9c91979 service nova] [instance: eaae47b9-a059-49f6-9ae6-d7147003e2f2] Received event network-vif-plugged-e9b2fcaa-f77b-4e5c-ad3c-797ce804a9ae {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:28:09 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-2e76b57f-8030-4762-801d-0b680d7c5900 req-87bdc26a-8840-45e0-8f66-3c9cc9c91979 service nova] Acquiring lock "eaae47b9-a059-49f6-9ae6-d7147003e2f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:28:09 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-2e76b57f-8030-4762-801d-0b680d7c5900 req-87bdc26a-8840-45e0-8f66-3c9cc9c91979 service nova] Lock "eaae47b9-a059-49f6-9ae6-d7147003e2f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:28:09 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-2e76b57f-8030-4762-801d-0b680d7c5900 req-87bdc26a-8840-45e0-8f66-3c9cc9c91979 service nova] Lock "eaae47b9-a059-49f6-9ae6-d7147003e2f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:28:09 user nova-compute[71731]: DEBUG nova.compute.manager [req-2e76b57f-8030-4762-801d-0b680d7c5900 req-87bdc26a-8840-45e0-8f66-3c9cc9c91979 service nova] [instance: eaae47b9-a059-49f6-9ae6-d7147003e2f2] No waiting events found dispatching network-vif-plugged-e9b2fcaa-f77b-4e5c-ad3c-797ce804a9ae {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:28:09 user nova-compute[71731]: WARNING nova.compute.manager [req-2e76b57f-8030-4762-801d-0b680d7c5900 req-87bdc26a-8840-45e0-8f66-3c9cc9c91979 service nova] [instance: eaae47b9-a059-49f6-9ae6-d7147003e2f2] Received unexpected event network-vif-plugged-e9b2fcaa-f77b-4e5c-ad3c-797ce804a9ae for instance with vm_state stopped and task_state powering-on.
Apr 13 16:28:09 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:28:09 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:28:09 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:28:09 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Auditing locally available compute resources for user (node: user) {{(pid=71731) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 16:28:09 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:28:09 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:28:09 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:28:09 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=71731) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 16:28:09 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acbcaee0-a47b-4fee-8765-9b1c9597d515/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:28:09 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acbcaee0-a47b-4fee-8765-9b1c9597d515/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:28:09 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acbcaee0-a47b-4fee-8765-9b1c9597d515/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:28:09 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acbcaee0-a47b-4fee-8765-9b1c9597d515/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:28:09 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=71731) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 16:28:09 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7973e93b-6311-44ed-91ff-e861c32d0277/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:28:09 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7973e93b-6311-44ed-91ff-e861c32d0277/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:28:09 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7973e93b-6311-44ed-91ff-e861c32d0277/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:28:10 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7973e93b-6311-44ed-91ff-e861c32d0277/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:28:10 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71731) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 16:28:10 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d50f597-3a29-4335-8166-6ab8e8149376/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:28:10 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d50f597-3a29-4335-8166-6ab8e8149376/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:28:10 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d50f597-3a29-4335-8166-6ab8e8149376/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:28:10 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d50f597-3a29-4335-8166-6ab8e8149376/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:28:10 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66553f5-5e1b-4f1d-8c5a-63bc340f7586/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:28:10 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66553f5-5e1b-4f1d-8c5a-63bc340f7586/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:28:10 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66553f5-5e1b-4f1d-8c5a-63bc340f7586/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:28:10 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66553f5-5e1b-4f1d-8c5a-63bc340f7586/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:28:10 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eaae47b9-a059-49f6-9ae6-d7147003e2f2/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:28:10 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eaae47b9-a059-49f6-9ae6-d7147003e2f2/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:28:10 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eaae47b9-a059-49f6-9ae6-d7147003e2f2/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:28:11 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eaae47b9-a059-49f6-9ae6-d7147003e2f2/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:28:11 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=71731) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 16:28:11 user nova-compute[71731]: DEBUG nova.compute.manager [req-09aaedfc-f30a-4d46-a722-7dd655f9b0fd req-bee1afec-575a-4c8d-9880-ed016b8cc870 service nova] [instance: eaae47b9-a059-49f6-9ae6-d7147003e2f2] Received event network-vif-plugged-e9b2fcaa-f77b-4e5c-ad3c-797ce804a9ae {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:28:11 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-09aaedfc-f30a-4d46-a722-7dd655f9b0fd req-bee1afec-575a-4c8d-9880-ed016b8cc870 service nova] Acquiring lock "eaae47b9-a059-49f6-9ae6-d7147003e2f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:28:11 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-09aaedfc-f30a-4d46-a722-7dd655f9b0fd req-bee1afec-575a-4c8d-9880-ed016b8cc870 service nova] Lock "eaae47b9-a059-49f6-9ae6-d7147003e2f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:28:11 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-09aaedfc-f30a-4d46-a722-7dd655f9b0fd req-bee1afec-575a-4c8d-9880-ed016b8cc870 service nova] Lock "eaae47b9-a059-49f6-9ae6-d7147003e2f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:28:11 user nova-compute[71731]: DEBUG nova.compute.manager [req-09aaedfc-f30a-4d46-a722-7dd655f9b0fd req-bee1afec-575a-4c8d-9880-ed016b8cc870 service nova] [instance: eaae47b9-a059-49f6-9ae6-d7147003e2f2] No waiting events found dispatching network-vif-plugged-e9b2fcaa-f77b-4e5c-ad3c-797ce804a9ae {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:28:11 user nova-compute[71731]: WARNING nova.compute.manager [req-09aaedfc-f30a-4d46-a722-7dd655f9b0fd req-bee1afec-575a-4c8d-9880-ed016b8cc870 service nova] [instance: eaae47b9-a059-49f6-9ae6-d7147003e2f2] Received unexpected event network-vif-plugged-e9b2fcaa-f77b-4e5c-ad3c-797ce804a9ae for instance with vm_state stopped and task_state powering-on.
Apr 13 16:28:11 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71731) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 16:28:11 user nova-compute[71731]: DEBUG nova.virt.driver [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Emitting event <LifecycleEvent: 1681403291.1479816, eaae47b9-a059-49f6-9ae6-d7147003e2f2 => Resumed> {{(pid=71731) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 16:28:11 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: eaae47b9-a059-49f6-9ae6-d7147003e2f2] VM Resumed (Lifecycle Event)
Apr 13 16:28:11 user nova-compute[71731]: DEBUG nova.compute.manager [None req-5c366176-05bf-425c-9dc3-7ec1952fdbb0 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] [instance: eaae47b9-a059-49f6-9ae6-d7147003e2f2] Instance event wait completed in 0 seconds for  {{(pid=71731) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 16:28:11 user nova-compute[71731]: INFO nova.virt.libvirt.driver [-] [instance: eaae47b9-a059-49f6-9ae6-d7147003e2f2] Instance rebooted successfully.
Apr 13 16:28:11 user nova-compute[71731]: DEBUG nova.compute.manager [None req-5c366176-05bf-425c-9dc3-7ec1952fdbb0 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] [instance: eaae47b9-a059-49f6-9ae6-d7147003e2f2] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:28:11 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: eaae47b9-a059-49f6-9ae6-d7147003e2f2] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:28:11 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: eaae47b9-a059-49f6-9ae6-d7147003e2f2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=71731) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 16:28:11 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:28:11 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: eaae47b9-a059-49f6-9ae6-d7147003e2f2] During sync_power_state the instance has a pending task (powering-on). Skip.
Apr 13 16:28:11 user nova-compute[71731]: DEBUG nova.virt.driver [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Emitting event <LifecycleEvent: 1681403291.1482415, eaae47b9-a059-49f6-9ae6-d7147003e2f2 => Started> {{(pid=71731) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 16:28:11 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: eaae47b9-a059-49f6-9ae6-d7147003e2f2] VM Started (Lifecycle Event)
Apr 13 16:28:11 user nova-compute[71731]: WARNING nova.virt.libvirt.driver [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 16:28:11 user nova-compute[71731]: WARNING nova.virt.libvirt.driver [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 16:28:11 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Hypervisor/Node resource view: name=user free_ram=7835MB free_disk=26.284435272216797GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71731) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 16:28:11 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:28:11 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:28:11 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: eaae47b9-a059-49f6-9ae6-d7147003e2f2] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:28:11 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: eaae47b9-a059-49f6-9ae6-d7147003e2f2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=71731) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 16:28:11 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance 7973e93b-6311-44ed-91ff-e861c32d0277 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 16:28:11 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance f66553f5-5e1b-4f1d-8c5a-63bc340f7586 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 16:28:11 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance 235f827c-7116-48e9-84c5-0c9761c18e1e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 16:28:11 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance acbcaee0-a47b-4fee-8765-9b1c9597d515 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 16:28:11 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance eaae47b9-a059-49f6-9ae6-d7147003e2f2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 16:28:11 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance 5ea4ab6a-6501-4a2f-a8f7-04090024747d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 16:28:11 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance 0f52d9e3-921c-4f79-9cdb-7d73500c8c35 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 16:28:11 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance 5d50f597-3a29-4335-8166-6ab8e8149376 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 16:28:11 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=71731) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 16:28:11 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Final resource view: name=user phys_ram=16023MB used_ram=1536MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=71731) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 16:28:12 user nova-compute[71731]: DEBUG nova.compute.provider_tree [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Inventory has not changed in ProviderTree for provider: cb6b1a64-0c24-4e2d-af1e-16576ca9165c {{(pid=71731) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 16:28:12 user nova-compute[71731]: DEBUG nova.scheduler.client.report [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Inventory has not changed for provider cb6b1a64-0c24-4e2d-af1e-16576ca9165c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71731) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 16:28:12 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Compute_service record updated for user:user {{(pid=71731) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 16:28:12 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.529s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:28:12 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:28:14 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:28:14 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Starting heal instance info cache {{(pid=71731) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 16:28:14 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Acquiring lock "refresh_cache-235f827c-7116-48e9-84c5-0c9761c18e1e" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 16:28:14 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Acquired lock "refresh_cache-235f827c-7116-48e9-84c5-0c9761c18e1e" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 16:28:14 user nova-compute[71731]: DEBUG nova.network.neutron [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] [instance: 235f827c-7116-48e9-84c5-0c9761c18e1e] Forcefully refreshing network info cache for instance {{(pid=71731) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 16:28:15 user nova-compute[71731]: DEBUG nova.network.neutron [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] [instance: 235f827c-7116-48e9-84c5-0c9761c18e1e] Updating instance_info_cache with network_info: [{"id": "b72a6c8b-7244-41c2-a4f7-6da43b4944b8", "address": "fa:16:3e:e3:62:b0", "network": {"id": "5a7877ff-8230-470b-90b5-e5dcfc8f0cee", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-779403873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2d09a74bf684a9fb1dd1e95d6c23f3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb72a6c8b-72", "ovs_interfaceid": "b72a6c8b-7244-41c2-a4f7-6da43b4944b8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:28:15 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Releasing lock "refresh_cache-235f827c-7116-48e9-84c5-0c9761c18e1e" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 16:28:15 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] [instance: 235f827c-7116-48e9-84c5-0c9761c18e1e] Updated the network info_cache for instance {{(pid=71731) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 16:28:15 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:28:15 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:28:15 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:28:15 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:28:15 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:28:15 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71731) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 16:28:16 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:28:16 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:28:17 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:28:17 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:28:18 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:28:18 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:28:18 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:28:21 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:28:22 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:28:23 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:28:25 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:28:26 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:28:27 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:28:28 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:28:28 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-38f289b4-d3a1-4d47-a8de-d9aa96d05988 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Acquiring lock "bf98c3a2-dbeb-4ae4-8423-ce55964c4258" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:28:28 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-38f289b4-d3a1-4d47-a8de-d9aa96d05988 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Lock "bf98c3a2-dbeb-4ae4-8423-ce55964c4258" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:28:28 user nova-compute[71731]: DEBUG nova.compute.manager [None req-38f289b4-d3a1-4d47-a8de-d9aa96d05988 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] [instance: bf98c3a2-dbeb-4ae4-8423-ce55964c4258] Starting instance... {{(pid=71731) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 16:28:29 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-38f289b4-d3a1-4d47-a8de-d9aa96d05988 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:28:29 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-38f289b4-d3a1-4d47-a8de-d9aa96d05988 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:28:29 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-38f289b4-d3a1-4d47-a8de-d9aa96d05988 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71731) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 16:28:29 user nova-compute[71731]: INFO nova.compute.claims [None req-38f289b4-d3a1-4d47-a8de-d9aa96d05988 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] [instance: bf98c3a2-dbeb-4ae4-8423-ce55964c4258] Claim successful on node user
Apr 13 16:28:29 user nova-compute[71731]: DEBUG nova.compute.provider_tree [None req-38f289b4-d3a1-4d47-a8de-d9aa96d05988 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Inventory has not changed in ProviderTree for provider: cb6b1a64-0c24-4e2d-af1e-16576ca9165c {{(pid=71731) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 16:28:29 user nova-compute[71731]: DEBUG nova.scheduler.client.report [None req-38f289b4-d3a1-4d47-a8de-d9aa96d05988 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Inventory has not changed for provider cb6b1a64-0c24-4e2d-af1e-16576ca9165c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71731) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 16:28:29 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-38f289b4-d3a1-4d47-a8de-d9aa96d05988 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.429s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:28:29 user nova-compute[71731]: DEBUG nova.compute.manager [None req-38f289b4-d3a1-4d47-a8de-d9aa96d05988 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] [instance: bf98c3a2-dbeb-4ae4-8423-ce55964c4258] Start building networks asynchronously for instance. {{(pid=71731) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 16:28:29 user nova-compute[71731]: DEBUG nova.compute.manager [None req-38f289b4-d3a1-4d47-a8de-d9aa96d05988 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] [instance: bf98c3a2-dbeb-4ae4-8423-ce55964c4258] Allocating IP information in the background. {{(pid=71731) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 16:28:29 user nova-compute[71731]: DEBUG nova.network.neutron [None req-38f289b4-d3a1-4d47-a8de-d9aa96d05988 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] [instance: bf98c3a2-dbeb-4ae4-8423-ce55964c4258] allocate_for_instance() {{(pid=71731) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 16:28:29 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-38f289b4-d3a1-4d47-a8de-d9aa96d05988 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] [instance: bf98c3a2-dbeb-4ae4-8423-ce55964c4258] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 16:28:29 user nova-compute[71731]: DEBUG nova.compute.manager [None req-38f289b4-d3a1-4d47-a8de-d9aa96d05988 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] [instance: bf98c3a2-dbeb-4ae4-8423-ce55964c4258] Start building block device mappings for instance. {{(pid=71731) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 16:28:29 user nova-compute[71731]: DEBUG nova.compute.manager [None req-38f289b4-d3a1-4d47-a8de-d9aa96d05988 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] [instance: bf98c3a2-dbeb-4ae4-8423-ce55964c4258] Start spawning the instance on the hypervisor. {{(pid=71731) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 16:28:29 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-38f289b4-d3a1-4d47-a8de-d9aa96d05988 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] [instance: bf98c3a2-dbeb-4ae4-8423-ce55964c4258] Creating instance directory {{(pid=71731) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 16:28:29 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-38f289b4-d3a1-4d47-a8de-d9aa96d05988 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] [instance: bf98c3a2-dbeb-4ae4-8423-ce55964c4258] Creating image(s)
Apr 13 16:28:29 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-38f289b4-d3a1-4d47-a8de-d9aa96d05988 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Acquiring lock "/opt/stack/data/nova/instances/bf98c3a2-dbeb-4ae4-8423-ce55964c4258/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:28:29 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-38f289b4-d3a1-4d47-a8de-d9aa96d05988 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Lock "/opt/stack/data/nova/instances/bf98c3a2-dbeb-4ae4-8423-ce55964c4258/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:28:29 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-38f289b4-d3a1-4d47-a8de-d9aa96d05988 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Lock "/opt/stack/data/nova/instances/bf98c3a2-dbeb-4ae4-8423-ce55964c4258/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.009s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:28:29 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-38f289b4-d3a1-4d47-a8de-d9aa96d05988 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279 --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:28:29 user nova-compute[71731]: DEBUG nova.policy [None req-38f289b4-d3a1-4d47-a8de-d9aa96d05988 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1318d817c48e40988e043fa33e908312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18e15bc7bee7466a840fb0d0e85d58bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71731) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 16:28:29 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-38f289b4-d3a1-4d47-a8de-d9aa96d05988 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279 --force-share --output=json" returned: 0 in 0.146s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:28:29 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-38f289b4-d3a1-4d47-a8de-d9aa96d05988 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Acquiring lock "9524227dd898575c3099d3976f096cd935414279" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:28:29 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-38f289b4-d3a1-4d47-a8de-d9aa96d05988 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Lock "9524227dd898575c3099d3976f096cd935414279" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:28:29 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-38f289b4-d3a1-4d47-a8de-d9aa96d05988 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279 --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:28:30 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-38f289b4-d3a1-4d47-a8de-d9aa96d05988 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279 --force-share --output=json" returned: 0 in 0.136s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:28:30 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-38f289b4-d3a1-4d47-a8de-d9aa96d05988 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279,backing_fmt=raw /opt/stack/data/nova/instances/bf98c3a2-dbeb-4ae4-8423-ce55964c4258/disk 1073741824 {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:28:30 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-38f289b4-d3a1-4d47-a8de-d9aa96d05988 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279,backing_fmt=raw /opt/stack/data/nova/instances/bf98c3a2-dbeb-4ae4-8423-ce55964c4258/disk 1073741824" returned: 0 in 0.074s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:28:30 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-38f289b4-d3a1-4d47-a8de-d9aa96d05988 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Lock "9524227dd898575c3099d3976f096cd935414279" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.216s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:28:30 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-38f289b4-d3a1-4d47-a8de-d9aa96d05988 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279 --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:28:30 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-38f289b4-d3a1-4d47-a8de-d9aa96d05988 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279 --force-share --output=json" returned: 0 in 0.155s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:28:30 user nova-compute[71731]: DEBUG nova.virt.disk.api [None req-38f289b4-d3a1-4d47-a8de-d9aa96d05988 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bf98c3a2-dbeb-4ae4-8423-ce55964c4258/disk. size=1073741824 {{(pid=71731) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 16:28:30 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-38f289b4-d3a1-4d47-a8de-d9aa96d05988 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf98c3a2-dbeb-4ae4-8423-ce55964c4258/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:28:30 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-38f289b4-d3a1-4d47-a8de-d9aa96d05988 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf98c3a2-dbeb-4ae4-8423-ce55964c4258/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:28:30 user nova-compute[71731]: DEBUG nova.virt.disk.api [None req-38f289b4-d3a1-4d47-a8de-d9aa96d05988 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Cannot resize image /opt/stack/data/nova/instances/bf98c3a2-dbeb-4ae4-8423-ce55964c4258/disk to a smaller size. {{(pid=71731) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 16:28:30 user nova-compute[71731]: DEBUG nova.objects.instance [None req-38f289b4-d3a1-4d47-a8de-d9aa96d05988 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Lazy-loading 'migration_context' on Instance uuid bf98c3a2-dbeb-4ae4-8423-ce55964c4258 {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:28:30 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-38f289b4-d3a1-4d47-a8de-d9aa96d05988 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] [instance: bf98c3a2-dbeb-4ae4-8423-ce55964c4258] Created local disks {{(pid=71731) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 16:28:30 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-38f289b4-d3a1-4d47-a8de-d9aa96d05988 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] [instance: bf98c3a2-dbeb-4ae4-8423-ce55964c4258] Ensure instance console log exists: /opt/stack/data/nova/instances/bf98c3a2-dbeb-4ae4-8423-ce55964c4258/console.log {{(pid=71731) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 16:28:30 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-38f289b4-d3a1-4d47-a8de-d9aa96d05988 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:28:30 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-38f289b4-d3a1-4d47-a8de-d9aa96d05988 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:28:30 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-38f289b4-d3a1-4d47-a8de-d9aa96d05988 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:28:30 user nova-compute[71731]: DEBUG nova.network.neutron [None req-38f289b4-d3a1-4d47-a8de-d9aa96d05988 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] [instance: bf98c3a2-dbeb-4ae4-8423-ce55964c4258] Successfully created port: 58361670-0371-4eb7-83b9-ce67bf2a67bb {{(pid=71731) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 16:28:30 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:28:31 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:28:31 user nova-compute[71731]: DEBUG nova.network.neutron [None req-38f289b4-d3a1-4d47-a8de-d9aa96d05988 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] [instance: bf98c3a2-dbeb-4ae4-8423-ce55964c4258] Successfully updated port: 58361670-0371-4eb7-83b9-ce67bf2a67bb {{(pid=71731) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 16:28:31 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-38f289b4-d3a1-4d47-a8de-d9aa96d05988 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Acquiring lock "refresh_cache-bf98c3a2-dbeb-4ae4-8423-ce55964c4258" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 16:28:31 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-38f289b4-d3a1-4d47-a8de-d9aa96d05988 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Acquired lock "refresh_cache-bf98c3a2-dbeb-4ae4-8423-ce55964c4258" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 16:28:31 user nova-compute[71731]: DEBUG nova.network.neutron [None req-38f289b4-d3a1-4d47-a8de-d9aa96d05988 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] [instance: bf98c3a2-dbeb-4ae4-8423-ce55964c4258] Building network info cache for instance {{(pid=71731) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 16:28:31 user nova-compute[71731]: DEBUG nova.compute.manager [req-4835f251-abe8-474b-aa7b-14f3c541a499 req-4375bed2-d51d-4ff4-b701-8d37c8d22f0f service nova] [instance: bf98c3a2-dbeb-4ae4-8423-ce55964c4258] Received event network-changed-58361670-0371-4eb7-83b9-ce67bf2a67bb {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:28:31 user nova-compute[71731]: DEBUG nova.compute.manager [req-4835f251-abe8-474b-aa7b-14f3c541a499 req-4375bed2-d51d-4ff4-b701-8d37c8d22f0f service nova] [instance: bf98c3a2-dbeb-4ae4-8423-ce55964c4258] Refreshing instance network info cache due to event network-changed-58361670-0371-4eb7-83b9-ce67bf2a67bb. {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 16:28:31 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-4835f251-abe8-474b-aa7b-14f3c541a499 req-4375bed2-d51d-4ff4-b701-8d37c8d22f0f service nova] Acquiring lock "refresh_cache-bf98c3a2-dbeb-4ae4-8423-ce55964c4258" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 16:28:31 user nova-compute[71731]: DEBUG nova.network.neutron [None req-38f289b4-d3a1-4d47-a8de-d9aa96d05988 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] [instance: bf98c3a2-dbeb-4ae4-8423-ce55964c4258] Instance cache missing network info. {{(pid=71731) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 16:28:32 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:28:32 user nova-compute[71731]: DEBUG nova.network.neutron [None req-38f289b4-d3a1-4d47-a8de-d9aa96d05988 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] [instance: bf98c3a2-dbeb-4ae4-8423-ce55964c4258] Updating instance_info_cache with network_info: [{"id": "58361670-0371-4eb7-83b9-ce67bf2a67bb", "address": "fa:16:3e:76:1a:b3", "network": {"id": "531e0c0e-c7aa-4a8c-b994-cf304d6e9089", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-897460632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18e15bc7bee7466a840fb0d0e85d58bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58361670-03", "ovs_interfaceid": "58361670-0371-4eb7-83b9-ce67bf2a67bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:28:32 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-38f289b4-d3a1-4d47-a8de-d9aa96d05988 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Releasing lock "refresh_cache-bf98c3a2-dbeb-4ae4-8423-ce55964c4258" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 16:28:32 user nova-compute[71731]: DEBUG nova.compute.manager [None req-38f289b4-d3a1-4d47-a8de-d9aa96d05988 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] [instance: bf98c3a2-dbeb-4ae4-8423-ce55964c4258] Instance network_info: |[{"id": "58361670-0371-4eb7-83b9-ce67bf2a67bb", "address": "fa:16:3e:76:1a:b3", "network": {"id": "531e0c0e-c7aa-4a8c-b994-cf304d6e9089", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-897460632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18e15bc7bee7466a840fb0d0e85d58bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58361670-03", "ovs_interfaceid": "58361670-0371-4eb7-83b9-ce67bf2a67bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71731) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 16:28:32 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-4835f251-abe8-474b-aa7b-14f3c541a499 req-4375bed2-d51d-4ff4-b701-8d37c8d22f0f service nova] Acquired lock "refresh_cache-bf98c3a2-dbeb-4ae4-8423-ce55964c4258" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 16:28:32 user nova-compute[71731]: DEBUG nova.network.neutron [req-4835f251-abe8-474b-aa7b-14f3c541a499 req-4375bed2-d51d-4ff4-b701-8d37c8d22f0f service nova] [instance: bf98c3a2-dbeb-4ae4-8423-ce55964c4258] Refreshing network info cache for port 58361670-0371-4eb7-83b9-ce67bf2a67bb {{(pid=71731) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 16:28:32 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-38f289b4-d3a1-4d47-a8de-d9aa96d05988 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] [instance: bf98c3a2-dbeb-4ae4-8423-ce55964c4258] Start _get_guest_xml network_info=[{"id": "58361670-0371-4eb7-83b9-ce67bf2a67bb", "address": "fa:16:3e:76:1a:b3", "network": {"id": "531e0c0e-c7aa-4a8c-b994-cf304d6e9089", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-897460632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18e15bc7bee7466a840fb0d0e85d58bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58361670-03", "ovs_interfaceid": "58361670-0371-4eb7-83b9-ce67bf2a67bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T16:16:31Z,direct_url=<?>,disk_format='qcow2',id=708622a9-7465-4492-ade8-b827198f7e30,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='0b29a975c552465aba0ac7d6288434bd',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T16:16:33Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'device_type': 'disk', 'encrypted': False, 'disk_bus': 'virtio', 'guest_format': None, 'encryption_options': None, 'image_id': '708622a9-7465-4492-ade8-b827198f7e30'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71731) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 16:28:32 user nova-compute[71731]: WARNING nova.virt.libvirt.driver [None req-38f289b4-d3a1-4d47-a8de-d9aa96d05988 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 16:28:32 user nova-compute[71731]: WARNING nova.virt.libvirt.driver [None req-38f289b4-d3a1-4d47-a8de-d9aa96d05988 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 16:28:32 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-38f289b4-d3a1-4d47-a8de-d9aa96d05988 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71731) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 16:28:32 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-38f289b4-d3a1-4d47-a8de-d9aa96d05988 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T16:17:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T16:16:31Z,direct_url=<?>,disk_format='qcow2',id=708622a9-7465-4492-ade8-b827198f7e30,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='0b29a975c552465aba0ac7d6288434bd',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T16:16:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 16:28:32 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-38f289b4-d3a1-4d47-a8de-d9aa96d05988 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Flavor limits 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 16:28:32 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-38f289b4-d3a1-4d47-a8de-d9aa96d05988 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Image limits 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 16:28:32 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-38f289b4-d3a1-4d47-a8de-d9aa96d05988 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Flavor pref 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 16:28:32 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-38f289b4-d3a1-4d47-a8de-d9aa96d05988 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Image pref 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 16:28:32 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-38f289b4-d3a1-4d47-a8de-d9aa96d05988 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 16:28:32 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-38f289b4-d3a1-4d47-a8de-d9aa96d05988 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 16:28:32 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-38f289b4-d3a1-4d47-a8de-d9aa96d05988 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71731) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 16:28:32 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-38f289b4-d3a1-4d47-a8de-d9aa96d05988 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Got 1 possible topologies {{(pid=71731) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 16:28:32 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-38f289b4-d3a1-4d47-a8de-d9aa96d05988 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 16:28:32 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-38f289b4-d3a1-4d47-a8de-d9aa96d05988 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 16:28:32 user nova-compute[71731]: DEBUG nova.virt.libvirt.vif [None req-38f289b4-d3a1-4d47-a8de-d9aa96d05988 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T16:28:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1023997191',display_name='tempest-SnapshotDataIntegrityTests-server-1023997191',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1023997191',id=22,image_ref='708622a9-7465-4492-ade8-b827198f7e30',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEWcfNxtsSrfqvopYusd+ZqI4KzA2ovArHxBPlxsew7LRP1txsdXHUeRRgEYzHNePmj25ZAs3NfqqgPBjo6KvTsbCCUknJjbmiyMs1ESu45VRGnYpt2phiwqtYQaA1tsdA==',key_name='tempest-SnapshotDataIntegrityTests-1768467450',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='18e15bc7bee7466a840fb0d0e85d58bd',ramdisk_id='',reservation_id='r-7hcnb6go',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='708622a9-7465-4492-ade8-b827198f7e30',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1801153584',owner_user_name='tempest-SnapshotDataIntegrityTests-1801153584-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T16:28:30Z,user_data=None,user_id='1318d817c48e40988e043fa33e908312',uuid=bf98c3a2-dbeb-4ae4-8423-ce55964c4258,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "58361670-0371-4eb7-83b9-ce67bf2a67bb", "address": "fa:16:3e:76:1a:b3", "network": {"id": "531e0c0e-c7aa-4a8c-b994-cf304d6e9089", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-897460632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18e15bc7bee7466a840fb0d0e85d58bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58361670-03", "ovs_interfaceid": "58361670-0371-4eb7-83b9-ce67bf2a67bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71731) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 16:28:32 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-38f289b4-d3a1-4d47-a8de-d9aa96d05988 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Converting VIF {"id": "58361670-0371-4eb7-83b9-ce67bf2a67bb", "address": "fa:16:3e:76:1a:b3", "network": {"id": "531e0c0e-c7aa-4a8c-b994-cf304d6e9089", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-897460632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18e15bc7bee7466a840fb0d0e85d58bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58361670-03", "ovs_interfaceid": "58361670-0371-4eb7-83b9-ce67bf2a67bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 16:28:32 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-38f289b4-d3a1-4d47-a8de-d9aa96d05988 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:76:1a:b3,bridge_name='br-int',has_traffic_filtering=True,id=58361670-0371-4eb7-83b9-ce67bf2a67bb,network=Network(531e0c0e-c7aa-4a8c-b994-cf304d6e9089),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58361670-03') {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 16:28:32 user nova-compute[71731]: DEBUG nova.objects.instance [None req-38f289b4-d3a1-4d47-a8de-d9aa96d05988 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Lazy-loading 'pci_devices' on Instance uuid bf98c3a2-dbeb-4ae4-8423-ce55964c4258 {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:28:32 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-38f289b4-d3a1-4d47-a8de-d9aa96d05988 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] [instance: bf98c3a2-dbeb-4ae4-8423-ce55964c4258] End _get_guest_xml xml=<domain type="kvm">
Apr 13 16:28:32 user nova-compute[71731]:   <uuid>bf98c3a2-dbeb-4ae4-8423-ce55964c4258</uuid>
Apr 13 16:28:32 user nova-compute[71731]:   <name>instance-00000016</name>
Apr 13 16:28:32 user nova-compute[71731]:   <memory>131072</memory>
Apr 13 16:28:32 user nova-compute[71731]:   <vcpu>1</vcpu>
Apr 13 16:28:32 user nova-compute[71731]:   <metadata>
Apr 13 16:28:32 user nova-compute[71731]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 16:28:32 user nova-compute[71731]:       <nova:package version="0.0.0"/>
Apr 13 16:28:32 user nova-compute[71731]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-1023997191</nova:name>
Apr 13 16:28:32 user nova-compute[71731]:       <nova:creationTime>2023-04-13 16:28:32</nova:creationTime>
Apr 13 16:28:32 user nova-compute[71731]:       <nova:flavor name="m1.nano">
Apr 13 16:28:32 user nova-compute[71731]:         <nova:memory>128</nova:memory>
Apr 13 16:28:32 user nova-compute[71731]:         <nova:disk>1</nova:disk>
Apr 13 16:28:32 user nova-compute[71731]:         <nova:swap>0</nova:swap>
Apr 13 16:28:32 user nova-compute[71731]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 16:28:32 user nova-compute[71731]:         <nova:vcpus>1</nova:vcpus>
Apr 13 16:28:32 user nova-compute[71731]:       </nova:flavor>
Apr 13 16:28:32 user nova-compute[71731]:       <nova:owner>
Apr 13 16:28:32 user nova-compute[71731]:         <nova:user uuid="1318d817c48e40988e043fa33e908312">tempest-SnapshotDataIntegrityTests-1801153584-project-member</nova:user>
Apr 13 16:28:32 user nova-compute[71731]:         <nova:project uuid="18e15bc7bee7466a840fb0d0e85d58bd">tempest-SnapshotDataIntegrityTests-1801153584</nova:project>
Apr 13 16:28:32 user nova-compute[71731]:       </nova:owner>
Apr 13 16:28:32 user nova-compute[71731]:       <nova:root type="image" uuid="708622a9-7465-4492-ade8-b827198f7e30"/>
Apr 13 16:28:32 user nova-compute[71731]:       <nova:ports>
Apr 13 16:28:32 user nova-compute[71731]:         <nova:port uuid="58361670-0371-4eb7-83b9-ce67bf2a67bb">
Apr 13 16:28:32 user nova-compute[71731]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Apr 13 16:28:32 user nova-compute[71731]:         </nova:port>
Apr 13 16:28:32 user nova-compute[71731]:       </nova:ports>
Apr 13 16:28:32 user nova-compute[71731]:     </nova:instance>
Apr 13 16:28:32 user nova-compute[71731]:   </metadata>
Apr 13 16:28:32 user nova-compute[71731]:   <sysinfo type="smbios">
Apr 13 16:28:32 user nova-compute[71731]:     <system>
Apr 13 16:28:32 user nova-compute[71731]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 16:28:32 user nova-compute[71731]:       <entry name="product">OpenStack Nova</entry>
Apr 13 16:28:32 user nova-compute[71731]:       <entry name="version">0.0.0</entry>
Apr 13 16:28:32 user nova-compute[71731]:       <entry name="serial">bf98c3a2-dbeb-4ae4-8423-ce55964c4258</entry>
Apr 13 16:28:32 user nova-compute[71731]:       <entry name="uuid">bf98c3a2-dbeb-4ae4-8423-ce55964c4258</entry>
Apr 13 16:28:32 user nova-compute[71731]:       <entry name="family">Virtual Machine</entry>
Apr 13 16:28:32 user nova-compute[71731]:     </system>
Apr 13 16:28:32 user nova-compute[71731]:   </sysinfo>
Apr 13 16:28:32 user nova-compute[71731]:   <os>
Apr 13 16:28:32 user nova-compute[71731]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 16:28:32 user nova-compute[71731]:     <boot dev="hd"/>
Apr 13 16:28:32 user nova-compute[71731]:     <smbios mode="sysinfo"/>
Apr 13 16:28:32 user nova-compute[71731]:   </os>
Apr 13 16:28:32 user nova-compute[71731]:   <features>
Apr 13 16:28:32 user nova-compute[71731]:     <acpi/>
Apr 13 16:28:32 user nova-compute[71731]:     <apic/>
Apr 13 16:28:32 user nova-compute[71731]:     <vmcoreinfo/>
Apr 13 16:28:32 user nova-compute[71731]:   </features>
Apr 13 16:28:32 user nova-compute[71731]:   <clock offset="utc">
Apr 13 16:28:32 user nova-compute[71731]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 16:28:32 user nova-compute[71731]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 16:28:32 user nova-compute[71731]:     <timer name="hpet" present="no"/>
Apr 13 16:28:32 user nova-compute[71731]:   </clock>
Apr 13 16:28:32 user nova-compute[71731]:   <cpu mode="custom" match="exact">
Apr 13 16:28:32 user nova-compute[71731]:     <model>Nehalem</model>
Apr 13 16:28:32 user nova-compute[71731]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 16:28:32 user nova-compute[71731]:   </cpu>
Apr 13 16:28:32 user nova-compute[71731]:   <devices>
Apr 13 16:28:32 user nova-compute[71731]:     <disk type="file" device="disk">
Apr 13 16:28:32 user nova-compute[71731]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 16:28:32 user nova-compute[71731]:       <source file="/opt/stack/data/nova/instances/bf98c3a2-dbeb-4ae4-8423-ce55964c4258/disk"/>
Apr 13 16:28:32 user nova-compute[71731]:       <target dev="vda" bus="virtio"/>
Apr 13 16:28:32 user nova-compute[71731]:     </disk>
Apr 13 16:28:32 user nova-compute[71731]:     <interface type="ethernet">
Apr 13 16:28:32 user nova-compute[71731]:       <mac address="fa:16:3e:76:1a:b3"/>
Apr 13 16:28:32 user nova-compute[71731]:       <model type="virtio"/>
Apr 13 16:28:32 user nova-compute[71731]:       <mtu size="1442"/>
Apr 13 16:28:32 user nova-compute[71731]:       <target dev="tap58361670-03"/>
Apr 13 16:28:32 user nova-compute[71731]:     </interface>
Apr 13 16:28:32 user nova-compute[71731]:     <serial type="pty">
Apr 13 16:28:32 user nova-compute[71731]:       <log file="/opt/stack/data/nova/instances/bf98c3a2-dbeb-4ae4-8423-ce55964c4258/console.log" append="off"/>
Apr 13 16:28:32 user nova-compute[71731]:     </serial>
Apr 13 16:28:32 user nova-compute[71731]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 16:28:32 user nova-compute[71731]:     <video>
Apr 13 16:28:32 user nova-compute[71731]:       <model type="virtio"/>
Apr 13 16:28:32 user nova-compute[71731]:     </video>
Apr 13 16:28:32 user nova-compute[71731]:     <rng model="virtio">
Apr 13 16:28:32 user nova-compute[71731]:       <backend model="random">/dev/urandom</backend>
Apr 13 16:28:32 user nova-compute[71731]:     </rng>
Apr 13 16:28:32 user nova-compute[71731]:     <controller type="usb" index="0" model="none"/>
Apr 13 16:28:32 user nova-compute[71731]:     <memballoon model="virtio">
Apr 13 16:28:32 user nova-compute[71731]:       <stats period="10"/>
Apr 13 16:28:32 user nova-compute[71731]:     </memballoon>
Apr 13 16:28:32 user nova-compute[71731]:   </devices>
Apr 13 16:28:32 user nova-compute[71731]: </domain>
Apr 13 16:28:32 user nova-compute[71731]:  {{(pid=71731) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 16:28:32 user nova-compute[71731]: DEBUG nova.virt.libvirt.vif [None req-38f289b4-d3a1-4d47-a8de-d9aa96d05988 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T16:28:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1023997191',display_name='tempest-SnapshotDataIntegrityTests-server-1023997191',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1023997191',id=22,image_ref='708622a9-7465-4492-ade8-b827198f7e30',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEWcfNxtsSrfqvopYusd+ZqI4KzA2ovArHxBPlxsew7LRP1txsdXHUeRRgEYzHNePmj25ZAs3NfqqgPBjo6KvTsbCCUknJjbmiyMs1ESu45VRGnYpt2phiwqtYQaA1tsdA==',key_name='tempest-SnapshotDataIntegrityTests-1768467450',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='18e15bc7bee7466a840fb0d0e85d58bd',ramdisk_id='',reservation_id='r-7hcnb6go',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='708622a9-7465-4492-ade8-b827198f7e30',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1801153584',owner_user_name='tempest-SnapshotDataIntegrityTests-1801153584-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T16:28:30Z,user_data=None,user_id='1318d817c48e40988e043fa33e908312',uuid=bf98c3a2-dbeb-4ae4-8423-ce55964c4258,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "58361670-0371-4eb7-83b9-ce67bf2a67bb", "address": "fa:16:3e:76:1a:b3", "network": {"id": "531e0c0e-c7aa-4a8c-b994-cf304d6e9089", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-897460632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18e15bc7bee7466a840fb0d0e85d58bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58361670-03", "ovs_interfaceid": "58361670-0371-4eb7-83b9-ce67bf2a67bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 16:28:32 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-38f289b4-d3a1-4d47-a8de-d9aa96d05988 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Converting VIF {"id": "58361670-0371-4eb7-83b9-ce67bf2a67bb", "address": "fa:16:3e:76:1a:b3", "network": {"id": "531e0c0e-c7aa-4a8c-b994-cf304d6e9089", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-897460632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18e15bc7bee7466a840fb0d0e85d58bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58361670-03", "ovs_interfaceid": "58361670-0371-4eb7-83b9-ce67bf2a67bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 16:28:32 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-38f289b4-d3a1-4d47-a8de-d9aa96d05988 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:76:1a:b3,bridge_name='br-int',has_traffic_filtering=True,id=58361670-0371-4eb7-83b9-ce67bf2a67bb,network=Network(531e0c0e-c7aa-4a8c-b994-cf304d6e9089),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58361670-03') {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 16:28:32 user nova-compute[71731]: DEBUG os_vif [None req-38f289b4-d3a1-4d47-a8de-d9aa96d05988 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:1a:b3,bridge_name='br-int',has_traffic_filtering=True,id=58361670-0371-4eb7-83b9-ce67bf2a67bb,network=Network(531e0c0e-c7aa-4a8c-b994-cf304d6e9089),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58361670-03') {{(pid=71731) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 16:28:32 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:28:32 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:28:32 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 16:28:32 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:28:32 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap58361670-03, may_exist=True) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:28:32 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap58361670-03, col_values=(('external_ids', {'iface-id': '58361670-0371-4eb7-83b9-ce67bf2a67bb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:76:1a:b3', 'vm-uuid': 'bf98c3a2-dbeb-4ae4-8423-ce55964c4258'}),)) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:28:32 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:28:32 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 16:28:32 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:28:32 user nova-compute[71731]: INFO os_vif [None req-38f289b4-d3a1-4d47-a8de-d9aa96d05988 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:1a:b3,bridge_name='br-int',has_traffic_filtering=True,id=58361670-0371-4eb7-83b9-ce67bf2a67bb,network=Network(531e0c0e-c7aa-4a8c-b994-cf304d6e9089),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58361670-03')
Apr 13 16:28:32 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-38f289b4-d3a1-4d47-a8de-d9aa96d05988 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] No BDM found with device name vda, not building metadata. {{(pid=71731) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 16:28:32 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-38f289b4-d3a1-4d47-a8de-d9aa96d05988 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] No VIF found with MAC fa:16:3e:76:1a:b3, not building metadata {{(pid=71731) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 16:28:33 user nova-compute[71731]: DEBUG nova.network.neutron [req-4835f251-abe8-474b-aa7b-14f3c541a499 req-4375bed2-d51d-4ff4-b701-8d37c8d22f0f service nova] [instance: bf98c3a2-dbeb-4ae4-8423-ce55964c4258] Updated VIF entry in instance network info cache for port 58361670-0371-4eb7-83b9-ce67bf2a67bb. {{(pid=71731) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 16:28:33 user nova-compute[71731]: DEBUG nova.network.neutron [req-4835f251-abe8-474b-aa7b-14f3c541a499 req-4375bed2-d51d-4ff4-b701-8d37c8d22f0f service nova] [instance: bf98c3a2-dbeb-4ae4-8423-ce55964c4258] Updating instance_info_cache with network_info: [{"id": "58361670-0371-4eb7-83b9-ce67bf2a67bb", "address": "fa:16:3e:76:1a:b3", "network": {"id": "531e0c0e-c7aa-4a8c-b994-cf304d6e9089", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-897460632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18e15bc7bee7466a840fb0d0e85d58bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58361670-03", "ovs_interfaceid": "58361670-0371-4eb7-83b9-ce67bf2a67bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:28:33 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-4835f251-abe8-474b-aa7b-14f3c541a499 req-4375bed2-d51d-4ff4-b701-8d37c8d22f0f service nova] Releasing lock "refresh_cache-bf98c3a2-dbeb-4ae4-8423-ce55964c4258" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 16:28:34 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:28:34 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:28:34 user nova-compute[71731]: DEBUG nova.compute.manager [req-5d24ac77-17ea-4f38-851c-885a3d0734d4 req-2f216627-78b2-434e-bf8d-4dbea0e17b31 service nova] [instance: bf98c3a2-dbeb-4ae4-8423-ce55964c4258] Received event network-vif-plugged-58361670-0371-4eb7-83b9-ce67bf2a67bb {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:28:34 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-5d24ac77-17ea-4f38-851c-885a3d0734d4 req-2f216627-78b2-434e-bf8d-4dbea0e17b31 service nova] Acquiring lock "bf98c3a2-dbeb-4ae4-8423-ce55964c4258-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:28:34 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-5d24ac77-17ea-4f38-851c-885a3d0734d4 req-2f216627-78b2-434e-bf8d-4dbea0e17b31 service nova] Lock "bf98c3a2-dbeb-4ae4-8423-ce55964c4258-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:28:34 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-5d24ac77-17ea-4f38-851c-885a3d0734d4 req-2f216627-78b2-434e-bf8d-4dbea0e17b31 service nova] Lock "bf98c3a2-dbeb-4ae4-8423-ce55964c4258-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:28:34 user nova-compute[71731]: DEBUG nova.compute.manager [req-5d24ac77-17ea-4f38-851c-885a3d0734d4 req-2f216627-78b2-434e-bf8d-4dbea0e17b31 service nova] [instance: bf98c3a2-dbeb-4ae4-8423-ce55964c4258] No waiting events found dispatching network-vif-plugged-58361670-0371-4eb7-83b9-ce67bf2a67bb {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:28:34 user nova-compute[71731]: WARNING nova.compute.manager [req-5d24ac77-17ea-4f38-851c-885a3d0734d4 req-2f216627-78b2-434e-bf8d-4dbea0e17b31 service nova] [instance: bf98c3a2-dbeb-4ae4-8423-ce55964c4258] Received unexpected event network-vif-plugged-58361670-0371-4eb7-83b9-ce67bf2a67bb for instance with vm_state building and task_state spawning.
Apr 13 16:28:34 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:28:34 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:28:34 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:28:34 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:28:36 user nova-compute[71731]: DEBUG nova.compute.manager [None req-38f289b4-d3a1-4d47-a8de-d9aa96d05988 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] [instance: bf98c3a2-dbeb-4ae4-8423-ce55964c4258] Instance event wait completed in 0 seconds for  {{(pid=71731) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 16:28:36 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-38f289b4-d3a1-4d47-a8de-d9aa96d05988 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] [instance: bf98c3a2-dbeb-4ae4-8423-ce55964c4258] Guest created on hypervisor {{(pid=71731) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 16:28:36 user nova-compute[71731]: DEBUG nova.virt.driver [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Emitting event <LifecycleEvent: 1681403316.4464931, bf98c3a2-dbeb-4ae4-8423-ce55964c4258 => Resumed> {{(pid=71731) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 16:28:36 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: bf98c3a2-dbeb-4ae4-8423-ce55964c4258] VM Resumed (Lifecycle Event)
Apr 13 16:28:36 user nova-compute[71731]: INFO nova.virt.libvirt.driver [-] [instance: bf98c3a2-dbeb-4ae4-8423-ce55964c4258] Instance spawned successfully.
Apr 13 16:28:36 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-38f289b4-d3a1-4d47-a8de-d9aa96d05988 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] [instance: bf98c3a2-dbeb-4ae4-8423-ce55964c4258] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 16:28:36 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-38f289b4-d3a1-4d47-a8de-d9aa96d05988 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] [instance: bf98c3a2-dbeb-4ae4-8423-ce55964c4258] Found default for hw_cdrom_bus of ide {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:28:36 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-38f289b4-d3a1-4d47-a8de-d9aa96d05988 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] [instance: bf98c3a2-dbeb-4ae4-8423-ce55964c4258] Found default for hw_disk_bus of virtio {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:28:36 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-38f289b4-d3a1-4d47-a8de-d9aa96d05988 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] [instance: bf98c3a2-dbeb-4ae4-8423-ce55964c4258] Found default for hw_input_bus of None {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:28:36 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-38f289b4-d3a1-4d47-a8de-d9aa96d05988 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] [instance: bf98c3a2-dbeb-4ae4-8423-ce55964c4258] Found default for hw_pointer_model of None {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:28:36 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-38f289b4-d3a1-4d47-a8de-d9aa96d05988 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] [instance: bf98c3a2-dbeb-4ae4-8423-ce55964c4258] Found default for hw_video_model of virtio {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:28:36 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-38f289b4-d3a1-4d47-a8de-d9aa96d05988 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] [instance: bf98c3a2-dbeb-4ae4-8423-ce55964c4258] Found default for hw_vif_model of virtio {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:28:36 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: bf98c3a2-dbeb-4ae4-8423-ce55964c4258] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:28:36 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: bf98c3a2-dbeb-4ae4-8423-ce55964c4258] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71731) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 16:28:36 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: bf98c3a2-dbeb-4ae4-8423-ce55964c4258] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 16:28:36 user nova-compute[71731]: DEBUG nova.virt.driver [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Emitting event <LifecycleEvent: 1681403316.4471061, bf98c3a2-dbeb-4ae4-8423-ce55964c4258 => Started> {{(pid=71731) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 16:28:36 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: bf98c3a2-dbeb-4ae4-8423-ce55964c4258] VM Started (Lifecycle Event)
Apr 13 16:28:36 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: bf98c3a2-dbeb-4ae4-8423-ce55964c4258] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:28:36 user nova-compute[71731]: INFO nova.compute.manager [None req-38f289b4-d3a1-4d47-a8de-d9aa96d05988 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] [instance: bf98c3a2-dbeb-4ae4-8423-ce55964c4258] Took 6.85 seconds to spawn the instance on the hypervisor.
Apr 13 16:28:36 user nova-compute[71731]: DEBUG nova.compute.manager [None req-38f289b4-d3a1-4d47-a8de-d9aa96d05988 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] [instance: bf98c3a2-dbeb-4ae4-8423-ce55964c4258] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:28:36 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: bf98c3a2-dbeb-4ae4-8423-ce55964c4258] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71731) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 16:28:36 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: bf98c3a2-dbeb-4ae4-8423-ce55964c4258] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 16:28:36 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:28:36 user nova-compute[71731]: DEBUG nova.compute.manager [req-259c3bfc-7f63-4488-b945-42a2b02dbd0c req-3c75fdc1-0c0b-46f6-a4d1-c4981e895e10 service nova] [instance: bf98c3a2-dbeb-4ae4-8423-ce55964c4258] Received event network-vif-plugged-58361670-0371-4eb7-83b9-ce67bf2a67bb {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:28:36 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-259c3bfc-7f63-4488-b945-42a2b02dbd0c req-3c75fdc1-0c0b-46f6-a4d1-c4981e895e10 service nova] Acquiring lock "bf98c3a2-dbeb-4ae4-8423-ce55964c4258-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:28:36 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-259c3bfc-7f63-4488-b945-42a2b02dbd0c req-3c75fdc1-0c0b-46f6-a4d1-c4981e895e10 service nova] Lock "bf98c3a2-dbeb-4ae4-8423-ce55964c4258-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:28:36 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-259c3bfc-7f63-4488-b945-42a2b02dbd0c req-3c75fdc1-0c0b-46f6-a4d1-c4981e895e10 service nova] Lock "bf98c3a2-dbeb-4ae4-8423-ce55964c4258-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:28:36 user nova-compute[71731]: DEBUG nova.compute.manager [req-259c3bfc-7f63-4488-b945-42a2b02dbd0c req-3c75fdc1-0c0b-46f6-a4d1-c4981e895e10 service nova] [instance: bf98c3a2-dbeb-4ae4-8423-ce55964c4258] No waiting events found dispatching network-vif-plugged-58361670-0371-4eb7-83b9-ce67bf2a67bb {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:28:36 user nova-compute[71731]: WARNING nova.compute.manager [req-259c3bfc-7f63-4488-b945-42a2b02dbd0c req-3c75fdc1-0c0b-46f6-a4d1-c4981e895e10 service nova] [instance: bf98c3a2-dbeb-4ae4-8423-ce55964c4258] Received unexpected event network-vif-plugged-58361670-0371-4eb7-83b9-ce67bf2a67bb for instance with vm_state building and task_state spawning.
Apr 13 16:28:36 user nova-compute[71731]: INFO nova.compute.manager [None req-38f289b4-d3a1-4d47-a8de-d9aa96d05988 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] [instance: bf98c3a2-dbeb-4ae4-8423-ce55964c4258] Took 7.68 seconds to build instance.
Apr 13 16:28:36 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-38f289b4-d3a1-4d47-a8de-d9aa96d05988 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Lock "bf98c3a2-dbeb-4ae4-8423-ce55964c4258" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.813s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:28:36 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:28:37 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:28:40 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:28:41 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:28:42 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:28:44 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-c38c07e1-2641-45b0-8a19-2ac6f0ca4df0 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Acquiring lock "32b18558-8bf2-4def-bc70-81c4e38fcc6f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:28:44 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-c38c07e1-2641-45b0-8a19-2ac6f0ca4df0 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Lock "32b18558-8bf2-4def-bc70-81c4e38fcc6f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:28:44 user nova-compute[71731]: DEBUG nova.compute.manager [None req-c38c07e1-2641-45b0-8a19-2ac6f0ca4df0 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] [instance: 32b18558-8bf2-4def-bc70-81c4e38fcc6f] Starting instance... {{(pid=71731) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 16:28:44 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-c38c07e1-2641-45b0-8a19-2ac6f0ca4df0 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:28:44 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-c38c07e1-2641-45b0-8a19-2ac6f0ca4df0 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:28:44 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-c38c07e1-2641-45b0-8a19-2ac6f0ca4df0 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71731) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 16:28:44 user nova-compute[71731]: INFO nova.compute.claims [None req-c38c07e1-2641-45b0-8a19-2ac6f0ca4df0 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] [instance: 32b18558-8bf2-4def-bc70-81c4e38fcc6f] Claim successful on node user
Apr 13 16:28:44 user nova-compute[71731]: DEBUG nova.compute.provider_tree [None req-c38c07e1-2641-45b0-8a19-2ac6f0ca4df0 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Inventory has not changed in ProviderTree for provider: cb6b1a64-0c24-4e2d-af1e-16576ca9165c {{(pid=71731) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 16:28:44 user nova-compute[71731]: DEBUG nova.scheduler.client.report [None req-c38c07e1-2641-45b0-8a19-2ac6f0ca4df0 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Inventory has not changed for provider cb6b1a64-0c24-4e2d-af1e-16576ca9165c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71731) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 16:28:44 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-c38c07e1-2641-45b0-8a19-2ac6f0ca4df0 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.421s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:28:44 user nova-compute[71731]: DEBUG nova.compute.manager [None req-c38c07e1-2641-45b0-8a19-2ac6f0ca4df0 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] [instance: 32b18558-8bf2-4def-bc70-81c4e38fcc6f] Start building networks asynchronously for instance. {{(pid=71731) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 16:28:44 user nova-compute[71731]: DEBUG nova.compute.manager [None req-c38c07e1-2641-45b0-8a19-2ac6f0ca4df0 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] [instance: 32b18558-8bf2-4def-bc70-81c4e38fcc6f] Allocating IP information in the background. {{(pid=71731) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 16:28:44 user nova-compute[71731]: DEBUG nova.network.neutron [None req-c38c07e1-2641-45b0-8a19-2ac6f0ca4df0 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] [instance: 32b18558-8bf2-4def-bc70-81c4e38fcc6f] allocate_for_instance() {{(pid=71731) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 16:28:44 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-c38c07e1-2641-45b0-8a19-2ac6f0ca4df0 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] [instance: 32b18558-8bf2-4def-bc70-81c4e38fcc6f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 16:28:45 user nova-compute[71731]: DEBUG nova.compute.manager [None req-c38c07e1-2641-45b0-8a19-2ac6f0ca4df0 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] [instance: 32b18558-8bf2-4def-bc70-81c4e38fcc6f] Start building block device mappings for instance. {{(pid=71731) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 16:28:45 user nova-compute[71731]: DEBUG nova.policy [None req-c38c07e1-2641-45b0-8a19-2ac6f0ca4df0 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f523740272844b6eb236477d0b116ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7100b359f341759cb6f6753e1539a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71731) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 16:28:45 user nova-compute[71731]: DEBUG nova.compute.manager [None req-c38c07e1-2641-45b0-8a19-2ac6f0ca4df0 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] [instance: 32b18558-8bf2-4def-bc70-81c4e38fcc6f] Start spawning the instance on the hypervisor. {{(pid=71731) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 16:28:45 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-c38c07e1-2641-45b0-8a19-2ac6f0ca4df0 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] [instance: 32b18558-8bf2-4def-bc70-81c4e38fcc6f] Creating instance directory {{(pid=71731) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 16:28:45 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-c38c07e1-2641-45b0-8a19-2ac6f0ca4df0 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] [instance: 32b18558-8bf2-4def-bc70-81c4e38fcc6f] Creating image(s)
Apr 13 16:28:45 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-c38c07e1-2641-45b0-8a19-2ac6f0ca4df0 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Acquiring lock "/opt/stack/data/nova/instances/32b18558-8bf2-4def-bc70-81c4e38fcc6f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:28:45 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-c38c07e1-2641-45b0-8a19-2ac6f0ca4df0 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Lock "/opt/stack/data/nova/instances/32b18558-8bf2-4def-bc70-81c4e38fcc6f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:28:45 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-c38c07e1-2641-45b0-8a19-2ac6f0ca4df0 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Lock "/opt/stack/data/nova/instances/32b18558-8bf2-4def-bc70-81c4e38fcc6f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.010s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:28:45 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-c38c07e1-2641-45b0-8a19-2ac6f0ca4df0 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279 --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:28:45 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-c38c07e1-2641-45b0-8a19-2ac6f0ca4df0 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279 --force-share --output=json" returned: 0 in 0.351s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:28:45 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-c38c07e1-2641-45b0-8a19-2ac6f0ca4df0 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Acquiring lock "9524227dd898575c3099d3976f096cd935414279" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:28:45 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-c38c07e1-2641-45b0-8a19-2ac6f0ca4df0 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Lock "9524227dd898575c3099d3976f096cd935414279" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:28:45 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-c38c07e1-2641-45b0-8a19-2ac6f0ca4df0 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279 --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:28:45 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-c38c07e1-2641-45b0-8a19-2ac6f0ca4df0 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279 --force-share --output=json" returned: 0 in 0.200s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:28:45 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-c38c07e1-2641-45b0-8a19-2ac6f0ca4df0 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279,backing_fmt=raw /opt/stack/data/nova/instances/32b18558-8bf2-4def-bc70-81c4e38fcc6f/disk 1073741824 {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:28:45 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-c38c07e1-2641-45b0-8a19-2ac6f0ca4df0 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279,backing_fmt=raw /opt/stack/data/nova/instances/32b18558-8bf2-4def-bc70-81c4e38fcc6f/disk 1073741824" returned: 0 in 0.052s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:28:45 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-c38c07e1-2641-45b0-8a19-2ac6f0ca4df0 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Lock "9524227dd898575c3099d3976f096cd935414279" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.260s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:28:45 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-c38c07e1-2641-45b0-8a19-2ac6f0ca4df0 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279 --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:28:45 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-c38c07e1-2641-45b0-8a19-2ac6f0ca4df0 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279 --force-share --output=json" returned: 0 in 0.143s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:28:45 user nova-compute[71731]: DEBUG nova.virt.disk.api [None req-c38c07e1-2641-45b0-8a19-2ac6f0ca4df0 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Checking if we can resize image /opt/stack/data/nova/instances/32b18558-8bf2-4def-bc70-81c4e38fcc6f/disk. size=1073741824 {{(pid=71731) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 16:28:45 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-c38c07e1-2641-45b0-8a19-2ac6f0ca4df0 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32b18558-8bf2-4def-bc70-81c4e38fcc6f/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:28:45 user nova-compute[71731]: DEBUG nova.network.neutron [None req-c38c07e1-2641-45b0-8a19-2ac6f0ca4df0 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] [instance: 32b18558-8bf2-4def-bc70-81c4e38fcc6f] Successfully created port: f9afb5f6-d601-4106-85c8-6d6179433f28 {{(pid=71731) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 16:28:46 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-c38c07e1-2641-45b0-8a19-2ac6f0ca4df0 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32b18558-8bf2-4def-bc70-81c4e38fcc6f/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:28:46 user nova-compute[71731]: DEBUG nova.virt.disk.api [None req-c38c07e1-2641-45b0-8a19-2ac6f0ca4df0 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Cannot resize image /opt/stack/data/nova/instances/32b18558-8bf2-4def-bc70-81c4e38fcc6f/disk to a smaller size. {{(pid=71731) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 16:28:46 user nova-compute[71731]: DEBUG nova.objects.instance [None req-c38c07e1-2641-45b0-8a19-2ac6f0ca4df0 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Lazy-loading 'migration_context' on Instance uuid 32b18558-8bf2-4def-bc70-81c4e38fcc6f {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:28:46 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-c38c07e1-2641-45b0-8a19-2ac6f0ca4df0 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] [instance: 32b18558-8bf2-4def-bc70-81c4e38fcc6f] Created local disks {{(pid=71731) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 16:28:46 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-c38c07e1-2641-45b0-8a19-2ac6f0ca4df0 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] [instance: 32b18558-8bf2-4def-bc70-81c4e38fcc6f] Ensure instance console log exists: /opt/stack/data/nova/instances/32b18558-8bf2-4def-bc70-81c4e38fcc6f/console.log {{(pid=71731) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 16:28:46 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-c38c07e1-2641-45b0-8a19-2ac6f0ca4df0 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:28:46 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-c38c07e1-2641-45b0-8a19-2ac6f0ca4df0 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:28:46 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-c38c07e1-2641-45b0-8a19-2ac6f0ca4df0 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:28:46 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:28:46 user nova-compute[71731]: DEBUG nova.network.neutron [None req-c38c07e1-2641-45b0-8a19-2ac6f0ca4df0 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] [instance: 32b18558-8bf2-4def-bc70-81c4e38fcc6f] Successfully updated port: f9afb5f6-d601-4106-85c8-6d6179433f28 {{(pid=71731) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 16:28:46 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-c38c07e1-2641-45b0-8a19-2ac6f0ca4df0 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Acquiring lock "refresh_cache-32b18558-8bf2-4def-bc70-81c4e38fcc6f" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 16:28:46 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-c38c07e1-2641-45b0-8a19-2ac6f0ca4df0 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Acquired lock "refresh_cache-32b18558-8bf2-4def-bc70-81c4e38fcc6f" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 16:28:46 user nova-compute[71731]: DEBUG nova.network.neutron [None req-c38c07e1-2641-45b0-8a19-2ac6f0ca4df0 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] [instance: 32b18558-8bf2-4def-bc70-81c4e38fcc6f] Building network info cache for instance {{(pid=71731) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 16:28:46 user nova-compute[71731]: DEBUG nova.compute.manager [req-3b05077a-d964-41d3-9a1c-eaf504bd7253 req-d74ce808-60ce-440f-bad7-b5c9135e6c7b service nova] [instance: 32b18558-8bf2-4def-bc70-81c4e38fcc6f] Received event network-changed-f9afb5f6-d601-4106-85c8-6d6179433f28 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:28:46 user nova-compute[71731]: DEBUG nova.compute.manager [req-3b05077a-d964-41d3-9a1c-eaf504bd7253 req-d74ce808-60ce-440f-bad7-b5c9135e6c7b service nova] [instance: 32b18558-8bf2-4def-bc70-81c4e38fcc6f] Refreshing instance network info cache due to event network-changed-f9afb5f6-d601-4106-85c8-6d6179433f28. {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 16:28:46 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-3b05077a-d964-41d3-9a1c-eaf504bd7253 req-d74ce808-60ce-440f-bad7-b5c9135e6c7b service nova] Acquiring lock "refresh_cache-32b18558-8bf2-4def-bc70-81c4e38fcc6f" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 16:28:46 user nova-compute[71731]: DEBUG nova.network.neutron [None req-c38c07e1-2641-45b0-8a19-2ac6f0ca4df0 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] [instance: 32b18558-8bf2-4def-bc70-81c4e38fcc6f] Instance cache missing network info. {{(pid=71731) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 16:28:47 user nova-compute[71731]: DEBUG nova.network.neutron [None req-c38c07e1-2641-45b0-8a19-2ac6f0ca4df0 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] [instance: 32b18558-8bf2-4def-bc70-81c4e38fcc6f] Updating instance_info_cache with network_info: [{"id": "f9afb5f6-d601-4106-85c8-6d6179433f28", "address": "fa:16:3e:72:0a:63", "network": {"id": "11386312-9ac6-4252-ab98-b3298a08599c", "bridge": "br-int", "label": "tempest-TestStampPattern-1747654565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb7100b359f341759cb6f6753e1539a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9afb5f6-d6", "ovs_interfaceid": "f9afb5f6-d601-4106-85c8-6d6179433f28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:28:47 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-c38c07e1-2641-45b0-8a19-2ac6f0ca4df0 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Releasing lock "refresh_cache-32b18558-8bf2-4def-bc70-81c4e38fcc6f" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 16:28:47 user nova-compute[71731]: DEBUG nova.compute.manager [None req-c38c07e1-2641-45b0-8a19-2ac6f0ca4df0 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] [instance: 32b18558-8bf2-4def-bc70-81c4e38fcc6f] Instance network_info: |[{"id": "f9afb5f6-d601-4106-85c8-6d6179433f28", "address": "fa:16:3e:72:0a:63", "network": {"id": "11386312-9ac6-4252-ab98-b3298a08599c", "bridge": "br-int", "label": "tempest-TestStampPattern-1747654565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb7100b359f341759cb6f6753e1539a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9afb5f6-d6", "ovs_interfaceid": "f9afb5f6-d601-4106-85c8-6d6179433f28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71731) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 16:28:47 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-3b05077a-d964-41d3-9a1c-eaf504bd7253 req-d74ce808-60ce-440f-bad7-b5c9135e6c7b service nova] Acquired lock "refresh_cache-32b18558-8bf2-4def-bc70-81c4e38fcc6f" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 16:28:47 user nova-compute[71731]: DEBUG nova.network.neutron [req-3b05077a-d964-41d3-9a1c-eaf504bd7253 req-d74ce808-60ce-440f-bad7-b5c9135e6c7b service nova] [instance: 32b18558-8bf2-4def-bc70-81c4e38fcc6f] Refreshing network info cache for port f9afb5f6-d601-4106-85c8-6d6179433f28 {{(pid=71731) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 16:28:47 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-c38c07e1-2641-45b0-8a19-2ac6f0ca4df0 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] [instance: 32b18558-8bf2-4def-bc70-81c4e38fcc6f] Start _get_guest_xml network_info=[{"id": "f9afb5f6-d601-4106-85c8-6d6179433f28", "address": "fa:16:3e:72:0a:63", "network": {"id": "11386312-9ac6-4252-ab98-b3298a08599c", "bridge": "br-int", "label": "tempest-TestStampPattern-1747654565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb7100b359f341759cb6f6753e1539a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9afb5f6-d6", "ovs_interfaceid": "f9afb5f6-d601-4106-85c8-6d6179433f28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T16:16:31Z,direct_url=<?>,disk_format='qcow2',id=708622a9-7465-4492-ade8-b827198f7e30,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='0b29a975c552465aba0ac7d6288434bd',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T16:16:33Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'device_type': 'disk', 'encrypted': False, 'disk_bus': 'virtio', 'guest_format': None, 'encryption_options': None, 'image_id': '708622a9-7465-4492-ade8-b827198f7e30'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71731) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 16:28:47 user nova-compute[71731]: WARNING nova.virt.libvirt.driver [None req-c38c07e1-2641-45b0-8a19-2ac6f0ca4df0 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 16:28:47 user nova-compute[71731]: WARNING nova.virt.libvirt.driver [None req-c38c07e1-2641-45b0-8a19-2ac6f0ca4df0 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 16:28:47 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-c38c07e1-2641-45b0-8a19-2ac6f0ca4df0 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71731) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 16:28:47 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-c38c07e1-2641-45b0-8a19-2ac6f0ca4df0 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T16:17:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T16:16:31Z,direct_url=<?>,disk_format='qcow2',id=708622a9-7465-4492-ade8-b827198f7e30,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='0b29a975c552465aba0ac7d6288434bd',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T16:16:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 16:28:47 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-c38c07e1-2641-45b0-8a19-2ac6f0ca4df0 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Flavor limits 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 16:28:47 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-c38c07e1-2641-45b0-8a19-2ac6f0ca4df0 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Image limits 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 16:28:47 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-c38c07e1-2641-45b0-8a19-2ac6f0ca4df0 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Flavor pref 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 16:28:47 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-c38c07e1-2641-45b0-8a19-2ac6f0ca4df0 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Image pref 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 16:28:47 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-c38c07e1-2641-45b0-8a19-2ac6f0ca4df0 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 16:28:47 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-c38c07e1-2641-45b0-8a19-2ac6f0ca4df0 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 16:28:47 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-c38c07e1-2641-45b0-8a19-2ac6f0ca4df0 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71731) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 16:28:47 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-c38c07e1-2641-45b0-8a19-2ac6f0ca4df0 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Got 1 possible topologies {{(pid=71731) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 16:28:47 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-c38c07e1-2641-45b0-8a19-2ac6f0ca4df0 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 16:28:47 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-c38c07e1-2641-45b0-8a19-2ac6f0ca4df0 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 16:28:47 user nova-compute[71731]: DEBUG nova.virt.libvirt.vif [None req-c38c07e1-2641-45b0-8a19-2ac6f0ca4df0 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T16:28:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1668766448',display_name='tempest-TestStampPattern-server-1668766448',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-teststamppattern-server-1668766448',id=23,image_ref='708622a9-7465-4492-ade8-b827198f7e30',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL2QPQmeuQ3QMNshoDoMdPG3OSftqyMCUtV3Pr6v+/rhaN+olW1hWBQn7y9Ew+sQSET4+DncPzqCVC4fuapQVvR4RUPvk9/ysi6s66mNzl8HmL0L6OHOtrjR4F2tcMOgTw==',key_name='tempest-TestStampPattern-792944514',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bb7100b359f341759cb6f6753e1539a8',ramdisk_id='',reservation_id='r-081plqh3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='708622a9-7465-4492-ade8-b827198f7e30',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-96878995',owner_user_name='tempest-TestStampPattern-96878995-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T16:28:45Z,user_data=None,user_id='f523740272844b6eb236477d0b116ddb',uuid=32b18558-8bf2-4def-bc70-81c4e38fcc6f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f9afb5f6-d601-4106-85c8-6d6179433f28", "address": "fa:16:3e:72:0a:63", "network": {"id": "11386312-9ac6-4252-ab98-b3298a08599c", "bridge": "br-int", "label": "tempest-TestStampPattern-1747654565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb7100b359f341759cb6f6753e1539a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9afb5f6-d6", "ovs_interfaceid": "f9afb5f6-d601-4106-85c8-6d6179433f28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71731) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 16:28:47 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-c38c07e1-2641-45b0-8a19-2ac6f0ca4df0 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Converting VIF {"id": "f9afb5f6-d601-4106-85c8-6d6179433f28", "address": "fa:16:3e:72:0a:63", "network": {"id": "11386312-9ac6-4252-ab98-b3298a08599c", "bridge": "br-int", "label": "tempest-TestStampPattern-1747654565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb7100b359f341759cb6f6753e1539a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9afb5f6-d6", "ovs_interfaceid": "f9afb5f6-d601-4106-85c8-6d6179433f28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 16:28:47 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-c38c07e1-2641-45b0-8a19-2ac6f0ca4df0 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:72:0a:63,bridge_name='br-int',has_traffic_filtering=True,id=f9afb5f6-d601-4106-85c8-6d6179433f28,network=Network(11386312-9ac6-4252-ab98-b3298a08599c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9afb5f6-d6') {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 16:28:47 user nova-compute[71731]: DEBUG nova.objects.instance [None req-c38c07e1-2641-45b0-8a19-2ac6f0ca4df0 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Lazy-loading 'pci_devices' on Instance uuid 32b18558-8bf2-4def-bc70-81c4e38fcc6f {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:28:47 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-c38c07e1-2641-45b0-8a19-2ac6f0ca4df0 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] [instance: 32b18558-8bf2-4def-bc70-81c4e38fcc6f] End _get_guest_xml xml=<domain type="kvm">
Apr 13 16:28:47 user nova-compute[71731]:   <uuid>32b18558-8bf2-4def-bc70-81c4e38fcc6f</uuid>
Apr 13 16:28:47 user nova-compute[71731]:   <name>instance-00000017</name>
Apr 13 16:28:47 user nova-compute[71731]:   <memory>131072</memory>
Apr 13 16:28:47 user nova-compute[71731]:   <vcpu>1</vcpu>
Apr 13 16:28:47 user nova-compute[71731]:   <metadata>
Apr 13 16:28:47 user nova-compute[71731]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 16:28:47 user nova-compute[71731]:       <nova:package version="0.0.0"/>
Apr 13 16:28:47 user nova-compute[71731]:       <nova:name>tempest-TestStampPattern-server-1668766448</nova:name>
Apr 13 16:28:47 user nova-compute[71731]:       <nova:creationTime>2023-04-13 16:28:47</nova:creationTime>
Apr 13 16:28:47 user nova-compute[71731]:       <nova:flavor name="m1.nano">
Apr 13 16:28:47 user nova-compute[71731]:         <nova:memory>128</nova:memory>
Apr 13 16:28:47 user nova-compute[71731]:         <nova:disk>1</nova:disk>
Apr 13 16:28:47 user nova-compute[71731]:         <nova:swap>0</nova:swap>
Apr 13 16:28:47 user nova-compute[71731]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 16:28:47 user nova-compute[71731]:         <nova:vcpus>1</nova:vcpus>
Apr 13 16:28:47 user nova-compute[71731]:       </nova:flavor>
Apr 13 16:28:47 user nova-compute[71731]:       <nova:owner>
Apr 13 16:28:47 user nova-compute[71731]:         <nova:user uuid="f523740272844b6eb236477d0b116ddb">tempest-TestStampPattern-96878995-project-member</nova:user>
Apr 13 16:28:47 user nova-compute[71731]:         <nova:project uuid="bb7100b359f341759cb6f6753e1539a8">tempest-TestStampPattern-96878995</nova:project>
Apr 13 16:28:47 user nova-compute[71731]:       </nova:owner>
Apr 13 16:28:47 user nova-compute[71731]:       <nova:root type="image" uuid="708622a9-7465-4492-ade8-b827198f7e30"/>
Apr 13 16:28:47 user nova-compute[71731]:       <nova:ports>
Apr 13 16:28:47 user nova-compute[71731]:         <nova:port uuid="f9afb5f6-d601-4106-85c8-6d6179433f28">
Apr 13 16:28:47 user nova-compute[71731]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Apr 13 16:28:47 user nova-compute[71731]:         </nova:port>
Apr 13 16:28:47 user nova-compute[71731]:       </nova:ports>
Apr 13 16:28:47 user nova-compute[71731]:     </nova:instance>
Apr 13 16:28:47 user nova-compute[71731]:   </metadata>
Apr 13 16:28:47 user nova-compute[71731]:   <sysinfo type="smbios">
Apr 13 16:28:47 user nova-compute[71731]:     <system>
Apr 13 16:28:47 user nova-compute[71731]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 16:28:47 user nova-compute[71731]:       <entry name="product">OpenStack Nova</entry>
Apr 13 16:28:47 user nova-compute[71731]:       <entry name="version">0.0.0</entry>
Apr 13 16:28:47 user nova-compute[71731]:       <entry name="serial">32b18558-8bf2-4def-bc70-81c4e38fcc6f</entry>
Apr 13 16:28:47 user nova-compute[71731]:       <entry name="uuid">32b18558-8bf2-4def-bc70-81c4e38fcc6f</entry>
Apr 13 16:28:47 user nova-compute[71731]:       <entry name="family">Virtual Machine</entry>
Apr 13 16:28:47 user nova-compute[71731]:     </system>
Apr 13 16:28:47 user nova-compute[71731]:   </sysinfo>
Apr 13 16:28:47 user nova-compute[71731]:   <os>
Apr 13 16:28:47 user nova-compute[71731]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 16:28:47 user nova-compute[71731]:     <boot dev="hd"/>
Apr 13 16:28:47 user nova-compute[71731]:     <smbios mode="sysinfo"/>
Apr 13 16:28:47 user nova-compute[71731]:   </os>
Apr 13 16:28:47 user nova-compute[71731]:   <features>
Apr 13 16:28:47 user nova-compute[71731]:     <acpi/>
Apr 13 16:28:47 user nova-compute[71731]:     <apic/>
Apr 13 16:28:47 user nova-compute[71731]:     <vmcoreinfo/>
Apr 13 16:28:47 user nova-compute[71731]:   </features>
Apr 13 16:28:47 user nova-compute[71731]:   <clock offset="utc">
Apr 13 16:28:47 user nova-compute[71731]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 16:28:47 user nova-compute[71731]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 16:28:47 user nova-compute[71731]:     <timer name="hpet" present="no"/>
Apr 13 16:28:47 user nova-compute[71731]:   </clock>
Apr 13 16:28:47 user nova-compute[71731]:   <cpu mode="custom" match="exact">
Apr 13 16:28:47 user nova-compute[71731]:     <model>Nehalem</model>
Apr 13 16:28:47 user nova-compute[71731]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 16:28:47 user nova-compute[71731]:   </cpu>
Apr 13 16:28:47 user nova-compute[71731]:   <devices>
Apr 13 16:28:47 user nova-compute[71731]:     <disk type="file" device="disk">
Apr 13 16:28:47 user nova-compute[71731]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 16:28:47 user nova-compute[71731]:       <source file="/opt/stack/data/nova/instances/32b18558-8bf2-4def-bc70-81c4e38fcc6f/disk"/>
Apr 13 16:28:47 user nova-compute[71731]:       <target dev="vda" bus="virtio"/>
Apr 13 16:28:47 user nova-compute[71731]:     </disk>
Apr 13 16:28:47 user nova-compute[71731]:     <interface type="ethernet">
Apr 13 16:28:47 user nova-compute[71731]:       <mac address="fa:16:3e:72:0a:63"/>
Apr 13 16:28:47 user nova-compute[71731]:       <model type="virtio"/>
Apr 13 16:28:47 user nova-compute[71731]:       <mtu size="1442"/>
Apr 13 16:28:47 user nova-compute[71731]:       <target dev="tapf9afb5f6-d6"/>
Apr 13 16:28:47 user nova-compute[71731]:     </interface>
Apr 13 16:28:47 user nova-compute[71731]:     <serial type="pty">
Apr 13 16:28:47 user nova-compute[71731]:       <log file="/opt/stack/data/nova/instances/32b18558-8bf2-4def-bc70-81c4e38fcc6f/console.log" append="off"/>
Apr 13 16:28:47 user nova-compute[71731]:     </serial>
Apr 13 16:28:47 user nova-compute[71731]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 16:28:47 user nova-compute[71731]:     <video>
Apr 13 16:28:47 user nova-compute[71731]:       <model type="virtio"/>
Apr 13 16:28:47 user nova-compute[71731]:     </video>
Apr 13 16:28:47 user nova-compute[71731]:     <rng model="virtio">
Apr 13 16:28:47 user nova-compute[71731]:       <backend model="random">/dev/urandom</backend>
Apr 13 16:28:47 user nova-compute[71731]:     </rng>
Apr 13 16:28:47 user nova-compute[71731]:     <controller type="usb" index="0" model="none"/>
Apr 13 16:28:47 user nova-compute[71731]:     <memballoon model="virtio">
Apr 13 16:28:47 user nova-compute[71731]:       <stats period="10"/>
Apr 13 16:28:47 user nova-compute[71731]:     </memballoon>
Apr 13 16:28:47 user nova-compute[71731]:   </devices>
Apr 13 16:28:47 user nova-compute[71731]: </domain>
Apr 13 16:28:47 user nova-compute[71731]:  {{(pid=71731) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 16:28:47 user nova-compute[71731]: DEBUG nova.virt.libvirt.vif [None req-c38c07e1-2641-45b0-8a19-2ac6f0ca4df0 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T16:28:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1668766448',display_name='tempest-TestStampPattern-server-1668766448',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-teststamppattern-server-1668766448',id=23,image_ref='708622a9-7465-4492-ade8-b827198f7e30',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL2QPQmeuQ3QMNshoDoMdPG3OSftqyMCUtV3Pr6v+/rhaN+olW1hWBQn7y9Ew+sQSET4+DncPzqCVC4fuapQVvR4RUPvk9/ysi6s66mNzl8HmL0L6OHOtrjR4F2tcMOgTw==',key_name='tempest-TestStampPattern-792944514',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bb7100b359f341759cb6f6753e1539a8',ramdisk_id='',reservation_id='r-081plqh3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='708622a9-7465-4492-ade8-b827198f7e30',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-96878995',owner_user_name='tempest-TestStampPattern-96878995-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T16:28:45Z,user_data=None,user_id='f523740272844b6eb236477d0b116ddb',uuid=32b18558-8bf2-4def-bc70-81c4e38fcc6f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f9afb5f6-d601-4106-85c8-6d6179433f28", "address": "fa:16:3e:72:0a:63", "network": {"id": "11386312-9ac6-4252-ab98-b3298a08599c", "bridge": "br-int", "label": "tempest-TestStampPattern-1747654565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb7100b359f341759cb6f6753e1539a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9afb5f6-d6", "ovs_interfaceid": "f9afb5f6-d601-4106-85c8-6d6179433f28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 16:28:47 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-c38c07e1-2641-45b0-8a19-2ac6f0ca4df0 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Converting VIF {"id": "f9afb5f6-d601-4106-85c8-6d6179433f28", "address": "fa:16:3e:72:0a:63", "network": {"id": "11386312-9ac6-4252-ab98-b3298a08599c", "bridge": "br-int", "label": "tempest-TestStampPattern-1747654565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb7100b359f341759cb6f6753e1539a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9afb5f6-d6", "ovs_interfaceid": "f9afb5f6-d601-4106-85c8-6d6179433f28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 16:28:47 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-c38c07e1-2641-45b0-8a19-2ac6f0ca4df0 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:72:0a:63,bridge_name='br-int',has_traffic_filtering=True,id=f9afb5f6-d601-4106-85c8-6d6179433f28,network=Network(11386312-9ac6-4252-ab98-b3298a08599c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9afb5f6-d6') {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 16:28:47 user nova-compute[71731]: DEBUG os_vif [None req-c38c07e1-2641-45b0-8a19-2ac6f0ca4df0 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:0a:63,bridge_name='br-int',has_traffic_filtering=True,id=f9afb5f6-d601-4106-85c8-6d6179433f28,network=Network(11386312-9ac6-4252-ab98-b3298a08599c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9afb5f6-d6') {{(pid=71731) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 16:28:47 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:28:47 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:28:47 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 16:28:47 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:28:47 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf9afb5f6-d6, may_exist=True) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:28:47 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf9afb5f6-d6, col_values=(('external_ids', {'iface-id': 'f9afb5f6-d601-4106-85c8-6d6179433f28', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:72:0a:63', 'vm-uuid': '32b18558-8bf2-4def-bc70-81c4e38fcc6f'}),)) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:28:47 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:28:47 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 16:28:47 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:28:47 user nova-compute[71731]: INFO os_vif [None req-c38c07e1-2641-45b0-8a19-2ac6f0ca4df0 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:0a:63,bridge_name='br-int',has_traffic_filtering=True,id=f9afb5f6-d601-4106-85c8-6d6179433f28,network=Network(11386312-9ac6-4252-ab98-b3298a08599c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9afb5f6-d6')
Apr 13 16:28:47 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-c38c07e1-2641-45b0-8a19-2ac6f0ca4df0 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] No BDM found with device name vda, not building metadata. {{(pid=71731) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 16:28:47 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-c38c07e1-2641-45b0-8a19-2ac6f0ca4df0 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] No VIF found with MAC fa:16:3e:72:0a:63, not building metadata {{(pid=71731) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 16:28:47 user nova-compute[71731]: DEBUG nova.network.neutron [req-3b05077a-d964-41d3-9a1c-eaf504bd7253 req-d74ce808-60ce-440f-bad7-b5c9135e6c7b service nova] [instance: 32b18558-8bf2-4def-bc70-81c4e38fcc6f] Updated VIF entry in instance network info cache for port f9afb5f6-d601-4106-85c8-6d6179433f28. {{(pid=71731) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 16:28:47 user nova-compute[71731]: DEBUG nova.network.neutron [req-3b05077a-d964-41d3-9a1c-eaf504bd7253 req-d74ce808-60ce-440f-bad7-b5c9135e6c7b service nova] [instance: 32b18558-8bf2-4def-bc70-81c4e38fcc6f] Updating instance_info_cache with network_info: [{"id": "f9afb5f6-d601-4106-85c8-6d6179433f28", "address": "fa:16:3e:72:0a:63", "network": {"id": "11386312-9ac6-4252-ab98-b3298a08599c", "bridge": "br-int", "label": "tempest-TestStampPattern-1747654565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb7100b359f341759cb6f6753e1539a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9afb5f6-d6", "ovs_interfaceid": "f9afb5f6-d601-4106-85c8-6d6179433f28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:28:47 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-3b05077a-d964-41d3-9a1c-eaf504bd7253 req-d74ce808-60ce-440f-bad7-b5c9135e6c7b service nova] Releasing lock "refresh_cache-32b18558-8bf2-4def-bc70-81c4e38fcc6f" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 16:28:48 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:28:48 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:28:48 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-90959a1e-1029-4303-89ae-1ebbc14087d7 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Acquiring lock "0f52d9e3-921c-4f79-9cdb-7d73500c8c35" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:28:48 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-90959a1e-1029-4303-89ae-1ebbc14087d7 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "0f52d9e3-921c-4f79-9cdb-7d73500c8c35" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:28:48 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-90959a1e-1029-4303-89ae-1ebbc14087d7 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Acquiring lock "0f52d9e3-921c-4f79-9cdb-7d73500c8c35-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:28:48 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-90959a1e-1029-4303-89ae-1ebbc14087d7 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "0f52d9e3-921c-4f79-9cdb-7d73500c8c35-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:28:48 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-90959a1e-1029-4303-89ae-1ebbc14087d7 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "0f52d9e3-921c-4f79-9cdb-7d73500c8c35-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:28:48 user nova-compute[71731]: INFO nova.compute.manager [None req-90959a1e-1029-4303-89ae-1ebbc14087d7 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 0f52d9e3-921c-4f79-9cdb-7d73500c8c35] Terminating instance
Apr 13 16:28:48 user nova-compute[71731]: DEBUG nova.compute.manager [None req-90959a1e-1029-4303-89ae-1ebbc14087d7 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 0f52d9e3-921c-4f79-9cdb-7d73500c8c35] Start destroying the instance on the hypervisor. {{(pid=71731) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 16:28:48 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:28:48 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:28:48 user nova-compute[71731]: DEBUG nova.compute.manager [req-bd6d6600-955f-4cd1-8d8d-1c14c97b9c11 req-db38f979-da7f-4ead-8e5f-a68cc2eec741 service nova] [instance: 32b18558-8bf2-4def-bc70-81c4e38fcc6f] Received event network-vif-plugged-f9afb5f6-d601-4106-85c8-6d6179433f28 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:28:48 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-bd6d6600-955f-4cd1-8d8d-1c14c97b9c11 req-db38f979-da7f-4ead-8e5f-a68cc2eec741 service nova] Acquiring lock "32b18558-8bf2-4def-bc70-81c4e38fcc6f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:28:48 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-bd6d6600-955f-4cd1-8d8d-1c14c97b9c11 req-db38f979-da7f-4ead-8e5f-a68cc2eec741 service nova] Lock "32b18558-8bf2-4def-bc70-81c4e38fcc6f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:28:48 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-bd6d6600-955f-4cd1-8d8d-1c14c97b9c11 req-db38f979-da7f-4ead-8e5f-a68cc2eec741 service nova] Lock "32b18558-8bf2-4def-bc70-81c4e38fcc6f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:28:48 user nova-compute[71731]: DEBUG nova.compute.manager [req-bd6d6600-955f-4cd1-8d8d-1c14c97b9c11 req-db38f979-da7f-4ead-8e5f-a68cc2eec741 service nova] [instance: 32b18558-8bf2-4def-bc70-81c4e38fcc6f] No waiting events found dispatching network-vif-plugged-f9afb5f6-d601-4106-85c8-6d6179433f28 {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:28:48 user nova-compute[71731]: WARNING nova.compute.manager [req-bd6d6600-955f-4cd1-8d8d-1c14c97b9c11 req-db38f979-da7f-4ead-8e5f-a68cc2eec741 service nova] [instance: 32b18558-8bf2-4def-bc70-81c4e38fcc6f] Received unexpected event network-vif-plugged-f9afb5f6-d601-4106-85c8-6d6179433f28 for instance with vm_state building and task_state spawning.
Apr 13 16:28:48 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-1e9a4262-6665-4e96-839e-b5a8009f095e tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Acquiring lock "650427bd-4dad-4bcd-922d-c17e60b36807" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:28:48 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-1e9a4262-6665-4e96-839e-b5a8009f095e tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lock "650427bd-4dad-4bcd-922d-c17e60b36807" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:28:49 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1e9a4262-6665-4e96-839e-b5a8009f095e tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: 650427bd-4dad-4bcd-922d-c17e60b36807] Starting instance... {{(pid=71731) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 16:28:49 user nova-compute[71731]: DEBUG nova.compute.manager [req-be44ecdd-e15e-4fa3-bb3e-d9c230266153 req-46a8fb3c-88f3-408a-bdda-779a27a17ba4 service nova] [instance: 0f52d9e3-921c-4f79-9cdb-7d73500c8c35] Received event network-vif-unplugged-d68dc4c7-5e6e-4d7f-8143-62eeb1816486 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:28:49 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-be44ecdd-e15e-4fa3-bb3e-d9c230266153 req-46a8fb3c-88f3-408a-bdda-779a27a17ba4 service nova] Acquiring lock "0f52d9e3-921c-4f79-9cdb-7d73500c8c35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:28:49 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-be44ecdd-e15e-4fa3-bb3e-d9c230266153 req-46a8fb3c-88f3-408a-bdda-779a27a17ba4 service nova] Lock "0f52d9e3-921c-4f79-9cdb-7d73500c8c35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:28:49 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-be44ecdd-e15e-4fa3-bb3e-d9c230266153 req-46a8fb3c-88f3-408a-bdda-779a27a17ba4 service nova] Lock "0f52d9e3-921c-4f79-9cdb-7d73500c8c35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:28:49 user nova-compute[71731]: DEBUG nova.compute.manager [req-be44ecdd-e15e-4fa3-bb3e-d9c230266153 req-46a8fb3c-88f3-408a-bdda-779a27a17ba4 service nova] [instance: 0f52d9e3-921c-4f79-9cdb-7d73500c8c35] No waiting events found dispatching network-vif-unplugged-d68dc4c7-5e6e-4d7f-8143-62eeb1816486 {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:28:49 user nova-compute[71731]: DEBUG nova.compute.manager [req-be44ecdd-e15e-4fa3-bb3e-d9c230266153 req-46a8fb3c-88f3-408a-bdda-779a27a17ba4 service nova] [instance: 0f52d9e3-921c-4f79-9cdb-7d73500c8c35] Received event network-vif-unplugged-d68dc4c7-5e6e-4d7f-8143-62eeb1816486 for instance with task_state deleting. {{(pid=71731) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 16:28:49 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-1e9a4262-6665-4e96-839e-b5a8009f095e tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:28:49 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-1e9a4262-6665-4e96-839e-b5a8009f095e tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:28:49 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-1e9a4262-6665-4e96-839e-b5a8009f095e tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71731) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 16:28:49 user nova-compute[71731]: INFO nova.compute.claims [None req-1e9a4262-6665-4e96-839e-b5a8009f095e tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: 650427bd-4dad-4bcd-922d-c17e60b36807] Claim successful on node user
Apr 13 16:28:49 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:28:49 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:28:49 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:28:49 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:28:49 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:28:49 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:28:49 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:28:49 user nova-compute[71731]: INFO nova.virt.libvirt.driver [-] [instance: 0f52d9e3-921c-4f79-9cdb-7d73500c8c35] Instance destroyed successfully.
Apr 13 16:28:49 user nova-compute[71731]: DEBUG nova.objects.instance [None req-90959a1e-1029-4303-89ae-1ebbc14087d7 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lazy-loading 'resources' on Instance uuid 0f52d9e3-921c-4f79-9cdb-7d73500c8c35 {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:28:49 user nova-compute[71731]: DEBUG nova.virt.libvirt.vif [None req-90959a1e-1029-4303-89ae-1ebbc14087d7 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T16:26:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1605197208',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1605197208',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1605197208',id=20,image_ref='02551df5-2d31-40a8-8d99-40af9cae089b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-13T16:27:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8d451e0e239f486aa2b3abe9e273eab3',ramdisk_id='',reservation_id='r-crrodjqz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-438786227',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-438786227-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-438786227',owner_user_name='tempest-TestVolumeBootPattern-438786227-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T16:27:15Z,user_data=None,user_id='d70e10f63cdd49a9a1ebe1fe4c9de0a2',uuid=0f52d9e3-921c-4f79-9cdb-7d73500c8c35,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d68dc4c7-5e6e-4d7f-8143-62eeb1816486", "address": "fa:16:3e:38:ee:28", "network": {"id": "d36bc206-f629-4d6e-8a3f-458061d7b525", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-893271134-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d451e0e239f486aa2b3abe9e273eab3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd68dc4c7-5e", "ovs_interfaceid": "d68dc4c7-5e6e-4d7f-8143-62eeb1816486", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 16:28:49 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-90959a1e-1029-4303-89ae-1ebbc14087d7 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Converting VIF {"id": "d68dc4c7-5e6e-4d7f-8143-62eeb1816486", "address": "fa:16:3e:38:ee:28", "network": {"id": "d36bc206-f629-4d6e-8a3f-458061d7b525", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-893271134-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d451e0e239f486aa2b3abe9e273eab3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd68dc4c7-5e", "ovs_interfaceid": "d68dc4c7-5e6e-4d7f-8143-62eeb1816486", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 16:28:49 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-90959a1e-1029-4303-89ae-1ebbc14087d7 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:38:ee:28,bridge_name='br-int',has_traffic_filtering=True,id=d68dc4c7-5e6e-4d7f-8143-62eeb1816486,network=Network(d36bc206-f629-4d6e-8a3f-458061d7b525),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd68dc4c7-5e') {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 16:28:49 user nova-compute[71731]: DEBUG os_vif [None req-90959a1e-1029-4303-89ae-1ebbc14087d7 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:ee:28,bridge_name='br-int',has_traffic_filtering=True,id=d68dc4c7-5e6e-4d7f-8143-62eeb1816486,network=Network(d36bc206-f629-4d6e-8a3f-458061d7b525),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd68dc4c7-5e') {{(pid=71731) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 16:28:49 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:28:49 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd68dc4c7-5e, bridge=br-int, if_exists=True) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:28:49 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:28:49 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 16:28:49 user nova-compute[71731]: INFO os_vif [None req-90959a1e-1029-4303-89ae-1ebbc14087d7 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:ee:28,bridge_name='br-int',has_traffic_filtering=True,id=d68dc4c7-5e6e-4d7f-8143-62eeb1816486,network=Network(d36bc206-f629-4d6e-8a3f-458061d7b525),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd68dc4c7-5e')
Apr 13 16:28:49 user nova-compute[71731]: DEBUG nova.virt.libvirt.volume.iscsi [None req-90959a1e-1029-4303-89ae-1ebbc14087d7 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 0f52d9e3-921c-4f79-9cdb-7d73500c8c35] calling os-brick to detach iSCSI Volume {{(pid=71731) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 16:28:49 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-90959a1e-1029-4303-89ae-1ebbc14087d7 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8cf0118790>, {'target_iqn': 'iqn.2010-10.org.openstack:f45c196f-e69b-4a40-8a72-2e5a3b2dbe82', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DSrgohBL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 16:28:49 user nova-compute[71731]: WARNING os_brick.initiator.connectors.base [None req-90959a1e-1029-4303-89ae-1ebbc14087d7 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 16:28:49 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-90959a1e-1029-4303-89ae-1ebbc14087d7 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 16:28:49 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-90959a1e-1029-4303-89ae-1ebbc14087d7 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 16:28:49 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:28:49 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.028s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:28:49 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[29bdefeb-333e-46b2-9d67-b6b4ad14d804]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e4317bfd-71c2-4c48-a0f0-e3c795f262a8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:eb2c60ec-fb52-436f-a98a-dfe15d1e3aa6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d53e720e-a9ca-499b-aacd-aad1a169a874\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f45c196f-e69b-4a40-8a72-2e5a3b2dbe82\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:28:49 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-90959a1e-1029-4303-89ae-1ebbc14087d7 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 16:28:49 user nova-compute[71731]: No targets found.
Apr 13 16:28:49 user nova-compute[71731]: iSNS:
Apr 13 16:28:49 user nova-compute[71731]: No targets found.
Apr 13 16:28:49 user nova-compute[71731]: STATIC:
Apr 13 16:28:49 user nova-compute[71731]: Target: iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97
Apr 13 16:28:49 user nova-compute[71731]:         Portal: 172.16.0.220:3260,-1
Apr 13 16:28:49 user nova-compute[71731]:                 Iface Name: default
Apr 13 16:28:49 user nova-compute[71731]: Target: iqn.2010-10.org.openstack:e4317bfd-71c2-4c48-a0f0-e3c795f262a8
Apr 13 16:28:49 user nova-compute[71731]:         Portal: 172.16.0.220:3260,-1
Apr 13 16:28:49 user nova-compute[71731]:                 Iface Name: default
Apr 13 16:28:49 user nova-compute[71731]: Target: iqn.2010-10.org.openstack:eb2c60ec-fb52-436f-a98a-dfe15d1e3aa6
Apr 13 16:28:49 user nova-compute[71731]:         Portal: 172.16.0.220:3260,-1
Apr 13 16:28:49 user nova-compute[71731]:                 Iface Name: default
Apr 13 16:28:49 user nova-compute[71731]: Target: iqn.2010-10.org.openstack:d53e720e-a9ca-499b-aacd-aad1a169a874
Apr 13 16:28:49 user nova-compute[71731]:         Portal: 172.16.0.220:3260,-1
Apr 13 16:28:49 user nova-compute[71731]:                 Iface Name: default
Apr 13 16:28:49 user nova-compute[71731]: Target: iqn.2010-10.org.openstack:f45c196f-e69b-4a40-8a72-2e5a3b2dbe82
Apr 13 16:28:49 user nova-compute[71731]:         Portal: 172.16.0.220:3260,-1
Apr 13 16:28:49 user nova-compute[71731]:                 Iface Name: default
Apr 13 16:28:49 user nova-compute[71731]: FIRMWARE:
Apr 13 16:28:49 user nova-compute[71731]: No targets found.
Apr 13 16:28:49 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 16:28:49 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-90959a1e-1029-4303-89ae-1ebbc14087d7 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 16:28:49 user nova-compute[71731]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 16:28:49 user nova-compute[71731]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71731) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 16:28:49 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-90959a1e-1029-4303-89ae-1ebbc14087d7 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f45c196f-e69b-4a40-8a72-2e5a3b2dbe82', 0)] {{(pid=71731) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 16:28:49 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:28:49 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:28:49 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[b616fced-1a00-4eae-ae81-0da600b1d321]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d53e720e-a9ca-499b-aacd-aad1a169a874\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e4317bfd-71c2-4c48-a0f0-e3c795f262a8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eb2c60ec-fb52-436f-a98a-dfe15d1e3aa6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f45c196f-e69b-4a40-8a72-2e5a3b2dbe82\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:28:49 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:28:49 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:28:49 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[488332ff-feaf-425b-b689-749acca04967]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4317bfd-71c2-4c48-a0f0-e3c795f262a8 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f45c196f-e69b-4a40-8a72-2e5a3b2dbe82 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d53e720e-a9ca-499b-aacd-aad1a169a874 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb2c60ec-fb52-436f-a98a-dfe15d1e3aa6 (non-flash)\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:28:49 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-90959a1e-1029-4303-89ae-1ebbc14087d7 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)
Apr 13 16:28:49 user nova-compute[71731]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4317bfd-71c2-4c48-a0f0-e3c795f262a8 (non-flash)
Apr 13 16:28:49 user nova-compute[71731]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f45c196f-e69b-4a40-8a72-2e5a3b2dbe82 (non-flash)
Apr 13 16:28:49 user nova-compute[71731]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d53e720e-a9ca-499b-aacd-aad1a169a874 (non-flash)
Apr 13 16:28:49 user nova-compute[71731]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb2c60ec-fb52-436f-a98a-dfe15d1e3aa6 (non-flash)
Apr 13 16:28:49 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 16:28:49 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-90959a1e-1029-4303-89ae-1ebbc14087d7 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)
Apr 13 16:28:49 user nova-compute[71731]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4317bfd-71c2-4c48-a0f0-e3c795f262a8 (non-flash)
Apr 13 16:28:49 user nova-compute[71731]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f45c196f-e69b-4a40-8a72-2e5a3b2dbe82 (non-flash)
Apr 13 16:28:49 user nova-compute[71731]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d53e720e-a9ca-499b-aacd-aad1a169a874 (non-flash)
Apr 13 16:28:49 user nova-compute[71731]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb2c60ec-fb52-436f-a98a-dfe15d1e3aa6 (non-flash)
Apr 13 16:28:49 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 16:28:49 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-90959a1e-1029-4303-89ae-1ebbc14087d7 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8cd0149120>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f45c196f-e69b-4a40-8a72-2e5a3b2dbe82'): ({'sdb'}, set())}) {{(pid=71731) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 16:28:49 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-90959a1e-1029-4303-89ae-1ebbc14087d7 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Removing single pathed devices sdb {{(pid=71731) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 16:28:49 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:28:49 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:28:49 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[027f9b7b-cfab-4800-9c78-b967fabac2f3]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:28:49 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:28:49 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:28:49 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ed80d7f-f22a-463d-8aa5-961feefdacdb]: (4, ('ok\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:28:49 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-90959a1e-1029-4303-89ae-1ebbc14087d7 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Flushing IO for device /dev/sdb {{(pid=71731) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 16:28:49 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:28:49 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:28:49 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cc2ece2-026e-48ef-9226-aad3a2c9a79f]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:28:49 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-90959a1e-1029-4303-89ae-1ebbc14087d7 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71731) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 16:28:49 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:28:49 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:28:49 user nova-compute[71731]: DEBUG nova.compute.provider_tree [None req-1e9a4262-6665-4e96-839e-b5a8009f095e tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Inventory has not changed in ProviderTree for provider: cb6b1a64-0c24-4e2d-af1e-16576ca9165c {{(pid=71731) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 16:28:49 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.057s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:28:49 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[d04e8276-f61f-42f5-bc1b-6abceea5a2f2]: (4, ('1', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:28:49 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-90959a1e-1029-4303-89ae-1ebbc14087d7 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71731) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 16:28:50 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-90959a1e-1029-4303-89ae-1ebbc14087d7 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] SCSI volumes sdb have been removed. {{(pid=71731) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 16:28:50 user nova-compute[71731]: DEBUG nova.scheduler.client.report [None req-1e9a4262-6665-4e96-839e-b5a8009f095e tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Inventory has not changed for provider cb6b1a64-0c24-4e2d-af1e-16576ca9165c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71731) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 16:28:50 user nova-compute[71731]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_b77d450', '/dev/disk/by-id/scsi-1SCST_BIOb77d450-3370ded5f2d2ef97', '/dev/disk/by-id/scsi-23333373064656435') {{(pid=81776) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Apr 13 16:28:50 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[dee7125c-605f-41bc-9d34-d79b5aa03036]: (4, None) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:28:50 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-90959a1e-1029-4303-89ae-1ebbc14087d7 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f45c196f-e69b-4a40-8a72-2e5a3b2dbe82')] {{(pid=71731) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 16:28:50 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f45c196f-e69b-4a40-8a72-2e5a3b2dbe82 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:28:50 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f45c196f-e69b-4a40-8a72-2e5a3b2dbe82 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.037s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:28:50 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea4f4b39-1cda-439d-a85d-d3df54d426f3]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:28:50 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-90959a1e-1029-4303-89ae-1ebbc14087d7 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:28:50 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f45c196f-e69b-4a40-8a72-2e5a3b2dbe82 -p 172.16.0.220:3260 --logout {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:28:50 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-1e9a4262-6665-4e96-839e-b5a8009f095e tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.992s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:28:50 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1e9a4262-6665-4e96-839e-b5a8009f095e tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: 650427bd-4dad-4bcd-922d-c17e60b36807] Start building networks asynchronously for instance. {{(pid=71731) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 16:28:50 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f45c196f-e69b-4a40-8a72-2e5a3b2dbe82 -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:28:50 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[b374b7d6-5040-4765-9377-78a18d161ddf]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:f45c196f-e69b-4a40-8a72-2e5a3b2dbe82, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:f45c196f-e69b-4a40-8a72-2e5a3b2dbe82, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:28:50 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-90959a1e-1029-4303-89ae-1ebbc14087d7 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:f45c196f-e69b-4a40-8a72-2e5a3b2dbe82, portal: 172.16.0.220,3260]
Apr 13 16:28:50 user nova-compute[71731]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:f45c196f-e69b-4a40-8a72-2e5a3b2dbe82, portal: 172.16.0.220,3260] successful.
Apr 13 16:28:50 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:28:50 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f45c196f-e69b-4a40-8a72-2e5a3b2dbe82 -p 172.16.0.220:3260 --op delete {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:28:50 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f45c196f-e69b-4a40-8a72-2e5a3b2dbe82 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:28:50 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9a233aa-9a64-42f7-a680-9bc59d45549a]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:28:50 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-90959a1e-1029-4303-89ae-1ebbc14087d7 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:28:50 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-90959a1e-1029-4303-89ae-1ebbc14087d7 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.413s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 16:28:50 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-90959a1e-1029-4303-89ae-1ebbc14087d7 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] <== disconnect_volume: return (415ms) None {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 16:28:50 user nova-compute[71731]: DEBUG nova.virt.libvirt.volume.iscsi [None req-90959a1e-1029-4303-89ae-1ebbc14087d7 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 0f52d9e3-921c-4f79-9cdb-7d73500c8c35] Disconnected iSCSI Volume {{(pid=71731) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 16:28:50 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-90959a1e-1029-4303-89ae-1ebbc14087d7 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 0f52d9e3-921c-4f79-9cdb-7d73500c8c35] Deleting instance files /opt/stack/data/nova/instances/0f52d9e3-921c-4f79-9cdb-7d73500c8c35_del
Apr 13 16:28:50 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-90959a1e-1029-4303-89ae-1ebbc14087d7 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 0f52d9e3-921c-4f79-9cdb-7d73500c8c35] Deletion of /opt/stack/data/nova/instances/0f52d9e3-921c-4f79-9cdb-7d73500c8c35_del complete
Apr 13 16:28:50 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1e9a4262-6665-4e96-839e-b5a8009f095e tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: 650427bd-4dad-4bcd-922d-c17e60b36807] Allocating IP information in the background. {{(pid=71731) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 16:28:50 user nova-compute[71731]: DEBUG nova.network.neutron [None req-1e9a4262-6665-4e96-839e-b5a8009f095e tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: 650427bd-4dad-4bcd-922d-c17e60b36807] allocate_for_instance() {{(pid=71731) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 16:28:50 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-1e9a4262-6665-4e96-839e-b5a8009f095e tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: 650427bd-4dad-4bcd-922d-c17e60b36807] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 16:28:50 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1e9a4262-6665-4e96-839e-b5a8009f095e tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: 650427bd-4dad-4bcd-922d-c17e60b36807] Start building block device mappings for instance. {{(pid=71731) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 16:28:50 user nova-compute[71731]: INFO nova.compute.manager [None req-90959a1e-1029-4303-89ae-1ebbc14087d7 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 0f52d9e3-921c-4f79-9cdb-7d73500c8c35] Took 1.51 seconds to destroy the instance on the hypervisor.
Apr 13 16:28:50 user nova-compute[71731]: DEBUG oslo.service.loopingcall [None req-90959a1e-1029-4303-89ae-1ebbc14087d7 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71731) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 16:28:50 user nova-compute[71731]: DEBUG nova.compute.manager [-] [instance: 0f52d9e3-921c-4f79-9cdb-7d73500c8c35] Deallocating network for instance {{(pid=71731) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 16:28:50 user nova-compute[71731]: DEBUG nova.network.neutron [-] [instance: 0f52d9e3-921c-4f79-9cdb-7d73500c8c35] deallocate_for_instance() {{(pid=71731) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 16:28:50 user nova-compute[71731]: DEBUG nova.policy [None req-1e9a4262-6665-4e96-839e-b5a8009f095e tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e45a882dbafb4ea4976e4f45289eb2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2d09a74bf684a9fb1dd1e95d6c23f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71731) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 16:28:50 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1e9a4262-6665-4e96-839e-b5a8009f095e tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: 650427bd-4dad-4bcd-922d-c17e60b36807] Start spawning the instance on the hypervisor. {{(pid=71731) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 16:28:50 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-1e9a4262-6665-4e96-839e-b5a8009f095e tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: 650427bd-4dad-4bcd-922d-c17e60b36807] Creating instance directory {{(pid=71731) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 16:28:50 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-1e9a4262-6665-4e96-839e-b5a8009f095e tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: 650427bd-4dad-4bcd-922d-c17e60b36807] Creating image(s)
Apr 13 16:28:50 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-1e9a4262-6665-4e96-839e-b5a8009f095e tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Acquiring lock "/opt/stack/data/nova/instances/650427bd-4dad-4bcd-922d-c17e60b36807/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:28:50 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-1e9a4262-6665-4e96-839e-b5a8009f095e tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lock "/opt/stack/data/nova/instances/650427bd-4dad-4bcd-922d-c17e60b36807/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:28:50 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-1e9a4262-6665-4e96-839e-b5a8009f095e tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lock "/opt/stack/data/nova/instances/650427bd-4dad-4bcd-922d-c17e60b36807/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:28:50 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-1e9a4262-6665-4e96-839e-b5a8009f095e tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279 --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:28:50 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-1e9a4262-6665-4e96-839e-b5a8009f095e tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279 --force-share --output=json" returned: 0 in 0.135s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:28:50 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-1e9a4262-6665-4e96-839e-b5a8009f095e tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Acquiring lock "9524227dd898575c3099d3976f096cd935414279" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:28:50 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-1e9a4262-6665-4e96-839e-b5a8009f095e tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lock "9524227dd898575c3099d3976f096cd935414279" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:28:50 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-1e9a4262-6665-4e96-839e-b5a8009f095e tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279 --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:28:50 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-1e9a4262-6665-4e96-839e-b5a8009f095e tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279 --force-share --output=json" returned: 0 in 0.141s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:28:50 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-1e9a4262-6665-4e96-839e-b5a8009f095e tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279,backing_fmt=raw /opt/stack/data/nova/instances/650427bd-4dad-4bcd-922d-c17e60b36807/disk 1073741824 {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:28:50 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-1e9a4262-6665-4e96-839e-b5a8009f095e tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279,backing_fmt=raw /opt/stack/data/nova/instances/650427bd-4dad-4bcd-922d-c17e60b36807/disk 1073741824" returned: 0 in 0.050s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:28:50 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-1e9a4262-6665-4e96-839e-b5a8009f095e tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lock "9524227dd898575c3099d3976f096cd935414279" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.200s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:28:50 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-1e9a4262-6665-4e96-839e-b5a8009f095e tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279 --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:28:50 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-1e9a4262-6665-4e96-839e-b5a8009f095e tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279 --force-share --output=json" returned: 0 in 0.139s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:28:50 user nova-compute[71731]: DEBUG nova.virt.disk.api [None req-1e9a4262-6665-4e96-839e-b5a8009f095e tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Checking if we can resize image /opt/stack/data/nova/instances/650427bd-4dad-4bcd-922d-c17e60b36807/disk. size=1073741824 {{(pid=71731) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 16:28:50 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-1e9a4262-6665-4e96-839e-b5a8009f095e tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/650427bd-4dad-4bcd-922d-c17e60b36807/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:28:51 user nova-compute[71731]: DEBUG nova.compute.manager [req-1fa43090-5ade-421c-87d0-dbd58c606df4 req-b8943f07-27f4-4de2-81bc-f608e150dbd7 service nova] [instance: 32b18558-8bf2-4def-bc70-81c4e38fcc6f] Received event network-vif-plugged-f9afb5f6-d601-4106-85c8-6d6179433f28 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:28:51 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-1fa43090-5ade-421c-87d0-dbd58c606df4 req-b8943f07-27f4-4de2-81bc-f608e150dbd7 service nova] Acquiring lock "32b18558-8bf2-4def-bc70-81c4e38fcc6f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:28:51 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-1fa43090-5ade-421c-87d0-dbd58c606df4 req-b8943f07-27f4-4de2-81bc-f608e150dbd7 service nova] Lock "32b18558-8bf2-4def-bc70-81c4e38fcc6f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:28:51 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-1fa43090-5ade-421c-87d0-dbd58c606df4 req-b8943f07-27f4-4de2-81bc-f608e150dbd7 service nova] Lock "32b18558-8bf2-4def-bc70-81c4e38fcc6f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:28:51 user nova-compute[71731]: DEBUG nova.compute.manager [req-1fa43090-5ade-421c-87d0-dbd58c606df4 req-b8943f07-27f4-4de2-81bc-f608e150dbd7 service nova] [instance: 32b18558-8bf2-4def-bc70-81c4e38fcc6f] No waiting events found dispatching network-vif-plugged-f9afb5f6-d601-4106-85c8-6d6179433f28 {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:28:51 user nova-compute[71731]: WARNING nova.compute.manager [req-1fa43090-5ade-421c-87d0-dbd58c606df4 req-b8943f07-27f4-4de2-81bc-f608e150dbd7 service nova] [instance: 32b18558-8bf2-4def-bc70-81c4e38fcc6f] Received unexpected event network-vif-plugged-f9afb5f6-d601-4106-85c8-6d6179433f28 for instance with vm_state building and task_state spawning.
Apr 13 16:28:51 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-1e9a4262-6665-4e96-839e-b5a8009f095e tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/650427bd-4dad-4bcd-922d-c17e60b36807/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:28:51 user nova-compute[71731]: DEBUG nova.virt.disk.api [None req-1e9a4262-6665-4e96-839e-b5a8009f095e tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Cannot resize image /opt/stack/data/nova/instances/650427bd-4dad-4bcd-922d-c17e60b36807/disk to a smaller size. {{(pid=71731) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 16:28:51 user nova-compute[71731]: DEBUG nova.objects.instance [None req-1e9a4262-6665-4e96-839e-b5a8009f095e tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lazy-loading 'migration_context' on Instance uuid 650427bd-4dad-4bcd-922d-c17e60b36807 {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:28:51 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-1e9a4262-6665-4e96-839e-b5a8009f095e tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: 650427bd-4dad-4bcd-922d-c17e60b36807] Created local disks {{(pid=71731) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 16:28:51 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-1e9a4262-6665-4e96-839e-b5a8009f095e tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: 650427bd-4dad-4bcd-922d-c17e60b36807] Ensure instance console log exists: /opt/stack/data/nova/instances/650427bd-4dad-4bcd-922d-c17e60b36807/console.log {{(pid=71731) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 16:28:51 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-1e9a4262-6665-4e96-839e-b5a8009f095e tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:28:51 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-1e9a4262-6665-4e96-839e-b5a8009f095e tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:28:51 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-1e9a4262-6665-4e96-839e-b5a8009f095e tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:28:51 user nova-compute[71731]: DEBUG nova.network.neutron [-] [instance: 0f52d9e3-921c-4f79-9cdb-7d73500c8c35] Updating instance_info_cache with network_info: [] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:28:51 user nova-compute[71731]: INFO nova.compute.manager [-] [instance: 0f52d9e3-921c-4f79-9cdb-7d73500c8c35] Took 0.83 seconds to deallocate network for instance.
Apr 13 16:28:51 user nova-compute[71731]: DEBUG nova.virt.driver [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Emitting event <LifecycleEvent: 1681403331.0874317, 32b18558-8bf2-4def-bc70-81c4e38fcc6f => Resumed> {{(pid=71731) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 16:28:51 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 32b18558-8bf2-4def-bc70-81c4e38fcc6f] VM Resumed (Lifecycle Event)
Apr 13 16:28:51 user nova-compute[71731]: DEBUG nova.compute.manager [None req-c38c07e1-2641-45b0-8a19-2ac6f0ca4df0 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] [instance: 32b18558-8bf2-4def-bc70-81c4e38fcc6f] Instance event wait completed in 0 seconds for  {{(pid=71731) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 16:28:51 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-c38c07e1-2641-45b0-8a19-2ac6f0ca4df0 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] [instance: 32b18558-8bf2-4def-bc70-81c4e38fcc6f] Guest created on hypervisor {{(pid=71731) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 16:28:51 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 32b18558-8bf2-4def-bc70-81c4e38fcc6f] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:28:51 user nova-compute[71731]: INFO nova.virt.libvirt.driver [-] [instance: 32b18558-8bf2-4def-bc70-81c4e38fcc6f] Instance spawned successfully.
Apr 13 16:28:51 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-c38c07e1-2641-45b0-8a19-2ac6f0ca4df0 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] [instance: 32b18558-8bf2-4def-bc70-81c4e38fcc6f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 16:28:51 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 32b18558-8bf2-4def-bc70-81c4e38fcc6f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71731) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 16:28:51 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 32b18558-8bf2-4def-bc70-81c4e38fcc6f] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 16:28:51 user nova-compute[71731]: DEBUG nova.virt.driver [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Emitting event <LifecycleEvent: 1681403331.0899096, 32b18558-8bf2-4def-bc70-81c4e38fcc6f => Started> {{(pid=71731) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 16:28:51 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 32b18558-8bf2-4def-bc70-81c4e38fcc6f] VM Started (Lifecycle Event)
Apr 13 16:28:51 user nova-compute[71731]: DEBUG nova.compute.manager [req-8ceb01fa-6ba5-4edb-9ac9-47b670ceddcf req-97b01042-4ea9-4560-aefb-0507c639b1fd service nova] [instance: 0f52d9e3-921c-4f79-9cdb-7d73500c8c35] Received event network-vif-plugged-d68dc4c7-5e6e-4d7f-8143-62eeb1816486 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:28:51 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-8ceb01fa-6ba5-4edb-9ac9-47b670ceddcf req-97b01042-4ea9-4560-aefb-0507c639b1fd service nova] Acquiring lock "0f52d9e3-921c-4f79-9cdb-7d73500c8c35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:28:51 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-8ceb01fa-6ba5-4edb-9ac9-47b670ceddcf req-97b01042-4ea9-4560-aefb-0507c639b1fd service nova] Lock "0f52d9e3-921c-4f79-9cdb-7d73500c8c35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:28:51 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-8ceb01fa-6ba5-4edb-9ac9-47b670ceddcf req-97b01042-4ea9-4560-aefb-0507c639b1fd service nova] Lock "0f52d9e3-921c-4f79-9cdb-7d73500c8c35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:28:51 user nova-compute[71731]: DEBUG nova.compute.manager [req-8ceb01fa-6ba5-4edb-9ac9-47b670ceddcf req-97b01042-4ea9-4560-aefb-0507c639b1fd service nova] [instance: 0f52d9e3-921c-4f79-9cdb-7d73500c8c35] No waiting events found dispatching network-vif-plugged-d68dc4c7-5e6e-4d7f-8143-62eeb1816486 {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:28:51 user nova-compute[71731]: WARNING nova.compute.manager [req-8ceb01fa-6ba5-4edb-9ac9-47b670ceddcf req-97b01042-4ea9-4560-aefb-0507c639b1fd service nova] [instance: 0f52d9e3-921c-4f79-9cdb-7d73500c8c35] Received unexpected event network-vif-plugged-d68dc4c7-5e6e-4d7f-8143-62eeb1816486 for instance with vm_state active and task_state deleting.
Apr 13 16:28:51 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-c38c07e1-2641-45b0-8a19-2ac6f0ca4df0 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] [instance: 32b18558-8bf2-4def-bc70-81c4e38fcc6f] Found default for hw_cdrom_bus of ide {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:28:51 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-c38c07e1-2641-45b0-8a19-2ac6f0ca4df0 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] [instance: 32b18558-8bf2-4def-bc70-81c4e38fcc6f] Found default for hw_disk_bus of virtio {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:28:51 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-c38c07e1-2641-45b0-8a19-2ac6f0ca4df0 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] [instance: 32b18558-8bf2-4def-bc70-81c4e38fcc6f] Found default for hw_input_bus of None {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:28:51 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-c38c07e1-2641-45b0-8a19-2ac6f0ca4df0 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] [instance: 32b18558-8bf2-4def-bc70-81c4e38fcc6f] Found default for hw_pointer_model of None {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:28:51 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-c38c07e1-2641-45b0-8a19-2ac6f0ca4df0 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] [instance: 32b18558-8bf2-4def-bc70-81c4e38fcc6f] Found default for hw_video_model of virtio {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:28:51 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-c38c07e1-2641-45b0-8a19-2ac6f0ca4df0 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] [instance: 32b18558-8bf2-4def-bc70-81c4e38fcc6f] Found default for hw_vif_model of virtio {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:28:51 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 32b18558-8bf2-4def-bc70-81c4e38fcc6f] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:28:51 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 32b18558-8bf2-4def-bc70-81c4e38fcc6f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71731) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 16:28:51 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 32b18558-8bf2-4def-bc70-81c4e38fcc6f] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 16:28:51 user nova-compute[71731]: INFO nova.compute.manager [None req-c38c07e1-2641-45b0-8a19-2ac6f0ca4df0 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] [instance: 32b18558-8bf2-4def-bc70-81c4e38fcc6f] Took 6.13 seconds to spawn the instance on the hypervisor.
Apr 13 16:28:51 user nova-compute[71731]: DEBUG nova.compute.manager [None req-c38c07e1-2641-45b0-8a19-2ac6f0ca4df0 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] [instance: 32b18558-8bf2-4def-bc70-81c4e38fcc6f] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:28:51 user nova-compute[71731]: DEBUG nova.network.neutron [None req-1e9a4262-6665-4e96-839e-b5a8009f095e tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: 650427bd-4dad-4bcd-922d-c17e60b36807] Successfully created port: c6fe8d62-f2ba-44d6-a5e3-da6f35679b3f {{(pid=71731) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 16:28:51 user nova-compute[71731]: INFO nova.compute.manager [None req-c38c07e1-2641-45b0-8a19-2ac6f0ca4df0 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] [instance: 32b18558-8bf2-4def-bc70-81c4e38fcc6f] Took 6.88 seconds to build instance.
Apr 13 16:28:51 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-c38c07e1-2641-45b0-8a19-2ac6f0ca4df0 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Lock "32b18558-8bf2-4def-bc70-81c4e38fcc6f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.987s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:28:51 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:28:51 user nova-compute[71731]: INFO nova.compute.manager [None req-90959a1e-1029-4303-89ae-1ebbc14087d7 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 0f52d9e3-921c-4f79-9cdb-7d73500c8c35] Took 0.87 seconds to detach 1 volumes for instance.
Apr 13 16:28:51 user nova-compute[71731]: DEBUG nova.compute.manager [None req-90959a1e-1029-4303-89ae-1ebbc14087d7 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 0f52d9e3-921c-4f79-9cdb-7d73500c8c35] Deleting volume: f45c196f-e69b-4a40-8a72-2e5a3b2dbe82 {{(pid=71731) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3202}}
Apr 13 16:28:51 user nova-compute[71731]: DEBUG nova.network.neutron [None req-1e9a4262-6665-4e96-839e-b5a8009f095e tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: 650427bd-4dad-4bcd-922d-c17e60b36807] Successfully updated port: c6fe8d62-f2ba-44d6-a5e3-da6f35679b3f {{(pid=71731) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 16:28:52 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-1e9a4262-6665-4e96-839e-b5a8009f095e tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Acquiring lock "refresh_cache-650427bd-4dad-4bcd-922d-c17e60b36807" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 16:28:52 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-1e9a4262-6665-4e96-839e-b5a8009f095e tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Acquired lock "refresh_cache-650427bd-4dad-4bcd-922d-c17e60b36807" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 16:28:52 user nova-compute[71731]: DEBUG nova.network.neutron [None req-1e9a4262-6665-4e96-839e-b5a8009f095e tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: 650427bd-4dad-4bcd-922d-c17e60b36807] Building network info cache for instance {{(pid=71731) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 16:28:52 user nova-compute[71731]: DEBUG nova.network.neutron [None req-1e9a4262-6665-4e96-839e-b5a8009f095e tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: 650427bd-4dad-4bcd-922d-c17e60b36807] Instance cache missing network info. {{(pid=71731) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 16:28:52 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-90959a1e-1029-4303-89ae-1ebbc14087d7 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:28:52 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-90959a1e-1029-4303-89ae-1ebbc14087d7 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:28:52 user nova-compute[71731]: DEBUG nova.network.neutron [None req-1e9a4262-6665-4e96-839e-b5a8009f095e tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: 650427bd-4dad-4bcd-922d-c17e60b36807] Updating instance_info_cache with network_info: [{"id": "c6fe8d62-f2ba-44d6-a5e3-da6f35679b3f", "address": "fa:16:3e:01:40:5b", "network": {"id": "5a7877ff-8230-470b-90b5-e5dcfc8f0cee", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-779403873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2d09a74bf684a9fb1dd1e95d6c23f3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6fe8d62-f2", "ovs_interfaceid": "c6fe8d62-f2ba-44d6-a5e3-da6f35679b3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:28:52 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-1e9a4262-6665-4e96-839e-b5a8009f095e tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Releasing lock "refresh_cache-650427bd-4dad-4bcd-922d-c17e60b36807" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 16:28:52 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1e9a4262-6665-4e96-839e-b5a8009f095e tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: 650427bd-4dad-4bcd-922d-c17e60b36807] Instance network_info: |[{"id": "c6fe8d62-f2ba-44d6-a5e3-da6f35679b3f", "address": "fa:16:3e:01:40:5b", "network": {"id": "5a7877ff-8230-470b-90b5-e5dcfc8f0cee", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-779403873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2d09a74bf684a9fb1dd1e95d6c23f3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6fe8d62-f2", "ovs_interfaceid": "c6fe8d62-f2ba-44d6-a5e3-da6f35679b3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71731) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 16:28:52 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-1e9a4262-6665-4e96-839e-b5a8009f095e tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: 650427bd-4dad-4bcd-922d-c17e60b36807] Start _get_guest_xml network_info=[{"id": "c6fe8d62-f2ba-44d6-a5e3-da6f35679b3f", "address": "fa:16:3e:01:40:5b", "network": {"id": "5a7877ff-8230-470b-90b5-e5dcfc8f0cee", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-779403873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2d09a74bf684a9fb1dd1e95d6c23f3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6fe8d62-f2", "ovs_interfaceid": "c6fe8d62-f2ba-44d6-a5e3-da6f35679b3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T16:16:31Z,direct_url=<?>,disk_format='qcow2',id=708622a9-7465-4492-ade8-b827198f7e30,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='0b29a975c552465aba0ac7d6288434bd',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T16:16:33Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'device_type': 'disk', 'encrypted': False, 'disk_bus': 'virtio', 'guest_format': None, 'encryption_options': None, 'image_id': '708622a9-7465-4492-ade8-b827198f7e30'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71731) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 16:28:52 user nova-compute[71731]: WARNING nova.virt.libvirt.driver [None req-1e9a4262-6665-4e96-839e-b5a8009f095e tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 16:28:52 user nova-compute[71731]: WARNING nova.virt.libvirt.driver [None req-1e9a4262-6665-4e96-839e-b5a8009f095e tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 16:28:52 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-1e9a4262-6665-4e96-839e-b5a8009f095e tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71731) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 16:28:52 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-1e9a4262-6665-4e96-839e-b5a8009f095e tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T16:17:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T16:16:31Z,direct_url=<?>,disk_format='qcow2',id=708622a9-7465-4492-ade8-b827198f7e30,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='0b29a975c552465aba0ac7d6288434bd',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T16:16:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 16:28:52 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-1e9a4262-6665-4e96-839e-b5a8009f095e tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Flavor limits 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 16:28:52 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-1e9a4262-6665-4e96-839e-b5a8009f095e tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Image limits 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 16:28:52 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-1e9a4262-6665-4e96-839e-b5a8009f095e tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Flavor pref 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 16:28:52 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-1e9a4262-6665-4e96-839e-b5a8009f095e tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Image pref 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 16:28:52 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-1e9a4262-6665-4e96-839e-b5a8009f095e tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 16:28:52 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-1e9a4262-6665-4e96-839e-b5a8009f095e tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 16:28:52 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-1e9a4262-6665-4e96-839e-b5a8009f095e tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71731) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 16:28:52 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-1e9a4262-6665-4e96-839e-b5a8009f095e tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Got 1 possible topologies {{(pid=71731) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 16:28:52 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-1e9a4262-6665-4e96-839e-b5a8009f095e tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 16:28:52 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-1e9a4262-6665-4e96-839e-b5a8009f095e tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 16:28:52 user nova-compute[71731]: DEBUG nova.virt.libvirt.vif [None req-1e9a4262-6665-4e96-839e-b5a8009f095e tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T16:28:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1877773095',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1877773095',id=24,image_ref='708622a9-7465-4492-ade8-b827198f7e30',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b2d09a74bf684a9fb1dd1e95d6c23f3c',ramdisk_id='',reservation_id='r-azgujbss',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='708622a9-7465-4492-ade8-b827198f7e30',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1960261099',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T16:28:50Z,user_data=None,user_id='e45a882dbafb4ea4976e4f45289eb2b8',uuid=650427bd-4dad-4bcd-922d-c17e60b36807,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c6fe8d62-f2ba-44d6-a5e3-da6f35679b3f", "address": "fa:16:3e:01:40:5b", "network": {"id": "5a7877ff-8230-470b-90b5-e5dcfc8f0cee", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-779403873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2d09a74bf684a9fb1dd1e95d6c23f3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6fe8d62-f2", "ovs_interfaceid": "c6fe8d62-f2ba-44d6-a5e3-da6f35679b3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71731) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 16:28:52 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-1e9a4262-6665-4e96-839e-b5a8009f095e tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Converting VIF {"id": "c6fe8d62-f2ba-44d6-a5e3-da6f35679b3f", "address": "fa:16:3e:01:40:5b", "network": {"id": "5a7877ff-8230-470b-90b5-e5dcfc8f0cee", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-779403873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2d09a74bf684a9fb1dd1e95d6c23f3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6fe8d62-f2", "ovs_interfaceid": "c6fe8d62-f2ba-44d6-a5e3-da6f35679b3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 16:28:52 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-1e9a4262-6665-4e96-839e-b5a8009f095e tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:01:40:5b,bridge_name='br-int',has_traffic_filtering=True,id=c6fe8d62-f2ba-44d6-a5e3-da6f35679b3f,network=Network(5a7877ff-8230-470b-90b5-e5dcfc8f0cee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc6fe8d62-f2') {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 16:28:52 user nova-compute[71731]: DEBUG nova.objects.instance [None req-1e9a4262-6665-4e96-839e-b5a8009f095e tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lazy-loading 'pci_devices' on Instance uuid 650427bd-4dad-4bcd-922d-c17e60b36807 {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:28:52 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-1e9a4262-6665-4e96-839e-b5a8009f095e tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: 650427bd-4dad-4bcd-922d-c17e60b36807] End _get_guest_xml xml=<domain type="kvm">
Apr 13 16:28:52 user nova-compute[71731]:   <uuid>650427bd-4dad-4bcd-922d-c17e60b36807</uuid>
Apr 13 16:28:52 user nova-compute[71731]:   <name>instance-00000018</name>
Apr 13 16:28:52 user nova-compute[71731]:   <memory>131072</memory>
Apr 13 16:28:52 user nova-compute[71731]:   <vcpu>1</vcpu>
Apr 13 16:28:52 user nova-compute[71731]:   <metadata>
Apr 13 16:28:52 user nova-compute[71731]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 16:28:52 user nova-compute[71731]:       <nova:package version="0.0.0"/>
Apr 13 16:28:52 user nova-compute[71731]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1877773095</nova:name>
Apr 13 16:28:52 user nova-compute[71731]:       <nova:creationTime>2023-04-13 16:28:52</nova:creationTime>
Apr 13 16:28:52 user nova-compute[71731]:       <nova:flavor name="m1.nano">
Apr 13 16:28:52 user nova-compute[71731]:         <nova:memory>128</nova:memory>
Apr 13 16:28:52 user nova-compute[71731]:         <nova:disk>1</nova:disk>
Apr 13 16:28:52 user nova-compute[71731]:         <nova:swap>0</nova:swap>
Apr 13 16:28:52 user nova-compute[71731]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 16:28:52 user nova-compute[71731]:         <nova:vcpus>1</nova:vcpus>
Apr 13 16:28:52 user nova-compute[71731]:       </nova:flavor>
Apr 13 16:28:52 user nova-compute[71731]:       <nova:owner>
Apr 13 16:28:52 user nova-compute[71731]:         <nova:user uuid="e45a882dbafb4ea4976e4f45289eb2b8">tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member</nova:user>
Apr 13 16:28:52 user nova-compute[71731]:         <nova:project uuid="b2d09a74bf684a9fb1dd1e95d6c23f3c">tempest-ServerBootFromVolumeStableRescueTest-1960261099</nova:project>
Apr 13 16:28:52 user nova-compute[71731]:       </nova:owner>
Apr 13 16:28:52 user nova-compute[71731]:       <nova:root type="image" uuid="708622a9-7465-4492-ade8-b827198f7e30"/>
Apr 13 16:28:52 user nova-compute[71731]:       <nova:ports>
Apr 13 16:28:52 user nova-compute[71731]:         <nova:port uuid="c6fe8d62-f2ba-44d6-a5e3-da6f35679b3f">
Apr 13 16:28:52 user nova-compute[71731]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Apr 13 16:28:52 user nova-compute[71731]:         </nova:port>
Apr 13 16:28:52 user nova-compute[71731]:       </nova:ports>
Apr 13 16:28:52 user nova-compute[71731]:     </nova:instance>
Apr 13 16:28:52 user nova-compute[71731]:   </metadata>
Apr 13 16:28:52 user nova-compute[71731]:   <sysinfo type="smbios">
Apr 13 16:28:52 user nova-compute[71731]:     <system>
Apr 13 16:28:52 user nova-compute[71731]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 16:28:52 user nova-compute[71731]:       <entry name="product">OpenStack Nova</entry>
Apr 13 16:28:52 user nova-compute[71731]:       <entry name="version">0.0.0</entry>
Apr 13 16:28:52 user nova-compute[71731]:       <entry name="serial">650427bd-4dad-4bcd-922d-c17e60b36807</entry>
Apr 13 16:28:52 user nova-compute[71731]:       <entry name="uuid">650427bd-4dad-4bcd-922d-c17e60b36807</entry>
Apr 13 16:28:52 user nova-compute[71731]:       <entry name="family">Virtual Machine</entry>
Apr 13 16:28:52 user nova-compute[71731]:     </system>
Apr 13 16:28:52 user nova-compute[71731]:   </sysinfo>
Apr 13 16:28:52 user nova-compute[71731]:   <os>
Apr 13 16:28:52 user nova-compute[71731]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 16:28:52 user nova-compute[71731]:     <boot dev="hd"/>
Apr 13 16:28:52 user nova-compute[71731]:     <smbios mode="sysinfo"/>
Apr 13 16:28:52 user nova-compute[71731]:   </os>
Apr 13 16:28:52 user nova-compute[71731]:   <features>
Apr 13 16:28:52 user nova-compute[71731]:     <acpi/>
Apr 13 16:28:52 user nova-compute[71731]:     <apic/>
Apr 13 16:28:52 user nova-compute[71731]:     <vmcoreinfo/>
Apr 13 16:28:52 user nova-compute[71731]:   </features>
Apr 13 16:28:52 user nova-compute[71731]:   <clock offset="utc">
Apr 13 16:28:52 user nova-compute[71731]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 16:28:52 user nova-compute[71731]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 16:28:52 user nova-compute[71731]:     <timer name="hpet" present="no"/>
Apr 13 16:28:52 user nova-compute[71731]:   </clock>
Apr 13 16:28:52 user nova-compute[71731]:   <cpu mode="custom" match="exact">
Apr 13 16:28:52 user nova-compute[71731]:     <model>Nehalem</model>
Apr 13 16:28:52 user nova-compute[71731]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 16:28:52 user nova-compute[71731]:   </cpu>
Apr 13 16:28:52 user nova-compute[71731]:   <devices>
Apr 13 16:28:52 user nova-compute[71731]:     <disk type="file" device="disk">
Apr 13 16:28:52 user nova-compute[71731]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 16:28:52 user nova-compute[71731]:       <source file="/opt/stack/data/nova/instances/650427bd-4dad-4bcd-922d-c17e60b36807/disk"/>
Apr 13 16:28:52 user nova-compute[71731]:       <target dev="vda" bus="virtio"/>
Apr 13 16:28:52 user nova-compute[71731]:     </disk>
Apr 13 16:28:52 user nova-compute[71731]:     <interface type="ethernet">
Apr 13 16:28:52 user nova-compute[71731]:       <mac address="fa:16:3e:01:40:5b"/>
Apr 13 16:28:52 user nova-compute[71731]:       <model type="virtio"/>
Apr 13 16:28:52 user nova-compute[71731]:       <mtu size="1442"/>
Apr 13 16:28:52 user nova-compute[71731]:       <target dev="tapc6fe8d62-f2"/>
Apr 13 16:28:52 user nova-compute[71731]:     </interface>
Apr 13 16:28:52 user nova-compute[71731]:     <serial type="pty">
Apr 13 16:28:52 user nova-compute[71731]:       <log file="/opt/stack/data/nova/instances/650427bd-4dad-4bcd-922d-c17e60b36807/console.log" append="off"/>
Apr 13 16:28:52 user nova-compute[71731]:     </serial>
Apr 13 16:28:52 user nova-compute[71731]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 16:28:52 user nova-compute[71731]:     <video>
Apr 13 16:28:52 user nova-compute[71731]:       <model type="virtio"/>
Apr 13 16:28:52 user nova-compute[71731]:     </video>
Apr 13 16:28:52 user nova-compute[71731]:     <rng model="virtio">
Apr 13 16:28:52 user nova-compute[71731]:       <backend model="random">/dev/urandom</backend>
Apr 13 16:28:52 user nova-compute[71731]:     </rng>
Apr 13 16:28:52 user nova-compute[71731]:     <controller type="usb" index="0" model="none"/>
Apr 13 16:28:52 user nova-compute[71731]:     <memballoon model="virtio">
Apr 13 16:28:52 user nova-compute[71731]:       <stats period="10"/>
Apr 13 16:28:52 user nova-compute[71731]:     </memballoon>
Apr 13 16:28:52 user nova-compute[71731]:   </devices>
Apr 13 16:28:52 user nova-compute[71731]: </domain>
Apr 13 16:28:52 user nova-compute[71731]:  {{(pid=71731) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 16:28:52 user nova-compute[71731]: DEBUG nova.virt.libvirt.vif [None req-1e9a4262-6665-4e96-839e-b5a8009f095e tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T16:28:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1877773095',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1877773095',id=24,image_ref='708622a9-7465-4492-ade8-b827198f7e30',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b2d09a74bf684a9fb1dd1e95d6c23f3c',ramdisk_id='',reservation_id='r-azgujbss',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='708622a9-7465-4492-ade8-b827198f7e30',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1960261099',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T16:28:50Z,user_data=None,user_id='e45a882dbafb4ea4976e4f45289eb2b8',uuid=650427bd-4dad-4bcd-922d-c17e60b36807,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c6fe8d62-f2ba-44d6-a5e3-da6f35679b3f", "address": "fa:16:3e:01:40:5b", "network": {"id": "5a7877ff-8230-470b-90b5-e5dcfc8f0cee", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-779403873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2d09a74bf684a9fb1dd1e95d6c23f3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6fe8d62-f2", "ovs_interfaceid": "c6fe8d62-f2ba-44d6-a5e3-da6f35679b3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 16:28:52 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-1e9a4262-6665-4e96-839e-b5a8009f095e tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Converting VIF {"id": "c6fe8d62-f2ba-44d6-a5e3-da6f35679b3f", "address": "fa:16:3e:01:40:5b", "network": {"id": "5a7877ff-8230-470b-90b5-e5dcfc8f0cee", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-779403873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2d09a74bf684a9fb1dd1e95d6c23f3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6fe8d62-f2", "ovs_interfaceid": "c6fe8d62-f2ba-44d6-a5e3-da6f35679b3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 16:28:52 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-1e9a4262-6665-4e96-839e-b5a8009f095e tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:01:40:5b,bridge_name='br-int',has_traffic_filtering=True,id=c6fe8d62-f2ba-44d6-a5e3-da6f35679b3f,network=Network(5a7877ff-8230-470b-90b5-e5dcfc8f0cee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc6fe8d62-f2') {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 16:28:52 user nova-compute[71731]: DEBUG os_vif [None req-1e9a4262-6665-4e96-839e-b5a8009f095e tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:01:40:5b,bridge_name='br-int',has_traffic_filtering=True,id=c6fe8d62-f2ba-44d6-a5e3-da6f35679b3f,network=Network(5a7877ff-8230-470b-90b5-e5dcfc8f0cee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc6fe8d62-f2') {{(pid=71731) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 16:28:52 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:28:52 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:28:52 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 16:28:52 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:28:52 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc6fe8d62-f2, may_exist=True) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:28:52 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc6fe8d62-f2, col_values=(('external_ids', {'iface-id': 'c6fe8d62-f2ba-44d6-a5e3-da6f35679b3f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:01:40:5b', 'vm-uuid': '650427bd-4dad-4bcd-922d-c17e60b36807'}),)) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:28:52 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 16:28:52 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:28:52 user nova-compute[71731]: INFO os_vif [None req-1e9a4262-6665-4e96-839e-b5a8009f095e tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:01:40:5b,bridge_name='br-int',has_traffic_filtering=True,id=c6fe8d62-f2ba-44d6-a5e3-da6f35679b3f,network=Network(5a7877ff-8230-470b-90b5-e5dcfc8f0cee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc6fe8d62-f2')
Apr 13 16:28:52 user nova-compute[71731]: DEBUG nova.compute.provider_tree [None req-90959a1e-1029-4303-89ae-1ebbc14087d7 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Inventory has not changed in ProviderTree for provider: cb6b1a64-0c24-4e2d-af1e-16576ca9165c {{(pid=71731) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 16:28:52 user nova-compute[71731]: DEBUG nova.scheduler.client.report [None req-90959a1e-1029-4303-89ae-1ebbc14087d7 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Inventory has not changed for provider cb6b1a64-0c24-4e2d-af1e-16576ca9165c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71731) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 16:28:52 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-90959a1e-1029-4303-89ae-1ebbc14087d7 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.472s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:28:52 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-1e9a4262-6665-4e96-839e-b5a8009f095e tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] No BDM found with device name vda, not building metadata. {{(pid=71731) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 16:28:52 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-1e9a4262-6665-4e96-839e-b5a8009f095e tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] No VIF found with MAC fa:16:3e:01:40:5b, not building metadata {{(pid=71731) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 16:28:52 user nova-compute[71731]: INFO nova.scheduler.client.report [None req-90959a1e-1029-4303-89ae-1ebbc14087d7 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Deleted allocations for instance 0f52d9e3-921c-4f79-9cdb-7d73500c8c35
Apr 13 16:28:52 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-90959a1e-1029-4303-89ae-1ebbc14087d7 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "0f52d9e3-921c-4f79-9cdb-7d73500c8c35" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.994s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:28:53 user nova-compute[71731]: DEBUG nova.compute.manager [req-e7f832fc-c2b2-4c3f-b329-98198bf6c67e req-51cbfe2c-5f9a-42d8-be57-2e70a8b5b16c service nova] [instance: 0f52d9e3-921c-4f79-9cdb-7d73500c8c35] Received event network-vif-deleted-d68dc4c7-5e6e-4d7f-8143-62eeb1816486 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:28:53 user nova-compute[71731]: DEBUG nova.compute.manager [req-e7f832fc-c2b2-4c3f-b329-98198bf6c67e req-51cbfe2c-5f9a-42d8-be57-2e70a8b5b16c service nova] [instance: 650427bd-4dad-4bcd-922d-c17e60b36807] Received event network-changed-c6fe8d62-f2ba-44d6-a5e3-da6f35679b3f {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:28:53 user nova-compute[71731]: DEBUG nova.compute.manager [req-e7f832fc-c2b2-4c3f-b329-98198bf6c67e req-51cbfe2c-5f9a-42d8-be57-2e70a8b5b16c service nova] [instance: 650427bd-4dad-4bcd-922d-c17e60b36807] Refreshing instance network info cache due to event network-changed-c6fe8d62-f2ba-44d6-a5e3-da6f35679b3f. {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 16:28:53 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-e7f832fc-c2b2-4c3f-b329-98198bf6c67e req-51cbfe2c-5f9a-42d8-be57-2e70a8b5b16c service nova] Acquiring lock "refresh_cache-650427bd-4dad-4bcd-922d-c17e60b36807" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 16:28:53 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-e7f832fc-c2b2-4c3f-b329-98198bf6c67e req-51cbfe2c-5f9a-42d8-be57-2e70a8b5b16c service nova] Acquired lock "refresh_cache-650427bd-4dad-4bcd-922d-c17e60b36807" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 16:28:53 user nova-compute[71731]: DEBUG nova.network.neutron [req-e7f832fc-c2b2-4c3f-b329-98198bf6c67e req-51cbfe2c-5f9a-42d8-be57-2e70a8b5b16c service nova] [instance: 650427bd-4dad-4bcd-922d-c17e60b36807] Refreshing network info cache for port c6fe8d62-f2ba-44d6-a5e3-da6f35679b3f {{(pid=71731) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 16:28:53 user nova-compute[71731]: DEBUG nova.network.neutron [req-e7f832fc-c2b2-4c3f-b329-98198bf6c67e req-51cbfe2c-5f9a-42d8-be57-2e70a8b5b16c service nova] [instance: 650427bd-4dad-4bcd-922d-c17e60b36807] Updated VIF entry in instance network info cache for port c6fe8d62-f2ba-44d6-a5e3-da6f35679b3f. {{(pid=71731) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 16:28:53 user nova-compute[71731]: DEBUG nova.network.neutron [req-e7f832fc-c2b2-4c3f-b329-98198bf6c67e req-51cbfe2c-5f9a-42d8-be57-2e70a8b5b16c service nova] [instance: 650427bd-4dad-4bcd-922d-c17e60b36807] Updating instance_info_cache with network_info: [{"id": "c6fe8d62-f2ba-44d6-a5e3-da6f35679b3f", "address": "fa:16:3e:01:40:5b", "network": {"id": "5a7877ff-8230-470b-90b5-e5dcfc8f0cee", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-779403873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2d09a74bf684a9fb1dd1e95d6c23f3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6fe8d62-f2", "ovs_interfaceid": "c6fe8d62-f2ba-44d6-a5e3-da6f35679b3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:28:53 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-e7f832fc-c2b2-4c3f-b329-98198bf6c67e req-51cbfe2c-5f9a-42d8-be57-2e70a8b5b16c service nova] Releasing lock "refresh_cache-650427bd-4dad-4bcd-922d-c17e60b36807" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 16:28:53 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:28:54 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:28:54 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:28:54 user nova-compute[71731]: DEBUG nova.compute.manager [req-5d13024c-a1d8-4158-892a-42d361bbbc95 req-a4cbe64c-3205-43af-9677-987b64a6dd89 service nova] [instance: 650427bd-4dad-4bcd-922d-c17e60b36807] Received event network-vif-plugged-c6fe8d62-f2ba-44d6-a5e3-da6f35679b3f {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:28:54 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-5d13024c-a1d8-4158-892a-42d361bbbc95 req-a4cbe64c-3205-43af-9677-987b64a6dd89 service nova] Acquiring lock "650427bd-4dad-4bcd-922d-c17e60b36807-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:28:54 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-5d13024c-a1d8-4158-892a-42d361bbbc95 req-a4cbe64c-3205-43af-9677-987b64a6dd89 service nova] Lock "650427bd-4dad-4bcd-922d-c17e60b36807-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:28:54 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-5d13024c-a1d8-4158-892a-42d361bbbc95 req-a4cbe64c-3205-43af-9677-987b64a6dd89 service nova] Lock "650427bd-4dad-4bcd-922d-c17e60b36807-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:28:54 user nova-compute[71731]: DEBUG nova.compute.manager [req-5d13024c-a1d8-4158-892a-42d361bbbc95 req-a4cbe64c-3205-43af-9677-987b64a6dd89 service nova] [instance: 650427bd-4dad-4bcd-922d-c17e60b36807] No waiting events found dispatching network-vif-plugged-c6fe8d62-f2ba-44d6-a5e3-da6f35679b3f {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:28:54 user nova-compute[71731]: WARNING nova.compute.manager [req-5d13024c-a1d8-4158-892a-42d361bbbc95 req-a4cbe64c-3205-43af-9677-987b64a6dd89 service nova] [instance: 650427bd-4dad-4bcd-922d-c17e60b36807] Received unexpected event network-vif-plugged-c6fe8d62-f2ba-44d6-a5e3-da6f35679b3f for instance with vm_state building and task_state spawning.
Apr 13 16:28:54 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:28:54 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:28:56 user nova-compute[71731]: DEBUG nova.virt.driver [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Emitting event <LifecycleEvent: 1681403336.2737694, 650427bd-4dad-4bcd-922d-c17e60b36807 => Resumed> {{(pid=71731) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 16:28:56 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 650427bd-4dad-4bcd-922d-c17e60b36807] VM Resumed (Lifecycle Event)
Apr 13 16:28:56 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1e9a4262-6665-4e96-839e-b5a8009f095e tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: 650427bd-4dad-4bcd-922d-c17e60b36807] Instance event wait completed in 0 seconds for  {{(pid=71731) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 16:28:56 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-1e9a4262-6665-4e96-839e-b5a8009f095e tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: 650427bd-4dad-4bcd-922d-c17e60b36807] Guest created on hypervisor {{(pid=71731) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 16:28:56 user nova-compute[71731]: INFO nova.virt.libvirt.driver [-] [instance: 650427bd-4dad-4bcd-922d-c17e60b36807] Instance spawned successfully.
Apr 13 16:28:56 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-1e9a4262-6665-4e96-839e-b5a8009f095e tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: 650427bd-4dad-4bcd-922d-c17e60b36807] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 16:28:56 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 650427bd-4dad-4bcd-922d-c17e60b36807] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:28:56 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 650427bd-4dad-4bcd-922d-c17e60b36807] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71731) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 16:28:56 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-1e9a4262-6665-4e96-839e-b5a8009f095e tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: 650427bd-4dad-4bcd-922d-c17e60b36807] Found default for hw_cdrom_bus of ide {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:28:56 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-1e9a4262-6665-4e96-839e-b5a8009f095e tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: 650427bd-4dad-4bcd-922d-c17e60b36807] Found default for hw_disk_bus of virtio {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:28:56 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-1e9a4262-6665-4e96-839e-b5a8009f095e tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: 650427bd-4dad-4bcd-922d-c17e60b36807] Found default for hw_input_bus of None {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:28:56 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-1e9a4262-6665-4e96-839e-b5a8009f095e tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: 650427bd-4dad-4bcd-922d-c17e60b36807] Found default for hw_pointer_model of None {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:28:56 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-1e9a4262-6665-4e96-839e-b5a8009f095e tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: 650427bd-4dad-4bcd-922d-c17e60b36807] Found default for hw_video_model of virtio {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:28:56 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-1e9a4262-6665-4e96-839e-b5a8009f095e tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: 650427bd-4dad-4bcd-922d-c17e60b36807] Found default for hw_vif_model of virtio {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:28:56 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 650427bd-4dad-4bcd-922d-c17e60b36807] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 16:28:56 user nova-compute[71731]: DEBUG nova.virt.driver [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Emitting event <LifecycleEvent: 1681403336.2790208, 650427bd-4dad-4bcd-922d-c17e60b36807 => Started> {{(pid=71731) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 16:28:56 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 650427bd-4dad-4bcd-922d-c17e60b36807] VM Started (Lifecycle Event)
Apr 13 16:28:56 user nova-compute[71731]: DEBUG nova.compute.manager [req-e6065c98-03a5-459e-9c1f-025a7c954eac req-68fc3da0-a0c5-4981-a074-32e0ce18bc47 service nova] [instance: 650427bd-4dad-4bcd-922d-c17e60b36807] Received event network-vif-plugged-c6fe8d62-f2ba-44d6-a5e3-da6f35679b3f {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:28:56 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-e6065c98-03a5-459e-9c1f-025a7c954eac req-68fc3da0-a0c5-4981-a074-32e0ce18bc47 service nova] Acquiring lock "650427bd-4dad-4bcd-922d-c17e60b36807-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:28:56 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-e6065c98-03a5-459e-9c1f-025a7c954eac req-68fc3da0-a0c5-4981-a074-32e0ce18bc47 service nova] Lock "650427bd-4dad-4bcd-922d-c17e60b36807-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:28:56 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-e6065c98-03a5-459e-9c1f-025a7c954eac req-68fc3da0-a0c5-4981-a074-32e0ce18bc47 service nova] Lock "650427bd-4dad-4bcd-922d-c17e60b36807-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:28:56 user nova-compute[71731]: DEBUG nova.compute.manager [req-e6065c98-03a5-459e-9c1f-025a7c954eac req-68fc3da0-a0c5-4981-a074-32e0ce18bc47 service nova] [instance: 650427bd-4dad-4bcd-922d-c17e60b36807] No waiting events found dispatching network-vif-plugged-c6fe8d62-f2ba-44d6-a5e3-da6f35679b3f {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:28:56 user nova-compute[71731]: WARNING nova.compute.manager [req-e6065c98-03a5-459e-9c1f-025a7c954eac req-68fc3da0-a0c5-4981-a074-32e0ce18bc47 service nova] [instance: 650427bd-4dad-4bcd-922d-c17e60b36807] Received unexpected event network-vif-plugged-c6fe8d62-f2ba-44d6-a5e3-da6f35679b3f for instance with vm_state building and task_state spawning.
Apr 13 16:28:56 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 650427bd-4dad-4bcd-922d-c17e60b36807] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:28:56 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 650427bd-4dad-4bcd-922d-c17e60b36807] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71731) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 16:28:56 user nova-compute[71731]: INFO nova.compute.manager [None req-1e9a4262-6665-4e96-839e-b5a8009f095e tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: 650427bd-4dad-4bcd-922d-c17e60b36807] Took 6.05 seconds to spawn the instance on the hypervisor.
Apr 13 16:28:56 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1e9a4262-6665-4e96-839e-b5a8009f095e tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: 650427bd-4dad-4bcd-922d-c17e60b36807] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:28:56 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 650427bd-4dad-4bcd-922d-c17e60b36807] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 16:28:56 user nova-compute[71731]: INFO nova.compute.manager [None req-1e9a4262-6665-4e96-839e-b5a8009f095e tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: 650427bd-4dad-4bcd-922d-c17e60b36807] Took 7.42 seconds to build instance.
Apr 13 16:28:56 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-1e9a4262-6665-4e96-839e-b5a8009f095e tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lock "650427bd-4dad-4bcd-922d-c17e60b36807" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.567s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:28:56 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:28:57 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:28:59 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-2fb4fee4-773b-4925-8dd6-11c258205815 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Acquiring lock "7973e93b-6311-44ed-91ff-e861c32d0277" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:28:59 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-2fb4fee4-773b-4925-8dd6-11c258205815 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Lock "7973e93b-6311-44ed-91ff-e861c32d0277" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:28:59 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-2fb4fee4-773b-4925-8dd6-11c258205815 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Acquiring lock "7973e93b-6311-44ed-91ff-e861c32d0277-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:28:59 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-2fb4fee4-773b-4925-8dd6-11c258205815 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Lock "7973e93b-6311-44ed-91ff-e861c32d0277-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:28:59 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-2fb4fee4-773b-4925-8dd6-11c258205815 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Lock "7973e93b-6311-44ed-91ff-e861c32d0277-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:28:59 user nova-compute[71731]: INFO nova.compute.manager [None req-2fb4fee4-773b-4925-8dd6-11c258205815 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] [instance: 7973e93b-6311-44ed-91ff-e861c32d0277] Terminating instance
Apr 13 16:28:59 user nova-compute[71731]: DEBUG nova.compute.manager [None req-2fb4fee4-773b-4925-8dd6-11c258205815 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] [instance: 7973e93b-6311-44ed-91ff-e861c32d0277] Start destroying the instance on the hypervisor. {{(pid=71731) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 16:29:00 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:29:00 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:29:00 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:29:00 user nova-compute[71731]: DEBUG nova.compute.manager [req-58291c53-8365-4f59-89e8-f44ca313d475 req-a2046c69-b1f6-434a-8e9a-d980f6efa5a3 service nova] [instance: 7973e93b-6311-44ed-91ff-e861c32d0277] Received event network-vif-unplugged-8ae83a6c-4fc7-4e2c-8f83-7aece5c239cd {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:29:00 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-58291c53-8365-4f59-89e8-f44ca313d475 req-a2046c69-b1f6-434a-8e9a-d980f6efa5a3 service nova] Acquiring lock "7973e93b-6311-44ed-91ff-e861c32d0277-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:29:00 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-58291c53-8365-4f59-89e8-f44ca313d475 req-a2046c69-b1f6-434a-8e9a-d980f6efa5a3 service nova] Lock "7973e93b-6311-44ed-91ff-e861c32d0277-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:29:00 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-58291c53-8365-4f59-89e8-f44ca313d475 req-a2046c69-b1f6-434a-8e9a-d980f6efa5a3 service nova] Lock "7973e93b-6311-44ed-91ff-e861c32d0277-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:29:00 user nova-compute[71731]: DEBUG nova.compute.manager [req-58291c53-8365-4f59-89e8-f44ca313d475 req-a2046c69-b1f6-434a-8e9a-d980f6efa5a3 service nova] [instance: 7973e93b-6311-44ed-91ff-e861c32d0277] No waiting events found dispatching network-vif-unplugged-8ae83a6c-4fc7-4e2c-8f83-7aece5c239cd {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:29:00 user nova-compute[71731]: DEBUG nova.compute.manager [req-58291c53-8365-4f59-89e8-f44ca313d475 req-a2046c69-b1f6-434a-8e9a-d980f6efa5a3 service nova] [instance: 7973e93b-6311-44ed-91ff-e861c32d0277] Received event network-vif-unplugged-8ae83a6c-4fc7-4e2c-8f83-7aece5c239cd for instance with task_state deleting. {{(pid=71731) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 16:29:00 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:29:00 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:29:00 user nova-compute[71731]: INFO nova.virt.libvirt.driver [-] [instance: 7973e93b-6311-44ed-91ff-e861c32d0277] Instance destroyed successfully.
Apr 13 16:29:00 user nova-compute[71731]: DEBUG nova.objects.instance [None req-2fb4fee4-773b-4925-8dd6-11c258205815 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Lazy-loading 'resources' on Instance uuid 7973e93b-6311-44ed-91ff-e861c32d0277 {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:29:00 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:29:00 user nova-compute[71731]: DEBUG nova.virt.libvirt.vif [None req-2fb4fee4-773b-4925-8dd6-11c258205815 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T16:20:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-700639075',display_name='tempest-ServersNegativeTestJSON-server-700639075',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-700639075',id=1,image_ref='708622a9-7465-4492-ade8-b827198f7e30',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-13T16:20:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5554aa7f1b4d471b8807a845ab1ea33f',ramdisk_id='',reservation_id='r-0io0hj0a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='708622a9-7465-4492-ade8-b827198f7e30',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1820659348',owner_user_name='tempest-ServersNegativeTestJSON-1820659348-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T16:20:32Z,user_data=None,user_id='4ddd547d240b43ccb213e9d459082309',uuid=7973e93b-6311-44ed-91ff-e861c32d0277,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8ae83a6c-4fc7-4e2c-8f83-7aece5c239cd", "address": "fa:16:3e:db:b9:e8", "network": {"id": "ae7f770e-a460-4297-91b5-ed0b908a895a", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1175970469-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5554aa7f1b4d471b8807a845ab1ea33f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ae83a6c-4f", "ovs_interfaceid": "8ae83a6c-4fc7-4e2c-8f83-7aece5c239cd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 16:29:00 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-2fb4fee4-773b-4925-8dd6-11c258205815 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Converting VIF {"id": "8ae83a6c-4fc7-4e2c-8f83-7aece5c239cd", "address": "fa:16:3e:db:b9:e8", "network": {"id": "ae7f770e-a460-4297-91b5-ed0b908a895a", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1175970469-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5554aa7f1b4d471b8807a845ab1ea33f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ae83a6c-4f", "ovs_interfaceid": "8ae83a6c-4fc7-4e2c-8f83-7aece5c239cd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 16:29:00 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-2fb4fee4-773b-4925-8dd6-11c258205815 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:db:b9:e8,bridge_name='br-int',has_traffic_filtering=True,id=8ae83a6c-4fc7-4e2c-8f83-7aece5c239cd,network=Network(ae7f770e-a460-4297-91b5-ed0b908a895a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ae83a6c-4f') {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 16:29:00 user nova-compute[71731]: DEBUG os_vif [None req-2fb4fee4-773b-4925-8dd6-11c258205815 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:db:b9:e8,bridge_name='br-int',has_traffic_filtering=True,id=8ae83a6c-4fc7-4e2c-8f83-7aece5c239cd,network=Network(ae7f770e-a460-4297-91b5-ed0b908a895a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ae83a6c-4f') {{(pid=71731) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 16:29:00 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:29:00 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8ae83a6c-4f, bridge=br-int, if_exists=True) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:29:00 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:29:00 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 16:29:00 user nova-compute[71731]: INFO os_vif [None req-2fb4fee4-773b-4925-8dd6-11c258205815 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:db:b9:e8,bridge_name='br-int',has_traffic_filtering=True,id=8ae83a6c-4fc7-4e2c-8f83-7aece5c239cd,network=Network(ae7f770e-a460-4297-91b5-ed0b908a895a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ae83a6c-4f')
Apr 13 16:29:00 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-2fb4fee4-773b-4925-8dd6-11c258205815 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] [instance: 7973e93b-6311-44ed-91ff-e861c32d0277] Deleting instance files /opt/stack/data/nova/instances/7973e93b-6311-44ed-91ff-e861c32d0277_del
Apr 13 16:29:00 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-2fb4fee4-773b-4925-8dd6-11c258205815 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] [instance: 7973e93b-6311-44ed-91ff-e861c32d0277] Deletion of /opt/stack/data/nova/instances/7973e93b-6311-44ed-91ff-e861c32d0277_del complete
Apr 13 16:29:00 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:29:00 user nova-compute[71731]: INFO nova.compute.manager [None req-2fb4fee4-773b-4925-8dd6-11c258205815 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] [instance: 7973e93b-6311-44ed-91ff-e861c32d0277] Took 0.70 seconds to destroy the instance on the hypervisor.
Apr 13 16:29:00 user nova-compute[71731]: DEBUG oslo.service.loopingcall [None req-2fb4fee4-773b-4925-8dd6-11c258205815 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71731) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 16:29:00 user nova-compute[71731]: DEBUG nova.compute.manager [-] [instance: 7973e93b-6311-44ed-91ff-e861c32d0277] Deallocating network for instance {{(pid=71731) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 16:29:00 user nova-compute[71731]: DEBUG nova.network.neutron [-] [instance: 7973e93b-6311-44ed-91ff-e861c32d0277] deallocate_for_instance() {{(pid=71731) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 16:29:01 user nova-compute[71731]: DEBUG nova.network.neutron [-] [instance: 7973e93b-6311-44ed-91ff-e861c32d0277] Updating instance_info_cache with network_info: [] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:29:01 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:29:01 user nova-compute[71731]: INFO nova.compute.manager [-] [instance: 7973e93b-6311-44ed-91ff-e861c32d0277] Took 0.57 seconds to deallocate network for instance.
Apr 13 16:29:01 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:29:01 user nova-compute[71731]: DEBUG nova.compute.manager [req-d58f29cb-363b-44a8-b295-b07a0da8eb16 req-d9f21674-c9c8-4bcf-abee-e893516b2bdd service nova] [instance: 7973e93b-6311-44ed-91ff-e861c32d0277] Received event network-vif-deleted-8ae83a6c-4fc7-4e2c-8f83-7aece5c239cd {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:29:01 user nova-compute[71731]: INFO nova.compute.manager [req-d58f29cb-363b-44a8-b295-b07a0da8eb16 req-d9f21674-c9c8-4bcf-abee-e893516b2bdd service nova] [instance: 7973e93b-6311-44ed-91ff-e861c32d0277] Neutron deleted interface 8ae83a6c-4fc7-4e2c-8f83-7aece5c239cd; detaching it from the instance and deleting it from the info cache
Apr 13 16:29:01 user nova-compute[71731]: DEBUG nova.network.neutron [req-d58f29cb-363b-44a8-b295-b07a0da8eb16 req-d9f21674-c9c8-4bcf-abee-e893516b2bdd service nova] [instance: 7973e93b-6311-44ed-91ff-e861c32d0277] Updating instance_info_cache with network_info: [] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:29:01 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:29:01 user nova-compute[71731]: DEBUG nova.compute.manager [req-d58f29cb-363b-44a8-b295-b07a0da8eb16 req-d9f21674-c9c8-4bcf-abee-e893516b2bdd service nova] [instance: 7973e93b-6311-44ed-91ff-e861c32d0277] Detach interface failed, port_id=8ae83a6c-4fc7-4e2c-8f83-7aece5c239cd, reason: Instance 7973e93b-6311-44ed-91ff-e861c32d0277 could not be found. {{(pid=71731) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 13 16:29:01 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-2fb4fee4-773b-4925-8dd6-11c258205815 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:29:01 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-2fb4fee4-773b-4925-8dd6-11c258205815 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:29:01 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:29:01 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:29:01 user nova-compute[71731]: DEBUG nova.compute.provider_tree [None req-2fb4fee4-773b-4925-8dd6-11c258205815 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Inventory has not changed in ProviderTree for provider: cb6b1a64-0c24-4e2d-af1e-16576ca9165c {{(pid=71731) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 16:29:01 user nova-compute[71731]: DEBUG nova.scheduler.client.report [None req-2fb4fee4-773b-4925-8dd6-11c258205815 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Inventory has not changed for provider cb6b1a64-0c24-4e2d-af1e-16576ca9165c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71731) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 16:29:01 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-2fb4fee4-773b-4925-8dd6-11c258205815 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.461s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:29:01 user nova-compute[71731]: INFO nova.scheduler.client.report [None req-2fb4fee4-773b-4925-8dd6-11c258205815 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Deleted allocations for instance 7973e93b-6311-44ed-91ff-e861c32d0277
Apr 13 16:29:01 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-2fb4fee4-773b-4925-8dd6-11c258205815 tempest-ServersNegativeTestJSON-1820659348 tempest-ServersNegativeTestJSON-1820659348-project-member] Lock "7973e93b-6311-44ed-91ff-e861c32d0277" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.976s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:29:02 user nova-compute[71731]: DEBUG nova.compute.manager [req-461ce698-9712-4315-92ff-420c7d2e5d15 req-c5ea474e-5949-4775-92ef-2618c0721499 service nova] [instance: 7973e93b-6311-44ed-91ff-e861c32d0277] Received event network-vif-plugged-8ae83a6c-4fc7-4e2c-8f83-7aece5c239cd {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:29:02 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-461ce698-9712-4315-92ff-420c7d2e5d15 req-c5ea474e-5949-4775-92ef-2618c0721499 service nova] Acquiring lock "7973e93b-6311-44ed-91ff-e861c32d0277-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:29:02 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-461ce698-9712-4315-92ff-420c7d2e5d15 req-c5ea474e-5949-4775-92ef-2618c0721499 service nova] Lock "7973e93b-6311-44ed-91ff-e861c32d0277-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:29:02 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-461ce698-9712-4315-92ff-420c7d2e5d15 req-c5ea474e-5949-4775-92ef-2618c0721499 service nova] Lock "7973e93b-6311-44ed-91ff-e861c32d0277-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:29:02 user nova-compute[71731]: DEBUG nova.compute.manager [req-461ce698-9712-4315-92ff-420c7d2e5d15 req-c5ea474e-5949-4775-92ef-2618c0721499 service nova] [instance: 7973e93b-6311-44ed-91ff-e861c32d0277] No waiting events found dispatching network-vif-plugged-8ae83a6c-4fc7-4e2c-8f83-7aece5c239cd {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:29:02 user nova-compute[71731]: WARNING nova.compute.manager [req-461ce698-9712-4315-92ff-420c7d2e5d15 req-c5ea474e-5949-4775-92ef-2618c0721499 service nova] [instance: 7973e93b-6311-44ed-91ff-e861c32d0277] Received unexpected event network-vif-plugged-8ae83a6c-4fc7-4e2c-8f83-7aece5c239cd for instance with vm_state deleted and task_state None.
Apr 13 16:29:02 user nova-compute[71731]: DEBUG nova.compute.manager [req-461ce698-9712-4315-92ff-420c7d2e5d15 req-c5ea474e-5949-4775-92ef-2618c0721499 service nova] [instance: 7973e93b-6311-44ed-91ff-e861c32d0277] Received event network-vif-plugged-8ae83a6c-4fc7-4e2c-8f83-7aece5c239cd {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:29:02 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-461ce698-9712-4315-92ff-420c7d2e5d15 req-c5ea474e-5949-4775-92ef-2618c0721499 service nova] Acquiring lock "7973e93b-6311-44ed-91ff-e861c32d0277-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:29:02 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-461ce698-9712-4315-92ff-420c7d2e5d15 req-c5ea474e-5949-4775-92ef-2618c0721499 service nova] Lock "7973e93b-6311-44ed-91ff-e861c32d0277-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:29:02 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-461ce698-9712-4315-92ff-420c7d2e5d15 req-c5ea474e-5949-4775-92ef-2618c0721499 service nova] Lock "7973e93b-6311-44ed-91ff-e861c32d0277-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:29:02 user nova-compute[71731]: DEBUG nova.compute.manager [req-461ce698-9712-4315-92ff-420c7d2e5d15 req-c5ea474e-5949-4775-92ef-2618c0721499 service nova] [instance: 7973e93b-6311-44ed-91ff-e861c32d0277] No waiting events found dispatching network-vif-plugged-8ae83a6c-4fc7-4e2c-8f83-7aece5c239cd {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:29:02 user nova-compute[71731]: WARNING nova.compute.manager [req-461ce698-9712-4315-92ff-420c7d2e5d15 req-c5ea474e-5949-4775-92ef-2618c0721499 service nova] [instance: 7973e93b-6311-44ed-91ff-e861c32d0277] Received unexpected event network-vif-plugged-8ae83a6c-4fc7-4e2c-8f83-7aece5c239cd for instance with vm_state deleted and task_state None.
Apr 13 16:29:02 user nova-compute[71731]: DEBUG nova.compute.manager [req-461ce698-9712-4315-92ff-420c7d2e5d15 req-c5ea474e-5949-4775-92ef-2618c0721499 service nova] [instance: 7973e93b-6311-44ed-91ff-e861c32d0277] Received event network-vif-plugged-8ae83a6c-4fc7-4e2c-8f83-7aece5c239cd {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:29:02 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-461ce698-9712-4315-92ff-420c7d2e5d15 req-c5ea474e-5949-4775-92ef-2618c0721499 service nova] Acquiring lock "7973e93b-6311-44ed-91ff-e861c32d0277-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:29:02 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-461ce698-9712-4315-92ff-420c7d2e5d15 req-c5ea474e-5949-4775-92ef-2618c0721499 service nova] Lock "7973e93b-6311-44ed-91ff-e861c32d0277-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:29:02 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-461ce698-9712-4315-92ff-420c7d2e5d15 req-c5ea474e-5949-4775-92ef-2618c0721499 service nova] Lock "7973e93b-6311-44ed-91ff-e861c32d0277-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:29:02 user nova-compute[71731]: DEBUG nova.compute.manager [req-461ce698-9712-4315-92ff-420c7d2e5d15 req-c5ea474e-5949-4775-92ef-2618c0721499 service nova] [instance: 7973e93b-6311-44ed-91ff-e861c32d0277] No waiting events found dispatching network-vif-plugged-8ae83a6c-4fc7-4e2c-8f83-7aece5c239cd {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:29:02 user nova-compute[71731]: WARNING nova.compute.manager [req-461ce698-9712-4315-92ff-420c7d2e5d15 req-c5ea474e-5949-4775-92ef-2618c0721499 service nova] [instance: 7973e93b-6311-44ed-91ff-e861c32d0277] Received unexpected event network-vif-plugged-8ae83a6c-4fc7-4e2c-8f83-7aece5c239cd for instance with vm_state deleted and task_state None.
Apr 13 16:29:02 user nova-compute[71731]: DEBUG nova.compute.manager [req-461ce698-9712-4315-92ff-420c7d2e5d15 req-c5ea474e-5949-4775-92ef-2618c0721499 service nova] [instance: 7973e93b-6311-44ed-91ff-e861c32d0277] Received event network-vif-plugged-8ae83a6c-4fc7-4e2c-8f83-7aece5c239cd {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:29:02 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-461ce698-9712-4315-92ff-420c7d2e5d15 req-c5ea474e-5949-4775-92ef-2618c0721499 service nova] Acquiring lock "7973e93b-6311-44ed-91ff-e861c32d0277-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:29:02 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-461ce698-9712-4315-92ff-420c7d2e5d15 req-c5ea474e-5949-4775-92ef-2618c0721499 service nova] Lock "7973e93b-6311-44ed-91ff-e861c32d0277-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:29:02 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-461ce698-9712-4315-92ff-420c7d2e5d15 req-c5ea474e-5949-4775-92ef-2618c0721499 service nova] Lock "7973e93b-6311-44ed-91ff-e861c32d0277-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:29:02 user nova-compute[71731]: DEBUG nova.compute.manager [req-461ce698-9712-4315-92ff-420c7d2e5d15 req-c5ea474e-5949-4775-92ef-2618c0721499 service nova] [instance: 7973e93b-6311-44ed-91ff-e861c32d0277] No waiting events found dispatching network-vif-plugged-8ae83a6c-4fc7-4e2c-8f83-7aece5c239cd {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:29:02 user nova-compute[71731]: WARNING nova.compute.manager [req-461ce698-9712-4315-92ff-420c7d2e5d15 req-c5ea474e-5949-4775-92ef-2618c0721499 service nova] [instance: 7973e93b-6311-44ed-91ff-e861c32d0277] Received unexpected event network-vif-plugged-8ae83a6c-4fc7-4e2c-8f83-7aece5c239cd for instance with vm_state deleted and task_state None.
Apr 13 16:29:04 user nova-compute[71731]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681403329.691584, 0f52d9e3-921c-4f79-9cdb-7d73500c8c35 => Stopped> {{(pid=71731) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 16:29:04 user nova-compute[71731]: INFO nova.compute.manager [-] [instance: 0f52d9e3-921c-4f79-9cdb-7d73500c8c35] VM Stopped (Lifecycle Event)
Apr 13 16:29:04 user nova-compute[71731]: DEBUG nova.compute.manager [None req-f93f156b-986e-40e4-af0c-adfd664cd313 None None] [instance: 0f52d9e3-921c-4f79-9cdb-7d73500c8c35] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:29:05 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:29:06 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:29:10 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager.update_available_resource {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:29:10 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:29:10 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:29:10 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:29:10 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Auditing locally available compute resources for user (node: user) {{(pid=71731) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 16:29:10 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=71731) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 16:29:10 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acbcaee0-a47b-4fee-8765-9b1c9597d515/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:29:10 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acbcaee0-a47b-4fee-8765-9b1c9597d515/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:29:10 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acbcaee0-a47b-4fee-8765-9b1c9597d515/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:29:10 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acbcaee0-a47b-4fee-8765-9b1c9597d515/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:29:10 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=71731) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 16:29:10 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d50f597-3a29-4335-8166-6ab8e8149376/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:29:10 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:29:10 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d50f597-3a29-4335-8166-6ab8e8149376/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:29:10 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d50f597-3a29-4335-8166-6ab8e8149376/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:29:10 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d50f597-3a29-4335-8166-6ab8e8149376/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:29:10 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66553f5-5e1b-4f1d-8c5a-63bc340f7586/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:29:10 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66553f5-5e1b-4f1d-8c5a-63bc340f7586/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:29:10 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66553f5-5e1b-4f1d-8c5a-63bc340f7586/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:29:11 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66553f5-5e1b-4f1d-8c5a-63bc340f7586/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:29:11 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eaae47b9-a059-49f6-9ae6-d7147003e2f2/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:29:11 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eaae47b9-a059-49f6-9ae6-d7147003e2f2/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:29:11 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eaae47b9-a059-49f6-9ae6-d7147003e2f2/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:29:11 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eaae47b9-a059-49f6-9ae6-d7147003e2f2/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:29:11 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=71731) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 16:29:11 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71731) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 16:29:11 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf98c3a2-dbeb-4ae4-8423-ce55964c4258/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:29:11 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf98c3a2-dbeb-4ae4-8423-ce55964c4258/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:29:11 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf98c3a2-dbeb-4ae4-8423-ce55964c4258/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:29:11 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:29:11 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf98c3a2-dbeb-4ae4-8423-ce55964c4258/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:29:11 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/650427bd-4dad-4bcd-922d-c17e60b36807/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:29:11 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/650427bd-4dad-4bcd-922d-c17e60b36807/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:29:11 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/650427bd-4dad-4bcd-922d-c17e60b36807/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:29:11 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/650427bd-4dad-4bcd-922d-c17e60b36807/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:29:11 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32b18558-8bf2-4def-bc70-81c4e38fcc6f/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:29:12 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32b18558-8bf2-4def-bc70-81c4e38fcc6f/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:29:12 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32b18558-8bf2-4def-bc70-81c4e38fcc6f/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:29:12 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32b18558-8bf2-4def-bc70-81c4e38fcc6f/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:29:12 user nova-compute[71731]: WARNING nova.virt.libvirt.driver [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 16:29:12 user nova-compute[71731]: WARNING nova.virt.libvirt.driver [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 16:29:12 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Hypervisor/Node resource view: name=user free_ram=7640MB free_disk=26.219989776611328GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71731) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 16:29:12 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:29:12 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:29:12 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance f66553f5-5e1b-4f1d-8c5a-63bc340f7586 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 16:29:12 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance 235f827c-7116-48e9-84c5-0c9761c18e1e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 16:29:12 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance acbcaee0-a47b-4fee-8765-9b1c9597d515 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 16:29:12 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance eaae47b9-a059-49f6-9ae6-d7147003e2f2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 16:29:12 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance 5ea4ab6a-6501-4a2f-a8f7-04090024747d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 16:29:12 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance 5d50f597-3a29-4335-8166-6ab8e8149376 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 16:29:12 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance bf98c3a2-dbeb-4ae4-8423-ce55964c4258 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 16:29:12 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance 32b18558-8bf2-4def-bc70-81c4e38fcc6f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 16:29:12 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance 650427bd-4dad-4bcd-922d-c17e60b36807 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 16:29:12 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=71731) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 16:29:12 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Final resource view: name=user phys_ram=16023MB used_ram=1664MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=71731) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 16:29:13 user nova-compute[71731]: DEBUG nova.compute.provider_tree [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Inventory has not changed in ProviderTree for provider: cb6b1a64-0c24-4e2d-af1e-16576ca9165c {{(pid=71731) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 16:29:13 user nova-compute[71731]: DEBUG nova.scheduler.client.report [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Inventory has not changed for provider cb6b1a64-0c24-4e2d-af1e-16576ca9165c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71731) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 16:29:13 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Compute_service record updated for user:user {{(pid=71731) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 16:29:13 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.511s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:29:14 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:29:14 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Starting heal instance info cache {{(pid=71731) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 16:29:14 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Acquiring lock "refresh_cache-acbcaee0-a47b-4fee-8765-9b1c9597d515" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 16:29:14 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Acquired lock "refresh_cache-acbcaee0-a47b-4fee-8765-9b1c9597d515" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 16:29:14 user nova-compute[71731]: DEBUG nova.network.neutron [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] Forcefully refreshing network info cache for instance {{(pid=71731) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 16:29:14 user nova-compute[71731]: DEBUG nova.network.neutron [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] Updating instance_info_cache with network_info: [{"id": "13471516-9514-4b85-938f-69657c2990e5", "address": "fa:16:3e:62:32:7f", "network": {"id": "cf1fef97-9ef1-449f-a302-b38110024547", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1138167711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "980559734a504574a83224deb7423c77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13471516-95", "ovs_interfaceid": "13471516-9514-4b85-938f-69657c2990e5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:29:14 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Releasing lock "refresh_cache-acbcaee0-a47b-4fee-8765-9b1c9597d515" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 16:29:14 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] Updated the network info_cache for instance {{(pid=71731) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 16:29:14 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:29:14 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:29:14 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:29:14 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:29:15 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:29:15 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71731) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 16:29:15 user nova-compute[71731]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681403340.5132704, 7973e93b-6311-44ed-91ff-e861c32d0277 => Stopped> {{(pid=71731) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 16:29:15 user nova-compute[71731]: INFO nova.compute.manager [-] [instance: 7973e93b-6311-44ed-91ff-e861c32d0277] VM Stopped (Lifecycle Event)
Apr 13 16:29:15 user nova-compute[71731]: DEBUG nova.compute.manager [None req-cd393a5d-614b-4513-aedb-2d3d37f990aa None None] [instance: 7973e93b-6311-44ed-91ff-e861c32d0277] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:29:15 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:29:16 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-6bfd2c29-81cb-4b08-9963-8db7a9bad627 tempest-VolumesNegativeTest-1740638080 tempest-VolumesNegativeTest-1740638080-project-member] Acquiring lock "71a2163b-fb6b-4b71-b93f-d682ad141b84" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:29:16 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-6bfd2c29-81cb-4b08-9963-8db7a9bad627 tempest-VolumesNegativeTest-1740638080 tempest-VolumesNegativeTest-1740638080-project-member] Lock "71a2163b-fb6b-4b71-b93f-d682ad141b84" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:29:16 user nova-compute[71731]: DEBUG nova.compute.manager [None req-6bfd2c29-81cb-4b08-9963-8db7a9bad627 tempest-VolumesNegativeTest-1740638080 tempest-VolumesNegativeTest-1740638080-project-member] [instance: 71a2163b-fb6b-4b71-b93f-d682ad141b84] Starting instance... {{(pid=71731) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 16:29:16 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:29:16 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-6bfd2c29-81cb-4b08-9963-8db7a9bad627 tempest-VolumesNegativeTest-1740638080 tempest-VolumesNegativeTest-1740638080-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:29:16 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-6bfd2c29-81cb-4b08-9963-8db7a9bad627 tempest-VolumesNegativeTest-1740638080 tempest-VolumesNegativeTest-1740638080-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:29:16 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-6bfd2c29-81cb-4b08-9963-8db7a9bad627 tempest-VolumesNegativeTest-1740638080 tempest-VolumesNegativeTest-1740638080-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71731) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 16:29:16 user nova-compute[71731]: INFO nova.compute.claims [None req-6bfd2c29-81cb-4b08-9963-8db7a9bad627 tempest-VolumesNegativeTest-1740638080 tempest-VolumesNegativeTest-1740638080-project-member] [instance: 71a2163b-fb6b-4b71-b93f-d682ad141b84] Claim successful on node user
Apr 13 16:29:17 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:29:17 user nova-compute[71731]: DEBUG nova.compute.provider_tree [None req-6bfd2c29-81cb-4b08-9963-8db7a9bad627 tempest-VolumesNegativeTest-1740638080 tempest-VolumesNegativeTest-1740638080-project-member] Inventory has not changed in ProviderTree for provider: cb6b1a64-0c24-4e2d-af1e-16576ca9165c {{(pid=71731) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 16:29:17 user nova-compute[71731]: DEBUG nova.scheduler.client.report [None req-6bfd2c29-81cb-4b08-9963-8db7a9bad627 tempest-VolumesNegativeTest-1740638080 tempest-VolumesNegativeTest-1740638080-project-member] Inventory has not changed for provider cb6b1a64-0c24-4e2d-af1e-16576ca9165c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71731) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 16:29:17 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-6bfd2c29-81cb-4b08-9963-8db7a9bad627 tempest-VolumesNegativeTest-1740638080 tempest-VolumesNegativeTest-1740638080-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.398s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:29:17 user nova-compute[71731]: DEBUG nova.compute.manager [None req-6bfd2c29-81cb-4b08-9963-8db7a9bad627 tempest-VolumesNegativeTest-1740638080 tempest-VolumesNegativeTest-1740638080-project-member] [instance: 71a2163b-fb6b-4b71-b93f-d682ad141b84] Start building networks asynchronously for instance. {{(pid=71731) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 16:29:17 user nova-compute[71731]: DEBUG nova.compute.manager [None req-6bfd2c29-81cb-4b08-9963-8db7a9bad627 tempest-VolumesNegativeTest-1740638080 tempest-VolumesNegativeTest-1740638080-project-member] [instance: 71a2163b-fb6b-4b71-b93f-d682ad141b84] Allocating IP information in the background. {{(pid=71731) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 16:29:17 user nova-compute[71731]: DEBUG nova.network.neutron [None req-6bfd2c29-81cb-4b08-9963-8db7a9bad627 tempest-VolumesNegativeTest-1740638080 tempest-VolumesNegativeTest-1740638080-project-member] [instance: 71a2163b-fb6b-4b71-b93f-d682ad141b84] allocate_for_instance() {{(pid=71731) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 16:29:17 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-6bfd2c29-81cb-4b08-9963-8db7a9bad627 tempest-VolumesNegativeTest-1740638080 tempest-VolumesNegativeTest-1740638080-project-member] [instance: 71a2163b-fb6b-4b71-b93f-d682ad141b84] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 16:29:17 user nova-compute[71731]: DEBUG nova.compute.manager [None req-6bfd2c29-81cb-4b08-9963-8db7a9bad627 tempest-VolumesNegativeTest-1740638080 tempest-VolumesNegativeTest-1740638080-project-member] [instance: 71a2163b-fb6b-4b71-b93f-d682ad141b84] Start building block device mappings for instance. {{(pid=71731) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 16:29:17 user nova-compute[71731]: DEBUG nova.compute.manager [None req-6bfd2c29-81cb-4b08-9963-8db7a9bad627 tempest-VolumesNegativeTest-1740638080 tempest-VolumesNegativeTest-1740638080-project-member] [instance: 71a2163b-fb6b-4b71-b93f-d682ad141b84] Start spawning the instance on the hypervisor. {{(pid=71731) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 16:29:17 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-6bfd2c29-81cb-4b08-9963-8db7a9bad627 tempest-VolumesNegativeTest-1740638080 tempest-VolumesNegativeTest-1740638080-project-member] [instance: 71a2163b-fb6b-4b71-b93f-d682ad141b84] Creating instance directory {{(pid=71731) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 16:29:17 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-6bfd2c29-81cb-4b08-9963-8db7a9bad627 tempest-VolumesNegativeTest-1740638080 tempest-VolumesNegativeTest-1740638080-project-member] [instance: 71a2163b-fb6b-4b71-b93f-d682ad141b84] Creating image(s)
Apr 13 16:29:17 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-6bfd2c29-81cb-4b08-9963-8db7a9bad627 tempest-VolumesNegativeTest-1740638080 tempest-VolumesNegativeTest-1740638080-project-member] Acquiring lock "/opt/stack/data/nova/instances/71a2163b-fb6b-4b71-b93f-d682ad141b84/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:29:17 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-6bfd2c29-81cb-4b08-9963-8db7a9bad627 tempest-VolumesNegativeTest-1740638080 tempest-VolumesNegativeTest-1740638080-project-member] Lock "/opt/stack/data/nova/instances/71a2163b-fb6b-4b71-b93f-d682ad141b84/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:29:17 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-6bfd2c29-81cb-4b08-9963-8db7a9bad627 tempest-VolumesNegativeTest-1740638080 tempest-VolumesNegativeTest-1740638080-project-member] Lock "/opt/stack/data/nova/instances/71a2163b-fb6b-4b71-b93f-d682ad141b84/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:29:17 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-6bfd2c29-81cb-4b08-9963-8db7a9bad627 tempest-VolumesNegativeTest-1740638080 tempest-VolumesNegativeTest-1740638080-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279 --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:29:17 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-6bfd2c29-81cb-4b08-9963-8db7a9bad627 tempest-VolumesNegativeTest-1740638080 tempest-VolumesNegativeTest-1740638080-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279 --force-share --output=json" returned: 0 in 0.138s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:29:17 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-6bfd2c29-81cb-4b08-9963-8db7a9bad627 tempest-VolumesNegativeTest-1740638080 tempest-VolumesNegativeTest-1740638080-project-member] Acquiring lock "9524227dd898575c3099d3976f096cd935414279" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:29:17 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-6bfd2c29-81cb-4b08-9963-8db7a9bad627 tempest-VolumesNegativeTest-1740638080 tempest-VolumesNegativeTest-1740638080-project-member] Lock "9524227dd898575c3099d3976f096cd935414279" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:29:17 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-6bfd2c29-81cb-4b08-9963-8db7a9bad627 tempest-VolumesNegativeTest-1740638080 tempest-VolumesNegativeTest-1740638080-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279 --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:29:17 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-6bfd2c29-81cb-4b08-9963-8db7a9bad627 tempest-VolumesNegativeTest-1740638080 tempest-VolumesNegativeTest-1740638080-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279 --force-share --output=json" returned: 0 in 0.133s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:29:17 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-6bfd2c29-81cb-4b08-9963-8db7a9bad627 tempest-VolumesNegativeTest-1740638080 tempest-VolumesNegativeTest-1740638080-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279,backing_fmt=raw /opt/stack/data/nova/instances/71a2163b-fb6b-4b71-b93f-d682ad141b84/disk 1073741824 {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:29:17 user nova-compute[71731]: DEBUG nova.policy [None req-6bfd2c29-81cb-4b08-9963-8db7a9bad627 tempest-VolumesNegativeTest-1740638080 tempest-VolumesNegativeTest-1740638080-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd7f9678e69654526b4d5dc9de05ac090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33101d535154c9a88cae865ee7ece46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71731) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 16:29:17 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-6bfd2c29-81cb-4b08-9963-8db7a9bad627 tempest-VolumesNegativeTest-1740638080 tempest-VolumesNegativeTest-1740638080-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279,backing_fmt=raw /opt/stack/data/nova/instances/71a2163b-fb6b-4b71-b93f-d682ad141b84/disk 1073741824" returned: 0 in 0.055s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:29:17 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-6bfd2c29-81cb-4b08-9963-8db7a9bad627 tempest-VolumesNegativeTest-1740638080 tempest-VolumesNegativeTest-1740638080-project-member] Lock "9524227dd898575c3099d3976f096cd935414279" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.193s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:29:17 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-6bfd2c29-81cb-4b08-9963-8db7a9bad627 tempest-VolumesNegativeTest-1740638080 tempest-VolumesNegativeTest-1740638080-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279 --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:29:17 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-6bfd2c29-81cb-4b08-9963-8db7a9bad627 tempest-VolumesNegativeTest-1740638080 tempest-VolumesNegativeTest-1740638080-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279 --force-share --output=json" returned: 0 in 0.130s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:29:17 user nova-compute[71731]: DEBUG nova.virt.disk.api [None req-6bfd2c29-81cb-4b08-9963-8db7a9bad627 tempest-VolumesNegativeTest-1740638080 tempest-VolumesNegativeTest-1740638080-project-member] Checking if we can resize image /opt/stack/data/nova/instances/71a2163b-fb6b-4b71-b93f-d682ad141b84/disk. size=1073741824 {{(pid=71731) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 16:29:17 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-6bfd2c29-81cb-4b08-9963-8db7a9bad627 tempest-VolumesNegativeTest-1740638080 tempest-VolumesNegativeTest-1740638080-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71a2163b-fb6b-4b71-b93f-d682ad141b84/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:29:17 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-6bfd2c29-81cb-4b08-9963-8db7a9bad627 tempest-VolumesNegativeTest-1740638080 tempest-VolumesNegativeTest-1740638080-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71a2163b-fb6b-4b71-b93f-d682ad141b84/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:29:17 user nova-compute[71731]: DEBUG nova.virt.disk.api [None req-6bfd2c29-81cb-4b08-9963-8db7a9bad627 tempest-VolumesNegativeTest-1740638080 tempest-VolumesNegativeTest-1740638080-project-member] Cannot resize image /opt/stack/data/nova/instances/71a2163b-fb6b-4b71-b93f-d682ad141b84/disk to a smaller size. {{(pid=71731) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 16:29:17 user nova-compute[71731]: DEBUG nova.objects.instance [None req-6bfd2c29-81cb-4b08-9963-8db7a9bad627 tempest-VolumesNegativeTest-1740638080 tempest-VolumesNegativeTest-1740638080-project-member] Lazy-loading 'migration_context' on Instance uuid 71a2163b-fb6b-4b71-b93f-d682ad141b84 {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:29:17 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-6bfd2c29-81cb-4b08-9963-8db7a9bad627 tempest-VolumesNegativeTest-1740638080 tempest-VolumesNegativeTest-1740638080-project-member] [instance: 71a2163b-fb6b-4b71-b93f-d682ad141b84] Created local disks {{(pid=71731) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 16:29:17 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-6bfd2c29-81cb-4b08-9963-8db7a9bad627 tempest-VolumesNegativeTest-1740638080 tempest-VolumesNegativeTest-1740638080-project-member] [instance: 71a2163b-fb6b-4b71-b93f-d682ad141b84] Ensure instance console log exists: /opt/stack/data/nova/instances/71a2163b-fb6b-4b71-b93f-d682ad141b84/console.log {{(pid=71731) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 16:29:17 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-6bfd2c29-81cb-4b08-9963-8db7a9bad627 tempest-VolumesNegativeTest-1740638080 tempest-VolumesNegativeTest-1740638080-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:29:17 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-6bfd2c29-81cb-4b08-9963-8db7a9bad627 tempest-VolumesNegativeTest-1740638080 tempest-VolumesNegativeTest-1740638080-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:29:17 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-6bfd2c29-81cb-4b08-9963-8db7a9bad627 tempest-VolumesNegativeTest-1740638080 tempest-VolumesNegativeTest-1740638080-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:29:18 user nova-compute[71731]: DEBUG nova.network.neutron [None req-6bfd2c29-81cb-4b08-9963-8db7a9bad627 tempest-VolumesNegativeTest-1740638080 tempest-VolumesNegativeTest-1740638080-project-member] [instance: 71a2163b-fb6b-4b71-b93f-d682ad141b84] Successfully created port: da3b7e52-803c-4172-a058-238c8dcedbbc {{(pid=71731) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 16:29:19 user nova-compute[71731]: DEBUG nova.network.neutron [None req-6bfd2c29-81cb-4b08-9963-8db7a9bad627 tempest-VolumesNegativeTest-1740638080 tempest-VolumesNegativeTest-1740638080-project-member] [instance: 71a2163b-fb6b-4b71-b93f-d682ad141b84] Successfully updated port: da3b7e52-803c-4172-a058-238c8dcedbbc {{(pid=71731) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 16:29:19 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-6bfd2c29-81cb-4b08-9963-8db7a9bad627 tempest-VolumesNegativeTest-1740638080 tempest-VolumesNegativeTest-1740638080-project-member] Acquiring lock "refresh_cache-71a2163b-fb6b-4b71-b93f-d682ad141b84" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 16:29:19 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-6bfd2c29-81cb-4b08-9963-8db7a9bad627 tempest-VolumesNegativeTest-1740638080 tempest-VolumesNegativeTest-1740638080-project-member] Acquired lock "refresh_cache-71a2163b-fb6b-4b71-b93f-d682ad141b84" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 16:29:19 user nova-compute[71731]: DEBUG nova.network.neutron [None req-6bfd2c29-81cb-4b08-9963-8db7a9bad627 tempest-VolumesNegativeTest-1740638080 tempest-VolumesNegativeTest-1740638080-project-member] [instance: 71a2163b-fb6b-4b71-b93f-d682ad141b84] Building network info cache for instance {{(pid=71731) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 16:29:19 user nova-compute[71731]: DEBUG nova.compute.manager [req-8bd6e647-cd89-4d58-8bd8-bfbf762ade2c req-67e0b20e-46ca-4da1-91ec-d62cde17fdf3 service nova] [instance: 71a2163b-fb6b-4b71-b93f-d682ad141b84] Received event network-changed-da3b7e52-803c-4172-a058-238c8dcedbbc {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:29:19 user nova-compute[71731]: DEBUG nova.compute.manager [req-8bd6e647-cd89-4d58-8bd8-bfbf762ade2c req-67e0b20e-46ca-4da1-91ec-d62cde17fdf3 service nova] [instance: 71a2163b-fb6b-4b71-b93f-d682ad141b84] Refreshing instance network info cache due to event network-changed-da3b7e52-803c-4172-a058-238c8dcedbbc. {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 16:29:19 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-8bd6e647-cd89-4d58-8bd8-bfbf762ade2c req-67e0b20e-46ca-4da1-91ec-d62cde17fdf3 service nova] Acquiring lock "refresh_cache-71a2163b-fb6b-4b71-b93f-d682ad141b84" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 16:29:19 user nova-compute[71731]: DEBUG nova.network.neutron [None req-6bfd2c29-81cb-4b08-9963-8db7a9bad627 tempest-VolumesNegativeTest-1740638080 tempest-VolumesNegativeTest-1740638080-project-member] [instance: 71a2163b-fb6b-4b71-b93f-d682ad141b84] Instance cache missing network info. {{(pid=71731) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 16:29:19 user nova-compute[71731]: DEBUG nova.network.neutron [None req-6bfd2c29-81cb-4b08-9963-8db7a9bad627 tempest-VolumesNegativeTest-1740638080 tempest-VolumesNegativeTest-1740638080-project-member] [instance: 71a2163b-fb6b-4b71-b93f-d682ad141b84] Updating instance_info_cache with network_info: [{"id": "da3b7e52-803c-4172-a058-238c8dcedbbc", "address": "fa:16:3e:9d:68:b6", "network": {"id": "0f6e6e5d-9902-4827-9e2c-50065c0fe402", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.212", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "0b29a975c552465aba0ac7d6288434bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda3b7e52-80", "ovs_interfaceid": "da3b7e52-803c-4172-a058-238c8dcedbbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:29:19 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-6bfd2c29-81cb-4b08-9963-8db7a9bad627 tempest-VolumesNegativeTest-1740638080 tempest-VolumesNegativeTest-1740638080-project-member] Releasing lock "refresh_cache-71a2163b-fb6b-4b71-b93f-d682ad141b84" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 16:29:19 user nova-compute[71731]: DEBUG nova.compute.manager [None req-6bfd2c29-81cb-4b08-9963-8db7a9bad627 tempest-VolumesNegativeTest-1740638080 tempest-VolumesNegativeTest-1740638080-project-member] [instance: 71a2163b-fb6b-4b71-b93f-d682ad141b84] Instance network_info: |[{"id": "da3b7e52-803c-4172-a058-238c8dcedbbc", "address": "fa:16:3e:9d:68:b6", "network": {"id": "0f6e6e5d-9902-4827-9e2c-50065c0fe402", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.212", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "0b29a975c552465aba0ac7d6288434bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda3b7e52-80", "ovs_interfaceid": "da3b7e52-803c-4172-a058-238c8dcedbbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71731) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 16:29:19 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-8bd6e647-cd89-4d58-8bd8-bfbf762ade2c req-67e0b20e-46ca-4da1-91ec-d62cde17fdf3 service nova] Acquired lock "refresh_cache-71a2163b-fb6b-4b71-b93f-d682ad141b84" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 16:29:19 user nova-compute[71731]: DEBUG nova.network.neutron [req-8bd6e647-cd89-4d58-8bd8-bfbf762ade2c req-67e0b20e-46ca-4da1-91ec-d62cde17fdf3 service nova] [instance: 71a2163b-fb6b-4b71-b93f-d682ad141b84] Refreshing network info cache for port da3b7e52-803c-4172-a058-238c8dcedbbc {{(pid=71731) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 16:29:19 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-6bfd2c29-81cb-4b08-9963-8db7a9bad627 tempest-VolumesNegativeTest-1740638080 tempest-VolumesNegativeTest-1740638080-project-member] [instance: 71a2163b-fb6b-4b71-b93f-d682ad141b84] Start _get_guest_xml network_info=[{"id": "da3b7e52-803c-4172-a058-238c8dcedbbc", "address": "fa:16:3e:9d:68:b6", "network": {"id": "0f6e6e5d-9902-4827-9e2c-50065c0fe402", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.212", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "0b29a975c552465aba0ac7d6288434bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda3b7e52-80", "ovs_interfaceid": "da3b7e52-803c-4172-a058-238c8dcedbbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T16:16:31Z,direct_url=<?>,disk_format='qcow2',id=708622a9-7465-4492-ade8-b827198f7e30,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='0b29a975c552465aba0ac7d6288434bd',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T16:16:33Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'device_type': 'disk', 'encrypted': False, 'disk_bus': 'virtio', 'guest_format': None, 'encryption_options': None, 'image_id': '708622a9-7465-4492-ade8-b827198f7e30'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71731) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 16:29:19 user nova-compute[71731]: WARNING nova.virt.libvirt.driver [None req-6bfd2c29-81cb-4b08-9963-8db7a9bad627 tempest-VolumesNegativeTest-1740638080 tempest-VolumesNegativeTest-1740638080-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 16:29:19 user nova-compute[71731]: WARNING nova.virt.libvirt.driver [None req-6bfd2c29-81cb-4b08-9963-8db7a9bad627 tempest-VolumesNegativeTest-1740638080 tempest-VolumesNegativeTest-1740638080-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 16:29:19 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-6bfd2c29-81cb-4b08-9963-8db7a9bad627 tempest-VolumesNegativeTest-1740638080 tempest-VolumesNegativeTest-1740638080-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71731) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 16:29:19 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-6bfd2c29-81cb-4b08-9963-8db7a9bad627 tempest-VolumesNegativeTest-1740638080 tempest-VolumesNegativeTest-1740638080-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T16:17:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T16:16:31Z,direct_url=<?>,disk_format='qcow2',id=708622a9-7465-4492-ade8-b827198f7e30,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='0b29a975c552465aba0ac7d6288434bd',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T16:16:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 16:29:19 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-6bfd2c29-81cb-4b08-9963-8db7a9bad627 tempest-VolumesNegativeTest-1740638080 tempest-VolumesNegativeTest-1740638080-project-member] Flavor limits 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 16:29:19 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-6bfd2c29-81cb-4b08-9963-8db7a9bad627 tempest-VolumesNegativeTest-1740638080 tempest-VolumesNegativeTest-1740638080-project-member] Image limits 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 16:29:19 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-6bfd2c29-81cb-4b08-9963-8db7a9bad627 tempest-VolumesNegativeTest-1740638080 tempest-VolumesNegativeTest-1740638080-project-member] Flavor pref 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 16:29:19 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-6bfd2c29-81cb-4b08-9963-8db7a9bad627 tempest-VolumesNegativeTest-1740638080 tempest-VolumesNegativeTest-1740638080-project-member] Image pref 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 16:29:19 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-6bfd2c29-81cb-4b08-9963-8db7a9bad627 tempest-VolumesNegativeTest-1740638080 tempest-VolumesNegativeTest-1740638080-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 16:29:19 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-6bfd2c29-81cb-4b08-9963-8db7a9bad627 tempest-VolumesNegativeTest-1740638080 tempest-VolumesNegativeTest-1740638080-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 16:29:19 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-6bfd2c29-81cb-4b08-9963-8db7a9bad627 tempest-VolumesNegativeTest-1740638080 tempest-VolumesNegativeTest-1740638080-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71731) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 16:29:19 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-6bfd2c29-81cb-4b08-9963-8db7a9bad627 tempest-VolumesNegativeTest-1740638080 tempest-VolumesNegativeTest-1740638080-project-member] Got 1 possible topologies {{(pid=71731) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 16:29:19 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-6bfd2c29-81cb-4b08-9963-8db7a9bad627 tempest-VolumesNegativeTest-1740638080 tempest-VolumesNegativeTest-1740638080-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 16:29:19 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-6bfd2c29-81cb-4b08-9963-8db7a9bad627 tempest-VolumesNegativeTest-1740638080 tempest-VolumesNegativeTest-1740638080-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 16:29:19 user nova-compute[71731]: DEBUG nova.virt.libvirt.vif [None req-6bfd2c29-81cb-4b08-9963-8db7a9bad627 tempest-VolumesNegativeTest-1740638080 tempest-VolumesNegativeTest-1740638080-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T16:29:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1825993154',display_name='tempest-VolumesNegativeTest-instance-1825993154',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1825993154',id=25,image_ref='708622a9-7465-4492-ade8-b827198f7e30',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c33101d535154c9a88cae865ee7ece46',ramdisk_id='',reservation_id='r-0n3u33k0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='708622a9-7465-4492-ade8-b827198f7e30',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1740638080',owner_user_name='tempest-VolumesNegativeTest-1740638080-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T16:29:17Z,user_data=None,user_id='d7f9678e69654526b4d5dc9de05ac090',uuid=71a2163b-fb6b-4b71-b93f-d682ad141b84,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "da3b7e52-803c-4172-a058-238c8dcedbbc", "address": "fa:16:3e:9d:68:b6", "network": {"id": "0f6e6e5d-9902-4827-9e2c-50065c0fe402", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.212", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "0b29a975c552465aba0ac7d6288434bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda3b7e52-80", "ovs_interfaceid": "da3b7e52-803c-4172-a058-238c8dcedbbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71731) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 16:29:19 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-6bfd2c29-81cb-4b08-9963-8db7a9bad627 tempest-VolumesNegativeTest-1740638080 tempest-VolumesNegativeTest-1740638080-project-member] Converting VIF {"id": "da3b7e52-803c-4172-a058-238c8dcedbbc", "address": "fa:16:3e:9d:68:b6", "network": {"id": "0f6e6e5d-9902-4827-9e2c-50065c0fe402", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.212", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "0b29a975c552465aba0ac7d6288434bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda3b7e52-80", "ovs_interfaceid": "da3b7e52-803c-4172-a058-238c8dcedbbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 16:29:19 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-6bfd2c29-81cb-4b08-9963-8db7a9bad627 tempest-VolumesNegativeTest-1740638080 tempest-VolumesNegativeTest-1740638080-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9d:68:b6,bridge_name='br-int',has_traffic_filtering=True,id=da3b7e52-803c-4172-a058-238c8dcedbbc,network=Network(0f6e6e5d-9902-4827-9e2c-50065c0fe402),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda3b7e52-80') {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 16:29:19 user nova-compute[71731]: DEBUG nova.objects.instance [None req-6bfd2c29-81cb-4b08-9963-8db7a9bad627 tempest-VolumesNegativeTest-1740638080 tempest-VolumesNegativeTest-1740638080-project-member] Lazy-loading 'pci_devices' on Instance uuid 71a2163b-fb6b-4b71-b93f-d682ad141b84 {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:29:19 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-6bfd2c29-81cb-4b08-9963-8db7a9bad627 tempest-VolumesNegativeTest-1740638080 tempest-VolumesNegativeTest-1740638080-project-member] [instance: 71a2163b-fb6b-4b71-b93f-d682ad141b84] End _get_guest_xml xml=<domain type="kvm">
Apr 13 16:29:19 user nova-compute[71731]:   <uuid>71a2163b-fb6b-4b71-b93f-d682ad141b84</uuid>
Apr 13 16:29:19 user nova-compute[71731]:   <name>instance-00000019</name>
Apr 13 16:29:19 user nova-compute[71731]:   <memory>131072</memory>
Apr 13 16:29:19 user nova-compute[71731]:   <vcpu>1</vcpu>
Apr 13 16:29:19 user nova-compute[71731]:   <metadata>
Apr 13 16:29:19 user nova-compute[71731]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 16:29:19 user nova-compute[71731]:       <nova:package version="0.0.0"/>
Apr 13 16:29:19 user nova-compute[71731]:       <nova:name>tempest-VolumesNegativeTest-instance-1825993154</nova:name>
Apr 13 16:29:19 user nova-compute[71731]:       <nova:creationTime>2023-04-13 16:29:19</nova:creationTime>
Apr 13 16:29:19 user nova-compute[71731]:       <nova:flavor name="m1.nano">
Apr 13 16:29:19 user nova-compute[71731]:         <nova:memory>128</nova:memory>
Apr 13 16:29:19 user nova-compute[71731]:         <nova:disk>1</nova:disk>
Apr 13 16:29:19 user nova-compute[71731]:         <nova:swap>0</nova:swap>
Apr 13 16:29:19 user nova-compute[71731]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 16:29:19 user nova-compute[71731]:         <nova:vcpus>1</nova:vcpus>
Apr 13 16:29:19 user nova-compute[71731]:       </nova:flavor>
Apr 13 16:29:19 user nova-compute[71731]:       <nova:owner>
Apr 13 16:29:19 user nova-compute[71731]:         <nova:user uuid="d7f9678e69654526b4d5dc9de05ac090">tempest-VolumesNegativeTest-1740638080-project-member</nova:user>
Apr 13 16:29:19 user nova-compute[71731]:         <nova:project uuid="c33101d535154c9a88cae865ee7ece46">tempest-VolumesNegativeTest-1740638080</nova:project>
Apr 13 16:29:19 user nova-compute[71731]:       </nova:owner>
Apr 13 16:29:19 user nova-compute[71731]:       <nova:root type="image" uuid="708622a9-7465-4492-ade8-b827198f7e30"/>
Apr 13 16:29:19 user nova-compute[71731]:       <nova:ports>
Apr 13 16:29:19 user nova-compute[71731]:         <nova:port uuid="da3b7e52-803c-4172-a058-238c8dcedbbc">
Apr 13 16:29:19 user nova-compute[71731]:           <nova:ip type="fixed" address="192.168.233.212" ipVersion="4"/>
Apr 13 16:29:19 user nova-compute[71731]:         </nova:port>
Apr 13 16:29:19 user nova-compute[71731]:       </nova:ports>
Apr 13 16:29:19 user nova-compute[71731]:     </nova:instance>
Apr 13 16:29:19 user nova-compute[71731]:   </metadata>
Apr 13 16:29:19 user nova-compute[71731]:   <sysinfo type="smbios">
Apr 13 16:29:19 user nova-compute[71731]:     <system>
Apr 13 16:29:19 user nova-compute[71731]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 16:29:19 user nova-compute[71731]:       <entry name="product">OpenStack Nova</entry>
Apr 13 16:29:19 user nova-compute[71731]:       <entry name="version">0.0.0</entry>
Apr 13 16:29:19 user nova-compute[71731]:       <entry name="serial">71a2163b-fb6b-4b71-b93f-d682ad141b84</entry>
Apr 13 16:29:19 user nova-compute[71731]:       <entry name="uuid">71a2163b-fb6b-4b71-b93f-d682ad141b84</entry>
Apr 13 16:29:19 user nova-compute[71731]:       <entry name="family">Virtual Machine</entry>
Apr 13 16:29:19 user nova-compute[71731]:     </system>
Apr 13 16:29:19 user nova-compute[71731]:   </sysinfo>
Apr 13 16:29:19 user nova-compute[71731]:   <os>
Apr 13 16:29:19 user nova-compute[71731]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 16:29:19 user nova-compute[71731]:     <boot dev="hd"/>
Apr 13 16:29:19 user nova-compute[71731]:     <smbios mode="sysinfo"/>
Apr 13 16:29:19 user nova-compute[71731]:   </os>
Apr 13 16:29:19 user nova-compute[71731]:   <features>
Apr 13 16:29:19 user nova-compute[71731]:     <acpi/>
Apr 13 16:29:19 user nova-compute[71731]:     <apic/>
Apr 13 16:29:19 user nova-compute[71731]:     <vmcoreinfo/>
Apr 13 16:29:19 user nova-compute[71731]:   </features>
Apr 13 16:29:19 user nova-compute[71731]:   <clock offset="utc">
Apr 13 16:29:19 user nova-compute[71731]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 16:29:19 user nova-compute[71731]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 16:29:19 user nova-compute[71731]:     <timer name="hpet" present="no"/>
Apr 13 16:29:19 user nova-compute[71731]:   </clock>
Apr 13 16:29:19 user nova-compute[71731]:   <cpu mode="custom" match="exact">
Apr 13 16:29:19 user nova-compute[71731]:     <model>Nehalem</model>
Apr 13 16:29:19 user nova-compute[71731]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 16:29:19 user nova-compute[71731]:   </cpu>
Apr 13 16:29:19 user nova-compute[71731]:   <devices>
Apr 13 16:29:19 user nova-compute[71731]:     <disk type="file" device="disk">
Apr 13 16:29:19 user nova-compute[71731]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 16:29:19 user nova-compute[71731]:       <source file="/opt/stack/data/nova/instances/71a2163b-fb6b-4b71-b93f-d682ad141b84/disk"/>
Apr 13 16:29:19 user nova-compute[71731]:       <target dev="vda" bus="virtio"/>
Apr 13 16:29:19 user nova-compute[71731]:     </disk>
Apr 13 16:29:19 user nova-compute[71731]:     <interface type="ethernet">
Apr 13 16:29:19 user nova-compute[71731]:       <mac address="fa:16:3e:9d:68:b6"/>
Apr 13 16:29:19 user nova-compute[71731]:       <model type="virtio"/>
Apr 13 16:29:19 user nova-compute[71731]:       <mtu size="1442"/>
Apr 13 16:29:19 user nova-compute[71731]:       <target dev="tapda3b7e52-80"/>
Apr 13 16:29:19 user nova-compute[71731]:     </interface>
Apr 13 16:29:19 user nova-compute[71731]:     <serial type="pty">
Apr 13 16:29:19 user nova-compute[71731]:       <log file="/opt/stack/data/nova/instances/71a2163b-fb6b-4b71-b93f-d682ad141b84/console.log" append="off"/>
Apr 13 16:29:19 user nova-compute[71731]:     </serial>
Apr 13 16:29:19 user nova-compute[71731]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 16:29:19 user nova-compute[71731]:     <video>
Apr 13 16:29:19 user nova-compute[71731]:       <model type="virtio"/>
Apr 13 16:29:19 user nova-compute[71731]:     </video>
Apr 13 16:29:19 user nova-compute[71731]:     <rng model="virtio">
Apr 13 16:29:19 user nova-compute[71731]:       <backend model="random">/dev/urandom</backend>
Apr 13 16:29:19 user nova-compute[71731]:     </rng>
Apr 13 16:29:19 user nova-compute[71731]:     <controller type="usb" index="0" model="none"/>
Apr 13 16:29:19 user nova-compute[71731]:     <memballoon model="virtio">
Apr 13 16:29:19 user nova-compute[71731]:       <stats period="10"/>
Apr 13 16:29:19 user nova-compute[71731]:     </memballoon>
Apr 13 16:29:19 user nova-compute[71731]:   </devices>
Apr 13 16:29:19 user nova-compute[71731]: </domain>
Apr 13 16:29:19 user nova-compute[71731]:  {{(pid=71731) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 16:29:19 user nova-compute[71731]: DEBUG nova.virt.libvirt.vif [None req-6bfd2c29-81cb-4b08-9963-8db7a9bad627 tempest-VolumesNegativeTest-1740638080 tempest-VolumesNegativeTest-1740638080-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T16:29:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1825993154',display_name='tempest-VolumesNegativeTest-instance-1825993154',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1825993154',id=25,image_ref='708622a9-7465-4492-ade8-b827198f7e30',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c33101d535154c9a88cae865ee7ece46',ramdisk_id='',reservation_id='r-0n3u33k0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='708622a9-7465-4492-ade8-b827198f7e30',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1740638080',owner_user_name='tempest-VolumesNegativeTest-1740638080-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T16:29:17Z,user_data=None,user_id='d7f9678e69654526b4d5dc9de05ac090',uuid=71a2163b-fb6b-4b71-b93f-d682ad141b84,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "da3b7e52-803c-4172-a058-238c8dcedbbc", "address": "fa:16:3e:9d:68:b6", "network": {"id": "0f6e6e5d-9902-4827-9e2c-50065c0fe402", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.212", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "0b29a975c552465aba0ac7d6288434bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda3b7e52-80", "ovs_interfaceid": "da3b7e52-803c-4172-a058-238c8dcedbbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 16:29:19 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-6bfd2c29-81cb-4b08-9963-8db7a9bad627 tempest-VolumesNegativeTest-1740638080 tempest-VolumesNegativeTest-1740638080-project-member] Converting VIF {"id": "da3b7e52-803c-4172-a058-238c8dcedbbc", "address": "fa:16:3e:9d:68:b6", "network": {"id": "0f6e6e5d-9902-4827-9e2c-50065c0fe402", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.212", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "0b29a975c552465aba0ac7d6288434bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda3b7e52-80", "ovs_interfaceid": "da3b7e52-803c-4172-a058-238c8dcedbbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 16:29:19 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-6bfd2c29-81cb-4b08-9963-8db7a9bad627 tempest-VolumesNegativeTest-1740638080 tempest-VolumesNegativeTest-1740638080-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9d:68:b6,bridge_name='br-int',has_traffic_filtering=True,id=da3b7e52-803c-4172-a058-238c8dcedbbc,network=Network(0f6e6e5d-9902-4827-9e2c-50065c0fe402),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda3b7e52-80') {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 16:29:19 user nova-compute[71731]: DEBUG os_vif [None req-6bfd2c29-81cb-4b08-9963-8db7a9bad627 tempest-VolumesNegativeTest-1740638080 tempest-VolumesNegativeTest-1740638080-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9d:68:b6,bridge_name='br-int',has_traffic_filtering=True,id=da3b7e52-803c-4172-a058-238c8dcedbbc,network=Network(0f6e6e5d-9902-4827-9e2c-50065c0fe402),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda3b7e52-80') {{(pid=71731) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 16:29:19 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:29:19 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:29:19 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 16:29:19 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:29:19 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapda3b7e52-80, may_exist=True) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:29:19 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapda3b7e52-80, col_values=(('external_ids', {'iface-id': 'da3b7e52-803c-4172-a058-238c8dcedbbc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9d:68:b6', 'vm-uuid': '71a2163b-fb6b-4b71-b93f-d682ad141b84'}),)) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:29:19 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:29:19 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 16:29:19 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:29:19 user nova-compute[71731]: INFO os_vif [None req-6bfd2c29-81cb-4b08-9963-8db7a9bad627 tempest-VolumesNegativeTest-1740638080 tempest-VolumesNegativeTest-1740638080-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9d:68:b6,bridge_name='br-int',has_traffic_filtering=True,id=da3b7e52-803c-4172-a058-238c8dcedbbc,network=Network(0f6e6e5d-9902-4827-9e2c-50065c0fe402),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda3b7e52-80')
Apr 13 16:29:19 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-6bfd2c29-81cb-4b08-9963-8db7a9bad627 tempest-VolumesNegativeTest-1740638080 tempest-VolumesNegativeTest-1740638080-project-member] No BDM found with device name vda, not building metadata. {{(pid=71731) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 16:29:19 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-6bfd2c29-81cb-4b08-9963-8db7a9bad627 tempest-VolumesNegativeTest-1740638080 tempest-VolumesNegativeTest-1740638080-project-member] No VIF found with MAC fa:16:3e:9d:68:b6, not building metadata {{(pid=71731) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 16:29:19 user nova-compute[71731]: DEBUG nova.network.neutron [req-8bd6e647-cd89-4d58-8bd8-bfbf762ade2c req-67e0b20e-46ca-4da1-91ec-d62cde17fdf3 service nova] [instance: 71a2163b-fb6b-4b71-b93f-d682ad141b84] Updated VIF entry in instance network info cache for port da3b7e52-803c-4172-a058-238c8dcedbbc. {{(pid=71731) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 16:29:19 user nova-compute[71731]: DEBUG nova.network.neutron [req-8bd6e647-cd89-4d58-8bd8-bfbf762ade2c req-67e0b20e-46ca-4da1-91ec-d62cde17fdf3 service nova] [instance: 71a2163b-fb6b-4b71-b93f-d682ad141b84] Updating instance_info_cache with network_info: [{"id": "da3b7e52-803c-4172-a058-238c8dcedbbc", "address": "fa:16:3e:9d:68:b6", "network": {"id": "0f6e6e5d-9902-4827-9e2c-50065c0fe402", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.212", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "0b29a975c552465aba0ac7d6288434bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda3b7e52-80", "ovs_interfaceid": "da3b7e52-803c-4172-a058-238c8dcedbbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:29:19 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-8bd6e647-cd89-4d58-8bd8-bfbf762ade2c req-67e0b20e-46ca-4da1-91ec-d62cde17fdf3 service nova] Releasing lock "refresh_cache-71a2163b-fb6b-4b71-b93f-d682ad141b84" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 16:29:20 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:29:20 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:29:20 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:29:20 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:29:21 user nova-compute[71731]: DEBUG nova.compute.manager [req-77dff801-3c2e-40cd-9abc-d2097d5ccd97 req-f0c9af4a-2389-40c3-a7f6-d58049c68415 service nova] [instance: 71a2163b-fb6b-4b71-b93f-d682ad141b84] Received event network-vif-plugged-da3b7e52-803c-4172-a058-238c8dcedbbc {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:29:21 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-77dff801-3c2e-40cd-9abc-d2097d5ccd97 req-f0c9af4a-2389-40c3-a7f6-d58049c68415 service nova] Acquiring lock "71a2163b-fb6b-4b71-b93f-d682ad141b84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:29:21 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-77dff801-3c2e-40cd-9abc-d2097d5ccd97 req-f0c9af4a-2389-40c3-a7f6-d58049c68415 service nova] Lock "71a2163b-fb6b-4b71-b93f-d682ad141b84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:29:21 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-77dff801-3c2e-40cd-9abc-d2097d5ccd97 req-f0c9af4a-2389-40c3-a7f6-d58049c68415 service nova] Lock "71a2163b-fb6b-4b71-b93f-d682ad141b84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:29:21 user nova-compute[71731]: DEBUG nova.compute.manager [req-77dff801-3c2e-40cd-9abc-d2097d5ccd97 req-f0c9af4a-2389-40c3-a7f6-d58049c68415 service nova] [instance: 71a2163b-fb6b-4b71-b93f-d682ad141b84] No waiting events found dispatching network-vif-plugged-da3b7e52-803c-4172-a058-238c8dcedbbc {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:29:21 user nova-compute[71731]: WARNING nova.compute.manager [req-77dff801-3c2e-40cd-9abc-d2097d5ccd97 req-f0c9af4a-2389-40c3-a7f6-d58049c68415 service nova] [instance: 71a2163b-fb6b-4b71-b93f-d682ad141b84] Received unexpected event network-vif-plugged-da3b7e52-803c-4172-a058-238c8dcedbbc for instance with vm_state building and task_state spawning.
Apr 13 16:29:21 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:29:21 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:29:21 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:29:21 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:29:21 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:29:23 user nova-compute[71731]: DEBUG nova.virt.driver [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Emitting event <LifecycleEvent: 1681403363.0053244, 71a2163b-fb6b-4b71-b93f-d682ad141b84 => Resumed> {{(pid=71731) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 16:29:23 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 71a2163b-fb6b-4b71-b93f-d682ad141b84] VM Resumed (Lifecycle Event)
Apr 13 16:29:23 user nova-compute[71731]: DEBUG nova.compute.manager [None req-6bfd2c29-81cb-4b08-9963-8db7a9bad627 tempest-VolumesNegativeTest-1740638080 tempest-VolumesNegativeTest-1740638080-project-member] [instance: 71a2163b-fb6b-4b71-b93f-d682ad141b84] Instance event wait completed in 0 seconds for  {{(pid=71731) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 16:29:23 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-6bfd2c29-81cb-4b08-9963-8db7a9bad627 tempest-VolumesNegativeTest-1740638080 tempest-VolumesNegativeTest-1740638080-project-member] [instance: 71a2163b-fb6b-4b71-b93f-d682ad141b84] Guest created on hypervisor {{(pid=71731) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 16:29:23 user nova-compute[71731]: INFO nova.virt.libvirt.driver [-] [instance: 71a2163b-fb6b-4b71-b93f-d682ad141b84] Instance spawned successfully.
Apr 13 16:29:23 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-6bfd2c29-81cb-4b08-9963-8db7a9bad627 tempest-VolumesNegativeTest-1740638080 tempest-VolumesNegativeTest-1740638080-project-member] [instance: 71a2163b-fb6b-4b71-b93f-d682ad141b84] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 16:29:23 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 71a2163b-fb6b-4b71-b93f-d682ad141b84] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:29:23 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 71a2163b-fb6b-4b71-b93f-d682ad141b84] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71731) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 16:29:23 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-6bfd2c29-81cb-4b08-9963-8db7a9bad627 tempest-VolumesNegativeTest-1740638080 tempest-VolumesNegativeTest-1740638080-project-member] [instance: 71a2163b-fb6b-4b71-b93f-d682ad141b84] Found default for hw_cdrom_bus of ide {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:29:23 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-6bfd2c29-81cb-4b08-9963-8db7a9bad627 tempest-VolumesNegativeTest-1740638080 tempest-VolumesNegativeTest-1740638080-project-member] [instance: 71a2163b-fb6b-4b71-b93f-d682ad141b84] Found default for hw_disk_bus of virtio {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:29:23 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-6bfd2c29-81cb-4b08-9963-8db7a9bad627 tempest-VolumesNegativeTest-1740638080 tempest-VolumesNegativeTest-1740638080-project-member] [instance: 71a2163b-fb6b-4b71-b93f-d682ad141b84] Found default for hw_input_bus of None {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:29:23 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-6bfd2c29-81cb-4b08-9963-8db7a9bad627 tempest-VolumesNegativeTest-1740638080 tempest-VolumesNegativeTest-1740638080-project-member] [instance: 71a2163b-fb6b-4b71-b93f-d682ad141b84] Found default for hw_pointer_model of None {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:29:23 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-6bfd2c29-81cb-4b08-9963-8db7a9bad627 tempest-VolumesNegativeTest-1740638080 tempest-VolumesNegativeTest-1740638080-project-member] [instance: 71a2163b-fb6b-4b71-b93f-d682ad141b84] Found default for hw_video_model of virtio {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:29:23 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-6bfd2c29-81cb-4b08-9963-8db7a9bad627 tempest-VolumesNegativeTest-1740638080 tempest-VolumesNegativeTest-1740638080-project-member] [instance: 71a2163b-fb6b-4b71-b93f-d682ad141b84] Found default for hw_vif_model of virtio {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:29:23 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 71a2163b-fb6b-4b71-b93f-d682ad141b84] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 16:29:23 user nova-compute[71731]: DEBUG nova.virt.driver [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Emitting event <LifecycleEvent: 1681403363.0087323, 71a2163b-fb6b-4b71-b93f-d682ad141b84 => Started> {{(pid=71731) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 16:29:23 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 71a2163b-fb6b-4b71-b93f-d682ad141b84] VM Started (Lifecycle Event)
Apr 13 16:29:23 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 71a2163b-fb6b-4b71-b93f-d682ad141b84] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:29:23 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 71a2163b-fb6b-4b71-b93f-d682ad141b84] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71731) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 16:29:23 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 71a2163b-fb6b-4b71-b93f-d682ad141b84] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 16:29:23 user nova-compute[71731]: INFO nova.compute.manager [None req-6bfd2c29-81cb-4b08-9963-8db7a9bad627 tempest-VolumesNegativeTest-1740638080 tempest-VolumesNegativeTest-1740638080-project-member] [instance: 71a2163b-fb6b-4b71-b93f-d682ad141b84] Took 5.78 seconds to spawn the instance on the hypervisor.
Apr 13 16:29:23 user nova-compute[71731]: DEBUG nova.compute.manager [None req-6bfd2c29-81cb-4b08-9963-8db7a9bad627 tempest-VolumesNegativeTest-1740638080 tempest-VolumesNegativeTest-1740638080-project-member] [instance: 71a2163b-fb6b-4b71-b93f-d682ad141b84] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:29:23 user nova-compute[71731]: INFO nova.compute.manager [None req-6bfd2c29-81cb-4b08-9963-8db7a9bad627 tempest-VolumesNegativeTest-1740638080 tempest-VolumesNegativeTest-1740638080-project-member] [instance: 71a2163b-fb6b-4b71-b93f-d682ad141b84] Took 6.49 seconds to build instance.
Apr 13 16:29:23 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-6bfd2c29-81cb-4b08-9963-8db7a9bad627 tempest-VolumesNegativeTest-1740638080 tempest-VolumesNegativeTest-1740638080-project-member] Lock "71a2163b-fb6b-4b71-b93f-d682ad141b84" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.583s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:29:23 user nova-compute[71731]: DEBUG nova.compute.manager [req-2e6284fe-c36f-49b1-a725-7e6bd3ca6e56 req-39cf557a-5e15-4023-8db7-294062b8fe3a service nova] [instance: 71a2163b-fb6b-4b71-b93f-d682ad141b84] Received event network-vif-plugged-da3b7e52-803c-4172-a058-238c8dcedbbc {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:29:23 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-2e6284fe-c36f-49b1-a725-7e6bd3ca6e56 req-39cf557a-5e15-4023-8db7-294062b8fe3a service nova] Acquiring lock "71a2163b-fb6b-4b71-b93f-d682ad141b84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:29:23 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-2e6284fe-c36f-49b1-a725-7e6bd3ca6e56 req-39cf557a-5e15-4023-8db7-294062b8fe3a service nova] Lock "71a2163b-fb6b-4b71-b93f-d682ad141b84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:29:23 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-2e6284fe-c36f-49b1-a725-7e6bd3ca6e56 req-39cf557a-5e15-4023-8db7-294062b8fe3a service nova] Lock "71a2163b-fb6b-4b71-b93f-d682ad141b84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:29:23 user nova-compute[71731]: DEBUG nova.compute.manager [req-2e6284fe-c36f-49b1-a725-7e6bd3ca6e56 req-39cf557a-5e15-4023-8db7-294062b8fe3a service nova] [instance: 71a2163b-fb6b-4b71-b93f-d682ad141b84] No waiting events found dispatching network-vif-plugged-da3b7e52-803c-4172-a058-238c8dcedbbc {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:29:23 user nova-compute[71731]: WARNING nova.compute.manager [req-2e6284fe-c36f-49b1-a725-7e6bd3ca6e56 req-39cf557a-5e15-4023-8db7-294062b8fe3a service nova] [instance: 71a2163b-fb6b-4b71-b93f-d682ad141b84] Received unexpected event network-vif-plugged-da3b7e52-803c-4172-a058-238c8dcedbbc for instance with vm_state active and task_state None.
Apr 13 16:29:24 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:29:26 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:29:29 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:29:31 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:29:34 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:29:35 user nova-compute[71731]: DEBUG nova.compute.manager [req-ac4c882a-87d8-4621-a63e-b4821140f626 req-cd942be9-4861-4cdc-9a07-1babebcd59a0 service nova] [instance: 5d50f597-3a29-4335-8166-6ab8e8149376] Received event network-changed-cde3b0f9-9ed1-4eba-8560-d5fa05166b2e {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:29:35 user nova-compute[71731]: DEBUG nova.compute.manager [req-ac4c882a-87d8-4621-a63e-b4821140f626 req-cd942be9-4861-4cdc-9a07-1babebcd59a0 service nova] [instance: 5d50f597-3a29-4335-8166-6ab8e8149376] Refreshing instance network info cache due to event network-changed-cde3b0f9-9ed1-4eba-8560-d5fa05166b2e. {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 16:29:35 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-ac4c882a-87d8-4621-a63e-b4821140f626 req-cd942be9-4861-4cdc-9a07-1babebcd59a0 service nova] Acquiring lock "refresh_cache-5d50f597-3a29-4335-8166-6ab8e8149376" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 16:29:35 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-ac4c882a-87d8-4621-a63e-b4821140f626 req-cd942be9-4861-4cdc-9a07-1babebcd59a0 service nova] Acquired lock "refresh_cache-5d50f597-3a29-4335-8166-6ab8e8149376" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 16:29:35 user nova-compute[71731]: DEBUG nova.network.neutron [req-ac4c882a-87d8-4621-a63e-b4821140f626 req-cd942be9-4861-4cdc-9a07-1babebcd59a0 service nova] [instance: 5d50f597-3a29-4335-8166-6ab8e8149376] Refreshing network info cache for port cde3b0f9-9ed1-4eba-8560-d5fa05166b2e {{(pid=71731) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 16:29:35 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-c43be997-c2da-443a-a90f-b31a5a50f870 tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Acquiring lock "interface-5d50f597-3a29-4335-8166-6ab8e8149376-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:29:35 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-c43be997-c2da-443a-a90f-b31a5a50f870 tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Lock "interface-5d50f597-3a29-4335-8166-6ab8e8149376-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:29:35 user nova-compute[71731]: DEBUG nova.objects.instance [None req-c43be997-c2da-443a-a90f-b31a5a50f870 tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Lazy-loading 'flavor' on Instance uuid 5d50f597-3a29-4335-8166-6ab8e8149376 {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:29:35 user nova-compute[71731]: DEBUG nova.objects.instance [None req-c43be997-c2da-443a-a90f-b31a5a50f870 tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Lazy-loading 'pci_requests' on Instance uuid 5d50f597-3a29-4335-8166-6ab8e8149376 {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:29:35 user nova-compute[71731]: DEBUG nova.network.neutron [req-ac4c882a-87d8-4621-a63e-b4821140f626 req-cd942be9-4861-4cdc-9a07-1babebcd59a0 service nova] [instance: 5d50f597-3a29-4335-8166-6ab8e8149376] Updated VIF entry in instance network info cache for port cde3b0f9-9ed1-4eba-8560-d5fa05166b2e. {{(pid=71731) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 16:29:35 user nova-compute[71731]: DEBUG nova.network.neutron [req-ac4c882a-87d8-4621-a63e-b4821140f626 req-cd942be9-4861-4cdc-9a07-1babebcd59a0 service nova] [instance: 5d50f597-3a29-4335-8166-6ab8e8149376] Updating instance_info_cache with network_info: [{"id": "cde3b0f9-9ed1-4eba-8560-d5fa05166b2e", "address": "fa:16:3e:9d:e7:97", "network": {"id": "c790aafd-fad0-4403-bfad-05bbf49d23b2", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1464281989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c33fd5889ce4d0b983f529767005267", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcde3b0f9-9e", "ovs_interfaceid": "cde3b0f9-9ed1-4eba-8560-d5fa05166b2e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:29:35 user nova-compute[71731]: DEBUG nova.network.neutron [None req-c43be997-c2da-443a-a90f-b31a5a50f870 tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] [instance: 5d50f597-3a29-4335-8166-6ab8e8149376] allocate_for_instance() {{(pid=71731) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 16:29:35 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-ac4c882a-87d8-4621-a63e-b4821140f626 req-cd942be9-4861-4cdc-9a07-1babebcd59a0 service nova] Releasing lock "refresh_cache-5d50f597-3a29-4335-8166-6ab8e8149376" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 16:29:35 user nova-compute[71731]: DEBUG nova.policy [None req-c43be997-c2da-443a-a90f-b31a5a50f870 tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fa66202e2e5547d1b6e792557b335d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c33fd5889ce4d0b983f529767005267', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71731) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 16:29:36 user nova-compute[71731]: DEBUG nova.network.neutron [None req-c43be997-c2da-443a-a90f-b31a5a50f870 tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] [instance: 5d50f597-3a29-4335-8166-6ab8e8149376] Successfully created port: deb6fd31-3a87-439d-b59c-4f4dbf9a11bc {{(pid=71731) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 16:29:36 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:29:37 user nova-compute[71731]: DEBUG nova.network.neutron [None req-c43be997-c2da-443a-a90f-b31a5a50f870 tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] [instance: 5d50f597-3a29-4335-8166-6ab8e8149376] Successfully updated port: deb6fd31-3a87-439d-b59c-4f4dbf9a11bc {{(pid=71731) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 16:29:37 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-c43be997-c2da-443a-a90f-b31a5a50f870 tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Acquiring lock "refresh_cache-5d50f597-3a29-4335-8166-6ab8e8149376" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 16:29:37 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-c43be997-c2da-443a-a90f-b31a5a50f870 tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Acquired lock "refresh_cache-5d50f597-3a29-4335-8166-6ab8e8149376" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 16:29:37 user nova-compute[71731]: DEBUG nova.network.neutron [None req-c43be997-c2da-443a-a90f-b31a5a50f870 tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] [instance: 5d50f597-3a29-4335-8166-6ab8e8149376] Building network info cache for instance {{(pid=71731) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 16:29:37 user nova-compute[71731]: DEBUG nova.compute.manager [req-7dc52c63-9640-466a-9cbe-dedd9df61e4a req-8637e694-a25f-438f-b7a1-8fddae426f60 service nova] [instance: 5d50f597-3a29-4335-8166-6ab8e8149376] Received event network-changed-deb6fd31-3a87-439d-b59c-4f4dbf9a11bc {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:29:37 user nova-compute[71731]: DEBUG nova.compute.manager [req-7dc52c63-9640-466a-9cbe-dedd9df61e4a req-8637e694-a25f-438f-b7a1-8fddae426f60 service nova] [instance: 5d50f597-3a29-4335-8166-6ab8e8149376] Refreshing instance network info cache due to event network-changed-deb6fd31-3a87-439d-b59c-4f4dbf9a11bc. {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 16:29:37 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-7dc52c63-9640-466a-9cbe-dedd9df61e4a req-8637e694-a25f-438f-b7a1-8fddae426f60 service nova] Acquiring lock "refresh_cache-5d50f597-3a29-4335-8166-6ab8e8149376" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 16:29:37 user nova-compute[71731]: DEBUG nova.network.neutron [None req-c43be997-c2da-443a-a90f-b31a5a50f870 tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] [instance: 5d50f597-3a29-4335-8166-6ab8e8149376] Updating instance_info_cache with network_info: [{"id": "cde3b0f9-9ed1-4eba-8560-d5fa05166b2e", "address": "fa:16:3e:9d:e7:97", "network": {"id": "c790aafd-fad0-4403-bfad-05bbf49d23b2", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1464281989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c33fd5889ce4d0b983f529767005267", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcde3b0f9-9e", "ovs_interfaceid": "cde3b0f9-9ed1-4eba-8560-d5fa05166b2e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "deb6fd31-3a87-439d-b59c-4f4dbf9a11bc", "address": "fa:16:3e:f5:7f:d0", "network": {"id": "80e09f45-b799-4c16-8c74-ee57ad2c4b6e", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-165222833", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.226", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "3c33fd5889ce4d0b983f529767005267", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdeb6fd31-3a", "ovs_interfaceid": "deb6fd31-3a87-439d-b59c-4f4dbf9a11bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:29:37 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-c43be997-c2da-443a-a90f-b31a5a50f870 tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Releasing lock "refresh_cache-5d50f597-3a29-4335-8166-6ab8e8149376" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 16:29:37 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-7dc52c63-9640-466a-9cbe-dedd9df61e4a req-8637e694-a25f-438f-b7a1-8fddae426f60 service nova] Acquired lock "refresh_cache-5d50f597-3a29-4335-8166-6ab8e8149376" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 16:29:37 user nova-compute[71731]: DEBUG nova.network.neutron [req-7dc52c63-9640-466a-9cbe-dedd9df61e4a req-8637e694-a25f-438f-b7a1-8fddae426f60 service nova] [instance: 5d50f597-3a29-4335-8166-6ab8e8149376] Refreshing network info cache for port deb6fd31-3a87-439d-b59c-4f4dbf9a11bc {{(pid=71731) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 16:29:37 user nova-compute[71731]: DEBUG nova.virt.libvirt.vif [None req-c43be997-c2da-443a-a90f-b31a5a50f870 tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T16:27:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2052401344',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-2052401344',id=21,image_ref='708622a9-7465-4492-ade8-b827198f7e30',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAENxxbnK5TO5rrhClGAK4OGBjRSl2WhguyF+uaJMZFTdQImhP15imwNCemvjwOF1cJdEvHpeqOmPATUZWcFezxU2vmY8dwhasInHSqB5TQd2r6SmgLKfFX1fag2EbRN/A==',key_name='tempest-keypair-1469740557',keypairs=<?>,launch_index=0,launched_at=2023-04-13T16:27:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='3c33fd5889ce4d0b983f529767005267',ramdisk_id='',reservation_id='r-99cwosbm',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='708622a9-7465-4492-ade8-b827198f7e30',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1979050233',owner_user_name='tempest-TaggedAttachmentsTest-1979050233-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T16:27:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fa66202e2e5547d1b6e792557b335d0f',uuid=5d50f597-3a29-4335-8166-6ab8e8149376,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "deb6fd31-3a87-439d-b59c-4f4dbf9a11bc", "address": "fa:16:3e:f5:7f:d0", "network": {"id": "80e09f45-b799-4c16-8c74-ee57ad2c4b6e", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-165222833", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.226", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "3c33fd5889ce4d0b983f529767005267", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdeb6fd31-3a", "ovs_interfaceid": "deb6fd31-3a87-439d-b59c-4f4dbf9a11bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 16:29:37 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-c43be997-c2da-443a-a90f-b31a5a50f870 tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Converting VIF {"id": "deb6fd31-3a87-439d-b59c-4f4dbf9a11bc", "address": "fa:16:3e:f5:7f:d0", "network": {"id": "80e09f45-b799-4c16-8c74-ee57ad2c4b6e", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-165222833", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.226", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "3c33fd5889ce4d0b983f529767005267", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdeb6fd31-3a", "ovs_interfaceid": "deb6fd31-3a87-439d-b59c-4f4dbf9a11bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 16:29:37 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-c43be997-c2da-443a-a90f-b31a5a50f870 tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:7f:d0,bridge_name='br-int',has_traffic_filtering=True,id=deb6fd31-3a87-439d-b59c-4f4dbf9a11bc,network=Network(80e09f45-b799-4c16-8c74-ee57ad2c4b6e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdeb6fd31-3a') {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 16:29:37 user nova-compute[71731]: DEBUG os_vif [None req-c43be997-c2da-443a-a90f-b31a5a50f870 tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:7f:d0,bridge_name='br-int',has_traffic_filtering=True,id=deb6fd31-3a87-439d-b59c-4f4dbf9a11bc,network=Network(80e09f45-b799-4c16-8c74-ee57ad2c4b6e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdeb6fd31-3a') {{(pid=71731) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 16:29:37 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:29:37 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:29:37 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 16:29:37 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:29:37 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdeb6fd31-3a, may_exist=True) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:29:37 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapdeb6fd31-3a, col_values=(('external_ids', {'iface-id': 'deb6fd31-3a87-439d-b59c-4f4dbf9a11bc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f5:7f:d0', 'vm-uuid': '5d50f597-3a29-4335-8166-6ab8e8149376'}),)) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:29:37 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:29:37 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 16:29:37 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:29:37 user nova-compute[71731]: INFO os_vif [None req-c43be997-c2da-443a-a90f-b31a5a50f870 tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:7f:d0,bridge_name='br-int',has_traffic_filtering=True,id=deb6fd31-3a87-439d-b59c-4f4dbf9a11bc,network=Network(80e09f45-b799-4c16-8c74-ee57ad2c4b6e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdeb6fd31-3a')
Apr 13 16:29:37 user nova-compute[71731]: DEBUG nova.virt.libvirt.vif [None req-c43be997-c2da-443a-a90f-b31a5a50f870 tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T16:27:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2052401344',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-2052401344',id=21,image_ref='708622a9-7465-4492-ade8-b827198f7e30',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAENxxbnK5TO5rrhClGAK4OGBjRSl2WhguyF+uaJMZFTdQImhP15imwNCemvjwOF1cJdEvHpeqOmPATUZWcFezxU2vmY8dwhasInHSqB5TQd2r6SmgLKfFX1fag2EbRN/A==',key_name='tempest-keypair-1469740557',keypairs=<?>,launch_index=0,launched_at=2023-04-13T16:27:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='3c33fd5889ce4d0b983f529767005267',ramdisk_id='',reservation_id='r-99cwosbm',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='708622a9-7465-4492-ade8-b827198f7e30',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1979050233',owner_user_name='tempest-TaggedAttachmentsTest-1979050233-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T16:27:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fa66202e2e5547d1b6e792557b335d0f',uuid=5d50f597-3a29-4335-8166-6ab8e8149376,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "deb6fd31-3a87-439d-b59c-4f4dbf9a11bc", "address": "fa:16:3e:f5:7f:d0", "network": {"id": "80e09f45-b799-4c16-8c74-ee57ad2c4b6e", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-165222833", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.226", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "3c33fd5889ce4d0b983f529767005267", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdeb6fd31-3a", "ovs_interfaceid": "deb6fd31-3a87-439d-b59c-4f4dbf9a11bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71731) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 16:29:37 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-c43be997-c2da-443a-a90f-b31a5a50f870 tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Converting VIF {"id": "deb6fd31-3a87-439d-b59c-4f4dbf9a11bc", "address": "fa:16:3e:f5:7f:d0", "network": {"id": "80e09f45-b799-4c16-8c74-ee57ad2c4b6e", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-165222833", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.226", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "3c33fd5889ce4d0b983f529767005267", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdeb6fd31-3a", "ovs_interfaceid": "deb6fd31-3a87-439d-b59c-4f4dbf9a11bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 16:29:37 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-c43be997-c2da-443a-a90f-b31a5a50f870 tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:7f:d0,bridge_name='br-int',has_traffic_filtering=True,id=deb6fd31-3a87-439d-b59c-4f4dbf9a11bc,network=Network(80e09f45-b799-4c16-8c74-ee57ad2c4b6e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdeb6fd31-3a') {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 16:29:37 user nova-compute[71731]: DEBUG nova.virt.libvirt.guest [None req-c43be997-c2da-443a-a90f-b31a5a50f870 tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] attach device xml: <interface type="ethernet">
Apr 13 16:29:37 user nova-compute[71731]:   <mac address="fa:16:3e:f5:7f:d0"/>
Apr 13 16:29:37 user nova-compute[71731]:   <model type="virtio"/>
Apr 13 16:29:37 user nova-compute[71731]:   <mtu size="1442"/>
Apr 13 16:29:37 user nova-compute[71731]:   <target dev="tapdeb6fd31-3a"/>
Apr 13 16:29:37 user nova-compute[71731]: </interface>
Apr 13 16:29:37 user nova-compute[71731]:  {{(pid=71731) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 13 16:29:37 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:29:38 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:29:38 user nova-compute[71731]: DEBUG nova.compute.manager [req-9712e264-e805-4b7c-ab88-3296e455c4e0 req-9ab28491-6913-4637-9559-017a98c366ac service nova] [instance: 5d50f597-3a29-4335-8166-6ab8e8149376] Received event network-vif-plugged-deb6fd31-3a87-439d-b59c-4f4dbf9a11bc {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:29:38 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-9712e264-e805-4b7c-ab88-3296e455c4e0 req-9ab28491-6913-4637-9559-017a98c366ac service nova] Acquiring lock "5d50f597-3a29-4335-8166-6ab8e8149376-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:29:38 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-9712e264-e805-4b7c-ab88-3296e455c4e0 req-9ab28491-6913-4637-9559-017a98c366ac service nova] Lock "5d50f597-3a29-4335-8166-6ab8e8149376-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:29:38 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-9712e264-e805-4b7c-ab88-3296e455c4e0 req-9ab28491-6913-4637-9559-017a98c366ac service nova] Lock "5d50f597-3a29-4335-8166-6ab8e8149376-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:29:38 user nova-compute[71731]: DEBUG nova.compute.manager [req-9712e264-e805-4b7c-ab88-3296e455c4e0 req-9ab28491-6913-4637-9559-017a98c366ac service nova] [instance: 5d50f597-3a29-4335-8166-6ab8e8149376] No waiting events found dispatching network-vif-plugged-deb6fd31-3a87-439d-b59c-4f4dbf9a11bc {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:29:38 user nova-compute[71731]: WARNING nova.compute.manager [req-9712e264-e805-4b7c-ab88-3296e455c4e0 req-9ab28491-6913-4637-9559-017a98c366ac service nova] [instance: 5d50f597-3a29-4335-8166-6ab8e8149376] Received unexpected event network-vif-plugged-deb6fd31-3a87-439d-b59c-4f4dbf9a11bc for instance with vm_state active and task_state None.
Apr 13 16:29:38 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-c43be997-c2da-443a-a90f-b31a5a50f870 tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] No BDM found with device name vda, not building metadata. {{(pid=71731) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 16:29:38 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-c43be997-c2da-443a-a90f-b31a5a50f870 tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] No BDM found with device name hda, not building metadata. {{(pid=71731) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 16:29:38 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-c43be997-c2da-443a-a90f-b31a5a50f870 tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] No VIF found with MAC fa:16:3e:9d:e7:97, not building metadata {{(pid=71731) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 16:29:38 user nova-compute[71731]: DEBUG nova.virt.libvirt.guest [None req-c43be997-c2da-443a-a90f-b31a5a50f870 tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 16:29:38 user nova-compute[71731]:   <nova:package version="0.0.0"/>
Apr 13 16:29:38 user nova-compute[71731]:   <nova:name>tempest-device-tagging-server-2052401344</nova:name>
Apr 13 16:29:38 user nova-compute[71731]:   <nova:creationTime>2023-04-13 16:29:38</nova:creationTime>
Apr 13 16:29:38 user nova-compute[71731]:   <nova:flavor name="m1.nano">
Apr 13 16:29:38 user nova-compute[71731]:     <nova:memory>128</nova:memory>
Apr 13 16:29:38 user nova-compute[71731]:     <nova:disk>1</nova:disk>
Apr 13 16:29:38 user nova-compute[71731]:     <nova:swap>0</nova:swap>
Apr 13 16:29:38 user nova-compute[71731]:     <nova:ephemeral>0</nova:ephemeral>
Apr 13 16:29:38 user nova-compute[71731]:     <nova:vcpus>1</nova:vcpus>
Apr 13 16:29:38 user nova-compute[71731]:   </nova:flavor>
Apr 13 16:29:38 user nova-compute[71731]:   <nova:owner>
Apr 13 16:29:38 user nova-compute[71731]:     <nova:user uuid="fa66202e2e5547d1b6e792557b335d0f">tempest-TaggedAttachmentsTest-1979050233-project-member</nova:user>
Apr 13 16:29:38 user nova-compute[71731]:     <nova:project uuid="3c33fd5889ce4d0b983f529767005267">tempest-TaggedAttachmentsTest-1979050233</nova:project>
Apr 13 16:29:38 user nova-compute[71731]:   </nova:owner>
Apr 13 16:29:38 user nova-compute[71731]:   <nova:root type="image" uuid="708622a9-7465-4492-ade8-b827198f7e30"/>
Apr 13 16:29:38 user nova-compute[71731]:   <nova:ports>
Apr 13 16:29:38 user nova-compute[71731]:     <nova:port uuid="cde3b0f9-9ed1-4eba-8560-d5fa05166b2e">
Apr 13 16:29:38 user nova-compute[71731]:       <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Apr 13 16:29:38 user nova-compute[71731]:     </nova:port>
Apr 13 16:29:38 user nova-compute[71731]:     <nova:port uuid="deb6fd31-3a87-439d-b59c-4f4dbf9a11bc">
Apr 13 16:29:38 user nova-compute[71731]:       <nova:ip type="fixed" address="10.10.10.226" ipVersion="4"/>
Apr 13 16:29:38 user nova-compute[71731]:     </nova:port>
Apr 13 16:29:38 user nova-compute[71731]:   </nova:ports>
Apr 13 16:29:38 user nova-compute[71731]: </nova:instance>
Apr 13 16:29:38 user nova-compute[71731]:  {{(pid=71731) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Apr 13 16:29:38 user nova-compute[71731]: DEBUG nova.network.neutron [req-7dc52c63-9640-466a-9cbe-dedd9df61e4a req-8637e694-a25f-438f-b7a1-8fddae426f60 service nova] [instance: 5d50f597-3a29-4335-8166-6ab8e8149376] Updated VIF entry in instance network info cache for port deb6fd31-3a87-439d-b59c-4f4dbf9a11bc. {{(pid=71731) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 16:29:38 user nova-compute[71731]: DEBUG nova.network.neutron [req-7dc52c63-9640-466a-9cbe-dedd9df61e4a req-8637e694-a25f-438f-b7a1-8fddae426f60 service nova] [instance: 5d50f597-3a29-4335-8166-6ab8e8149376] Updating instance_info_cache with network_info: [{"id": "cde3b0f9-9ed1-4eba-8560-d5fa05166b2e", "address": "fa:16:3e:9d:e7:97", "network": {"id": "c790aafd-fad0-4403-bfad-05bbf49d23b2", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1464281989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c33fd5889ce4d0b983f529767005267", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcde3b0f9-9e", "ovs_interfaceid": "cde3b0f9-9ed1-4eba-8560-d5fa05166b2e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "deb6fd31-3a87-439d-b59c-4f4dbf9a11bc", "address": "fa:16:3e:f5:7f:d0", "network": {"id": "80e09f45-b799-4c16-8c74-ee57ad2c4b6e", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-165222833", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.226", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "3c33fd5889ce4d0b983f529767005267", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdeb6fd31-3a", "ovs_interfaceid": "deb6fd31-3a87-439d-b59c-4f4dbf9a11bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:29:38 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-c43be997-c2da-443a-a90f-b31a5a50f870 tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Lock "interface-5d50f597-3a29-4335-8166-6ab8e8149376-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 2.934s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:29:38 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-7dc52c63-9640-466a-9cbe-dedd9df61e4a req-8637e694-a25f-438f-b7a1-8fddae426f60 service nova] Releasing lock "refresh_cache-5d50f597-3a29-4335-8166-6ab8e8149376" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 16:29:38 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-ef04bf9c-d554-4767-be2e-adabe6106b03 tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Acquiring lock "5d50f597-3a29-4335-8166-6ab8e8149376" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:29:38 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-ef04bf9c-d554-4767-be2e-adabe6106b03 tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Lock "5d50f597-3a29-4335-8166-6ab8e8149376" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:29:38 user nova-compute[71731]: DEBUG nova.objects.instance [None req-ef04bf9c-d554-4767-be2e-adabe6106b03 tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Lazy-loading 'flavor' on Instance uuid 5d50f597-3a29-4335-8166-6ab8e8149376 {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:29:38 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-ef04bf9c-d554-4767-be2e-adabe6106b03 tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Lock "5d50f597-3a29-4335-8166-6ab8e8149376" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:29:38 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-ef04bf9c-d554-4767-be2e-adabe6106b03 tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Acquiring lock "5d50f597-3a29-4335-8166-6ab8e8149376" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:29:38 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-ef04bf9c-d554-4767-be2e-adabe6106b03 tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Lock "5d50f597-3a29-4335-8166-6ab8e8149376" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:29:38 user nova-compute[71731]: INFO nova.compute.manager [None req-ef04bf9c-d554-4767-be2e-adabe6106b03 tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] [instance: 5d50f597-3a29-4335-8166-6ab8e8149376] Attaching volume bc906e31-eece-4b17-adf4-55ad76b7e51a to /dev/vdb
Apr 13 16:29:38 user nova-compute[71731]: DEBUG os_brick.utils [None req-ef04bf9c-d554-4767-be2e-adabe6106b03 tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 16:29:38 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:29:39 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:29:39 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[32d2daa0-e7fc-4ee7-8cd7-aa7cddb120a3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:81501d91421\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:29:39 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:29:39 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:29:39 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:29:39 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:29:39 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:29:39 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d8a1c59-0061-4c5b-8407-38be4cf952a7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:29:39 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:29:39 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:29:39 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:29:39 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[80a9f66d-57d0-4f90-9383-bbbd38c8112b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:29:39 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[49d90e49-b6e8-477f-a97c-9ec21b100ffe]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:29:39 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-ef04bf9c-d554-4767-be2e-adabe6106b03 tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Running cmd (subprocess): nvme version {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:29:39 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-ef04bf9c-d554-4767-be2e-adabe6106b03 tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] 'nvme version' failed. Not Retrying. {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 16:29:39 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ef04bf9c-d554-4767-be2e-adabe6106b03 tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] nvme not present on system {{(pid=71731) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 16:29:39 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:29:39 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 16:29:39 user nova-compute[71731]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 16:29:39 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c05fb54-02ed-4ef4-aa6f-ebbfcef2a209]: (4, '') {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:29:39 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.lightos [None req-ef04bf9c-d554-4767-be2e-adabe6106b03 tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71731) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 16:29:39 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.lightos [None req-ef04bf9c-d554-4767-be2e-adabe6106b03 tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71731) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 16:29:39 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.lightos [None req-ef04bf9c-d554-4767-be2e-adabe6106b03 tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] LIGHTOS: no hostnqn found. {{(pid=71731) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 16:29:39 user nova-compute[71731]: DEBUG os_brick.utils [None req-ef04bf9c-d554-4767-be2e-adabe6106b03 tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:81501d91421', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 16:29:39 user nova-compute[71731]: DEBUG nova.virt.block_device [None req-ef04bf9c-d554-4767-be2e-adabe6106b03 tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] [instance: 5d50f597-3a29-4335-8166-6ab8e8149376] Updating existing volume attachment record: 1ce00a66-4bd3-4207-8cb7-56cb6ba39a1e {{(pid=71731) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 16:29:40 user nova-compute[71731]: DEBUG nova.compute.manager [req-6da46d02-9025-4015-ba4a-f4a3cde0af2e req-46bef7cf-ab54-415c-bf91-cd43c9f02180 service nova] [instance: 5d50f597-3a29-4335-8166-6ab8e8149376] Received event network-vif-plugged-deb6fd31-3a87-439d-b59c-4f4dbf9a11bc {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:29:40 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-6da46d02-9025-4015-ba4a-f4a3cde0af2e req-46bef7cf-ab54-415c-bf91-cd43c9f02180 service nova] Acquiring lock "5d50f597-3a29-4335-8166-6ab8e8149376-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:29:40 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-6da46d02-9025-4015-ba4a-f4a3cde0af2e req-46bef7cf-ab54-415c-bf91-cd43c9f02180 service nova] Lock "5d50f597-3a29-4335-8166-6ab8e8149376-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:29:40 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-6da46d02-9025-4015-ba4a-f4a3cde0af2e req-46bef7cf-ab54-415c-bf91-cd43c9f02180 service nova] Lock "5d50f597-3a29-4335-8166-6ab8e8149376-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:29:40 user nova-compute[71731]: DEBUG nova.compute.manager [req-6da46d02-9025-4015-ba4a-f4a3cde0af2e req-46bef7cf-ab54-415c-bf91-cd43c9f02180 service nova] [instance: 5d50f597-3a29-4335-8166-6ab8e8149376] No waiting events found dispatching network-vif-plugged-deb6fd31-3a87-439d-b59c-4f4dbf9a11bc {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:29:40 user nova-compute[71731]: WARNING nova.compute.manager [req-6da46d02-9025-4015-ba4a-f4a3cde0af2e req-46bef7cf-ab54-415c-bf91-cd43c9f02180 service nova] [instance: 5d50f597-3a29-4335-8166-6ab8e8149376] Received unexpected event network-vif-plugged-deb6fd31-3a87-439d-b59c-4f4dbf9a11bc for instance with vm_state active and task_state None.
Apr 13 16:29:41 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:29:42 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:29:45 user nova-compute[71731]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ef04bf9c-d554-4767-be2e-adabe6106b03 tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] [instance: 5d50f597-3a29-4335-8166-6ab8e8149376] Calling os-brick to attach iSCSI Volume {{(pid=71731) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 16:29:45 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef04bf9c-d554-4767-be2e-adabe6106b03 tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8cf0118790>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:bc906e31-eece-4b17-adf4-55ad76b7e51a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sWlpktRw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 16:29:45 user nova-compute[71731]: WARNING os_brick.initiator.connectors.base [None req-ef04bf9c-d554-4767-be2e-adabe6106b03 tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 16:29:45 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-ef04bf9c-d554-4767-be2e-adabe6106b03 tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 16:29:45 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-ef04bf9c-d554-4767-be2e-adabe6106b03 tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 16:29:45 user nova-compute[71731]: WARNING os_brick.initiator.connectors.base [None req-ef04bf9c-d554-4767-be2e-adabe6106b03 tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 16:29:45 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-ef04bf9c-d554-4767-be2e-adabe6106b03 tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bc906e31-eece-4b17-adf4-55ad76b7e51a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 16:29:45 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-ef04bf9c-d554-4767-be2e-adabe6106b03 tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bc906e31-eece-4b17-adf4-55ad76b7e51a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 16:29:45 user nova-compute[71731]: INFO os_brick.initiator.connectors.iscsi [None req-ef04bf9c-d554-4767-be2e-adabe6106b03 tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 16:29:45 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc906e31-eece-4b17-adf4-55ad76b7e51a -p 172.16.0.220:3260 {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:29:45 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc906e31-eece-4b17-adf4-55ad76b7e51a -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:29:45 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7907c71-ea5d-4fbe-835b-d9d61694b315]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:29:45 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef04bf9c-d554-4767-be2e-adabe6106b03 tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 16:29:45 user nova-compute[71731]:  {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:29:45 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc906e31-eece-4b17-adf4-55ad76b7e51a -p 172.16.0.220:3260 --interface default --op new {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:29:45 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc906e31-eece-4b17-adf4-55ad76b7e51a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:29:45 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9b776c6-2d5a-44ee-84c8-e009483e3c96]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bc906e31-eece-4b17-adf4-55ad76b7e51a] added\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:29:45 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef04bf9c-d554-4767-be2e-adabe6106b03 tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bc906e31-eece-4b17-adf4-55ad76b7e51a] added
Apr 13 16:29:45 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:29:45 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc906e31-eece-4b17-adf4-55ad76b7e51a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:29:45 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc906e31-eece-4b17-adf4-55ad76b7e51a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:29:45 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe56efe4-3234-4aea-bc18-b6b15236158a]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:29:45 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef04bf9c-d554-4767-be2e-adabe6106b03 tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:29:45 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc906e31-eece-4b17-adf4-55ad76b7e51a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:29:45 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc906e31-eece-4b17-adf4-55ad76b7e51a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:29:45 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6bba9cb-a592-40c8-897e-965c327b6489]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:29:45 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef04bf9c-d554-4767-be2e-adabe6106b03 tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:29:45 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc906e31-eece-4b17-adf4-55ad76b7e51a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sWlpktRw {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:29:45 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc906e31-eece-4b17-adf4-55ad76b7e51a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sWlpktRw" returned: 0 in 0.027s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:29:45 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2c7c777-77c9-4067-9491-0df5577e2317]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:29:45 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef04bf9c-d554-4767-be2e-adabe6106b03 tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'sWlpktRw'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:29:45 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc906e31-eece-4b17-adf4-55ad76b7e51a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:29:45 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc906e31-eece-4b17-adf4-55ad76b7e51a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:29:45 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[183da282-9ce8-448a-9416-36f294ca240f]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:29:45 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef04bf9c-d554-4767-be2e-adabe6106b03 tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:29:45 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:29:45 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:29:45 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bc54b3b-329b-4e2d-836e-39cb653a28aa]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4317bfd-71c2-4c48-a0f0-e3c795f262a8 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d53e720e-a9ca-499b-aacd-aad1a169a874 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb2c60ec-fb52-436f-a98a-dfe15d1e3aa6 (non-flash)\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:29:45 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef04bf9c-d554-4767-be2e-adabe6106b03 tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)
Apr 13 16:29:45 user nova-compute[71731]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4317bfd-71c2-4c48-a0f0-e3c795f262a8 (non-flash)
Apr 13 16:29:45 user nova-compute[71731]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d53e720e-a9ca-499b-aacd-aad1a169a874 (non-flash)
Apr 13 16:29:45 user nova-compute[71731]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb2c60ec-fb52-436f-a98a-dfe15d1e3aa6 (non-flash)
Apr 13 16:29:45 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 16:29:45 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef04bf9c-d554-4767-be2e-adabe6106b03 tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)
Apr 13 16:29:45 user nova-compute[71731]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4317bfd-71c2-4c48-a0f0-e3c795f262a8 (non-flash)
Apr 13 16:29:45 user nova-compute[71731]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d53e720e-a9ca-499b-aacd-aad1a169a874 (non-flash)
Apr 13 16:29:45 user nova-compute[71731]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb2c60ec-fb52-436f-a98a-dfe15d1e3aa6 (non-flash)
Apr 13 16:29:45 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 16:29:45 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc906e31-eece-4b17-adf4-55ad76b7e51a -p 172.16.0.220:3260 --login {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:29:45 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc906e31-eece-4b17-adf4-55ad76b7e51a -p 172.16.0.220:3260 --login" returned: 0 in 0.081s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:29:45 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f31d483-893a-45ab-b393-8b1f65acc9d1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bc906e31-eece-4b17-adf4-55ad76b7e51a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bc906e31-eece-4b17-adf4-55ad76b7e51a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:29:45 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef04bf9c-d554-4767-be2e-adabe6106b03 tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bc906e31-eece-4b17-adf4-55ad76b7e51a, portal: 172.16.0.220,3260]
Apr 13 16:29:45 user nova-compute[71731]: Login to [iface: default, target: iqn.2010-10.org.openstack:bc906e31-eece-4b17-adf4-55ad76b7e51a, portal: 172.16.0.220,3260] successful.
Apr 13 16:29:45 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:29:45 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc906e31-eece-4b17-adf4-55ad76b7e51a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:29:45 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-9e46175c-c4ac-4ce5-8e70-84d97a448bb7 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Acquiring lock "5ea4ab6a-6501-4a2f-a8f7-04090024747d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:29:45 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-9e46175c-c4ac-4ce5-8e70-84d97a448bb7 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "5ea4ab6a-6501-4a2f-a8f7-04090024747d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:29:45 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-9e46175c-c4ac-4ce5-8e70-84d97a448bb7 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Acquiring lock "5ea4ab6a-6501-4a2f-a8f7-04090024747d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:29:45 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-9e46175c-c4ac-4ce5-8e70-84d97a448bb7 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "5ea4ab6a-6501-4a2f-a8f7-04090024747d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:29:45 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-9e46175c-c4ac-4ce5-8e70-84d97a448bb7 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "5ea4ab6a-6501-4a2f-a8f7-04090024747d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:29:45 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc906e31-eece-4b17-adf4-55ad76b7e51a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:29:45 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[067d1385-b4b4-4c33-8117-b1740ee1cf91]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:29:45 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef04bf9c-d554-4767-be2e-adabe6106b03 tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:29:45 user nova-compute[71731]: INFO nova.compute.manager [None req-9e46175c-c4ac-4ce5-8e70-84d97a448bb7 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 5ea4ab6a-6501-4a2f-a8f7-04090024747d] Terminating instance
Apr 13 16:29:45 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:29:45 user nova-compute[71731]: DEBUG nova.compute.manager [None req-9e46175c-c4ac-4ce5-8e70-84d97a448bb7 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 5ea4ab6a-6501-4a2f-a8f7-04090024747d] Start destroying the instance on the hypervisor. {{(pid=71731) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 16:29:45 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:29:45 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[84ef0946-ec37-402b-9b12-66beb6a31ab4]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4317bfd-71c2-4c48-a0f0-e3c795f262a8 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d53e720e-a9ca-499b-aacd-aad1a169a874 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb2c60ec-fb52-436f-a98a-dfe15d1e3aa6 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc906e31-eece-4b17-adf4-55ad76b7e51a (non-flash)\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:29:45 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef04bf9c-d554-4767-be2e-adabe6106b03 tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)
Apr 13 16:29:45 user nova-compute[71731]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4317bfd-71c2-4c48-a0f0-e3c795f262a8 (non-flash)
Apr 13 16:29:45 user nova-compute[71731]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d53e720e-a9ca-499b-aacd-aad1a169a874 (non-flash)
Apr 13 16:29:45 user nova-compute[71731]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb2c60ec-fb52-436f-a98a-dfe15d1e3aa6 (non-flash)
Apr 13 16:29:45 user nova-compute[71731]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc906e31-eece-4b17-adf4-55ad76b7e51a (non-flash)
Apr 13 16:29:45 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 16:29:45 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef04bf9c-d554-4767-be2e-adabe6106b03 tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)
Apr 13 16:29:45 user nova-compute[71731]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4317bfd-71c2-4c48-a0f0-e3c795f262a8 (non-flash)
Apr 13 16:29:45 user nova-compute[71731]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d53e720e-a9ca-499b-aacd-aad1a169a874 (non-flash)
Apr 13 16:29:45 user nova-compute[71731]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb2c60ec-fb52-436f-a98a-dfe15d1e3aa6 (non-flash)
Apr 13 16:29:45 user nova-compute[71731]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc906e31-eece-4b17-adf4-55ad76b7e51a (non-flash)
Apr 13 16:29:45 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 16:29:45 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-ef04bf9c-d554-4767-be2e-adabe6106b03 tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bc906e31-eece-4b17-adf4-55ad76b7e51a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.341s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 16:29:45 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef04bf9c-d554-4767-be2e-adabe6106b03 tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Connected to 172.16.0.220:3260 {{(pid=71731) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 16:29:45 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-ef04bf9c-d554-4767-be2e-adabe6106b03 tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] HCTL ('33', '-', '-', 0) found on session 27 with lun 0 {{(pid=71731) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 16:29:45 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-ef04bf9c-d554-4767-be2e-adabe6106b03 tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71731) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 16:29:45 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:29:45 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:29:45 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a89364d-245b-4b30-92af-f094344a01a5]: (4, ('- - 0', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:29:45 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-ef04bf9c-d554-4767-be2e-adabe6106b03 tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Searching for a device in session 27 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71731) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 16:29:45 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef04bf9c-d554-4767-be2e-adabe6106b03 tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:bc906e31-eece-4b17-adf4-55ad76b7e51a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sWlpktRw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71731) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 16:29:45 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:29:45 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:29:45 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:29:45 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:29:45 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:29:45 user nova-compute[71731]: DEBUG nova.compute.manager [req-fefecb84-49b3-433a-9dd2-62ea6ab3780c req-dd4a5c56-6445-4090-98a1-60cf05146e02 service nova] [instance: 5ea4ab6a-6501-4a2f-a8f7-04090024747d] Received event network-vif-unplugged-8a5c66fa-4693-4162-b5a8-2c80b33cf979 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:29:45 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-fefecb84-49b3-433a-9dd2-62ea6ab3780c req-dd4a5c56-6445-4090-98a1-60cf05146e02 service nova] Acquiring lock "5ea4ab6a-6501-4a2f-a8f7-04090024747d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:29:45 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-fefecb84-49b3-433a-9dd2-62ea6ab3780c req-dd4a5c56-6445-4090-98a1-60cf05146e02 service nova] Lock "5ea4ab6a-6501-4a2f-a8f7-04090024747d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:29:45 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-fefecb84-49b3-433a-9dd2-62ea6ab3780c req-dd4a5c56-6445-4090-98a1-60cf05146e02 service nova] Lock "5ea4ab6a-6501-4a2f-a8f7-04090024747d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:29:45 user nova-compute[71731]: DEBUG nova.compute.manager [req-fefecb84-49b3-433a-9dd2-62ea6ab3780c req-dd4a5c56-6445-4090-98a1-60cf05146e02 service nova] [instance: 5ea4ab6a-6501-4a2f-a8f7-04090024747d] No waiting events found dispatching network-vif-unplugged-8a5c66fa-4693-4162-b5a8-2c80b33cf979 {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:29:45 user nova-compute[71731]: DEBUG nova.compute.manager [req-fefecb84-49b3-433a-9dd2-62ea6ab3780c req-dd4a5c56-6445-4090-98a1-60cf05146e02 service nova] [instance: 5ea4ab6a-6501-4a2f-a8f7-04090024747d] Received event network-vif-unplugged-8a5c66fa-4693-4162-b5a8-2c80b33cf979 for instance with task_state deleting. {{(pid=71731) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 16:29:46 user nova-compute[71731]: INFO nova.virt.libvirt.driver [-] [instance: 5ea4ab6a-6501-4a2f-a8f7-04090024747d] Instance destroyed successfully.
Apr 13 16:29:46 user nova-compute[71731]: DEBUG nova.objects.instance [None req-9e46175c-c4ac-4ce5-8e70-84d97a448bb7 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lazy-loading 'resources' on Instance uuid 5ea4ab6a-6501-4a2f-a8f7-04090024747d {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:29:46 user nova-compute[71731]: DEBUG nova.virt.libvirt.vif [None req-9e46175c-c4ac-4ce5-8e70-84d97a448bb7 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T16:25:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1961905208',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1961905208',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1961905208',id=19,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-13T16:25:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8d451e0e239f486aa2b3abe9e273eab3',ramdisk_id='',reservation_id='r-o0bt6f2g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-438786227',owner_user_name='tempest-TestVolumeBootPattern-438786227-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T16:25:19Z,user_data=None,user_id='d70e10f63cdd49a9a1ebe1fe4c9de0a2',uuid=5ea4ab6a-6501-4a2f-a8f7-04090024747d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8a5c66fa-4693-4162-b5a8-2c80b33cf979", "address": "fa:16:3e:78:06:8d", "network": {"id": "d36bc206-f629-4d6e-8a3f-458061d7b525", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-893271134-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d451e0e239f486aa2b3abe9e273eab3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a5c66fa-46", "ovs_interfaceid": "8a5c66fa-4693-4162-b5a8-2c80b33cf979", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 16:29:46 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-9e46175c-c4ac-4ce5-8e70-84d97a448bb7 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Converting VIF {"id": "8a5c66fa-4693-4162-b5a8-2c80b33cf979", "address": "fa:16:3e:78:06:8d", "network": {"id": "d36bc206-f629-4d6e-8a3f-458061d7b525", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-893271134-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d451e0e239f486aa2b3abe9e273eab3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a5c66fa-46", "ovs_interfaceid": "8a5c66fa-4693-4162-b5a8-2c80b33cf979", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 16:29:46 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-9e46175c-c4ac-4ce5-8e70-84d97a448bb7 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:78:06:8d,bridge_name='br-int',has_traffic_filtering=True,id=8a5c66fa-4693-4162-b5a8-2c80b33cf979,network=Network(d36bc206-f629-4d6e-8a3f-458061d7b525),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a5c66fa-46') {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 16:29:46 user nova-compute[71731]: DEBUG os_vif [None req-9e46175c-c4ac-4ce5-8e70-84d97a448bb7 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:78:06:8d,bridge_name='br-int',has_traffic_filtering=True,id=8a5c66fa-4693-4162-b5a8-2c80b33cf979,network=Network(d36bc206-f629-4d6e-8a3f-458061d7b525),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a5c66fa-46') {{(pid=71731) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 16:29:46 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:29:46 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8a5c66fa-46, bridge=br-int, if_exists=True) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:29:46 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:29:46 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:29:46 user nova-compute[71731]: INFO os_vif [None req-9e46175c-c4ac-4ce5-8e70-84d97a448bb7 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:78:06:8d,bridge_name='br-int',has_traffic_filtering=True,id=8a5c66fa-4693-4162-b5a8-2c80b33cf979,network=Network(d36bc206-f629-4d6e-8a3f-458061d7b525),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a5c66fa-46')
Apr 13 16:29:46 user nova-compute[71731]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9e46175c-c4ac-4ce5-8e70-84d97a448bb7 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 5ea4ab6a-6501-4a2f-a8f7-04090024747d] calling os-brick to detach iSCSI Volume {{(pid=71731) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 16:29:46 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e46175c-c4ac-4ce5-8e70-84d97a448bb7 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8cf0118790>, {'target_iqn': 'iqn.2010-10.org.openstack:e4317bfd-71c2-4c48-a0f0-e3c795f262a8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tPRqdNic', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 16:29:46 user nova-compute[71731]: WARNING os_brick.initiator.connectors.base [None req-9e46175c-c4ac-4ce5-8e70-84d97a448bb7 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 16:29:46 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-9e46175c-c4ac-4ce5-8e70-84d97a448bb7 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 16:29:46 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-ef04bf9c-d554-4767-be2e-adabe6106b03 tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.376s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 16:29:46 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef04bf9c-d554-4767-be2e-adabe6106b03 tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] <== connect_volume: return (1377ms) {'type': 'block', 'scsi_wwn': '26335333738616330', 'path': '/dev/sdb'} {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 16:29:46 user nova-compute[71731]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ef04bf9c-d554-4767-be2e-adabe6106b03 tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] [instance: 5d50f597-3a29-4335-8166-6ab8e8149376] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26335333738616330', 'path': '/dev/sdb'} {{(pid=71731) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 16:29:46 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-9e46175c-c4ac-4ce5-8e70-84d97a448bb7 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.286s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 16:29:46 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:29:46 user nova-compute[71731]: DEBUG nova.objects.instance [None req-ef04bf9c-d554-4767-be2e-adabe6106b03 tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Lazy-loading 'flavor' on Instance uuid 5d50f597-3a29-4335-8166-6ab8e8149376 {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:29:46 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:29:46 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[58996974-ed77-4cf8-b87a-3cfda9be8985]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e4317bfd-71c2-4c48-a0f0-e3c795f262a8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:eb2c60ec-fb52-436f-a98a-dfe15d1e3aa6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d53e720e-a9ca-499b-aacd-aad1a169a874\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bc906e31-eece-4b17-adf4-55ad76b7e51a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:29:46 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e46175c-c4ac-4ce5-8e70-84d97a448bb7 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 16:29:46 user nova-compute[71731]: No targets found.
Apr 13 16:29:46 user nova-compute[71731]: iSNS:
Apr 13 16:29:46 user nova-compute[71731]: No targets found.
Apr 13 16:29:46 user nova-compute[71731]: STATIC:
Apr 13 16:29:46 user nova-compute[71731]: Target: iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97
Apr 13 16:29:46 user nova-compute[71731]:         Portal: 172.16.0.220:3260,-1
Apr 13 16:29:46 user nova-compute[71731]:                 Iface Name: default
Apr 13 16:29:46 user nova-compute[71731]: Target: iqn.2010-10.org.openstack:e4317bfd-71c2-4c48-a0f0-e3c795f262a8
Apr 13 16:29:46 user nova-compute[71731]:         Portal: 172.16.0.220:3260,-1
Apr 13 16:29:46 user nova-compute[71731]:                 Iface Name: default
Apr 13 16:29:46 user nova-compute[71731]: Target: iqn.2010-10.org.openstack:eb2c60ec-fb52-436f-a98a-dfe15d1e3aa6
Apr 13 16:29:46 user nova-compute[71731]:         Portal: 172.16.0.220:3260,-1
Apr 13 16:29:46 user nova-compute[71731]:                 Iface Name: default
Apr 13 16:29:46 user nova-compute[71731]: Target: iqn.2010-10.org.openstack:d53e720e-a9ca-499b-aacd-aad1a169a874
Apr 13 16:29:46 user nova-compute[71731]:         Portal: 172.16.0.220:3260,-1
Apr 13 16:29:46 user nova-compute[71731]:                 Iface Name: default
Apr 13 16:29:46 user nova-compute[71731]: Target: iqn.2010-10.org.openstack:bc906e31-eece-4b17-adf4-55ad76b7e51a
Apr 13 16:29:46 user nova-compute[71731]:         Portal: 172.16.0.220:3260,-1
Apr 13 16:29:46 user nova-compute[71731]:                 Iface Name: default
Apr 13 16:29:46 user nova-compute[71731]: FIRMWARE:
Apr 13 16:29:46 user nova-compute[71731]: No targets found.
Apr 13 16:29:46 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 16:29:46 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e46175c-c4ac-4ce5-8e70-84d97a448bb7 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 16:29:46 user nova-compute[71731]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 16:29:46 user nova-compute[71731]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71731) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 16:29:46 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e46175c-c4ac-4ce5-8e70-84d97a448bb7 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e4317bfd-71c2-4c48-a0f0-e3c795f262a8', 0)] {{(pid=71731) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 16:29:46 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:29:46 user nova-compute[71731]: DEBUG nova.virt.libvirt.guest [None req-ef04bf9c-d554-4767-be2e-adabe6106b03 tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] attach device xml: <disk type="block" device="disk">
Apr 13 16:29:46 user nova-compute[71731]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 16:29:46 user nova-compute[71731]:   <source dev="/dev/sdb"/>
Apr 13 16:29:46 user nova-compute[71731]:   <target dev="vdb" bus="virtio"/>
Apr 13 16:29:46 user nova-compute[71731]:   <serial>bc906e31-eece-4b17-adf4-55ad76b7e51a</serial>
Apr 13 16:29:46 user nova-compute[71731]: </disk>
Apr 13 16:29:46 user nova-compute[71731]:  {{(pid=71731) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 13 16:29:46 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:29:46 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:29:46 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[56b36f4d-b032-4c95-b76f-07397a68f67d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bc906e31-eece-4b17-adf4-55ad76b7e51a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d53e720e-a9ca-499b-aacd-aad1a169a874\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e4317bfd-71c2-4c48-a0f0-e3c795f262a8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eb2c60ec-fb52-436f-a98a-dfe15d1e3aa6\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:29:46 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:29:46 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:29:46 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f290af8-0e2e-4827-83bb-dd84e15e174e]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4317bfd-71c2-4c48-a0f0-e3c795f262a8 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d53e720e-a9ca-499b-aacd-aad1a169a874 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb2c60ec-fb52-436f-a98a-dfe15d1e3aa6 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc906e31-eece-4b17-adf4-55ad76b7e51a (non-flash)\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:29:46 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e46175c-c4ac-4ce5-8e70-84d97a448bb7 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)
Apr 13 16:29:46 user nova-compute[71731]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4317bfd-71c2-4c48-a0f0-e3c795f262a8 (non-flash)
Apr 13 16:29:46 user nova-compute[71731]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d53e720e-a9ca-499b-aacd-aad1a169a874 (non-flash)
Apr 13 16:29:46 user nova-compute[71731]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb2c60ec-fb52-436f-a98a-dfe15d1e3aa6 (non-flash)
Apr 13 16:29:46 user nova-compute[71731]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc906e31-eece-4b17-adf4-55ad76b7e51a (non-flash)
Apr 13 16:29:46 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 16:29:46 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e46175c-c4ac-4ce5-8e70-84d97a448bb7 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)
Apr 13 16:29:46 user nova-compute[71731]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4317bfd-71c2-4c48-a0f0-e3c795f262a8 (non-flash)
Apr 13 16:29:46 user nova-compute[71731]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d53e720e-a9ca-499b-aacd-aad1a169a874 (non-flash)
Apr 13 16:29:46 user nova-compute[71731]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb2c60ec-fb52-436f-a98a-dfe15d1e3aa6 (non-flash)
Apr 13 16:29:46 user nova-compute[71731]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc906e31-eece-4b17-adf4-55ad76b7e51a (non-flash)
Apr 13 16:29:46 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 16:29:46 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e46175c-c4ac-4ce5-8e70-84d97a448bb7 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8cff4cc430>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e4317bfd-71c2-4c48-a0f0-e3c795f262a8'): ({'sdd'}, set())}) {{(pid=71731) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 16:29:46 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-9e46175c-c4ac-4ce5-8e70-84d97a448bb7 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Removing single pathed devices sdd {{(pid=71731) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 16:29:46 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:29:46 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:29:46 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[85501123-b569-46bc-a8b7-cf836f6ca692]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:29:46 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:29:46 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:29:46 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[e47c363b-ad46-4237-9b1f-15dee2db2a69]: (4, ('ok\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:29:46 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-9e46175c-c4ac-4ce5-8e70-84d97a448bb7 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Flushing IO for device /dev/sdd {{(pid=71731) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 16:29:46 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:29:46 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:29:46 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[02a9eb13-2e77-4990-8bb8-faac53e45324]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:29:46 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-9e46175c-c4ac-4ce5-8e70-84d97a448bb7 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=71731) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 16:29:46 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:29:46 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.046s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:29:46 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd27abf6-3158-4884-bb9d-79ff80c0dc6f]: (4, ('1', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:29:46 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-9e46175c-c4ac-4ce5-8e70-84d97a448bb7 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=71731) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 16:29:46 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-9e46175c-c4ac-4ce5-8e70-84d97a448bb7 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] SCSI volumes sdd have been removed. {{(pid=71731) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 16:29:46 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e46175c-c4ac-4ce5-8e70-84d97a448bb7 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e4317bfd-71c2-4c48-a0f0-e3c795f262a8')] {{(pid=71731) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 16:29:46 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4317bfd-71c2-4c48-a0f0-e3c795f262a8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:29:46 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4317bfd-71c2-4c48-a0f0-e3c795f262a8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:29:46 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f94208d-d087-4904-bd0c-5e13aea70f22]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:29:46 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e46175c-c4ac-4ce5-8e70-84d97a448bb7 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:29:46 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4317bfd-71c2-4c48-a0f0-e3c795f262a8 -p 172.16.0.220:3260 --logout {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:29:46 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4317bfd-71c2-4c48-a0f0-e3c795f262a8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.081s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:29:46 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[993a2fe8-5fa0-47d9-b9e6-8778310bed51]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:e4317bfd-71c2-4c48-a0f0-e3c795f262a8, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:e4317bfd-71c2-4c48-a0f0-e3c795f262a8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:29:46 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e46175c-c4ac-4ce5-8e70-84d97a448bb7 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:e4317bfd-71c2-4c48-a0f0-e3c795f262a8, portal: 172.16.0.220,3260]
Apr 13 16:29:46 user nova-compute[71731]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:e4317bfd-71c2-4c48-a0f0-e3c795f262a8, portal: 172.16.0.220,3260] successful.
Apr 13 16:29:46 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:29:46 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4317bfd-71c2-4c48-a0f0-e3c795f262a8 -p 172.16.0.220:3260 --op delete {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:29:47 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4317bfd-71c2-4c48-a0f0-e3c795f262a8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.041s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:29:47 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[88c2c520-10cf-4e3a-8cd0-a23ffd5179be]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:29:47 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e46175c-c4ac-4ce5-8e70-84d97a448bb7 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:29:47 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-9e46175c-c4ac-4ce5-8e70-84d97a448bb7 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.354s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 16:29:47 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e46175c-c4ac-4ce5-8e70-84d97a448bb7 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] <== disconnect_volume: return (640ms) None {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 16:29:47 user nova-compute[71731]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9e46175c-c4ac-4ce5-8e70-84d97a448bb7 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 5ea4ab6a-6501-4a2f-a8f7-04090024747d] Disconnected iSCSI Volume {{(pid=71731) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 16:29:47 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-9e46175c-c4ac-4ce5-8e70-84d97a448bb7 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 5ea4ab6a-6501-4a2f-a8f7-04090024747d] Deleting instance files /opt/stack/data/nova/instances/5ea4ab6a-6501-4a2f-a8f7-04090024747d_del
Apr 13 16:29:47 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-9e46175c-c4ac-4ce5-8e70-84d97a448bb7 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 5ea4ab6a-6501-4a2f-a8f7-04090024747d] Deletion of /opt/stack/data/nova/instances/5ea4ab6a-6501-4a2f-a8f7-04090024747d_del complete
Apr 13 16:29:47 user nova-compute[71731]: INFO nova.compute.manager [None req-9e46175c-c4ac-4ce5-8e70-84d97a448bb7 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 5ea4ab6a-6501-4a2f-a8f7-04090024747d] Took 1.51 seconds to destroy the instance on the hypervisor.
Apr 13 16:29:47 user nova-compute[71731]: DEBUG oslo.service.loopingcall [None req-9e46175c-c4ac-4ce5-8e70-84d97a448bb7 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71731) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 16:29:47 user nova-compute[71731]: DEBUG nova.compute.manager [-] [instance: 5ea4ab6a-6501-4a2f-a8f7-04090024747d] Deallocating network for instance {{(pid=71731) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 16:29:47 user nova-compute[71731]: DEBUG nova.network.neutron [-] [instance: 5ea4ab6a-6501-4a2f-a8f7-04090024747d] deallocate_for_instance() {{(pid=71731) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 16:29:47 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-ef04bf9c-d554-4767-be2e-adabe6106b03 tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] No BDM found with device name vda, not building metadata. {{(pid=71731) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 16:29:47 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-ef04bf9c-d554-4767-be2e-adabe6106b03 tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] No BDM found with device name hda, not building metadata. {{(pid=71731) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 16:29:47 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-ef04bf9c-d554-4767-be2e-adabe6106b03 tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] No VIF found with MAC fa:16:3e:9d:e7:97, not building metadata {{(pid=71731) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 16:29:47 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-ef04bf9c-d554-4767-be2e-adabe6106b03 tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Lock "5d50f597-3a29-4335-8166-6ab8e8149376" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.341s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:29:47 user nova-compute[71731]: DEBUG nova.network.neutron [-] [instance: 5ea4ab6a-6501-4a2f-a8f7-04090024747d] Updating instance_info_cache with network_info: [] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:29:47 user nova-compute[71731]: INFO nova.compute.manager [-] [instance: 5ea4ab6a-6501-4a2f-a8f7-04090024747d] Took 0.48 seconds to deallocate network for instance.
Apr 13 16:29:47 user nova-compute[71731]: DEBUG nova.compute.manager [req-59bf4a51-c666-43ac-8f53-ec346d0b8620 req-e39ea0ee-f617-4e54-b15e-57e55bc13e3e service nova] [instance: 5ea4ab6a-6501-4a2f-a8f7-04090024747d] Received event network-vif-plugged-8a5c66fa-4693-4162-b5a8-2c80b33cf979 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:29:47 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-59bf4a51-c666-43ac-8f53-ec346d0b8620 req-e39ea0ee-f617-4e54-b15e-57e55bc13e3e service nova] Acquiring lock "5ea4ab6a-6501-4a2f-a8f7-04090024747d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:29:47 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-59bf4a51-c666-43ac-8f53-ec346d0b8620 req-e39ea0ee-f617-4e54-b15e-57e55bc13e3e service nova] Lock "5ea4ab6a-6501-4a2f-a8f7-04090024747d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:29:47 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-59bf4a51-c666-43ac-8f53-ec346d0b8620 req-e39ea0ee-f617-4e54-b15e-57e55bc13e3e service nova] Lock "5ea4ab6a-6501-4a2f-a8f7-04090024747d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:29:47 user nova-compute[71731]: DEBUG nova.compute.manager [req-59bf4a51-c666-43ac-8f53-ec346d0b8620 req-e39ea0ee-f617-4e54-b15e-57e55bc13e3e service nova] [instance: 5ea4ab6a-6501-4a2f-a8f7-04090024747d] No waiting events found dispatching network-vif-plugged-8a5c66fa-4693-4162-b5a8-2c80b33cf979 {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:29:47 user nova-compute[71731]: WARNING nova.compute.manager [req-59bf4a51-c666-43ac-8f53-ec346d0b8620 req-e39ea0ee-f617-4e54-b15e-57e55bc13e3e service nova] [instance: 5ea4ab6a-6501-4a2f-a8f7-04090024747d] Received unexpected event network-vif-plugged-8a5c66fa-4693-4162-b5a8-2c80b33cf979 for instance with vm_state active and task_state deleting.
Apr 13 16:29:47 user nova-compute[71731]: DEBUG nova.compute.manager [req-59bf4a51-c666-43ac-8f53-ec346d0b8620 req-e39ea0ee-f617-4e54-b15e-57e55bc13e3e service nova] [instance: 5ea4ab6a-6501-4a2f-a8f7-04090024747d] Received event network-vif-deleted-8a5c66fa-4693-4162-b5a8-2c80b33cf979 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:29:48 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-cfb1e1e0-df47-45b9-8026-83d103ce3a1d tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Acquiring lock "5d50f597-3a29-4335-8166-6ab8e8149376" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:29:48 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-cfb1e1e0-df47-45b9-8026-83d103ce3a1d tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Lock "5d50f597-3a29-4335-8166-6ab8e8149376" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:29:48 user nova-compute[71731]: INFO nova.compute.manager [None req-cfb1e1e0-df47-45b9-8026-83d103ce3a1d tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] [instance: 5d50f597-3a29-4335-8166-6ab8e8149376] Detaching volume bc906e31-eece-4b17-adf4-55ad76b7e51a
Apr 13 16:29:48 user nova-compute[71731]: INFO nova.virt.block_device [None req-cfb1e1e0-df47-45b9-8026-83d103ce3a1d tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] [instance: 5d50f597-3a29-4335-8166-6ab8e8149376] Attempting to driver detach volume bc906e31-eece-4b17-adf4-55ad76b7e51a from mountpoint /dev/vdb
Apr 13 16:29:48 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-cfb1e1e0-df47-45b9-8026-83d103ce3a1d tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Attempting to detach device vdb from instance 5d50f597-3a29-4335-8166-6ab8e8149376 from the persistent domain config. {{(pid=71731) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 13 16:29:48 user nova-compute[71731]: DEBUG nova.virt.libvirt.guest [None req-cfb1e1e0-df47-45b9-8026-83d103ce3a1d tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 16:29:48 user nova-compute[71731]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 16:29:48 user nova-compute[71731]:   <source dev="/dev/sdb"/>
Apr 13 16:29:48 user nova-compute[71731]:   <target dev="vdb" bus="virtio"/>
Apr 13 16:29:48 user nova-compute[71731]:   <serial>bc906e31-eece-4b17-adf4-55ad76b7e51a</serial>
Apr 13 16:29:48 user nova-compute[71731]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Apr 13 16:29:48 user nova-compute[71731]: </disk>
Apr 13 16:29:48 user nova-compute[71731]:  {{(pid=71731) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 16:29:48 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-cfb1e1e0-df47-45b9-8026-83d103ce3a1d tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Successfully detached device vdb from instance 5d50f597-3a29-4335-8166-6ab8e8149376 from the persistent domain config.
Apr 13 16:29:48 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-cfb1e1e0-df47-45b9-8026-83d103ce3a1d tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 5d50f597-3a29-4335-8166-6ab8e8149376 from the live domain config. {{(pid=71731) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 13 16:29:48 user nova-compute[71731]: DEBUG nova.virt.libvirt.guest [None req-cfb1e1e0-df47-45b9-8026-83d103ce3a1d tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 16:29:48 user nova-compute[71731]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 16:29:48 user nova-compute[71731]:   <source dev="/dev/sdb"/>
Apr 13 16:29:48 user nova-compute[71731]:   <target dev="vdb" bus="virtio"/>
Apr 13 16:29:48 user nova-compute[71731]:   <serial>bc906e31-eece-4b17-adf4-55ad76b7e51a</serial>
Apr 13 16:29:48 user nova-compute[71731]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Apr 13 16:29:48 user nova-compute[71731]: </disk>
Apr 13 16:29:48 user nova-compute[71731]:  {{(pid=71731) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 16:29:48 user nova-compute[71731]: INFO nova.compute.manager [None req-9e46175c-c4ac-4ce5-8e70-84d97a448bb7 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 5ea4ab6a-6501-4a2f-a8f7-04090024747d] Took 0.93 seconds to detach 1 volumes for instance.
Apr 13 16:29:48 user nova-compute[71731]: DEBUG nova.compute.manager [None req-9e46175c-c4ac-4ce5-8e70-84d97a448bb7 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 5ea4ab6a-6501-4a2f-a8f7-04090024747d] Deleting volume: e4317bfd-71c2-4c48-a0f0-e3c795f262a8 {{(pid=71731) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3202}}
Apr 13 16:29:48 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-9e46175c-c4ac-4ce5-8e70-84d97a448bb7 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:29:48 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-9e46175c-c4ac-4ce5-8e70-84d97a448bb7 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:29:48 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Received event <DeviceRemovedEvent: 1681403388.7374136, 5d50f597-3a29-4335-8166-6ab8e8149376 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71731) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 13 16:29:48 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-cfb1e1e0-df47-45b9-8026-83d103ce3a1d tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 5d50f597-3a29-4335-8166-6ab8e8149376 {{(pid=71731) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 13 16:29:48 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-cfb1e1e0-df47-45b9-8026-83d103ce3a1d tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Successfully detached device vdb from instance 5d50f597-3a29-4335-8166-6ab8e8149376 from the live domain config.
Apr 13 16:29:48 user nova-compute[71731]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cfb1e1e0-df47-45b9-8026-83d103ce3a1d tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] [instance: 5d50f597-3a29-4335-8166-6ab8e8149376] calling os-brick to detach iSCSI Volume {{(pid=71731) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 16:29:48 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfb1e1e0-df47-45b9-8026-83d103ce3a1d tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8cf0118790>, {'target_iqn': 'iqn.2010-10.org.openstack:bc906e31-eece-4b17-adf4-55ad76b7e51a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sWlpktRw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 16:29:48 user nova-compute[71731]: WARNING os_brick.initiator.connectors.base [None req-cfb1e1e0-df47-45b9-8026-83d103ce3a1d tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 16:29:48 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-cfb1e1e0-df47-45b9-8026-83d103ce3a1d tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 16:29:48 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-cfb1e1e0-df47-45b9-8026-83d103ce3a1d tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 16:29:48 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:29:48 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:29:48 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[17804484-63c3-4fe1-b22b-ed2c6b9e9c4e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:eb2c60ec-fb52-436f-a98a-dfe15d1e3aa6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d53e720e-a9ca-499b-aacd-aad1a169a874\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bc906e31-eece-4b17-adf4-55ad76b7e51a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:29:48 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfb1e1e0-df47-45b9-8026-83d103ce3a1d tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 16:29:48 user nova-compute[71731]: No targets found.
Apr 13 16:29:48 user nova-compute[71731]: iSNS:
Apr 13 16:29:48 user nova-compute[71731]: No targets found.
Apr 13 16:29:48 user nova-compute[71731]: STATIC:
Apr 13 16:29:48 user nova-compute[71731]: Target: iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97
Apr 13 16:29:48 user nova-compute[71731]:         Portal: 172.16.0.220:3260,-1
Apr 13 16:29:48 user nova-compute[71731]:                 Iface Name: default
Apr 13 16:29:48 user nova-compute[71731]: Target: iqn.2010-10.org.openstack:eb2c60ec-fb52-436f-a98a-dfe15d1e3aa6
Apr 13 16:29:48 user nova-compute[71731]:         Portal: 172.16.0.220:3260,-1
Apr 13 16:29:48 user nova-compute[71731]:                 Iface Name: default
Apr 13 16:29:48 user nova-compute[71731]: Target: iqn.2010-10.org.openstack:d53e720e-a9ca-499b-aacd-aad1a169a874
Apr 13 16:29:48 user nova-compute[71731]:         Portal: 172.16.0.220:3260,-1
Apr 13 16:29:48 user nova-compute[71731]:                 Iface Name: default
Apr 13 16:29:48 user nova-compute[71731]: Target: iqn.2010-10.org.openstack:bc906e31-eece-4b17-adf4-55ad76b7e51a
Apr 13 16:29:48 user nova-compute[71731]:         Portal: 172.16.0.220:3260,-1
Apr 13 16:29:48 user nova-compute[71731]:                 Iface Name: default
Apr 13 16:29:48 user nova-compute[71731]: FIRMWARE:
Apr 13 16:29:48 user nova-compute[71731]: No targets found.
Apr 13 16:29:48 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 16:29:48 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfb1e1e0-df47-45b9-8026-83d103ce3a1d tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 16:29:48 user nova-compute[71731]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 16:29:48 user nova-compute[71731]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71731) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 16:29:48 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfb1e1e0-df47-45b9-8026-83d103ce3a1d tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bc906e31-eece-4b17-adf4-55ad76b7e51a', 0)] {{(pid=71731) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 16:29:48 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:29:48 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:29:48 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[3beca37a-f75d-4473-8ea1-461246eccadc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bc906e31-eece-4b17-adf4-55ad76b7e51a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d53e720e-a9ca-499b-aacd-aad1a169a874\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eb2c60ec-fb52-436f-a98a-dfe15d1e3aa6\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:29:48 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:29:48 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:29:48 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bb5a0b3-7eeb-476f-99e7-161f8d3d39ab]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d53e720e-a9ca-499b-aacd-aad1a169a874 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb2c60ec-fb52-436f-a98a-dfe15d1e3aa6 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc906e31-eece-4b17-adf4-55ad76b7e51a (non-flash)\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:29:48 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfb1e1e0-df47-45b9-8026-83d103ce3a1d tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)
Apr 13 16:29:48 user nova-compute[71731]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d53e720e-a9ca-499b-aacd-aad1a169a874 (non-flash)
Apr 13 16:29:48 user nova-compute[71731]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb2c60ec-fb52-436f-a98a-dfe15d1e3aa6 (non-flash)
Apr 13 16:29:48 user nova-compute[71731]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc906e31-eece-4b17-adf4-55ad76b7e51a (non-flash)
Apr 13 16:29:48 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 16:29:48 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfb1e1e0-df47-45b9-8026-83d103ce3a1d tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)
Apr 13 16:29:48 user nova-compute[71731]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d53e720e-a9ca-499b-aacd-aad1a169a874 (non-flash)
Apr 13 16:29:48 user nova-compute[71731]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb2c60ec-fb52-436f-a98a-dfe15d1e3aa6 (non-flash)
Apr 13 16:29:48 user nova-compute[71731]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc906e31-eece-4b17-adf4-55ad76b7e51a (non-flash)
Apr 13 16:29:48 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 16:29:48 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfb1e1e0-df47-45b9-8026-83d103ce3a1d tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8cd022d750>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bc906e31-eece-4b17-adf4-55ad76b7e51a'): ({'sdb'}, set())}) {{(pid=71731) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 16:29:48 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-cfb1e1e0-df47-45b9-8026-83d103ce3a1d tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Removing single pathed devices sdb {{(pid=71731) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 16:29:48 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:29:48 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:29:48 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[75c55cd9-a428-4478-bfa0-13b20d711de3]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:29:48 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:29:48 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:29:48 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[2088c6b8-0345-413f-b92c-7a01df9307e5]: (4, ('ok\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:29:48 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-cfb1e1e0-df47-45b9-8026-83d103ce3a1d tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Flushing IO for device /dev/sdb {{(pid=71731) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 16:29:48 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:29:48 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:29:48 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[8189aff7-c898-4b40-a0c6-838e8713f108]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:29:48 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-cfb1e1e0-df47-45b9-8026-83d103ce3a1d tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71731) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 16:29:48 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:29:48 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:29:48 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[a088cd39-6e39-4c23-a2da-541d81048675]: (4, ('1', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:29:48 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-cfb1e1e0-df47-45b9-8026-83d103ce3a1d tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71731) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 16:29:48 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-cfb1e1e0-df47-45b9-8026-83d103ce3a1d tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] SCSI volumes sdb have been removed. {{(pid=71731) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 16:29:48 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfb1e1e0-df47-45b9-8026-83d103ce3a1d tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bc906e31-eece-4b17-adf4-55ad76b7e51a')] {{(pid=71731) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 16:29:48 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc906e31-eece-4b17-adf4-55ad76b7e51a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:29:48 user nova-compute[71731]: DEBUG nova.compute.provider_tree [None req-9e46175c-c4ac-4ce5-8e70-84d97a448bb7 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Inventory has not changed in ProviderTree for provider: cb6b1a64-0c24-4e2d-af1e-16576ca9165c {{(pid=71731) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 16:29:48 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc906e31-eece-4b17-adf4-55ad76b7e51a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:29:48 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[36c3f6f3-4a4c-425b-b2f1-f70394d465ce]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:29:48 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfb1e1e0-df47-45b9-8026-83d103ce3a1d tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:29:48 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc906e31-eece-4b17-adf4-55ad76b7e51a -p 172.16.0.220:3260 --logout {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:29:48 user nova-compute[71731]: DEBUG nova.scheduler.client.report [None req-9e46175c-c4ac-4ce5-8e70-84d97a448bb7 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Inventory has not changed for provider cb6b1a64-0c24-4e2d-af1e-16576ca9165c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71731) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 16:29:49 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-9e46175c-c4ac-4ce5-8e70-84d97a448bb7 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.383s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:29:49 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc906e31-eece-4b17-adf4-55ad76b7e51a -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:29:49 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[1466411e-3262-49b8-b6c9-13c4c5c72a0e]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:bc906e31-eece-4b17-adf4-55ad76b7e51a, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:bc906e31-eece-4b17-adf4-55ad76b7e51a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:29:49 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfb1e1e0-df47-45b9-8026-83d103ce3a1d tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:bc906e31-eece-4b17-adf4-55ad76b7e51a, portal: 172.16.0.220,3260]
Apr 13 16:29:49 user nova-compute[71731]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:bc906e31-eece-4b17-adf4-55ad76b7e51a, portal: 172.16.0.220,3260] successful.
Apr 13 16:29:49 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:29:49 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc906e31-eece-4b17-adf4-55ad76b7e51a -p 172.16.0.220:3260 --op delete {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:29:49 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc906e31-eece-4b17-adf4-55ad76b7e51a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:29:49 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb20f85d-7af1-430d-91ff-57a713f75521]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:29:49 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfb1e1e0-df47-45b9-8026-83d103ce3a1d tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:29:49 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-cfb1e1e0-df47-45b9-8026-83d103ce3a1d tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.310s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 16:29:49 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfb1e1e0-df47-45b9-8026-83d103ce3a1d tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] <== disconnect_volume: return (312ms) None {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 16:29:49 user nova-compute[71731]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cfb1e1e0-df47-45b9-8026-83d103ce3a1d tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] [instance: 5d50f597-3a29-4335-8166-6ab8e8149376] Disconnected iSCSI Volume {{(pid=71731) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 16:29:49 user nova-compute[71731]: INFO nova.scheduler.client.report [None req-9e46175c-c4ac-4ce5-8e70-84d97a448bb7 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Deleted allocations for instance 5ea4ab6a-6501-4a2f-a8f7-04090024747d
Apr 13 16:29:49 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-9e46175c-c4ac-4ce5-8e70-84d97a448bb7 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "5ea4ab6a-6501-4a2f-a8f7-04090024747d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.570s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:29:50 user nova-compute[71731]: DEBUG nova.objects.instance [None req-cfb1e1e0-df47-45b9-8026-83d103ce3a1d tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Lazy-loading 'flavor' on Instance uuid 5d50f597-3a29-4335-8166-6ab8e8149376 {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:29:51 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-cfb1e1e0-df47-45b9-8026-83d103ce3a1d tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Lock "5d50f597-3a29-4335-8166-6ab8e8149376" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.881s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:29:51 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:29:51 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-036b777d-1ffe-43b6-b1f2-5a8ed4f4f6ec tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Acquiring lock "interface-5d50f597-3a29-4335-8166-6ab8e8149376-deb6fd31-3a87-439d-b59c-4f4dbf9a11bc" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:29:51 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-036b777d-1ffe-43b6-b1f2-5a8ed4f4f6ec tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Lock "interface-5d50f597-3a29-4335-8166-6ab8e8149376-deb6fd31-3a87-439d-b59c-4f4dbf9a11bc" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:29:51 user nova-compute[71731]: DEBUG nova.objects.instance [None req-036b777d-1ffe-43b6-b1f2-5a8ed4f4f6ec tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Lazy-loading 'flavor' on Instance uuid 5d50f597-3a29-4335-8166-6ab8e8149376 {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:29:51 user nova-compute[71731]: DEBUG nova.virt.libvirt.vif [None req-036b777d-1ffe-43b6-b1f2-5a8ed4f4f6ec tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T16:27:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2052401344',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-2052401344',id=21,image_ref='708622a9-7465-4492-ade8-b827198f7e30',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAENxxbnK5TO5rrhClGAK4OGBjRSl2WhguyF+uaJMZFTdQImhP15imwNCemvjwOF1cJdEvHpeqOmPATUZWcFezxU2vmY8dwhasInHSqB5TQd2r6SmgLKfFX1fag2EbRN/A==',key_name='tempest-keypair-1469740557',keypairs=<?>,launch_index=0,launched_at=2023-04-13T16:27:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3c33fd5889ce4d0b983f529767005267',ramdisk_id='',reservation_id='r-99cwosbm',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='708622a9-7465-4492-ade8-b827198f7e30',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1979050233',owner_user_name='tempest-TaggedAttachmentsTest-1979050233-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T16:27:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fa66202e2e5547d1b6e792557b335d0f',uuid=5d50f597-3a29-4335-8166-6ab8e8149376,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "deb6fd31-3a87-439d-b59c-4f4dbf9a11bc", "address": "fa:16:3e:f5:7f:d0", "network": {"id": "80e09f45-b799-4c16-8c74-ee57ad2c4b6e", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-165222833", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.226", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "3c33fd5889ce4d0b983f529767005267", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdeb6fd31-3a", "ovs_interfaceid": "deb6fd31-3a87-439d-b59c-4f4dbf9a11bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71731) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 16:29:51 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-036b777d-1ffe-43b6-b1f2-5a8ed4f4f6ec tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Converting VIF {"id": "deb6fd31-3a87-439d-b59c-4f4dbf9a11bc", "address": "fa:16:3e:f5:7f:d0", "network": {"id": "80e09f45-b799-4c16-8c74-ee57ad2c4b6e", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-165222833", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.226", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "3c33fd5889ce4d0b983f529767005267", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdeb6fd31-3a", "ovs_interfaceid": "deb6fd31-3a87-439d-b59c-4f4dbf9a11bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 16:29:51 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-036b777d-1ffe-43b6-b1f2-5a8ed4f4f6ec tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:7f:d0,bridge_name='br-int',has_traffic_filtering=True,id=deb6fd31-3a87-439d-b59c-4f4dbf9a11bc,network=Network(80e09f45-b799-4c16-8c74-ee57ad2c4b6e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdeb6fd31-3a') {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 16:29:51 user nova-compute[71731]: DEBUG nova.virt.libvirt.guest [None req-036b777d-1ffe-43b6-b1f2-5a8ed4f4f6ec tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:f5:7f:d0"/><model type="virtio"/><mtu size="1442"/><target dev="tapdeb6fd31-3a"/></interface> {{(pid=71731) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Apr 13 16:29:51 user nova-compute[71731]: DEBUG nova.virt.libvirt.guest [None req-036b777d-1ffe-43b6-b1f2-5a8ed4f4f6ec tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:f5:7f:d0"/><model type="virtio"/><mtu size="1442"/><target dev="tapdeb6fd31-3a"/></interface> {{(pid=71731) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Apr 13 16:29:51 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-036b777d-1ffe-43b6-b1f2-5a8ed4f4f6ec tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Attempting to detach device tapdeb6fd31-3a from instance 5d50f597-3a29-4335-8166-6ab8e8149376 from the persistent domain config. {{(pid=71731) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 13 16:29:51 user nova-compute[71731]: DEBUG nova.virt.libvirt.guest [None req-036b777d-1ffe-43b6-b1f2-5a8ed4f4f6ec tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] detach device xml: <interface type="ethernet">
Apr 13 16:29:51 user nova-compute[71731]:   <mac address="fa:16:3e:f5:7f:d0"/>
Apr 13 16:29:51 user nova-compute[71731]:   <model type="virtio"/>
Apr 13 16:29:51 user nova-compute[71731]:   <mtu size="1442"/>
Apr 13 16:29:51 user nova-compute[71731]:   <target dev="tapdeb6fd31-3a"/>
Apr 13 16:29:51 user nova-compute[71731]: </interface>
Apr 13 16:29:51 user nova-compute[71731]:  {{(pid=71731) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 16:29:51 user nova-compute[71731]: DEBUG nova.virt.libvirt.guest [None req-036b777d-1ffe-43b6-b1f2-5a8ed4f4f6ec tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:f5:7f:d0"/><model type="virtio"/><mtu size="1442"/><target dev="tapdeb6fd31-3a"/></interface> {{(pid=71731) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Apr 13 16:29:51 user nova-compute[71731]: DEBUG nova.virt.libvirt.guest [None req-036b777d-1ffe-43b6-b1f2-5a8ed4f4f6ec tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:f5:7f:d0"/><model type="virtio"/><mtu size="1442"/><target dev="tapdeb6fd31-3a"/></interface>not found in domain: <domain type='kvm' id='27'>
Apr 13 16:29:51 user nova-compute[71731]:   <name>instance-00000015</name>
Apr 13 16:29:51 user nova-compute[71731]:   <uuid>5d50f597-3a29-4335-8166-6ab8e8149376</uuid>
Apr 13 16:29:51 user nova-compute[71731]:   <metadata>
Apr 13 16:29:51 user nova-compute[71731]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 16:29:51 user nova-compute[71731]:   <nova:package version="0.0.0"/>
Apr 13 16:29:51 user nova-compute[71731]:   <nova:name>tempest-device-tagging-server-2052401344</nova:name>
Apr 13 16:29:51 user nova-compute[71731]:   <nova:creationTime>2023-04-13 16:29:38</nova:creationTime>
Apr 13 16:29:51 user nova-compute[71731]:   <nova:flavor name="m1.nano">
Apr 13 16:29:51 user nova-compute[71731]:     <nova:memory>128</nova:memory>
Apr 13 16:29:51 user nova-compute[71731]:     <nova:disk>1</nova:disk>
Apr 13 16:29:51 user nova-compute[71731]:     <nova:swap>0</nova:swap>
Apr 13 16:29:51 user nova-compute[71731]:     <nova:ephemeral>0</nova:ephemeral>
Apr 13 16:29:51 user nova-compute[71731]:     <nova:vcpus>1</nova:vcpus>
Apr 13 16:29:51 user nova-compute[71731]:   </nova:flavor>
Apr 13 16:29:51 user nova-compute[71731]:   <nova:owner>
Apr 13 16:29:51 user nova-compute[71731]:     <nova:user uuid="fa66202e2e5547d1b6e792557b335d0f">tempest-TaggedAttachmentsTest-1979050233-project-member</nova:user>
Apr 13 16:29:51 user nova-compute[71731]:     <nova:project uuid="3c33fd5889ce4d0b983f529767005267">tempest-TaggedAttachmentsTest-1979050233</nova:project>
Apr 13 16:29:51 user nova-compute[71731]:   </nova:owner>
Apr 13 16:29:51 user nova-compute[71731]:   <nova:root type="image" uuid="708622a9-7465-4492-ade8-b827198f7e30"/>
Apr 13 16:29:51 user nova-compute[71731]:   <nova:ports>
Apr 13 16:29:51 user nova-compute[71731]:     <nova:port uuid="cde3b0f9-9ed1-4eba-8560-d5fa05166b2e">
Apr 13 16:29:51 user nova-compute[71731]:       <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Apr 13 16:29:51 user nova-compute[71731]:     </nova:port>
Apr 13 16:29:51 user nova-compute[71731]:     <nova:port uuid="deb6fd31-3a87-439d-b59c-4f4dbf9a11bc">
Apr 13 16:29:51 user nova-compute[71731]:       <nova:ip type="fixed" address="10.10.10.226" ipVersion="4"/>
Apr 13 16:29:51 user nova-compute[71731]:     </nova:port>
Apr 13 16:29:51 user nova-compute[71731]:   </nova:ports>
Apr 13 16:29:51 user nova-compute[71731]: </nova:instance>
Apr 13 16:29:51 user nova-compute[71731]:   </metadata>
Apr 13 16:29:51 user nova-compute[71731]:   <memory unit='KiB'>131072</memory>
Apr 13 16:29:51 user nova-compute[71731]:   <currentMemory unit='KiB'>131072</currentMemory>
Apr 13 16:29:51 user nova-compute[71731]:   <vcpu placement='static'>1</vcpu>
Apr 13 16:29:51 user nova-compute[71731]:   <resource>
Apr 13 16:29:51 user nova-compute[71731]:     <partition>/machine</partition>
Apr 13 16:29:51 user nova-compute[71731]:   </resource>
Apr 13 16:29:51 user nova-compute[71731]:   <sysinfo type='smbios'>
Apr 13 16:29:51 user nova-compute[71731]:     <system>
Apr 13 16:29:51 user nova-compute[71731]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Apr 13 16:29:51 user nova-compute[71731]:       <entry name='product'>OpenStack Nova</entry>
Apr 13 16:29:51 user nova-compute[71731]:       <entry name='version'>0.0.0</entry>
Apr 13 16:29:51 user nova-compute[71731]:       <entry name='serial'>5d50f597-3a29-4335-8166-6ab8e8149376</entry>
Apr 13 16:29:51 user nova-compute[71731]:       <entry name='uuid'>5d50f597-3a29-4335-8166-6ab8e8149376</entry>
Apr 13 16:29:51 user nova-compute[71731]:       <entry name='family'>Virtual Machine</entry>
Apr 13 16:29:51 user nova-compute[71731]:     </system>
Apr 13 16:29:51 user nova-compute[71731]:   </sysinfo>
Apr 13 16:29:51 user nova-compute[71731]:   <os>
Apr 13 16:29:51 user nova-compute[71731]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Apr 13 16:29:51 user nova-compute[71731]:     <boot dev='hd'/>
Apr 13 16:29:51 user nova-compute[71731]:     <smbios mode='sysinfo'/>
Apr 13 16:29:51 user nova-compute[71731]:   </os>
Apr 13 16:29:51 user nova-compute[71731]:   <features>
Apr 13 16:29:51 user nova-compute[71731]:     <acpi/>
Apr 13 16:29:51 user nova-compute[71731]:     <apic/>
Apr 13 16:29:51 user nova-compute[71731]:     <vmcoreinfo state='on'/>
Apr 13 16:29:51 user nova-compute[71731]:   </features>
Apr 13 16:29:51 user nova-compute[71731]:   <cpu mode='custom' match='exact' check='full'>
Apr 13 16:29:51 user nova-compute[71731]:     <model fallback='forbid'>Nehalem</model>
Apr 13 16:29:51 user nova-compute[71731]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Apr 13 16:29:51 user nova-compute[71731]:     <feature policy='require' name='vme'/>
Apr 13 16:29:51 user nova-compute[71731]:     <feature policy='require' name='x2apic'/>
Apr 13 16:29:51 user nova-compute[71731]:     <feature policy='require' name='hypervisor'/>
Apr 13 16:29:51 user nova-compute[71731]:   </cpu>
Apr 13 16:29:51 user nova-compute[71731]:   <clock offset='utc'>
Apr 13 16:29:51 user nova-compute[71731]:     <timer name='pit' tickpolicy='delay'/>
Apr 13 16:29:51 user nova-compute[71731]:     <timer name='rtc' tickpolicy='catchup'/>
Apr 13 16:29:51 user nova-compute[71731]:     <timer name='hpet' present='no'/>
Apr 13 16:29:51 user nova-compute[71731]:   </clock>
Apr 13 16:29:51 user nova-compute[71731]:   <on_poweroff>destroy</on_poweroff>
Apr 13 16:29:51 user nova-compute[71731]:   <on_reboot>restart</on_reboot>
Apr 13 16:29:51 user nova-compute[71731]:   <on_crash>destroy</on_crash>
Apr 13 16:29:51 user nova-compute[71731]:   <devices>
Apr 13 16:29:51 user nova-compute[71731]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Apr 13 16:29:51 user nova-compute[71731]:     <disk type='file' device='disk'>
Apr 13 16:29:51 user nova-compute[71731]:       <driver name='qemu' type='qcow2' cache='none'/>
Apr 13 16:29:51 user nova-compute[71731]:       <source file='/opt/stack/data/nova/instances/5d50f597-3a29-4335-8166-6ab8e8149376/disk' index='2'/>
Apr 13 16:29:51 user nova-compute[71731]:       <backingStore type='file' index='3'>
Apr 13 16:29:51 user nova-compute[71731]:         <format type='raw'/>
Apr 13 16:29:51 user nova-compute[71731]:         <source file='/opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279'/>
Apr 13 16:29:51 user nova-compute[71731]:         <backingStore/>
Apr 13 16:29:51 user nova-compute[71731]:       </backingStore>
Apr 13 16:29:51 user nova-compute[71731]:       <target dev='vda' bus='virtio'/>
Apr 13 16:29:51 user nova-compute[71731]:       <alias name='virtio-disk0'/>
Apr 13 16:29:51 user nova-compute[71731]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Apr 13 16:29:51 user nova-compute[71731]:     </disk>
Apr 13 16:29:51 user nova-compute[71731]:     <disk type='file' device='cdrom'>
Apr 13 16:29:51 user nova-compute[71731]:       <driver name='qemu' type='raw' cache='none'/>
Apr 13 16:29:51 user nova-compute[71731]:       <source file='/opt/stack/data/nova/instances/5d50f597-3a29-4335-8166-6ab8e8149376/disk.config' index='1'/>
Apr 13 16:29:51 user nova-compute[71731]:       <backingStore/>
Apr 13 16:29:51 user nova-compute[71731]:       <target dev='hda' bus='ide'/>
Apr 13 16:29:51 user nova-compute[71731]:       <readonly/>
Apr 13 16:29:51 user nova-compute[71731]:       <alias name='ide0-0-0'/>
Apr 13 16:29:51 user nova-compute[71731]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Apr 13 16:29:51 user nova-compute[71731]:     </disk>
Apr 13 16:29:51 user nova-compute[71731]:     <controller type='usb' index='0' model='none'>
Apr 13 16:29:51 user nova-compute[71731]:       <alias name='usb'/>
Apr 13 16:29:51 user nova-compute[71731]:     </controller>
Apr 13 16:29:51 user nova-compute[71731]:     <controller type='pci' index='0' model='pci-root'>
Apr 13 16:29:51 user nova-compute[71731]:       <alias name='pci.0'/>
Apr 13 16:29:51 user nova-compute[71731]:     </controller>
Apr 13 16:29:51 user nova-compute[71731]:     <controller type='ide' index='0'>
Apr 13 16:29:51 user nova-compute[71731]:       <alias name='ide'/>
Apr 13 16:29:51 user nova-compute[71731]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Apr 13 16:29:51 user nova-compute[71731]:     </controller>
Apr 13 16:29:51 user nova-compute[71731]:     <interface type='ethernet'>
Apr 13 16:29:51 user nova-compute[71731]:       <mac address='fa:16:3e:9d:e7:97'/>
Apr 13 16:29:51 user nova-compute[71731]:       <target dev='tapcde3b0f9-9e'/>
Apr 13 16:29:51 user nova-compute[71731]:       <model type='virtio'/>
Apr 13 16:29:51 user nova-compute[71731]:       <mtu size='1442'/>
Apr 13 16:29:51 user nova-compute[71731]:       <alias name='net0'/>
Apr 13 16:29:51 user nova-compute[71731]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Apr 13 16:29:51 user nova-compute[71731]:     </interface>
Apr 13 16:29:51 user nova-compute[71731]:     <interface type='ethernet'>
Apr 13 16:29:51 user nova-compute[71731]:       <mac address='fa:16:3e:f5:7f:d0'/>
Apr 13 16:29:51 user nova-compute[71731]:       <target dev='tapdeb6fd31-3a'/>
Apr 13 16:29:51 user nova-compute[71731]:       <model type='virtio'/>
Apr 13 16:29:51 user nova-compute[71731]:       <mtu size='1442'/>
Apr 13 16:29:51 user nova-compute[71731]:       <alias name='net1'/>
Apr 13 16:29:51 user nova-compute[71731]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Apr 13 16:29:51 user nova-compute[71731]:     </interface>
Apr 13 16:29:51 user nova-compute[71731]:     <serial type='pty'>
Apr 13 16:29:51 user nova-compute[71731]:       <source path='/dev/pts/5'/>
Apr 13 16:29:51 user nova-compute[71731]:       <log file='/opt/stack/data/nova/instances/5d50f597-3a29-4335-8166-6ab8e8149376/console.log' append='off'/>
Apr 13 16:29:51 user nova-compute[71731]:       <target type='isa-serial' port='0'>
Apr 13 16:29:51 user nova-compute[71731]:         <model name='isa-serial'/>
Apr 13 16:29:51 user nova-compute[71731]:       </target>
Apr 13 16:29:51 user nova-compute[71731]:       <alias name='serial0'/>
Apr 13 16:29:51 user nova-compute[71731]:     </serial>
Apr 13 16:29:51 user nova-compute[71731]:     <console type='pty' tty='/dev/pts/5'>
Apr 13 16:29:51 user nova-compute[71731]:       <source path='/dev/pts/5'/>
Apr 13 16:29:51 user nova-compute[71731]:       <log file='/opt/stack/data/nova/instances/5d50f597-3a29-4335-8166-6ab8e8149376/console.log' append='off'/>
Apr 13 16:29:51 user nova-compute[71731]:       <target type='serial' port='0'/>
Apr 13 16:29:51 user nova-compute[71731]:       <alias name='serial0'/>
Apr 13 16:29:51 user nova-compute[71731]:     </console>
Apr 13 16:29:51 user nova-compute[71731]:     <input type='mouse' bus='ps2'>
Apr 13 16:29:51 user nova-compute[71731]:       <alias name='input0'/>
Apr 13 16:29:51 user nova-compute[71731]:     </input>
Apr 13 16:29:51 user nova-compute[71731]:     <input type='keyboard' bus='ps2'>
Apr 13 16:29:51 user nova-compute[71731]:       <alias name='input1'/>
Apr 13 16:29:51 user nova-compute[71731]:     </input>
Apr 13 16:29:51 user nova-compute[71731]:     <graphics type='vnc' port='5906' autoport='yes' listen='0.0.0.0'>
Apr 13 16:29:51 user nova-compute[71731]:       <listen type='address' address='0.0.0.0'/>
Apr 13 16:29:51 user nova-compute[71731]:     </graphics>
Apr 13 16:29:51 user nova-compute[71731]:     <audio id='1' type='none'/>
Apr 13 16:29:51 user nova-compute[71731]:     <video>
Apr 13 16:29:51 user nova-compute[71731]:       <model type='virtio' heads='1' primary='yes'/>
Apr 13 16:29:51 user nova-compute[71731]:       <alias name='video0'/>
Apr 13 16:29:51 user nova-compute[71731]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Apr 13 16:29:51 user nova-compute[71731]:     </video>
Apr 13 16:29:51 user nova-compute[71731]:     <memballoon model='virtio'>
Apr 13 16:29:51 user nova-compute[71731]:       <stats period='10'/>
Apr 13 16:29:51 user nova-compute[71731]:       <alias name='balloon0'/>
Apr 13 16:29:51 user nova-compute[71731]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Apr 13 16:29:51 user nova-compute[71731]:     </memballoon>
Apr 13 16:29:51 user nova-compute[71731]:     <rng model='virtio'>
Apr 13 16:29:51 user nova-compute[71731]:       <backend model='random'>/dev/urandom</backend>
Apr 13 16:29:51 user nova-compute[71731]:       <alias name='rng0'/>
Apr 13 16:29:51 user nova-compute[71731]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Apr 13 16:29:51 user nova-compute[71731]:     </rng>
Apr 13 16:29:51 user nova-compute[71731]:   </devices>
Apr 13 16:29:51 user nova-compute[71731]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Apr 13 16:29:51 user nova-compute[71731]:     <label>libvirt-5d50f597-3a29-4335-8166-6ab8e8149376</label>
Apr 13 16:29:51 user nova-compute[71731]:     <imagelabel>libvirt-5d50f597-3a29-4335-8166-6ab8e8149376</imagelabel>
Apr 13 16:29:51 user nova-compute[71731]:   </seclabel>
Apr 13 16:29:51 user nova-compute[71731]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Apr 13 16:29:51 user nova-compute[71731]:     <label>+64055:+108</label>
Apr 13 16:29:51 user nova-compute[71731]:     <imagelabel>+64055:+108</imagelabel>
Apr 13 16:29:51 user nova-compute[71731]:   </seclabel>
Apr 13 16:29:51 user nova-compute[71731]: </domain>
Apr 13 16:29:51 user nova-compute[71731]:  {{(pid=71731) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Apr 13 16:29:51 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-036b777d-1ffe-43b6-b1f2-5a8ed4f4f6ec tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Successfully detached device tapdeb6fd31-3a from instance 5d50f597-3a29-4335-8166-6ab8e8149376 from the persistent domain config.
Apr 13 16:29:51 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-036b777d-1ffe-43b6-b1f2-5a8ed4f4f6ec tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] (1/8): Attempting to detach device tapdeb6fd31-3a with device alias net1 from instance 5d50f597-3a29-4335-8166-6ab8e8149376 from the live domain config. {{(pid=71731) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 13 16:29:51 user nova-compute[71731]: DEBUG nova.virt.libvirt.guest [None req-036b777d-1ffe-43b6-b1f2-5a8ed4f4f6ec tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] detach device xml: <interface type="ethernet">
Apr 13 16:29:51 user nova-compute[71731]:   <mac address="fa:16:3e:f5:7f:d0"/>
Apr 13 16:29:51 user nova-compute[71731]:   <model type="virtio"/>
Apr 13 16:29:51 user nova-compute[71731]:   <mtu size="1442"/>
Apr 13 16:29:51 user nova-compute[71731]:   <target dev="tapdeb6fd31-3a"/>
Apr 13 16:29:51 user nova-compute[71731]: </interface>
Apr 13 16:29:51 user nova-compute[71731]:  {{(pid=71731) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 16:29:51 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:29:51 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:29:51 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:29:51 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Received event <DeviceRemovedEvent: 1681403391.8186963, 5d50f597-3a29-4335-8166-6ab8e8149376 => net1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71731) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 13 16:29:51 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:29:51 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-036b777d-1ffe-43b6-b1f2-5a8ed4f4f6ec tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Start waiting for the detach event from libvirt for device tapdeb6fd31-3a with device alias net1 for instance 5d50f597-3a29-4335-8166-6ab8e8149376 {{(pid=71731) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 13 16:29:51 user nova-compute[71731]: DEBUG nova.virt.libvirt.guest [None req-036b777d-1ffe-43b6-b1f2-5a8ed4f4f6ec tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:f5:7f:d0"/><model type="virtio"/><mtu size="1442"/><target dev="tapdeb6fd31-3a"/></interface> {{(pid=71731) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Apr 13 16:29:51 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:29:51 user nova-compute[71731]: DEBUG nova.virt.libvirt.guest [None req-036b777d-1ffe-43b6-b1f2-5a8ed4f4f6ec tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:f5:7f:d0"/><model type="virtio"/><mtu size="1442"/><target dev="tapdeb6fd31-3a"/></interface>not found in domain: <domain type='kvm' id='27'>
Apr 13 16:29:51 user nova-compute[71731]:   <name>instance-00000015</name>
Apr 13 16:29:51 user nova-compute[71731]:   <uuid>5d50f597-3a29-4335-8166-6ab8e8149376</uuid>
Apr 13 16:29:51 user nova-compute[71731]:   <metadata>
Apr 13 16:29:51 user nova-compute[71731]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 16:29:51 user nova-compute[71731]:   <nova:package version="0.0.0"/>
Apr 13 16:29:51 user nova-compute[71731]:   <nova:name>tempest-device-tagging-server-2052401344</nova:name>
Apr 13 16:29:51 user nova-compute[71731]:   <nova:creationTime>2023-04-13 16:29:38</nova:creationTime>
Apr 13 16:29:51 user nova-compute[71731]:   <nova:flavor name="m1.nano">
Apr 13 16:29:51 user nova-compute[71731]:     <nova:memory>128</nova:memory>
Apr 13 16:29:51 user nova-compute[71731]:     <nova:disk>1</nova:disk>
Apr 13 16:29:51 user nova-compute[71731]:     <nova:swap>0</nova:swap>
Apr 13 16:29:51 user nova-compute[71731]:     <nova:ephemeral>0</nova:ephemeral>
Apr 13 16:29:51 user nova-compute[71731]:     <nova:vcpus>1</nova:vcpus>
Apr 13 16:29:51 user nova-compute[71731]:   </nova:flavor>
Apr 13 16:29:51 user nova-compute[71731]:   <nova:owner>
Apr 13 16:29:51 user nova-compute[71731]:     <nova:user uuid="fa66202e2e5547d1b6e792557b335d0f">tempest-TaggedAttachmentsTest-1979050233-project-member</nova:user>
Apr 13 16:29:51 user nova-compute[71731]:     <nova:project uuid="3c33fd5889ce4d0b983f529767005267">tempest-TaggedAttachmentsTest-1979050233</nova:project>
Apr 13 16:29:51 user nova-compute[71731]:   </nova:owner>
Apr 13 16:29:51 user nova-compute[71731]:   <nova:root type="image" uuid="708622a9-7465-4492-ade8-b827198f7e30"/>
Apr 13 16:29:51 user nova-compute[71731]:   <nova:ports>
Apr 13 16:29:51 user nova-compute[71731]:     <nova:port uuid="cde3b0f9-9ed1-4eba-8560-d5fa05166b2e">
Apr 13 16:29:51 user nova-compute[71731]:       <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Apr 13 16:29:51 user nova-compute[71731]:     </nova:port>
Apr 13 16:29:51 user nova-compute[71731]:     <nova:port uuid="deb6fd31-3a87-439d-b59c-4f4dbf9a11bc">
Apr 13 16:29:51 user nova-compute[71731]:       <nova:ip type="fixed" address="10.10.10.226" ipVersion="4"/>
Apr 13 16:29:51 user nova-compute[71731]:     </nova:port>
Apr 13 16:29:51 user nova-compute[71731]:   </nova:ports>
Apr 13 16:29:51 user nova-compute[71731]: </nova:instance>
Apr 13 16:29:51 user nova-compute[71731]:   </metadata>
Apr 13 16:29:51 user nova-compute[71731]:   <memory unit='KiB'>131072</memory>
Apr 13 16:29:51 user nova-compute[71731]:   <currentMemory unit='KiB'>131072</currentMemory>
Apr 13 16:29:51 user nova-compute[71731]:   <vcpu placement='static'>1</vcpu>
Apr 13 16:29:51 user nova-compute[71731]:   <resource>
Apr 13 16:29:51 user nova-compute[71731]:     <partition>/machine</partition>
Apr 13 16:29:51 user nova-compute[71731]:   </resource>
Apr 13 16:29:51 user nova-compute[71731]:   <sysinfo type='smbios'>
Apr 13 16:29:51 user nova-compute[71731]:     <system>
Apr 13 16:29:51 user nova-compute[71731]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Apr 13 16:29:51 user nova-compute[71731]:       <entry name='product'>OpenStack Nova</entry>
Apr 13 16:29:51 user nova-compute[71731]:       <entry name='version'>0.0.0</entry>
Apr 13 16:29:51 user nova-compute[71731]:       <entry name='serial'>5d50f597-3a29-4335-8166-6ab8e8149376</entry>
Apr 13 16:29:51 user nova-compute[71731]:       <entry name='uuid'>5d50f597-3a29-4335-8166-6ab8e8149376</entry>
Apr 13 16:29:51 user nova-compute[71731]:       <entry name='family'>Virtual Machine</entry>
Apr 13 16:29:51 user nova-compute[71731]:     </system>
Apr 13 16:29:51 user nova-compute[71731]:   </sysinfo>
Apr 13 16:29:51 user nova-compute[71731]:   <os>
Apr 13 16:29:51 user nova-compute[71731]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Apr 13 16:29:51 user nova-compute[71731]:     <boot dev='hd'/>
Apr 13 16:29:51 user nova-compute[71731]:     <smbios mode='sysinfo'/>
Apr 13 16:29:51 user nova-compute[71731]:   </os>
Apr 13 16:29:51 user nova-compute[71731]:   <features>
Apr 13 16:29:51 user nova-compute[71731]:     <acpi/>
Apr 13 16:29:51 user nova-compute[71731]:     <apic/>
Apr 13 16:29:51 user nova-compute[71731]:     <vmcoreinfo state='on'/>
Apr 13 16:29:51 user nova-compute[71731]:   </features>
Apr 13 16:29:51 user nova-compute[71731]:   <cpu mode='custom' match='exact' check='full'>
Apr 13 16:29:51 user nova-compute[71731]:     <model fallback='forbid'>Nehalem</model>
Apr 13 16:29:51 user nova-compute[71731]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Apr 13 16:29:51 user nova-compute[71731]:     <feature policy='require' name='vme'/>
Apr 13 16:29:51 user nova-compute[71731]:     <feature policy='require' name='x2apic'/>
Apr 13 16:29:51 user nova-compute[71731]:     <feature policy='require' name='hypervisor'/>
Apr 13 16:29:51 user nova-compute[71731]:   </cpu>
Apr 13 16:29:51 user nova-compute[71731]:   <clock offset='utc'>
Apr 13 16:29:51 user nova-compute[71731]:     <timer name='pit' tickpolicy='delay'/>
Apr 13 16:29:51 user nova-compute[71731]:     <timer name='rtc' tickpolicy='catchup'/>
Apr 13 16:29:51 user nova-compute[71731]:     <timer name='hpet' present='no'/>
Apr 13 16:29:51 user nova-compute[71731]:   </clock>
Apr 13 16:29:51 user nova-compute[71731]:   <on_poweroff>destroy</on_poweroff>
Apr 13 16:29:51 user nova-compute[71731]:   <on_reboot>restart</on_reboot>
Apr 13 16:29:51 user nova-compute[71731]:   <on_crash>destroy</on_crash>
Apr 13 16:29:51 user nova-compute[71731]:   <devices>
Apr 13 16:29:51 user nova-compute[71731]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Apr 13 16:29:51 user nova-compute[71731]:     <disk type='file' device='disk'>
Apr 13 16:29:51 user nova-compute[71731]:       <driver name='qemu' type='qcow2' cache='none'/>
Apr 13 16:29:51 user nova-compute[71731]:       <source file='/opt/stack/data/nova/instances/5d50f597-3a29-4335-8166-6ab8e8149376/disk' index='2'/>
Apr 13 16:29:51 user nova-compute[71731]:       <backingStore type='file' index='3'>
Apr 13 16:29:51 user nova-compute[71731]:         <format type='raw'/>
Apr 13 16:29:51 user nova-compute[71731]:         <source file='/opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279'/>
Apr 13 16:29:51 user nova-compute[71731]:         <backingStore/>
Apr 13 16:29:51 user nova-compute[71731]:       </backingStore>
Apr 13 16:29:51 user nova-compute[71731]:       <target dev='vda' bus='virtio'/>
Apr 13 16:29:51 user nova-compute[71731]:       <alias name='virtio-disk0'/>
Apr 13 16:29:51 user nova-compute[71731]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Apr 13 16:29:51 user nova-compute[71731]:     </disk>
Apr 13 16:29:51 user nova-compute[71731]:     <disk type='file' device='cdrom'>
Apr 13 16:29:51 user nova-compute[71731]:       <driver name='qemu' type='raw' cache='none'/>
Apr 13 16:29:51 user nova-compute[71731]:       <source file='/opt/stack/data/nova/instances/5d50f597-3a29-4335-8166-6ab8e8149376/disk.config' index='1'/>
Apr 13 16:29:51 user nova-compute[71731]:       <backingStore/>
Apr 13 16:29:51 user nova-compute[71731]:       <target dev='hda' bus='ide'/>
Apr 13 16:29:51 user nova-compute[71731]:       <readonly/>
Apr 13 16:29:51 user nova-compute[71731]:       <alias name='ide0-0-0'/>
Apr 13 16:29:51 user nova-compute[71731]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Apr 13 16:29:51 user nova-compute[71731]:     </disk>
Apr 13 16:29:51 user nova-compute[71731]:     <controller type='usb' index='0' model='none'>
Apr 13 16:29:51 user nova-compute[71731]:       <alias name='usb'/>
Apr 13 16:29:51 user nova-compute[71731]:     </controller>
Apr 13 16:29:51 user nova-compute[71731]:     <controller type='pci' index='0' model='pci-root'>
Apr 13 16:29:51 user nova-compute[71731]:       <alias name='pci.0'/>
Apr 13 16:29:51 user nova-compute[71731]:     </controller>
Apr 13 16:29:51 user nova-compute[71731]:     <controller type='ide' index='0'>
Apr 13 16:29:51 user nova-compute[71731]:       <alias name='ide'/>
Apr 13 16:29:51 user nova-compute[71731]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Apr 13 16:29:51 user nova-compute[71731]:     </controller>
Apr 13 16:29:51 user nova-compute[71731]:     <interface type='ethernet'>
Apr 13 16:29:51 user nova-compute[71731]:       <mac address='fa:16:3e:9d:e7:97'/>
Apr 13 16:29:51 user nova-compute[71731]:       <target dev='tapcde3b0f9-9e'/>
Apr 13 16:29:51 user nova-compute[71731]:       <model type='virtio'/>
Apr 13 16:29:51 user nova-compute[71731]:       <mtu size='1442'/>
Apr 13 16:29:51 user nova-compute[71731]:       <alias name='net0'/>
Apr 13 16:29:51 user nova-compute[71731]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Apr 13 16:29:51 user nova-compute[71731]:     </interface>
Apr 13 16:29:51 user nova-compute[71731]:     <serial type='pty'>
Apr 13 16:29:51 user nova-compute[71731]:       <source path='/dev/pts/5'/>
Apr 13 16:29:51 user nova-compute[71731]:       <log file='/opt/stack/data/nova/instances/5d50f597-3a29-4335-8166-6ab8e8149376/console.log' append='off'/>
Apr 13 16:29:51 user nova-compute[71731]:       <target type='isa-serial' port='0'>
Apr 13 16:29:51 user nova-compute[71731]:         <model name='isa-serial'/>
Apr 13 16:29:51 user nova-compute[71731]:       </target>
Apr 13 16:29:51 user nova-compute[71731]:       <alias name='serial0'/>
Apr 13 16:29:51 user nova-compute[71731]:     </serial>
Apr 13 16:29:51 user nova-compute[71731]:     <console type='pty' tty='/dev/pts/5'>
Apr 13 16:29:51 user nova-compute[71731]:       <source path='/dev/pts/5'/>
Apr 13 16:29:51 user nova-compute[71731]:       <log file='/opt/stack/data/nova/instances/5d50f597-3a29-4335-8166-6ab8e8149376/console.log' append='off'/>
Apr 13 16:29:51 user nova-compute[71731]:       <target type='serial' port='0'/>
Apr 13 16:29:51 user nova-compute[71731]:       <alias name='serial0'/>
Apr 13 16:29:51 user nova-compute[71731]:     </console>
Apr 13 16:29:51 user nova-compute[71731]:     <input type='mouse' bus='ps2'>
Apr 13 16:29:51 user nova-compute[71731]:       <alias name='input0'/>
Apr 13 16:29:51 user nova-compute[71731]:     </input>
Apr 13 16:29:51 user nova-compute[71731]:     <input type='keyboard' bus='ps2'>
Apr 13 16:29:51 user nova-compute[71731]:       <alias name='input1'/>
Apr 13 16:29:51 user nova-compute[71731]:     </input>
Apr 13 16:29:51 user nova-compute[71731]:     <graphics type='vnc' port='5906' autoport='yes' listen='0.0.0.0'>
Apr 13 16:29:51 user nova-compute[71731]:       <listen type='address' address='0.0.0.0'/>
Apr 13 16:29:51 user nova-compute[71731]:     </graphics>
Apr 13 16:29:51 user nova-compute[71731]:     <audio id='1' type='none'/>
Apr 13 16:29:51 user nova-compute[71731]:     <video>
Apr 13 16:29:51 user nova-compute[71731]:       <model type='virtio' heads='1' primary='yes'/>
Apr 13 16:29:51 user nova-compute[71731]:       <alias name='video0'/>
Apr 13 16:29:51 user nova-compute[71731]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Apr 13 16:29:51 user nova-compute[71731]:     </video>
Apr 13 16:29:51 user nova-compute[71731]:     <memballoon model='virtio'>
Apr 13 16:29:51 user nova-compute[71731]:       <stats period='10'/>
Apr 13 16:29:51 user nova-compute[71731]:       <alias name='balloon0'/>
Apr 13 16:29:51 user nova-compute[71731]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Apr 13 16:29:51 user nova-compute[71731]:     </memballoon>
Apr 13 16:29:51 user nova-compute[71731]:     <rng model='virtio'>
Apr 13 16:29:51 user nova-compute[71731]:       <backend model='random'>/dev/urandom</backend>
Apr 13 16:29:51 user nova-compute[71731]:       <alias name='rng0'/>
Apr 13 16:29:51 user nova-compute[71731]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Apr 13 16:29:51 user nova-compute[71731]:     </rng>
Apr 13 16:29:51 user nova-compute[71731]:   </devices>
Apr 13 16:29:51 user nova-compute[71731]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Apr 13 16:29:51 user nova-compute[71731]:     <label>libvirt-5d50f597-3a29-4335-8166-6ab8e8149376</label>
Apr 13 16:29:51 user nova-compute[71731]:     <imagelabel>libvirt-5d50f597-3a29-4335-8166-6ab8e8149376</imagelabel>
Apr 13 16:29:51 user nova-compute[71731]:   </seclabel>
Apr 13 16:29:51 user nova-compute[71731]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Apr 13 16:29:51 user nova-compute[71731]:     <label>+64055:+108</label>
Apr 13 16:29:51 user nova-compute[71731]:     <imagelabel>+64055:+108</imagelabel>
Apr 13 16:29:51 user nova-compute[71731]:   </seclabel>
Apr 13 16:29:51 user nova-compute[71731]: </domain>
Apr 13 16:29:51 user nova-compute[71731]:  {{(pid=71731) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Apr 13 16:29:51 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-036b777d-1ffe-43b6-b1f2-5a8ed4f4f6ec tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Successfully detached device tapdeb6fd31-3a from instance 5d50f597-3a29-4335-8166-6ab8e8149376 from the live domain config.
Apr 13 16:29:51 user nova-compute[71731]: DEBUG nova.virt.libvirt.vif [None req-036b777d-1ffe-43b6-b1f2-5a8ed4f4f6ec tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T16:27:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2052401344',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-2052401344',id=21,image_ref='708622a9-7465-4492-ade8-b827198f7e30',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAENxxbnK5TO5rrhClGAK4OGBjRSl2WhguyF+uaJMZFTdQImhP15imwNCemvjwOF1cJdEvHpeqOmPATUZWcFezxU2vmY8dwhasInHSqB5TQd2r6SmgLKfFX1fag2EbRN/A==',key_name='tempest-keypair-1469740557',keypairs=<?>,launch_index=0,launched_at=2023-04-13T16:27:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3c33fd5889ce4d0b983f529767005267',ramdisk_id='',reservation_id='r-99cwosbm',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='708622a9-7465-4492-ade8-b827198f7e30',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1979050233',owner_user_name='tempest-TaggedAttachmentsTest-1979050233-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T16:27:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fa66202e2e5547d1b6e792557b335d0f',uuid=5d50f597-3a29-4335-8166-6ab8e8149376,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "deb6fd31-3a87-439d-b59c-4f4dbf9a11bc", "address": "fa:16:3e:f5:7f:d0", "network": {"id": "80e09f45-b799-4c16-8c74-ee57ad2c4b6e", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-165222833", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.226", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "3c33fd5889ce4d0b983f529767005267", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdeb6fd31-3a", "ovs_interfaceid": "deb6fd31-3a87-439d-b59c-4f4dbf9a11bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 16:29:51 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-036b777d-1ffe-43b6-b1f2-5a8ed4f4f6ec tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Converting VIF {"id": "deb6fd31-3a87-439d-b59c-4f4dbf9a11bc", "address": "fa:16:3e:f5:7f:d0", "network": {"id": "80e09f45-b799-4c16-8c74-ee57ad2c4b6e", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-165222833", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.226", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "3c33fd5889ce4d0b983f529767005267", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdeb6fd31-3a", "ovs_interfaceid": "deb6fd31-3a87-439d-b59c-4f4dbf9a11bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 16:29:51 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-036b777d-1ffe-43b6-b1f2-5a8ed4f4f6ec tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:7f:d0,bridge_name='br-int',has_traffic_filtering=True,id=deb6fd31-3a87-439d-b59c-4f4dbf9a11bc,network=Network(80e09f45-b799-4c16-8c74-ee57ad2c4b6e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdeb6fd31-3a') {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 16:29:51 user nova-compute[71731]: DEBUG os_vif [None req-036b777d-1ffe-43b6-b1f2-5a8ed4f4f6ec tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:7f:d0,bridge_name='br-int',has_traffic_filtering=True,id=deb6fd31-3a87-439d-b59c-4f4dbf9a11bc,network=Network(80e09f45-b799-4c16-8c74-ee57ad2c4b6e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdeb6fd31-3a') {{(pid=71731) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 16:29:51 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:29:51 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdeb6fd31-3a, bridge=br-int, if_exists=True) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:29:51 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:29:51 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 16:29:51 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:29:51 user nova-compute[71731]: INFO os_vif [None req-036b777d-1ffe-43b6-b1f2-5a8ed4f4f6ec tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:7f:d0,bridge_name='br-int',has_traffic_filtering=True,id=deb6fd31-3a87-439d-b59c-4f4dbf9a11bc,network=Network(80e09f45-b799-4c16-8c74-ee57ad2c4b6e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdeb6fd31-3a')
Apr 13 16:29:51 user nova-compute[71731]: DEBUG nova.virt.libvirt.guest [None req-036b777d-1ffe-43b6-b1f2-5a8ed4f4f6ec tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 16:29:51 user nova-compute[71731]:   <nova:package version="0.0.0"/>
Apr 13 16:29:51 user nova-compute[71731]:   <nova:name>tempest-device-tagging-server-2052401344</nova:name>
Apr 13 16:29:51 user nova-compute[71731]:   <nova:creationTime>2023-04-13 16:29:51</nova:creationTime>
Apr 13 16:29:51 user nova-compute[71731]:   <nova:flavor name="m1.nano">
Apr 13 16:29:51 user nova-compute[71731]:     <nova:memory>128</nova:memory>
Apr 13 16:29:51 user nova-compute[71731]:     <nova:disk>1</nova:disk>
Apr 13 16:29:51 user nova-compute[71731]:     <nova:swap>0</nova:swap>
Apr 13 16:29:51 user nova-compute[71731]:     <nova:ephemeral>0</nova:ephemeral>
Apr 13 16:29:51 user nova-compute[71731]:     <nova:vcpus>1</nova:vcpus>
Apr 13 16:29:51 user nova-compute[71731]:   </nova:flavor>
Apr 13 16:29:51 user nova-compute[71731]:   <nova:owner>
Apr 13 16:29:51 user nova-compute[71731]:     <nova:user uuid="fa66202e2e5547d1b6e792557b335d0f">tempest-TaggedAttachmentsTest-1979050233-project-member</nova:user>
Apr 13 16:29:51 user nova-compute[71731]:     <nova:project uuid="3c33fd5889ce4d0b983f529767005267">tempest-TaggedAttachmentsTest-1979050233</nova:project>
Apr 13 16:29:51 user nova-compute[71731]:   </nova:owner>
Apr 13 16:29:51 user nova-compute[71731]:   <nova:root type="image" uuid="708622a9-7465-4492-ade8-b827198f7e30"/>
Apr 13 16:29:51 user nova-compute[71731]:   <nova:ports>
Apr 13 16:29:51 user nova-compute[71731]:     <nova:port uuid="cde3b0f9-9ed1-4eba-8560-d5fa05166b2e">
Apr 13 16:29:51 user nova-compute[71731]:       <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Apr 13 16:29:51 user nova-compute[71731]:     </nova:port>
Apr 13 16:29:51 user nova-compute[71731]:   </nova:ports>
Apr 13 16:29:51 user nova-compute[71731]: </nova:instance>
Apr 13 16:29:51 user nova-compute[71731]:  {{(pid=71731) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Apr 13 16:29:51 user nova-compute[71731]: DEBUG nova.compute.manager [req-4c431ddf-d0a5-4573-b723-ea5ce5ffbf86 req-cd2b656b-374b-4584-9dee-37eed42f3b1f service nova] [instance: 5d50f597-3a29-4335-8166-6ab8e8149376] Received event network-vif-unplugged-deb6fd31-3a87-439d-b59c-4f4dbf9a11bc {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:29:51 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-4c431ddf-d0a5-4573-b723-ea5ce5ffbf86 req-cd2b656b-374b-4584-9dee-37eed42f3b1f service nova] Acquiring lock "5d50f597-3a29-4335-8166-6ab8e8149376-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:29:51 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-4c431ddf-d0a5-4573-b723-ea5ce5ffbf86 req-cd2b656b-374b-4584-9dee-37eed42f3b1f service nova] Lock "5d50f597-3a29-4335-8166-6ab8e8149376-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:29:51 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-4c431ddf-d0a5-4573-b723-ea5ce5ffbf86 req-cd2b656b-374b-4584-9dee-37eed42f3b1f service nova] Lock "5d50f597-3a29-4335-8166-6ab8e8149376-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:29:51 user nova-compute[71731]: DEBUG nova.compute.manager [req-4c431ddf-d0a5-4573-b723-ea5ce5ffbf86 req-cd2b656b-374b-4584-9dee-37eed42f3b1f service nova] [instance: 5d50f597-3a29-4335-8166-6ab8e8149376] No waiting events found dispatching network-vif-unplugged-deb6fd31-3a87-439d-b59c-4f4dbf9a11bc {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:29:51 user nova-compute[71731]: WARNING nova.compute.manager [req-4c431ddf-d0a5-4573-b723-ea5ce5ffbf86 req-cd2b656b-374b-4584-9dee-37eed42f3b1f service nova] [instance: 5d50f597-3a29-4335-8166-6ab8e8149376] Received unexpected event network-vif-unplugged-deb6fd31-3a87-439d-b59c-4f4dbf9a11bc for instance with vm_state active and task_state None.
Apr 13 16:29:52 user nova-compute[71731]: DEBUG nova.compute.manager [req-d9a5f313-ef9a-4b65-a37e-834c317a5f35 req-a2b5f3c9-f9bc-4923-b95f-c13159f8077c service nova] [instance: 5d50f597-3a29-4335-8166-6ab8e8149376] Received event network-vif-deleted-deb6fd31-3a87-439d-b59c-4f4dbf9a11bc {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:29:52 user nova-compute[71731]: INFO nova.compute.manager [req-d9a5f313-ef9a-4b65-a37e-834c317a5f35 req-a2b5f3c9-f9bc-4923-b95f-c13159f8077c service nova] [instance: 5d50f597-3a29-4335-8166-6ab8e8149376] Neutron deleted interface deb6fd31-3a87-439d-b59c-4f4dbf9a11bc; detaching it from the instance and deleting it from the info cache
Apr 13 16:29:52 user nova-compute[71731]: DEBUG nova.network.neutron [req-d9a5f313-ef9a-4b65-a37e-834c317a5f35 req-a2b5f3c9-f9bc-4923-b95f-c13159f8077c service nova] [instance: 5d50f597-3a29-4335-8166-6ab8e8149376] Updating instance_info_cache with network_info: [{"id": "cde3b0f9-9ed1-4eba-8560-d5fa05166b2e", "address": "fa:16:3e:9d:e7:97", "network": {"id": "c790aafd-fad0-4403-bfad-05bbf49d23b2", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1464281989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c33fd5889ce4d0b983f529767005267", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcde3b0f9-9e", "ovs_interfaceid": "cde3b0f9-9ed1-4eba-8560-d5fa05166b2e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:29:52 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-036b777d-1ffe-43b6-b1f2-5a8ed4f4f6ec tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Acquiring lock "refresh_cache-5d50f597-3a29-4335-8166-6ab8e8149376" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 16:29:52 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-036b777d-1ffe-43b6-b1f2-5a8ed4f4f6ec tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Acquired lock "refresh_cache-5d50f597-3a29-4335-8166-6ab8e8149376" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 16:29:52 user nova-compute[71731]: DEBUG nova.network.neutron [None req-036b777d-1ffe-43b6-b1f2-5a8ed4f4f6ec tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] [instance: 5d50f597-3a29-4335-8166-6ab8e8149376] Building network info cache for instance {{(pid=71731) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 16:29:52 user nova-compute[71731]: DEBUG nova.objects.instance [req-d9a5f313-ef9a-4b65-a37e-834c317a5f35 req-a2b5f3c9-f9bc-4923-b95f-c13159f8077c service nova] Lazy-loading 'system_metadata' on Instance uuid 5d50f597-3a29-4335-8166-6ab8e8149376 {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:29:52 user nova-compute[71731]: DEBUG nova.objects.instance [req-d9a5f313-ef9a-4b65-a37e-834c317a5f35 req-a2b5f3c9-f9bc-4923-b95f-c13159f8077c service nova] Lazy-loading 'flavor' on Instance uuid 5d50f597-3a29-4335-8166-6ab8e8149376 {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:29:52 user nova-compute[71731]: DEBUG nova.virt.libvirt.vif [req-d9a5f313-ef9a-4b65-a37e-834c317a5f35 req-a2b5f3c9-f9bc-4923-b95f-c13159f8077c service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T16:27:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2052401344',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-2052401344',id=21,image_ref='708622a9-7465-4492-ade8-b827198f7e30',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAENxxbnK5TO5rrhClGAK4OGBjRSl2WhguyF+uaJMZFTdQImhP15imwNCemvjwOF1cJdEvHpeqOmPATUZWcFezxU2vmY8dwhasInHSqB5TQd2r6SmgLKfFX1fag2EbRN/A==',key_name='tempest-keypair-1469740557',keypairs=<?>,launch_index=0,launched_at=2023-04-13T16:27:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3c33fd5889ce4d0b983f529767005267',ramdisk_id='',reservation_id='r-99cwosbm',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='708622a9-7465-4492-ade8-b827198f7e30',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1979050233',owner_user_name='tempest-TaggedAttachmentsTest-1979050233-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T16:27:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fa66202e2e5547d1b6e792557b335d0f',uuid=5d50f597-3a29-4335-8166-6ab8e8149376,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "deb6fd31-3a87-439d-b59c-4f4dbf9a11bc", "address": "fa:16:3e:f5:7f:d0", "network": {"id": "80e09f45-b799-4c16-8c74-ee57ad2c4b6e", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-165222833", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.226", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "3c33fd5889ce4d0b983f529767005267", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdeb6fd31-3a", "ovs_interfaceid": "deb6fd31-3a87-439d-b59c-4f4dbf9a11bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71731) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 16:29:52 user nova-compute[71731]: DEBUG nova.network.os_vif_util [req-d9a5f313-ef9a-4b65-a37e-834c317a5f35 req-a2b5f3c9-f9bc-4923-b95f-c13159f8077c service nova] Converting VIF {"id": "deb6fd31-3a87-439d-b59c-4f4dbf9a11bc", "address": "fa:16:3e:f5:7f:d0", "network": {"id": "80e09f45-b799-4c16-8c74-ee57ad2c4b6e", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-165222833", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.226", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "3c33fd5889ce4d0b983f529767005267", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdeb6fd31-3a", "ovs_interfaceid": "deb6fd31-3a87-439d-b59c-4f4dbf9a11bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 16:29:52 user nova-compute[71731]: DEBUG nova.network.os_vif_util [req-d9a5f313-ef9a-4b65-a37e-834c317a5f35 req-a2b5f3c9-f9bc-4923-b95f-c13159f8077c service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:7f:d0,bridge_name='br-int',has_traffic_filtering=True,id=deb6fd31-3a87-439d-b59c-4f4dbf9a11bc,network=Network(80e09f45-b799-4c16-8c74-ee57ad2c4b6e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdeb6fd31-3a') {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 16:29:52 user nova-compute[71731]: DEBUG nova.virt.libvirt.guest [req-d9a5f313-ef9a-4b65-a37e-834c317a5f35 req-a2b5f3c9-f9bc-4923-b95f-c13159f8077c service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:f5:7f:d0"/><model type="virtio"/><mtu size="1442"/><target dev="tapdeb6fd31-3a"/></interface> {{(pid=71731) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Apr 13 16:29:52 user nova-compute[71731]: DEBUG nova.virt.libvirt.guest [req-d9a5f313-ef9a-4b65-a37e-834c317a5f35 req-a2b5f3c9-f9bc-4923-b95f-c13159f8077c service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:f5:7f:d0"/><model type="virtio"/><mtu size="1442"/><target dev="tapdeb6fd31-3a"/></interface>not found in domain: <domain type='kvm' id='27'>
Apr 13 16:29:52 user nova-compute[71731]:   <name>instance-00000015</name>
Apr 13 16:29:52 user nova-compute[71731]:   <uuid>5d50f597-3a29-4335-8166-6ab8e8149376</uuid>
Apr 13 16:29:52 user nova-compute[71731]:   <metadata>
Apr 13 16:29:52 user nova-compute[71731]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 16:29:52 user nova-compute[71731]:   <nova:package version="0.0.0"/>
Apr 13 16:29:52 user nova-compute[71731]:   <nova:name>tempest-device-tagging-server-2052401344</nova:name>
Apr 13 16:29:52 user nova-compute[71731]:   <nova:creationTime>2023-04-13 16:29:51</nova:creationTime>
Apr 13 16:29:52 user nova-compute[71731]:   <nova:flavor name="m1.nano">
Apr 13 16:29:52 user nova-compute[71731]:     <nova:memory>128</nova:memory>
Apr 13 16:29:52 user nova-compute[71731]:     <nova:disk>1</nova:disk>
Apr 13 16:29:52 user nova-compute[71731]:     <nova:swap>0</nova:swap>
Apr 13 16:29:52 user nova-compute[71731]:     <nova:ephemeral>0</nova:ephemeral>
Apr 13 16:29:52 user nova-compute[71731]:     <nova:vcpus>1</nova:vcpus>
Apr 13 16:29:52 user nova-compute[71731]:   </nova:flavor>
Apr 13 16:29:52 user nova-compute[71731]:   <nova:owner>
Apr 13 16:29:52 user nova-compute[71731]:     <nova:user uuid="fa66202e2e5547d1b6e792557b335d0f">tempest-TaggedAttachmentsTest-1979050233-project-member</nova:user>
Apr 13 16:29:52 user nova-compute[71731]:     <nova:project uuid="3c33fd5889ce4d0b983f529767005267">tempest-TaggedAttachmentsTest-1979050233</nova:project>
Apr 13 16:29:52 user nova-compute[71731]:   </nova:owner>
Apr 13 16:29:52 user nova-compute[71731]:   <nova:root type="image" uuid="708622a9-7465-4492-ade8-b827198f7e30"/>
Apr 13 16:29:52 user nova-compute[71731]:   <nova:ports>
Apr 13 16:29:52 user nova-compute[71731]:     <nova:port uuid="cde3b0f9-9ed1-4eba-8560-d5fa05166b2e">
Apr 13 16:29:52 user nova-compute[71731]:       <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Apr 13 16:29:52 user nova-compute[71731]:     </nova:port>
Apr 13 16:29:52 user nova-compute[71731]:   </nova:ports>
Apr 13 16:29:52 user nova-compute[71731]: </nova:instance>
Apr 13 16:29:52 user nova-compute[71731]:   </metadata>
Apr 13 16:29:52 user nova-compute[71731]:   <memory unit='KiB'>131072</memory>
Apr 13 16:29:52 user nova-compute[71731]:   <currentMemory unit='KiB'>131072</currentMemory>
Apr 13 16:29:52 user nova-compute[71731]:   <vcpu placement='static'>1</vcpu>
Apr 13 16:29:52 user nova-compute[71731]:   <resource>
Apr 13 16:29:52 user nova-compute[71731]:     <partition>/machine</partition>
Apr 13 16:29:52 user nova-compute[71731]:   </resource>
Apr 13 16:29:52 user nova-compute[71731]:   <sysinfo type='smbios'>
Apr 13 16:29:52 user nova-compute[71731]:     <system>
Apr 13 16:29:52 user nova-compute[71731]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Apr 13 16:29:52 user nova-compute[71731]:       <entry name='product'>OpenStack Nova</entry>
Apr 13 16:29:52 user nova-compute[71731]:       <entry name='version'>0.0.0</entry>
Apr 13 16:29:52 user nova-compute[71731]:       <entry name='serial'>5d50f597-3a29-4335-8166-6ab8e8149376</entry>
Apr 13 16:29:52 user nova-compute[71731]:       <entry name='uuid'>5d50f597-3a29-4335-8166-6ab8e8149376</entry>
Apr 13 16:29:52 user nova-compute[71731]:       <entry name='family'>Virtual Machine</entry>
Apr 13 16:29:52 user nova-compute[71731]:     </system>
Apr 13 16:29:52 user nova-compute[71731]:   </sysinfo>
Apr 13 16:29:52 user nova-compute[71731]:   <os>
Apr 13 16:29:52 user nova-compute[71731]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Apr 13 16:29:52 user nova-compute[71731]:     <boot dev='hd'/>
Apr 13 16:29:52 user nova-compute[71731]:     <smbios mode='sysinfo'/>
Apr 13 16:29:52 user nova-compute[71731]:   </os>
Apr 13 16:29:52 user nova-compute[71731]:   <features>
Apr 13 16:29:52 user nova-compute[71731]:     <acpi/>
Apr 13 16:29:52 user nova-compute[71731]:     <apic/>
Apr 13 16:29:52 user nova-compute[71731]:     <vmcoreinfo state='on'/>
Apr 13 16:29:52 user nova-compute[71731]:   </features>
Apr 13 16:29:52 user nova-compute[71731]:   <cpu mode='custom' match='exact' check='full'>
Apr 13 16:29:52 user nova-compute[71731]:     <model fallback='forbid'>Nehalem</model>
Apr 13 16:29:52 user nova-compute[71731]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Apr 13 16:29:52 user nova-compute[71731]:     <feature policy='require' name='vme'/>
Apr 13 16:29:52 user nova-compute[71731]:     <feature policy='require' name='x2apic'/>
Apr 13 16:29:52 user nova-compute[71731]:     <feature policy='require' name='hypervisor'/>
Apr 13 16:29:52 user nova-compute[71731]:   </cpu>
Apr 13 16:29:52 user nova-compute[71731]:   <clock offset='utc'>
Apr 13 16:29:52 user nova-compute[71731]:     <timer name='pit' tickpolicy='delay'/>
Apr 13 16:29:52 user nova-compute[71731]:     <timer name='rtc' tickpolicy='catchup'/>
Apr 13 16:29:52 user nova-compute[71731]:     <timer name='hpet' present='no'/>
Apr 13 16:29:52 user nova-compute[71731]:   </clock>
Apr 13 16:29:52 user nova-compute[71731]:   <on_poweroff>destroy</on_poweroff>
Apr 13 16:29:52 user nova-compute[71731]:   <on_reboot>restart</on_reboot>
Apr 13 16:29:52 user nova-compute[71731]:   <on_crash>destroy</on_crash>
Apr 13 16:29:52 user nova-compute[71731]:   <devices>
Apr 13 16:29:52 user nova-compute[71731]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Apr 13 16:29:52 user nova-compute[71731]:     <disk type='file' device='disk'>
Apr 13 16:29:52 user nova-compute[71731]:       <driver name='qemu' type='qcow2' cache='none'/>
Apr 13 16:29:52 user nova-compute[71731]:       <source file='/opt/stack/data/nova/instances/5d50f597-3a29-4335-8166-6ab8e8149376/disk' index='2'/>
Apr 13 16:29:52 user nova-compute[71731]:       <backingStore type='file' index='3'>
Apr 13 16:29:52 user nova-compute[71731]:         <format type='raw'/>
Apr 13 16:29:52 user nova-compute[71731]:         <source file='/opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279'/>
Apr 13 16:29:52 user nova-compute[71731]:         <backingStore/>
Apr 13 16:29:52 user nova-compute[71731]:       </backingStore>
Apr 13 16:29:52 user nova-compute[71731]:       <target dev='vda' bus='virtio'/>
Apr 13 16:29:52 user nova-compute[71731]:       <alias name='virtio-disk0'/>
Apr 13 16:29:52 user nova-compute[71731]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Apr 13 16:29:52 user nova-compute[71731]:     </disk>
Apr 13 16:29:52 user nova-compute[71731]:     <disk type='file' device='cdrom'>
Apr 13 16:29:52 user nova-compute[71731]:       <driver name='qemu' type='raw' cache='none'/>
Apr 13 16:29:52 user nova-compute[71731]:       <source file='/opt/stack/data/nova/instances/5d50f597-3a29-4335-8166-6ab8e8149376/disk.config' index='1'/>
Apr 13 16:29:52 user nova-compute[71731]:       <backingStore/>
Apr 13 16:29:52 user nova-compute[71731]:       <target dev='hda' bus='ide'/>
Apr 13 16:29:52 user nova-compute[71731]:       <readonly/>
Apr 13 16:29:52 user nova-compute[71731]:       <alias name='ide0-0-0'/>
Apr 13 16:29:52 user nova-compute[71731]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Apr 13 16:29:52 user nova-compute[71731]:     </disk>
Apr 13 16:29:52 user nova-compute[71731]:     <controller type='usb' index='0' model='none'>
Apr 13 16:29:52 user nova-compute[71731]:       <alias name='usb'/>
Apr 13 16:29:52 user nova-compute[71731]:     </controller>
Apr 13 16:29:52 user nova-compute[71731]:     <controller type='pci' index='0' model='pci-root'>
Apr 13 16:29:52 user nova-compute[71731]:       <alias name='pci.0'/>
Apr 13 16:29:52 user nova-compute[71731]:     </controller>
Apr 13 16:29:52 user nova-compute[71731]:     <controller type='ide' index='0'>
Apr 13 16:29:52 user nova-compute[71731]:       <alias name='ide'/>
Apr 13 16:29:52 user nova-compute[71731]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Apr 13 16:29:52 user nova-compute[71731]:     </controller>
Apr 13 16:29:52 user nova-compute[71731]:     <interface type='ethernet'>
Apr 13 16:29:52 user nova-compute[71731]:       <mac address='fa:16:3e:9d:e7:97'/>
Apr 13 16:29:52 user nova-compute[71731]:       <target dev='tapcde3b0f9-9e'/>
Apr 13 16:29:52 user nova-compute[71731]:       <model type='virtio'/>
Apr 13 16:29:52 user nova-compute[71731]:       <mtu size='1442'/>
Apr 13 16:29:52 user nova-compute[71731]:       <alias name='net0'/>
Apr 13 16:29:52 user nova-compute[71731]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Apr 13 16:29:52 user nova-compute[71731]:     </interface>
Apr 13 16:29:52 user nova-compute[71731]:     <serial type='pty'>
Apr 13 16:29:52 user nova-compute[71731]:       <source path='/dev/pts/5'/>
Apr 13 16:29:52 user nova-compute[71731]:       <log file='/opt/stack/data/nova/instances/5d50f597-3a29-4335-8166-6ab8e8149376/console.log' append='off'/>
Apr 13 16:29:52 user nova-compute[71731]:       <target type='isa-serial' port='0'>
Apr 13 16:29:52 user nova-compute[71731]:         <model name='isa-serial'/>
Apr 13 16:29:52 user nova-compute[71731]:       </target>
Apr 13 16:29:52 user nova-compute[71731]:       <alias name='serial0'/>
Apr 13 16:29:52 user nova-compute[71731]:     </serial>
Apr 13 16:29:52 user nova-compute[71731]:     <console type='pty' tty='/dev/pts/5'>
Apr 13 16:29:52 user nova-compute[71731]:       <source path='/dev/pts/5'/>
Apr 13 16:29:52 user nova-compute[71731]:       <log file='/opt/stack/data/nova/instances/5d50f597-3a29-4335-8166-6ab8e8149376/console.log' append='off'/>
Apr 13 16:29:52 user nova-compute[71731]:       <target type='serial' port='0'/>
Apr 13 16:29:52 user nova-compute[71731]:       <alias name='serial0'/>
Apr 13 16:29:52 user nova-compute[71731]:     </console>
Apr 13 16:29:52 user nova-compute[71731]:     <input type='mouse' bus='ps2'>
Apr 13 16:29:52 user nova-compute[71731]:       <alias name='input0'/>
Apr 13 16:29:52 user nova-compute[71731]:     </input>
Apr 13 16:29:52 user nova-compute[71731]:     <input type='keyboard' bus='ps2'>
Apr 13 16:29:52 user nova-compute[71731]:       <alias name='input1'/>
Apr 13 16:29:52 user nova-compute[71731]:     </input>
Apr 13 16:29:52 user nova-compute[71731]:     <graphics type='vnc' port='5906' autoport='yes' listen='0.0.0.0'>
Apr 13 16:29:52 user nova-compute[71731]:       <listen type='address' address='0.0.0.0'/>
Apr 13 16:29:52 user nova-compute[71731]:     </graphics>
Apr 13 16:29:52 user nova-compute[71731]:     <audio id='1' type='none'/>
Apr 13 16:29:52 user nova-compute[71731]:     <video>
Apr 13 16:29:52 user nova-compute[71731]:       <model type='virtio' heads='1' primary='yes'/>
Apr 13 16:29:52 user nova-compute[71731]:       <alias name='video0'/>
Apr 13 16:29:52 user nova-compute[71731]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Apr 13 16:29:52 user nova-compute[71731]:     </video>
Apr 13 16:29:52 user nova-compute[71731]:     <memballoon model='virtio'>
Apr 13 16:29:52 user nova-compute[71731]:       <stats period='10'/>
Apr 13 16:29:52 user nova-compute[71731]:       <alias name='balloon0'/>
Apr 13 16:29:52 user nova-compute[71731]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Apr 13 16:29:52 user nova-compute[71731]:     </memballoon>
Apr 13 16:29:52 user nova-compute[71731]:     <rng model='virtio'>
Apr 13 16:29:52 user nova-compute[71731]:       <backend model='random'>/dev/urandom</backend>
Apr 13 16:29:52 user nova-compute[71731]:       <alias name='rng0'/>
Apr 13 16:29:52 user nova-compute[71731]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Apr 13 16:29:52 user nova-compute[71731]:     </rng>
Apr 13 16:29:52 user nova-compute[71731]:   </devices>
Apr 13 16:29:52 user nova-compute[71731]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Apr 13 16:29:52 user nova-compute[71731]:     <label>libvirt-5d50f597-3a29-4335-8166-6ab8e8149376</label>
Apr 13 16:29:52 user nova-compute[71731]:     <imagelabel>libvirt-5d50f597-3a29-4335-8166-6ab8e8149376</imagelabel>
Apr 13 16:29:52 user nova-compute[71731]:   </seclabel>
Apr 13 16:29:52 user nova-compute[71731]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Apr 13 16:29:52 user nova-compute[71731]:     <label>+64055:+108</label>
Apr 13 16:29:52 user nova-compute[71731]:     <imagelabel>+64055:+108</imagelabel>
Apr 13 16:29:52 user nova-compute[71731]:   </seclabel>
Apr 13 16:29:52 user nova-compute[71731]: </domain>
Apr 13 16:29:52 user nova-compute[71731]:  {{(pid=71731) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Apr 13 16:29:52 user nova-compute[71731]: DEBUG nova.virt.libvirt.guest [req-d9a5f313-ef9a-4b65-a37e-834c317a5f35 req-a2b5f3c9-f9bc-4923-b95f-c13159f8077c service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:f5:7f:d0"/><model type="virtio"/><mtu size="1442"/><target dev="tapdeb6fd31-3a"/></interface> {{(pid=71731) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Apr 13 16:29:52 user nova-compute[71731]: DEBUG nova.virt.libvirt.guest [req-d9a5f313-ef9a-4b65-a37e-834c317a5f35 req-a2b5f3c9-f9bc-4923-b95f-c13159f8077c service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:f5:7f:d0"/><model type="virtio"/><mtu size="1442"/><target dev="tapdeb6fd31-3a"/></interface>not found in domain: <domain type='kvm' id='27'>
Apr 13 16:29:52 user nova-compute[71731]:   <name>instance-00000015</name>
Apr 13 16:29:52 user nova-compute[71731]:   <uuid>5d50f597-3a29-4335-8166-6ab8e8149376</uuid>
Apr 13 16:29:52 user nova-compute[71731]:   <metadata>
Apr 13 16:29:52 user nova-compute[71731]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 16:29:52 user nova-compute[71731]:   <nova:package version="0.0.0"/>
Apr 13 16:29:52 user nova-compute[71731]:   <nova:name>tempest-device-tagging-server-2052401344</nova:name>
Apr 13 16:29:52 user nova-compute[71731]:   <nova:creationTime>2023-04-13 16:29:51</nova:creationTime>
Apr 13 16:29:52 user nova-compute[71731]:   <nova:flavor name="m1.nano">
Apr 13 16:29:52 user nova-compute[71731]:     <nova:memory>128</nova:memory>
Apr 13 16:29:52 user nova-compute[71731]:     <nova:disk>1</nova:disk>
Apr 13 16:29:52 user nova-compute[71731]:     <nova:swap>0</nova:swap>
Apr 13 16:29:52 user nova-compute[71731]:     <nova:ephemeral>0</nova:ephemeral>
Apr 13 16:29:52 user nova-compute[71731]:     <nova:vcpus>1</nova:vcpus>
Apr 13 16:29:52 user nova-compute[71731]:   </nova:flavor>
Apr 13 16:29:52 user nova-compute[71731]:   <nova:owner>
Apr 13 16:29:52 user nova-compute[71731]:     <nova:user uuid="fa66202e2e5547d1b6e792557b335d0f">tempest-TaggedAttachmentsTest-1979050233-project-member</nova:user>
Apr 13 16:29:52 user nova-compute[71731]:     <nova:project uuid="3c33fd5889ce4d0b983f529767005267">tempest-TaggedAttachmentsTest-1979050233</nova:project>
Apr 13 16:29:52 user nova-compute[71731]:   </nova:owner>
Apr 13 16:29:52 user nova-compute[71731]:   <nova:root type="image" uuid="708622a9-7465-4492-ade8-b827198f7e30"/>
Apr 13 16:29:52 user nova-compute[71731]:   <nova:ports>
Apr 13 16:29:52 user nova-compute[71731]:     <nova:port uuid="cde3b0f9-9ed1-4eba-8560-d5fa05166b2e">
Apr 13 16:29:52 user nova-compute[71731]:       <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Apr 13 16:29:52 user nova-compute[71731]:     </nova:port>
Apr 13 16:29:52 user nova-compute[71731]:   </nova:ports>
Apr 13 16:29:52 user nova-compute[71731]: </nova:instance>
Apr 13 16:29:52 user nova-compute[71731]:   </metadata>
Apr 13 16:29:52 user nova-compute[71731]:   <memory unit='KiB'>131072</memory>
Apr 13 16:29:52 user nova-compute[71731]:   <currentMemory unit='KiB'>131072</currentMemory>
Apr 13 16:29:52 user nova-compute[71731]:   <vcpu placement='static'>1</vcpu>
Apr 13 16:29:52 user nova-compute[71731]:   <resource>
Apr 13 16:29:52 user nova-compute[71731]:     <partition>/machine</partition>
Apr 13 16:29:52 user nova-compute[71731]:   </resource>
Apr 13 16:29:52 user nova-compute[71731]:   <sysinfo type='smbios'>
Apr 13 16:29:52 user nova-compute[71731]:     <system>
Apr 13 16:29:52 user nova-compute[71731]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Apr 13 16:29:52 user nova-compute[71731]:       <entry name='product'>OpenStack Nova</entry>
Apr 13 16:29:52 user nova-compute[71731]:       <entry name='version'>0.0.0</entry>
Apr 13 16:29:52 user nova-compute[71731]:       <entry name='serial'>5d50f597-3a29-4335-8166-6ab8e8149376</entry>
Apr 13 16:29:52 user nova-compute[71731]:       <entry name='uuid'>5d50f597-3a29-4335-8166-6ab8e8149376</entry>
Apr 13 16:29:52 user nova-compute[71731]:       <entry name='family'>Virtual Machine</entry>
Apr 13 16:29:52 user nova-compute[71731]:     </system>
Apr 13 16:29:52 user nova-compute[71731]:   </sysinfo>
Apr 13 16:29:52 user nova-compute[71731]:   <os>
Apr 13 16:29:52 user nova-compute[71731]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Apr 13 16:29:52 user nova-compute[71731]:     <boot dev='hd'/>
Apr 13 16:29:52 user nova-compute[71731]:     <smbios mode='sysinfo'/>
Apr 13 16:29:52 user nova-compute[71731]:   </os>
Apr 13 16:29:52 user nova-compute[71731]:   <features>
Apr 13 16:29:52 user nova-compute[71731]:     <acpi/>
Apr 13 16:29:52 user nova-compute[71731]:     <apic/>
Apr 13 16:29:52 user nova-compute[71731]:     <vmcoreinfo state='on'/>
Apr 13 16:29:52 user nova-compute[71731]:   </features>
Apr 13 16:29:52 user nova-compute[71731]:   <cpu mode='custom' match='exact' check='full'>
Apr 13 16:29:52 user nova-compute[71731]:     <model fallback='forbid'>Nehalem</model>
Apr 13 16:29:52 user nova-compute[71731]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Apr 13 16:29:52 user nova-compute[71731]:     <feature policy='require' name='vme'/>
Apr 13 16:29:52 user nova-compute[71731]:     <feature policy='require' name='x2apic'/>
Apr 13 16:29:52 user nova-compute[71731]:     <feature policy='require' name='hypervisor'/>
Apr 13 16:29:52 user nova-compute[71731]:   </cpu>
Apr 13 16:29:52 user nova-compute[71731]:   <clock offset='utc'>
Apr 13 16:29:52 user nova-compute[71731]:     <timer name='pit' tickpolicy='delay'/>
Apr 13 16:29:52 user nova-compute[71731]:     <timer name='rtc' tickpolicy='catchup'/>
Apr 13 16:29:52 user nova-compute[71731]:     <timer name='hpet' present='no'/>
Apr 13 16:29:52 user nova-compute[71731]:   </clock>
Apr 13 16:29:52 user nova-compute[71731]:   <on_poweroff>destroy</on_poweroff>
Apr 13 16:29:52 user nova-compute[71731]:   <on_reboot>restart</on_reboot>
Apr 13 16:29:52 user nova-compute[71731]:   <on_crash>destroy</on_crash>
Apr 13 16:29:52 user nova-compute[71731]:   <devices>
Apr 13 16:29:52 user nova-compute[71731]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Apr 13 16:29:52 user nova-compute[71731]:     <disk type='file' device='disk'>
Apr 13 16:29:52 user nova-compute[71731]:       <driver name='qemu' type='qcow2' cache='none'/>
Apr 13 16:29:52 user nova-compute[71731]:       <source file='/opt/stack/data/nova/instances/5d50f597-3a29-4335-8166-6ab8e8149376/disk' index='2'/>
Apr 13 16:29:52 user nova-compute[71731]:       <backingStore type='file' index='3'>
Apr 13 16:29:52 user nova-compute[71731]:         <format type='raw'/>
Apr 13 16:29:52 user nova-compute[71731]:         <source file='/opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279'/>
Apr 13 16:29:52 user nova-compute[71731]:         <backingStore/>
Apr 13 16:29:52 user nova-compute[71731]:       </backingStore>
Apr 13 16:29:52 user nova-compute[71731]:       <target dev='vda' bus='virtio'/>
Apr 13 16:29:52 user nova-compute[71731]:       <alias name='virtio-disk0'/>
Apr 13 16:29:52 user nova-compute[71731]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Apr 13 16:29:52 user nova-compute[71731]:     </disk>
Apr 13 16:29:52 user nova-compute[71731]:     <disk type='file' device='cdrom'>
Apr 13 16:29:52 user nova-compute[71731]:       <driver name='qemu' type='raw' cache='none'/>
Apr 13 16:29:52 user nova-compute[71731]:       <source file='/opt/stack/data/nova/instances/5d50f597-3a29-4335-8166-6ab8e8149376/disk.config' index='1'/>
Apr 13 16:29:52 user nova-compute[71731]:       <backingStore/>
Apr 13 16:29:52 user nova-compute[71731]:       <target dev='hda' bus='ide'/>
Apr 13 16:29:52 user nova-compute[71731]:       <readonly/>
Apr 13 16:29:52 user nova-compute[71731]:       <alias name='ide0-0-0'/>
Apr 13 16:29:52 user nova-compute[71731]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Apr 13 16:29:52 user nova-compute[71731]:     </disk>
Apr 13 16:29:52 user nova-compute[71731]:     <controller type='usb' index='0' model='none'>
Apr 13 16:29:52 user nova-compute[71731]:       <alias name='usb'/>
Apr 13 16:29:52 user nova-compute[71731]:     </controller>
Apr 13 16:29:52 user nova-compute[71731]:     <controller type='pci' index='0' model='pci-root'>
Apr 13 16:29:52 user nova-compute[71731]:       <alias name='pci.0'/>
Apr 13 16:29:52 user nova-compute[71731]:     </controller>
Apr 13 16:29:52 user nova-compute[71731]:     <controller type='ide' index='0'>
Apr 13 16:29:52 user nova-compute[71731]:       <alias name='ide'/>
Apr 13 16:29:52 user nova-compute[71731]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Apr 13 16:29:52 user nova-compute[71731]:     </controller>
Apr 13 16:29:52 user nova-compute[71731]:     <interface type='ethernet'>
Apr 13 16:29:52 user nova-compute[71731]:       <mac address='fa:16:3e:9d:e7:97'/>
Apr 13 16:29:52 user nova-compute[71731]:       <target dev='tapcde3b0f9-9e'/>
Apr 13 16:29:52 user nova-compute[71731]:       <model type='virtio'/>
Apr 13 16:29:52 user nova-compute[71731]:       <mtu size='1442'/>
Apr 13 16:29:52 user nova-compute[71731]:       <alias name='net0'/>
Apr 13 16:29:52 user nova-compute[71731]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Apr 13 16:29:52 user nova-compute[71731]:     </interface>
Apr 13 16:29:52 user nova-compute[71731]:     <serial type='pty'>
Apr 13 16:29:52 user nova-compute[71731]:       <source path='/dev/pts/5'/>
Apr 13 16:29:52 user nova-compute[71731]:       <log file='/opt/stack/data/nova/instances/5d50f597-3a29-4335-8166-6ab8e8149376/console.log' append='off'/>
Apr 13 16:29:52 user nova-compute[71731]:       <target type='isa-serial' port='0'>
Apr 13 16:29:52 user nova-compute[71731]:         <model name='isa-serial'/>
Apr 13 16:29:52 user nova-compute[71731]:       </target>
Apr 13 16:29:52 user nova-compute[71731]:       <alias name='serial0'/>
Apr 13 16:29:52 user nova-compute[71731]:     </serial>
Apr 13 16:29:52 user nova-compute[71731]:     <console type='pty' tty='/dev/pts/5'>
Apr 13 16:29:52 user nova-compute[71731]:       <source path='/dev/pts/5'/>
Apr 13 16:29:52 user nova-compute[71731]:       <log file='/opt/stack/data/nova/instances/5d50f597-3a29-4335-8166-6ab8e8149376/console.log' append='off'/>
Apr 13 16:29:52 user nova-compute[71731]:       <target type='serial' port='0'/>
Apr 13 16:29:52 user nova-compute[71731]:       <alias name='serial0'/>
Apr 13 16:29:52 user nova-compute[71731]:     </console>
Apr 13 16:29:52 user nova-compute[71731]:     <input type='mouse' bus='ps2'>
Apr 13 16:29:52 user nova-compute[71731]:       <alias name='input0'/>
Apr 13 16:29:52 user nova-compute[71731]:     </input>
Apr 13 16:29:52 user nova-compute[71731]:     <input type='keyboard' bus='ps2'>
Apr 13 16:29:52 user nova-compute[71731]:       <alias name='input1'/>
Apr 13 16:29:52 user nova-compute[71731]:     </input>
Apr 13 16:29:52 user nova-compute[71731]:     <graphics type='vnc' port='5906' autoport='yes' listen='0.0.0.0'>
Apr 13 16:29:52 user nova-compute[71731]:       <listen type='address' address='0.0.0.0'/>
Apr 13 16:29:52 user nova-compute[71731]:     </graphics>
Apr 13 16:29:52 user nova-compute[71731]:     <audio id='1' type='none'/>
Apr 13 16:29:52 user nova-compute[71731]:     <video>
Apr 13 16:29:52 user nova-compute[71731]:       <model type='virtio' heads='1' primary='yes'/>
Apr 13 16:29:52 user nova-compute[71731]:       <alias name='video0'/>
Apr 13 16:29:52 user nova-compute[71731]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Apr 13 16:29:52 user nova-compute[71731]:     </video>
Apr 13 16:29:52 user nova-compute[71731]:     <memballoon model='virtio'>
Apr 13 16:29:52 user nova-compute[71731]:       <stats period='10'/>
Apr 13 16:29:52 user nova-compute[71731]:       <alias name='balloon0'/>
Apr 13 16:29:52 user nova-compute[71731]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Apr 13 16:29:52 user nova-compute[71731]:     </memballoon>
Apr 13 16:29:52 user nova-compute[71731]:     <rng model='virtio'>
Apr 13 16:29:52 user nova-compute[71731]:       <backend model='random'>/dev/urandom</backend>
Apr 13 16:29:52 user nova-compute[71731]:       <alias name='rng0'/>
Apr 13 16:29:52 user nova-compute[71731]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Apr 13 16:29:52 user nova-compute[71731]:     </rng>
Apr 13 16:29:52 user nova-compute[71731]:   </devices>
Apr 13 16:29:52 user nova-compute[71731]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Apr 13 16:29:52 user nova-compute[71731]:     <label>libvirt-5d50f597-3a29-4335-8166-6ab8e8149376</label>
Apr 13 16:29:52 user nova-compute[71731]:     <imagelabel>libvirt-5d50f597-3a29-4335-8166-6ab8e8149376</imagelabel>
Apr 13 16:29:52 user nova-compute[71731]:   </seclabel>
Apr 13 16:29:52 user nova-compute[71731]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Apr 13 16:29:52 user nova-compute[71731]:     <label>+64055:+108</label>
Apr 13 16:29:52 user nova-compute[71731]:     <imagelabel>+64055:+108</imagelabel>
Apr 13 16:29:52 user nova-compute[71731]:   </seclabel>
Apr 13 16:29:52 user nova-compute[71731]: </domain>
Apr 13 16:29:52 user nova-compute[71731]:  {{(pid=71731) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Apr 13 16:29:52 user nova-compute[71731]: WARNING nova.virt.libvirt.driver [req-d9a5f313-ef9a-4b65-a37e-834c317a5f35 req-a2b5f3c9-f9bc-4923-b95f-c13159f8077c service nova] [instance: 5d50f597-3a29-4335-8166-6ab8e8149376] Detaching interface fa:16:3e:f5:7f:d0 failed because the device is no longer found on the guest.: nova.exception.DeviceNotFound: Device 'tapdeb6fd31-3a' not found.
Apr 13 16:29:52 user nova-compute[71731]: DEBUG nova.virt.libvirt.vif [req-d9a5f313-ef9a-4b65-a37e-834c317a5f35 req-a2b5f3c9-f9bc-4923-b95f-c13159f8077c service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T16:27:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2052401344',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-2052401344',id=21,image_ref='708622a9-7465-4492-ade8-b827198f7e30',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAENxxbnK5TO5rrhClGAK4OGBjRSl2WhguyF+uaJMZFTdQImhP15imwNCemvjwOF1cJdEvHpeqOmPATUZWcFezxU2vmY8dwhasInHSqB5TQd2r6SmgLKfFX1fag2EbRN/A==',key_name='tempest-keypair-1469740557',keypairs=<?>,launch_index=0,launched_at=2023-04-13T16:27:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3c33fd5889ce4d0b983f529767005267',ramdisk_id='',reservation_id='r-99cwosbm',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='708622a9-7465-4492-ade8-b827198f7e30',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1979050233',owner_user_name='tempest-TaggedAttachmentsTest-1979050233-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T16:27:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fa66202e2e5547d1b6e792557b335d0f',uuid=5d50f597-3a29-4335-8166-6ab8e8149376,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "deb6fd31-3a87-439d-b59c-4f4dbf9a11bc", "address": "fa:16:3e:f5:7f:d0", "network": {"id": "80e09f45-b799-4c16-8c74-ee57ad2c4b6e", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-165222833", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.226", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "3c33fd5889ce4d0b983f529767005267", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdeb6fd31-3a", "ovs_interfaceid": "deb6fd31-3a87-439d-b59c-4f4dbf9a11bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 16:29:52 user nova-compute[71731]: DEBUG nova.network.os_vif_util [req-d9a5f313-ef9a-4b65-a37e-834c317a5f35 req-a2b5f3c9-f9bc-4923-b95f-c13159f8077c service nova] Converting VIF {"id": "deb6fd31-3a87-439d-b59c-4f4dbf9a11bc", "address": "fa:16:3e:f5:7f:d0", "network": {"id": "80e09f45-b799-4c16-8c74-ee57ad2c4b6e", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-165222833", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.226", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "3c33fd5889ce4d0b983f529767005267", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdeb6fd31-3a", "ovs_interfaceid": "deb6fd31-3a87-439d-b59c-4f4dbf9a11bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 16:29:52 user nova-compute[71731]: DEBUG nova.network.os_vif_util [req-d9a5f313-ef9a-4b65-a37e-834c317a5f35 req-a2b5f3c9-f9bc-4923-b95f-c13159f8077c service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:7f:d0,bridge_name='br-int',has_traffic_filtering=True,id=deb6fd31-3a87-439d-b59c-4f4dbf9a11bc,network=Network(80e09f45-b799-4c16-8c74-ee57ad2c4b6e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdeb6fd31-3a') {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 16:29:52 user nova-compute[71731]: DEBUG os_vif [req-d9a5f313-ef9a-4b65-a37e-834c317a5f35 req-a2b5f3c9-f9bc-4923-b95f-c13159f8077c service nova] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:7f:d0,bridge_name='br-int',has_traffic_filtering=True,id=deb6fd31-3a87-439d-b59c-4f4dbf9a11bc,network=Network(80e09f45-b799-4c16-8c74-ee57ad2c4b6e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdeb6fd31-3a') {{(pid=71731) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 16:29:52 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:29:52 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdeb6fd31-3a, bridge=br-int, if_exists=True) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:29:52 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 16:29:52 user nova-compute[71731]: INFO os_vif [req-d9a5f313-ef9a-4b65-a37e-834c317a5f35 req-a2b5f3c9-f9bc-4923-b95f-c13159f8077c service nova] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:7f:d0,bridge_name='br-int',has_traffic_filtering=True,id=deb6fd31-3a87-439d-b59c-4f4dbf9a11bc,network=Network(80e09f45-b799-4c16-8c74-ee57ad2c4b6e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdeb6fd31-3a')
Apr 13 16:29:52 user nova-compute[71731]: DEBUG nova.virt.libvirt.guest [req-d9a5f313-ef9a-4b65-a37e-834c317a5f35 req-a2b5f3c9-f9bc-4923-b95f-c13159f8077c service nova] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 16:29:52 user nova-compute[71731]:   <nova:package version="0.0.0"/>
Apr 13 16:29:52 user nova-compute[71731]:   <nova:name>tempest-device-tagging-server-2052401344</nova:name>
Apr 13 16:29:52 user nova-compute[71731]:   <nova:creationTime>2023-04-13 16:29:52</nova:creationTime>
Apr 13 16:29:52 user nova-compute[71731]:   <nova:flavor name="m1.nano">
Apr 13 16:29:52 user nova-compute[71731]:     <nova:memory>128</nova:memory>
Apr 13 16:29:52 user nova-compute[71731]:     <nova:disk>1</nova:disk>
Apr 13 16:29:52 user nova-compute[71731]:     <nova:swap>0</nova:swap>
Apr 13 16:29:52 user nova-compute[71731]:     <nova:ephemeral>0</nova:ephemeral>
Apr 13 16:29:52 user nova-compute[71731]:     <nova:vcpus>1</nova:vcpus>
Apr 13 16:29:52 user nova-compute[71731]:   </nova:flavor>
Apr 13 16:29:52 user nova-compute[71731]:   <nova:owner>
Apr 13 16:29:52 user nova-compute[71731]:     <nova:user uuid="fa66202e2e5547d1b6e792557b335d0f">tempest-TaggedAttachmentsTest-1979050233-project-member</nova:user>
Apr 13 16:29:52 user nova-compute[71731]:     <nova:project uuid="3c33fd5889ce4d0b983f529767005267">tempest-TaggedAttachmentsTest-1979050233</nova:project>
Apr 13 16:29:52 user nova-compute[71731]:   </nova:owner>
Apr 13 16:29:52 user nova-compute[71731]:   <nova:root type="image" uuid="708622a9-7465-4492-ade8-b827198f7e30"/>
Apr 13 16:29:52 user nova-compute[71731]:   <nova:ports>
Apr 13 16:29:52 user nova-compute[71731]:     <nova:port uuid="cde3b0f9-9ed1-4eba-8560-d5fa05166b2e">
Apr 13 16:29:52 user nova-compute[71731]:       <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Apr 13 16:29:52 user nova-compute[71731]:     </nova:port>
Apr 13 16:29:52 user nova-compute[71731]:   </nova:ports>
Apr 13 16:29:52 user nova-compute[71731]: </nova:instance>
Apr 13 16:29:52 user nova-compute[71731]:  {{(pid=71731) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Apr 13 16:29:52 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:29:53 user nova-compute[71731]: DEBUG nova.network.neutron [None req-036b777d-1ffe-43b6-b1f2-5a8ed4f4f6ec tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] [instance: 5d50f597-3a29-4335-8166-6ab8e8149376] Updating instance_info_cache with network_info: [{"id": "cde3b0f9-9ed1-4eba-8560-d5fa05166b2e", "address": "fa:16:3e:9d:e7:97", "network": {"id": "c790aafd-fad0-4403-bfad-05bbf49d23b2", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1464281989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c33fd5889ce4d0b983f529767005267", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcde3b0f9-9e", "ovs_interfaceid": "cde3b0f9-9ed1-4eba-8560-d5fa05166b2e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:29:53 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-036b777d-1ffe-43b6-b1f2-5a8ed4f4f6ec tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Releasing lock "refresh_cache-5d50f597-3a29-4335-8166-6ab8e8149376" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 16:29:53 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-036b777d-1ffe-43b6-b1f2-5a8ed4f4f6ec tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Lock "interface-5d50f597-3a29-4335-8166-6ab8e8149376-deb6fd31-3a87-439d-b59c-4f4dbf9a11bc" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 1.963s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:29:54 user nova-compute[71731]: DEBUG nova.compute.manager [req-c423bc9d-ee8e-4631-ae71-5881cc0e2ea4 req-9d3dd53d-8899-4f1f-a39e-81c959327cc4 service nova] [instance: 5d50f597-3a29-4335-8166-6ab8e8149376] Received event network-vif-plugged-deb6fd31-3a87-439d-b59c-4f4dbf9a11bc {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:29:54 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-c423bc9d-ee8e-4631-ae71-5881cc0e2ea4 req-9d3dd53d-8899-4f1f-a39e-81c959327cc4 service nova] Acquiring lock "5d50f597-3a29-4335-8166-6ab8e8149376-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:29:54 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-c423bc9d-ee8e-4631-ae71-5881cc0e2ea4 req-9d3dd53d-8899-4f1f-a39e-81c959327cc4 service nova] Lock "5d50f597-3a29-4335-8166-6ab8e8149376-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:29:54 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-c423bc9d-ee8e-4631-ae71-5881cc0e2ea4 req-9d3dd53d-8899-4f1f-a39e-81c959327cc4 service nova] Lock "5d50f597-3a29-4335-8166-6ab8e8149376-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:29:54 user nova-compute[71731]: DEBUG nova.compute.manager [req-c423bc9d-ee8e-4631-ae71-5881cc0e2ea4 req-9d3dd53d-8899-4f1f-a39e-81c959327cc4 service nova] [instance: 5d50f597-3a29-4335-8166-6ab8e8149376] No waiting events found dispatching network-vif-plugged-deb6fd31-3a87-439d-b59c-4f4dbf9a11bc {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:29:54 user nova-compute[71731]: WARNING nova.compute.manager [req-c423bc9d-ee8e-4631-ae71-5881cc0e2ea4 req-9d3dd53d-8899-4f1f-a39e-81c959327cc4 service nova] [instance: 5d50f597-3a29-4335-8166-6ab8e8149376] Received unexpected event network-vif-plugged-deb6fd31-3a87-439d-b59c-4f4dbf9a11bc for instance with vm_state active and task_state None.
Apr 13 16:29:55 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-4266630d-aeb5-4fa3-9987-971fa52c33be tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Acquiring lock "eaae47b9-a059-49f6-9ae6-d7147003e2f2" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:29:55 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-4266630d-aeb5-4fa3-9987-971fa52c33be tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lock "eaae47b9-a059-49f6-9ae6-d7147003e2f2" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:29:55 user nova-compute[71731]: INFO nova.compute.manager [None req-4266630d-aeb5-4fa3-9987-971fa52c33be tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] [instance: eaae47b9-a059-49f6-9ae6-d7147003e2f2] Detaching volume eb2c60ec-fb52-436f-a98a-dfe15d1e3aa6
Apr 13 16:29:55 user nova-compute[71731]: INFO nova.virt.block_device [None req-4266630d-aeb5-4fa3-9987-971fa52c33be tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] [instance: eaae47b9-a059-49f6-9ae6-d7147003e2f2] Attempting to driver detach volume eb2c60ec-fb52-436f-a98a-dfe15d1e3aa6 from mountpoint /dev/vdb
Apr 13 16:29:55 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-4266630d-aeb5-4fa3-9987-971fa52c33be tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Attempting to detach device vdb from instance eaae47b9-a059-49f6-9ae6-d7147003e2f2 from the persistent domain config. {{(pid=71731) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 13 16:29:55 user nova-compute[71731]: DEBUG nova.virt.libvirt.guest [None req-4266630d-aeb5-4fa3-9987-971fa52c33be tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 16:29:55 user nova-compute[71731]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 16:29:55 user nova-compute[71731]:   <source dev="/dev/sdf"/>
Apr 13 16:29:55 user nova-compute[71731]:   <target dev="vdb" bus="virtio"/>
Apr 13 16:29:55 user nova-compute[71731]:   <serial>eb2c60ec-fb52-436f-a98a-dfe15d1e3aa6</serial>
Apr 13 16:29:55 user nova-compute[71731]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 13 16:29:55 user nova-compute[71731]: </disk>
Apr 13 16:29:55 user nova-compute[71731]:  {{(pid=71731) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 16:29:55 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-4266630d-aeb5-4fa3-9987-971fa52c33be tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Successfully detached device vdb from instance eaae47b9-a059-49f6-9ae6-d7147003e2f2 from the persistent domain config.
Apr 13 16:29:55 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-4266630d-aeb5-4fa3-9987-971fa52c33be tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance eaae47b9-a059-49f6-9ae6-d7147003e2f2 from the live domain config. {{(pid=71731) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 13 16:29:55 user nova-compute[71731]: DEBUG nova.virt.libvirt.guest [None req-4266630d-aeb5-4fa3-9987-971fa52c33be tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 16:29:55 user nova-compute[71731]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 16:29:55 user nova-compute[71731]:   <source dev="/dev/sdf"/>
Apr 13 16:29:55 user nova-compute[71731]:   <target dev="vdb" bus="virtio"/>
Apr 13 16:29:55 user nova-compute[71731]:   <serial>eb2c60ec-fb52-436f-a98a-dfe15d1e3aa6</serial>
Apr 13 16:29:55 user nova-compute[71731]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 13 16:29:55 user nova-compute[71731]: </disk>
Apr 13 16:29:55 user nova-compute[71731]:  {{(pid=71731) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 16:29:56 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Received event <DeviceRemovedEvent: 1681403396.0765235, eaae47b9-a059-49f6-9ae6-d7147003e2f2 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71731) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 13 16:29:56 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-4266630d-aeb5-4fa3-9987-971fa52c33be tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance eaae47b9-a059-49f6-9ae6-d7147003e2f2 {{(pid=71731) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 13 16:29:56 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-4266630d-aeb5-4fa3-9987-971fa52c33be tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Successfully detached device vdb from instance eaae47b9-a059-49f6-9ae6-d7147003e2f2 from the live domain config.
Apr 13 16:29:56 user nova-compute[71731]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4266630d-aeb5-4fa3-9987-971fa52c33be tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] [instance: eaae47b9-a059-49f6-9ae6-d7147003e2f2] calling os-brick to detach iSCSI Volume {{(pid=71731) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 16:29:56 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-4266630d-aeb5-4fa3-9987-971fa52c33be tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8cf0118790>, {'target_iqn': 'iqn.2010-10.org.openstack:eb2c60ec-fb52-436f-a98a-dfe15d1e3aa6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gzcNiTHC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf': {}}" {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 16:29:56 user nova-compute[71731]: WARNING os_brick.initiator.connectors.base [None req-4266630d-aeb5-4fa3-9987-971fa52c33be tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 16:29:56 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-4266630d-aeb5-4fa3-9987-971fa52c33be tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 16:29:56 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-4266630d-aeb5-4fa3-9987-971fa52c33be tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 16:29:56 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:29:56 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:29:56 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[af0f6220-ac9c-428b-93f1-234f6873d6ab]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:eb2c60ec-fb52-436f-a98a-dfe15d1e3aa6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d53e720e-a9ca-499b-aacd-aad1a169a874\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:29:56 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-4266630d-aeb5-4fa3-9987-971fa52c33be tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 16:29:56 user nova-compute[71731]: No targets found.
Apr 13 16:29:56 user nova-compute[71731]: iSNS:
Apr 13 16:29:56 user nova-compute[71731]: No targets found.
Apr 13 16:29:56 user nova-compute[71731]: STATIC:
Apr 13 16:29:56 user nova-compute[71731]: Target: iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97
Apr 13 16:29:56 user nova-compute[71731]:         Portal: 172.16.0.220:3260,-1
Apr 13 16:29:56 user nova-compute[71731]:                 Iface Name: default
Apr 13 16:29:56 user nova-compute[71731]: Target: iqn.2010-10.org.openstack:eb2c60ec-fb52-436f-a98a-dfe15d1e3aa6
Apr 13 16:29:56 user nova-compute[71731]:         Portal: 172.16.0.220:3260,-1
Apr 13 16:29:56 user nova-compute[71731]:                 Iface Name: default
Apr 13 16:29:56 user nova-compute[71731]: Target: iqn.2010-10.org.openstack:d53e720e-a9ca-499b-aacd-aad1a169a874
Apr 13 16:29:56 user nova-compute[71731]:         Portal: 172.16.0.220:3260,-1
Apr 13 16:29:56 user nova-compute[71731]:                 Iface Name: default
Apr 13 16:29:56 user nova-compute[71731]: FIRMWARE:
Apr 13 16:29:56 user nova-compute[71731]: No targets found.
Apr 13 16:29:56 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 16:29:56 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-4266630d-aeb5-4fa3-9987-971fa52c33be tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 16:29:56 user nova-compute[71731]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 16:29:56 user nova-compute[71731]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71731) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 16:29:56 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-4266630d-aeb5-4fa3-9987-971fa52c33be tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eb2c60ec-fb52-436f-a98a-dfe15d1e3aa6', 0)] {{(pid=71731) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 16:29:56 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:29:56 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:29:56 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[a830edb2-f422-4e99-b8ea-66bd262e378f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d53e720e-a9ca-499b-aacd-aad1a169a874\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eb2c60ec-fb52-436f-a98a-dfe15d1e3aa6\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:29:56 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:29:56 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:29:56 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe5ab99e-2e48-483e-90cf-1a42e4cbdf1b]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d53e720e-a9ca-499b-aacd-aad1a169a874 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb2c60ec-fb52-436f-a98a-dfe15d1e3aa6 (non-flash)\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:29:56 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-4266630d-aeb5-4fa3-9987-971fa52c33be tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)
Apr 13 16:29:56 user nova-compute[71731]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d53e720e-a9ca-499b-aacd-aad1a169a874 (non-flash)
Apr 13 16:29:56 user nova-compute[71731]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb2c60ec-fb52-436f-a98a-dfe15d1e3aa6 (non-flash)
Apr 13 16:29:56 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 16:29:56 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-4266630d-aeb5-4fa3-9987-971fa52c33be tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)
Apr 13 16:29:56 user nova-compute[71731]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d53e720e-a9ca-499b-aacd-aad1a169a874 (non-flash)
Apr 13 16:29:56 user nova-compute[71731]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb2c60ec-fb52-436f-a98a-dfe15d1e3aa6 (non-flash)
Apr 13 16:29:56 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 16:29:56 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-4266630d-aeb5-4fa3-9987-971fa52c33be tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8cd022ff40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eb2c60ec-fb52-436f-a98a-dfe15d1e3aa6'): ({'sdf'}, set())}) {{(pid=71731) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 16:29:56 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-4266630d-aeb5-4fa3-9987-971fa52c33be tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Removing single pathed devices sdf {{(pid=71731) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 16:29:56 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:29:56 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:29:56 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cf290a1-1369-42b0-a14f-eff0da7f99cc]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:29:56 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:29:56 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:29:56 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7a6ba77-d36d-4baf-80e6-95a30f696534]: (4, ('ok\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:29:56 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-4266630d-aeb5-4fa3-9987-971fa52c33be tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Flushing IO for device /dev/sdf {{(pid=71731) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 16:29:56 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:29:56 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:29:56 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[a82bf0f7-2a08-4ffa-9a7e-168f4258d465]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:29:56 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-4266630d-aeb5-4fa3-9987-971fa52c33be tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=71731) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 16:29:56 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:29:56 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.047s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:29:56 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaa35cfc-6e62-4551-b799-e040190cbec1]: (4, ('1', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:29:56 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-4266630d-aeb5-4fa3-9987-971fa52c33be tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=71731) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 16:29:56 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-4266630d-aeb5-4fa3-9987-971fa52c33be tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] SCSI volumes sdf have been removed. {{(pid=71731) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 16:29:56 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-4266630d-aeb5-4fa3-9987-971fa52c33be tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eb2c60ec-fb52-436f-a98a-dfe15d1e3aa6')] {{(pid=71731) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 16:29:56 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb2c60ec-fb52-436f-a98a-dfe15d1e3aa6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:29:56 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb2c60ec-fb52-436f-a98a-dfe15d1e3aa6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:29:56 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[a390473b-0c1c-4886-b43c-bb7d35e22e95]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:29:56 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-4266630d-aeb5-4fa3-9987-971fa52c33be tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:29:56 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb2c60ec-fb52-436f-a98a-dfe15d1e3aa6 -p 172.16.0.220:3260 --logout {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:29:56 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb2c60ec-fb52-436f-a98a-dfe15d1e3aa6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:29:56 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[d55e4e6a-1e08-4aba-9258-f6f2a1accda4]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:eb2c60ec-fb52-436f-a98a-dfe15d1e3aa6, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:eb2c60ec-fb52-436f-a98a-dfe15d1e3aa6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:29:56 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-4266630d-aeb5-4fa3-9987-971fa52c33be tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:eb2c60ec-fb52-436f-a98a-dfe15d1e3aa6, portal: 172.16.0.220,3260]
Apr 13 16:29:56 user nova-compute[71731]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:eb2c60ec-fb52-436f-a98a-dfe15d1e3aa6, portal: 172.16.0.220,3260] successful.
Apr 13 16:29:56 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:29:56 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb2c60ec-fb52-436f-a98a-dfe15d1e3aa6 -p 172.16.0.220:3260 --op delete {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:29:56 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb2c60ec-fb52-436f-a98a-dfe15d1e3aa6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:29:56 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[29c81320-1653-4da0-9b75-32c2009e581e]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:29:56 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-4266630d-aeb5-4fa3-9987-971fa52c33be tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:29:56 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-4266630d-aeb5-4fa3-9987-971fa52c33be tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.327s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 16:29:56 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-4266630d-aeb5-4fa3-9987-971fa52c33be tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] <== disconnect_volume: return (328ms) None {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 16:29:56 user nova-compute[71731]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4266630d-aeb5-4fa3-9987-971fa52c33be tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] [instance: eaae47b9-a059-49f6-9ae6-d7147003e2f2] Disconnected iSCSI Volume {{(pid=71731) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 16:29:56 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:29:56 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:29:57 user nova-compute[71731]: DEBUG nova.objects.instance [None req-4266630d-aeb5-4fa3-9987-971fa52c33be tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lazy-loading 'flavor' on Instance uuid eaae47b9-a059-49f6-9ae6-d7147003e2f2 {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:29:57 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-4266630d-aeb5-4fa3-9987-971fa52c33be tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lock "eaae47b9-a059-49f6-9ae6-d7147003e2f2" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.681s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:29:57 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-7a6affc8-8378-4b47-b967-d3aa339be059 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Acquiring lock "eaae47b9-a059-49f6-9ae6-d7147003e2f2" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:29:57 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-7a6affc8-8378-4b47-b967-d3aa339be059 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lock "eaae47b9-a059-49f6-9ae6-d7147003e2f2" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:29:57 user nova-compute[71731]: DEBUG nova.compute.manager [None req-7a6affc8-8378-4b47-b967-d3aa339be059 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] [instance: eaae47b9-a059-49f6-9ae6-d7147003e2f2] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:29:57 user nova-compute[71731]: DEBUG nova.compute.manager [None req-7a6affc8-8378-4b47-b967-d3aa339be059 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] [instance: eaae47b9-a059-49f6-9ae6-d7147003e2f2] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=71731) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3323}}
Apr 13 16:29:57 user nova-compute[71731]: DEBUG nova.objects.instance [None req-7a6affc8-8378-4b47-b967-d3aa339be059 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lazy-loading 'flavor' on Instance uuid eaae47b9-a059-49f6-9ae6-d7147003e2f2 {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:29:57 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:29:57 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:29:57 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:29:58 user nova-compute[71731]: DEBUG nova.compute.manager [req-a3d5b41f-ff43-4d5e-bbd4-404d5480635b req-70a74a64-64c4-4a92-aa13-b8342dabb074 service nova] [instance: eaae47b9-a059-49f6-9ae6-d7147003e2f2] Received event network-vif-unplugged-e9b2fcaa-f77b-4e5c-ad3c-797ce804a9ae {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:29:58 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-a3d5b41f-ff43-4d5e-bbd4-404d5480635b req-70a74a64-64c4-4a92-aa13-b8342dabb074 service nova] Acquiring lock "eaae47b9-a059-49f6-9ae6-d7147003e2f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:29:58 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-a3d5b41f-ff43-4d5e-bbd4-404d5480635b req-70a74a64-64c4-4a92-aa13-b8342dabb074 service nova] Lock "eaae47b9-a059-49f6-9ae6-d7147003e2f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:29:58 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-a3d5b41f-ff43-4d5e-bbd4-404d5480635b req-70a74a64-64c4-4a92-aa13-b8342dabb074 service nova] Lock "eaae47b9-a059-49f6-9ae6-d7147003e2f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:29:58 user nova-compute[71731]: DEBUG nova.compute.manager [req-a3d5b41f-ff43-4d5e-bbd4-404d5480635b req-70a74a64-64c4-4a92-aa13-b8342dabb074 service nova] [instance: eaae47b9-a059-49f6-9ae6-d7147003e2f2] No waiting events found dispatching network-vif-unplugged-e9b2fcaa-f77b-4e5c-ad3c-797ce804a9ae {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:29:58 user nova-compute[71731]: WARNING nova.compute.manager [req-a3d5b41f-ff43-4d5e-bbd4-404d5480635b req-70a74a64-64c4-4a92-aa13-b8342dabb074 service nova] [instance: eaae47b9-a059-49f6-9ae6-d7147003e2f2] Received unexpected event network-vif-unplugged-e9b2fcaa-f77b-4e5c-ad3c-797ce804a9ae for instance with vm_state active and task_state powering-off.
Apr 13 16:29:58 user nova-compute[71731]: INFO nova.virt.libvirt.driver [-] [instance: eaae47b9-a059-49f6-9ae6-d7147003e2f2] Instance destroyed successfully.
Apr 13 16:29:58 user nova-compute[71731]: DEBUG nova.compute.manager [None req-7a6affc8-8378-4b47-b967-d3aa339be059 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] [instance: eaae47b9-a059-49f6-9ae6-d7147003e2f2] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:29:58 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-7a6affc8-8378-4b47-b967-d3aa339be059 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lock "eaae47b9-a059-49f6-9ae6-d7147003e2f2" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.827s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:30:00 user nova-compute[71731]: DEBUG nova.compute.manager [req-7ea7b06d-2aec-40fb-b6f7-84190f876118 req-67f6fac1-73b3-4468-9867-6b05e9caf269 service nova] [instance: eaae47b9-a059-49f6-9ae6-d7147003e2f2] Received event network-vif-plugged-e9b2fcaa-f77b-4e5c-ad3c-797ce804a9ae {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:30:00 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-7ea7b06d-2aec-40fb-b6f7-84190f876118 req-67f6fac1-73b3-4468-9867-6b05e9caf269 service nova] Acquiring lock "eaae47b9-a059-49f6-9ae6-d7147003e2f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:30:00 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-7ea7b06d-2aec-40fb-b6f7-84190f876118 req-67f6fac1-73b3-4468-9867-6b05e9caf269 service nova] Lock "eaae47b9-a059-49f6-9ae6-d7147003e2f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:30:00 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-7ea7b06d-2aec-40fb-b6f7-84190f876118 req-67f6fac1-73b3-4468-9867-6b05e9caf269 service nova] Lock "eaae47b9-a059-49f6-9ae6-d7147003e2f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:30:00 user nova-compute[71731]: DEBUG nova.compute.manager [req-7ea7b06d-2aec-40fb-b6f7-84190f876118 req-67f6fac1-73b3-4468-9867-6b05e9caf269 service nova] [instance: eaae47b9-a059-49f6-9ae6-d7147003e2f2] No waiting events found dispatching network-vif-plugged-e9b2fcaa-f77b-4e5c-ad3c-797ce804a9ae {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:30:00 user nova-compute[71731]: WARNING nova.compute.manager [req-7ea7b06d-2aec-40fb-b6f7-84190f876118 req-67f6fac1-73b3-4468-9867-6b05e9caf269 service nova] [instance: eaae47b9-a059-49f6-9ae6-d7147003e2f2] Received unexpected event network-vif-plugged-e9b2fcaa-f77b-4e5c-ad3c-797ce804a9ae for instance with vm_state stopped and task_state None.
Apr 13 16:30:01 user nova-compute[71731]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681403386.3280613, 5ea4ab6a-6501-4a2f-a8f7-04090024747d => Stopped> {{(pid=71731) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 16:30:01 user nova-compute[71731]: INFO nova.compute.manager [-] [instance: 5ea4ab6a-6501-4a2f-a8f7-04090024747d] VM Stopped (Lifecycle Event)
Apr 13 16:30:01 user nova-compute[71731]: DEBUG nova.compute.manager [None req-8bc89579-11d9-4f08-b161-451b506bc228 None None] [instance: 5ea4ab6a-6501-4a2f-a8f7-04090024747d] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:30:01 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:30:06 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:30:06 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:30:08 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:30:11 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager.update_available_resource {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:30:11 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:30:11 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:30:11 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:30:11 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Auditing locally available compute resources for user (node: user) {{(pid=71731) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 16:30:11 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acbcaee0-a47b-4fee-8765-9b1c9597d515/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:30:11 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acbcaee0-a47b-4fee-8765-9b1c9597d515/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:30:11 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acbcaee0-a47b-4fee-8765-9b1c9597d515/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:30:11 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acbcaee0-a47b-4fee-8765-9b1c9597d515/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:30:11 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=71731) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 16:30:11 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71a2163b-fb6b-4b71-b93f-d682ad141b84/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:30:11 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:30:11 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71a2163b-fb6b-4b71-b93f-d682ad141b84/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:30:11 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71a2163b-fb6b-4b71-b93f-d682ad141b84/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:30:11 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71a2163b-fb6b-4b71-b93f-d682ad141b84/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:30:11 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:30:11 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d50f597-3a29-4335-8166-6ab8e8149376/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:30:12 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d50f597-3a29-4335-8166-6ab8e8149376/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:30:12 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d50f597-3a29-4335-8166-6ab8e8149376/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:30:12 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d50f597-3a29-4335-8166-6ab8e8149376/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:30:12 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66553f5-5e1b-4f1d-8c5a-63bc340f7586/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:30:12 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66553f5-5e1b-4f1d-8c5a-63bc340f7586/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:30:12 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66553f5-5e1b-4f1d-8c5a-63bc340f7586/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:30:12 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66553f5-5e1b-4f1d-8c5a-63bc340f7586/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:30:12 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eaae47b9-a059-49f6-9ae6-d7147003e2f2/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:30:12 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eaae47b9-a059-49f6-9ae6-d7147003e2f2/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:30:12 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eaae47b9-a059-49f6-9ae6-d7147003e2f2/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:30:12 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eaae47b9-a059-49f6-9ae6-d7147003e2f2/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:30:12 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71731) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 16:30:12 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf98c3a2-dbeb-4ae4-8423-ce55964c4258/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:30:12 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf98c3a2-dbeb-4ae4-8423-ce55964c4258/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:30:12 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf98c3a2-dbeb-4ae4-8423-ce55964c4258/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:30:13 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf98c3a2-dbeb-4ae4-8423-ce55964c4258/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:30:13 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/650427bd-4dad-4bcd-922d-c17e60b36807/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:30:13 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/650427bd-4dad-4bcd-922d-c17e60b36807/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:30:13 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/650427bd-4dad-4bcd-922d-c17e60b36807/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:30:13 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/650427bd-4dad-4bcd-922d-c17e60b36807/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:30:13 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32b18558-8bf2-4def-bc70-81c4e38fcc6f/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:30:13 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32b18558-8bf2-4def-bc70-81c4e38fcc6f/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:30:13 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32b18558-8bf2-4def-bc70-81c4e38fcc6f/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:30:13 user nova-compute[71731]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681403398.549419, eaae47b9-a059-49f6-9ae6-d7147003e2f2 => Stopped> {{(pid=71731) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 16:30:13 user nova-compute[71731]: INFO nova.compute.manager [-] [instance: eaae47b9-a059-49f6-9ae6-d7147003e2f2] VM Stopped (Lifecycle Event)
Apr 13 16:30:13 user nova-compute[71731]: DEBUG nova.compute.manager [None req-ba7b7568-bf1d-4d9a-87fb-b152d239faf5 None None] [instance: eaae47b9-a059-49f6-9ae6-d7147003e2f2] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:30:13 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32b18558-8bf2-4def-bc70-81c4e38fcc6f/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:30:13 user nova-compute[71731]: DEBUG nova.compute.manager [None req-ba7b7568-bf1d-4d9a-87fb-b152d239faf5 None None] [instance: eaae47b9-a059-49f6-9ae6-d7147003e2f2] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=71731) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 16:30:14 user nova-compute[71731]: WARNING nova.virt.libvirt.driver [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 16:30:14 user nova-compute[71731]: WARNING nova.virt.libvirt.driver [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 16:30:14 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Hypervisor/Node resource view: name=user free_ram=7773MB free_disk=26.195045471191406GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71731) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 16:30:14 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:30:14 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:30:14 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance f66553f5-5e1b-4f1d-8c5a-63bc340f7586 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 16:30:14 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance 235f827c-7116-48e9-84c5-0c9761c18e1e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 16:30:14 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance acbcaee0-a47b-4fee-8765-9b1c9597d515 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 16:30:14 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance eaae47b9-a059-49f6-9ae6-d7147003e2f2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 16:30:14 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance 5d50f597-3a29-4335-8166-6ab8e8149376 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 16:30:14 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance bf98c3a2-dbeb-4ae4-8423-ce55964c4258 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 16:30:14 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance 32b18558-8bf2-4def-bc70-81c4e38fcc6f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 16:30:14 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance 650427bd-4dad-4bcd-922d-c17e60b36807 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 16:30:14 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance 71a2163b-fb6b-4b71-b93f-d682ad141b84 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 16:30:14 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=71731) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 16:30:14 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Final resource view: name=user phys_ram=16023MB used_ram=1664MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=71731) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 16:30:14 user nova-compute[71731]: DEBUG nova.compute.provider_tree [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Inventory has not changed in ProviderTree for provider: cb6b1a64-0c24-4e2d-af1e-16576ca9165c {{(pid=71731) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 16:30:14 user nova-compute[71731]: DEBUG nova.scheduler.client.report [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Inventory has not changed for provider cb6b1a64-0c24-4e2d-af1e-16576ca9165c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71731) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 16:30:14 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Compute_service record updated for user:user {{(pid=71731) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 16:30:14 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.465s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:30:15 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:30:15 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Starting heal instance info cache {{(pid=71731) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 16:30:15 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Acquiring lock "refresh_cache-eaae47b9-a059-49f6-9ae6-d7147003e2f2" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 16:30:15 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Acquired lock "refresh_cache-eaae47b9-a059-49f6-9ae6-d7147003e2f2" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 16:30:15 user nova-compute[71731]: DEBUG nova.network.neutron [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] [instance: eaae47b9-a059-49f6-9ae6-d7147003e2f2] Forcefully refreshing network info cache for instance {{(pid=71731) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 16:30:16 user nova-compute[71731]: DEBUG nova.network.neutron [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] [instance: eaae47b9-a059-49f6-9ae6-d7147003e2f2] Updating instance_info_cache with network_info: [{"id": "e9b2fcaa-f77b-4e5c-ad3c-797ce804a9ae", "address": "fa:16:3e:ff:85:92", "network": {"id": "79e9ef20-b14d-4850-b298-9d3ed4d10b90", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1756253617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24904988cf334657b084fd726c7ecf8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9b2fcaa-f7", "ovs_interfaceid": "e9b2fcaa-f77b-4e5c-ad3c-797ce804a9ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:30:16 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Releasing lock "refresh_cache-eaae47b9-a059-49f6-9ae6-d7147003e2f2" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 16:30:16 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] [instance: eaae47b9-a059-49f6-9ae6-d7147003e2f2] Updated the network info_cache for instance {{(pid=71731) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 16:30:16 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:30:16 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:30:16 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:30:16 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:30:16 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:30:16 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71731) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 16:30:16 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 16:30:20 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:30:20 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:30:20 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:30:21 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:30:21 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:30:22 user nova-compute[71731]: DEBUG nova.compute.manager [req-ebb5ec15-c2b7-458a-aa12-204067ccd21a req-22f67eeb-f1e3-4ce7-9659-a99e811dd589 service nova] [instance: bf98c3a2-dbeb-4ae4-8423-ce55964c4258] Received event network-changed-58361670-0371-4eb7-83b9-ce67bf2a67bb {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:30:22 user nova-compute[71731]: DEBUG nova.compute.manager [req-ebb5ec15-c2b7-458a-aa12-204067ccd21a req-22f67eeb-f1e3-4ce7-9659-a99e811dd589 service nova] [instance: bf98c3a2-dbeb-4ae4-8423-ce55964c4258] Refreshing instance network info cache due to event network-changed-58361670-0371-4eb7-83b9-ce67bf2a67bb. {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 16:30:22 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-ebb5ec15-c2b7-458a-aa12-204067ccd21a req-22f67eeb-f1e3-4ce7-9659-a99e811dd589 service nova] Acquiring lock "refresh_cache-bf98c3a2-dbeb-4ae4-8423-ce55964c4258" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 16:30:22 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-ebb5ec15-c2b7-458a-aa12-204067ccd21a req-22f67eeb-f1e3-4ce7-9659-a99e811dd589 service nova] Acquired lock "refresh_cache-bf98c3a2-dbeb-4ae4-8423-ce55964c4258" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 16:30:22 user nova-compute[71731]: DEBUG nova.network.neutron [req-ebb5ec15-c2b7-458a-aa12-204067ccd21a req-22f67eeb-f1e3-4ce7-9659-a99e811dd589 service nova] [instance: bf98c3a2-dbeb-4ae4-8423-ce55964c4258] Refreshing network info cache for port 58361670-0371-4eb7-83b9-ce67bf2a67bb {{(pid=71731) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 16:30:22 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-9f479eaf-564d-4715-8d91-68a5e619be19 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Acquiring lock "bf98c3a2-dbeb-4ae4-8423-ce55964c4258" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:30:22 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-9f479eaf-564d-4715-8d91-68a5e619be19 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Lock "bf98c3a2-dbeb-4ae4-8423-ce55964c4258" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:30:22 user nova-compute[71731]: DEBUG nova.objects.instance [None req-9f479eaf-564d-4715-8d91-68a5e619be19 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Lazy-loading 'flavor' on Instance uuid bf98c3a2-dbeb-4ae4-8423-ce55964c4258 {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:30:23 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-9f479eaf-564d-4715-8d91-68a5e619be19 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Lock "bf98c3a2-dbeb-4ae4-8423-ce55964c4258" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:30:23 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-9f479eaf-564d-4715-8d91-68a5e619be19 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Acquiring lock "bf98c3a2-dbeb-4ae4-8423-ce55964c4258" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:30:23 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-9f479eaf-564d-4715-8d91-68a5e619be19 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Lock "bf98c3a2-dbeb-4ae4-8423-ce55964c4258" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:30:23 user nova-compute[71731]: INFO nova.compute.manager [None req-9f479eaf-564d-4715-8d91-68a5e619be19 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] [instance: bf98c3a2-dbeb-4ae4-8423-ce55964c4258] Attaching volume 5b3d0f80-78b5-444b-9440-b679010c3698 to /dev/vdb
Apr 13 16:30:23 user nova-compute[71731]: DEBUG os_brick.utils [None req-9f479eaf-564d-4715-8d91-68a5e619be19 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 16:30:23 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:30:23 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:30:23 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a5856bd-fa48-4632-a801-7a2f8d08fd8f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:81501d91421\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:30:23 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:30:23 user nova-compute[71731]: DEBUG nova.network.neutron [req-ebb5ec15-c2b7-458a-aa12-204067ccd21a req-22f67eeb-f1e3-4ce7-9659-a99e811dd589 service nova] [instance: bf98c3a2-dbeb-4ae4-8423-ce55964c4258] Updated VIF entry in instance network info cache for port 58361670-0371-4eb7-83b9-ce67bf2a67bb. {{(pid=71731) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 16:30:23 user nova-compute[71731]: DEBUG nova.network.neutron [req-ebb5ec15-c2b7-458a-aa12-204067ccd21a req-22f67eeb-f1e3-4ce7-9659-a99e811dd589 service nova] [instance: bf98c3a2-dbeb-4ae4-8423-ce55964c4258] Updating instance_info_cache with network_info: [{"id": "58361670-0371-4eb7-83b9-ce67bf2a67bb", "address": "fa:16:3e:76:1a:b3", "network": {"id": "531e0c0e-c7aa-4a8c-b994-cf304d6e9089", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-897460632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.113", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18e15bc7bee7466a840fb0d0e85d58bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58361670-03", "ovs_interfaceid": "58361670-0371-4eb7-83b9-ce67bf2a67bb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:30:23 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:30:23 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[a01894bf-fb1f-4d81-8de4-b768b03b31ee]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:30:23 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:30:23 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-ebb5ec15-c2b7-458a-aa12-204067ccd21a req-22f67eeb-f1e3-4ce7-9659-a99e811dd589 service nova] Releasing lock "refresh_cache-bf98c3a2-dbeb-4ae4-8423-ce55964c4258" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 16:30:23 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:30:23 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[f11b34f7-d358-4f49-aef3-75b17a6ce5c9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:30:23 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[97141720-05ab-4fd1-952b-0faa226c5ea7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:30:23 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-9f479eaf-564d-4715-8d91-68a5e619be19 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Running cmd (subprocess): nvme version {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:30:23 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-9f479eaf-564d-4715-8d91-68a5e619be19 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] 'nvme version' failed. Not Retrying. {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 16:30:23 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9f479eaf-564d-4715-8d91-68a5e619be19 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] nvme not present on system {{(pid=71731) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 16:30:23 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:30:23 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 16:30:23 user nova-compute[71731]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 16:30:23 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[176f61ae-6a75-4694-8113-9499ffe5c259]: (4, '') {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:30:23 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.lightos [None req-9f479eaf-564d-4715-8d91-68a5e619be19 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71731) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 16:30:23 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.lightos [None req-9f479eaf-564d-4715-8d91-68a5e619be19 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71731) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 16:30:23 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.lightos [None req-9f479eaf-564d-4715-8d91-68a5e619be19 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] LIGHTOS: no hostnqn found. {{(pid=71731) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 16:30:23 user nova-compute[71731]: DEBUG os_brick.utils [None req-9f479eaf-564d-4715-8d91-68a5e619be19 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:81501d91421', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 16:30:23 user nova-compute[71731]: DEBUG nova.virt.block_device [None req-9f479eaf-564d-4715-8d91-68a5e619be19 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] [instance: bf98c3a2-dbeb-4ae4-8423-ce55964c4258] Updating existing volume attachment record: 28eb8a03-a821-432a-b4ae-b3d9aa7f12db {{(pid=71731) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 16:30:26 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:30:26 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:30:26 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-d3ff97e3-c1eb-4deb-a4d6-176498695190 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Acquiring lock "acbcaee0-a47b-4fee-8765-9b1c9597d515" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:30:26 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-d3ff97e3-c1eb-4deb-a4d6-176498695190 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "acbcaee0-a47b-4fee-8765-9b1c9597d515" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:30:26 user nova-compute[71731]: INFO nova.compute.manager [None req-d3ff97e3-c1eb-4deb-a4d6-176498695190 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] Detaching volume d53e720e-a9ca-499b-aacd-aad1a169a874
Apr 13 16:30:26 user nova-compute[71731]: INFO nova.virt.block_device [None req-d3ff97e3-c1eb-4deb-a4d6-176498695190 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] Attempting to driver detach volume d53e720e-a9ca-499b-aacd-aad1a169a874 from mountpoint /dev/vdb
Apr 13 16:30:26 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-d3ff97e3-c1eb-4deb-a4d6-176498695190 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Attempting to detach device vdb from instance acbcaee0-a47b-4fee-8765-9b1c9597d515 from the persistent domain config. {{(pid=71731) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 13 16:30:26 user nova-compute[71731]: DEBUG nova.virt.libvirt.guest [None req-d3ff97e3-c1eb-4deb-a4d6-176498695190 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 16:30:26 user nova-compute[71731]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 16:30:26 user nova-compute[71731]:   <source dev="/dev/sde"/>
Apr 13 16:30:26 user nova-compute[71731]:   <target dev="vdb" bus="virtio"/>
Apr 13 16:30:26 user nova-compute[71731]:   <serial>d53e720e-a9ca-499b-aacd-aad1a169a874</serial>
Apr 13 16:30:26 user nova-compute[71731]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 13 16:30:26 user nova-compute[71731]: </disk>
Apr 13 16:30:26 user nova-compute[71731]:  {{(pid=71731) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 16:30:26 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-d3ff97e3-c1eb-4deb-a4d6-176498695190 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Successfully detached device vdb from instance acbcaee0-a47b-4fee-8765-9b1c9597d515 from the persistent domain config.
Apr 13 16:30:26 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-d3ff97e3-c1eb-4deb-a4d6-176498695190 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance acbcaee0-a47b-4fee-8765-9b1c9597d515 from the live domain config. {{(pid=71731) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 13 16:30:26 user nova-compute[71731]: DEBUG nova.virt.libvirt.guest [None req-d3ff97e3-c1eb-4deb-a4d6-176498695190 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 16:30:26 user nova-compute[71731]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 16:30:26 user nova-compute[71731]:   <source dev="/dev/sde"/>
Apr 13 16:30:26 user nova-compute[71731]:   <target dev="vdb" bus="virtio"/>
Apr 13 16:30:26 user nova-compute[71731]:   <serial>d53e720e-a9ca-499b-aacd-aad1a169a874</serial>
Apr 13 16:30:26 user nova-compute[71731]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 13 16:30:26 user nova-compute[71731]: </disk>
Apr 13 16:30:26 user nova-compute[71731]:  {{(pid=71731) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 16:30:27 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Received event <DeviceRemovedEvent: 1681403427.4266012, acbcaee0-a47b-4fee-8765-9b1c9597d515 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71731) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 13 16:30:27 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-d3ff97e3-c1eb-4deb-a4d6-176498695190 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance acbcaee0-a47b-4fee-8765-9b1c9597d515 {{(pid=71731) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 13 16:30:27 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-d3ff97e3-c1eb-4deb-a4d6-176498695190 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Successfully detached device vdb from instance acbcaee0-a47b-4fee-8765-9b1c9597d515 from the live domain config.
Apr 13 16:30:27 user nova-compute[71731]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d3ff97e3-c1eb-4deb-a4d6-176498695190 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] calling os-brick to detach iSCSI Volume {{(pid=71731) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 16:30:27 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3ff97e3-c1eb-4deb-a4d6-176498695190 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8cf0118790>, {'target_iqn': 'iqn.2010-10.org.openstack:d53e720e-a9ca-499b-aacd-aad1a169a874', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZTozqKwG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde': {}}" {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 16:30:27 user nova-compute[71731]: WARNING os_brick.initiator.connectors.base [None req-d3ff97e3-c1eb-4deb-a4d6-176498695190 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 16:30:27 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-d3ff97e3-c1eb-4deb-a4d6-176498695190 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 16:30:27 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-d3ff97e3-c1eb-4deb-a4d6-176498695190 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 16:30:27 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:30:27 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:30:27 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[649066c3-130e-4ba5-9062-462afe171c65]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d53e720e-a9ca-499b-aacd-aad1a169a874\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:30:27 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3ff97e3-c1eb-4deb-a4d6-176498695190 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 16:30:27 user nova-compute[71731]: No targets found.
Apr 13 16:30:27 user nova-compute[71731]: iSNS:
Apr 13 16:30:27 user nova-compute[71731]: No targets found.
Apr 13 16:30:27 user nova-compute[71731]: STATIC:
Apr 13 16:30:27 user nova-compute[71731]: Target: iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97
Apr 13 16:30:27 user nova-compute[71731]:         Portal: 172.16.0.220:3260,-1
Apr 13 16:30:27 user nova-compute[71731]:                 Iface Name: default
Apr 13 16:30:27 user nova-compute[71731]: Target: iqn.2010-10.org.openstack:d53e720e-a9ca-499b-aacd-aad1a169a874
Apr 13 16:30:27 user nova-compute[71731]:         Portal: 172.16.0.220:3260,-1
Apr 13 16:30:27 user nova-compute[71731]:                 Iface Name: default
Apr 13 16:30:27 user nova-compute[71731]: FIRMWARE:
Apr 13 16:30:27 user nova-compute[71731]: No targets found.
Apr 13 16:30:27 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 16:30:27 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3ff97e3-c1eb-4deb-a4d6-176498695190 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 16:30:27 user nova-compute[71731]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 16:30:27 user nova-compute[71731]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71731) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 16:30:27 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3ff97e3-c1eb-4deb-a4d6-176498695190 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d53e720e-a9ca-499b-aacd-aad1a169a874', 0)] {{(pid=71731) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 16:30:27 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:30:27 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:30:27 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[c87a35b4-8154-4d14-8eb8-dc1ed24cc406]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d53e720e-a9ca-499b-aacd-aad1a169a874\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:30:27 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:30:27 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:30:27 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d5da4c2-d6ae-4da9-9b02-81d77cf57b32]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d53e720e-a9ca-499b-aacd-aad1a169a874 (non-flash)\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:30:27 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3ff97e3-c1eb-4deb-a4d6-176498695190 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)
Apr 13 16:30:27 user nova-compute[71731]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d53e720e-a9ca-499b-aacd-aad1a169a874 (non-flash)
Apr 13 16:30:27 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 16:30:27 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3ff97e3-c1eb-4deb-a4d6-176498695190 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)
Apr 13 16:30:27 user nova-compute[71731]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d53e720e-a9ca-499b-aacd-aad1a169a874 (non-flash)
Apr 13 16:30:27 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 16:30:27 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3ff97e3-c1eb-4deb-a4d6-176498695190 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8cf067dcf0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d53e720e-a9ca-499b-aacd-aad1a169a874'): ({'sde'}, set())}) {{(pid=71731) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 16:30:27 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-d3ff97e3-c1eb-4deb-a4d6-176498695190 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Removing single pathed devices sde {{(pid=71731) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 16:30:27 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:30:27 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:30:27 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e0ef2d2-b119-4090-ab3f-f32bce239b48]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:30:27 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:30:27 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:30:27 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[4486a1ce-61f2-4562-96f9-162e1cbdc285]: (4, ('ok\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:30:27 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-d3ff97e3-c1eb-4deb-a4d6-176498695190 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Flushing IO for device /dev/sde {{(pid=71731) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 16:30:27 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:30:27 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:30:27 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[5489571b-18b0-4b92-be12-83658a5e0d0e]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:30:27 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-d3ff97e3-c1eb-4deb-a4d6-176498695190 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=71731) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 16:30:27 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:30:27 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.042s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:30:27 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7020e7e-bd97-40ce-aaa1-d5bc6e1620c4]: (4, ('1', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:30:27 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-d3ff97e3-c1eb-4deb-a4d6-176498695190 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=71731) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 16:30:27 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-d3ff97e3-c1eb-4deb-a4d6-176498695190 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] SCSI volumes sde have been removed. {{(pid=71731) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 16:30:27 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3ff97e3-c1eb-4deb-a4d6-176498695190 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d53e720e-a9ca-499b-aacd-aad1a169a874')] {{(pid=71731) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 16:30:27 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d53e720e-a9ca-499b-aacd-aad1a169a874 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:30:27 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d53e720e-a9ca-499b-aacd-aad1a169a874 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:30:27 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[debcfeac-d847-4059-931d-f932502a70f6]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:30:27 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3ff97e3-c1eb-4deb-a4d6-176498695190 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:30:27 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d53e720e-a9ca-499b-aacd-aad1a169a874 -p 172.16.0.220:3260 --logout {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:30:27 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d53e720e-a9ca-499b-aacd-aad1a169a874 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:30:27 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e63c380-e7a5-44ef-b53f-bbfa48fcf7c0]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:d53e720e-a9ca-499b-aacd-aad1a169a874, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:d53e720e-a9ca-499b-aacd-aad1a169a874, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:30:27 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3ff97e3-c1eb-4deb-a4d6-176498695190 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:d53e720e-a9ca-499b-aacd-aad1a169a874, portal: 172.16.0.220,3260]
Apr 13 16:30:27 user nova-compute[71731]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:d53e720e-a9ca-499b-aacd-aad1a169a874, portal: 172.16.0.220,3260] successful.
Apr 13 16:30:27 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:30:27 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d53e720e-a9ca-499b-aacd-aad1a169a874 -p 172.16.0.220:3260 --op delete {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:30:27 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d53e720e-a9ca-499b-aacd-aad1a169a874 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:30:27 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[92fb4915-382b-4671-a854-a1c5a14d85d6]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:30:27 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3ff97e3-c1eb-4deb-a4d6-176498695190 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:30:27 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-d3ff97e3-c1eb-4deb-a4d6-176498695190 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.288s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 16:30:27 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3ff97e3-c1eb-4deb-a4d6-176498695190 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] <== disconnect_volume: return (289ms) None {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 16:30:27 user nova-compute[71731]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d3ff97e3-c1eb-4deb-a4d6-176498695190 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] Disconnected iSCSI Volume {{(pid=71731) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 16:30:28 user nova-compute[71731]: DEBUG nova.objects.instance [None req-d3ff97e3-c1eb-4deb-a4d6-176498695190 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lazy-loading 'flavor' on Instance uuid acbcaee0-a47b-4fee-8765-9b1c9597d515 {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:30:28 user nova-compute[71731]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9f479eaf-564d-4715-8d91-68a5e619be19 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] [instance: bf98c3a2-dbeb-4ae4-8423-ce55964c4258] Calling os-brick to attach iSCSI Volume {{(pid=71731) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 16:30:28 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f479eaf-564d-4715-8d91-68a5e619be19 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8cf0118790>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5b3d0f80-78b5-444b-9440-b679010c3698', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GpdQvjTN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 16:30:28 user nova-compute[71731]: WARNING os_brick.initiator.connectors.base [None req-9f479eaf-564d-4715-8d91-68a5e619be19 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 16:30:28 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-9f479eaf-564d-4715-8d91-68a5e619be19 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 16:30:28 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-9f479eaf-564d-4715-8d91-68a5e619be19 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 16:30:28 user nova-compute[71731]: WARNING os_brick.initiator.connectors.base [None req-9f479eaf-564d-4715-8d91-68a5e619be19 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 16:30:28 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-9f479eaf-564d-4715-8d91-68a5e619be19 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5b3d0f80-78b5-444b-9440-b679010c3698" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 16:30:28 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-9f479eaf-564d-4715-8d91-68a5e619be19 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5b3d0f80-78b5-444b-9440-b679010c3698" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 16:30:28 user nova-compute[71731]: INFO os_brick.initiator.connectors.iscsi [None req-9f479eaf-564d-4715-8d91-68a5e619be19 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 16:30:28 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b3d0f80-78b5-444b-9440-b679010c3698 -p 172.16.0.220:3260 {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:30:28 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-d3ff97e3-c1eb-4deb-a4d6-176498695190 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "acbcaee0-a47b-4fee-8765-9b1c9597d515" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.720s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:30:28 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b3d0f80-78b5-444b-9440-b679010c3698 -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:30:28 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[a41de342-98f1-477a-afc4-7fe106fb93b1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:30:28 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f479eaf-564d-4715-8d91-68a5e619be19 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 16:30:28 user nova-compute[71731]:  {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:30:28 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b3d0f80-78b5-444b-9440-b679010c3698 -p 172.16.0.220:3260 --interface default --op new {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:30:28 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b3d0f80-78b5-444b-9440-b679010c3698 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:30:28 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[034691e4-4670-4d93-86de-7bb7a5e8c4dd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5b3d0f80-78b5-444b-9440-b679010c3698] added\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:30:28 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f479eaf-564d-4715-8d91-68a5e619be19 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5b3d0f80-78b5-444b-9440-b679010c3698] added
Apr 13 16:30:28 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:30:28 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b3d0f80-78b5-444b-9440-b679010c3698 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:30:28 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b3d0f80-78b5-444b-9440-b679010c3698 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:30:28 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6d9359e-4f06-4f29-92d7-dd054337b07f]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:30:28 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f479eaf-564d-4715-8d91-68a5e619be19 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:30:28 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b3d0f80-78b5-444b-9440-b679010c3698 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:30:28 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b3d0f80-78b5-444b-9440-b679010c3698 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:30:28 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d044018-4533-4113-806e-23f808de8d96]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:30:28 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f479eaf-564d-4715-8d91-68a5e619be19 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:30:28 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b3d0f80-78b5-444b-9440-b679010c3698 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GpdQvjTN {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:30:28 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b3d0f80-78b5-444b-9440-b679010c3698 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GpdQvjTN" returned: 0 in 0.018s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:30:28 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[a74578ff-e1b1-4fa1-9139-a67be616319e]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:30:28 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f479eaf-564d-4715-8d91-68a5e619be19 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GpdQvjTN'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:30:28 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b3d0f80-78b5-444b-9440-b679010c3698 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:30:28 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b3d0f80-78b5-444b-9440-b679010c3698 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:30:28 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[d43c0cc3-043e-4da1-a8bf-6af2100be901]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:30:28 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f479eaf-564d-4715-8d91-68a5e619be19 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:30:28 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:30:28 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:30:28 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee8d808e-d1cf-464c-8fc5-c23f3d2c2b03]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:30:28 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f479eaf-564d-4715-8d91-68a5e619be19 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)
Apr 13 16:30:28 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 16:30:28 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f479eaf-564d-4715-8d91-68a5e619be19 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)
Apr 13 16:30:28 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 16:30:28 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b3d0f80-78b5-444b-9440-b679010c3698 -p 172.16.0.220:3260 --login {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:30:28 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b3d0f80-78b5-444b-9440-b679010c3698 -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:30:28 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2e72d66-823b-46da-8cd1-ee97ab65e463]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5b3d0f80-78b5-444b-9440-b679010c3698, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5b3d0f80-78b5-444b-9440-b679010c3698, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:30:28 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f479eaf-564d-4715-8d91-68a5e619be19 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5b3d0f80-78b5-444b-9440-b679010c3698, portal: 172.16.0.220,3260]
Apr 13 16:30:28 user nova-compute[71731]: Login to [iface: default, target: iqn.2010-10.org.openstack:5b3d0f80-78b5-444b-9440-b679010c3698, portal: 172.16.0.220,3260] successful.
Apr 13 16:30:28 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:30:28 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b3d0f80-78b5-444b-9440-b679010c3698 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:30:28 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b3d0f80-78b5-444b-9440-b679010c3698 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:30:28 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2624389-8303-4c6b-bd33-edb95914c79d]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:30:28 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f479eaf-564d-4715-8d91-68a5e619be19 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:30:28 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:30:28 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:30:28 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4d3c0fe-2336-42fd-8fe2-3a99fe422f85]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b3d0f80-78b5-444b-9440-b679010c3698 (non-flash)\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:30:28 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f479eaf-564d-4715-8d91-68a5e619be19 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)
Apr 13 16:30:28 user nova-compute[71731]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b3d0f80-78b5-444b-9440-b679010c3698 (non-flash)
Apr 13 16:30:28 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 16:30:28 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f479eaf-564d-4715-8d91-68a5e619be19 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)
Apr 13 16:30:28 user nova-compute[71731]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b3d0f80-78b5-444b-9440-b679010c3698 (non-flash)
Apr 13 16:30:28 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 16:30:28 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-9f479eaf-564d-4715-8d91-68a5e619be19 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5b3d0f80-78b5-444b-9440-b679010c3698" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.267s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 16:30:28 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f479eaf-564d-4715-8d91-68a5e619be19 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Connected to 172.16.0.220:3260 {{(pid=71731) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 16:30:28 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-9f479eaf-564d-4715-8d91-68a5e619be19 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] HCTL ('33', '-', '-', 0) found on session 28 with lun 0 {{(pid=71731) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 16:30:28 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-9f479eaf-564d-4715-8d91-68a5e619be19 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71731) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 16:30:28 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:30:28 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:30:28 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[73737a8a-dff4-48f8-8517-2da5927f3f77]: (4, ('- - 0', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:30:28 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-9f479eaf-564d-4715-8d91-68a5e619be19 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Searching for a device in session 28 and hctl ['33', '*', '*', 0] yield: None {{(pid=71731) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 16:30:29 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-9f479eaf-564d-4715-8d91-68a5e619be19 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Searching for a device in session 28 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71731) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 16:30:29 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f479eaf-564d-4715-8d91-68a5e619be19 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:5b3d0f80-78b5-444b-9440-b679010c3698', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GpdQvjTN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71731) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 16:30:29 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-9f479eaf-564d-4715-8d91-68a5e619be19 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.294s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 16:30:29 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f479eaf-564d-4715-8d91-68a5e619be19 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] <== connect_volume: return (1295ms) {'type': 'block', 'scsi_wwn': '26137353866303863', 'path': '/dev/sdb'} {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 16:30:29 user nova-compute[71731]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9f479eaf-564d-4715-8d91-68a5e619be19 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] [instance: bf98c3a2-dbeb-4ae4-8423-ce55964c4258] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26137353866303863', 'path': '/dev/sdb'} {{(pid=71731) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 16:30:29 user nova-compute[71731]: DEBUG nova.objects.instance [None req-9f479eaf-564d-4715-8d91-68a5e619be19 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Lazy-loading 'flavor' on Instance uuid bf98c3a2-dbeb-4ae4-8423-ce55964c4258 {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:30:29 user nova-compute[71731]: DEBUG nova.virt.libvirt.guest [None req-9f479eaf-564d-4715-8d91-68a5e619be19 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] attach device xml: <disk type="block" device="disk">
Apr 13 16:30:29 user nova-compute[71731]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 16:30:29 user nova-compute[71731]:   <source dev="/dev/sdb"/>
Apr 13 16:30:29 user nova-compute[71731]:   <target dev="vdb" bus="virtio"/>
Apr 13 16:30:29 user nova-compute[71731]:   <serial>5b3d0f80-78b5-444b-9440-b679010c3698</serial>
Apr 13 16:30:29 user nova-compute[71731]: </disk>
Apr 13 16:30:29 user nova-compute[71731]:  {{(pid=71731) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 13 16:30:30 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-9f479eaf-564d-4715-8d91-68a5e619be19 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] No BDM found with device name vda, not building metadata. {{(pid=71731) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 16:30:30 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-9f479eaf-564d-4715-8d91-68a5e619be19 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71731) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 16:30:30 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-9f479eaf-564d-4715-8d91-68a5e619be19 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] No VIF found with MAC fa:16:3e:76:1a:b3, not building metadata {{(pid=71731) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 16:30:30 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-9f479eaf-564d-4715-8d91-68a5e619be19 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Lock "bf98c3a2-dbeb-4ae4-8423-ce55964c4258" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.285s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:30:31 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:30:31 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:30:36 user nova-compute[71731]: DEBUG nova.compute.manager [req-2497c27c-581d-4b6e-8ac3-bdd7e80963b2 req-a12d7ac5-4c23-41ef-af1b-6180bdd2322c service nova] [instance: 32b18558-8bf2-4def-bc70-81c4e38fcc6f] Received event network-changed-f9afb5f6-d601-4106-85c8-6d6179433f28 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:30:36 user nova-compute[71731]: DEBUG nova.compute.manager [req-2497c27c-581d-4b6e-8ac3-bdd7e80963b2 req-a12d7ac5-4c23-41ef-af1b-6180bdd2322c service nova] [instance: 32b18558-8bf2-4def-bc70-81c4e38fcc6f] Refreshing instance network info cache due to event network-changed-f9afb5f6-d601-4106-85c8-6d6179433f28. {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 16:30:36 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-2497c27c-581d-4b6e-8ac3-bdd7e80963b2 req-a12d7ac5-4c23-41ef-af1b-6180bdd2322c service nova] Acquiring lock "refresh_cache-32b18558-8bf2-4def-bc70-81c4e38fcc6f" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 16:30:36 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-2497c27c-581d-4b6e-8ac3-bdd7e80963b2 req-a12d7ac5-4c23-41ef-af1b-6180bdd2322c service nova] Acquired lock "refresh_cache-32b18558-8bf2-4def-bc70-81c4e38fcc6f" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 16:30:36 user nova-compute[71731]: DEBUG nova.network.neutron [req-2497c27c-581d-4b6e-8ac3-bdd7e80963b2 req-a12d7ac5-4c23-41ef-af1b-6180bdd2322c service nova] [instance: 32b18558-8bf2-4def-bc70-81c4e38fcc6f] Refreshing network info cache for port f9afb5f6-d601-4106-85c8-6d6179433f28 {{(pid=71731) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 16:30:36 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:30:36 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-48ff9fac-adf2-4223-b7ea-2b7a8d8d129a tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Acquiring lock "32b18558-8bf2-4def-bc70-81c4e38fcc6f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:30:36 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-48ff9fac-adf2-4223-b7ea-2b7a8d8d129a tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Lock "32b18558-8bf2-4def-bc70-81c4e38fcc6f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:30:36 user nova-compute[71731]: DEBUG nova.objects.instance [None req-48ff9fac-adf2-4223-b7ea-2b7a8d8d129a tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Lazy-loading 'flavor' on Instance uuid 32b18558-8bf2-4def-bc70-81c4e38fcc6f {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:30:36 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-48ff9fac-adf2-4223-b7ea-2b7a8d8d129a tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Lock "32b18558-8bf2-4def-bc70-81c4e38fcc6f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:30:36 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:30:37 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-48ff9fac-adf2-4223-b7ea-2b7a8d8d129a tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Acquiring lock "32b18558-8bf2-4def-bc70-81c4e38fcc6f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:30:37 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-48ff9fac-adf2-4223-b7ea-2b7a8d8d129a tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Lock "32b18558-8bf2-4def-bc70-81c4e38fcc6f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:30:37 user nova-compute[71731]: INFO nova.compute.manager [None req-48ff9fac-adf2-4223-b7ea-2b7a8d8d129a tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] [instance: 32b18558-8bf2-4def-bc70-81c4e38fcc6f] Attaching volume 3030feb6-6893-43c8-84b8-46b8535c3077 to /dev/vdb
Apr 13 16:30:37 user nova-compute[71731]: DEBUG os_brick.utils [None req-48ff9fac-adf2-4223-b7ea-2b7a8d8d129a tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 16:30:37 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:30:37 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:30:37 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e99c12f-8aa9-4bdf-a2c2-66a2d9de9036]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:81501d91421\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:30:37 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:30:37 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.029s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:30:37 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b9df47d-6aa0-423b-80e4-0cd21af97d9c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:30:37 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:30:37 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:30:37 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[66187add-4e17-4ec8-a4d3-dc7bfa0db097]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:30:37 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[36105308-db6a-49cc-8cac-8d1e60517cff]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:30:37 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-48ff9fac-adf2-4223-b7ea-2b7a8d8d129a tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Running cmd (subprocess): nvme version {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:30:37 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-48ff9fac-adf2-4223-b7ea-2b7a8d8d129a tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] 'nvme version' failed. Not Retrying. {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 16:30:37 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.nvmeof [None req-48ff9fac-adf2-4223-b7ea-2b7a8d8d129a tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] nvme not present on system {{(pid=71731) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 16:30:37 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:30:37 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 16:30:37 user nova-compute[71731]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 16:30:37 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b1ab271-2dc0-4f07-9003-32c77e410bc4]: (4, '') {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:30:37 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.lightos [None req-48ff9fac-adf2-4223-b7ea-2b7a8d8d129a tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71731) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 16:30:37 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.lightos [None req-48ff9fac-adf2-4223-b7ea-2b7a8d8d129a tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71731) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 16:30:37 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.lightos [None req-48ff9fac-adf2-4223-b7ea-2b7a8d8d129a tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] LIGHTOS: no hostnqn found. {{(pid=71731) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 16:30:37 user nova-compute[71731]: DEBUG os_brick.utils [None req-48ff9fac-adf2-4223-b7ea-2b7a8d8d129a tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] <== get_connector_properties: return (145ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:81501d91421', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 16:30:37 user nova-compute[71731]: DEBUG nova.virt.block_device [None req-48ff9fac-adf2-4223-b7ea-2b7a8d8d129a tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] [instance: 32b18558-8bf2-4def-bc70-81c4e38fcc6f] Updating existing volume attachment record: b538b424-9e09-4be2-9e76-c4ba2c7e4e9c {{(pid=71731) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 16:30:37 user nova-compute[71731]: DEBUG nova.network.neutron [req-2497c27c-581d-4b6e-8ac3-bdd7e80963b2 req-a12d7ac5-4c23-41ef-af1b-6180bdd2322c service nova] [instance: 32b18558-8bf2-4def-bc70-81c4e38fcc6f] Updated VIF entry in instance network info cache for port f9afb5f6-d601-4106-85c8-6d6179433f28. {{(pid=71731) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 16:30:37 user nova-compute[71731]: DEBUG nova.network.neutron [req-2497c27c-581d-4b6e-8ac3-bdd7e80963b2 req-a12d7ac5-4c23-41ef-af1b-6180bdd2322c service nova] [instance: 32b18558-8bf2-4def-bc70-81c4e38fcc6f] Updating instance_info_cache with network_info: [{"id": "f9afb5f6-d601-4106-85c8-6d6179433f28", "address": "fa:16:3e:72:0a:63", "network": {"id": "11386312-9ac6-4252-ab98-b3298a08599c", "bridge": "br-int", "label": "tempest-TestStampPattern-1747654565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.41", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb7100b359f341759cb6f6753e1539a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9afb5f6-d6", "ovs_interfaceid": "f9afb5f6-d601-4106-85c8-6d6179433f28", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:30:37 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-2497c27c-581d-4b6e-8ac3-bdd7e80963b2 req-a12d7ac5-4c23-41ef-af1b-6180bdd2322c service nova] Releasing lock "refresh_cache-32b18558-8bf2-4def-bc70-81c4e38fcc6f" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 16:30:39 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-d0e8136b-0448-434b-b21e-b9faa8ce66d1 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Acquiring lock "bf98c3a2-dbeb-4ae4-8423-ce55964c4258" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:30:39 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-d0e8136b-0448-434b-b21e-b9faa8ce66d1 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Lock "bf98c3a2-dbeb-4ae4-8423-ce55964c4258" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:30:39 user nova-compute[71731]: INFO nova.compute.manager [None req-d0e8136b-0448-434b-b21e-b9faa8ce66d1 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] [instance: bf98c3a2-dbeb-4ae4-8423-ce55964c4258] Detaching volume 5b3d0f80-78b5-444b-9440-b679010c3698
Apr 13 16:30:39 user nova-compute[71731]: INFO nova.virt.block_device [None req-d0e8136b-0448-434b-b21e-b9faa8ce66d1 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] [instance: bf98c3a2-dbeb-4ae4-8423-ce55964c4258] Attempting to driver detach volume 5b3d0f80-78b5-444b-9440-b679010c3698 from mountpoint /dev/vdb
Apr 13 16:30:39 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-d0e8136b-0448-434b-b21e-b9faa8ce66d1 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Attempting to detach device vdb from instance bf98c3a2-dbeb-4ae4-8423-ce55964c4258 from the persistent domain config. {{(pid=71731) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 13 16:30:39 user nova-compute[71731]: DEBUG nova.virt.libvirt.guest [None req-d0e8136b-0448-434b-b21e-b9faa8ce66d1 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 16:30:39 user nova-compute[71731]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 16:30:39 user nova-compute[71731]:   <source dev="/dev/sdb"/>
Apr 13 16:30:39 user nova-compute[71731]:   <target dev="vdb" bus="virtio"/>
Apr 13 16:30:39 user nova-compute[71731]:   <serial>5b3d0f80-78b5-444b-9440-b679010c3698</serial>
Apr 13 16:30:39 user nova-compute[71731]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 13 16:30:39 user nova-compute[71731]: </disk>
Apr 13 16:30:39 user nova-compute[71731]:  {{(pid=71731) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 16:30:39 user nova-compute[71731]: DEBUG nova.compute.manager [None req-32354ff0-230a-4b7b-9e77-ae2db00b523b tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: 650427bd-4dad-4bcd-922d-c17e60b36807] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:30:40 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-d0e8136b-0448-434b-b21e-b9faa8ce66d1 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Successfully detached device vdb from instance bf98c3a2-dbeb-4ae4-8423-ce55964c4258 from the persistent domain config.
Apr 13 16:30:40 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-d0e8136b-0448-434b-b21e-b9faa8ce66d1 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance bf98c3a2-dbeb-4ae4-8423-ce55964c4258 from the live domain config. {{(pid=71731) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 13 16:30:40 user nova-compute[71731]: DEBUG nova.virt.libvirt.guest [None req-d0e8136b-0448-434b-b21e-b9faa8ce66d1 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 16:30:40 user nova-compute[71731]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 16:30:40 user nova-compute[71731]:   <source dev="/dev/sdb"/>
Apr 13 16:30:40 user nova-compute[71731]:   <target dev="vdb" bus="virtio"/>
Apr 13 16:30:40 user nova-compute[71731]:   <serial>5b3d0f80-78b5-444b-9440-b679010c3698</serial>
Apr 13 16:30:40 user nova-compute[71731]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 13 16:30:40 user nova-compute[71731]: </disk>
Apr 13 16:30:40 user nova-compute[71731]:  {{(pid=71731) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 16:30:40 user nova-compute[71731]: INFO nova.compute.manager [None req-32354ff0-230a-4b7b-9e77-ae2db00b523b tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: 650427bd-4dad-4bcd-922d-c17e60b36807] instance snapshotting
Apr 13 16:30:40 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-32354ff0-230a-4b7b-9e77-ae2db00b523b tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: 650427bd-4dad-4bcd-922d-c17e60b36807] Beginning live snapshot process
Apr 13 16:30:40 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-32354ff0-230a-4b7b-9e77-ae2db00b523b tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/650427bd-4dad-4bcd-922d-c17e60b36807/disk --force-share --output=json -f qcow2 {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:30:40 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-32354ff0-230a-4b7b-9e77-ae2db00b523b tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/650427bd-4dad-4bcd-922d-c17e60b36807/disk --force-share --output=json -f qcow2" returned: 0 in 0.151s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:30:40 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-32354ff0-230a-4b7b-9e77-ae2db00b523b tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/650427bd-4dad-4bcd-922d-c17e60b36807/disk --force-share --output=json -f qcow2 {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:30:40 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Received event <DeviceRemovedEvent: 1681403440.502559, bf98c3a2-dbeb-4ae4-8423-ce55964c4258 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71731) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 13 16:30:40 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-d0e8136b-0448-434b-b21e-b9faa8ce66d1 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance bf98c3a2-dbeb-4ae4-8423-ce55964c4258 {{(pid=71731) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 13 16:30:40 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-d0e8136b-0448-434b-b21e-b9faa8ce66d1 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Successfully detached device vdb from instance bf98c3a2-dbeb-4ae4-8423-ce55964c4258 from the live domain config.
Apr 13 16:30:40 user nova-compute[71731]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d0e8136b-0448-434b-b21e-b9faa8ce66d1 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] [instance: bf98c3a2-dbeb-4ae4-8423-ce55964c4258] calling os-brick to detach iSCSI Volume {{(pid=71731) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 16:30:40 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0e8136b-0448-434b-b21e-b9faa8ce66d1 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8cf0118790>, {'target_iqn': 'iqn.2010-10.org.openstack:5b3d0f80-78b5-444b-9440-b679010c3698', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GpdQvjTN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 16:30:40 user nova-compute[71731]: WARNING os_brick.initiator.connectors.base [None req-d0e8136b-0448-434b-b21e-b9faa8ce66d1 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 16:30:40 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-d0e8136b-0448-434b-b21e-b9faa8ce66d1 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 16:30:40 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-d0e8136b-0448-434b-b21e-b9faa8ce66d1 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 16:30:40 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:30:40 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:30:40 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[95ddabd4-fa03-4a02-a019-67d5c35ace28]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5b3d0f80-78b5-444b-9440-b679010c3698\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:30:40 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0e8136b-0448-434b-b21e-b9faa8ce66d1 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 16:30:40 user nova-compute[71731]: No targets found.
Apr 13 16:30:40 user nova-compute[71731]: iSNS:
Apr 13 16:30:40 user nova-compute[71731]: No targets found.
Apr 13 16:30:40 user nova-compute[71731]: STATIC:
Apr 13 16:30:40 user nova-compute[71731]: Target: iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97
Apr 13 16:30:40 user nova-compute[71731]:         Portal: 172.16.0.220:3260,-1
Apr 13 16:30:40 user nova-compute[71731]:                 Iface Name: default
Apr 13 16:30:40 user nova-compute[71731]: Target: iqn.2010-10.org.openstack:5b3d0f80-78b5-444b-9440-b679010c3698
Apr 13 16:30:40 user nova-compute[71731]:         Portal: 172.16.0.220:3260,-1
Apr 13 16:30:40 user nova-compute[71731]:                 Iface Name: default
Apr 13 16:30:40 user nova-compute[71731]: FIRMWARE:
Apr 13 16:30:40 user nova-compute[71731]: No targets found.
Apr 13 16:30:40 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 16:30:40 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0e8136b-0448-434b-b21e-b9faa8ce66d1 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 16:30:40 user nova-compute[71731]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 16:30:40 user nova-compute[71731]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71731) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 16:30:40 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0e8136b-0448-434b-b21e-b9faa8ce66d1 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5b3d0f80-78b5-444b-9440-b679010c3698', 0)] {{(pid=71731) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 16:30:40 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:30:40 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:30:40 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[69edcd07-ccbc-4a6d-bd02-12326d1ccbfa]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5b3d0f80-78b5-444b-9440-b679010c3698\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:30:40 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-32354ff0-230a-4b7b-9e77-ae2db00b523b tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/650427bd-4dad-4bcd-922d-c17e60b36807/disk --force-share --output=json -f qcow2" returned: 0 in 0.135s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:30:40 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-32354ff0-230a-4b7b-9e77-ae2db00b523b tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279 --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:30:40 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:30:40 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:30:40 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ee60a7d-78e7-4c09-bb2a-3c799ed3d995]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b3d0f80-78b5-444b-9440-b679010c3698 (non-flash)\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:30:40 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0e8136b-0448-434b-b21e-b9faa8ce66d1 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)
Apr 13 16:30:40 user nova-compute[71731]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b3d0f80-78b5-444b-9440-b679010c3698 (non-flash)
Apr 13 16:30:40 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 16:30:40 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0e8136b-0448-434b-b21e-b9faa8ce66d1 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)
Apr 13 16:30:40 user nova-compute[71731]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b3d0f80-78b5-444b-9440-b679010c3698 (non-flash)
Apr 13 16:30:40 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 16:30:40 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0e8136b-0448-434b-b21e-b9faa8ce66d1 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8cf0205630>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5b3d0f80-78b5-444b-9440-b679010c3698'): ({'sdb'}, set())}) {{(pid=71731) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 16:30:40 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-d0e8136b-0448-434b-b21e-b9faa8ce66d1 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Removing single pathed devices sdb {{(pid=71731) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 16:30:40 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:30:40 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:30:40 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[5940dc81-2bff-4edc-b7c6-e7d3fb6cccca]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:30:40 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:30:40 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:30:40 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a4da52a-78fe-407e-aef0-2cc1def38476]: (4, ('ok\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:30:40 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-d0e8136b-0448-434b-b21e-b9faa8ce66d1 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Flushing IO for device /dev/sdb {{(pid=71731) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 16:30:40 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:30:40 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:30:40 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[000d4a7b-e97d-4363-9c16-8ed48d89158d]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:30:40 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-d0e8136b-0448-434b-b21e-b9faa8ce66d1 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71731) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 16:30:40 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:30:40 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-32354ff0-230a-4b7b-9e77-ae2db00b523b tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279 --force-share --output=json" returned: 0 in 0.136s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:30:40 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-32354ff0-230a-4b7b-9e77-ae2db00b523b tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpgcbnapev/11849873b67940edbe1cc1abaad390a0.delta 1073741824 {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:30:40 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:30:40 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[f06c0a36-d234-45b4-a086-c61022e6148c]: (4, ('1', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:30:40 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-d0e8136b-0448-434b-b21e-b9faa8ce66d1 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71731) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 16:30:40 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-d0e8136b-0448-434b-b21e-b9faa8ce66d1 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] SCSI volumes sdb have been removed. {{(pid=71731) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 16:30:40 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0e8136b-0448-434b-b21e-b9faa8ce66d1 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5b3d0f80-78b5-444b-9440-b679010c3698')] {{(pid=71731) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 16:30:40 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b3d0f80-78b5-444b-9440-b679010c3698 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:30:40 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-32354ff0-230a-4b7b-9e77-ae2db00b523b tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpgcbnapev/11849873b67940edbe1cc1abaad390a0.delta 1073741824" returned: 0 in 0.050s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:30:40 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-32354ff0-230a-4b7b-9e77-ae2db00b523b tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: 650427bd-4dad-4bcd-922d-c17e60b36807] Quiescing instance not available: QEMU guest agent is not enabled.
Apr 13 16:30:40 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b3d0f80-78b5-444b-9440-b679010c3698 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:30:40 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b6fac3c-51e7-46d7-ab89-aa8927f7a02c]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:30:40 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0e8136b-0448-434b-b21e-b9faa8ce66d1 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:30:40 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b3d0f80-78b5-444b-9440-b679010c3698 -p 172.16.0.220:3260 --logout {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:30:40 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b3d0f80-78b5-444b-9440-b679010c3698 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:30:40 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[7403b3bc-b5e8-48ef-8b1c-da4ff1e2b53f]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:5b3d0f80-78b5-444b-9440-b679010c3698, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:5b3d0f80-78b5-444b-9440-b679010c3698, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:30:40 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0e8136b-0448-434b-b21e-b9faa8ce66d1 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:5b3d0f80-78b5-444b-9440-b679010c3698, portal: 172.16.0.220,3260]
Apr 13 16:30:40 user nova-compute[71731]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:5b3d0f80-78b5-444b-9440-b679010c3698, portal: 172.16.0.220,3260] successful.
Apr 13 16:30:40 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:30:40 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b3d0f80-78b5-444b-9440-b679010c3698 -p 172.16.0.220:3260 --op delete {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:30:40 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b3d0f80-78b5-444b-9440-b679010c3698 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:30:40 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[4873a784-57de-4268-a88c-c4acc7d49825]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:30:40 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0e8136b-0448-434b-b21e-b9faa8ce66d1 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:30:40 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-d0e8136b-0448-434b-b21e-b9faa8ce66d1 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.338s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 16:30:40 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0e8136b-0448-434b-b21e-b9faa8ce66d1 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] <== disconnect_volume: return (340ms) None {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 16:30:40 user nova-compute[71731]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d0e8136b-0448-434b-b21e-b9faa8ce66d1 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] [instance: bf98c3a2-dbeb-4ae4-8423-ce55964c4258] Disconnected iSCSI Volume {{(pid=71731) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 16:30:41 user nova-compute[71731]: DEBUG nova.virt.libvirt.guest [None req-32354ff0-230a-4b7b-9e77-ae2db00b523b tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] COPY block job progress, current cursor: 0 final cursor: 43778048 {{(pid=71731) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 13 16:30:41 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:30:41 user nova-compute[71731]: DEBUG nova.objects.instance [None req-d0e8136b-0448-434b-b21e-b9faa8ce66d1 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Lazy-loading 'flavor' on Instance uuid bf98c3a2-dbeb-4ae4-8423-ce55964c4258 {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:30:41 user nova-compute[71731]: DEBUG nova.virt.libvirt.volume.iscsi [None req-48ff9fac-adf2-4223-b7ea-2b7a8d8d129a tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] [instance: 32b18558-8bf2-4def-bc70-81c4e38fcc6f] Calling os-brick to attach iSCSI Volume {{(pid=71731) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 16:30:41 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-48ff9fac-adf2-4223-b7ea-2b7a8d8d129a tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8cf0118790>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3030feb6-6893-43c8-84b8-46b8535c3077', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NYndfhqK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 16:30:41 user nova-compute[71731]: WARNING os_brick.initiator.connectors.base [None req-48ff9fac-adf2-4223-b7ea-2b7a8d8d129a tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 16:30:41 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-48ff9fac-adf2-4223-b7ea-2b7a8d8d129a tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 16:30:41 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-48ff9fac-adf2-4223-b7ea-2b7a8d8d129a tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 16:30:41 user nova-compute[71731]: WARNING os_brick.initiator.connectors.base [None req-48ff9fac-adf2-4223-b7ea-2b7a8d8d129a tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 16:30:41 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-48ff9fac-adf2-4223-b7ea-2b7a8d8d129a tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3030feb6-6893-43c8-84b8-46b8535c3077" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 16:30:41 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-48ff9fac-adf2-4223-b7ea-2b7a8d8d129a tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3030feb6-6893-43c8-84b8-46b8535c3077" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 16:30:41 user nova-compute[71731]: INFO os_brick.initiator.connectors.iscsi [None req-48ff9fac-adf2-4223-b7ea-2b7a8d8d129a tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 16:30:41 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3030feb6-6893-43c8-84b8-46b8535c3077 -p 172.16.0.220:3260 {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:30:41 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3030feb6-6893-43c8-84b8-46b8535c3077 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:30:41 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae96e6c7-92db-413b-8d2b-9af6a141f72e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:30:41 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-48ff9fac-adf2-4223-b7ea-2b7a8d8d129a tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 16:30:41 user nova-compute[71731]:  {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:30:41 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:30:41 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3030feb6-6893-43c8-84b8-46b8535c3077 -p 172.16.0.220:3260 --interface default --op new {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:30:41 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3030feb6-6893-43c8-84b8-46b8535c3077 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.028s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:30:41 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6121702-8800-489a-800d-2f2d09487857]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3030feb6-6893-43c8-84b8-46b8535c3077] added\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:30:41 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-d0e8136b-0448-434b-b21e-b9faa8ce66d1 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Lock "bf98c3a2-dbeb-4ae4-8423-ce55964c4258" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.042s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:30:41 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-48ff9fac-adf2-4223-b7ea-2b7a8d8d129a tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3030feb6-6893-43c8-84b8-46b8535c3077] added
Apr 13 16:30:41 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:30:41 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3030feb6-6893-43c8-84b8-46b8535c3077 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:30:41 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3030feb6-6893-43c8-84b8-46b8535c3077 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:30:41 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[39c44490-1f79-41d8-b287-abfe2e7d981d]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:30:41 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-48ff9fac-adf2-4223-b7ea-2b7a8d8d129a tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:30:41 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3030feb6-6893-43c8-84b8-46b8535c3077 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:30:41 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3030feb6-6893-43c8-84b8-46b8535c3077 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:30:41 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbf19542-71c3-4476-a494-dcf4489d511b]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:30:41 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-48ff9fac-adf2-4223-b7ea-2b7a8d8d129a tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:30:41 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3030feb6-6893-43c8-84b8-46b8535c3077 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NYndfhqK {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:30:41 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3030feb6-6893-43c8-84b8-46b8535c3077 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NYndfhqK" returned: 0 in 0.022s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:30:41 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[c634070a-5bd1-4323-84b3-7b6f98225cc9]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:30:42 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-48ff9fac-adf2-4223-b7ea-2b7a8d8d129a tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NYndfhqK'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:30:42 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3030feb6-6893-43c8-84b8-46b8535c3077 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:30:42 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3030feb6-6893-43c8-84b8-46b8535c3077 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:30:42 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca0efba5-94a7-492c-8a16-0d9544ba839b]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:30:42 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-48ff9fac-adf2-4223-b7ea-2b7a8d8d129a tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:30:42 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:30:42 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:30:42 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbf1812a-6c41-453f-9f6c-f7d663a8f61c]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:30:42 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-48ff9fac-adf2-4223-b7ea-2b7a8d8d129a tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)
Apr 13 16:30:42 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 16:30:42 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-48ff9fac-adf2-4223-b7ea-2b7a8d8d129a tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)
Apr 13 16:30:42 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 16:30:42 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3030feb6-6893-43c8-84b8-46b8535c3077 -p 172.16.0.220:3260 --login {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:30:42 user nova-compute[71731]: DEBUG nova.virt.libvirt.guest [None req-32354ff0-230a-4b7b-9e77-ae2db00b523b tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] COPY block job progress, current cursor: 43778048 final cursor: 43778048 {{(pid=71731) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 13 16:30:42 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-32354ff0-230a-4b7b-9e77-ae2db00b523b tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: 650427bd-4dad-4bcd-922d-c17e60b36807] Skipping quiescing instance: QEMU guest agent is not enabled.
Apr 13 16:30:42 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3030feb6-6893-43c8-84b8-46b8535c3077 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:30:42 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[d94645a0-e0a8-4265-a899-b5db98516e41]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3030feb6-6893-43c8-84b8-46b8535c3077, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3030feb6-6893-43c8-84b8-46b8535c3077, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:30:42 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-48ff9fac-adf2-4223-b7ea-2b7a8d8d129a tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3030feb6-6893-43c8-84b8-46b8535c3077, portal: 172.16.0.220,3260]
Apr 13 16:30:42 user nova-compute[71731]: Login to [iface: default, target: iqn.2010-10.org.openstack:3030feb6-6893-43c8-84b8-46b8535c3077, portal: 172.16.0.220,3260] successful.
Apr 13 16:30:42 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:30:42 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3030feb6-6893-43c8-84b8-46b8535c3077 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:30:42 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3030feb6-6893-43c8-84b8-46b8535c3077 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:30:42 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba498437-47b5-4f09-b918-7f26a02a5261]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:30:42 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-48ff9fac-adf2-4223-b7ea-2b7a8d8d129a tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:30:42 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:30:42 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:30:42 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[590586e7-36d7-4504-8c4d-a2f72ab9687b]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3030feb6-6893-43c8-84b8-46b8535c3077 (non-flash)\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:30:42 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-48ff9fac-adf2-4223-b7ea-2b7a8d8d129a tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)
Apr 13 16:30:42 user nova-compute[71731]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3030feb6-6893-43c8-84b8-46b8535c3077 (non-flash)
Apr 13 16:30:42 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 16:30:42 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-48ff9fac-adf2-4223-b7ea-2b7a8d8d129a tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)
Apr 13 16:30:42 user nova-compute[71731]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3030feb6-6893-43c8-84b8-46b8535c3077 (non-flash)
Apr 13 16:30:42 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 16:30:42 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-48ff9fac-adf2-4223-b7ea-2b7a8d8d129a tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3030feb6-6893-43c8-84b8-46b8535c3077" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.333s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 16:30:42 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-48ff9fac-adf2-4223-b7ea-2b7a8d8d129a tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Connected to 172.16.0.220:3260 {{(pid=71731) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 16:30:42 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-48ff9fac-adf2-4223-b7ea-2b7a8d8d129a tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] HCTL ('33', '-', '-', 0) found on session 29 with lun 0 {{(pid=71731) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 16:30:42 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-48ff9fac-adf2-4223-b7ea-2b7a8d8d129a tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71731) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 16:30:42 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:30:42 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:30:42 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[f65c5921-3b12-434e-9334-8ec3906ffd26]: (4, ('- - 0', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:30:42 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-48ff9fac-adf2-4223-b7ea-2b7a8d8d129a tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Searching for a device in session 29 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71731) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 16:30:42 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-48ff9fac-adf2-4223-b7ea-2b7a8d8d129a tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:3030feb6-6893-43c8-84b8-46b8535c3077', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NYndfhqK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71731) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 16:30:42 user nova-compute[71731]: DEBUG nova.privsep.utils [None req-32354ff0-230a-4b7b-9e77-ae2db00b523b tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71731) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 13 16:30:42 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-32354ff0-230a-4b7b-9e77-ae2db00b523b tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpgcbnapev/11849873b67940edbe1cc1abaad390a0.delta /opt/stack/data/nova/instances/snapshots/tmpgcbnapev/11849873b67940edbe1cc1abaad390a0 {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:30:42 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-34ba711f-5e49-496e-be03-94a3b737449a tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Acquiring lock "5d50f597-3a29-4335-8166-6ab8e8149376" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:30:42 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-34ba711f-5e49-496e-be03-94a3b737449a tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Lock "5d50f597-3a29-4335-8166-6ab8e8149376" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:30:42 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-34ba711f-5e49-496e-be03-94a3b737449a tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Acquiring lock "5d50f597-3a29-4335-8166-6ab8e8149376-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:30:42 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-34ba711f-5e49-496e-be03-94a3b737449a tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Lock "5d50f597-3a29-4335-8166-6ab8e8149376-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.005s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:30:42 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-34ba711f-5e49-496e-be03-94a3b737449a tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Lock "5d50f597-3a29-4335-8166-6ab8e8149376-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:30:42 user nova-compute[71731]: INFO nova.compute.manager [None req-34ba711f-5e49-496e-be03-94a3b737449a tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] [instance: 5d50f597-3a29-4335-8166-6ab8e8149376] Terminating instance
Apr 13 16:30:42 user nova-compute[71731]: DEBUG nova.compute.manager [None req-34ba711f-5e49-496e-be03-94a3b737449a tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] [instance: 5d50f597-3a29-4335-8166-6ab8e8149376] Start destroying the instance on the hypervisor. {{(pid=71731) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 16:30:42 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-32354ff0-230a-4b7b-9e77-ae2db00b523b tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpgcbnapev/11849873b67940edbe1cc1abaad390a0.delta /opt/stack/data/nova/instances/snapshots/tmpgcbnapev/11849873b67940edbe1cc1abaad390a0" returned: 0 in 0.355s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:30:42 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-32354ff0-230a-4b7b-9e77-ae2db00b523b tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: 650427bd-4dad-4bcd-922d-c17e60b36807] Snapshot extracted, beginning image upload
Apr 13 16:30:42 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:30:42 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:30:42 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:30:42 user nova-compute[71731]: DEBUG nova.compute.manager [req-2a011e1d-ec85-48e4-b9ee-ce47673ce07c req-b843d21e-7bae-4584-b0cd-1966b5162a5d service nova] [instance: 5d50f597-3a29-4335-8166-6ab8e8149376] Received event network-vif-unplugged-cde3b0f9-9ed1-4eba-8560-d5fa05166b2e {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:30:42 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-2a011e1d-ec85-48e4-b9ee-ce47673ce07c req-b843d21e-7bae-4584-b0cd-1966b5162a5d service nova] Acquiring lock "5d50f597-3a29-4335-8166-6ab8e8149376-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:30:42 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-2a011e1d-ec85-48e4-b9ee-ce47673ce07c req-b843d21e-7bae-4584-b0cd-1966b5162a5d service nova] Lock "5d50f597-3a29-4335-8166-6ab8e8149376-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:30:42 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-2a011e1d-ec85-48e4-b9ee-ce47673ce07c req-b843d21e-7bae-4584-b0cd-1966b5162a5d service nova] Lock "5d50f597-3a29-4335-8166-6ab8e8149376-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:30:42 user nova-compute[71731]: DEBUG nova.compute.manager [req-2a011e1d-ec85-48e4-b9ee-ce47673ce07c req-b843d21e-7bae-4584-b0cd-1966b5162a5d service nova] [instance: 5d50f597-3a29-4335-8166-6ab8e8149376] No waiting events found dispatching network-vif-unplugged-cde3b0f9-9ed1-4eba-8560-d5fa05166b2e {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:30:42 user nova-compute[71731]: DEBUG nova.compute.manager [req-2a011e1d-ec85-48e4-b9ee-ce47673ce07c req-b843d21e-7bae-4584-b0cd-1966b5162a5d service nova] [instance: 5d50f597-3a29-4335-8166-6ab8e8149376] Received event network-vif-unplugged-cde3b0f9-9ed1-4eba-8560-d5fa05166b2e for instance with task_state deleting. {{(pid=71731) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 16:30:43 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-48ff9fac-adf2-4223-b7ea-2b7a8d8d129a tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.369s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 16:30:43 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-48ff9fac-adf2-4223-b7ea-2b7a8d8d129a tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] <== connect_volume: return (1371ms) {'type': 'block', 'scsi_wwn': '23437616361316133', 'path': '/dev/sdb'} {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 16:30:43 user nova-compute[71731]: DEBUG nova.virt.libvirt.volume.iscsi [None req-48ff9fac-adf2-4223-b7ea-2b7a8d8d129a tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] [instance: 32b18558-8bf2-4def-bc70-81c4e38fcc6f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23437616361316133', 'path': '/dev/sdb'} {{(pid=71731) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 16:30:43 user nova-compute[71731]: DEBUG nova.objects.instance [None req-48ff9fac-adf2-4223-b7ea-2b7a8d8d129a tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Lazy-loading 'flavor' on Instance uuid 32b18558-8bf2-4def-bc70-81c4e38fcc6f {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:30:43 user nova-compute[71731]: DEBUG nova.virt.libvirt.guest [None req-48ff9fac-adf2-4223-b7ea-2b7a8d8d129a tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] attach device xml: <disk type="block" device="disk">
Apr 13 16:30:43 user nova-compute[71731]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 16:30:43 user nova-compute[71731]:   <source dev="/dev/sdb"/>
Apr 13 16:30:43 user nova-compute[71731]:   <target dev="vdb" bus="virtio"/>
Apr 13 16:30:43 user nova-compute[71731]:   <serial>3030feb6-6893-43c8-84b8-46b8535c3077</serial>
Apr 13 16:30:43 user nova-compute[71731]: </disk>
Apr 13 16:30:43 user nova-compute[71731]:  {{(pid=71731) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 13 16:30:43 user nova-compute[71731]: INFO nova.virt.libvirt.driver [-] [instance: 5d50f597-3a29-4335-8166-6ab8e8149376] Instance destroyed successfully.
Apr 13 16:30:43 user nova-compute[71731]: DEBUG nova.objects.instance [None req-34ba711f-5e49-496e-be03-94a3b737449a tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Lazy-loading 'resources' on Instance uuid 5d50f597-3a29-4335-8166-6ab8e8149376 {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:30:43 user nova-compute[71731]: DEBUG nova.virt.libvirt.vif [None req-34ba711f-5e49-496e-be03-94a3b737449a tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T16:27:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2052401344',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-2052401344',id=21,image_ref='708622a9-7465-4492-ade8-b827198f7e30',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAENxxbnK5TO5rrhClGAK4OGBjRSl2WhguyF+uaJMZFTdQImhP15imwNCemvjwOF1cJdEvHpeqOmPATUZWcFezxU2vmY8dwhasInHSqB5TQd2r6SmgLKfFX1fag2EbRN/A==',key_name='tempest-keypair-1469740557',keypairs=<?>,launch_index=0,launched_at=2023-04-13T16:27:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3c33fd5889ce4d0b983f529767005267',ramdisk_id='',reservation_id='r-99cwosbm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='708622a9-7465-4492-ade8-b827198f7e30',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1979050233',owner_user_name='tempest-TaggedAttachmentsTest-1979050233-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T16:27:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fa66202e2e5547d1b6e792557b335d0f',uuid=5d50f597-3a29-4335-8166-6ab8e8149376,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cde3b0f9-9ed1-4eba-8560-d5fa05166b2e", "address": "fa:16:3e:9d:e7:97", "network": {"id": "c790aafd-fad0-4403-bfad-05bbf49d23b2", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1464281989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c33fd5889ce4d0b983f529767005267", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcde3b0f9-9e", "ovs_interfaceid": "cde3b0f9-9ed1-4eba-8560-d5fa05166b2e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 16:30:43 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-34ba711f-5e49-496e-be03-94a3b737449a tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Converting VIF {"id": "cde3b0f9-9ed1-4eba-8560-d5fa05166b2e", "address": "fa:16:3e:9d:e7:97", "network": {"id": "c790aafd-fad0-4403-bfad-05bbf49d23b2", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1464281989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c33fd5889ce4d0b983f529767005267", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcde3b0f9-9e", "ovs_interfaceid": "cde3b0f9-9ed1-4eba-8560-d5fa05166b2e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 16:30:43 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-34ba711f-5e49-496e-be03-94a3b737449a tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9d:e7:97,bridge_name='br-int',has_traffic_filtering=True,id=cde3b0f9-9ed1-4eba-8560-d5fa05166b2e,network=Network(c790aafd-fad0-4403-bfad-05bbf49d23b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcde3b0f9-9e') {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 16:30:43 user nova-compute[71731]: DEBUG os_vif [None req-34ba711f-5e49-496e-be03-94a3b737449a tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9d:e7:97,bridge_name='br-int',has_traffic_filtering=True,id=cde3b0f9-9ed1-4eba-8560-d5fa05166b2e,network=Network(c790aafd-fad0-4403-bfad-05bbf49d23b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcde3b0f9-9e') {{(pid=71731) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 16:30:43 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:30:43 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcde3b0f9-9e, bridge=br-int, if_exists=True) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:30:43 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:30:43 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 16:30:43 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:30:43 user nova-compute[71731]: INFO os_vif [None req-34ba711f-5e49-496e-be03-94a3b737449a tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9d:e7:97,bridge_name='br-int',has_traffic_filtering=True,id=cde3b0f9-9ed1-4eba-8560-d5fa05166b2e,network=Network(c790aafd-fad0-4403-bfad-05bbf49d23b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcde3b0f9-9e')
Apr 13 16:30:43 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-34ba711f-5e49-496e-be03-94a3b737449a tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] [instance: 5d50f597-3a29-4335-8166-6ab8e8149376] Deleting instance files /opt/stack/data/nova/instances/5d50f597-3a29-4335-8166-6ab8e8149376_del
Apr 13 16:30:43 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-34ba711f-5e49-496e-be03-94a3b737449a tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] [instance: 5d50f597-3a29-4335-8166-6ab8e8149376] Deletion of /opt/stack/data/nova/instances/5d50f597-3a29-4335-8166-6ab8e8149376_del complete
Apr 13 16:30:43 user nova-compute[71731]: INFO nova.compute.manager [None req-34ba711f-5e49-496e-be03-94a3b737449a tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] [instance: 5d50f597-3a29-4335-8166-6ab8e8149376] Took 0.87 seconds to destroy the instance on the hypervisor.
Apr 13 16:30:43 user nova-compute[71731]: DEBUG oslo.service.loopingcall [None req-34ba711f-5e49-496e-be03-94a3b737449a tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71731) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 16:30:43 user nova-compute[71731]: DEBUG nova.compute.manager [-] [instance: 5d50f597-3a29-4335-8166-6ab8e8149376] Deallocating network for instance {{(pid=71731) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 16:30:43 user nova-compute[71731]: DEBUG nova.network.neutron [-] [instance: 5d50f597-3a29-4335-8166-6ab8e8149376] deallocate_for_instance() {{(pid=71731) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 16:30:43 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-69ee0e73-9794-415c-a1cf-a95d8d739e7c tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Acquiring lock "03200054-c651-4333-acce-3bea3defe22a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:30:43 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-69ee0e73-9794-415c-a1cf-a95d8d739e7c tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "03200054-c651-4333-acce-3bea3defe22a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:30:43 user nova-compute[71731]: DEBUG nova.compute.manager [None req-69ee0e73-9794-415c-a1cf-a95d8d739e7c tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 03200054-c651-4333-acce-3bea3defe22a] Starting instance... {{(pid=71731) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 16:30:43 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-69ee0e73-9794-415c-a1cf-a95d8d739e7c tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:30:43 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-69ee0e73-9794-415c-a1cf-a95d8d739e7c tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:30:43 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-69ee0e73-9794-415c-a1cf-a95d8d739e7c tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71731) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 16:30:43 user nova-compute[71731]: INFO nova.compute.claims [None req-69ee0e73-9794-415c-a1cf-a95d8d739e7c tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 03200054-c651-4333-acce-3bea3defe22a] Claim successful on node user
Apr 13 16:30:43 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-48ff9fac-adf2-4223-b7ea-2b7a8d8d129a tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] No BDM found with device name vda, not building metadata. {{(pid=71731) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 16:30:43 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-48ff9fac-adf2-4223-b7ea-2b7a8d8d129a tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71731) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 16:30:43 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-48ff9fac-adf2-4223-b7ea-2b7a8d8d129a tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] No VIF found with MAC fa:16:3e:72:0a:63, not building metadata {{(pid=71731) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 16:30:43 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-48ff9fac-adf2-4223-b7ea-2b7a8d8d129a tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Lock "32b18558-8bf2-4def-bc70-81c4e38fcc6f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.929s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:30:44 user nova-compute[71731]: DEBUG nova.compute.provider_tree [None req-69ee0e73-9794-415c-a1cf-a95d8d739e7c tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Inventory has not changed in ProviderTree for provider: cb6b1a64-0c24-4e2d-af1e-16576ca9165c {{(pid=71731) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 16:30:44 user nova-compute[71731]: DEBUG nova.scheduler.client.report [None req-69ee0e73-9794-415c-a1cf-a95d8d739e7c tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Inventory has not changed for provider cb6b1a64-0c24-4e2d-af1e-16576ca9165c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71731) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 16:30:44 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-69ee0e73-9794-415c-a1cf-a95d8d739e7c tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.507s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:30:44 user nova-compute[71731]: DEBUG nova.compute.manager [None req-69ee0e73-9794-415c-a1cf-a95d8d739e7c tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 03200054-c651-4333-acce-3bea3defe22a] Start building networks asynchronously for instance. {{(pid=71731) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 16:30:44 user nova-compute[71731]: DEBUG nova.compute.manager [None req-69ee0e73-9794-415c-a1cf-a95d8d739e7c tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 03200054-c651-4333-acce-3bea3defe22a] Allocating IP information in the background. {{(pid=71731) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 16:30:44 user nova-compute[71731]: DEBUG nova.network.neutron [None req-69ee0e73-9794-415c-a1cf-a95d8d739e7c tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 03200054-c651-4333-acce-3bea3defe22a] allocate_for_instance() {{(pid=71731) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 16:30:44 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-69ee0e73-9794-415c-a1cf-a95d8d739e7c tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 03200054-c651-4333-acce-3bea3defe22a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 16:30:44 user nova-compute[71731]: DEBUG nova.compute.manager [None req-69ee0e73-9794-415c-a1cf-a95d8d739e7c tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 03200054-c651-4333-acce-3bea3defe22a] Start building block device mappings for instance. {{(pid=71731) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 16:30:44 user nova-compute[71731]: INFO nova.virt.block_device [None req-69ee0e73-9794-415c-a1cf-a95d8d739e7c tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 03200054-c651-4333-acce-3bea3defe22a] Booting with volume c2088266-1d33-4bb1-ac5b-1de832ff7985 at /dev/vda
Apr 13 16:30:44 user nova-compute[71731]: DEBUG nova.network.neutron [-] [instance: 5d50f597-3a29-4335-8166-6ab8e8149376] Updating instance_info_cache with network_info: [] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:30:44 user nova-compute[71731]: DEBUG nova.policy [None req-69ee0e73-9794-415c-a1cf-a95d8d739e7c tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd70e10f63cdd49a9a1ebe1fe4c9de0a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d451e0e239f486aa2b3abe9e273eab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71731) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 16:30:44 user nova-compute[71731]: INFO nova.compute.manager [-] [instance: 5d50f597-3a29-4335-8166-6ab8e8149376] Took 0.97 seconds to deallocate network for instance.
Apr 13 16:30:44 user nova-compute[71731]: DEBUG os_brick.utils [None req-69ee0e73-9794-415c-a1cf-a95d8d739e7c tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 16:30:44 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:30:44 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-34ba711f-5e49-496e-be03-94a3b737449a tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:30:44 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-34ba711f-5e49-496e-be03-94a3b737449a tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:30:44 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.022s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:30:44 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5426969-a5e0-437e-a89c-d6bac3ec9281]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:81501d91421\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:30:44 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:30:44 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.024s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:30:44 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[cae875a3-28fb-4595-a6cf-b51ec21c3594]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:30:44 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:30:44 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:30:44 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0884a0b-3e98-46f4-8391-1c1b85c7eb2b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:30:44 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[f27f5e60-1ef5-4ed1-845d-007be9ce108e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:30:44 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-69ee0e73-9794-415c-a1cf-a95d8d739e7c tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Running cmd (subprocess): nvme version {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:30:44 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-69ee0e73-9794-415c-a1cf-a95d8d739e7c tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] 'nvme version' failed. Not Retrying. {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 16:30:44 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.nvmeof [None req-69ee0e73-9794-415c-a1cf-a95d8d739e7c tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] nvme not present on system {{(pid=71731) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 16:30:44 user nova-compute[71731]: DEBUG nova.compute.manager [req-4fdfad25-a0e7-4a63-835b-010ad4699d6f req-7b8921da-db66-431a-987b-0656f94565cb service nova] [instance: 5d50f597-3a29-4335-8166-6ab8e8149376] Received event network-vif-deleted-cde3b0f9-9ed1-4eba-8560-d5fa05166b2e {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:30:44 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:30:44 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 16:30:44 user nova-compute[71731]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 16:30:44 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2d4e1dc-dd45-4301-ac4d-3fe93ef60d05]: (4, '') {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:30:44 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.lightos [None req-69ee0e73-9794-415c-a1cf-a95d8d739e7c tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71731) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 16:30:44 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.lightos [None req-69ee0e73-9794-415c-a1cf-a95d8d739e7c tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71731) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 16:30:44 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.lightos [None req-69ee0e73-9794-415c-a1cf-a95d8d739e7c tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] LIGHTOS: no hostnqn found. {{(pid=71731) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 16:30:44 user nova-compute[71731]: DEBUG os_brick.utils [None req-69ee0e73-9794-415c-a1cf-a95d8d739e7c tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] <== get_connector_properties: return (156ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:81501d91421', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 16:30:44 user nova-compute[71731]: DEBUG nova.virt.block_device [None req-69ee0e73-9794-415c-a1cf-a95d8d739e7c tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 03200054-c651-4333-acce-3bea3defe22a] Updating existing volume attachment record: e9b9bcc6-f1a8-4ada-81c3-145d703bdcd5 {{(pid=71731) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 16:30:44 user nova-compute[71731]: DEBUG nova.compute.provider_tree [None req-34ba711f-5e49-496e-be03-94a3b737449a tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Inventory has not changed in ProviderTree for provider: cb6b1a64-0c24-4e2d-af1e-16576ca9165c {{(pid=71731) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 16:30:44 user nova-compute[71731]: DEBUG nova.scheduler.client.report [None req-34ba711f-5e49-496e-be03-94a3b737449a tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Inventory has not changed for provider cb6b1a64-0c24-4e2d-af1e-16576ca9165c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71731) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 16:30:44 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-34ba711f-5e49-496e-be03-94a3b737449a tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.409s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:30:44 user nova-compute[71731]: DEBUG nova.compute.manager [req-3183e0d3-6e40-41a4-a3cc-04000e361226 req-9f808166-ef82-4ca3-a791-544ed27cf5d4 service nova] [instance: 5d50f597-3a29-4335-8166-6ab8e8149376] Received event network-vif-plugged-cde3b0f9-9ed1-4eba-8560-d5fa05166b2e {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:30:44 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-3183e0d3-6e40-41a4-a3cc-04000e361226 req-9f808166-ef82-4ca3-a791-544ed27cf5d4 service nova] Acquiring lock "5d50f597-3a29-4335-8166-6ab8e8149376-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:30:44 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-3183e0d3-6e40-41a4-a3cc-04000e361226 req-9f808166-ef82-4ca3-a791-544ed27cf5d4 service nova] Lock "5d50f597-3a29-4335-8166-6ab8e8149376-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:30:44 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-3183e0d3-6e40-41a4-a3cc-04000e361226 req-9f808166-ef82-4ca3-a791-544ed27cf5d4 service nova] Lock "5d50f597-3a29-4335-8166-6ab8e8149376-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:30:44 user nova-compute[71731]: DEBUG nova.compute.manager [req-3183e0d3-6e40-41a4-a3cc-04000e361226 req-9f808166-ef82-4ca3-a791-544ed27cf5d4 service nova] [instance: 5d50f597-3a29-4335-8166-6ab8e8149376] No waiting events found dispatching network-vif-plugged-cde3b0f9-9ed1-4eba-8560-d5fa05166b2e {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:30:44 user nova-compute[71731]: WARNING nova.compute.manager [req-3183e0d3-6e40-41a4-a3cc-04000e361226 req-9f808166-ef82-4ca3-a791-544ed27cf5d4 service nova] [instance: 5d50f597-3a29-4335-8166-6ab8e8149376] Received unexpected event network-vif-plugged-cde3b0f9-9ed1-4eba-8560-d5fa05166b2e for instance with vm_state deleted and task_state None.
Apr 13 16:30:44 user nova-compute[71731]: INFO nova.scheduler.client.report [None req-34ba711f-5e49-496e-be03-94a3b737449a tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Deleted allocations for instance 5d50f597-3a29-4335-8166-6ab8e8149376
Apr 13 16:30:44 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-32354ff0-230a-4b7b-9e77-ae2db00b523b tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: 650427bd-4dad-4bcd-922d-c17e60b36807] Snapshot image upload complete
Apr 13 16:30:44 user nova-compute[71731]: INFO nova.compute.manager [None req-32354ff0-230a-4b7b-9e77-ae2db00b523b tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: 650427bd-4dad-4bcd-922d-c17e60b36807] Took 4.92 seconds to snapshot the instance on the hypervisor.
Apr 13 16:30:44 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-34ba711f-5e49-496e-be03-94a3b737449a tempest-TaggedAttachmentsTest-1979050233 tempest-TaggedAttachmentsTest-1979050233-project-member] Lock "5d50f597-3a29-4335-8166-6ab8e8149376" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.471s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:30:45 user nova-compute[71731]: DEBUG nova.network.neutron [None req-69ee0e73-9794-415c-a1cf-a95d8d739e7c tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 03200054-c651-4333-acce-3bea3defe22a] Successfully created port: b40a4a40-0a9a-42f8-8d44-41bf4042454b {{(pid=71731) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 16:30:45 user nova-compute[71731]: DEBUG nova.network.neutron [None req-69ee0e73-9794-415c-a1cf-a95d8d739e7c tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 03200054-c651-4333-acce-3bea3defe22a] Successfully updated port: b40a4a40-0a9a-42f8-8d44-41bf4042454b {{(pid=71731) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 16:30:45 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-69ee0e73-9794-415c-a1cf-a95d8d739e7c tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Acquiring lock "refresh_cache-03200054-c651-4333-acce-3bea3defe22a" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 16:30:45 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-69ee0e73-9794-415c-a1cf-a95d8d739e7c tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Acquired lock "refresh_cache-03200054-c651-4333-acce-3bea3defe22a" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 16:30:45 user nova-compute[71731]: DEBUG nova.network.neutron [None req-69ee0e73-9794-415c-a1cf-a95d8d739e7c tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 03200054-c651-4333-acce-3bea3defe22a] Building network info cache for instance {{(pid=71731) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 16:30:45 user nova-compute[71731]: DEBUG nova.network.neutron [None req-69ee0e73-9794-415c-a1cf-a95d8d739e7c tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 03200054-c651-4333-acce-3bea3defe22a] Instance cache missing network info. {{(pid=71731) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 16:30:46 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-ba49f720-5a2e-44a2-81e0-be5cf81a932b tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Acquiring lock "32b18558-8bf2-4def-bc70-81c4e38fcc6f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:30:46 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-ba49f720-5a2e-44a2-81e0-be5cf81a932b tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Lock "32b18558-8bf2-4def-bc70-81c4e38fcc6f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:30:46 user nova-compute[71731]: INFO nova.compute.manager [None req-ba49f720-5a2e-44a2-81e0-be5cf81a932b tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] [instance: 32b18558-8bf2-4def-bc70-81c4e38fcc6f] Detaching volume 3030feb6-6893-43c8-84b8-46b8535c3077
Apr 13 16:30:46 user nova-compute[71731]: DEBUG nova.network.neutron [None req-69ee0e73-9794-415c-a1cf-a95d8d739e7c tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 03200054-c651-4333-acce-3bea3defe22a] Updating instance_info_cache with network_info: [{"id": "b40a4a40-0a9a-42f8-8d44-41bf4042454b", "address": "fa:16:3e:e7:02:ec", "network": {"id": "d36bc206-f629-4d6e-8a3f-458061d7b525", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-893271134-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d451e0e239f486aa2b3abe9e273eab3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb40a4a40-0a", "ovs_interfaceid": "b40a4a40-0a9a-42f8-8d44-41bf4042454b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:30:46 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-69ee0e73-9794-415c-a1cf-a95d8d739e7c tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Releasing lock "refresh_cache-03200054-c651-4333-acce-3bea3defe22a" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 16:30:46 user nova-compute[71731]: DEBUG nova.compute.manager [None req-69ee0e73-9794-415c-a1cf-a95d8d739e7c tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 03200054-c651-4333-acce-3bea3defe22a] Instance network_info: |[{"id": "b40a4a40-0a9a-42f8-8d44-41bf4042454b", "address": "fa:16:3e:e7:02:ec", "network": {"id": "d36bc206-f629-4d6e-8a3f-458061d7b525", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-893271134-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d451e0e239f486aa2b3abe9e273eab3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb40a4a40-0a", "ovs_interfaceid": "b40a4a40-0a9a-42f8-8d44-41bf4042454b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71731) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 16:30:46 user nova-compute[71731]: INFO nova.virt.block_device [None req-ba49f720-5a2e-44a2-81e0-be5cf81a932b tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] [instance: 32b18558-8bf2-4def-bc70-81c4e38fcc6f] Attempting to driver detach volume 3030feb6-6893-43c8-84b8-46b8535c3077 from mountpoint /dev/vdb
Apr 13 16:30:46 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-ba49f720-5a2e-44a2-81e0-be5cf81a932b tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Attempting to detach device vdb from instance 32b18558-8bf2-4def-bc70-81c4e38fcc6f from the persistent domain config. {{(pid=71731) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 13 16:30:46 user nova-compute[71731]: DEBUG nova.virt.libvirt.guest [None req-ba49f720-5a2e-44a2-81e0-be5cf81a932b tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 16:30:46 user nova-compute[71731]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 16:30:46 user nova-compute[71731]:   <source dev="/dev/sdb"/>
Apr 13 16:30:46 user nova-compute[71731]:   <target dev="vdb" bus="virtio"/>
Apr 13 16:30:46 user nova-compute[71731]:   <serial>3030feb6-6893-43c8-84b8-46b8535c3077</serial>
Apr 13 16:30:46 user nova-compute[71731]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 13 16:30:46 user nova-compute[71731]: </disk>
Apr 13 16:30:46 user nova-compute[71731]:  {{(pid=71731) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 16:30:46 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-ba49f720-5a2e-44a2-81e0-be5cf81a932b tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Successfully detached device vdb from instance 32b18558-8bf2-4def-bc70-81c4e38fcc6f from the persistent domain config.
Apr 13 16:30:46 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-ba49f720-5a2e-44a2-81e0-be5cf81a932b tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 32b18558-8bf2-4def-bc70-81c4e38fcc6f from the live domain config. {{(pid=71731) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 13 16:30:46 user nova-compute[71731]: DEBUG nova.virt.libvirt.guest [None req-ba49f720-5a2e-44a2-81e0-be5cf81a932b tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 16:30:46 user nova-compute[71731]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 16:30:46 user nova-compute[71731]:   <source dev="/dev/sdb"/>
Apr 13 16:30:46 user nova-compute[71731]:   <target dev="vdb" bus="virtio"/>
Apr 13 16:30:46 user nova-compute[71731]:   <serial>3030feb6-6893-43c8-84b8-46b8535c3077</serial>
Apr 13 16:30:46 user nova-compute[71731]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 13 16:30:46 user nova-compute[71731]: </disk>
Apr 13 16:30:46 user nova-compute[71731]:  {{(pid=71731) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 16:30:46 user nova-compute[71731]: DEBUG nova.compute.manager [req-37e32117-64c6-4958-8485-a357dee5f0f2 req-c77f4b07-e406-4895-b3eb-ace836a6432b service nova] [instance: 03200054-c651-4333-acce-3bea3defe22a] Received event network-changed-b40a4a40-0a9a-42f8-8d44-41bf4042454b {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:30:46 user nova-compute[71731]: DEBUG nova.compute.manager [req-37e32117-64c6-4958-8485-a357dee5f0f2 req-c77f4b07-e406-4895-b3eb-ace836a6432b service nova] [instance: 03200054-c651-4333-acce-3bea3defe22a] Refreshing instance network info cache due to event network-changed-b40a4a40-0a9a-42f8-8d44-41bf4042454b. {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 16:30:46 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-37e32117-64c6-4958-8485-a357dee5f0f2 req-c77f4b07-e406-4895-b3eb-ace836a6432b service nova] Acquiring lock "refresh_cache-03200054-c651-4333-acce-3bea3defe22a" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 16:30:46 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-37e32117-64c6-4958-8485-a357dee5f0f2 req-c77f4b07-e406-4895-b3eb-ace836a6432b service nova] Acquired lock "refresh_cache-03200054-c651-4333-acce-3bea3defe22a" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 16:30:46 user nova-compute[71731]: DEBUG nova.network.neutron [req-37e32117-64c6-4958-8485-a357dee5f0f2 req-c77f4b07-e406-4895-b3eb-ace836a6432b service nova] [instance: 03200054-c651-4333-acce-3bea3defe22a] Refreshing network info cache for port b40a4a40-0a9a-42f8-8d44-41bf4042454b {{(pid=71731) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 16:30:46 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:30:46 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Received event <DeviceRemovedEvent: 1681403446.8382645, 32b18558-8bf2-4def-bc70-81c4e38fcc6f => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71731) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 13 16:30:46 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-ba49f720-5a2e-44a2-81e0-be5cf81a932b tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 32b18558-8bf2-4def-bc70-81c4e38fcc6f {{(pid=71731) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 13 16:30:46 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-ba49f720-5a2e-44a2-81e0-be5cf81a932b tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Successfully detached device vdb from instance 32b18558-8bf2-4def-bc70-81c4e38fcc6f from the live domain config.
Apr 13 16:30:46 user nova-compute[71731]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ba49f720-5a2e-44a2-81e0-be5cf81a932b tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] [instance: 32b18558-8bf2-4def-bc70-81c4e38fcc6f] calling os-brick to detach iSCSI Volume {{(pid=71731) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 16:30:46 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba49f720-5a2e-44a2-81e0-be5cf81a932b tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8cf0118790>, {'target_iqn': 'iqn.2010-10.org.openstack:3030feb6-6893-43c8-84b8-46b8535c3077', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NYndfhqK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 16:30:46 user nova-compute[71731]: WARNING os_brick.initiator.connectors.base [None req-ba49f720-5a2e-44a2-81e0-be5cf81a932b tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 16:30:46 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-ba49f720-5a2e-44a2-81e0-be5cf81a932b tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 16:30:46 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-ba49f720-5a2e-44a2-81e0-be5cf81a932b tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 16:30:46 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:30:46 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:30:46 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bf3f8c7-ac02-46d6-b1a2-3e71ffff32a6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3030feb6-6893-43c8-84b8-46b8535c3077\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:30:46 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba49f720-5a2e-44a2-81e0-be5cf81a932b tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 16:30:46 user nova-compute[71731]: No targets found.
Apr 13 16:30:46 user nova-compute[71731]: iSNS:
Apr 13 16:30:46 user nova-compute[71731]: No targets found.
Apr 13 16:30:46 user nova-compute[71731]: STATIC:
Apr 13 16:30:46 user nova-compute[71731]: Target: iqn.2010-10.org.openstack:3030feb6-6893-43c8-84b8-46b8535c3077
Apr 13 16:30:46 user nova-compute[71731]:         Portal: 172.16.0.220:3260,-1
Apr 13 16:30:46 user nova-compute[71731]:                 Iface Name: default
Apr 13 16:30:46 user nova-compute[71731]: Target: iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97
Apr 13 16:30:46 user nova-compute[71731]:         Portal: 172.16.0.220:3260,-1
Apr 13 16:30:46 user nova-compute[71731]:                 Iface Name: default
Apr 13 16:30:46 user nova-compute[71731]: FIRMWARE:
Apr 13 16:30:46 user nova-compute[71731]: No targets found.
Apr 13 16:30:46 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 16:30:46 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba49f720-5a2e-44a2-81e0-be5cf81a932b tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 16:30:46 user nova-compute[71731]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 16:30:46 user nova-compute[71731]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71731) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 16:30:46 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba49f720-5a2e-44a2-81e0-be5cf81a932b tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3030feb6-6893-43c8-84b8-46b8535c3077', 0)] {{(pid=71731) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 16:30:46 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:30:46 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:30:46 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[e20e399a-9de8-4c9b-b419-21406a0a444e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3030feb6-6893-43c8-84b8-46b8535c3077\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:30:46 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:30:46 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:30:46 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0a5d7d8-4ffe-4fc3-ac08-6988de87e51f]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3030feb6-6893-43c8-84b8-46b8535c3077 (non-flash)\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:30:46 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba49f720-5a2e-44a2-81e0-be5cf81a932b tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)
Apr 13 16:30:46 user nova-compute[71731]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3030feb6-6893-43c8-84b8-46b8535c3077 (non-flash)
Apr 13 16:30:46 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 16:30:46 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba49f720-5a2e-44a2-81e0-be5cf81a932b tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)
Apr 13 16:30:46 user nova-compute[71731]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3030feb6-6893-43c8-84b8-46b8535c3077 (non-flash)
Apr 13 16:30:46 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 16:30:46 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba49f720-5a2e-44a2-81e0-be5cf81a932b tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8cb0671750>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3030feb6-6893-43c8-84b8-46b8535c3077'): ({'sdb'}, set())}) {{(pid=71731) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 16:30:46 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-ba49f720-5a2e-44a2-81e0-be5cf81a932b tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Removing single pathed devices sdb {{(pid=71731) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 16:30:46 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:30:46 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:30:46 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a327240-1d3c-42c4-90c2-b0c384a97e66]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:30:46 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:30:46 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:30:46 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[98bccc16-1e0a-496b-b77e-b8d59dcbfb67]: (4, ('ok\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:30:46 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-ba49f720-5a2e-44a2-81e0-be5cf81a932b tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Flushing IO for device /dev/sdb {{(pid=71731) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 16:30:46 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:30:46 user nova-compute[71731]: DEBUG nova.network.neutron [req-37e32117-64c6-4958-8485-a357dee5f0f2 req-c77f4b07-e406-4895-b3eb-ace836a6432b service nova] [instance: 03200054-c651-4333-acce-3bea3defe22a] Updated VIF entry in instance network info cache for port b40a4a40-0a9a-42f8-8d44-41bf4042454b. {{(pid=71731) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 16:30:46 user nova-compute[71731]: DEBUG nova.network.neutron [req-37e32117-64c6-4958-8485-a357dee5f0f2 req-c77f4b07-e406-4895-b3eb-ace836a6432b service nova] [instance: 03200054-c651-4333-acce-3bea3defe22a] Updating instance_info_cache with network_info: [{"id": "b40a4a40-0a9a-42f8-8d44-41bf4042454b", "address": "fa:16:3e:e7:02:ec", "network": {"id": "d36bc206-f629-4d6e-8a3f-458061d7b525", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-893271134-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d451e0e239f486aa2b3abe9e273eab3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb40a4a40-0a", "ovs_interfaceid": "b40a4a40-0a9a-42f8-8d44-41bf4042454b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:30:46 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:30:46 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[565fd0e4-3efd-46a1-b3c4-bbd59bfa71ae]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:30:46 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-ba49f720-5a2e-44a2-81e0-be5cf81a932b tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71731) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 16:30:47 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:30:47 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-37e32117-64c6-4958-8485-a357dee5f0f2 req-c77f4b07-e406-4895-b3eb-ace836a6432b service nova] Releasing lock "refresh_cache-03200054-c651-4333-acce-3bea3defe22a" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 16:30:47 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:30:47 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[781c6858-d91d-4212-ac7e-cc5f0154874d]: (4, ('1', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:30:47 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-ba49f720-5a2e-44a2-81e0-be5cf81a932b tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71731) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 16:30:47 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-ba49f720-5a2e-44a2-81e0-be5cf81a932b tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] SCSI volumes sdb have been removed. {{(pid=71731) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 16:30:47 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba49f720-5a2e-44a2-81e0-be5cf81a932b tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3030feb6-6893-43c8-84b8-46b8535c3077')] {{(pid=71731) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 16:30:47 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3030feb6-6893-43c8-84b8-46b8535c3077 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:30:47 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3030feb6-6893-43c8-84b8-46b8535c3077 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:30:47 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d2c753e-e524-4919-a8f0-6554e9a55256]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:30:47 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba49f720-5a2e-44a2-81e0-be5cf81a932b tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:30:47 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3030feb6-6893-43c8-84b8-46b8535c3077 -p 172.16.0.220:3260 --logout {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:30:47 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3030feb6-6893-43c8-84b8-46b8535c3077 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:30:47 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[dee454b0-bae0-41e2-9de2-aaeaa38e6d71]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:3030feb6-6893-43c8-84b8-46b8535c3077, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:3030feb6-6893-43c8-84b8-46b8535c3077, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:30:47 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba49f720-5a2e-44a2-81e0-be5cf81a932b tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:3030feb6-6893-43c8-84b8-46b8535c3077, portal: 172.16.0.220,3260]
Apr 13 16:30:47 user nova-compute[71731]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:3030feb6-6893-43c8-84b8-46b8535c3077, portal: 172.16.0.220,3260] successful.
Apr 13 16:30:47 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:30:47 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3030feb6-6893-43c8-84b8-46b8535c3077 -p 172.16.0.220:3260 --op delete {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:30:47 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3030feb6-6893-43c8-84b8-46b8535c3077 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:30:47 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4b99919-6798-4c26-a02c-eca71330509a]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:30:47 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba49f720-5a2e-44a2-81e0-be5cf81a932b tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:30:47 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-ba49f720-5a2e-44a2-81e0-be5cf81a932b tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.303s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 16:30:47 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba49f720-5a2e-44a2-81e0-be5cf81a932b tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] <== disconnect_volume: return (305ms) None {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 16:30:47 user nova-compute[71731]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ba49f720-5a2e-44a2-81e0-be5cf81a932b tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] [instance: 32b18558-8bf2-4def-bc70-81c4e38fcc6f] Disconnected iSCSI Volume {{(pid=71731) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 16:30:47 user nova-compute[71731]: DEBUG nova.objects.instance [None req-ba49f720-5a2e-44a2-81e0-be5cf81a932b tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Lazy-loading 'flavor' on Instance uuid 32b18558-8bf2-4def-bc70-81c4e38fcc6f {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:30:47 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-ba49f720-5a2e-44a2-81e0-be5cf81a932b tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Lock "32b18558-8bf2-4def-bc70-81c4e38fcc6f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.675s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:30:48 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:30:49 user nova-compute[71731]: DEBUG nova.compute.manager [None req-69ee0e73-9794-415c-a1cf-a95d8d739e7c tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 03200054-c651-4333-acce-3bea3defe22a] Start spawning the instance on the hypervisor. {{(pid=71731) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 16:30:49 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-69ee0e73-9794-415c-a1cf-a95d8d739e7c tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 03200054-c651-4333-acce-3bea3defe22a] Creating instance directory {{(pid=71731) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 16:30:49 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-69ee0e73-9794-415c-a1cf-a95d8d739e7c tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 03200054-c651-4333-acce-3bea3defe22a] Creating image(s)
Apr 13 16:30:49 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-69ee0e73-9794-415c-a1cf-a95d8d739e7c tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 03200054-c651-4333-acce-3bea3defe22a] Did not create local disks {{(pid=71731) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 13 16:30:49 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-69ee0e73-9794-415c-a1cf-a95d8d739e7c tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 03200054-c651-4333-acce-3bea3defe22a] Ensure instance console log exists: /opt/stack/data/nova/instances/03200054-c651-4333-acce-3bea3defe22a/console.log {{(pid=71731) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 16:30:49 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-69ee0e73-9794-415c-a1cf-a95d8d739e7c tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:30:49 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-69ee0e73-9794-415c-a1cf-a95d8d739e7c tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:30:49 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-69ee0e73-9794-415c-a1cf-a95d8d739e7c tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:30:49 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-69ee0e73-9794-415c-a1cf-a95d8d739e7c tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 03200054-c651-4333-acce-3bea3defe22a] Start _get_guest_xml network_info=[{"id": "b40a4a40-0a9a-42f8-8d44-41bf4042454b", "address": "fa:16:3e:e7:02:ec", "network": {"id": "d36bc206-f629-4d6e-8a3f-458061d7b525", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-893271134-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d451e0e239f486aa2b3abe9e273eab3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb40a4a40-0a", "ovs_interfaceid": "b40a4a40-0a9a-42f8-8d44-41bf4042454b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'attachment_id': 'e9b9bcc6-f1a8-4ada-81c3-145d703bdcd5', 'mount_device': '/dev/vda', 'delete_on_termination': False, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c2088266-1d33-4bb1-ac5b-1de832ff7985', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mePtryhb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '03200054-c651-4333-acce-3bea3defe22a', 'attached_at': '', 'detached_at': '', 'volume_id': 'c2088266-1d33-4bb1-ac5b-1de832ff7985', 'serial': 'c2088266-1d33-4bb1-ac5b-1de832ff7985'}, 'disk_bus': 'virtio', 'guest_format': None, 'volume_type': None} {{(pid=71731) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 16:30:49 user nova-compute[71731]: WARNING nova.virt.libvirt.driver [None req-69ee0e73-9794-415c-a1cf-a95d8d739e7c tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 16:30:49 user nova-compute[71731]: WARNING nova.virt.libvirt.driver [None req-69ee0e73-9794-415c-a1cf-a95d8d739e7c tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 16:30:49 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-69ee0e73-9794-415c-a1cf-a95d8d739e7c tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71731) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 16:30:49 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-69ee0e73-9794-415c-a1cf-a95d8d739e7c tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T16:17:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 16:30:49 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-69ee0e73-9794-415c-a1cf-a95d8d739e7c tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Flavor limits 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 16:30:49 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-69ee0e73-9794-415c-a1cf-a95d8d739e7c tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Image limits 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 16:30:49 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-69ee0e73-9794-415c-a1cf-a95d8d739e7c tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Flavor pref 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 16:30:49 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-69ee0e73-9794-415c-a1cf-a95d8d739e7c tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Image pref 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 16:30:49 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-69ee0e73-9794-415c-a1cf-a95d8d739e7c tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 16:30:49 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-69ee0e73-9794-415c-a1cf-a95d8d739e7c tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 16:30:49 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-69ee0e73-9794-415c-a1cf-a95d8d739e7c tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71731) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 16:30:49 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-69ee0e73-9794-415c-a1cf-a95d8d739e7c tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Got 1 possible topologies {{(pid=71731) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 16:30:49 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-69ee0e73-9794-415c-a1cf-a95d8d739e7c tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 16:30:49 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-69ee0e73-9794-415c-a1cf-a95d8d739e7c tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 16:30:49 user nova-compute[71731]: DEBUG nova.virt.libvirt.volume.iscsi [None req-69ee0e73-9794-415c-a1cf-a95d8d739e7c tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 03200054-c651-4333-acce-3bea3defe22a] Calling os-brick to attach iSCSI Volume {{(pid=71731) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 16:30:49 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-69ee0e73-9794-415c-a1cf-a95d8d739e7c tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8cf0118790>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c2088266-1d33-4bb1-ac5b-1de832ff7985', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mePtryhb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 16:30:49 user nova-compute[71731]: WARNING os_brick.initiator.connectors.base [None req-69ee0e73-9794-415c-a1cf-a95d8d739e7c tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 16:30:49 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-69ee0e73-9794-415c-a1cf-a95d8d739e7c tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 16:30:49 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-69ee0e73-9794-415c-a1cf-a95d8d739e7c tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 16:30:49 user nova-compute[71731]: WARNING os_brick.initiator.connectors.base [None req-69ee0e73-9794-415c-a1cf-a95d8d739e7c tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 16:30:49 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-69ee0e73-9794-415c-a1cf-a95d8d739e7c tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c2088266-1d33-4bb1-ac5b-1de832ff7985" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 16:30:49 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-69ee0e73-9794-415c-a1cf-a95d8d739e7c tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c2088266-1d33-4bb1-ac5b-1de832ff7985" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 16:30:49 user nova-compute[71731]: INFO os_brick.initiator.connectors.iscsi [None req-69ee0e73-9794-415c-a1cf-a95d8d739e7c tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 16:30:49 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2088266-1d33-4bb1-ac5b-1de832ff7985 -p 172.16.0.220:3260 {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:30:49 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2088266-1d33-4bb1-ac5b-1de832ff7985 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:30:49 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[74f3d2e1-8c72-46f9-a64b-690596595e4e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:30:49 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-69ee0e73-9794-415c-a1cf-a95d8d739e7c tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 16:30:49 user nova-compute[71731]:  {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:30:49 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2088266-1d33-4bb1-ac5b-1de832ff7985 -p 172.16.0.220:3260 --interface default --op new {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:30:49 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2088266-1d33-4bb1-ac5b-1de832ff7985 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:30:49 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2f6a368-24c2-41a2-a331-77b64b0caa46]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c2088266-1d33-4bb1-ac5b-1de832ff7985] added\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:30:49 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-69ee0e73-9794-415c-a1cf-a95d8d739e7c tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c2088266-1d33-4bb1-ac5b-1de832ff7985] added
Apr 13 16:30:49 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:30:49 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2088266-1d33-4bb1-ac5b-1de832ff7985 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:30:49 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2088266-1d33-4bb1-ac5b-1de832ff7985 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.016s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:30:49 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[1998be97-cc77-422f-a31c-03ef1b097996]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:30:49 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-69ee0e73-9794-415c-a1cf-a95d8d739e7c tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:30:49 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2088266-1d33-4bb1-ac5b-1de832ff7985 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:30:49 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2088266-1d33-4bb1-ac5b-1de832ff7985 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:30:49 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[f538ddd7-2ee9-482d-950f-f661153f64af]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:30:49 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-69ee0e73-9794-415c-a1cf-a95d8d739e7c tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:30:49 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2088266-1d33-4bb1-ac5b-1de832ff7985 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mePtryhb {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:30:49 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2088266-1d33-4bb1-ac5b-1de832ff7985 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mePtryhb" returned: 0 in 0.016s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:30:49 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcd5004f-32b4-4fd4-9c84-9fd3ae06c5d2]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:30:49 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-69ee0e73-9794-415c-a1cf-a95d8d739e7c tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mePtryhb'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:30:49 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2088266-1d33-4bb1-ac5b-1de832ff7985 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:30:49 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2088266-1d33-4bb1-ac5b-1de832ff7985 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:30:49 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[043fea1c-452c-4cf6-a07d-d50b0594c950]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:30:49 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-69ee0e73-9794-415c-a1cf-a95d8d739e7c tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:30:49 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:30:49 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:30:49 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[3853892d-8567-42d6-95e0-0a0ff5ef6a78]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:30:49 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-69ee0e73-9794-415c-a1cf-a95d8d739e7c tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)
Apr 13 16:30:49 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 16:30:49 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-69ee0e73-9794-415c-a1cf-a95d8d739e7c tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)
Apr 13 16:30:49 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 16:30:49 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2088266-1d33-4bb1-ac5b-1de832ff7985 -p 172.16.0.220:3260 --login {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:30:49 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2088266-1d33-4bb1-ac5b-1de832ff7985 -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:30:49 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[66d42dc8-6ff0-4683-b56e-c05ff014972f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c2088266-1d33-4bb1-ac5b-1de832ff7985, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c2088266-1d33-4bb1-ac5b-1de832ff7985, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:30:49 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-69ee0e73-9794-415c-a1cf-a95d8d739e7c tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c2088266-1d33-4bb1-ac5b-1de832ff7985, portal: 172.16.0.220,3260]
Apr 13 16:30:49 user nova-compute[71731]: Login to [iface: default, target: iqn.2010-10.org.openstack:c2088266-1d33-4bb1-ac5b-1de832ff7985, portal: 172.16.0.220,3260] successful.
Apr 13 16:30:49 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:30:49 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2088266-1d33-4bb1-ac5b-1de832ff7985 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:30:49 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2088266-1d33-4bb1-ac5b-1de832ff7985 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:30:49 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[d43d80e6-89c6-4608-bb7d-2b689a2a2a39]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:30:49 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-69ee0e73-9794-415c-a1cf-a95d8d739e7c tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:30:49 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:30:49 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:30:49 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4906d47-cced-496f-8e3e-4a85ba9cbca8]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2088266-1d33-4bb1-ac5b-1de832ff7985 (non-flash)\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:30:49 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-69ee0e73-9794-415c-a1cf-a95d8d739e7c tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)
Apr 13 16:30:49 user nova-compute[71731]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2088266-1d33-4bb1-ac5b-1de832ff7985 (non-flash)
Apr 13 16:30:49 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 16:30:49 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-69ee0e73-9794-415c-a1cf-a95d8d739e7c tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)
Apr 13 16:30:49 user nova-compute[71731]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2088266-1d33-4bb1-ac5b-1de832ff7985 (non-flash)
Apr 13 16:30:49 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 16:30:49 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-69ee0e73-9794-415c-a1cf-a95d8d739e7c tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c2088266-1d33-4bb1-ac5b-1de832ff7985" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.249s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 16:30:49 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-69ee0e73-9794-415c-a1cf-a95d8d739e7c tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Connected to 172.16.0.220:3260 {{(pid=71731) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 16:30:49 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-69ee0e73-9794-415c-a1cf-a95d8d739e7c tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] HCTL ('33', '-', '-', 0) found on session 30 with lun 0 {{(pid=71731) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 16:30:49 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-69ee0e73-9794-415c-a1cf-a95d8d739e7c tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71731) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 16:30:49 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:30:49 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:30:49 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[44492036-1096-4669-a52f-2fddcefa72e9]: (4, ('- - 0', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:30:49 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-69ee0e73-9794-415c-a1cf-a95d8d739e7c tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Searching for a device in session 30 and hctl ['33', '*', '*', 0] yield: None {{(pid=71731) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 16:30:50 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-69ee0e73-9794-415c-a1cf-a95d8d739e7c tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Searching for a device in session 30 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71731) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 16:30:50 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-69ee0e73-9794-415c-a1cf-a95d8d739e7c tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:c2088266-1d33-4bb1-ac5b-1de832ff7985', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mePtryhb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71731) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 16:30:50 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-69ee0e73-9794-415c-a1cf-a95d8d739e7c tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.279s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 16:30:50 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-69ee0e73-9794-415c-a1cf-a95d8d739e7c tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] <== connect_volume: return (1280ms) {'type': 'block', 'scsi_wwn': '23137643431323836', 'path': '/dev/sdb'} {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 16:30:50 user nova-compute[71731]: DEBUG nova.virt.libvirt.volume.iscsi [None req-69ee0e73-9794-415c-a1cf-a95d8d739e7c tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 03200054-c651-4333-acce-3bea3defe22a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23137643431323836', 'path': '/dev/sdb'} {{(pid=71731) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 16:30:50 user nova-compute[71731]: DEBUG nova.virt.libvirt.vif [None req-69ee0e73-9794-415c-a1cf-a95d8d739e7c tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T16:30:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1444057207',display_name='tempest-TestVolumeBootPattern-server-1444057207',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1444057207',id=26,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIspJuW0ouAVIXdRkaEFP67MIl/YPuQkC9G3HjohNK4Y6ERboR/Jfb2q58aDhzUN+56TLqbLCfdFh2NtWLgvjHOwe+zpPoSYOKAkWLX+NSuU860pg4Djj9vwVgJj/Bkydw==',key_name='tempest-TestVolumeBootPattern-1747083001',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8d451e0e239f486aa2b3abe9e273eab3',ramdisk_id='',reservation_id='r-d39s4kc5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-438786227',owner_user_name='tempest-TestVolumeBootPattern-438786227-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T16:30:44Z,user_data=None,user_id='d70e10f63cdd49a9a1ebe1fe4c9de0a2',uuid=03200054-c651-4333-acce-3bea3defe22a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b40a4a40-0a9a-42f8-8d44-41bf4042454b", "address": "fa:16:3e:e7:02:ec", "network": {"id": "d36bc206-f629-4d6e-8a3f-458061d7b525", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-893271134-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d451e0e239f486aa2b3abe9e273eab3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb40a4a40-0a", "ovs_interfaceid": "b40a4a40-0a9a-42f8-8d44-41bf4042454b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71731) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 16:30:50 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-69ee0e73-9794-415c-a1cf-a95d8d739e7c tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Converting VIF {"id": "b40a4a40-0a9a-42f8-8d44-41bf4042454b", "address": "fa:16:3e:e7:02:ec", "network": {"id": "d36bc206-f629-4d6e-8a3f-458061d7b525", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-893271134-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d451e0e239f486aa2b3abe9e273eab3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb40a4a40-0a", "ovs_interfaceid": "b40a4a40-0a9a-42f8-8d44-41bf4042454b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 16:30:50 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-69ee0e73-9794-415c-a1cf-a95d8d739e7c tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:02:ec,bridge_name='br-int',has_traffic_filtering=True,id=b40a4a40-0a9a-42f8-8d44-41bf4042454b,network=Network(d36bc206-f629-4d6e-8a3f-458061d7b525),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb40a4a40-0a') {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 16:30:50 user nova-compute[71731]: DEBUG nova.objects.instance [None req-69ee0e73-9794-415c-a1cf-a95d8d739e7c tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lazy-loading 'pci_devices' on Instance uuid 03200054-c651-4333-acce-3bea3defe22a {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:30:50 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-69ee0e73-9794-415c-a1cf-a95d8d739e7c tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 03200054-c651-4333-acce-3bea3defe22a] End _get_guest_xml xml=<domain type="kvm">
Apr 13 16:30:50 user nova-compute[71731]:   <uuid>03200054-c651-4333-acce-3bea3defe22a</uuid>
Apr 13 16:30:50 user nova-compute[71731]:   <name>instance-0000001a</name>
Apr 13 16:30:50 user nova-compute[71731]:   <memory>131072</memory>
Apr 13 16:30:50 user nova-compute[71731]:   <vcpu>1</vcpu>
Apr 13 16:30:50 user nova-compute[71731]:   <metadata>
Apr 13 16:30:50 user nova-compute[71731]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 16:30:50 user nova-compute[71731]:       <nova:package version="0.0.0"/>
Apr 13 16:30:50 user nova-compute[71731]:       <nova:name>tempest-TestVolumeBootPattern-server-1444057207</nova:name>
Apr 13 16:30:50 user nova-compute[71731]:       <nova:creationTime>2023-04-13 16:30:49</nova:creationTime>
Apr 13 16:30:50 user nova-compute[71731]:       <nova:flavor name="m1.nano">
Apr 13 16:30:50 user nova-compute[71731]:         <nova:memory>128</nova:memory>
Apr 13 16:30:50 user nova-compute[71731]:         <nova:disk>1</nova:disk>
Apr 13 16:30:50 user nova-compute[71731]:         <nova:swap>0</nova:swap>
Apr 13 16:30:50 user nova-compute[71731]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 16:30:50 user nova-compute[71731]:         <nova:vcpus>1</nova:vcpus>
Apr 13 16:30:50 user nova-compute[71731]:       </nova:flavor>
Apr 13 16:30:50 user nova-compute[71731]:       <nova:owner>
Apr 13 16:30:50 user nova-compute[71731]:         <nova:user uuid="d70e10f63cdd49a9a1ebe1fe4c9de0a2">tempest-TestVolumeBootPattern-438786227-project-member</nova:user>
Apr 13 16:30:50 user nova-compute[71731]:         <nova:project uuid="8d451e0e239f486aa2b3abe9e273eab3">tempest-TestVolumeBootPattern-438786227</nova:project>
Apr 13 16:30:50 user nova-compute[71731]:       </nova:owner>
Apr 13 16:30:50 user nova-compute[71731]:       <nova:ports>
Apr 13 16:30:50 user nova-compute[71731]:         <nova:port uuid="b40a4a40-0a9a-42f8-8d44-41bf4042454b">
Apr 13 16:30:50 user nova-compute[71731]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Apr 13 16:30:50 user nova-compute[71731]:         </nova:port>
Apr 13 16:30:50 user nova-compute[71731]:       </nova:ports>
Apr 13 16:30:50 user nova-compute[71731]:     </nova:instance>
Apr 13 16:30:50 user nova-compute[71731]:   </metadata>
Apr 13 16:30:50 user nova-compute[71731]:   <sysinfo type="smbios">
Apr 13 16:30:50 user nova-compute[71731]:     <system>
Apr 13 16:30:50 user nova-compute[71731]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 16:30:50 user nova-compute[71731]:       <entry name="product">OpenStack Nova</entry>
Apr 13 16:30:50 user nova-compute[71731]:       <entry name="version">0.0.0</entry>
Apr 13 16:30:50 user nova-compute[71731]:       <entry name="serial">03200054-c651-4333-acce-3bea3defe22a</entry>
Apr 13 16:30:50 user nova-compute[71731]:       <entry name="uuid">03200054-c651-4333-acce-3bea3defe22a</entry>
Apr 13 16:30:50 user nova-compute[71731]:       <entry name="family">Virtual Machine</entry>
Apr 13 16:30:50 user nova-compute[71731]:     </system>
Apr 13 16:30:50 user nova-compute[71731]:   </sysinfo>
Apr 13 16:30:50 user nova-compute[71731]:   <os>
Apr 13 16:30:50 user nova-compute[71731]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 16:30:50 user nova-compute[71731]:     <boot dev="hd"/>
Apr 13 16:30:50 user nova-compute[71731]:     <smbios mode="sysinfo"/>
Apr 13 16:30:50 user nova-compute[71731]:   </os>
Apr 13 16:30:50 user nova-compute[71731]:   <features>
Apr 13 16:30:50 user nova-compute[71731]:     <acpi/>
Apr 13 16:30:50 user nova-compute[71731]:     <apic/>
Apr 13 16:30:50 user nova-compute[71731]:     <vmcoreinfo/>
Apr 13 16:30:50 user nova-compute[71731]:   </features>
Apr 13 16:30:50 user nova-compute[71731]:   <clock offset="utc">
Apr 13 16:30:50 user nova-compute[71731]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 16:30:50 user nova-compute[71731]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 16:30:50 user nova-compute[71731]:     <timer name="hpet" present="no"/>
Apr 13 16:30:50 user nova-compute[71731]:   </clock>
Apr 13 16:30:50 user nova-compute[71731]:   <cpu mode="custom" match="exact">
Apr 13 16:30:50 user nova-compute[71731]:     <model>Nehalem</model>
Apr 13 16:30:50 user nova-compute[71731]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 16:30:50 user nova-compute[71731]:   </cpu>
Apr 13 16:30:50 user nova-compute[71731]:   <devices>
Apr 13 16:30:50 user nova-compute[71731]:     <disk type="block" device="disk">
Apr 13 16:30:50 user nova-compute[71731]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 16:30:50 user nova-compute[71731]:       <source dev="/dev/sdb"/>
Apr 13 16:30:50 user nova-compute[71731]:       <target dev="vda" bus="virtio"/>
Apr 13 16:30:50 user nova-compute[71731]:       <serial>c2088266-1d33-4bb1-ac5b-1de832ff7985</serial>
Apr 13 16:30:50 user nova-compute[71731]:     </disk>
Apr 13 16:30:50 user nova-compute[71731]:     <interface type="ethernet">
Apr 13 16:30:50 user nova-compute[71731]:       <mac address="fa:16:3e:e7:02:ec"/>
Apr 13 16:30:50 user nova-compute[71731]:       <model type="virtio"/>
Apr 13 16:30:50 user nova-compute[71731]:       <mtu size="1442"/>
Apr 13 16:30:50 user nova-compute[71731]:       <target dev="tapb40a4a40-0a"/>
Apr 13 16:30:50 user nova-compute[71731]:     </interface>
Apr 13 16:30:50 user nova-compute[71731]:     <serial type="pty">
Apr 13 16:30:50 user nova-compute[71731]:       <log file="/opt/stack/data/nova/instances/03200054-c651-4333-acce-3bea3defe22a/console.log" append="off"/>
Apr 13 16:30:50 user nova-compute[71731]:     </serial>
Apr 13 16:30:50 user nova-compute[71731]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 16:30:50 user nova-compute[71731]:     <video>
Apr 13 16:30:50 user nova-compute[71731]:       <model type="virtio"/>
Apr 13 16:30:50 user nova-compute[71731]:     </video>
Apr 13 16:30:50 user nova-compute[71731]:     <rng model="virtio">
Apr 13 16:30:50 user nova-compute[71731]:       <backend model="random">/dev/urandom</backend>
Apr 13 16:30:50 user nova-compute[71731]:     </rng>
Apr 13 16:30:50 user nova-compute[71731]:     <controller type="usb" index="0" model="none"/>
Apr 13 16:30:50 user nova-compute[71731]:     <memballoon model="virtio">
Apr 13 16:30:50 user nova-compute[71731]:       <stats period="10"/>
Apr 13 16:30:50 user nova-compute[71731]:     </memballoon>
Apr 13 16:30:50 user nova-compute[71731]:   </devices>
Apr 13 16:30:50 user nova-compute[71731]: </domain>
Apr 13 16:30:50 user nova-compute[71731]:  {{(pid=71731) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 16:30:50 user nova-compute[71731]: DEBUG nova.virt.libvirt.vif [None req-69ee0e73-9794-415c-a1cf-a95d8d739e7c tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T16:30:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1444057207',display_name='tempest-TestVolumeBootPattern-server-1444057207',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1444057207',id=26,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIspJuW0ouAVIXdRkaEFP67MIl/YPuQkC9G3HjohNK4Y6ERboR/Jfb2q58aDhzUN+56TLqbLCfdFh2NtWLgvjHOwe+zpPoSYOKAkWLX+NSuU860pg4Djj9vwVgJj/Bkydw==',key_name='tempest-TestVolumeBootPattern-1747083001',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8d451e0e239f486aa2b3abe9e273eab3',ramdisk_id='',reservation_id='r-d39s4kc5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-438786227',owner_user_name='tempest-TestVolumeBootPattern-438786227-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T16:30:44Z,user_data=None,user_id='d70e10f63cdd49a9a1ebe1fe4c9de0a2',uuid=03200054-c651-4333-acce-3bea3defe22a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b40a4a40-0a9a-42f8-8d44-41bf4042454b", "address": "fa:16:3e:e7:02:ec", "network": {"id": "d36bc206-f629-4d6e-8a3f-458061d7b525", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-893271134-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d451e0e239f486aa2b3abe9e273eab3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb40a4a40-0a", "ovs_interfaceid": "b40a4a40-0a9a-42f8-8d44-41bf4042454b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 16:30:50 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-69ee0e73-9794-415c-a1cf-a95d8d739e7c tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Converting VIF {"id": "b40a4a40-0a9a-42f8-8d44-41bf4042454b", "address": "fa:16:3e:e7:02:ec", "network": {"id": "d36bc206-f629-4d6e-8a3f-458061d7b525", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-893271134-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d451e0e239f486aa2b3abe9e273eab3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb40a4a40-0a", "ovs_interfaceid": "b40a4a40-0a9a-42f8-8d44-41bf4042454b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 16:30:50 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-69ee0e73-9794-415c-a1cf-a95d8d739e7c tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:02:ec,bridge_name='br-int',has_traffic_filtering=True,id=b40a4a40-0a9a-42f8-8d44-41bf4042454b,network=Network(d36bc206-f629-4d6e-8a3f-458061d7b525),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb40a4a40-0a') {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 16:30:50 user nova-compute[71731]: DEBUG os_vif [None req-69ee0e73-9794-415c-a1cf-a95d8d739e7c tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:02:ec,bridge_name='br-int',has_traffic_filtering=True,id=b40a4a40-0a9a-42f8-8d44-41bf4042454b,network=Network(d36bc206-f629-4d6e-8a3f-458061d7b525),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb40a4a40-0a') {{(pid=71731) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 16:30:50 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:30:50 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:30:50 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 16:30:50 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:30:50 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb40a4a40-0a, may_exist=True) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:30:50 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb40a4a40-0a, col_values=(('external_ids', {'iface-id': 'b40a4a40-0a9a-42f8-8d44-41bf4042454b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e7:02:ec', 'vm-uuid': '03200054-c651-4333-acce-3bea3defe22a'}),)) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:30:50 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:30:50 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 16:30:50 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:30:50 user nova-compute[71731]: INFO os_vif [None req-69ee0e73-9794-415c-a1cf-a95d8d739e7c tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:02:ec,bridge_name='br-int',has_traffic_filtering=True,id=b40a4a40-0a9a-42f8-8d44-41bf4042454b,network=Network(d36bc206-f629-4d6e-8a3f-458061d7b525),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb40a4a40-0a')
Apr 13 16:30:50 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-69ee0e73-9794-415c-a1cf-a95d8d739e7c tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] No BDM found with device name vda, not building metadata. {{(pid=71731) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 16:30:50 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-69ee0e73-9794-415c-a1cf-a95d8d739e7c tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] No VIF found with MAC fa:16:3e:e7:02:ec, not building metadata {{(pid=71731) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 16:30:51 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:30:51 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:30:51 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:30:51 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:30:52 user nova-compute[71731]: DEBUG nova.compute.manager [req-560cad9d-05e2-442c-a00f-13b7e4283147 req-502839c3-9d51-4f9a-8c73-6d6ddf160e07 service nova] [instance: 03200054-c651-4333-acce-3bea3defe22a] Received event network-vif-plugged-b40a4a40-0a9a-42f8-8d44-41bf4042454b {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:30:52 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-560cad9d-05e2-442c-a00f-13b7e4283147 req-502839c3-9d51-4f9a-8c73-6d6ddf160e07 service nova] Acquiring lock "03200054-c651-4333-acce-3bea3defe22a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:30:52 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-560cad9d-05e2-442c-a00f-13b7e4283147 req-502839c3-9d51-4f9a-8c73-6d6ddf160e07 service nova] Lock "03200054-c651-4333-acce-3bea3defe22a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:30:52 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-560cad9d-05e2-442c-a00f-13b7e4283147 req-502839c3-9d51-4f9a-8c73-6d6ddf160e07 service nova] Lock "03200054-c651-4333-acce-3bea3defe22a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:30:52 user nova-compute[71731]: DEBUG nova.compute.manager [req-560cad9d-05e2-442c-a00f-13b7e4283147 req-502839c3-9d51-4f9a-8c73-6d6ddf160e07 service nova] [instance: 03200054-c651-4333-acce-3bea3defe22a] No waiting events found dispatching network-vif-plugged-b40a4a40-0a9a-42f8-8d44-41bf4042454b {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:30:52 user nova-compute[71731]: WARNING nova.compute.manager [req-560cad9d-05e2-442c-a00f-13b7e4283147 req-502839c3-9d51-4f9a-8c73-6d6ddf160e07 service nova] [instance: 03200054-c651-4333-acce-3bea3defe22a] Received unexpected event network-vif-plugged-b40a4a40-0a9a-42f8-8d44-41bf4042454b for instance with vm_state building and task_state spawning.
Apr 13 16:30:52 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:30:52 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:30:52 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:30:52 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:30:52 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:30:53 user nova-compute[71731]: DEBUG nova.virt.driver [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Emitting event <LifecycleEvent: 1681403453.9949822, 03200054-c651-4333-acce-3bea3defe22a => Resumed> {{(pid=71731) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 16:30:53 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 03200054-c651-4333-acce-3bea3defe22a] VM Resumed (Lifecycle Event)
Apr 13 16:30:53 user nova-compute[71731]: DEBUG nova.compute.manager [None req-69ee0e73-9794-415c-a1cf-a95d8d739e7c tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 03200054-c651-4333-acce-3bea3defe22a] Instance event wait completed in 0 seconds for  {{(pid=71731) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 16:30:53 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-69ee0e73-9794-415c-a1cf-a95d8d739e7c tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 03200054-c651-4333-acce-3bea3defe22a] Guest created on hypervisor {{(pid=71731) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 16:30:54 user nova-compute[71731]: INFO nova.virt.libvirt.driver [-] [instance: 03200054-c651-4333-acce-3bea3defe22a] Instance spawned successfully.
Apr 13 16:30:54 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-69ee0e73-9794-415c-a1cf-a95d8d739e7c tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 03200054-c651-4333-acce-3bea3defe22a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 16:30:54 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 03200054-c651-4333-acce-3bea3defe22a] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:30:54 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 03200054-c651-4333-acce-3bea3defe22a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71731) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 16:30:54 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-69ee0e73-9794-415c-a1cf-a95d8d739e7c tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 03200054-c651-4333-acce-3bea3defe22a] Found default for hw_cdrom_bus of ide {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:30:54 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-69ee0e73-9794-415c-a1cf-a95d8d739e7c tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 03200054-c651-4333-acce-3bea3defe22a] Found default for hw_disk_bus of virtio {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:30:54 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-69ee0e73-9794-415c-a1cf-a95d8d739e7c tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 03200054-c651-4333-acce-3bea3defe22a] Found default for hw_input_bus of None {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:30:54 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-69ee0e73-9794-415c-a1cf-a95d8d739e7c tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 03200054-c651-4333-acce-3bea3defe22a] Found default for hw_pointer_model of None {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:30:54 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-69ee0e73-9794-415c-a1cf-a95d8d739e7c tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 03200054-c651-4333-acce-3bea3defe22a] Found default for hw_video_model of virtio {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:30:54 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-69ee0e73-9794-415c-a1cf-a95d8d739e7c tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 03200054-c651-4333-acce-3bea3defe22a] Found default for hw_vif_model of virtio {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:30:54 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 03200054-c651-4333-acce-3bea3defe22a] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 16:30:54 user nova-compute[71731]: DEBUG nova.virt.driver [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Emitting event <LifecycleEvent: 1681403453.9961314, 03200054-c651-4333-acce-3bea3defe22a => Started> {{(pid=71731) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 16:30:54 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 03200054-c651-4333-acce-3bea3defe22a] VM Started (Lifecycle Event)
Apr 13 16:30:54 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 03200054-c651-4333-acce-3bea3defe22a] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:30:54 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 03200054-c651-4333-acce-3bea3defe22a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71731) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 16:30:54 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 03200054-c651-4333-acce-3bea3defe22a] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 16:30:54 user nova-compute[71731]: INFO nova.compute.manager [None req-69ee0e73-9794-415c-a1cf-a95d8d739e7c tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 03200054-c651-4333-acce-3bea3defe22a] Took 4.87 seconds to spawn the instance on the hypervisor.
Apr 13 16:30:54 user nova-compute[71731]: DEBUG nova.compute.manager [None req-69ee0e73-9794-415c-a1cf-a95d8d739e7c tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 03200054-c651-4333-acce-3bea3defe22a] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:30:54 user nova-compute[71731]: INFO nova.compute.manager [None req-69ee0e73-9794-415c-a1cf-a95d8d739e7c tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 03200054-c651-4333-acce-3bea3defe22a] Took 10.60 seconds to build instance.
Apr 13 16:30:54 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-69ee0e73-9794-415c-a1cf-a95d8d739e7c tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "03200054-c651-4333-acce-3bea3defe22a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.696s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:30:54 user nova-compute[71731]: DEBUG nova.compute.manager [req-bb5600a4-feae-400e-ac22-cb19748f7429 req-5b13243e-e4db-4f54-847b-5f42b972eb66 service nova] [instance: 03200054-c651-4333-acce-3bea3defe22a] Received event network-vif-plugged-b40a4a40-0a9a-42f8-8d44-41bf4042454b {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:30:54 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-bb5600a4-feae-400e-ac22-cb19748f7429 req-5b13243e-e4db-4f54-847b-5f42b972eb66 service nova] Acquiring lock "03200054-c651-4333-acce-3bea3defe22a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:30:54 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-bb5600a4-feae-400e-ac22-cb19748f7429 req-5b13243e-e4db-4f54-847b-5f42b972eb66 service nova] Lock "03200054-c651-4333-acce-3bea3defe22a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:30:54 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-bb5600a4-feae-400e-ac22-cb19748f7429 req-5b13243e-e4db-4f54-847b-5f42b972eb66 service nova] Lock "03200054-c651-4333-acce-3bea3defe22a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:30:54 user nova-compute[71731]: DEBUG nova.compute.manager [req-bb5600a4-feae-400e-ac22-cb19748f7429 req-5b13243e-e4db-4f54-847b-5f42b972eb66 service nova] [instance: 03200054-c651-4333-acce-3bea3defe22a] No waiting events found dispatching network-vif-plugged-b40a4a40-0a9a-42f8-8d44-41bf4042454b {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:30:54 user nova-compute[71731]: WARNING nova.compute.manager [req-bb5600a4-feae-400e-ac22-cb19748f7429 req-5b13243e-e4db-4f54-847b-5f42b972eb66 service nova] [instance: 03200054-c651-4333-acce-3bea3defe22a] Received unexpected event network-vif-plugged-b40a4a40-0a9a-42f8-8d44-41bf4042454b for instance with vm_state active and task_state None.
Apr 13 16:30:55 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:30:56 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:30:58 user nova-compute[71731]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681403443.279771, 5d50f597-3a29-4335-8166-6ab8e8149376 => Stopped> {{(pid=71731) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 16:30:58 user nova-compute[71731]: INFO nova.compute.manager [-] [instance: 5d50f597-3a29-4335-8166-6ab8e8149376] VM Stopped (Lifecycle Event)
Apr 13 16:30:58 user nova-compute[71731]: DEBUG nova.compute.manager [None req-41ac6b89-16fe-40a4-8241-9c5073fc59d2 None None] [instance: 5d50f597-3a29-4335-8166-6ab8e8149376] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:31:00 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:31:05 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 16:31:06 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:31:06 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-2e0a7286-20ea-48c6-8aca-7f816ea381bb tempest-VolumesNegativeTest-1740638080 tempest-VolumesNegativeTest-1740638080-project-member] Acquiring lock "71a2163b-fb6b-4b71-b93f-d682ad141b84" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:31:06 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-2e0a7286-20ea-48c6-8aca-7f816ea381bb tempest-VolumesNegativeTest-1740638080 tempest-VolumesNegativeTest-1740638080-project-member] Lock "71a2163b-fb6b-4b71-b93f-d682ad141b84" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:31:06 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-2e0a7286-20ea-48c6-8aca-7f816ea381bb tempest-VolumesNegativeTest-1740638080 tempest-VolumesNegativeTest-1740638080-project-member] Acquiring lock "71a2163b-fb6b-4b71-b93f-d682ad141b84-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:31:06 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-2e0a7286-20ea-48c6-8aca-7f816ea381bb tempest-VolumesNegativeTest-1740638080 tempest-VolumesNegativeTest-1740638080-project-member] Lock "71a2163b-fb6b-4b71-b93f-d682ad141b84-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:31:06 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-2e0a7286-20ea-48c6-8aca-7f816ea381bb tempest-VolumesNegativeTest-1740638080 tempest-VolumesNegativeTest-1740638080-project-member] Lock "71a2163b-fb6b-4b71-b93f-d682ad141b84-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:31:06 user nova-compute[71731]: INFO nova.compute.manager [None req-2e0a7286-20ea-48c6-8aca-7f816ea381bb tempest-VolumesNegativeTest-1740638080 tempest-VolumesNegativeTest-1740638080-project-member] [instance: 71a2163b-fb6b-4b71-b93f-d682ad141b84] Terminating instance
Apr 13 16:31:06 user nova-compute[71731]: DEBUG nova.compute.manager [None req-2e0a7286-20ea-48c6-8aca-7f816ea381bb tempest-VolumesNegativeTest-1740638080 tempest-VolumesNegativeTest-1740638080-project-member] [instance: 71a2163b-fb6b-4b71-b93f-d682ad141b84] Start destroying the instance on the hypervisor. {{(pid=71731) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 16:31:07 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:31:07 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:31:07 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:31:07 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:31:07 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:31:07 user nova-compute[71731]: DEBUG nova.compute.manager [req-88228ecb-7b91-462e-b27d-64e2448b54bc req-f0d0c791-4dc0-4486-a193-d2495cdb864e service nova] [instance: 71a2163b-fb6b-4b71-b93f-d682ad141b84] Received event network-vif-unplugged-da3b7e52-803c-4172-a058-238c8dcedbbc {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:31:07 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-88228ecb-7b91-462e-b27d-64e2448b54bc req-f0d0c791-4dc0-4486-a193-d2495cdb864e service nova] Acquiring lock "71a2163b-fb6b-4b71-b93f-d682ad141b84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:31:07 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-88228ecb-7b91-462e-b27d-64e2448b54bc req-f0d0c791-4dc0-4486-a193-d2495cdb864e service nova] Lock "71a2163b-fb6b-4b71-b93f-d682ad141b84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:31:07 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-88228ecb-7b91-462e-b27d-64e2448b54bc req-f0d0c791-4dc0-4486-a193-d2495cdb864e service nova] Lock "71a2163b-fb6b-4b71-b93f-d682ad141b84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:31:07 user nova-compute[71731]: DEBUG nova.compute.manager [req-88228ecb-7b91-462e-b27d-64e2448b54bc req-f0d0c791-4dc0-4486-a193-d2495cdb864e service nova] [instance: 71a2163b-fb6b-4b71-b93f-d682ad141b84] No waiting events found dispatching network-vif-unplugged-da3b7e52-803c-4172-a058-238c8dcedbbc {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:31:07 user nova-compute[71731]: DEBUG nova.compute.manager [req-88228ecb-7b91-462e-b27d-64e2448b54bc req-f0d0c791-4dc0-4486-a193-d2495cdb864e service nova] [instance: 71a2163b-fb6b-4b71-b93f-d682ad141b84] Received event network-vif-unplugged-da3b7e52-803c-4172-a058-238c8dcedbbc for instance with task_state deleting. {{(pid=71731) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 16:31:07 user nova-compute[71731]: INFO nova.virt.libvirt.driver [-] [instance: 71a2163b-fb6b-4b71-b93f-d682ad141b84] Instance destroyed successfully.
Apr 13 16:31:07 user nova-compute[71731]: DEBUG nova.objects.instance [None req-2e0a7286-20ea-48c6-8aca-7f816ea381bb tempest-VolumesNegativeTest-1740638080 tempest-VolumesNegativeTest-1740638080-project-member] Lazy-loading 'resources' on Instance uuid 71a2163b-fb6b-4b71-b93f-d682ad141b84 {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:31:07 user nova-compute[71731]: DEBUG nova.virt.libvirt.vif [None req-2e0a7286-20ea-48c6-8aca-7f816ea381bb tempest-VolumesNegativeTest-1740638080 tempest-VolumesNegativeTest-1740638080-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T16:29:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1825993154',display_name='tempest-VolumesNegativeTest-instance-1825993154',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1825993154',id=25,image_ref='708622a9-7465-4492-ade8-b827198f7e30',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-13T16:29:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c33101d535154c9a88cae865ee7ece46',ramdisk_id='',reservation_id='r-0n3u33k0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='708622a9-7465-4492-ade8-b827198f7e30',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-1740638080',owner_user_name='tempest-VolumesNegativeTest-1740638080-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T16:29:23Z,user_data=None,user_id='d7f9678e69654526b4d5dc9de05ac090',uuid=71a2163b-fb6b-4b71-b93f-d682ad141b84,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "da3b7e52-803c-4172-a058-238c8dcedbbc", "address": "fa:16:3e:9d:68:b6", "network": {"id": "0f6e6e5d-9902-4827-9e2c-50065c0fe402", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.212", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "0b29a975c552465aba0ac7d6288434bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda3b7e52-80", "ovs_interfaceid": "da3b7e52-803c-4172-a058-238c8dcedbbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 16:31:07 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-2e0a7286-20ea-48c6-8aca-7f816ea381bb tempest-VolumesNegativeTest-1740638080 tempest-VolumesNegativeTest-1740638080-project-member] Converting VIF {"id": "da3b7e52-803c-4172-a058-238c8dcedbbc", "address": "fa:16:3e:9d:68:b6", "network": {"id": "0f6e6e5d-9902-4827-9e2c-50065c0fe402", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.212", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "0b29a975c552465aba0ac7d6288434bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda3b7e52-80", "ovs_interfaceid": "da3b7e52-803c-4172-a058-238c8dcedbbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 16:31:07 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-2e0a7286-20ea-48c6-8aca-7f816ea381bb tempest-VolumesNegativeTest-1740638080 tempest-VolumesNegativeTest-1740638080-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9d:68:b6,bridge_name='br-int',has_traffic_filtering=True,id=da3b7e52-803c-4172-a058-238c8dcedbbc,network=Network(0f6e6e5d-9902-4827-9e2c-50065c0fe402),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda3b7e52-80') {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 16:31:07 user nova-compute[71731]: DEBUG os_vif [None req-2e0a7286-20ea-48c6-8aca-7f816ea381bb tempest-VolumesNegativeTest-1740638080 tempest-VolumesNegativeTest-1740638080-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9d:68:b6,bridge_name='br-int',has_traffic_filtering=True,id=da3b7e52-803c-4172-a058-238c8dcedbbc,network=Network(0f6e6e5d-9902-4827-9e2c-50065c0fe402),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda3b7e52-80') {{(pid=71731) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 16:31:07 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:31:07 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapda3b7e52-80, bridge=br-int, if_exists=True) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:31:07 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:31:07 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 16:31:07 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:31:07 user nova-compute[71731]: INFO os_vif [None req-2e0a7286-20ea-48c6-8aca-7f816ea381bb tempest-VolumesNegativeTest-1740638080 tempest-VolumesNegativeTest-1740638080-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9d:68:b6,bridge_name='br-int',has_traffic_filtering=True,id=da3b7e52-803c-4172-a058-238c8dcedbbc,network=Network(0f6e6e5d-9902-4827-9e2c-50065c0fe402),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda3b7e52-80')
Apr 13 16:31:07 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-2e0a7286-20ea-48c6-8aca-7f816ea381bb tempest-VolumesNegativeTest-1740638080 tempest-VolumesNegativeTest-1740638080-project-member] [instance: 71a2163b-fb6b-4b71-b93f-d682ad141b84] Deleting instance files /opt/stack/data/nova/instances/71a2163b-fb6b-4b71-b93f-d682ad141b84_del
Apr 13 16:31:07 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-2e0a7286-20ea-48c6-8aca-7f816ea381bb tempest-VolumesNegativeTest-1740638080 tempest-VolumesNegativeTest-1740638080-project-member] [instance: 71a2163b-fb6b-4b71-b93f-d682ad141b84] Deletion of /opt/stack/data/nova/instances/71a2163b-fb6b-4b71-b93f-d682ad141b84_del complete
Apr 13 16:31:07 user nova-compute[71731]: INFO nova.compute.manager [None req-2e0a7286-20ea-48c6-8aca-7f816ea381bb tempest-VolumesNegativeTest-1740638080 tempest-VolumesNegativeTest-1740638080-project-member] [instance: 71a2163b-fb6b-4b71-b93f-d682ad141b84] Took 0.90 seconds to destroy the instance on the hypervisor.
Apr 13 16:31:07 user nova-compute[71731]: DEBUG oslo.service.loopingcall [None req-2e0a7286-20ea-48c6-8aca-7f816ea381bb tempest-VolumesNegativeTest-1740638080 tempest-VolumesNegativeTest-1740638080-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71731) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 16:31:07 user nova-compute[71731]: DEBUG nova.compute.manager [-] [instance: 71a2163b-fb6b-4b71-b93f-d682ad141b84] Deallocating network for instance {{(pid=71731) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 16:31:07 user nova-compute[71731]: DEBUG nova.network.neutron [-] [instance: 71a2163b-fb6b-4b71-b93f-d682ad141b84] deallocate_for_instance() {{(pid=71731) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 16:31:08 user nova-compute[71731]: DEBUG nova.network.neutron [-] [instance: 71a2163b-fb6b-4b71-b93f-d682ad141b84] Updating instance_info_cache with network_info: [] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:31:08 user nova-compute[71731]: INFO nova.compute.manager [-] [instance: 71a2163b-fb6b-4b71-b93f-d682ad141b84] Took 0.50 seconds to deallocate network for instance.
Apr 13 16:31:08 user nova-compute[71731]: DEBUG nova.compute.manager [req-bb5c0815-110d-472b-99ae-87b05a4a446b req-96084f46-401a-4471-9a25-ecd436ea8abd service nova] [instance: 71a2163b-fb6b-4b71-b93f-d682ad141b84] Received event network-vif-deleted-da3b7e52-803c-4172-a058-238c8dcedbbc {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:31:08 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-2e0a7286-20ea-48c6-8aca-7f816ea381bb tempest-VolumesNegativeTest-1740638080 tempest-VolumesNegativeTest-1740638080-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:31:08 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-2e0a7286-20ea-48c6-8aca-7f816ea381bb tempest-VolumesNegativeTest-1740638080 tempest-VolumesNegativeTest-1740638080-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:31:08 user nova-compute[71731]: DEBUG nova.compute.provider_tree [None req-2e0a7286-20ea-48c6-8aca-7f816ea381bb tempest-VolumesNegativeTest-1740638080 tempest-VolumesNegativeTest-1740638080-project-member] Inventory has not changed in ProviderTree for provider: cb6b1a64-0c24-4e2d-af1e-16576ca9165c {{(pid=71731) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 16:31:08 user nova-compute[71731]: DEBUG nova.scheduler.client.report [None req-2e0a7286-20ea-48c6-8aca-7f816ea381bb tempest-VolumesNegativeTest-1740638080 tempest-VolumesNegativeTest-1740638080-project-member] Inventory has not changed for provider cb6b1a64-0c24-4e2d-af1e-16576ca9165c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71731) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 16:31:08 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-2e0a7286-20ea-48c6-8aca-7f816ea381bb tempest-VolumesNegativeTest-1740638080 tempest-VolumesNegativeTest-1740638080-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.279s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:31:08 user nova-compute[71731]: INFO nova.scheduler.client.report [None req-2e0a7286-20ea-48c6-8aca-7f816ea381bb tempest-VolumesNegativeTest-1740638080 tempest-VolumesNegativeTest-1740638080-project-member] Deleted allocations for instance 71a2163b-fb6b-4b71-b93f-d682ad141b84
Apr 13 16:31:08 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-2e0a7286-20ea-48c6-8aca-7f816ea381bb tempest-VolumesNegativeTest-1740638080 tempest-VolumesNegativeTest-1740638080-project-member] Lock "71a2163b-fb6b-4b71-b93f-d682ad141b84" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.894s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:31:09 user nova-compute[71731]: DEBUG nova.compute.manager [req-0f33c503-8c39-49d6-9eac-12abae51c37c req-10fd4e84-4a1a-43f5-a907-0fbbef82beac service nova] [instance: 71a2163b-fb6b-4b71-b93f-d682ad141b84] Received event network-vif-plugged-da3b7e52-803c-4172-a058-238c8dcedbbc {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:31:09 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-0f33c503-8c39-49d6-9eac-12abae51c37c req-10fd4e84-4a1a-43f5-a907-0fbbef82beac service nova] Acquiring lock "71a2163b-fb6b-4b71-b93f-d682ad141b84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:31:09 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-0f33c503-8c39-49d6-9eac-12abae51c37c req-10fd4e84-4a1a-43f5-a907-0fbbef82beac service nova] Lock "71a2163b-fb6b-4b71-b93f-d682ad141b84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:31:09 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-0f33c503-8c39-49d6-9eac-12abae51c37c req-10fd4e84-4a1a-43f5-a907-0fbbef82beac service nova] Lock "71a2163b-fb6b-4b71-b93f-d682ad141b84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:31:09 user nova-compute[71731]: DEBUG nova.compute.manager [req-0f33c503-8c39-49d6-9eac-12abae51c37c req-10fd4e84-4a1a-43f5-a907-0fbbef82beac service nova] [instance: 71a2163b-fb6b-4b71-b93f-d682ad141b84] No waiting events found dispatching network-vif-plugged-da3b7e52-803c-4172-a058-238c8dcedbbc {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:31:09 user nova-compute[71731]: WARNING nova.compute.manager [req-0f33c503-8c39-49d6-9eac-12abae51c37c req-10fd4e84-4a1a-43f5-a907-0fbbef82beac service nova] [instance: 71a2163b-fb6b-4b71-b93f-d682ad141b84] Received unexpected event network-vif-plugged-da3b7e52-803c-4172-a058-238c8dcedbbc for instance with vm_state deleted and task_state None.
Apr 13 16:31:11 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:31:12 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:31:12 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:31:13 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager.update_available_resource {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:31:13 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:31:13 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:31:13 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:31:13 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Auditing locally available compute resources for user (node: user) {{(pid=71731) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 16:31:13 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acbcaee0-a47b-4fee-8765-9b1c9597d515/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:31:13 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acbcaee0-a47b-4fee-8765-9b1c9597d515/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:31:13 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acbcaee0-a47b-4fee-8765-9b1c9597d515/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:31:13 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acbcaee0-a47b-4fee-8765-9b1c9597d515/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:31:13 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66553f5-5e1b-4f1d-8c5a-63bc340f7586/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:31:13 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66553f5-5e1b-4f1d-8c5a-63bc340f7586/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:31:13 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66553f5-5e1b-4f1d-8c5a-63bc340f7586/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:31:13 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66553f5-5e1b-4f1d-8c5a-63bc340f7586/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:31:13 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71731) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 16:31:13 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eaae47b9-a059-49f6-9ae6-d7147003e2f2/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:31:13 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eaae47b9-a059-49f6-9ae6-d7147003e2f2/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:31:13 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eaae47b9-a059-49f6-9ae6-d7147003e2f2/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:31:14 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eaae47b9-a059-49f6-9ae6-d7147003e2f2/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:31:14 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71731) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 16:31:14 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf98c3a2-dbeb-4ae4-8423-ce55964c4258/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:31:14 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf98c3a2-dbeb-4ae4-8423-ce55964c4258/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:31:14 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf98c3a2-dbeb-4ae4-8423-ce55964c4258/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:31:14 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf98c3a2-dbeb-4ae4-8423-ce55964c4258/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:31:14 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/650427bd-4dad-4bcd-922d-c17e60b36807/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:31:14 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/650427bd-4dad-4bcd-922d-c17e60b36807/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:31:14 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/650427bd-4dad-4bcd-922d-c17e60b36807/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:31:14 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/650427bd-4dad-4bcd-922d-c17e60b36807/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:31:14 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32b18558-8bf2-4def-bc70-81c4e38fcc6f/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:31:14 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32b18558-8bf2-4def-bc70-81c4e38fcc6f/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:31:14 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32b18558-8bf2-4def-bc70-81c4e38fcc6f/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:31:14 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32b18558-8bf2-4def-bc70-81c4e38fcc6f/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:31:15 user nova-compute[71731]: WARNING nova.virt.libvirt.driver [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 16:31:15 user nova-compute[71731]: WARNING nova.virt.libvirt.driver [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 16:31:15 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Hypervisor/Node resource view: name=user free_ram=7934MB free_disk=26.185989379882812GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71731) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 16:31:15 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:31:15 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:31:15 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance f66553f5-5e1b-4f1d-8c5a-63bc340f7586 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 16:31:15 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance 235f827c-7116-48e9-84c5-0c9761c18e1e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 16:31:15 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance acbcaee0-a47b-4fee-8765-9b1c9597d515 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 16:31:15 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance eaae47b9-a059-49f6-9ae6-d7147003e2f2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 16:31:15 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance bf98c3a2-dbeb-4ae4-8423-ce55964c4258 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 16:31:15 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance 32b18558-8bf2-4def-bc70-81c4e38fcc6f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 16:31:15 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance 650427bd-4dad-4bcd-922d-c17e60b36807 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 16:31:15 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance 03200054-c651-4333-acce-3bea3defe22a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 16:31:15 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=71731) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 16:31:15 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Final resource view: name=user phys_ram=16023MB used_ram=1536MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=71731) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 16:31:15 user nova-compute[71731]: DEBUG nova.compute.provider_tree [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Inventory has not changed in ProviderTree for provider: cb6b1a64-0c24-4e2d-af1e-16576ca9165c {{(pid=71731) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 16:31:15 user nova-compute[71731]: DEBUG nova.scheduler.client.report [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Inventory has not changed for provider cb6b1a64-0c24-4e2d-af1e-16576ca9165c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71731) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 16:31:15 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Compute_service record updated for user:user {{(pid=71731) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 16:31:15 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.378s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:31:15 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:31:16 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:31:16 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Starting heal instance info cache {{(pid=71731) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 16:31:16 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Didn't find any instances for network info cache update. {{(pid=71731) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 13 16:31:16 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:31:16 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:31:16 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:31:16 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71731) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 16:31:16 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:31:16 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Cleaning up deleted instances {{(pid=71731) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 13 16:31:16 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] There are 0 instances to clean {{(pid=71731) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 13 16:31:17 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:31:17 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:31:20 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:31:21 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:31:21 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:31:22 user nova-compute[71731]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681403467.6978514, 71a2163b-fb6b-4b71-b93f-d682ad141b84 => Stopped> {{(pid=71731) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 16:31:22 user nova-compute[71731]: INFO nova.compute.manager [-] [instance: 71a2163b-fb6b-4b71-b93f-d682ad141b84] VM Stopped (Lifecycle Event)
Apr 13 16:31:22 user nova-compute[71731]: DEBUG nova.compute.manager [None req-a61ce8db-81ab-4abe-83f3-de3311c8d261 None None] [instance: 71a2163b-fb6b-4b71-b93f-d682ad141b84] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:31:22 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:31:27 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:31:27 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Cleaning up deleted instances with incomplete migration  {{(pid=71731) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 13 16:31:27 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:31:32 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:31:32 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-067eaca3-baf6-4dbc-a381-07a5d6009e5b tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Acquiring lock "bf98c3a2-dbeb-4ae4-8423-ce55964c4258" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:31:32 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-067eaca3-baf6-4dbc-a381-07a5d6009e5b tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Lock "bf98c3a2-dbeb-4ae4-8423-ce55964c4258" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:31:32 user nova-compute[71731]: DEBUG nova.objects.instance [None req-067eaca3-baf6-4dbc-a381-07a5d6009e5b tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Lazy-loading 'flavor' on Instance uuid bf98c3a2-dbeb-4ae4-8423-ce55964c4258 {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:31:32 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-067eaca3-baf6-4dbc-a381-07a5d6009e5b tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Lock "bf98c3a2-dbeb-4ae4-8423-ce55964c4258" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:31:33 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-067eaca3-baf6-4dbc-a381-07a5d6009e5b tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Acquiring lock "bf98c3a2-dbeb-4ae4-8423-ce55964c4258" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:31:33 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-067eaca3-baf6-4dbc-a381-07a5d6009e5b tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Lock "bf98c3a2-dbeb-4ae4-8423-ce55964c4258" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:31:33 user nova-compute[71731]: INFO nova.compute.manager [None req-067eaca3-baf6-4dbc-a381-07a5d6009e5b tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] [instance: bf98c3a2-dbeb-4ae4-8423-ce55964c4258] Attaching volume 6bdf834e-4cc1-4a8e-850c-84ce4564c544 to /dev/vdb
Apr 13 16:31:33 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:31:33 user nova-compute[71731]: DEBUG os_brick.utils [None req-067eaca3-baf6-4dbc-a381-07a5d6009e5b tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 16:31:33 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:31:33 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:31:33 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca140b59-3f89-4e14-aac4-cbd5e0fcf211]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:81501d91421\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:31:33 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:31:33 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:31:33 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[b15dd394-664b-496b-b96e-133914b8e763]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:31:33 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:31:33 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:31:33 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[bec154f7-1cc0-4cb7-a278-a7287d6fa558]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:31:33 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b029fbd-3c0a-4afd-ac08-cff5bcc9b72b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:31:33 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-067eaca3-baf6-4dbc-a381-07a5d6009e5b tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Running cmd (subprocess): nvme version {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:31:33 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-067eaca3-baf6-4dbc-a381-07a5d6009e5b tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] 'nvme version' failed. Not Retrying. {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 16:31:33 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.nvmeof [None req-067eaca3-baf6-4dbc-a381-07a5d6009e5b tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] nvme not present on system {{(pid=71731) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 16:31:33 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:31:33 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 16:31:33 user nova-compute[71731]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 16:31:33 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[586ba217-27bb-463f-9f34-45d65a544f0a]: (4, '') {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:31:33 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.lightos [None req-067eaca3-baf6-4dbc-a381-07a5d6009e5b tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71731) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 16:31:33 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.lightos [None req-067eaca3-baf6-4dbc-a381-07a5d6009e5b tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71731) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 16:31:33 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.lightos [None req-067eaca3-baf6-4dbc-a381-07a5d6009e5b tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] LIGHTOS: no hostnqn found. {{(pid=71731) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 16:31:33 user nova-compute[71731]: DEBUG os_brick.utils [None req-067eaca3-baf6-4dbc-a381-07a5d6009e5b tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:81501d91421', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 16:31:33 user nova-compute[71731]: DEBUG nova.virt.block_device [None req-067eaca3-baf6-4dbc-a381-07a5d6009e5b tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] [instance: bf98c3a2-dbeb-4ae4-8423-ce55964c4258] Updating existing volume attachment record: 2707f246-e120-4120-b3d9-b08846a1b8b9 {{(pid=71731) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 16:31:36 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:31:37 user nova-compute[71731]: DEBUG nova.virt.libvirt.volume.iscsi [None req-067eaca3-baf6-4dbc-a381-07a5d6009e5b tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] [instance: bf98c3a2-dbeb-4ae4-8423-ce55964c4258] Calling os-brick to attach iSCSI Volume {{(pid=71731) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 16:31:37 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-067eaca3-baf6-4dbc-a381-07a5d6009e5b tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8cf0118790>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6bdf834e-4cc1-4a8e-850c-84ce4564c544', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DsXnfWuc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 16:31:37 user nova-compute[71731]: WARNING os_brick.initiator.connectors.base [None req-067eaca3-baf6-4dbc-a381-07a5d6009e5b tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 16:31:37 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-067eaca3-baf6-4dbc-a381-07a5d6009e5b tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 16:31:37 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-067eaca3-baf6-4dbc-a381-07a5d6009e5b tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 16:31:37 user nova-compute[71731]: WARNING os_brick.initiator.connectors.base [None req-067eaca3-baf6-4dbc-a381-07a5d6009e5b tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 16:31:37 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-067eaca3-baf6-4dbc-a381-07a5d6009e5b tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6bdf834e-4cc1-4a8e-850c-84ce4564c544" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 16:31:37 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-067eaca3-baf6-4dbc-a381-07a5d6009e5b tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6bdf834e-4cc1-4a8e-850c-84ce4564c544" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 16:31:37 user nova-compute[71731]: INFO os_brick.initiator.connectors.iscsi [None req-067eaca3-baf6-4dbc-a381-07a5d6009e5b tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 16:31:37 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6bdf834e-4cc1-4a8e-850c-84ce4564c544 -p 172.16.0.220:3260 {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:31:37 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6bdf834e-4cc1-4a8e-850c-84ce4564c544 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:31:37 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[641ac0bd-1476-45f5-bab4-8495063588a5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:31:37 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-067eaca3-baf6-4dbc-a381-07a5d6009e5b tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 16:31:37 user nova-compute[71731]:  {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:31:37 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6bdf834e-4cc1-4a8e-850c-84ce4564c544 -p 172.16.0.220:3260 --interface default --op new {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:31:37 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6bdf834e-4cc1-4a8e-850c-84ce4564c544 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:31:37 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[33915955-3d00-439e-a307-1b8c3fa03940]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6bdf834e-4cc1-4a8e-850c-84ce4564c544] added\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:31:37 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-067eaca3-baf6-4dbc-a381-07a5d6009e5b tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6bdf834e-4cc1-4a8e-850c-84ce4564c544] added
Apr 13 16:31:37 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:31:37 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6bdf834e-4cc1-4a8e-850c-84ce4564c544 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:31:37 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6bdf834e-4cc1-4a8e-850c-84ce4564c544 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:31:37 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[286ea3f3-ac0d-4b02-bfa8-95a348ba39fb]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:31:37 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-067eaca3-baf6-4dbc-a381-07a5d6009e5b tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:31:37 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6bdf834e-4cc1-4a8e-850c-84ce4564c544 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:31:37 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6bdf834e-4cc1-4a8e-850c-84ce4564c544 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:31:37 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[f799e5cb-f960-4d62-b52f-d5fa8f1125d0]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:31:37 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-067eaca3-baf6-4dbc-a381-07a5d6009e5b tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:31:37 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6bdf834e-4cc1-4a8e-850c-84ce4564c544 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DsXnfWuc {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:31:37 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:31:37 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6bdf834e-4cc1-4a8e-850c-84ce4564c544 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DsXnfWuc" returned: 0 in 0.019s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:31:37 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[d32c48d3-6924-4c2f-979f-4918372bb15f]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:31:37 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-067eaca3-baf6-4dbc-a381-07a5d6009e5b tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DsXnfWuc'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:31:37 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6bdf834e-4cc1-4a8e-850c-84ce4564c544 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:31:37 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6bdf834e-4cc1-4a8e-850c-84ce4564c544 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.028s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:31:37 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[37052e5c-4904-4d06-9214-2e81aa1065aa]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:31:37 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-067eaca3-baf6-4dbc-a381-07a5d6009e5b tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:31:37 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:31:37 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:31:37 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1bae7e1-3620-4725-a74a-7b7065be9887]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2088266-1d33-4bb1-ac5b-1de832ff7985 (non-flash)\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:31:37 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-067eaca3-baf6-4dbc-a381-07a5d6009e5b tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)
Apr 13 16:31:37 user nova-compute[71731]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2088266-1d33-4bb1-ac5b-1de832ff7985 (non-flash)
Apr 13 16:31:37 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 16:31:37 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-067eaca3-baf6-4dbc-a381-07a5d6009e5b tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)
Apr 13 16:31:37 user nova-compute[71731]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2088266-1d33-4bb1-ac5b-1de832ff7985 (non-flash)
Apr 13 16:31:37 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 16:31:37 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6bdf834e-4cc1-4a8e-850c-84ce4564c544 -p 172.16.0.220:3260 --login {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:31:37 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6bdf834e-4cc1-4a8e-850c-84ce4564c544 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:31:37 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[c065b8c5-75fc-455b-94be-0d53605bf753]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6bdf834e-4cc1-4a8e-850c-84ce4564c544, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6bdf834e-4cc1-4a8e-850c-84ce4564c544, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:31:37 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-067eaca3-baf6-4dbc-a381-07a5d6009e5b tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6bdf834e-4cc1-4a8e-850c-84ce4564c544, portal: 172.16.0.220,3260]
Apr 13 16:31:37 user nova-compute[71731]: Login to [iface: default, target: iqn.2010-10.org.openstack:6bdf834e-4cc1-4a8e-850c-84ce4564c544, portal: 172.16.0.220,3260] successful.
Apr 13 16:31:37 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:31:37 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6bdf834e-4cc1-4a8e-850c-84ce4564c544 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:31:37 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6bdf834e-4cc1-4a8e-850c-84ce4564c544 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:31:37 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1bc06db-1c44-49e4-9f4e-80a6c3697f14]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:31:37 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-067eaca3-baf6-4dbc-a381-07a5d6009e5b tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:31:37 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:31:37 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:31:37 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[62c0dcef-eb4c-4db8-b60f-09659434eda2]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2088266-1d33-4bb1-ac5b-1de832ff7985 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bdf834e-4cc1-4a8e-850c-84ce4564c544 (non-flash)\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:31:37 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-067eaca3-baf6-4dbc-a381-07a5d6009e5b tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)
Apr 13 16:31:37 user nova-compute[71731]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2088266-1d33-4bb1-ac5b-1de832ff7985 (non-flash)
Apr 13 16:31:37 user nova-compute[71731]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bdf834e-4cc1-4a8e-850c-84ce4564c544 (non-flash)
Apr 13 16:31:37 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 16:31:37 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-067eaca3-baf6-4dbc-a381-07a5d6009e5b tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)
Apr 13 16:31:37 user nova-compute[71731]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2088266-1d33-4bb1-ac5b-1de832ff7985 (non-flash)
Apr 13 16:31:37 user nova-compute[71731]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bdf834e-4cc1-4a8e-850c-84ce4564c544 (non-flash)
Apr 13 16:31:37 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 16:31:37 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-067eaca3-baf6-4dbc-a381-07a5d6009e5b tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6bdf834e-4cc1-4a8e-850c-84ce4564c544" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.297s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 16:31:37 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-067eaca3-baf6-4dbc-a381-07a5d6009e5b tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Connected to 172.16.0.220:3260 {{(pid=71731) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 16:31:37 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-067eaca3-baf6-4dbc-a381-07a5d6009e5b tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] HCTL ('35', '-', '-', 0) found on session 31 with lun 0 {{(pid=71731) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 16:31:37 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-067eaca3-baf6-4dbc-a381-07a5d6009e5b tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=71731) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 16:31:37 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:31:37 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:31:37 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[14fe1d55-8c58-4b10-81b3-7bdad7ec6a51]: (4, ('- - 0', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:31:37 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-067eaca3-baf6-4dbc-a381-07a5d6009e5b tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Searching for a device in session 31 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=71731) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 16:31:37 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-067eaca3-baf6-4dbc-a381-07a5d6009e5b tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:6bdf834e-4cc1-4a8e-850c-84ce4564c544', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DsXnfWuc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71731) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 16:31:38 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-067eaca3-baf6-4dbc-a381-07a5d6009e5b tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.331s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 16:31:38 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-067eaca3-baf6-4dbc-a381-07a5d6009e5b tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] <== connect_volume: return (1333ms) {'type': 'block', 'scsi_wwn': '26134316664306630', 'path': '/dev/sdd'} {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 16:31:38 user nova-compute[71731]: DEBUG nova.virt.libvirt.volume.iscsi [None req-067eaca3-baf6-4dbc-a381-07a5d6009e5b tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] [instance: bf98c3a2-dbeb-4ae4-8423-ce55964c4258] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26134316664306630', 'path': '/dev/sdd'} {{(pid=71731) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 16:31:38 user nova-compute[71731]: DEBUG nova.objects.instance [None req-067eaca3-baf6-4dbc-a381-07a5d6009e5b tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Lazy-loading 'flavor' on Instance uuid bf98c3a2-dbeb-4ae4-8423-ce55964c4258 {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:31:38 user nova-compute[71731]: DEBUG nova.virt.libvirt.guest [None req-067eaca3-baf6-4dbc-a381-07a5d6009e5b tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] attach device xml: <disk type="block" device="disk">
Apr 13 16:31:38 user nova-compute[71731]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 16:31:38 user nova-compute[71731]:   <source dev="/dev/sdd"/>
Apr 13 16:31:38 user nova-compute[71731]:   <target dev="vdb" bus="virtio"/>
Apr 13 16:31:38 user nova-compute[71731]:   <serial>6bdf834e-4cc1-4a8e-850c-84ce4564c544</serial>
Apr 13 16:31:38 user nova-compute[71731]: </disk>
Apr 13 16:31:38 user nova-compute[71731]:  {{(pid=71731) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 13 16:31:39 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:31:39 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-067eaca3-baf6-4dbc-a381-07a5d6009e5b tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] No BDM found with device name vda, not building metadata. {{(pid=71731) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 16:31:39 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-067eaca3-baf6-4dbc-a381-07a5d6009e5b tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71731) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 16:31:39 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-067eaca3-baf6-4dbc-a381-07a5d6009e5b tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] No VIF found with MAC fa:16:3e:76:1a:b3, not building metadata {{(pid=71731) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 16:31:39 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-067eaca3-baf6-4dbc-a381-07a5d6009e5b tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Lock "bf98c3a2-dbeb-4ae4-8423-ce55964c4258" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.555s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:31:39 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1aaac619-001d-41d1-80b4-7ac1d50241bf tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] [instance: 32b18558-8bf2-4def-bc70-81c4e38fcc6f] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:31:39 user nova-compute[71731]: INFO nova.compute.manager [None req-1aaac619-001d-41d1-80b4-7ac1d50241bf tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] [instance: 32b18558-8bf2-4def-bc70-81c4e38fcc6f] instance snapshotting
Apr 13 16:31:39 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-1aaac619-001d-41d1-80b4-7ac1d50241bf tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] [instance: 32b18558-8bf2-4def-bc70-81c4e38fcc6f] Beginning live snapshot process
Apr 13 16:31:40 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-1aaac619-001d-41d1-80b4-7ac1d50241bf tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32b18558-8bf2-4def-bc70-81c4e38fcc6f/disk --force-share --output=json -f qcow2 {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:31:40 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-1aaac619-001d-41d1-80b4-7ac1d50241bf tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32b18558-8bf2-4def-bc70-81c4e38fcc6f/disk --force-share --output=json -f qcow2" returned: 0 in 0.155s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:31:40 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-1aaac619-001d-41d1-80b4-7ac1d50241bf tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32b18558-8bf2-4def-bc70-81c4e38fcc6f/disk --force-share --output=json -f qcow2 {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:31:40 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-1aaac619-001d-41d1-80b4-7ac1d50241bf tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32b18558-8bf2-4def-bc70-81c4e38fcc6f/disk --force-share --output=json -f qcow2" returned: 0 in 0.147s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:31:40 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-1aaac619-001d-41d1-80b4-7ac1d50241bf tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279 --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:31:40 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-1aaac619-001d-41d1-80b4-7ac1d50241bf tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279 --force-share --output=json" returned: 0 in 0.136s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:31:40 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-1aaac619-001d-41d1-80b4-7ac1d50241bf tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpeijz8xyd/33ccfbd96f64492db9819328cb9d2595.delta 1073741824 {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:31:40 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-1aaac619-001d-41d1-80b4-7ac1d50241bf tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpeijz8xyd/33ccfbd96f64492db9819328cb9d2595.delta 1073741824" returned: 0 in 0.049s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:31:40 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-1aaac619-001d-41d1-80b4-7ac1d50241bf tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] [instance: 32b18558-8bf2-4def-bc70-81c4e38fcc6f] Quiescing instance not available: QEMU guest agent is not enabled.
Apr 13 16:31:41 user nova-compute[71731]: DEBUG nova.virt.libvirt.guest [None req-1aaac619-001d-41d1-80b4-7ac1d50241bf tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] COPY block job progress, current cursor: 0 final cursor: 43843584 {{(pid=71731) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 13 16:31:41 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-96c96180-99f7-4ff1-a9af-0f15b58b86c3 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Acquiring lock "bf98c3a2-dbeb-4ae4-8423-ce55964c4258" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:31:41 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-96c96180-99f7-4ff1-a9af-0f15b58b86c3 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Lock "bf98c3a2-dbeb-4ae4-8423-ce55964c4258" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:31:41 user nova-compute[71731]: INFO nova.compute.manager [None req-96c96180-99f7-4ff1-a9af-0f15b58b86c3 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] [instance: bf98c3a2-dbeb-4ae4-8423-ce55964c4258] Detaching volume 6bdf834e-4cc1-4a8e-850c-84ce4564c544
Apr 13 16:31:41 user nova-compute[71731]: INFO nova.virt.block_device [None req-96c96180-99f7-4ff1-a9af-0f15b58b86c3 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] [instance: bf98c3a2-dbeb-4ae4-8423-ce55964c4258] Attempting to driver detach volume 6bdf834e-4cc1-4a8e-850c-84ce4564c544 from mountpoint /dev/vdb
Apr 13 16:31:41 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-96c96180-99f7-4ff1-a9af-0f15b58b86c3 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Attempting to detach device vdb from instance bf98c3a2-dbeb-4ae4-8423-ce55964c4258 from the persistent domain config. {{(pid=71731) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 13 16:31:41 user nova-compute[71731]: DEBUG nova.virt.libvirt.guest [None req-96c96180-99f7-4ff1-a9af-0f15b58b86c3 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 16:31:41 user nova-compute[71731]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 16:31:41 user nova-compute[71731]:   <source dev="/dev/sdd"/>
Apr 13 16:31:41 user nova-compute[71731]:   <target dev="vdb" bus="virtio"/>
Apr 13 16:31:41 user nova-compute[71731]:   <serial>6bdf834e-4cc1-4a8e-850c-84ce4564c544</serial>
Apr 13 16:31:41 user nova-compute[71731]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 13 16:31:41 user nova-compute[71731]: </disk>
Apr 13 16:31:41 user nova-compute[71731]:  {{(pid=71731) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 16:31:41 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-96c96180-99f7-4ff1-a9af-0f15b58b86c3 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Successfully detached device vdb from instance bf98c3a2-dbeb-4ae4-8423-ce55964c4258 from the persistent domain config.
Apr 13 16:31:41 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-96c96180-99f7-4ff1-a9af-0f15b58b86c3 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance bf98c3a2-dbeb-4ae4-8423-ce55964c4258 from the live domain config. {{(pid=71731) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 13 16:31:41 user nova-compute[71731]: DEBUG nova.virt.libvirt.guest [None req-96c96180-99f7-4ff1-a9af-0f15b58b86c3 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 16:31:41 user nova-compute[71731]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 16:31:41 user nova-compute[71731]:   <source dev="/dev/sdd"/>
Apr 13 16:31:41 user nova-compute[71731]:   <target dev="vdb" bus="virtio"/>
Apr 13 16:31:41 user nova-compute[71731]:   <serial>6bdf834e-4cc1-4a8e-850c-84ce4564c544</serial>
Apr 13 16:31:41 user nova-compute[71731]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 13 16:31:41 user nova-compute[71731]: </disk>
Apr 13 16:31:41 user nova-compute[71731]:  {{(pid=71731) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 16:31:41 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:31:41 user nova-compute[71731]: DEBUG nova.virt.libvirt.guest [None req-1aaac619-001d-41d1-80b4-7ac1d50241bf tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] COPY block job progress, current cursor: 43843584 final cursor: 43843584 {{(pid=71731) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 13 16:31:41 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-1aaac619-001d-41d1-80b4-7ac1d50241bf tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] [instance: 32b18558-8bf2-4def-bc70-81c4e38fcc6f] Skipping quiescing instance: QEMU guest agent is not enabled.
Apr 13 16:31:42 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Received event <DeviceRemovedEvent: 1681403502.1297793, bf98c3a2-dbeb-4ae4-8423-ce55964c4258 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71731) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 13 16:31:42 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-96c96180-99f7-4ff1-a9af-0f15b58b86c3 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance bf98c3a2-dbeb-4ae4-8423-ce55964c4258 {{(pid=71731) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 13 16:31:42 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-96c96180-99f7-4ff1-a9af-0f15b58b86c3 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Successfully detached device vdb from instance bf98c3a2-dbeb-4ae4-8423-ce55964c4258 from the live domain config.
Apr 13 16:31:42 user nova-compute[71731]: DEBUG nova.virt.libvirt.volume.iscsi [None req-96c96180-99f7-4ff1-a9af-0f15b58b86c3 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] [instance: bf98c3a2-dbeb-4ae4-8423-ce55964c4258] calling os-brick to detach iSCSI Volume {{(pid=71731) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 16:31:42 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-96c96180-99f7-4ff1-a9af-0f15b58b86c3 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8cf0118790>, {'target_iqn': 'iqn.2010-10.org.openstack:6bdf834e-4cc1-4a8e-850c-84ce4564c544', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DsXnfWuc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 16:31:42 user nova-compute[71731]: WARNING os_brick.initiator.connectors.base [None req-96c96180-99f7-4ff1-a9af-0f15b58b86c3 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 16:31:42 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-96c96180-99f7-4ff1-a9af-0f15b58b86c3 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 16:31:42 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-96c96180-99f7-4ff1-a9af-0f15b58b86c3 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 16:31:42 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:31:42 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:31:42 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:31:42 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[b00058d6-50f3-4b4e-9c0a-2d9831f2df7d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c2088266-1d33-4bb1-ac5b-1de832ff7985\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6bdf834e-4cc1-4a8e-850c-84ce4564c544\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:31:42 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-96c96180-99f7-4ff1-a9af-0f15b58b86c3 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 16:31:42 user nova-compute[71731]: No targets found.
Apr 13 16:31:42 user nova-compute[71731]: iSNS:
Apr 13 16:31:42 user nova-compute[71731]: No targets found.
Apr 13 16:31:42 user nova-compute[71731]: STATIC:
Apr 13 16:31:42 user nova-compute[71731]: Target: iqn.2010-10.org.openstack:c2088266-1d33-4bb1-ac5b-1de832ff7985
Apr 13 16:31:42 user nova-compute[71731]:         Portal: 172.16.0.220:3260,-1
Apr 13 16:31:42 user nova-compute[71731]:                 Iface Name: default
Apr 13 16:31:42 user nova-compute[71731]: Target: iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97
Apr 13 16:31:42 user nova-compute[71731]:         Portal: 172.16.0.220:3260,-1
Apr 13 16:31:42 user nova-compute[71731]:                 Iface Name: default
Apr 13 16:31:42 user nova-compute[71731]: Target: iqn.2010-10.org.openstack:6bdf834e-4cc1-4a8e-850c-84ce4564c544
Apr 13 16:31:42 user nova-compute[71731]:         Portal: 172.16.0.220:3260,-1
Apr 13 16:31:42 user nova-compute[71731]:                 Iface Name: default
Apr 13 16:31:42 user nova-compute[71731]: FIRMWARE:
Apr 13 16:31:42 user nova-compute[71731]: No targets found.
Apr 13 16:31:42 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 16:31:42 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-96c96180-99f7-4ff1-a9af-0f15b58b86c3 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 16:31:42 user nova-compute[71731]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 16:31:42 user nova-compute[71731]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71731) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 16:31:42 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-96c96180-99f7-4ff1-a9af-0f15b58b86c3 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6bdf834e-4cc1-4a8e-850c-84ce4564c544', 0)] {{(pid=71731) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 16:31:42 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:31:42 user nova-compute[71731]: DEBUG nova.privsep.utils [None req-1aaac619-001d-41d1-80b4-7ac1d50241bf tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71731) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 13 16:31:42 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-1aaac619-001d-41d1-80b4-7ac1d50241bf tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpeijz8xyd/33ccfbd96f64492db9819328cb9d2595.delta /opt/stack/data/nova/instances/snapshots/tmpeijz8xyd/33ccfbd96f64492db9819328cb9d2595 {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:31:42 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:31:42 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe446d83-e4ed-4f97-80b3-90826cc662cb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6bdf834e-4cc1-4a8e-850c-84ce4564c544\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c2088266-1d33-4bb1-ac5b-1de832ff7985\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:31:42 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:31:42 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:31:42 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4642b24-91e4-4183-90fe-5e9be7e42767]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2088266-1d33-4bb1-ac5b-1de832ff7985 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bdf834e-4cc1-4a8e-850c-84ce4564c544 (non-flash)\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:31:42 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-96c96180-99f7-4ff1-a9af-0f15b58b86c3 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)
Apr 13 16:31:42 user nova-compute[71731]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2088266-1d33-4bb1-ac5b-1de832ff7985 (non-flash)
Apr 13 16:31:42 user nova-compute[71731]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bdf834e-4cc1-4a8e-850c-84ce4564c544 (non-flash)
Apr 13 16:31:42 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 16:31:42 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-96c96180-99f7-4ff1-a9af-0f15b58b86c3 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)
Apr 13 16:31:42 user nova-compute[71731]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2088266-1d33-4bb1-ac5b-1de832ff7985 (non-flash)
Apr 13 16:31:42 user nova-compute[71731]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bdf834e-4cc1-4a8e-850c-84ce4564c544 (non-flash)
Apr 13 16:31:42 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 16:31:42 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-96c96180-99f7-4ff1-a9af-0f15b58b86c3 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8cb06717e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6bdf834e-4cc1-4a8e-850c-84ce4564c544'): ({'sdd'}, set())}) {{(pid=71731) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 16:31:42 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-96c96180-99f7-4ff1-a9af-0f15b58b86c3 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Removing single pathed devices sdd {{(pid=71731) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 16:31:42 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:31:42 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:31:42 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dfd8222-e6c2-496b-bc9a-ce3baa3e6f02]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:31:42 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:31:42 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:31:42 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[10a353d0-99ad-486d-8235-92de8ca45bd2]: (4, ('ok\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:31:42 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-96c96180-99f7-4ff1-a9af-0f15b58b86c3 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Flushing IO for device /dev/sdd {{(pid=71731) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 16:31:42 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:31:42 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.018s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:31:42 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[be2c67c4-d207-4c25-ae12-422856377755]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:31:42 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-96c96180-99f7-4ff1-a9af-0f15b58b86c3 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=71731) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 16:31:42 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:31:42 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.168s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:31:42 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2439a36-7073-4d78-80f4-cb187db27682]: (4, ('1', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:31:42 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-96c96180-99f7-4ff1-a9af-0f15b58b86c3 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=71731) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 16:31:42 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-96c96180-99f7-4ff1-a9af-0f15b58b86c3 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] SCSI volumes sdd have been removed. {{(pid=71731) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 16:31:42 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-96c96180-99f7-4ff1-a9af-0f15b58b86c3 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6bdf834e-4cc1-4a8e-850c-84ce4564c544')] {{(pid=71731) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 16:31:42 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6bdf834e-4cc1-4a8e-850c-84ce4564c544 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:31:42 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6bdf834e-4cc1-4a8e-850c-84ce4564c544 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.046s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:31:42 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9ad7b08-ea3c-49e9-b2d2-1d2b7f5acf03]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:31:42 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-96c96180-99f7-4ff1-a9af-0f15b58b86c3 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:31:42 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6bdf834e-4cc1-4a8e-850c-84ce4564c544 -p 172.16.0.220:3260 --logout {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:31:42 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-1aaac619-001d-41d1-80b4-7ac1d50241bf tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpeijz8xyd/33ccfbd96f64492db9819328cb9d2595.delta /opt/stack/data/nova/instances/snapshots/tmpeijz8xyd/33ccfbd96f64492db9819328cb9d2595" returned: 0 in 0.423s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:31:42 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-1aaac619-001d-41d1-80b4-7ac1d50241bf tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] [instance: 32b18558-8bf2-4def-bc70-81c4e38fcc6f] Snapshot extracted, beginning image upload
Apr 13 16:31:42 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6bdf834e-4cc1-4a8e-850c-84ce4564c544 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:31:42 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ed388c1-8db8-47bd-8a0d-3006e30bf6d0]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:6bdf834e-4cc1-4a8e-850c-84ce4564c544, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:6bdf834e-4cc1-4a8e-850c-84ce4564c544, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:31:42 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-96c96180-99f7-4ff1-a9af-0f15b58b86c3 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:6bdf834e-4cc1-4a8e-850c-84ce4564c544, portal: 172.16.0.220,3260]
Apr 13 16:31:42 user nova-compute[71731]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:6bdf834e-4cc1-4a8e-850c-84ce4564c544, portal: 172.16.0.220,3260] successful.
Apr 13 16:31:42 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:31:42 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6bdf834e-4cc1-4a8e-850c-84ce4564c544 -p 172.16.0.220:3260 --op delete {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:31:42 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6bdf834e-4cc1-4a8e-850c-84ce4564c544 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:31:42 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbf78410-f3be-46f6-96f5-542329f51cbd]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:31:42 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-96c96180-99f7-4ff1-a9af-0f15b58b86c3 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:31:42 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-96c96180-99f7-4ff1-a9af-0f15b58b86c3 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.507s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 16:31:42 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-96c96180-99f7-4ff1-a9af-0f15b58b86c3 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] <== disconnect_volume: return (509ms) None {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 16:31:42 user nova-compute[71731]: DEBUG nova.virt.libvirt.volume.iscsi [None req-96c96180-99f7-4ff1-a9af-0f15b58b86c3 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] [instance: bf98c3a2-dbeb-4ae4-8423-ce55964c4258] Disconnected iSCSI Volume {{(pid=71731) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 16:31:42 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:31:43 user nova-compute[71731]: DEBUG nova.objects.instance [None req-96c96180-99f7-4ff1-a9af-0f15b58b86c3 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Lazy-loading 'flavor' on Instance uuid bf98c3a2-dbeb-4ae4-8423-ce55964c4258 {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:31:43 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-96c96180-99f7-4ff1-a9af-0f15b58b86c3 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Lock "bf98c3a2-dbeb-4ae4-8423-ce55964c4258" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.952s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:31:44 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-1aaac619-001d-41d1-80b4-7ac1d50241bf tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] [instance: 32b18558-8bf2-4def-bc70-81c4e38fcc6f] Snapshot image upload complete
Apr 13 16:31:44 user nova-compute[71731]: INFO nova.compute.manager [None req-1aaac619-001d-41d1-80b4-7ac1d50241bf tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] [instance: 32b18558-8bf2-4def-bc70-81c4e38fcc6f] Took 5.19 seconds to snapshot the instance on the hypervisor.
Apr 13 16:31:46 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-b347c3f9-ba96-4152-b346-ddd7bd69468d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Acquiring lock "2956ab05-28ff-4c9e-b646-dbb83b3db278" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:31:46 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-b347c3f9-ba96-4152-b346-ddd7bd69468d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lock "2956ab05-28ff-4c9e-b646-dbb83b3db278" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:31:46 user nova-compute[71731]: DEBUG nova.compute.manager [None req-b347c3f9-ba96-4152-b346-ddd7bd69468d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: 2956ab05-28ff-4c9e-b646-dbb83b3db278] Starting instance... {{(pid=71731) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 16:31:46 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-b347c3f9-ba96-4152-b346-ddd7bd69468d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:31:46 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-b347c3f9-ba96-4152-b346-ddd7bd69468d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:31:46 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-b347c3f9-ba96-4152-b346-ddd7bd69468d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71731) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 16:31:46 user nova-compute[71731]: INFO nova.compute.claims [None req-b347c3f9-ba96-4152-b346-ddd7bd69468d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: 2956ab05-28ff-4c9e-b646-dbb83b3db278] Claim successful on node user
Apr 13 16:31:47 user nova-compute[71731]: DEBUG nova.scheduler.client.report [None req-b347c3f9-ba96-4152-b346-ddd7bd69468d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Refreshing inventories for resource provider cb6b1a64-0c24-4e2d-af1e-16576ca9165c {{(pid=71731) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 13 16:31:47 user nova-compute[71731]: DEBUG nova.scheduler.client.report [None req-b347c3f9-ba96-4152-b346-ddd7bd69468d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Updating ProviderTree inventory for provider cb6b1a64-0c24-4e2d-af1e-16576ca9165c from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71731) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 13 16:31:47 user nova-compute[71731]: DEBUG nova.compute.provider_tree [None req-b347c3f9-ba96-4152-b346-ddd7bd69468d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Updating inventory in ProviderTree for provider cb6b1a64-0c24-4e2d-af1e-16576ca9165c with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71731) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 13 16:31:47 user nova-compute[71731]: DEBUG nova.scheduler.client.report [None req-b347c3f9-ba96-4152-b346-ddd7bd69468d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Refreshing aggregate associations for resource provider cb6b1a64-0c24-4e2d-af1e-16576ca9165c, aggregates: None {{(pid=71731) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 13 16:31:47 user nova-compute[71731]: DEBUG nova.scheduler.client.report [None req-b347c3f9-ba96-4152-b346-ddd7bd69468d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Refreshing trait associations for resource provider cb6b1a64-0c24-4e2d-af1e-16576ca9165c, traits: COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSSE3,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_SATA,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_SSE,COMPUTE_RESCUE_BFV,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE41,HW_CPU_X86_MMX,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_RAW {{(pid=71731) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 13 16:31:47 user nova-compute[71731]: DEBUG nova.compute.provider_tree [None req-b347c3f9-ba96-4152-b346-ddd7bd69468d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Inventory has not changed in ProviderTree for provider: cb6b1a64-0c24-4e2d-af1e-16576ca9165c {{(pid=71731) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 16:31:47 user nova-compute[71731]: DEBUG nova.scheduler.client.report [None req-b347c3f9-ba96-4152-b346-ddd7bd69468d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Inventory has not changed for provider cb6b1a64-0c24-4e2d-af1e-16576ca9165c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71731) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 16:31:47 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-b347c3f9-ba96-4152-b346-ddd7bd69468d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.498s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:31:47 user nova-compute[71731]: DEBUG nova.compute.manager [None req-b347c3f9-ba96-4152-b346-ddd7bd69468d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: 2956ab05-28ff-4c9e-b646-dbb83b3db278] Start building networks asynchronously for instance. {{(pid=71731) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 16:31:47 user nova-compute[71731]: DEBUG nova.compute.manager [None req-b347c3f9-ba96-4152-b346-ddd7bd69468d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: 2956ab05-28ff-4c9e-b646-dbb83b3db278] Allocating IP information in the background. {{(pid=71731) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 16:31:47 user nova-compute[71731]: DEBUG nova.network.neutron [None req-b347c3f9-ba96-4152-b346-ddd7bd69468d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: 2956ab05-28ff-4c9e-b646-dbb83b3db278] allocate_for_instance() {{(pid=71731) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 16:31:47 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-b347c3f9-ba96-4152-b346-ddd7bd69468d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: 2956ab05-28ff-4c9e-b646-dbb83b3db278] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 16:31:47 user nova-compute[71731]: DEBUG nova.compute.manager [None req-b347c3f9-ba96-4152-b346-ddd7bd69468d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: 2956ab05-28ff-4c9e-b646-dbb83b3db278] Start building block device mappings for instance. {{(pid=71731) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 16:31:47 user nova-compute[71731]: INFO nova.virt.block_device [None req-b347c3f9-ba96-4152-b346-ddd7bd69468d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: 2956ab05-28ff-4c9e-b646-dbb83b3db278] Booting with volume-backed-image 708622a9-7465-4492-ade8-b827198f7e30 at /dev/vda
Apr 13 16:31:47 user nova-compute[71731]: DEBUG nova.policy [None req-b347c3f9-ba96-4152-b346-ddd7bd69468d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e45a882dbafb4ea4976e4f45289eb2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2d09a74bf684a9fb1dd1e95d6c23f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71731) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 16:31:47 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 16:31:47 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:31:47 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71731) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 16:31:47 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71731) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 16:31:47 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71731) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 16:31:47 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:31:48 user nova-compute[71731]: DEBUG nova.network.neutron [None req-b347c3f9-ba96-4152-b346-ddd7bd69468d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: 2956ab05-28ff-4c9e-b646-dbb83b3db278] Successfully created port: 84df62e9-af7c-4e62-83da-b43b511be2a0 {{(pid=71731) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 16:31:48 user nova-compute[71731]: DEBUG nova.objects.instance [None req-8ab9bd8c-c7e5-4030-8d9c-10bc5b800524 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lazy-loading 'flavor' on Instance uuid eaae47b9-a059-49f6-9ae6-d7147003e2f2 {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:31:48 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-8ab9bd8c-c7e5-4030-8d9c-10bc5b800524 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Acquiring lock "refresh_cache-eaae47b9-a059-49f6-9ae6-d7147003e2f2" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 16:31:48 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-8ab9bd8c-c7e5-4030-8d9c-10bc5b800524 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Acquired lock "refresh_cache-eaae47b9-a059-49f6-9ae6-d7147003e2f2" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 16:31:48 user nova-compute[71731]: DEBUG nova.network.neutron [None req-8ab9bd8c-c7e5-4030-8d9c-10bc5b800524 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] [instance: eaae47b9-a059-49f6-9ae6-d7147003e2f2] Building network info cache for instance {{(pid=71731) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 16:31:48 user nova-compute[71731]: DEBUG nova.objects.instance [None req-8ab9bd8c-c7e5-4030-8d9c-10bc5b800524 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lazy-loading 'info_cache' on Instance uuid eaae47b9-a059-49f6-9ae6-d7147003e2f2 {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:31:48 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:31:49 user nova-compute[71731]: DEBUG nova.network.neutron [None req-8ab9bd8c-c7e5-4030-8d9c-10bc5b800524 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] [instance: eaae47b9-a059-49f6-9ae6-d7147003e2f2] Updating instance_info_cache with network_info: [{"id": "e9b2fcaa-f77b-4e5c-ad3c-797ce804a9ae", "address": "fa:16:3e:ff:85:92", "network": {"id": "79e9ef20-b14d-4850-b298-9d3ed4d10b90", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1756253617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24904988cf334657b084fd726c7ecf8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9b2fcaa-f7", "ovs_interfaceid": "e9b2fcaa-f77b-4e5c-ad3c-797ce804a9ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:31:49 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-8ab9bd8c-c7e5-4030-8d9c-10bc5b800524 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Releasing lock "refresh_cache-eaae47b9-a059-49f6-9ae6-d7147003e2f2" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 16:31:50 user nova-compute[71731]: INFO nova.virt.libvirt.driver [-] [instance: eaae47b9-a059-49f6-9ae6-d7147003e2f2] Instance destroyed successfully.
Apr 13 16:31:50 user nova-compute[71731]: DEBUG nova.objects.instance [None req-8ab9bd8c-c7e5-4030-8d9c-10bc5b800524 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lazy-loading 'resources' on Instance uuid eaae47b9-a059-49f6-9ae6-d7147003e2f2 {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:31:50 user nova-compute[71731]: DEBUG nova.virt.libvirt.vif [None req-8ab9bd8c-c7e5-4030-8d9c-10bc5b800524 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T16:24:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1335647489',display_name='tempest-AttachVolumeTestJSON-server-1335647489',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1335647489',id=17,image_ref='708622a9-7465-4492-ade8-b827198f7e30',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBWOy0oVQ9hC0pTOafixaz1QU1E5DFmqkYHL4O9l7OLTdaq0+Nt41+fxYUKgEMEMs0o2pxQBhqAzayIAyGV1IIb01ym4tkG3pd4D4/xbjIzoE586YH9dqYrXgxzYqNSiRA==',key_name='tempest-keypair-1534458766',keypairs=<?>,launch_index=0,launched_at=2023-04-13T16:24:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='24904988cf334657b084fd726c7ecf8f',ramdisk_id='',reservation_id='r-aer2ghdf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='708622a9-7465-4492-ade8-b827198f7e30',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-836650657',owner_user_name='tempest-AttachVolumeTestJSON-836650657-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T16:29:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='47fab402fb794a5a9281cfb7fe188813',uuid=eaae47b9-a059-49f6-9ae6-d7147003e2f2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "e9b2fcaa-f77b-4e5c-ad3c-797ce804a9ae", "address": "fa:16:3e:ff:85:92", "network": {"id": "79e9ef20-b14d-4850-b298-9d3ed4d10b90", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1756253617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24904988cf334657b084fd726c7ecf8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9b2fcaa-f7", "ovs_interfaceid": "e9b2fcaa-f77b-4e5c-ad3c-797ce804a9ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 16:31:50 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-8ab9bd8c-c7e5-4030-8d9c-10bc5b800524 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Converting VIF {"id": "e9b2fcaa-f77b-4e5c-ad3c-797ce804a9ae", "address": "fa:16:3e:ff:85:92", "network": {"id": "79e9ef20-b14d-4850-b298-9d3ed4d10b90", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1756253617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24904988cf334657b084fd726c7ecf8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9b2fcaa-f7", "ovs_interfaceid": "e9b2fcaa-f77b-4e5c-ad3c-797ce804a9ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 16:31:50 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-8ab9bd8c-c7e5-4030-8d9c-10bc5b800524 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ff:85:92,bridge_name='br-int',has_traffic_filtering=True,id=e9b2fcaa-f77b-4e5c-ad3c-797ce804a9ae,network=Network(79e9ef20-b14d-4850-b298-9d3ed4d10b90),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9b2fcaa-f7') {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 16:31:50 user nova-compute[71731]: DEBUG os_vif [None req-8ab9bd8c-c7e5-4030-8d9c-10bc5b800524 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:85:92,bridge_name='br-int',has_traffic_filtering=True,id=e9b2fcaa-f77b-4e5c-ad3c-797ce804a9ae,network=Network(79e9ef20-b14d-4850-b298-9d3ed4d10b90),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9b2fcaa-f7') {{(pid=71731) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 16:31:50 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:31:50 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape9b2fcaa-f7, bridge=br-int, if_exists=True) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:31:50 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:31:50 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 16:31:50 user nova-compute[71731]: INFO os_vif [None req-8ab9bd8c-c7e5-4030-8d9c-10bc5b800524 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:85:92,bridge_name='br-int',has_traffic_filtering=True,id=e9b2fcaa-f77b-4e5c-ad3c-797ce804a9ae,network=Network(79e9ef20-b14d-4850-b298-9d3ed4d10b90),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9b2fcaa-f7')
Apr 13 16:31:50 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-8ab9bd8c-c7e5-4030-8d9c-10bc5b800524 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] [instance: eaae47b9-a059-49f6-9ae6-d7147003e2f2] Start _get_guest_xml network_info=[{"id": "e9b2fcaa-f77b-4e5c-ad3c-797ce804a9ae", "address": "fa:16:3e:ff:85:92", "network": {"id": "79e9ef20-b14d-4850-b298-9d3ed4d10b90", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1756253617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24904988cf334657b084fd726c7ecf8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9b2fcaa-f7", "ovs_interfaceid": "e9b2fcaa-f77b-4e5c-ad3c-797ce804a9ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=708622a9-7465-4492-ade8-b827198f7e30,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'device_type': 'disk', 'encrypted': False, 'disk_bus': 'virtio', 'guest_format': None, 'encryption_options': None, 'image_id': '708622a9-7465-4492-ade8-b827198f7e30'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71731) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 16:31:50 user nova-compute[71731]: DEBUG nova.objects.instance [None req-8ab9bd8c-c7e5-4030-8d9c-10bc5b800524 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lazy-loading 'numa_topology' on Instance uuid eaae47b9-a059-49f6-9ae6-d7147003e2f2 {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:31:50 user nova-compute[71731]: WARNING nova.virt.libvirt.driver [None req-8ab9bd8c-c7e5-4030-8d9c-10bc5b800524 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 16:31:50 user nova-compute[71731]: WARNING nova.virt.libvirt.driver [None req-8ab9bd8c-c7e5-4030-8d9c-10bc5b800524 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 16:31:50 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-8ab9bd8c-c7e5-4030-8d9c-10bc5b800524 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71731) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 16:31:50 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-8ab9bd8c-c7e5-4030-8d9c-10bc5b800524 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T16:17:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=708622a9-7465-4492-ade8-b827198f7e30,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 16:31:50 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-8ab9bd8c-c7e5-4030-8d9c-10bc5b800524 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Flavor limits 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 16:31:50 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-8ab9bd8c-c7e5-4030-8d9c-10bc5b800524 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Image limits 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 16:31:50 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-8ab9bd8c-c7e5-4030-8d9c-10bc5b800524 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Flavor pref 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 16:31:50 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-8ab9bd8c-c7e5-4030-8d9c-10bc5b800524 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Image pref 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 16:31:50 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-8ab9bd8c-c7e5-4030-8d9c-10bc5b800524 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 16:31:50 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-8ab9bd8c-c7e5-4030-8d9c-10bc5b800524 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 16:31:50 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-8ab9bd8c-c7e5-4030-8d9c-10bc5b800524 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71731) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 16:31:50 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-8ab9bd8c-c7e5-4030-8d9c-10bc5b800524 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Got 1 possible topologies {{(pid=71731) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 16:31:50 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-8ab9bd8c-c7e5-4030-8d9c-10bc5b800524 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 16:31:50 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-8ab9bd8c-c7e5-4030-8d9c-10bc5b800524 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 16:31:50 user nova-compute[71731]: DEBUG nova.objects.instance [None req-8ab9bd8c-c7e5-4030-8d9c-10bc5b800524 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lazy-loading 'vcpu_model' on Instance uuid eaae47b9-a059-49f6-9ae6-d7147003e2f2 {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:31:50 user nova-compute[71731]: DEBUG nova.virt.libvirt.vif [None req-8ab9bd8c-c7e5-4030-8d9c-10bc5b800524 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T16:24:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1335647489',display_name='tempest-AttachVolumeTestJSON-server-1335647489',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1335647489',id=17,image_ref='708622a9-7465-4492-ade8-b827198f7e30',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBWOy0oVQ9hC0pTOafixaz1QU1E5DFmqkYHL4O9l7OLTdaq0+Nt41+fxYUKgEMEMs0o2pxQBhqAzayIAyGV1IIb01ym4tkG3pd4D4/xbjIzoE586YH9dqYrXgxzYqNSiRA==',key_name='tempest-keypair-1534458766',keypairs=<?>,launch_index=0,launched_at=2023-04-13T16:24:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='24904988cf334657b084fd726c7ecf8f',ramdisk_id='',reservation_id='r-aer2ghdf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='708622a9-7465-4492-ade8-b827198f7e30',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-836650657',owner_user_name='tempest-AttachVolumeTestJSON-836650657-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T16:29:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='47fab402fb794a5a9281cfb7fe188813',uuid=eaae47b9-a059-49f6-9ae6-d7147003e2f2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "e9b2fcaa-f77b-4e5c-ad3c-797ce804a9ae", "address": "fa:16:3e:ff:85:92", "network": {"id": "79e9ef20-b14d-4850-b298-9d3ed4d10b90", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1756253617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24904988cf334657b084fd726c7ecf8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9b2fcaa-f7", "ovs_interfaceid": "e9b2fcaa-f77b-4e5c-ad3c-797ce804a9ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71731) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 16:31:50 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-8ab9bd8c-c7e5-4030-8d9c-10bc5b800524 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Converting VIF {"id": "e9b2fcaa-f77b-4e5c-ad3c-797ce804a9ae", "address": "fa:16:3e:ff:85:92", "network": {"id": "79e9ef20-b14d-4850-b298-9d3ed4d10b90", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1756253617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24904988cf334657b084fd726c7ecf8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9b2fcaa-f7", "ovs_interfaceid": "e9b2fcaa-f77b-4e5c-ad3c-797ce804a9ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 16:31:50 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-8ab9bd8c-c7e5-4030-8d9c-10bc5b800524 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ff:85:92,bridge_name='br-int',has_traffic_filtering=True,id=e9b2fcaa-f77b-4e5c-ad3c-797ce804a9ae,network=Network(79e9ef20-b14d-4850-b298-9d3ed4d10b90),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9b2fcaa-f7') {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 16:31:50 user nova-compute[71731]: DEBUG nova.objects.instance [None req-8ab9bd8c-c7e5-4030-8d9c-10bc5b800524 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lazy-loading 'pci_devices' on Instance uuid eaae47b9-a059-49f6-9ae6-d7147003e2f2 {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:31:50 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-8ab9bd8c-c7e5-4030-8d9c-10bc5b800524 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] [instance: eaae47b9-a059-49f6-9ae6-d7147003e2f2] End _get_guest_xml xml=<domain type="kvm">
Apr 13 16:31:50 user nova-compute[71731]:   <uuid>eaae47b9-a059-49f6-9ae6-d7147003e2f2</uuid>
Apr 13 16:31:50 user nova-compute[71731]:   <name>instance-00000011</name>
Apr 13 16:31:50 user nova-compute[71731]:   <memory>131072</memory>
Apr 13 16:31:50 user nova-compute[71731]:   <vcpu>1</vcpu>
Apr 13 16:31:50 user nova-compute[71731]:   <metadata>
Apr 13 16:31:50 user nova-compute[71731]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 16:31:50 user nova-compute[71731]:       <nova:package version="0.0.0"/>
Apr 13 16:31:50 user nova-compute[71731]:       <nova:name>tempest-AttachVolumeTestJSON-server-1335647489</nova:name>
Apr 13 16:31:50 user nova-compute[71731]:       <nova:creationTime>2023-04-13 16:31:50</nova:creationTime>
Apr 13 16:31:50 user nova-compute[71731]:       <nova:flavor name="m1.nano">
Apr 13 16:31:50 user nova-compute[71731]:         <nova:memory>128</nova:memory>
Apr 13 16:31:50 user nova-compute[71731]:         <nova:disk>1</nova:disk>
Apr 13 16:31:50 user nova-compute[71731]:         <nova:swap>0</nova:swap>
Apr 13 16:31:50 user nova-compute[71731]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 16:31:50 user nova-compute[71731]:         <nova:vcpus>1</nova:vcpus>
Apr 13 16:31:50 user nova-compute[71731]:       </nova:flavor>
Apr 13 16:31:50 user nova-compute[71731]:       <nova:owner>
Apr 13 16:31:50 user nova-compute[71731]:         <nova:user uuid="47fab402fb794a5a9281cfb7fe188813">tempest-AttachVolumeTestJSON-836650657-project-member</nova:user>
Apr 13 16:31:50 user nova-compute[71731]:         <nova:project uuid="24904988cf334657b084fd726c7ecf8f">tempest-AttachVolumeTestJSON-836650657</nova:project>
Apr 13 16:31:50 user nova-compute[71731]:       </nova:owner>
Apr 13 16:31:50 user nova-compute[71731]:       <nova:root type="image" uuid="708622a9-7465-4492-ade8-b827198f7e30"/>
Apr 13 16:31:50 user nova-compute[71731]:       <nova:ports>
Apr 13 16:31:50 user nova-compute[71731]:         <nova:port uuid="e9b2fcaa-f77b-4e5c-ad3c-797ce804a9ae">
Apr 13 16:31:50 user nova-compute[71731]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Apr 13 16:31:50 user nova-compute[71731]:         </nova:port>
Apr 13 16:31:50 user nova-compute[71731]:       </nova:ports>
Apr 13 16:31:50 user nova-compute[71731]:     </nova:instance>
Apr 13 16:31:50 user nova-compute[71731]:   </metadata>
Apr 13 16:31:50 user nova-compute[71731]:   <sysinfo type="smbios">
Apr 13 16:31:50 user nova-compute[71731]:     <system>
Apr 13 16:31:50 user nova-compute[71731]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 16:31:50 user nova-compute[71731]:       <entry name="product">OpenStack Nova</entry>
Apr 13 16:31:50 user nova-compute[71731]:       <entry name="version">0.0.0</entry>
Apr 13 16:31:50 user nova-compute[71731]:       <entry name="serial">eaae47b9-a059-49f6-9ae6-d7147003e2f2</entry>
Apr 13 16:31:50 user nova-compute[71731]:       <entry name="uuid">eaae47b9-a059-49f6-9ae6-d7147003e2f2</entry>
Apr 13 16:31:50 user nova-compute[71731]:       <entry name="family">Virtual Machine</entry>
Apr 13 16:31:50 user nova-compute[71731]:     </system>
Apr 13 16:31:50 user nova-compute[71731]:   </sysinfo>
Apr 13 16:31:50 user nova-compute[71731]:   <os>
Apr 13 16:31:50 user nova-compute[71731]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 16:31:50 user nova-compute[71731]:     <boot dev="hd"/>
Apr 13 16:31:50 user nova-compute[71731]:     <smbios mode="sysinfo"/>
Apr 13 16:31:50 user nova-compute[71731]:   </os>
Apr 13 16:31:50 user nova-compute[71731]:   <features>
Apr 13 16:31:50 user nova-compute[71731]:     <acpi/>
Apr 13 16:31:50 user nova-compute[71731]:     <apic/>
Apr 13 16:31:50 user nova-compute[71731]:     <vmcoreinfo/>
Apr 13 16:31:50 user nova-compute[71731]:   </features>
Apr 13 16:31:50 user nova-compute[71731]:   <clock offset="utc">
Apr 13 16:31:50 user nova-compute[71731]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 16:31:50 user nova-compute[71731]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 16:31:50 user nova-compute[71731]:     <timer name="hpet" present="no"/>
Apr 13 16:31:50 user nova-compute[71731]:   </clock>
Apr 13 16:31:50 user nova-compute[71731]:   <cpu mode="custom" match="exact">
Apr 13 16:31:50 user nova-compute[71731]:     <model>Nehalem</model>
Apr 13 16:31:50 user nova-compute[71731]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 16:31:50 user nova-compute[71731]:   </cpu>
Apr 13 16:31:50 user nova-compute[71731]:   <devices>
Apr 13 16:31:50 user nova-compute[71731]:     <disk type="file" device="disk">
Apr 13 16:31:50 user nova-compute[71731]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 16:31:50 user nova-compute[71731]:       <source file="/opt/stack/data/nova/instances/eaae47b9-a059-49f6-9ae6-d7147003e2f2/disk"/>
Apr 13 16:31:50 user nova-compute[71731]:       <target dev="vda" bus="virtio"/>
Apr 13 16:31:50 user nova-compute[71731]:     </disk>
Apr 13 16:31:50 user nova-compute[71731]:     <interface type="ethernet">
Apr 13 16:31:50 user nova-compute[71731]:       <mac address="fa:16:3e:ff:85:92"/>
Apr 13 16:31:50 user nova-compute[71731]:       <model type="virtio"/>
Apr 13 16:31:50 user nova-compute[71731]:       <mtu size="1442"/>
Apr 13 16:31:50 user nova-compute[71731]:       <target dev="tape9b2fcaa-f7"/>
Apr 13 16:31:50 user nova-compute[71731]:     </interface>
Apr 13 16:31:50 user nova-compute[71731]:     <serial type="pty">
Apr 13 16:31:50 user nova-compute[71731]:       <log file="/opt/stack/data/nova/instances/eaae47b9-a059-49f6-9ae6-d7147003e2f2/console.log" append="off"/>
Apr 13 16:31:50 user nova-compute[71731]:     </serial>
Apr 13 16:31:50 user nova-compute[71731]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 16:31:50 user nova-compute[71731]:     <video>
Apr 13 16:31:50 user nova-compute[71731]:       <model type="virtio"/>
Apr 13 16:31:50 user nova-compute[71731]:     </video>
Apr 13 16:31:50 user nova-compute[71731]:     <rng model="virtio">
Apr 13 16:31:50 user nova-compute[71731]:       <backend model="random">/dev/urandom</backend>
Apr 13 16:31:50 user nova-compute[71731]:     </rng>
Apr 13 16:31:50 user nova-compute[71731]:     <controller type="usb" index="0" model="none"/>
Apr 13 16:31:50 user nova-compute[71731]:     <memballoon model="virtio">
Apr 13 16:31:50 user nova-compute[71731]:       <stats period="10"/>
Apr 13 16:31:50 user nova-compute[71731]:     </memballoon>
Apr 13 16:31:50 user nova-compute[71731]:   </devices>
Apr 13 16:31:50 user nova-compute[71731]: </domain>
Apr 13 16:31:50 user nova-compute[71731]:  {{(pid=71731) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 16:31:50 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-8ab9bd8c-c7e5-4030-8d9c-10bc5b800524 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eaae47b9-a059-49f6-9ae6-d7147003e2f2/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:31:50 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-8ab9bd8c-c7e5-4030-8d9c-10bc5b800524 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eaae47b9-a059-49f6-9ae6-d7147003e2f2/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:31:50 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-8ab9bd8c-c7e5-4030-8d9c-10bc5b800524 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eaae47b9-a059-49f6-9ae6-d7147003e2f2/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:31:50 user nova-compute[71731]: DEBUG nova.network.neutron [None req-b347c3f9-ba96-4152-b346-ddd7bd69468d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: 2956ab05-28ff-4c9e-b646-dbb83b3db278] Successfully updated port: 84df62e9-af7c-4e62-83da-b43b511be2a0 {{(pid=71731) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 16:31:50 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-1cbd883c-06ac-47dd-acfa-2f5baa8ec9ba tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Acquiring lock "64a9c052-89a9-48ba-80c9-13fb5ef22f0e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:31:50 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-1cbd883c-06ac-47dd-acfa-2f5baa8ec9ba tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Lock "64a9c052-89a9-48ba-80c9-13fb5ef22f0e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:31:50 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-b347c3f9-ba96-4152-b346-ddd7bd69468d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Acquiring lock "refresh_cache-2956ab05-28ff-4c9e-b646-dbb83b3db278" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 16:31:50 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-b347c3f9-ba96-4152-b346-ddd7bd69468d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Acquired lock "refresh_cache-2956ab05-28ff-4c9e-b646-dbb83b3db278" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 16:31:50 user nova-compute[71731]: DEBUG nova.network.neutron [None req-b347c3f9-ba96-4152-b346-ddd7bd69468d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: 2956ab05-28ff-4c9e-b646-dbb83b3db278] Building network info cache for instance {{(pid=71731) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 16:31:50 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1cbd883c-06ac-47dd-acfa-2f5baa8ec9ba tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] [instance: 64a9c052-89a9-48ba-80c9-13fb5ef22f0e] Starting instance... {{(pid=71731) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 16:31:50 user nova-compute[71731]: DEBUG nova.compute.manager [req-cccc1a35-d4ce-44c5-b279-3a97749c6ef0 req-780951a5-ac0f-4c64-ada0-560da721f61f service nova] [instance: 2956ab05-28ff-4c9e-b646-dbb83b3db278] Received event network-changed-84df62e9-af7c-4e62-83da-b43b511be2a0 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:31:50 user nova-compute[71731]: DEBUG nova.compute.manager [req-cccc1a35-d4ce-44c5-b279-3a97749c6ef0 req-780951a5-ac0f-4c64-ada0-560da721f61f service nova] [instance: 2956ab05-28ff-4c9e-b646-dbb83b3db278] Refreshing instance network info cache due to event network-changed-84df62e9-af7c-4e62-83da-b43b511be2a0. {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 16:31:50 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-cccc1a35-d4ce-44c5-b279-3a97749c6ef0 req-780951a5-ac0f-4c64-ada0-560da721f61f service nova] Acquiring lock "refresh_cache-2956ab05-28ff-4c9e-b646-dbb83b3db278" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 16:31:50 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-8ab9bd8c-c7e5-4030-8d9c-10bc5b800524 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eaae47b9-a059-49f6-9ae6-d7147003e2f2/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:31:50 user nova-compute[71731]: DEBUG nova.objects.instance [None req-8ab9bd8c-c7e5-4030-8d9c-10bc5b800524 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lazy-loading 'trusted_certs' on Instance uuid eaae47b9-a059-49f6-9ae6-d7147003e2f2 {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:31:50 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-8ab9bd8c-c7e5-4030-8d9c-10bc5b800524 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279 --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:31:50 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-1cbd883c-06ac-47dd-acfa-2f5baa8ec9ba tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:31:50 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-1cbd883c-06ac-47dd-acfa-2f5baa8ec9ba tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:31:50 user nova-compute[71731]: DEBUG nova.network.neutron [None req-b347c3f9-ba96-4152-b346-ddd7bd69468d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: 2956ab05-28ff-4c9e-b646-dbb83b3db278] Instance cache missing network info. {{(pid=71731) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 16:31:50 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-1cbd883c-06ac-47dd-acfa-2f5baa8ec9ba tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71731) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 16:31:50 user nova-compute[71731]: INFO nova.compute.claims [None req-1cbd883c-06ac-47dd-acfa-2f5baa8ec9ba tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] [instance: 64a9c052-89a9-48ba-80c9-13fb5ef22f0e] Claim successful on node user
Apr 13 16:31:50 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-8ab9bd8c-c7e5-4030-8d9c-10bc5b800524 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279 --force-share --output=json" returned: 0 in 0.144s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:31:50 user nova-compute[71731]: DEBUG nova.virt.disk.api [None req-8ab9bd8c-c7e5-4030-8d9c-10bc5b800524 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Checking if we can resize image /opt/stack/data/nova/instances/eaae47b9-a059-49f6-9ae6-d7147003e2f2/disk. size=1073741824 {{(pid=71731) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 16:31:50 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-8ab9bd8c-c7e5-4030-8d9c-10bc5b800524 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eaae47b9-a059-49f6-9ae6-d7147003e2f2/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:31:50 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-8ab9bd8c-c7e5-4030-8d9c-10bc5b800524 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eaae47b9-a059-49f6-9ae6-d7147003e2f2/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:31:50 user nova-compute[71731]: DEBUG nova.virt.disk.api [None req-8ab9bd8c-c7e5-4030-8d9c-10bc5b800524 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Cannot resize image /opt/stack/data/nova/instances/eaae47b9-a059-49f6-9ae6-d7147003e2f2/disk to a smaller size. {{(pid=71731) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 16:31:50 user nova-compute[71731]: DEBUG nova.objects.instance [None req-8ab9bd8c-c7e5-4030-8d9c-10bc5b800524 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lazy-loading 'migration_context' on Instance uuid eaae47b9-a059-49f6-9ae6-d7147003e2f2 {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:31:50 user nova-compute[71731]: DEBUG nova.virt.libvirt.vif [None req-8ab9bd8c-c7e5-4030-8d9c-10bc5b800524 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T16:24:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1335647489',display_name='tempest-AttachVolumeTestJSON-server-1335647489',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1335647489',id=17,image_ref='708622a9-7465-4492-ade8-b827198f7e30',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBWOy0oVQ9hC0pTOafixaz1QU1E5DFmqkYHL4O9l7OLTdaq0+Nt41+fxYUKgEMEMs0o2pxQBhqAzayIAyGV1IIb01ym4tkG3pd4D4/xbjIzoE586YH9dqYrXgxzYqNSiRA==',key_name='tempest-keypair-1534458766',keypairs=<?>,launch_index=0,launched_at=2023-04-13T16:24:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='24904988cf334657b084fd726c7ecf8f',ramdisk_id='',reservation_id='r-aer2ghdf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='708622a9-7465-4492-ade8-b827198f7e30',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-836650657',owner_user_name='tempest-AttachVolumeTestJSON-836650657-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T16:29:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='47fab402fb794a5a9281cfb7fe188813',uuid=eaae47b9-a059-49f6-9ae6-d7147003e2f2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "e9b2fcaa-f77b-4e5c-ad3c-797ce804a9ae", "address": "fa:16:3e:ff:85:92", "network": {"id": "79e9ef20-b14d-4850-b298-9d3ed4d10b90", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1756253617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24904988cf334657b084fd726c7ecf8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9b2fcaa-f7", "ovs_interfaceid": "e9b2fcaa-f77b-4e5c-ad3c-797ce804a9ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 16:31:50 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-8ab9bd8c-c7e5-4030-8d9c-10bc5b800524 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Converting VIF {"id": "e9b2fcaa-f77b-4e5c-ad3c-797ce804a9ae", "address": "fa:16:3e:ff:85:92", "network": {"id": "79e9ef20-b14d-4850-b298-9d3ed4d10b90", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1756253617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24904988cf334657b084fd726c7ecf8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9b2fcaa-f7", "ovs_interfaceid": "e9b2fcaa-f77b-4e5c-ad3c-797ce804a9ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 16:31:50 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-8ab9bd8c-c7e5-4030-8d9c-10bc5b800524 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ff:85:92,bridge_name='br-int',has_traffic_filtering=True,id=e9b2fcaa-f77b-4e5c-ad3c-797ce804a9ae,network=Network(79e9ef20-b14d-4850-b298-9d3ed4d10b90),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9b2fcaa-f7') {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 16:31:50 user nova-compute[71731]: DEBUG os_vif [None req-8ab9bd8c-c7e5-4030-8d9c-10bc5b800524 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:85:92,bridge_name='br-int',has_traffic_filtering=True,id=e9b2fcaa-f77b-4e5c-ad3c-797ce804a9ae,network=Network(79e9ef20-b14d-4850-b298-9d3ed4d10b90),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9b2fcaa-f7') {{(pid=71731) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 16:31:50 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:31:50 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:31:50 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 16:31:50 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:31:50 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape9b2fcaa-f7, may_exist=True) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:31:50 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape9b2fcaa-f7, col_values=(('external_ids', {'iface-id': 'e9b2fcaa-f77b-4e5c-ad3c-797ce804a9ae', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ff:85:92', 'vm-uuid': 'eaae47b9-a059-49f6-9ae6-d7147003e2f2'}),)) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:31:50 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:31:50 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 16:31:50 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:31:50 user nova-compute[71731]: INFO os_vif [None req-8ab9bd8c-c7e5-4030-8d9c-10bc5b800524 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:85:92,bridge_name='br-int',has_traffic_filtering=True,id=e9b2fcaa-f77b-4e5c-ad3c-797ce804a9ae,network=Network(79e9ef20-b14d-4850-b298-9d3ed4d10b90),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9b2fcaa-f7')
Apr 13 16:31:50 user nova-compute[71731]: DEBUG nova.compute.provider_tree [None req-1cbd883c-06ac-47dd-acfa-2f5baa8ec9ba tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Inventory has not changed in ProviderTree for provider: cb6b1a64-0c24-4e2d-af1e-16576ca9165c {{(pid=71731) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 16:31:50 user nova-compute[71731]: DEBUG nova.scheduler.client.report [None req-1cbd883c-06ac-47dd-acfa-2f5baa8ec9ba tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Inventory has not changed for provider cb6b1a64-0c24-4e2d-af1e-16576ca9165c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71731) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 16:31:51 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-1cbd883c-06ac-47dd-acfa-2f5baa8ec9ba tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.496s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:31:51 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1cbd883c-06ac-47dd-acfa-2f5baa8ec9ba tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] [instance: 64a9c052-89a9-48ba-80c9-13fb5ef22f0e] Start building networks asynchronously for instance. {{(pid=71731) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 16:31:51 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1cbd883c-06ac-47dd-acfa-2f5baa8ec9ba tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] [instance: 64a9c052-89a9-48ba-80c9-13fb5ef22f0e] Allocating IP information in the background. {{(pid=71731) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 16:31:51 user nova-compute[71731]: DEBUG nova.network.neutron [None req-1cbd883c-06ac-47dd-acfa-2f5baa8ec9ba tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] [instance: 64a9c052-89a9-48ba-80c9-13fb5ef22f0e] allocate_for_instance() {{(pid=71731) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 16:31:51 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-1cbd883c-06ac-47dd-acfa-2f5baa8ec9ba tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] [instance: 64a9c052-89a9-48ba-80c9-13fb5ef22f0e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 16:31:51 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1cbd883c-06ac-47dd-acfa-2f5baa8ec9ba tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] [instance: 64a9c052-89a9-48ba-80c9-13fb5ef22f0e] Start building block device mappings for instance. {{(pid=71731) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 16:31:51 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1cbd883c-06ac-47dd-acfa-2f5baa8ec9ba tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] [instance: 64a9c052-89a9-48ba-80c9-13fb5ef22f0e] Start spawning the instance on the hypervisor. {{(pid=71731) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 16:31:51 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-1cbd883c-06ac-47dd-acfa-2f5baa8ec9ba tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] [instance: 64a9c052-89a9-48ba-80c9-13fb5ef22f0e] Creating instance directory {{(pid=71731) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 16:31:51 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-1cbd883c-06ac-47dd-acfa-2f5baa8ec9ba tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] [instance: 64a9c052-89a9-48ba-80c9-13fb5ef22f0e] Creating image(s)
Apr 13 16:31:51 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-1cbd883c-06ac-47dd-acfa-2f5baa8ec9ba tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Acquiring lock "/opt/stack/data/nova/instances/64a9c052-89a9-48ba-80c9-13fb5ef22f0e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:31:51 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-1cbd883c-06ac-47dd-acfa-2f5baa8ec9ba tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Lock "/opt/stack/data/nova/instances/64a9c052-89a9-48ba-80c9-13fb5ef22f0e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:31:51 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-1cbd883c-06ac-47dd-acfa-2f5baa8ec9ba tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Lock "/opt/stack/data/nova/instances/64a9c052-89a9-48ba-80c9-13fb5ef22f0e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:31:51 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-1cbd883c-06ac-47dd-acfa-2f5baa8ec9ba tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Acquiring lock "8a473598334c2a118e9cfdc58efc2d7cf3d2962e" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:31:51 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-1cbd883c-06ac-47dd-acfa-2f5baa8ec9ba tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Lock "8a473598334c2a118e9cfdc58efc2d7cf3d2962e" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:31:51 user nova-compute[71731]: DEBUG nova.network.neutron [None req-b347c3f9-ba96-4152-b346-ddd7bd69468d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: 2956ab05-28ff-4c9e-b646-dbb83b3db278] Updating instance_info_cache with network_info: [{"id": "84df62e9-af7c-4e62-83da-b43b511be2a0", "address": "fa:16:3e:66:e8:40", "network": {"id": "5a7877ff-8230-470b-90b5-e5dcfc8f0cee", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-779403873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2d09a74bf684a9fb1dd1e95d6c23f3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84df62e9-af", "ovs_interfaceid": "84df62e9-af7c-4e62-83da-b43b511be2a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:31:51 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-1cbd883c-06ac-47dd-acfa-2f5baa8ec9ba tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8a473598334c2a118e9cfdc58efc2d7cf3d2962e.part --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:31:51 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:31:52 user nova-compute[71731]: DEBUG nova.policy [None req-1cbd883c-06ac-47dd-acfa-2f5baa8ec9ba tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f523740272844b6eb236477d0b116ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7100b359f341759cb6f6753e1539a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71731) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 16:31:52 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-b347c3f9-ba96-4152-b346-ddd7bd69468d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Releasing lock "refresh_cache-2956ab05-28ff-4c9e-b646-dbb83b3db278" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 16:31:52 user nova-compute[71731]: DEBUG nova.compute.manager [None req-b347c3f9-ba96-4152-b346-ddd7bd69468d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: 2956ab05-28ff-4c9e-b646-dbb83b3db278] Instance network_info: |[{"id": "84df62e9-af7c-4e62-83da-b43b511be2a0", "address": "fa:16:3e:66:e8:40", "network": {"id": "5a7877ff-8230-470b-90b5-e5dcfc8f0cee", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-779403873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2d09a74bf684a9fb1dd1e95d6c23f3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84df62e9-af", "ovs_interfaceid": "84df62e9-af7c-4e62-83da-b43b511be2a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71731) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 16:31:52 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-cccc1a35-d4ce-44c5-b279-3a97749c6ef0 req-780951a5-ac0f-4c64-ada0-560da721f61f service nova] Acquired lock "refresh_cache-2956ab05-28ff-4c9e-b646-dbb83b3db278" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 16:31:52 user nova-compute[71731]: DEBUG nova.network.neutron [req-cccc1a35-d4ce-44c5-b279-3a97749c6ef0 req-780951a5-ac0f-4c64-ada0-560da721f61f service nova] [instance: 2956ab05-28ff-4c9e-b646-dbb83b3db278] Refreshing network info cache for port 84df62e9-af7c-4e62-83da-b43b511be2a0 {{(pid=71731) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 16:31:52 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-1cbd883c-06ac-47dd-acfa-2f5baa8ec9ba tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8a473598334c2a118e9cfdc58efc2d7cf3d2962e.part --force-share --output=json" returned: 0 in 0.162s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:31:52 user nova-compute[71731]: DEBUG nova.virt.images [None req-1cbd883c-06ac-47dd-acfa-2f5baa8ec9ba tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] 2d22499e-4681-4f01-8d24-292a6af73d70 was qcow2, converting to raw {{(pid=71731) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 13 16:31:52 user nova-compute[71731]: DEBUG nova.privsep.utils [None req-1cbd883c-06ac-47dd-acfa-2f5baa8ec9ba tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71731) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 13 16:31:52 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-1cbd883c-06ac-47dd-acfa-2f5baa8ec9ba tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/8a473598334c2a118e9cfdc58efc2d7cf3d2962e.part /opt/stack/data/nova/instances/_base/8a473598334c2a118e9cfdc58efc2d7cf3d2962e.converted {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:31:52 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:31:52 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:31:52 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:31:52 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-1cbd883c-06ac-47dd-acfa-2f5baa8ec9ba tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/8a473598334c2a118e9cfdc58efc2d7cf3d2962e.part /opt/stack/data/nova/instances/_base/8a473598334c2a118e9cfdc58efc2d7cf3d2962e.converted" returned: 0 in 0.234s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:31:52 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-1cbd883c-06ac-47dd-acfa-2f5baa8ec9ba tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8a473598334c2a118e9cfdc58efc2d7cf3d2962e.converted --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:31:52 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-1cbd883c-06ac-47dd-acfa-2f5baa8ec9ba tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8a473598334c2a118e9cfdc58efc2d7cf3d2962e.converted --force-share --output=json" returned: 0 in 0.167s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:31:52 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-1cbd883c-06ac-47dd-acfa-2f5baa8ec9ba tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Lock "8a473598334c2a118e9cfdc58efc2d7cf3d2962e" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.282s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:31:52 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-1cbd883c-06ac-47dd-acfa-2f5baa8ec9ba tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8a473598334c2a118e9cfdc58efc2d7cf3d2962e --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:31:52 user nova-compute[71731]: DEBUG nova.compute.manager [req-6efeb63d-9450-4a44-b040-be765a604ef6 req-67a790d5-50c6-4d0f-8f20-8ebb8db3c2f3 service nova] [instance: eaae47b9-a059-49f6-9ae6-d7147003e2f2] Received event network-vif-plugged-e9b2fcaa-f77b-4e5c-ad3c-797ce804a9ae {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:31:52 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-6efeb63d-9450-4a44-b040-be765a604ef6 req-67a790d5-50c6-4d0f-8f20-8ebb8db3c2f3 service nova] Acquiring lock "eaae47b9-a059-49f6-9ae6-d7147003e2f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:31:52 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-6efeb63d-9450-4a44-b040-be765a604ef6 req-67a790d5-50c6-4d0f-8f20-8ebb8db3c2f3 service nova] Lock "eaae47b9-a059-49f6-9ae6-d7147003e2f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:31:52 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-6efeb63d-9450-4a44-b040-be765a604ef6 req-67a790d5-50c6-4d0f-8f20-8ebb8db3c2f3 service nova] Lock "eaae47b9-a059-49f6-9ae6-d7147003e2f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:31:52 user nova-compute[71731]: DEBUG nova.compute.manager [req-6efeb63d-9450-4a44-b040-be765a604ef6 req-67a790d5-50c6-4d0f-8f20-8ebb8db3c2f3 service nova] [instance: eaae47b9-a059-49f6-9ae6-d7147003e2f2] No waiting events found dispatching network-vif-plugged-e9b2fcaa-f77b-4e5c-ad3c-797ce804a9ae {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:31:52 user nova-compute[71731]: WARNING nova.compute.manager [req-6efeb63d-9450-4a44-b040-be765a604ef6 req-67a790d5-50c6-4d0f-8f20-8ebb8db3c2f3 service nova] [instance: eaae47b9-a059-49f6-9ae6-d7147003e2f2] Received unexpected event network-vif-plugged-e9b2fcaa-f77b-4e5c-ad3c-797ce804a9ae for instance with vm_state stopped and task_state powering-on.
Apr 13 16:31:52 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-1cbd883c-06ac-47dd-acfa-2f5baa8ec9ba tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8a473598334c2a118e9cfdc58efc2d7cf3d2962e --force-share --output=json" returned: 0 in 0.150s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:31:52 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-1cbd883c-06ac-47dd-acfa-2f5baa8ec9ba tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Acquiring lock "8a473598334c2a118e9cfdc58efc2d7cf3d2962e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:31:52 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-1cbd883c-06ac-47dd-acfa-2f5baa8ec9ba tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Lock "8a473598334c2a118e9cfdc58efc2d7cf3d2962e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:31:52 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-1cbd883c-06ac-47dd-acfa-2f5baa8ec9ba tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8a473598334c2a118e9cfdc58efc2d7cf3d2962e --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:31:52 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:31:52 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-1cbd883c-06ac-47dd-acfa-2f5baa8ec9ba tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8a473598334c2a118e9cfdc58efc2d7cf3d2962e --force-share --output=json" returned: 0 in 0.140s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:31:52 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-1cbd883c-06ac-47dd-acfa-2f5baa8ec9ba tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8a473598334c2a118e9cfdc58efc2d7cf3d2962e,backing_fmt=raw /opt/stack/data/nova/instances/64a9c052-89a9-48ba-80c9-13fb5ef22f0e/disk 1073741824 {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:31:52 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:31:52 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-1cbd883c-06ac-47dd-acfa-2f5baa8ec9ba tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8a473598334c2a118e9cfdc58efc2d7cf3d2962e,backing_fmt=raw /opt/stack/data/nova/instances/64a9c052-89a9-48ba-80c9-13fb5ef22f0e/disk 1073741824" returned: 0 in 0.052s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:31:52 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-1cbd883c-06ac-47dd-acfa-2f5baa8ec9ba tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Lock "8a473598334c2a118e9cfdc58efc2d7cf3d2962e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.196s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:31:52 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-1cbd883c-06ac-47dd-acfa-2f5baa8ec9ba tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8a473598334c2a118e9cfdc58efc2d7cf3d2962e --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:31:53 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-1cbd883c-06ac-47dd-acfa-2f5baa8ec9ba tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8a473598334c2a118e9cfdc58efc2d7cf3d2962e --force-share --output=json" returned: 0 in 0.134s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:31:53 user nova-compute[71731]: DEBUG nova.objects.instance [None req-1cbd883c-06ac-47dd-acfa-2f5baa8ec9ba tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Lazy-loading 'migration_context' on Instance uuid 64a9c052-89a9-48ba-80c9-13fb5ef22f0e {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:31:53 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-1cbd883c-06ac-47dd-acfa-2f5baa8ec9ba tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] [instance: 64a9c052-89a9-48ba-80c9-13fb5ef22f0e] Created local disks {{(pid=71731) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 16:31:53 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-1cbd883c-06ac-47dd-acfa-2f5baa8ec9ba tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] [instance: 64a9c052-89a9-48ba-80c9-13fb5ef22f0e] Ensure instance console log exists: /opt/stack/data/nova/instances/64a9c052-89a9-48ba-80c9-13fb5ef22f0e/console.log {{(pid=71731) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 16:31:53 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-1cbd883c-06ac-47dd-acfa-2f5baa8ec9ba tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:31:53 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-1cbd883c-06ac-47dd-acfa-2f5baa8ec9ba tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:31:53 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-1cbd883c-06ac-47dd-acfa-2f5baa8ec9ba tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:31:53 user nova-compute[71731]: DEBUG os_brick.utils [None req-b347c3f9-ba96-4152-b346-ddd7bd69468d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 16:31:53 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:31:53 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:31:53 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddcc9087-b221-47ec-9c44-9fde2d931d7e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:81501d91421\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:31:53 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:31:53 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:31:53 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbb065a8-9a60-4a39-a797-c8812bf05e40]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:31:53 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:31:53 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:31:53 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8320240-e892-461b-adc2-ead3ce258043]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:31:53 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f6238f6-af2c-44be-9e17-592cfa3ca801]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:31:53 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-b347c3f9-ba96-4152-b346-ddd7bd69468d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Running cmd (subprocess): nvme version {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:31:53 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-b347c3f9-ba96-4152-b346-ddd7bd69468d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] 'nvme version' failed. Not Retrying. {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 16:31:53 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b347c3f9-ba96-4152-b346-ddd7bd69468d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] nvme not present on system {{(pid=71731) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 16:31:53 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:31:53 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 16:31:53 user nova-compute[71731]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 16:31:53 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[71614876-49a7-4999-9248-231d0b3c10e5]: (4, '') {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:31:53 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.lightos [None req-b347c3f9-ba96-4152-b346-ddd7bd69468d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71731) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 16:31:53 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.lightos [None req-b347c3f9-ba96-4152-b346-ddd7bd69468d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71731) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 16:31:53 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.lightos [None req-b347c3f9-ba96-4152-b346-ddd7bd69468d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] LIGHTOS: no hostnqn found. {{(pid=71731) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 16:31:53 user nova-compute[71731]: DEBUG os_brick.utils [None req-b347c3f9-ba96-4152-b346-ddd7bd69468d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:81501d91421', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 16:31:53 user nova-compute[71731]: DEBUG nova.virt.block_device [None req-b347c3f9-ba96-4152-b346-ddd7bd69468d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: 2956ab05-28ff-4c9e-b646-dbb83b3db278] Updating existing volume attachment record: 37249968-badc-4f49-a9e0-ad66fe289877 {{(pid=71731) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 16:31:53 user nova-compute[71731]: DEBUG nova.network.neutron [req-cccc1a35-d4ce-44c5-b279-3a97749c6ef0 req-780951a5-ac0f-4c64-ada0-560da721f61f service nova] [instance: 2956ab05-28ff-4c9e-b646-dbb83b3db278] Updated VIF entry in instance network info cache for port 84df62e9-af7c-4e62-83da-b43b511be2a0. {{(pid=71731) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 16:31:53 user nova-compute[71731]: DEBUG nova.network.neutron [req-cccc1a35-d4ce-44c5-b279-3a97749c6ef0 req-780951a5-ac0f-4c64-ada0-560da721f61f service nova] [instance: 2956ab05-28ff-4c9e-b646-dbb83b3db278] Updating instance_info_cache with network_info: [{"id": "84df62e9-af7c-4e62-83da-b43b511be2a0", "address": "fa:16:3e:66:e8:40", "network": {"id": "5a7877ff-8230-470b-90b5-e5dcfc8f0cee", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-779403873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2d09a74bf684a9fb1dd1e95d6c23f3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84df62e9-af", "ovs_interfaceid": "84df62e9-af7c-4e62-83da-b43b511be2a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:31:53 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-cccc1a35-d4ce-44c5-b279-3a97749c6ef0 req-780951a5-ac0f-4c64-ada0-560da721f61f service nova] Releasing lock "refresh_cache-2956ab05-28ff-4c9e-b646-dbb83b3db278" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 16:31:54 user nova-compute[71731]: DEBUG nova.network.neutron [None req-1cbd883c-06ac-47dd-acfa-2f5baa8ec9ba tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] [instance: 64a9c052-89a9-48ba-80c9-13fb5ef22f0e] Successfully created port: 5128334f-7255-4a56-9e8b-1151027d219b {{(pid=71731) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 16:31:54 user nova-compute[71731]: DEBUG nova.virt.driver [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Emitting event <LifecycleEvent: 1681403514.359899, eaae47b9-a059-49f6-9ae6-d7147003e2f2 => Resumed> {{(pid=71731) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 16:31:54 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: eaae47b9-a059-49f6-9ae6-d7147003e2f2] VM Resumed (Lifecycle Event)
Apr 13 16:31:54 user nova-compute[71731]: DEBUG nova.compute.manager [None req-8ab9bd8c-c7e5-4030-8d9c-10bc5b800524 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] [instance: eaae47b9-a059-49f6-9ae6-d7147003e2f2] Instance event wait completed in 0 seconds for  {{(pid=71731) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 16:31:54 user nova-compute[71731]: INFO nova.virt.libvirt.driver [-] [instance: eaae47b9-a059-49f6-9ae6-d7147003e2f2] Instance rebooted successfully.
Apr 13 16:31:54 user nova-compute[71731]: DEBUG nova.compute.manager [None req-8ab9bd8c-c7e5-4030-8d9c-10bc5b800524 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] [instance: eaae47b9-a059-49f6-9ae6-d7147003e2f2] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:31:54 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: eaae47b9-a059-49f6-9ae6-d7147003e2f2] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:31:54 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: eaae47b9-a059-49f6-9ae6-d7147003e2f2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=71731) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 16:31:54 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: eaae47b9-a059-49f6-9ae6-d7147003e2f2] During sync_power_state the instance has a pending task (powering-on). Skip.
Apr 13 16:31:54 user nova-compute[71731]: DEBUG nova.virt.driver [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Emitting event <LifecycleEvent: 1681403514.3618374, eaae47b9-a059-49f6-9ae6-d7147003e2f2 => Started> {{(pid=71731) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 16:31:54 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: eaae47b9-a059-49f6-9ae6-d7147003e2f2] VM Started (Lifecycle Event)
Apr 13 16:31:54 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: eaae47b9-a059-49f6-9ae6-d7147003e2f2] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:31:54 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: eaae47b9-a059-49f6-9ae6-d7147003e2f2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=71731) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 16:31:54 user nova-compute[71731]: DEBUG nova.compute.manager [req-80e5ba1f-6707-4c10-b3bf-3652864e2146 req-db190321-7eb0-4cf9-918b-d12ab7dc39dd service nova] [instance: eaae47b9-a059-49f6-9ae6-d7147003e2f2] Received event network-vif-plugged-e9b2fcaa-f77b-4e5c-ad3c-797ce804a9ae {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:31:54 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-80e5ba1f-6707-4c10-b3bf-3652864e2146 req-db190321-7eb0-4cf9-918b-d12ab7dc39dd service nova] Acquiring lock "eaae47b9-a059-49f6-9ae6-d7147003e2f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:31:54 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-80e5ba1f-6707-4c10-b3bf-3652864e2146 req-db190321-7eb0-4cf9-918b-d12ab7dc39dd service nova] Lock "eaae47b9-a059-49f6-9ae6-d7147003e2f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:31:54 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-80e5ba1f-6707-4c10-b3bf-3652864e2146 req-db190321-7eb0-4cf9-918b-d12ab7dc39dd service nova] Lock "eaae47b9-a059-49f6-9ae6-d7147003e2f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:31:54 user nova-compute[71731]: DEBUG nova.compute.manager [req-80e5ba1f-6707-4c10-b3bf-3652864e2146 req-db190321-7eb0-4cf9-918b-d12ab7dc39dd service nova] [instance: eaae47b9-a059-49f6-9ae6-d7147003e2f2] No waiting events found dispatching network-vif-plugged-e9b2fcaa-f77b-4e5c-ad3c-797ce804a9ae {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:31:54 user nova-compute[71731]: WARNING nova.compute.manager [req-80e5ba1f-6707-4c10-b3bf-3652864e2146 req-db190321-7eb0-4cf9-918b-d12ab7dc39dd service nova] [instance: eaae47b9-a059-49f6-9ae6-d7147003e2f2] Received unexpected event network-vif-plugged-e9b2fcaa-f77b-4e5c-ad3c-797ce804a9ae for instance with vm_state active and task_state None.
Apr 13 16:31:54 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-f5944cc3-0bfe-4afc-80f2-fb850e13932f tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Acquiring lock "35b23303-e373-4f35-b7ee-76e6815073ce" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:31:54 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-f5944cc3-0bfe-4afc-80f2-fb850e13932f tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lock "35b23303-e373-4f35-b7ee-76e6815073ce" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:31:54 user nova-compute[71731]: DEBUG nova.compute.manager [None req-f5944cc3-0bfe-4afc-80f2-fb850e13932f tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] [instance: 35b23303-e373-4f35-b7ee-76e6815073ce] Starting instance... {{(pid=71731) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 16:31:54 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-f5944cc3-0bfe-4afc-80f2-fb850e13932f tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:31:54 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-f5944cc3-0bfe-4afc-80f2-fb850e13932f tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:31:54 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-f5944cc3-0bfe-4afc-80f2-fb850e13932f tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71731) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 16:31:54 user nova-compute[71731]: INFO nova.compute.claims [None req-f5944cc3-0bfe-4afc-80f2-fb850e13932f tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] [instance: 35b23303-e373-4f35-b7ee-76e6815073ce] Claim successful on node user
Apr 13 16:31:55 user nova-compute[71731]: DEBUG nova.network.neutron [None req-1cbd883c-06ac-47dd-acfa-2f5baa8ec9ba tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] [instance: 64a9c052-89a9-48ba-80c9-13fb5ef22f0e] Successfully updated port: 5128334f-7255-4a56-9e8b-1151027d219b {{(pid=71731) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 16:31:55 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-1cbd883c-06ac-47dd-acfa-2f5baa8ec9ba tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Acquiring lock "refresh_cache-64a9c052-89a9-48ba-80c9-13fb5ef22f0e" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 16:31:55 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-1cbd883c-06ac-47dd-acfa-2f5baa8ec9ba tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Acquired lock "refresh_cache-64a9c052-89a9-48ba-80c9-13fb5ef22f0e" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 16:31:55 user nova-compute[71731]: DEBUG nova.network.neutron [None req-1cbd883c-06ac-47dd-acfa-2f5baa8ec9ba tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] [instance: 64a9c052-89a9-48ba-80c9-13fb5ef22f0e] Building network info cache for instance {{(pid=71731) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 16:31:55 user nova-compute[71731]: DEBUG nova.compute.manager [req-6ca6dac9-ec5d-4652-83b2-2c89f825f1cf req-310e95e7-b9d2-4409-b6ac-94ad8a9f06ee service nova] [instance: 64a9c052-89a9-48ba-80c9-13fb5ef22f0e] Received event network-changed-5128334f-7255-4a56-9e8b-1151027d219b {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:31:55 user nova-compute[71731]: DEBUG nova.compute.manager [req-6ca6dac9-ec5d-4652-83b2-2c89f825f1cf req-310e95e7-b9d2-4409-b6ac-94ad8a9f06ee service nova] [instance: 64a9c052-89a9-48ba-80c9-13fb5ef22f0e] Refreshing instance network info cache due to event network-changed-5128334f-7255-4a56-9e8b-1151027d219b. {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 16:31:55 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-6ca6dac9-ec5d-4652-83b2-2c89f825f1cf req-310e95e7-b9d2-4409-b6ac-94ad8a9f06ee service nova] Acquiring lock "refresh_cache-64a9c052-89a9-48ba-80c9-13fb5ef22f0e" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 16:31:55 user nova-compute[71731]: DEBUG nova.network.neutron [None req-1cbd883c-06ac-47dd-acfa-2f5baa8ec9ba tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] [instance: 64a9c052-89a9-48ba-80c9-13fb5ef22f0e] Instance cache missing network info. {{(pid=71731) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 16:31:55 user nova-compute[71731]: DEBUG nova.compute.provider_tree [None req-f5944cc3-0bfe-4afc-80f2-fb850e13932f tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Inventory has not changed in ProviderTree for provider: cb6b1a64-0c24-4e2d-af1e-16576ca9165c {{(pid=71731) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 16:31:55 user nova-compute[71731]: DEBUG nova.scheduler.client.report [None req-f5944cc3-0bfe-4afc-80f2-fb850e13932f tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Inventory has not changed for provider cb6b1a64-0c24-4e2d-af1e-16576ca9165c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71731) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 16:31:55 user nova-compute[71731]: DEBUG nova.network.neutron [None req-1cbd883c-06ac-47dd-acfa-2f5baa8ec9ba tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] [instance: 64a9c052-89a9-48ba-80c9-13fb5ef22f0e] Updating instance_info_cache with network_info: [{"id": "5128334f-7255-4a56-9e8b-1151027d219b", "address": "fa:16:3e:fe:54:1c", "network": {"id": "11386312-9ac6-4252-ab98-b3298a08599c", "bridge": "br-int", "label": "tempest-TestStampPattern-1747654565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb7100b359f341759cb6f6753e1539a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5128334f-72", "ovs_interfaceid": "5128334f-7255-4a56-9e8b-1151027d219b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:31:55 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-f5944cc3-0bfe-4afc-80f2-fb850e13932f tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.460s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:31:55 user nova-compute[71731]: DEBUG nova.compute.manager [None req-f5944cc3-0bfe-4afc-80f2-fb850e13932f tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] [instance: 35b23303-e373-4f35-b7ee-76e6815073ce] Start building networks asynchronously for instance. {{(pid=71731) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 16:31:55 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-1cbd883c-06ac-47dd-acfa-2f5baa8ec9ba tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Releasing lock "refresh_cache-64a9c052-89a9-48ba-80c9-13fb5ef22f0e" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 16:31:55 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1cbd883c-06ac-47dd-acfa-2f5baa8ec9ba tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] [instance: 64a9c052-89a9-48ba-80c9-13fb5ef22f0e] Instance network_info: |[{"id": "5128334f-7255-4a56-9e8b-1151027d219b", "address": "fa:16:3e:fe:54:1c", "network": {"id": "11386312-9ac6-4252-ab98-b3298a08599c", "bridge": "br-int", "label": "tempest-TestStampPattern-1747654565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb7100b359f341759cb6f6753e1539a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5128334f-72", "ovs_interfaceid": "5128334f-7255-4a56-9e8b-1151027d219b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71731) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 16:31:55 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-6ca6dac9-ec5d-4652-83b2-2c89f825f1cf req-310e95e7-b9d2-4409-b6ac-94ad8a9f06ee service nova] Acquired lock "refresh_cache-64a9c052-89a9-48ba-80c9-13fb5ef22f0e" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 16:31:55 user nova-compute[71731]: DEBUG nova.network.neutron [req-6ca6dac9-ec5d-4652-83b2-2c89f825f1cf req-310e95e7-b9d2-4409-b6ac-94ad8a9f06ee service nova] [instance: 64a9c052-89a9-48ba-80c9-13fb5ef22f0e] Refreshing network info cache for port 5128334f-7255-4a56-9e8b-1151027d219b {{(pid=71731) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 16:31:55 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-1cbd883c-06ac-47dd-acfa-2f5baa8ec9ba tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] [instance: 64a9c052-89a9-48ba-80c9-13fb5ef22f0e] Start _get_guest_xml network_info=[{"id": "5128334f-7255-4a56-9e8b-1151027d219b", "address": "fa:16:3e:fe:54:1c", "network": {"id": "11386312-9ac6-4252-ab98-b3298a08599c", "bridge": "br-int", "label": "tempest-TestStampPattern-1747654565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb7100b359f341759cb6f6753e1539a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5128334f-72", "ovs_interfaceid": "5128334f-7255-4a56-9e8b-1151027d219b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='2903b056d29229a6d8515ac728b1f6a5',container_format='bare',created_at=2023-04-13T16:31:40Z,direct_url=<?>,disk_format='qcow2',id=2d22499e-4681-4f01-8d24-292a6af73d70,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1791398459',owner='bb7100b359f341759cb6f6753e1539a8',properties=ImageMetaProps,protected=<?>,size=38666240,status='active',tags=<?>,updated_at=2023-04-13T16:31:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'device_type': 'disk', 'encrypted': False, 'disk_bus': 'virtio', 'guest_format': None, 'encryption_options': None, 'image_id': '2d22499e-4681-4f01-8d24-292a6af73d70'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71731) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 16:31:55 user nova-compute[71731]: WARNING nova.virt.libvirt.driver [None req-1cbd883c-06ac-47dd-acfa-2f5baa8ec9ba tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 16:31:55 user nova-compute[71731]: WARNING nova.virt.libvirt.driver [None req-1cbd883c-06ac-47dd-acfa-2f5baa8ec9ba tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 16:31:55 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-1cbd883c-06ac-47dd-acfa-2f5baa8ec9ba tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71731) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 16:31:55 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-1cbd883c-06ac-47dd-acfa-2f5baa8ec9ba tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T16:17:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='2903b056d29229a6d8515ac728b1f6a5',container_format='bare',created_at=2023-04-13T16:31:40Z,direct_url=<?>,disk_format='qcow2',id=2d22499e-4681-4f01-8d24-292a6af73d70,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1791398459',owner='bb7100b359f341759cb6f6753e1539a8',properties=ImageMetaProps,protected=<?>,size=38666240,status='active',tags=<?>,updated_at=2023-04-13T16:31:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 16:31:55 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-1cbd883c-06ac-47dd-acfa-2f5baa8ec9ba tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Flavor limits 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 16:31:55 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-1cbd883c-06ac-47dd-acfa-2f5baa8ec9ba tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Image limits 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 16:31:55 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-1cbd883c-06ac-47dd-acfa-2f5baa8ec9ba tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Flavor pref 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 16:31:55 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-1cbd883c-06ac-47dd-acfa-2f5baa8ec9ba tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Image pref 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 16:31:55 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-1cbd883c-06ac-47dd-acfa-2f5baa8ec9ba tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 16:31:55 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-1cbd883c-06ac-47dd-acfa-2f5baa8ec9ba tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 16:31:55 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-1cbd883c-06ac-47dd-acfa-2f5baa8ec9ba tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71731) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 16:31:55 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-1cbd883c-06ac-47dd-acfa-2f5baa8ec9ba tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Got 1 possible topologies {{(pid=71731) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 16:31:55 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-1cbd883c-06ac-47dd-acfa-2f5baa8ec9ba tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 16:31:55 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-1cbd883c-06ac-47dd-acfa-2f5baa8ec9ba tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 16:31:55 user nova-compute[71731]: DEBUG nova.virt.libvirt.vif [None req-1cbd883c-06ac-47dd-acfa-2f5baa8ec9ba tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T16:31:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-228552911',display_name='tempest-TestStampPattern-server-228552911',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-teststamppattern-server-228552911',id=28,image_ref='2d22499e-4681-4f01-8d24-292a6af73d70',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL2QPQmeuQ3QMNshoDoMdPG3OSftqyMCUtV3Pr6v+/rhaN+olW1hWBQn7y9Ew+sQSET4+DncPzqCVC4fuapQVvR4RUPvk9/ysi6s66mNzl8HmL0L6OHOtrjR4F2tcMOgTw==',key_name='tempest-TestStampPattern-792944514',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bb7100b359f341759cb6f6753e1539a8',ramdisk_id='',reservation_id='r-lplra19f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='708622a9-7465-4492-ade8-b827198f7e30',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='32b18558-8bf2-4def-bc70-81c4e38fcc6f',image_min_disk='1',image_min_ram='0',image_owner_id='bb7100b359f341759cb6f6753e1539a8',image_owner_project_name='tempest-TestStampPattern-96878995',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-96878995-project-member',image_user_id='f523740272844b6eb236477d0b116ddb',network_allocated='True',owner_project_name='tempest-TestStampPattern-96878995',owner_user_name='tempest-TestStampPattern-96878995-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T16:31:51Z,user_data=None,user_id='f523740272844b6eb236477d0b116ddb',uuid=64a9c052-89a9-48ba-80c9-13fb5ef22f0e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5128334f-7255-4a56-9e8b-1151027d219b", "address": "fa:16:3e:fe:54:1c", "network": {"id": "11386312-9ac6-4252-ab98-b3298a08599c", "bridge": "br-int", "label": "tempest-TestStampPattern-1747654565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb7100b359f341759cb6f6753e1539a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5128334f-72", "ovs_interfaceid": "5128334f-7255-4a56-9e8b-1151027d219b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71731) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 16:31:55 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-1cbd883c-06ac-47dd-acfa-2f5baa8ec9ba tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Converting VIF {"id": "5128334f-7255-4a56-9e8b-1151027d219b", "address": "fa:16:3e:fe:54:1c", "network": {"id": "11386312-9ac6-4252-ab98-b3298a08599c", "bridge": "br-int", "label": "tempest-TestStampPattern-1747654565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb7100b359f341759cb6f6753e1539a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5128334f-72", "ovs_interfaceid": "5128334f-7255-4a56-9e8b-1151027d219b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 16:31:55 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-1cbd883c-06ac-47dd-acfa-2f5baa8ec9ba tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fe:54:1c,bridge_name='br-int',has_traffic_filtering=True,id=5128334f-7255-4a56-9e8b-1151027d219b,network=Network(11386312-9ac6-4252-ab98-b3298a08599c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5128334f-72') {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 16:31:55 user nova-compute[71731]: DEBUG nova.objects.instance [None req-1cbd883c-06ac-47dd-acfa-2f5baa8ec9ba tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Lazy-loading 'pci_devices' on Instance uuid 64a9c052-89a9-48ba-80c9-13fb5ef22f0e {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:31:55 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-1cbd883c-06ac-47dd-acfa-2f5baa8ec9ba tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] [instance: 64a9c052-89a9-48ba-80c9-13fb5ef22f0e] End _get_guest_xml xml=<domain type="kvm">
Apr 13 16:31:55 user nova-compute[71731]:   <uuid>64a9c052-89a9-48ba-80c9-13fb5ef22f0e</uuid>
Apr 13 16:31:55 user nova-compute[71731]:   <name>instance-0000001c</name>
Apr 13 16:31:55 user nova-compute[71731]:   <memory>131072</memory>
Apr 13 16:31:55 user nova-compute[71731]:   <vcpu>1</vcpu>
Apr 13 16:31:55 user nova-compute[71731]:   <metadata>
Apr 13 16:31:55 user nova-compute[71731]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 16:31:55 user nova-compute[71731]:       <nova:package version="0.0.0"/>
Apr 13 16:31:55 user nova-compute[71731]:       <nova:name>tempest-TestStampPattern-server-228552911</nova:name>
Apr 13 16:31:55 user nova-compute[71731]:       <nova:creationTime>2023-04-13 16:31:55</nova:creationTime>
Apr 13 16:31:55 user nova-compute[71731]:       <nova:flavor name="m1.nano">
Apr 13 16:31:55 user nova-compute[71731]:         <nova:memory>128</nova:memory>
Apr 13 16:31:55 user nova-compute[71731]:         <nova:disk>1</nova:disk>
Apr 13 16:31:55 user nova-compute[71731]:         <nova:swap>0</nova:swap>
Apr 13 16:31:55 user nova-compute[71731]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 16:31:55 user nova-compute[71731]:         <nova:vcpus>1</nova:vcpus>
Apr 13 16:31:55 user nova-compute[71731]:       </nova:flavor>
Apr 13 16:31:55 user nova-compute[71731]:       <nova:owner>
Apr 13 16:31:55 user nova-compute[71731]:         <nova:user uuid="f523740272844b6eb236477d0b116ddb">tempest-TestStampPattern-96878995-project-member</nova:user>
Apr 13 16:31:55 user nova-compute[71731]:         <nova:project uuid="bb7100b359f341759cb6f6753e1539a8">tempest-TestStampPattern-96878995</nova:project>
Apr 13 16:31:55 user nova-compute[71731]:       </nova:owner>
Apr 13 16:31:55 user nova-compute[71731]:       <nova:root type="image" uuid="2d22499e-4681-4f01-8d24-292a6af73d70"/>
Apr 13 16:31:55 user nova-compute[71731]:       <nova:ports>
Apr 13 16:31:55 user nova-compute[71731]:         <nova:port uuid="5128334f-7255-4a56-9e8b-1151027d219b">
Apr 13 16:31:55 user nova-compute[71731]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Apr 13 16:31:55 user nova-compute[71731]:         </nova:port>
Apr 13 16:31:55 user nova-compute[71731]:       </nova:ports>
Apr 13 16:31:55 user nova-compute[71731]:     </nova:instance>
Apr 13 16:31:55 user nova-compute[71731]:   </metadata>
Apr 13 16:31:55 user nova-compute[71731]:   <sysinfo type="smbios">
Apr 13 16:31:55 user nova-compute[71731]:     <system>
Apr 13 16:31:55 user nova-compute[71731]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 16:31:55 user nova-compute[71731]:       <entry name="product">OpenStack Nova</entry>
Apr 13 16:31:55 user nova-compute[71731]:       <entry name="version">0.0.0</entry>
Apr 13 16:31:55 user nova-compute[71731]:       <entry name="serial">64a9c052-89a9-48ba-80c9-13fb5ef22f0e</entry>
Apr 13 16:31:55 user nova-compute[71731]:       <entry name="uuid">64a9c052-89a9-48ba-80c9-13fb5ef22f0e</entry>
Apr 13 16:31:55 user nova-compute[71731]:       <entry name="family">Virtual Machine</entry>
Apr 13 16:31:55 user nova-compute[71731]:     </system>
Apr 13 16:31:55 user nova-compute[71731]:   </sysinfo>
Apr 13 16:31:55 user nova-compute[71731]:   <os>
Apr 13 16:31:55 user nova-compute[71731]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 16:31:55 user nova-compute[71731]:     <boot dev="hd"/>
Apr 13 16:31:55 user nova-compute[71731]:     <smbios mode="sysinfo"/>
Apr 13 16:31:55 user nova-compute[71731]:   </os>
Apr 13 16:31:55 user nova-compute[71731]:   <features>
Apr 13 16:31:55 user nova-compute[71731]:     <acpi/>
Apr 13 16:31:55 user nova-compute[71731]:     <apic/>
Apr 13 16:31:55 user nova-compute[71731]:     <vmcoreinfo/>
Apr 13 16:31:55 user nova-compute[71731]:   </features>
Apr 13 16:31:55 user nova-compute[71731]:   <clock offset="utc">
Apr 13 16:31:55 user nova-compute[71731]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 16:31:55 user nova-compute[71731]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 16:31:55 user nova-compute[71731]:     <timer name="hpet" present="no"/>
Apr 13 16:31:55 user nova-compute[71731]:   </clock>
Apr 13 16:31:55 user nova-compute[71731]:   <cpu mode="custom" match="exact">
Apr 13 16:31:55 user nova-compute[71731]:     <model>Nehalem</model>
Apr 13 16:31:55 user nova-compute[71731]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 16:31:55 user nova-compute[71731]:   </cpu>
Apr 13 16:31:55 user nova-compute[71731]:   <devices>
Apr 13 16:31:55 user nova-compute[71731]:     <disk type="file" device="disk">
Apr 13 16:31:55 user nova-compute[71731]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 16:31:55 user nova-compute[71731]:       <source file="/opt/stack/data/nova/instances/64a9c052-89a9-48ba-80c9-13fb5ef22f0e/disk"/>
Apr 13 16:31:55 user nova-compute[71731]:       <target dev="vda" bus="virtio"/>
Apr 13 16:31:55 user nova-compute[71731]:     </disk>
Apr 13 16:31:55 user nova-compute[71731]:     <interface type="ethernet">
Apr 13 16:31:55 user nova-compute[71731]:       <mac address="fa:16:3e:fe:54:1c"/>
Apr 13 16:31:55 user nova-compute[71731]:       <model type="virtio"/>
Apr 13 16:31:55 user nova-compute[71731]:       <mtu size="1442"/>
Apr 13 16:31:55 user nova-compute[71731]:       <target dev="tap5128334f-72"/>
Apr 13 16:31:55 user nova-compute[71731]:     </interface>
Apr 13 16:31:55 user nova-compute[71731]:     <serial type="pty">
Apr 13 16:31:55 user nova-compute[71731]:       <log file="/opt/stack/data/nova/instances/64a9c052-89a9-48ba-80c9-13fb5ef22f0e/console.log" append="off"/>
Apr 13 16:31:55 user nova-compute[71731]:     </serial>
Apr 13 16:31:55 user nova-compute[71731]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 16:31:55 user nova-compute[71731]:     <video>
Apr 13 16:31:55 user nova-compute[71731]:       <model type="virtio"/>
Apr 13 16:31:55 user nova-compute[71731]:     </video>
Apr 13 16:31:55 user nova-compute[71731]:     <rng model="virtio">
Apr 13 16:31:55 user nova-compute[71731]:       <backend model="random">/dev/urandom</backend>
Apr 13 16:31:55 user nova-compute[71731]:     </rng>
Apr 13 16:31:55 user nova-compute[71731]:     <controller type="usb" index="0" model="none"/>
Apr 13 16:31:55 user nova-compute[71731]:     <memballoon model="virtio">
Apr 13 16:31:55 user nova-compute[71731]:       <stats period="10"/>
Apr 13 16:31:55 user nova-compute[71731]:     </memballoon>
Apr 13 16:31:55 user nova-compute[71731]:   </devices>
Apr 13 16:31:55 user nova-compute[71731]: </domain>
Apr 13 16:31:55 user nova-compute[71731]:  {{(pid=71731) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 16:31:55 user nova-compute[71731]: DEBUG nova.virt.libvirt.vif [None req-1cbd883c-06ac-47dd-acfa-2f5baa8ec9ba tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T16:31:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-228552911',display_name='tempest-TestStampPattern-server-228552911',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-teststamppattern-server-228552911',id=28,image_ref='2d22499e-4681-4f01-8d24-292a6af73d70',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL2QPQmeuQ3QMNshoDoMdPG3OSftqyMCUtV3Pr6v+/rhaN+olW1hWBQn7y9Ew+sQSET4+DncPzqCVC4fuapQVvR4RUPvk9/ysi6s66mNzl8HmL0L6OHOtrjR4F2tcMOgTw==',key_name='tempest-TestStampPattern-792944514',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bb7100b359f341759cb6f6753e1539a8',ramdisk_id='',reservation_id='r-lplra19f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='708622a9-7465-4492-ade8-b827198f7e30',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='32b18558-8bf2-4def-bc70-81c4e38fcc6f',image_min_disk='1',image_min_ram='0',image_owner_id='bb7100b359f341759cb6f6753e1539a8',image_owner_project_name='tempest-TestStampPattern-96878995',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-96878995-project-member',image_user_id='f523740272844b6eb236477d0b116ddb',network_allocated='True',owner_project_name='tempest-TestStampPattern-96878995',owner_user_name='tempest-TestStampPattern-96878995-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T16:31:51Z,user_data=None,user_id='f523740272844b6eb236477d0b116ddb',uuid=64a9c052-89a9-48ba-80c9-13fb5ef22f0e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5128334f-7255-4a56-9e8b-1151027d219b", "address": "fa:16:3e:fe:54:1c", "network": {"id": "11386312-9ac6-4252-ab98-b3298a08599c", "bridge": "br-int", "label": "tempest-TestStampPattern-1747654565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb7100b359f341759cb6f6753e1539a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5128334f-72", "ovs_interfaceid": "5128334f-7255-4a56-9e8b-1151027d219b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 16:31:55 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-1cbd883c-06ac-47dd-acfa-2f5baa8ec9ba tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Converting VIF {"id": "5128334f-7255-4a56-9e8b-1151027d219b", "address": "fa:16:3e:fe:54:1c", "network": {"id": "11386312-9ac6-4252-ab98-b3298a08599c", "bridge": "br-int", "label": "tempest-TestStampPattern-1747654565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb7100b359f341759cb6f6753e1539a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5128334f-72", "ovs_interfaceid": "5128334f-7255-4a56-9e8b-1151027d219b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 16:31:55 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-1cbd883c-06ac-47dd-acfa-2f5baa8ec9ba tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fe:54:1c,bridge_name='br-int',has_traffic_filtering=True,id=5128334f-7255-4a56-9e8b-1151027d219b,network=Network(11386312-9ac6-4252-ab98-b3298a08599c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5128334f-72') {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 16:31:55 user nova-compute[71731]: DEBUG os_vif [None req-1cbd883c-06ac-47dd-acfa-2f5baa8ec9ba tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fe:54:1c,bridge_name='br-int',has_traffic_filtering=True,id=5128334f-7255-4a56-9e8b-1151027d219b,network=Network(11386312-9ac6-4252-ab98-b3298a08599c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5128334f-72') {{(pid=71731) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 16:31:55 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:31:55 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:31:55 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 16:31:55 user nova-compute[71731]: DEBUG nova.compute.manager [None req-f5944cc3-0bfe-4afc-80f2-fb850e13932f tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] [instance: 35b23303-e373-4f35-b7ee-76e6815073ce] Allocating IP information in the background. {{(pid=71731) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 16:31:55 user nova-compute[71731]: DEBUG nova.network.neutron [None req-f5944cc3-0bfe-4afc-80f2-fb850e13932f tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] [instance: 35b23303-e373-4f35-b7ee-76e6815073ce] allocate_for_instance() {{(pid=71731) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 16:31:55 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:31:55 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5128334f-72, may_exist=True) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:31:55 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5128334f-72, col_values=(('external_ids', {'iface-id': '5128334f-7255-4a56-9e8b-1151027d219b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fe:54:1c', 'vm-uuid': '64a9c052-89a9-48ba-80c9-13fb5ef22f0e'}),)) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:31:55 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:31:55 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 16:31:55 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:31:55 user nova-compute[71731]: INFO os_vif [None req-1cbd883c-06ac-47dd-acfa-2f5baa8ec9ba tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fe:54:1c,bridge_name='br-int',has_traffic_filtering=True,id=5128334f-7255-4a56-9e8b-1151027d219b,network=Network(11386312-9ac6-4252-ab98-b3298a08599c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5128334f-72')
Apr 13 16:31:55 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-f5944cc3-0bfe-4afc-80f2-fb850e13932f tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] [instance: 35b23303-e373-4f35-b7ee-76e6815073ce] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 16:31:55 user nova-compute[71731]: DEBUG nova.compute.manager [None req-f5944cc3-0bfe-4afc-80f2-fb850e13932f tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] [instance: 35b23303-e373-4f35-b7ee-76e6815073ce] Start building block device mappings for instance. {{(pid=71731) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 16:31:55 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-1cbd883c-06ac-47dd-acfa-2f5baa8ec9ba tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] No BDM found with device name vda, not building metadata. {{(pid=71731) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 16:31:55 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-1cbd883c-06ac-47dd-acfa-2f5baa8ec9ba tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] No VIF found with MAC fa:16:3e:fe:54:1c, not building metadata {{(pid=71731) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 16:31:55 user nova-compute[71731]: DEBUG nova.compute.manager [None req-f5944cc3-0bfe-4afc-80f2-fb850e13932f tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] [instance: 35b23303-e373-4f35-b7ee-76e6815073ce] Start spawning the instance on the hypervisor. {{(pid=71731) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 16:31:55 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-f5944cc3-0bfe-4afc-80f2-fb850e13932f tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] [instance: 35b23303-e373-4f35-b7ee-76e6815073ce] Creating instance directory {{(pid=71731) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 16:31:55 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-f5944cc3-0bfe-4afc-80f2-fb850e13932f tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] [instance: 35b23303-e373-4f35-b7ee-76e6815073ce] Creating image(s)
Apr 13 16:31:55 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-f5944cc3-0bfe-4afc-80f2-fb850e13932f tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Acquiring lock "/opt/stack/data/nova/instances/35b23303-e373-4f35-b7ee-76e6815073ce/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:31:55 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-f5944cc3-0bfe-4afc-80f2-fb850e13932f tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lock "/opt/stack/data/nova/instances/35b23303-e373-4f35-b7ee-76e6815073ce/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:31:55 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-f5944cc3-0bfe-4afc-80f2-fb850e13932f tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lock "/opt/stack/data/nova/instances/35b23303-e373-4f35-b7ee-76e6815073ce/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:31:55 user nova-compute[71731]: DEBUG nova.policy [None req-f5944cc3-0bfe-4afc-80f2-fb850e13932f tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '48b4e972cd1049509fa899449961ab59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0653ab16660b46cea9c5af58ea0b1931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71731) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 16:31:55 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-f5944cc3-0bfe-4afc-80f2-fb850e13932f tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279 --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:31:55 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-f5944cc3-0bfe-4afc-80f2-fb850e13932f tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279 --force-share --output=json" returned: 0 in 0.147s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:31:55 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-f5944cc3-0bfe-4afc-80f2-fb850e13932f tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Acquiring lock "9524227dd898575c3099d3976f096cd935414279" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:31:55 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-f5944cc3-0bfe-4afc-80f2-fb850e13932f tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lock "9524227dd898575c3099d3976f096cd935414279" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:31:55 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-f5944cc3-0bfe-4afc-80f2-fb850e13932f tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279 --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:31:56 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-f5944cc3-0bfe-4afc-80f2-fb850e13932f tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279 --force-share --output=json" returned: 0 in 0.174s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:31:56 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-f5944cc3-0bfe-4afc-80f2-fb850e13932f tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279,backing_fmt=raw /opt/stack/data/nova/instances/35b23303-e373-4f35-b7ee-76e6815073ce/disk 1073741824 {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:31:56 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-f5944cc3-0bfe-4afc-80f2-fb850e13932f tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279,backing_fmt=raw /opt/stack/data/nova/instances/35b23303-e373-4f35-b7ee-76e6815073ce/disk 1073741824" returned: 0 in 0.054s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:31:56 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-f5944cc3-0bfe-4afc-80f2-fb850e13932f tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lock "9524227dd898575c3099d3976f096cd935414279" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.236s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:31:56 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-f5944cc3-0bfe-4afc-80f2-fb850e13932f tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279 --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:31:56 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-f5944cc3-0bfe-4afc-80f2-fb850e13932f tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279 --force-share --output=json" returned: 0 in 0.163s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:31:56 user nova-compute[71731]: DEBUG nova.virt.disk.api [None req-f5944cc3-0bfe-4afc-80f2-fb850e13932f tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Checking if we can resize image /opt/stack/data/nova/instances/35b23303-e373-4f35-b7ee-76e6815073ce/disk. size=1073741824 {{(pid=71731) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 16:31:56 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-f5944cc3-0bfe-4afc-80f2-fb850e13932f tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35b23303-e373-4f35-b7ee-76e6815073ce/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:31:56 user nova-compute[71731]: DEBUG nova.network.neutron [req-6ca6dac9-ec5d-4652-83b2-2c89f825f1cf req-310e95e7-b9d2-4409-b6ac-94ad8a9f06ee service nova] [instance: 64a9c052-89a9-48ba-80c9-13fb5ef22f0e] Updated VIF entry in instance network info cache for port 5128334f-7255-4a56-9e8b-1151027d219b. {{(pid=71731) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 16:31:56 user nova-compute[71731]: DEBUG nova.network.neutron [req-6ca6dac9-ec5d-4652-83b2-2c89f825f1cf req-310e95e7-b9d2-4409-b6ac-94ad8a9f06ee service nova] [instance: 64a9c052-89a9-48ba-80c9-13fb5ef22f0e] Updating instance_info_cache with network_info: [{"id": "5128334f-7255-4a56-9e8b-1151027d219b", "address": "fa:16:3e:fe:54:1c", "network": {"id": "11386312-9ac6-4252-ab98-b3298a08599c", "bridge": "br-int", "label": "tempest-TestStampPattern-1747654565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb7100b359f341759cb6f6753e1539a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5128334f-72", "ovs_interfaceid": "5128334f-7255-4a56-9e8b-1151027d219b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:31:56 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-6ca6dac9-ec5d-4652-83b2-2c89f825f1cf req-310e95e7-b9d2-4409-b6ac-94ad8a9f06ee service nova] Releasing lock "refresh_cache-64a9c052-89a9-48ba-80c9-13fb5ef22f0e" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 16:31:56 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-f5944cc3-0bfe-4afc-80f2-fb850e13932f tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35b23303-e373-4f35-b7ee-76e6815073ce/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:31:56 user nova-compute[71731]: DEBUG nova.virt.disk.api [None req-f5944cc3-0bfe-4afc-80f2-fb850e13932f tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Cannot resize image /opt/stack/data/nova/instances/35b23303-e373-4f35-b7ee-76e6815073ce/disk to a smaller size. {{(pid=71731) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 16:31:56 user nova-compute[71731]: DEBUG nova.objects.instance [None req-f5944cc3-0bfe-4afc-80f2-fb850e13932f tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lazy-loading 'migration_context' on Instance uuid 35b23303-e373-4f35-b7ee-76e6815073ce {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:31:56 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-f5944cc3-0bfe-4afc-80f2-fb850e13932f tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] [instance: 35b23303-e373-4f35-b7ee-76e6815073ce] Created local disks {{(pid=71731) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 16:31:56 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-f5944cc3-0bfe-4afc-80f2-fb850e13932f tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] [instance: 35b23303-e373-4f35-b7ee-76e6815073ce] Ensure instance console log exists: /opt/stack/data/nova/instances/35b23303-e373-4f35-b7ee-76e6815073ce/console.log {{(pid=71731) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 16:31:56 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-f5944cc3-0bfe-4afc-80f2-fb850e13932f tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:31:56 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-f5944cc3-0bfe-4afc-80f2-fb850e13932f tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:31:56 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-f5944cc3-0bfe-4afc-80f2-fb850e13932f tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:31:56 user nova-compute[71731]: DEBUG nova.network.neutron [None req-f5944cc3-0bfe-4afc-80f2-fb850e13932f tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] [instance: 35b23303-e373-4f35-b7ee-76e6815073ce] Successfully created port: d3c66e4e-b15d-4bc9-a838-265ca07a6a66 {{(pid=71731) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 16:31:56 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:31:56 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:31:56 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:31:57 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:31:57 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:31:57 user nova-compute[71731]: DEBUG nova.compute.manager [req-7d9bf468-0ffd-4107-9e3f-65107797b3fc req-45253ddb-f0ec-4711-951d-796b1679c5c3 service nova] [instance: 64a9c052-89a9-48ba-80c9-13fb5ef22f0e] Received event network-vif-plugged-5128334f-7255-4a56-9e8b-1151027d219b {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:31:57 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-7d9bf468-0ffd-4107-9e3f-65107797b3fc req-45253ddb-f0ec-4711-951d-796b1679c5c3 service nova] Acquiring lock "64a9c052-89a9-48ba-80c9-13fb5ef22f0e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:31:57 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-7d9bf468-0ffd-4107-9e3f-65107797b3fc req-45253ddb-f0ec-4711-951d-796b1679c5c3 service nova] Lock "64a9c052-89a9-48ba-80c9-13fb5ef22f0e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:31:57 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-7d9bf468-0ffd-4107-9e3f-65107797b3fc req-45253ddb-f0ec-4711-951d-796b1679c5c3 service nova] Lock "64a9c052-89a9-48ba-80c9-13fb5ef22f0e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:31:57 user nova-compute[71731]: DEBUG nova.compute.manager [req-7d9bf468-0ffd-4107-9e3f-65107797b3fc req-45253ddb-f0ec-4711-951d-796b1679c5c3 service nova] [instance: 64a9c052-89a9-48ba-80c9-13fb5ef22f0e] No waiting events found dispatching network-vif-plugged-5128334f-7255-4a56-9e8b-1151027d219b {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:31:57 user nova-compute[71731]: WARNING nova.compute.manager [req-7d9bf468-0ffd-4107-9e3f-65107797b3fc req-45253ddb-f0ec-4711-951d-796b1679c5c3 service nova] [instance: 64a9c052-89a9-48ba-80c9-13fb5ef22f0e] Received unexpected event network-vif-plugged-5128334f-7255-4a56-9e8b-1151027d219b for instance with vm_state building and task_state spawning.
Apr 13 16:31:58 user nova-compute[71731]: DEBUG nova.network.neutron [None req-f5944cc3-0bfe-4afc-80f2-fb850e13932f tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] [instance: 35b23303-e373-4f35-b7ee-76e6815073ce] Successfully updated port: d3c66e4e-b15d-4bc9-a838-265ca07a6a66 {{(pid=71731) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 16:31:58 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-f5944cc3-0bfe-4afc-80f2-fb850e13932f tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Acquiring lock "refresh_cache-35b23303-e373-4f35-b7ee-76e6815073ce" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 16:31:58 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-f5944cc3-0bfe-4afc-80f2-fb850e13932f tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Acquired lock "refresh_cache-35b23303-e373-4f35-b7ee-76e6815073ce" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 16:31:58 user nova-compute[71731]: DEBUG nova.network.neutron [None req-f5944cc3-0bfe-4afc-80f2-fb850e13932f tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] [instance: 35b23303-e373-4f35-b7ee-76e6815073ce] Building network info cache for instance {{(pid=71731) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 16:31:58 user nova-compute[71731]: DEBUG nova.network.neutron [None req-f5944cc3-0bfe-4afc-80f2-fb850e13932f tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] [instance: 35b23303-e373-4f35-b7ee-76e6815073ce] Instance cache missing network info. {{(pid=71731) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 16:31:58 user nova-compute[71731]: DEBUG nova.compute.manager [None req-b347c3f9-ba96-4152-b346-ddd7bd69468d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: 2956ab05-28ff-4c9e-b646-dbb83b3db278] Start spawning the instance on the hypervisor. {{(pid=71731) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 16:31:58 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-b347c3f9-ba96-4152-b346-ddd7bd69468d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: 2956ab05-28ff-4c9e-b646-dbb83b3db278] Creating instance directory {{(pid=71731) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 16:31:58 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-b347c3f9-ba96-4152-b346-ddd7bd69468d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: 2956ab05-28ff-4c9e-b646-dbb83b3db278] Creating image(s)
Apr 13 16:31:58 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-b347c3f9-ba96-4152-b346-ddd7bd69468d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: 2956ab05-28ff-4c9e-b646-dbb83b3db278] Did not create local disks {{(pid=71731) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 13 16:31:58 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-b347c3f9-ba96-4152-b346-ddd7bd69468d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: 2956ab05-28ff-4c9e-b646-dbb83b3db278] Ensure instance console log exists: /opt/stack/data/nova/instances/2956ab05-28ff-4c9e-b646-dbb83b3db278/console.log {{(pid=71731) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 16:31:58 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-b347c3f9-ba96-4152-b346-ddd7bd69468d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:31:58 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-b347c3f9-ba96-4152-b346-ddd7bd69468d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:31:58 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-b347c3f9-ba96-4152-b346-ddd7bd69468d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:31:58 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-b347c3f9-ba96-4152-b346-ddd7bd69468d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: 2956ab05-28ff-4c9e-b646-dbb83b3db278] Start _get_guest_xml network_info=[{"id": "84df62e9-af7c-4e62-83da-b43b511be2a0", "address": "fa:16:3e:66:e8:40", "network": {"id": "5a7877ff-8230-470b-90b5-e5dcfc8f0cee", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-779403873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2d09a74bf684a9fb1dd1e95d6c23f3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84df62e9-af", "ovs_interfaceid": "84df62e9-af7c-4e62-83da-b43b511be2a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T16:16:31Z,direct_url=<?>,disk_format='qcow2',id=708622a9-7465-4492-ade8-b827198f7e30,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='0b29a975c552465aba0ac7d6288434bd',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T16:16:33Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'attachment_id': '37249968-badc-4f49-a9e0-ad66fe289877', 'mount_device': '/dev/vda', 'delete_on_termination': False, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:25c3dc97-c9cb-4529-ab32-26ef7fd94fc6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZFsWRaGN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '2956ab05-28ff-4c9e-b646-dbb83b3db278', 'attached_at': '', 'detached_at': '', 'volume_id': '25c3dc97-c9cb-4529-ab32-26ef7fd94fc6', 'serial': '25c3dc97-c9cb-4529-ab32-26ef7fd94fc6'}, 'disk_bus': 'virtio', 'guest_format': None, 'volume_type': None} {{(pid=71731) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 16:31:58 user nova-compute[71731]: WARNING nova.virt.libvirt.driver [None req-b347c3f9-ba96-4152-b346-ddd7bd69468d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 16:31:58 user nova-compute[71731]: WARNING nova.virt.libvirt.driver [None req-b347c3f9-ba96-4152-b346-ddd7bd69468d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 16:31:58 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-b347c3f9-ba96-4152-b346-ddd7bd69468d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71731) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 16:31:58 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-b347c3f9-ba96-4152-b346-ddd7bd69468d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T16:17:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T16:16:31Z,direct_url=<?>,disk_format='qcow2',id=708622a9-7465-4492-ade8-b827198f7e30,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='0b29a975c552465aba0ac7d6288434bd',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T16:16:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 16:31:58 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-b347c3f9-ba96-4152-b346-ddd7bd69468d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Flavor limits 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 16:31:58 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-b347c3f9-ba96-4152-b346-ddd7bd69468d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Image limits 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 16:31:58 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-b347c3f9-ba96-4152-b346-ddd7bd69468d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Flavor pref 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 16:31:58 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-b347c3f9-ba96-4152-b346-ddd7bd69468d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Image pref 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 16:31:58 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-b347c3f9-ba96-4152-b346-ddd7bd69468d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 16:31:58 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-b347c3f9-ba96-4152-b346-ddd7bd69468d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 16:31:58 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-b347c3f9-ba96-4152-b346-ddd7bd69468d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71731) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 16:31:58 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-b347c3f9-ba96-4152-b346-ddd7bd69468d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Got 1 possible topologies {{(pid=71731) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 16:31:58 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-b347c3f9-ba96-4152-b346-ddd7bd69468d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 16:31:58 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-b347c3f9-ba96-4152-b346-ddd7bd69468d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 16:31:58 user nova-compute[71731]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b347c3f9-ba96-4152-b346-ddd7bd69468d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: 2956ab05-28ff-4c9e-b646-dbb83b3db278] Calling os-brick to attach iSCSI Volume {{(pid=71731) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 16:31:58 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-b347c3f9-ba96-4152-b346-ddd7bd69468d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8cf0118790>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:25c3dc97-c9cb-4529-ab32-26ef7fd94fc6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZFsWRaGN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 16:31:58 user nova-compute[71731]: WARNING os_brick.initiator.connectors.base [None req-b347c3f9-ba96-4152-b346-ddd7bd69468d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 16:31:58 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-b347c3f9-ba96-4152-b346-ddd7bd69468d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 16:31:58 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-b347c3f9-ba96-4152-b346-ddd7bd69468d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 16:31:58 user nova-compute[71731]: WARNING os_brick.initiator.connectors.base [None req-b347c3f9-ba96-4152-b346-ddd7bd69468d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 16:31:58 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-b347c3f9-ba96-4152-b346-ddd7bd69468d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:25c3dc97-c9cb-4529-ab32-26ef7fd94fc6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 16:31:58 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-b347c3f9-ba96-4152-b346-ddd7bd69468d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:25c3dc97-c9cb-4529-ab32-26ef7fd94fc6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 16:31:58 user nova-compute[71731]: INFO os_brick.initiator.connectors.iscsi [None req-b347c3f9-ba96-4152-b346-ddd7bd69468d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 16:31:58 user nova-compute[71731]: DEBUG nova.network.neutron [None req-f5944cc3-0bfe-4afc-80f2-fb850e13932f tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] [instance: 35b23303-e373-4f35-b7ee-76e6815073ce] Updating instance_info_cache with network_info: [{"id": "d3c66e4e-b15d-4bc9-a838-265ca07a6a66", "address": "fa:16:3e:3a:4e:db", "network": {"id": "5acc9a78-1127-46df-bb60-7544cdd2c1ef", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2143082515-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0653ab16660b46cea9c5af58ea0b1931", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3c66e4e-b1", "ovs_interfaceid": "d3c66e4e-b15d-4bc9-a838-265ca07a6a66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:31:58 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25c3dc97-c9cb-4529-ab32-26ef7fd94fc6 -p 172.16.0.220:3260 {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:31:58 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25c3dc97-c9cb-4529-ab32-26ef7fd94fc6 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:31:58 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aa82d3b-628a-443c-907e-7246a58b1912]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:31:58 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-b347c3f9-ba96-4152-b346-ddd7bd69468d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 16:31:58 user nova-compute[71731]:  {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:31:58 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25c3dc97-c9cb-4529-ab32-26ef7fd94fc6 -p 172.16.0.220:3260 --interface default --op new {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:31:58 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-f5944cc3-0bfe-4afc-80f2-fb850e13932f tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Releasing lock "refresh_cache-35b23303-e373-4f35-b7ee-76e6815073ce" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 16:31:58 user nova-compute[71731]: DEBUG nova.compute.manager [None req-f5944cc3-0bfe-4afc-80f2-fb850e13932f tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] [instance: 35b23303-e373-4f35-b7ee-76e6815073ce] Instance network_info: |[{"id": "d3c66e4e-b15d-4bc9-a838-265ca07a6a66", "address": "fa:16:3e:3a:4e:db", "network": {"id": "5acc9a78-1127-46df-bb60-7544cdd2c1ef", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2143082515-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0653ab16660b46cea9c5af58ea0b1931", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3c66e4e-b1", "ovs_interfaceid": "d3c66e4e-b15d-4bc9-a838-265ca07a6a66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71731) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 16:31:58 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-f5944cc3-0bfe-4afc-80f2-fb850e13932f tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] [instance: 35b23303-e373-4f35-b7ee-76e6815073ce] Start _get_guest_xml network_info=[{"id": "d3c66e4e-b15d-4bc9-a838-265ca07a6a66", "address": "fa:16:3e:3a:4e:db", "network": {"id": "5acc9a78-1127-46df-bb60-7544cdd2c1ef", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2143082515-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0653ab16660b46cea9c5af58ea0b1931", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3c66e4e-b1", "ovs_interfaceid": "d3c66e4e-b15d-4bc9-a838-265ca07a6a66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T16:16:31Z,direct_url=<?>,disk_format='qcow2',id=708622a9-7465-4492-ade8-b827198f7e30,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='0b29a975c552465aba0ac7d6288434bd',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T16:16:33Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'device_type': 'disk', 'encrypted': False, 'disk_bus': 'virtio', 'guest_format': None, 'encryption_options': None, 'image_id': '708622a9-7465-4492-ade8-b827198f7e30'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71731) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 16:31:58 user nova-compute[71731]: WARNING nova.virt.libvirt.driver [None req-f5944cc3-0bfe-4afc-80f2-fb850e13932f tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 16:31:58 user nova-compute[71731]: WARNING nova.virt.libvirt.driver [None req-f5944cc3-0bfe-4afc-80f2-fb850e13932f tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 16:31:58 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-f5944cc3-0bfe-4afc-80f2-fb850e13932f tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71731) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 16:31:58 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-f5944cc3-0bfe-4afc-80f2-fb850e13932f tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T16:17:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T16:16:31Z,direct_url=<?>,disk_format='qcow2',id=708622a9-7465-4492-ade8-b827198f7e30,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='0b29a975c552465aba0ac7d6288434bd',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T16:16:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 16:31:58 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-f5944cc3-0bfe-4afc-80f2-fb850e13932f tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Flavor limits 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 16:31:58 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-f5944cc3-0bfe-4afc-80f2-fb850e13932f tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Image limits 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 16:31:58 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-f5944cc3-0bfe-4afc-80f2-fb850e13932f tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Flavor pref 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 16:31:58 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-f5944cc3-0bfe-4afc-80f2-fb850e13932f tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Image pref 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 16:31:58 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-f5944cc3-0bfe-4afc-80f2-fb850e13932f tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 16:31:58 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-f5944cc3-0bfe-4afc-80f2-fb850e13932f tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 16:31:58 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-f5944cc3-0bfe-4afc-80f2-fb850e13932f tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71731) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 16:31:58 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-f5944cc3-0bfe-4afc-80f2-fb850e13932f tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Got 1 possible topologies {{(pid=71731) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 16:31:58 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-f5944cc3-0bfe-4afc-80f2-fb850e13932f tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 16:31:58 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-f5944cc3-0bfe-4afc-80f2-fb850e13932f tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 16:31:58 user nova-compute[71731]: DEBUG nova.virt.libvirt.vif [None req-f5944cc3-0bfe-4afc-80f2-fb850e13932f tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T16:31:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1250036054',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1250036054',id=29,image_ref='708622a9-7465-4492-ade8-b827198f7e30',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLQeZ76om971CHhTZu4ReSq6QPGcHpR5nWHWtfdjAVD10KpB0WFrcOFE78MwJOBYC8dClsRGNG38ZB3wd8nDfZlZongElXTKw6yUyFEOVvzfdaLLX/bmjmfAtuiMX+ECkA==',key_name='tempest-keypair-179744772',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0653ab16660b46cea9c5af58ea0b1931',ramdisk_id='',reservation_id='r-h5vfm9ar',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='708622a9-7465-4492-ade8-b827198f7e30',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1310775310',owner_user_name='tempest-AttachVolumeShelveTestJSON-1310775310-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T16:31:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='48b4e972cd1049509fa899449961ab59',uuid=35b23303-e373-4f35-b7ee-76e6815073ce,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d3c66e4e-b15d-4bc9-a838-265ca07a6a66", "address": "fa:16:3e:3a:4e:db", "network": {"id": "5acc9a78-1127-46df-bb60-7544cdd2c1ef", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2143082515-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0653ab16660b46cea9c5af58ea0b1931", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3c66e4e-b1", "ovs_interfaceid": "d3c66e4e-b15d-4bc9-a838-265ca07a6a66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71731) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 16:31:58 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-f5944cc3-0bfe-4afc-80f2-fb850e13932f tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Converting VIF {"id": "d3c66e4e-b15d-4bc9-a838-265ca07a6a66", "address": "fa:16:3e:3a:4e:db", "network": {"id": "5acc9a78-1127-46df-bb60-7544cdd2c1ef", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2143082515-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0653ab16660b46cea9c5af58ea0b1931", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3c66e4e-b1", "ovs_interfaceid": "d3c66e4e-b15d-4bc9-a838-265ca07a6a66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 16:31:58 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-f5944cc3-0bfe-4afc-80f2-fb850e13932f tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3a:4e:db,bridge_name='br-int',has_traffic_filtering=True,id=d3c66e4e-b15d-4bc9-a838-265ca07a6a66,network=Network(5acc9a78-1127-46df-bb60-7544cdd2c1ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3c66e4e-b1') {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 16:31:58 user nova-compute[71731]: DEBUG nova.objects.instance [None req-f5944cc3-0bfe-4afc-80f2-fb850e13932f tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lazy-loading 'pci_devices' on Instance uuid 35b23303-e373-4f35-b7ee-76e6815073ce {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:31:58 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25c3dc97-c9cb-4529-ab32-26ef7fd94fc6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:31:58 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[31a0fc4c-4509-48be-9068-29453f2bc7c0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:25c3dc97-c9cb-4529-ab32-26ef7fd94fc6] added\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:31:58 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-b347c3f9-ba96-4152-b346-ddd7bd69468d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:25c3dc97-c9cb-4529-ab32-26ef7fd94fc6] added
Apr 13 16:31:58 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:31:58 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25c3dc97-c9cb-4529-ab32-26ef7fd94fc6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:31:58 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-f5944cc3-0bfe-4afc-80f2-fb850e13932f tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] [instance: 35b23303-e373-4f35-b7ee-76e6815073ce] End _get_guest_xml xml=<domain type="kvm">
Apr 13 16:31:58 user nova-compute[71731]:   <uuid>35b23303-e373-4f35-b7ee-76e6815073ce</uuid>
Apr 13 16:31:58 user nova-compute[71731]:   <name>instance-0000001d</name>
Apr 13 16:31:58 user nova-compute[71731]:   <memory>131072</memory>
Apr 13 16:31:58 user nova-compute[71731]:   <vcpu>1</vcpu>
Apr 13 16:31:58 user nova-compute[71731]:   <metadata>
Apr 13 16:31:58 user nova-compute[71731]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 16:31:58 user nova-compute[71731]:       <nova:package version="0.0.0"/>
Apr 13 16:31:58 user nova-compute[71731]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1250036054</nova:name>
Apr 13 16:31:58 user nova-compute[71731]:       <nova:creationTime>2023-04-13 16:31:58</nova:creationTime>
Apr 13 16:31:58 user nova-compute[71731]:       <nova:flavor name="m1.nano">
Apr 13 16:31:58 user nova-compute[71731]:         <nova:memory>128</nova:memory>
Apr 13 16:31:58 user nova-compute[71731]:         <nova:disk>1</nova:disk>
Apr 13 16:31:58 user nova-compute[71731]:         <nova:swap>0</nova:swap>
Apr 13 16:31:58 user nova-compute[71731]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 16:31:58 user nova-compute[71731]:         <nova:vcpus>1</nova:vcpus>
Apr 13 16:31:58 user nova-compute[71731]:       </nova:flavor>
Apr 13 16:31:58 user nova-compute[71731]:       <nova:owner>
Apr 13 16:31:58 user nova-compute[71731]:         <nova:user uuid="48b4e972cd1049509fa899449961ab59">tempest-AttachVolumeShelveTestJSON-1310775310-project-member</nova:user>
Apr 13 16:31:58 user nova-compute[71731]:         <nova:project uuid="0653ab16660b46cea9c5af58ea0b1931">tempest-AttachVolumeShelveTestJSON-1310775310</nova:project>
Apr 13 16:31:58 user nova-compute[71731]:       </nova:owner>
Apr 13 16:31:58 user nova-compute[71731]:       <nova:root type="image" uuid="708622a9-7465-4492-ade8-b827198f7e30"/>
Apr 13 16:31:58 user nova-compute[71731]:       <nova:ports>
Apr 13 16:31:58 user nova-compute[71731]:         <nova:port uuid="d3c66e4e-b15d-4bc9-a838-265ca07a6a66">
Apr 13 16:31:58 user nova-compute[71731]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Apr 13 16:31:58 user nova-compute[71731]:         </nova:port>
Apr 13 16:31:58 user nova-compute[71731]:       </nova:ports>
Apr 13 16:31:58 user nova-compute[71731]:     </nova:instance>
Apr 13 16:31:58 user nova-compute[71731]:   </metadata>
Apr 13 16:31:58 user nova-compute[71731]:   <sysinfo type="smbios">
Apr 13 16:31:58 user nova-compute[71731]:     <system>
Apr 13 16:31:58 user nova-compute[71731]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 16:31:58 user nova-compute[71731]:       <entry name="product">OpenStack Nova</entry>
Apr 13 16:31:58 user nova-compute[71731]:       <entry name="version">0.0.0</entry>
Apr 13 16:31:58 user nova-compute[71731]:       <entry name="serial">35b23303-e373-4f35-b7ee-76e6815073ce</entry>
Apr 13 16:31:58 user nova-compute[71731]:       <entry name="uuid">35b23303-e373-4f35-b7ee-76e6815073ce</entry>
Apr 13 16:31:58 user nova-compute[71731]:       <entry name="family">Virtual Machine</entry>
Apr 13 16:31:58 user nova-compute[71731]:     </system>
Apr 13 16:31:58 user nova-compute[71731]:   </sysinfo>
Apr 13 16:31:58 user nova-compute[71731]:   <os>
Apr 13 16:31:58 user nova-compute[71731]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 16:31:58 user nova-compute[71731]:     <boot dev="hd"/>
Apr 13 16:31:58 user nova-compute[71731]:     <smbios mode="sysinfo"/>
Apr 13 16:31:58 user nova-compute[71731]:   </os>
Apr 13 16:31:58 user nova-compute[71731]:   <features>
Apr 13 16:31:58 user nova-compute[71731]:     <acpi/>
Apr 13 16:31:58 user nova-compute[71731]:     <apic/>
Apr 13 16:31:58 user nova-compute[71731]:     <vmcoreinfo/>
Apr 13 16:31:58 user nova-compute[71731]:   </features>
Apr 13 16:31:58 user nova-compute[71731]:   <clock offset="utc">
Apr 13 16:31:58 user nova-compute[71731]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 16:31:58 user nova-compute[71731]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 16:31:58 user nova-compute[71731]:     <timer name="hpet" present="no"/>
Apr 13 16:31:58 user nova-compute[71731]:   </clock>
Apr 13 16:31:58 user nova-compute[71731]:   <cpu mode="custom" match="exact">
Apr 13 16:31:58 user nova-compute[71731]:     <model>Nehalem</model>
Apr 13 16:31:58 user nova-compute[71731]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 16:31:58 user nova-compute[71731]:   </cpu>
Apr 13 16:31:58 user nova-compute[71731]:   <devices>
Apr 13 16:31:58 user nova-compute[71731]:     <disk type="file" device="disk">
Apr 13 16:31:58 user nova-compute[71731]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 16:31:58 user nova-compute[71731]:       <source file="/opt/stack/data/nova/instances/35b23303-e373-4f35-b7ee-76e6815073ce/disk"/>
Apr 13 16:31:58 user nova-compute[71731]:       <target dev="vda" bus="virtio"/>
Apr 13 16:31:58 user nova-compute[71731]:     </disk>
Apr 13 16:31:58 user nova-compute[71731]:     <interface type="ethernet">
Apr 13 16:31:58 user nova-compute[71731]:       <mac address="fa:16:3e:3a:4e:db"/>
Apr 13 16:31:58 user nova-compute[71731]:       <model type="virtio"/>
Apr 13 16:31:58 user nova-compute[71731]:       <mtu size="1442"/>
Apr 13 16:31:58 user nova-compute[71731]:       <target dev="tapd3c66e4e-b1"/>
Apr 13 16:31:58 user nova-compute[71731]:     </interface>
Apr 13 16:31:58 user nova-compute[71731]:     <serial type="pty">
Apr 13 16:31:58 user nova-compute[71731]:       <log file="/opt/stack/data/nova/instances/35b23303-e373-4f35-b7ee-76e6815073ce/console.log" append="off"/>
Apr 13 16:31:58 user nova-compute[71731]:     </serial>
Apr 13 16:31:58 user nova-compute[71731]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 16:31:58 user nova-compute[71731]:     <video>
Apr 13 16:31:58 user nova-compute[71731]:       <model type="virtio"/>
Apr 13 16:31:58 user nova-compute[71731]:     </video>
Apr 13 16:31:58 user nova-compute[71731]:     <rng model="virtio">
Apr 13 16:31:58 user nova-compute[71731]:       <backend model="random">/dev/urandom</backend>
Apr 13 16:31:58 user nova-compute[71731]:     </rng>
Apr 13 16:31:58 user nova-compute[71731]:     <controller type="usb" index="0" model="none"/>
Apr 13 16:31:58 user nova-compute[71731]:     <memballoon model="virtio">
Apr 13 16:31:58 user nova-compute[71731]:       <stats period="10"/>
Apr 13 16:31:58 user nova-compute[71731]:     </memballoon>
Apr 13 16:31:58 user nova-compute[71731]:   </devices>
Apr 13 16:31:58 user nova-compute[71731]: </domain>
Apr 13 16:31:58 user nova-compute[71731]:  {{(pid=71731) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 16:31:58 user nova-compute[71731]: DEBUG nova.virt.libvirt.vif [None req-f5944cc3-0bfe-4afc-80f2-fb850e13932f tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T16:31:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1250036054',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1250036054',id=29,image_ref='708622a9-7465-4492-ade8-b827198f7e30',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLQeZ76om971CHhTZu4ReSq6QPGcHpR5nWHWtfdjAVD10KpB0WFrcOFE78MwJOBYC8dClsRGNG38ZB3wd8nDfZlZongElXTKw6yUyFEOVvzfdaLLX/bmjmfAtuiMX+ECkA==',key_name='tempest-keypair-179744772',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0653ab16660b46cea9c5af58ea0b1931',ramdisk_id='',reservation_id='r-h5vfm9ar',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='708622a9-7465-4492-ade8-b827198f7e30',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1310775310',owner_user_name='tempest-AttachVolumeShelveTestJSON-1310775310-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T16:31:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='48b4e972cd1049509fa899449961ab59',uuid=35b23303-e373-4f35-b7ee-76e6815073ce,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d3c66e4e-b15d-4bc9-a838-265ca07a6a66", "address": "fa:16:3e:3a:4e:db", "network": {"id": "5acc9a78-1127-46df-bb60-7544cdd2c1ef", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2143082515-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0653ab16660b46cea9c5af58ea0b1931", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3c66e4e-b1", "ovs_interfaceid": "d3c66e4e-b15d-4bc9-a838-265ca07a6a66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 16:31:58 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-f5944cc3-0bfe-4afc-80f2-fb850e13932f tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Converting VIF {"id": "d3c66e4e-b15d-4bc9-a838-265ca07a6a66", "address": "fa:16:3e:3a:4e:db", "network": {"id": "5acc9a78-1127-46df-bb60-7544cdd2c1ef", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2143082515-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0653ab16660b46cea9c5af58ea0b1931", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3c66e4e-b1", "ovs_interfaceid": "d3c66e4e-b15d-4bc9-a838-265ca07a6a66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 16:31:58 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-f5944cc3-0bfe-4afc-80f2-fb850e13932f tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3a:4e:db,bridge_name='br-int',has_traffic_filtering=True,id=d3c66e4e-b15d-4bc9-a838-265ca07a6a66,network=Network(5acc9a78-1127-46df-bb60-7544cdd2c1ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3c66e4e-b1') {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 16:31:58 user nova-compute[71731]: DEBUG os_vif [None req-f5944cc3-0bfe-4afc-80f2-fb850e13932f tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:4e:db,bridge_name='br-int',has_traffic_filtering=True,id=d3c66e4e-b15d-4bc9-a838-265ca07a6a66,network=Network(5acc9a78-1127-46df-bb60-7544cdd2c1ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3c66e4e-b1') {{(pid=71731) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 16:31:58 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:31:58 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:31:58 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 16:31:58 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25c3dc97-c9cb-4529-ab32-26ef7fd94fc6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:31:58 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccbcd25b-4e6a-4c43-be99-a3d07c61ea9c]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:31:58 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-b347c3f9-ba96-4152-b346-ddd7bd69468d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:31:58 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25c3dc97-c9cb-4529-ab32-26ef7fd94fc6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:31:58 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:31:58 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd3c66e4e-b1, may_exist=True) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:31:58 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd3c66e4e-b1, col_values=(('external_ids', {'iface-id': 'd3c66e4e-b15d-4bc9-a838-265ca07a6a66', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3a:4e:db', 'vm-uuid': '35b23303-e373-4f35-b7ee-76e6815073ce'}),)) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:31:58 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:31:58 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 16:31:58 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25c3dc97-c9cb-4529-ab32-26ef7fd94fc6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:31:58 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[c93c56fc-d1af-43d9-92e9-0ae4ecd499dc]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:31:58 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-b347c3f9-ba96-4152-b346-ddd7bd69468d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:31:58 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:31:58 user nova-compute[71731]: INFO os_vif [None req-f5944cc3-0bfe-4afc-80f2-fb850e13932f tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:4e:db,bridge_name='br-int',has_traffic_filtering=True,id=d3c66e4e-b15d-4bc9-a838-265ca07a6a66,network=Network(5acc9a78-1127-46df-bb60-7544cdd2c1ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3c66e4e-b1')
Apr 13 16:31:58 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25c3dc97-c9cb-4529-ab32-26ef7fd94fc6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZFsWRaGN {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:31:59 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25c3dc97-c9cb-4529-ab32-26ef7fd94fc6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZFsWRaGN" returned: 0 in 0.031s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:31:59 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[498bf124-6179-45b1-8ef5-ec349e7dbdb7]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:31:59 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-b347c3f9-ba96-4152-b346-ddd7bd69468d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZFsWRaGN'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:31:59 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25c3dc97-c9cb-4529-ab32-26ef7fd94fc6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:31:59 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25c3dc97-c9cb-4529-ab32-26ef7fd94fc6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:31:59 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[112e5e61-016e-427d-a205-dd7ea196e82a]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:31:59 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-b347c3f9-ba96-4152-b346-ddd7bd69468d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:31:59 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:31:59 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-f5944cc3-0bfe-4afc-80f2-fb850e13932f tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] No BDM found with device name vda, not building metadata. {{(pid=71731) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 16:31:59 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-f5944cc3-0bfe-4afc-80f2-fb850e13932f tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] No VIF found with MAC fa:16:3e:3a:4e:db, not building metadata {{(pid=71731) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 16:31:59 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:31:59 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[d81dc96e-5f09-4921-bb7c-8c77afe97064]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2088266-1d33-4bb1-ac5b-1de832ff7985 (non-flash)\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:31:59 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-b347c3f9-ba96-4152-b346-ddd7bd69468d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)
Apr 13 16:31:59 user nova-compute[71731]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2088266-1d33-4bb1-ac5b-1de832ff7985 (non-flash)
Apr 13 16:31:59 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 16:31:59 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-b347c3f9-ba96-4152-b346-ddd7bd69468d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)
Apr 13 16:31:59 user nova-compute[71731]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2088266-1d33-4bb1-ac5b-1de832ff7985 (non-flash)
Apr 13 16:31:59 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 16:31:59 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25c3dc97-c9cb-4529-ab32-26ef7fd94fc6 -p 172.16.0.220:3260 --login {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:31:59 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25c3dc97-c9cb-4529-ab32-26ef7fd94fc6 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:31:59 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[db1b2c2c-2085-42ad-a442-ed4a1eba8f32]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:25c3dc97-c9cb-4529-ab32-26ef7fd94fc6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:25c3dc97-c9cb-4529-ab32-26ef7fd94fc6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:31:59 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-b347c3f9-ba96-4152-b346-ddd7bd69468d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:25c3dc97-c9cb-4529-ab32-26ef7fd94fc6, portal: 172.16.0.220,3260]
Apr 13 16:31:59 user nova-compute[71731]: Login to [iface: default, target: iqn.2010-10.org.openstack:25c3dc97-c9cb-4529-ab32-26ef7fd94fc6, portal: 172.16.0.220,3260] successful.
Apr 13 16:31:59 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:31:59 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25c3dc97-c9cb-4529-ab32-26ef7fd94fc6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:31:59 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25c3dc97-c9cb-4529-ab32-26ef7fd94fc6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:31:59 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ae69842-c387-4e09-a2bc-a7ab1ac2c734]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:31:59 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-b347c3f9-ba96-4152-b346-ddd7bd69468d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:31:59 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:31:59 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1cbd883c-06ac-47dd-acfa-2f5baa8ec9ba tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] [instance: 64a9c052-89a9-48ba-80c9-13fb5ef22f0e] Instance event wait completed in 0 seconds for  {{(pid=71731) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 16:31:59 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-1cbd883c-06ac-47dd-acfa-2f5baa8ec9ba tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] [instance: 64a9c052-89a9-48ba-80c9-13fb5ef22f0e] Guest created on hypervisor {{(pid=71731) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 16:31:59 user nova-compute[71731]: DEBUG nova.virt.driver [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Emitting event <LifecycleEvent: 1681403519.2085383, 64a9c052-89a9-48ba-80c9-13fb5ef22f0e => Resumed> {{(pid=71731) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 16:31:59 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 64a9c052-89a9-48ba-80c9-13fb5ef22f0e] VM Resumed (Lifecycle Event)
Apr 13 16:31:59 user nova-compute[71731]: INFO nova.virt.libvirt.driver [-] [instance: 64a9c052-89a9-48ba-80c9-13fb5ef22f0e] Instance spawned successfully.
Apr 13 16:31:59 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-1cbd883c-06ac-47dd-acfa-2f5baa8ec9ba tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] [instance: 64a9c052-89a9-48ba-80c9-13fb5ef22f0e] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 16:31:59 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 64a9c052-89a9-48ba-80c9-13fb5ef22f0e] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:31:59 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:31:59 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b357502-bc99-4030-9959-05f35e8774a2]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2088266-1d33-4bb1-ac5b-1de832ff7985 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25c3dc97-c9cb-4529-ab32-26ef7fd94fc6 (non-flash)\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:31:59 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-b347c3f9-ba96-4152-b346-ddd7bd69468d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)
Apr 13 16:31:59 user nova-compute[71731]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2088266-1d33-4bb1-ac5b-1de832ff7985 (non-flash)
Apr 13 16:31:59 user nova-compute[71731]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25c3dc97-c9cb-4529-ab32-26ef7fd94fc6 (non-flash)
Apr 13 16:31:59 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 16:31:59 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-b347c3f9-ba96-4152-b346-ddd7bd69468d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)
Apr 13 16:31:59 user nova-compute[71731]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2088266-1d33-4bb1-ac5b-1de832ff7985 (non-flash)
Apr 13 16:31:59 user nova-compute[71731]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25c3dc97-c9cb-4529-ab32-26ef7fd94fc6 (non-flash)
Apr 13 16:31:59 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 16:31:59 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-b347c3f9-ba96-4152-b346-ddd7bd69468d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:25c3dc97-c9cb-4529-ab32-26ef7fd94fc6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.708s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 16:31:59 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-b347c3f9-ba96-4152-b346-ddd7bd69468d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Connected to 172.16.0.220:3260 {{(pid=71731) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 16:31:59 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-b347c3f9-ba96-4152-b346-ddd7bd69468d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] HCTL ('35', '-', '-', 0) found on session 32 with lun 0 {{(pid=71731) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 16:31:59 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-b347c3f9-ba96-4152-b346-ddd7bd69468d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=71731) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 16:31:59 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:31:59 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-1cbd883c-06ac-47dd-acfa-2f5baa8ec9ba tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] [instance: 64a9c052-89a9-48ba-80c9-13fb5ef22f0e] Found default for hw_input_bus of None {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:31:59 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-1cbd883c-06ac-47dd-acfa-2f5baa8ec9ba tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] [instance: 64a9c052-89a9-48ba-80c9-13fb5ef22f0e] Found default for hw_pointer_model of None {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:31:59 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 64a9c052-89a9-48ba-80c9-13fb5ef22f0e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71731) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 16:31:59 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:31:59 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dd8c084-604b-472c-b544-122f7d1622d2]: (4, ('- - 0', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:31:59 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-b347c3f9-ba96-4152-b346-ddd7bd69468d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Searching for a device in session 32 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=71731) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 16:31:59 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-b347c3f9-ba96-4152-b346-ddd7bd69468d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:25c3dc97-c9cb-4529-ab32-26ef7fd94fc6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZFsWRaGN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71731) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 16:31:59 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 64a9c052-89a9-48ba-80c9-13fb5ef22f0e] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 16:31:59 user nova-compute[71731]: DEBUG nova.virt.driver [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Emitting event <LifecycleEvent: 1681403519.2086966, 64a9c052-89a9-48ba-80c9-13fb5ef22f0e => Started> {{(pid=71731) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 16:31:59 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 64a9c052-89a9-48ba-80c9-13fb5ef22f0e] VM Started (Lifecycle Event)
Apr 13 16:31:59 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 64a9c052-89a9-48ba-80c9-13fb5ef22f0e] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:31:59 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 64a9c052-89a9-48ba-80c9-13fb5ef22f0e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71731) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 16:31:59 user nova-compute[71731]: INFO nova.compute.manager [None req-1cbd883c-06ac-47dd-acfa-2f5baa8ec9ba tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] [instance: 64a9c052-89a9-48ba-80c9-13fb5ef22f0e] Took 8.06 seconds to spawn the instance on the hypervisor.
Apr 13 16:31:59 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1cbd883c-06ac-47dd-acfa-2f5baa8ec9ba tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] [instance: 64a9c052-89a9-48ba-80c9-13fb5ef22f0e] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:31:59 user nova-compute[71731]: DEBUG nova.compute.manager [req-f334f80b-81fb-4b1a-82f2-a483877d78b4 req-3cd4bdd2-a0cc-417a-9751-bb7871583dc2 service nova] [instance: 64a9c052-89a9-48ba-80c9-13fb5ef22f0e] Received event network-vif-plugged-5128334f-7255-4a56-9e8b-1151027d219b {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:31:59 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-f334f80b-81fb-4b1a-82f2-a483877d78b4 req-3cd4bdd2-a0cc-417a-9751-bb7871583dc2 service nova] Acquiring lock "64a9c052-89a9-48ba-80c9-13fb5ef22f0e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:31:59 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-f334f80b-81fb-4b1a-82f2-a483877d78b4 req-3cd4bdd2-a0cc-417a-9751-bb7871583dc2 service nova] Lock "64a9c052-89a9-48ba-80c9-13fb5ef22f0e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:31:59 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-f334f80b-81fb-4b1a-82f2-a483877d78b4 req-3cd4bdd2-a0cc-417a-9751-bb7871583dc2 service nova] Lock "64a9c052-89a9-48ba-80c9-13fb5ef22f0e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:31:59 user nova-compute[71731]: DEBUG nova.compute.manager [req-f334f80b-81fb-4b1a-82f2-a483877d78b4 req-3cd4bdd2-a0cc-417a-9751-bb7871583dc2 service nova] [instance: 64a9c052-89a9-48ba-80c9-13fb5ef22f0e] No waiting events found dispatching network-vif-plugged-5128334f-7255-4a56-9e8b-1151027d219b {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:31:59 user nova-compute[71731]: WARNING nova.compute.manager [req-f334f80b-81fb-4b1a-82f2-a483877d78b4 req-3cd4bdd2-a0cc-417a-9751-bb7871583dc2 service nova] [instance: 64a9c052-89a9-48ba-80c9-13fb5ef22f0e] Received unexpected event network-vif-plugged-5128334f-7255-4a56-9e8b-1151027d219b for instance with vm_state building and task_state spawning.
Apr 13 16:31:59 user nova-compute[71731]: DEBUG nova.compute.manager [req-f334f80b-81fb-4b1a-82f2-a483877d78b4 req-3cd4bdd2-a0cc-417a-9751-bb7871583dc2 service nova] [instance: 35b23303-e373-4f35-b7ee-76e6815073ce] Received event network-changed-d3c66e4e-b15d-4bc9-a838-265ca07a6a66 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:31:59 user nova-compute[71731]: DEBUG nova.compute.manager [req-f334f80b-81fb-4b1a-82f2-a483877d78b4 req-3cd4bdd2-a0cc-417a-9751-bb7871583dc2 service nova] [instance: 35b23303-e373-4f35-b7ee-76e6815073ce] Refreshing instance network info cache due to event network-changed-d3c66e4e-b15d-4bc9-a838-265ca07a6a66. {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 16:31:59 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-f334f80b-81fb-4b1a-82f2-a483877d78b4 req-3cd4bdd2-a0cc-417a-9751-bb7871583dc2 service nova] Acquiring lock "refresh_cache-35b23303-e373-4f35-b7ee-76e6815073ce" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 16:31:59 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-f334f80b-81fb-4b1a-82f2-a483877d78b4 req-3cd4bdd2-a0cc-417a-9751-bb7871583dc2 service nova] Acquired lock "refresh_cache-35b23303-e373-4f35-b7ee-76e6815073ce" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 16:31:59 user nova-compute[71731]: DEBUG nova.network.neutron [req-f334f80b-81fb-4b1a-82f2-a483877d78b4 req-3cd4bdd2-a0cc-417a-9751-bb7871583dc2 service nova] [instance: 35b23303-e373-4f35-b7ee-76e6815073ce] Refreshing network info cache for port d3c66e4e-b15d-4bc9-a838-265ca07a6a66 {{(pid=71731) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 16:31:59 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 64a9c052-89a9-48ba-80c9-13fb5ef22f0e] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 16:31:59 user nova-compute[71731]: INFO nova.compute.manager [None req-1cbd883c-06ac-47dd-acfa-2f5baa8ec9ba tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] [instance: 64a9c052-89a9-48ba-80c9-13fb5ef22f0e] Took 8.93 seconds to build instance.
Apr 13 16:31:59 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-1cbd883c-06ac-47dd-acfa-2f5baa8ec9ba tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Lock "64a9c052-89a9-48ba-80c9-13fb5ef22f0e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.036s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:31:59 user nova-compute[71731]: DEBUG nova.network.neutron [req-f334f80b-81fb-4b1a-82f2-a483877d78b4 req-3cd4bdd2-a0cc-417a-9751-bb7871583dc2 service nova] [instance: 35b23303-e373-4f35-b7ee-76e6815073ce] Updated VIF entry in instance network info cache for port d3c66e4e-b15d-4bc9-a838-265ca07a6a66. {{(pid=71731) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 16:31:59 user nova-compute[71731]: DEBUG nova.network.neutron [req-f334f80b-81fb-4b1a-82f2-a483877d78b4 req-3cd4bdd2-a0cc-417a-9751-bb7871583dc2 service nova] [instance: 35b23303-e373-4f35-b7ee-76e6815073ce] Updating instance_info_cache with network_info: [{"id": "d3c66e4e-b15d-4bc9-a838-265ca07a6a66", "address": "fa:16:3e:3a:4e:db", "network": {"id": "5acc9a78-1127-46df-bb60-7544cdd2c1ef", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2143082515-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0653ab16660b46cea9c5af58ea0b1931", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3c66e4e-b1", "ovs_interfaceid": "d3c66e4e-b15d-4bc9-a838-265ca07a6a66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:31:59 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-f334f80b-81fb-4b1a-82f2-a483877d78b4 req-3cd4bdd2-a0cc-417a-9751-bb7871583dc2 service nova] Releasing lock "refresh_cache-35b23303-e373-4f35-b7ee-76e6815073ce" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 16:32:00 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-b347c3f9-ba96-4152-b346-ddd7bd69468d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.744s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 16:32:00 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-b347c3f9-ba96-4152-b346-ddd7bd69468d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] <== connect_volume: return (1746ms) {'type': 'block', 'scsi_wwn': '23838303333626134', 'path': '/dev/sdd'} {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 16:32:00 user nova-compute[71731]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b347c3f9-ba96-4152-b346-ddd7bd69468d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: 2956ab05-28ff-4c9e-b646-dbb83b3db278] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23838303333626134', 'path': '/dev/sdd'} {{(pid=71731) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 16:32:00 user nova-compute[71731]: DEBUG nova.virt.libvirt.vif [None req-b347c3f9-ba96-4152-b346-ddd7bd69468d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T16:31:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1531186020',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1531186020',id=27,image_ref='708622a9-7465-4492-ade8-b827198f7e30',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b2d09a74bf684a9fb1dd1e95d6c23f3c',ramdisk_id='',reservation_id='r-ijjf8jor',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='708622a9-7465-4492-ade8-b827198f7e30',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1960261099',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T16:31:48Z,user_data=None,user_id='e45a882dbafb4ea4976e4f45289eb2b8',uuid=2956ab05-28ff-4c9e-b646-dbb83b3db278,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "84df62e9-af7c-4e62-83da-b43b511be2a0", "address": "fa:16:3e:66:e8:40", "network": {"id": "5a7877ff-8230-470b-90b5-e5dcfc8f0cee", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-779403873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2d09a74bf684a9fb1dd1e95d6c23f3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84df62e9-af", "ovs_interfaceid": "84df62e9-af7c-4e62-83da-b43b511be2a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71731) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 16:32:00 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-b347c3f9-ba96-4152-b346-ddd7bd69468d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Converting VIF {"id": "84df62e9-af7c-4e62-83da-b43b511be2a0", "address": "fa:16:3e:66:e8:40", "network": {"id": "5a7877ff-8230-470b-90b5-e5dcfc8f0cee", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-779403873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2d09a74bf684a9fb1dd1e95d6c23f3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84df62e9-af", "ovs_interfaceid": "84df62e9-af7c-4e62-83da-b43b511be2a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 16:32:00 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-b347c3f9-ba96-4152-b346-ddd7bd69468d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:66:e8:40,bridge_name='br-int',has_traffic_filtering=True,id=84df62e9-af7c-4e62-83da-b43b511be2a0,network=Network(5a7877ff-8230-470b-90b5-e5dcfc8f0cee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84df62e9-af') {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 16:32:00 user nova-compute[71731]: DEBUG nova.objects.instance [None req-b347c3f9-ba96-4152-b346-ddd7bd69468d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lazy-loading 'pci_devices' on Instance uuid 2956ab05-28ff-4c9e-b646-dbb83b3db278 {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:32:00 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-b347c3f9-ba96-4152-b346-ddd7bd69468d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: 2956ab05-28ff-4c9e-b646-dbb83b3db278] End _get_guest_xml xml=<domain type="kvm">
Apr 13 16:32:00 user nova-compute[71731]:   <uuid>2956ab05-28ff-4c9e-b646-dbb83b3db278</uuid>
Apr 13 16:32:00 user nova-compute[71731]:   <name>instance-0000001b</name>
Apr 13 16:32:00 user nova-compute[71731]:   <memory>131072</memory>
Apr 13 16:32:00 user nova-compute[71731]:   <vcpu>1</vcpu>
Apr 13 16:32:00 user nova-compute[71731]:   <metadata>
Apr 13 16:32:00 user nova-compute[71731]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 16:32:00 user nova-compute[71731]:       <nova:package version="0.0.0"/>
Apr 13 16:32:00 user nova-compute[71731]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1531186020</nova:name>
Apr 13 16:32:00 user nova-compute[71731]:       <nova:creationTime>2023-04-13 16:31:58</nova:creationTime>
Apr 13 16:32:00 user nova-compute[71731]:       <nova:flavor name="m1.nano">
Apr 13 16:32:00 user nova-compute[71731]:         <nova:memory>128</nova:memory>
Apr 13 16:32:00 user nova-compute[71731]:         <nova:disk>1</nova:disk>
Apr 13 16:32:00 user nova-compute[71731]:         <nova:swap>0</nova:swap>
Apr 13 16:32:00 user nova-compute[71731]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 16:32:00 user nova-compute[71731]:         <nova:vcpus>1</nova:vcpus>
Apr 13 16:32:00 user nova-compute[71731]:       </nova:flavor>
Apr 13 16:32:00 user nova-compute[71731]:       <nova:owner>
Apr 13 16:32:00 user nova-compute[71731]:         <nova:user uuid="e45a882dbafb4ea4976e4f45289eb2b8">tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member</nova:user>
Apr 13 16:32:00 user nova-compute[71731]:         <nova:project uuid="b2d09a74bf684a9fb1dd1e95d6c23f3c">tempest-ServerBootFromVolumeStableRescueTest-1960261099</nova:project>
Apr 13 16:32:00 user nova-compute[71731]:       </nova:owner>
Apr 13 16:32:00 user nova-compute[71731]:       <nova:root type="image" uuid="708622a9-7465-4492-ade8-b827198f7e30"/>
Apr 13 16:32:00 user nova-compute[71731]:       <nova:ports>
Apr 13 16:32:00 user nova-compute[71731]:         <nova:port uuid="84df62e9-af7c-4e62-83da-b43b511be2a0">
Apr 13 16:32:00 user nova-compute[71731]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Apr 13 16:32:00 user nova-compute[71731]:         </nova:port>
Apr 13 16:32:00 user nova-compute[71731]:       </nova:ports>
Apr 13 16:32:00 user nova-compute[71731]:     </nova:instance>
Apr 13 16:32:00 user nova-compute[71731]:   </metadata>
Apr 13 16:32:00 user nova-compute[71731]:   <sysinfo type="smbios">
Apr 13 16:32:00 user nova-compute[71731]:     <system>
Apr 13 16:32:00 user nova-compute[71731]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 16:32:00 user nova-compute[71731]:       <entry name="product">OpenStack Nova</entry>
Apr 13 16:32:00 user nova-compute[71731]:       <entry name="version">0.0.0</entry>
Apr 13 16:32:00 user nova-compute[71731]:       <entry name="serial">2956ab05-28ff-4c9e-b646-dbb83b3db278</entry>
Apr 13 16:32:00 user nova-compute[71731]:       <entry name="uuid">2956ab05-28ff-4c9e-b646-dbb83b3db278</entry>
Apr 13 16:32:00 user nova-compute[71731]:       <entry name="family">Virtual Machine</entry>
Apr 13 16:32:00 user nova-compute[71731]:     </system>
Apr 13 16:32:00 user nova-compute[71731]:   </sysinfo>
Apr 13 16:32:00 user nova-compute[71731]:   <os>
Apr 13 16:32:00 user nova-compute[71731]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 16:32:00 user nova-compute[71731]:     <boot dev="hd"/>
Apr 13 16:32:00 user nova-compute[71731]:     <smbios mode="sysinfo"/>
Apr 13 16:32:00 user nova-compute[71731]:   </os>
Apr 13 16:32:00 user nova-compute[71731]:   <features>
Apr 13 16:32:00 user nova-compute[71731]:     <acpi/>
Apr 13 16:32:00 user nova-compute[71731]:     <apic/>
Apr 13 16:32:00 user nova-compute[71731]:     <vmcoreinfo/>
Apr 13 16:32:00 user nova-compute[71731]:   </features>
Apr 13 16:32:00 user nova-compute[71731]:   <clock offset="utc">
Apr 13 16:32:00 user nova-compute[71731]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 16:32:00 user nova-compute[71731]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 16:32:00 user nova-compute[71731]:     <timer name="hpet" present="no"/>
Apr 13 16:32:00 user nova-compute[71731]:   </clock>
Apr 13 16:32:00 user nova-compute[71731]:   <cpu mode="custom" match="exact">
Apr 13 16:32:00 user nova-compute[71731]:     <model>Nehalem</model>
Apr 13 16:32:00 user nova-compute[71731]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 16:32:00 user nova-compute[71731]:   </cpu>
Apr 13 16:32:00 user nova-compute[71731]:   <devices>
Apr 13 16:32:00 user nova-compute[71731]:     <disk type="block" device="disk">
Apr 13 16:32:00 user nova-compute[71731]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 16:32:00 user nova-compute[71731]:       <source dev="/dev/sdd"/>
Apr 13 16:32:00 user nova-compute[71731]:       <target dev="vda" bus="virtio"/>
Apr 13 16:32:00 user nova-compute[71731]:       <serial>25c3dc97-c9cb-4529-ab32-26ef7fd94fc6</serial>
Apr 13 16:32:00 user nova-compute[71731]:     </disk>
Apr 13 16:32:00 user nova-compute[71731]:     <interface type="ethernet">
Apr 13 16:32:00 user nova-compute[71731]:       <mac address="fa:16:3e:66:e8:40"/>
Apr 13 16:32:00 user nova-compute[71731]:       <model type="virtio"/>
Apr 13 16:32:00 user nova-compute[71731]:       <mtu size="1442"/>
Apr 13 16:32:00 user nova-compute[71731]:       <target dev="tap84df62e9-af"/>
Apr 13 16:32:00 user nova-compute[71731]:     </interface>
Apr 13 16:32:00 user nova-compute[71731]:     <serial type="pty">
Apr 13 16:32:00 user nova-compute[71731]:       <log file="/opt/stack/data/nova/instances/2956ab05-28ff-4c9e-b646-dbb83b3db278/console.log" append="off"/>
Apr 13 16:32:00 user nova-compute[71731]:     </serial>
Apr 13 16:32:00 user nova-compute[71731]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 16:32:00 user nova-compute[71731]:     <video>
Apr 13 16:32:00 user nova-compute[71731]:       <model type="virtio"/>
Apr 13 16:32:00 user nova-compute[71731]:     </video>
Apr 13 16:32:00 user nova-compute[71731]:     <rng model="virtio">
Apr 13 16:32:00 user nova-compute[71731]:       <backend model="random">/dev/urandom</backend>
Apr 13 16:32:00 user nova-compute[71731]:     </rng>
Apr 13 16:32:00 user nova-compute[71731]:     <controller type="usb" index="0" model="none"/>
Apr 13 16:32:00 user nova-compute[71731]:     <memballoon model="virtio">
Apr 13 16:32:00 user nova-compute[71731]:       <stats period="10"/>
Apr 13 16:32:00 user nova-compute[71731]:     </memballoon>
Apr 13 16:32:00 user nova-compute[71731]:   </devices>
Apr 13 16:32:00 user nova-compute[71731]: </domain>
Apr 13 16:32:00 user nova-compute[71731]:  {{(pid=71731) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 16:32:00 user nova-compute[71731]: DEBUG nova.virt.libvirt.vif [None req-b347c3f9-ba96-4152-b346-ddd7bd69468d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T16:31:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1531186020',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1531186020',id=27,image_ref='708622a9-7465-4492-ade8-b827198f7e30',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b2d09a74bf684a9fb1dd1e95d6c23f3c',ramdisk_id='',reservation_id='r-ijjf8jor',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='708622a9-7465-4492-ade8-b827198f7e30',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1960261099',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T16:31:48Z,user_data=None,user_id='e45a882dbafb4ea4976e4f45289eb2b8',uuid=2956ab05-28ff-4c9e-b646-dbb83b3db278,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "84df62e9-af7c-4e62-83da-b43b511be2a0", "address": "fa:16:3e:66:e8:40", "network": {"id": "5a7877ff-8230-470b-90b5-e5dcfc8f0cee", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-779403873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2d09a74bf684a9fb1dd1e95d6c23f3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84df62e9-af", "ovs_interfaceid": "84df62e9-af7c-4e62-83da-b43b511be2a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 16:32:00 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-b347c3f9-ba96-4152-b346-ddd7bd69468d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Converting VIF {"id": "84df62e9-af7c-4e62-83da-b43b511be2a0", "address": "fa:16:3e:66:e8:40", "network": {"id": "5a7877ff-8230-470b-90b5-e5dcfc8f0cee", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-779403873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2d09a74bf684a9fb1dd1e95d6c23f3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84df62e9-af", "ovs_interfaceid": "84df62e9-af7c-4e62-83da-b43b511be2a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 16:32:00 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-b347c3f9-ba96-4152-b346-ddd7bd69468d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:66:e8:40,bridge_name='br-int',has_traffic_filtering=True,id=84df62e9-af7c-4e62-83da-b43b511be2a0,network=Network(5a7877ff-8230-470b-90b5-e5dcfc8f0cee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84df62e9-af') {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 16:32:00 user nova-compute[71731]: DEBUG os_vif [None req-b347c3f9-ba96-4152-b346-ddd7bd69468d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:e8:40,bridge_name='br-int',has_traffic_filtering=True,id=84df62e9-af7c-4e62-83da-b43b511be2a0,network=Network(5a7877ff-8230-470b-90b5-e5dcfc8f0cee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84df62e9-af') {{(pid=71731) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 16:32:00 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:32:00 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:32:00 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 16:32:00 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:32:00 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap84df62e9-af, may_exist=True) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:32:00 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap84df62e9-af, col_values=(('external_ids', {'iface-id': '84df62e9-af7c-4e62-83da-b43b511be2a0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:66:e8:40', 'vm-uuid': '2956ab05-28ff-4c9e-b646-dbb83b3db278'}),)) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:32:00 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:32:00 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 16:32:00 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:32:00 user nova-compute[71731]: INFO os_vif [None req-b347c3f9-ba96-4152-b346-ddd7bd69468d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:e8:40,bridge_name='br-int',has_traffic_filtering=True,id=84df62e9-af7c-4e62-83da-b43b511be2a0,network=Network(5a7877ff-8230-470b-90b5-e5dcfc8f0cee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84df62e9-af')
Apr 13 16:32:00 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:32:00 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-b347c3f9-ba96-4152-b346-ddd7bd69468d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] No BDM found with device name vda, not building metadata. {{(pid=71731) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 16:32:00 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-b347c3f9-ba96-4152-b346-ddd7bd69468d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] No VIF found with MAC fa:16:3e:66:e8:40, not building metadata {{(pid=71731) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 16:32:00 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:32:00 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:32:00 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:32:00 user nova-compute[71731]: DEBUG nova.compute.manager [req-d1642f9c-92a0-47c6-a8d0-b328afd76268 req-26a1c975-0e22-4b31-9b44-8806f0727422 service nova] [instance: 35b23303-e373-4f35-b7ee-76e6815073ce] Received event network-vif-plugged-d3c66e4e-b15d-4bc9-a838-265ca07a6a66 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:32:00 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-d1642f9c-92a0-47c6-a8d0-b328afd76268 req-26a1c975-0e22-4b31-9b44-8806f0727422 service nova] Acquiring lock "35b23303-e373-4f35-b7ee-76e6815073ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:32:00 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-d1642f9c-92a0-47c6-a8d0-b328afd76268 req-26a1c975-0e22-4b31-9b44-8806f0727422 service nova] Lock "35b23303-e373-4f35-b7ee-76e6815073ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:32:00 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-d1642f9c-92a0-47c6-a8d0-b328afd76268 req-26a1c975-0e22-4b31-9b44-8806f0727422 service nova] Lock "35b23303-e373-4f35-b7ee-76e6815073ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:32:00 user nova-compute[71731]: DEBUG nova.compute.manager [req-d1642f9c-92a0-47c6-a8d0-b328afd76268 req-26a1c975-0e22-4b31-9b44-8806f0727422 service nova] [instance: 35b23303-e373-4f35-b7ee-76e6815073ce] No waiting events found dispatching network-vif-plugged-d3c66e4e-b15d-4bc9-a838-265ca07a6a66 {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:32:00 user nova-compute[71731]: WARNING nova.compute.manager [req-d1642f9c-92a0-47c6-a8d0-b328afd76268 req-26a1c975-0e22-4b31-9b44-8806f0727422 service nova] [instance: 35b23303-e373-4f35-b7ee-76e6815073ce] Received unexpected event network-vif-plugged-d3c66e4e-b15d-4bc9-a838-265ca07a6a66 for instance with vm_state building and task_state spawning.
Apr 13 16:32:01 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:32:01 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:32:01 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:32:01 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:32:01 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:32:01 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:32:02 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:32:02 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:32:02 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:32:02 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:32:02 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:32:02 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:32:02 user nova-compute[71731]: DEBUG nova.compute.manager [req-a6f43fe8-f097-40fe-8db1-78a5dac0c995 req-e27d058f-c046-4318-b850-3d6dbbdc1ee2 service nova] [instance: 2956ab05-28ff-4c9e-b646-dbb83b3db278] Received event network-vif-plugged-84df62e9-af7c-4e62-83da-b43b511be2a0 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:32:02 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-a6f43fe8-f097-40fe-8db1-78a5dac0c995 req-e27d058f-c046-4318-b850-3d6dbbdc1ee2 service nova] Acquiring lock "2956ab05-28ff-4c9e-b646-dbb83b3db278-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:32:02 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-a6f43fe8-f097-40fe-8db1-78a5dac0c995 req-e27d058f-c046-4318-b850-3d6dbbdc1ee2 service nova] Lock "2956ab05-28ff-4c9e-b646-dbb83b3db278-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:32:02 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-a6f43fe8-f097-40fe-8db1-78a5dac0c995 req-e27d058f-c046-4318-b850-3d6dbbdc1ee2 service nova] Lock "2956ab05-28ff-4c9e-b646-dbb83b3db278-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:32:02 user nova-compute[71731]: DEBUG nova.compute.manager [req-a6f43fe8-f097-40fe-8db1-78a5dac0c995 req-e27d058f-c046-4318-b850-3d6dbbdc1ee2 service nova] [instance: 2956ab05-28ff-4c9e-b646-dbb83b3db278] No waiting events found dispatching network-vif-plugged-84df62e9-af7c-4e62-83da-b43b511be2a0 {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:32:02 user nova-compute[71731]: WARNING nova.compute.manager [req-a6f43fe8-f097-40fe-8db1-78a5dac0c995 req-e27d058f-c046-4318-b850-3d6dbbdc1ee2 service nova] [instance: 2956ab05-28ff-4c9e-b646-dbb83b3db278] Received unexpected event network-vif-plugged-84df62e9-af7c-4e62-83da-b43b511be2a0 for instance with vm_state building and task_state spawning.
Apr 13 16:32:02 user nova-compute[71731]: DEBUG nova.compute.manager [req-14e2fff3-5d02-4dbe-934f-d5e68d64f627 req-02333e31-a140-437c-99ec-a04bb8977f13 service nova] [instance: 35b23303-e373-4f35-b7ee-76e6815073ce] Received event network-vif-plugged-d3c66e4e-b15d-4bc9-a838-265ca07a6a66 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:32:02 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-14e2fff3-5d02-4dbe-934f-d5e68d64f627 req-02333e31-a140-437c-99ec-a04bb8977f13 service nova] Acquiring lock "35b23303-e373-4f35-b7ee-76e6815073ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:32:02 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-14e2fff3-5d02-4dbe-934f-d5e68d64f627 req-02333e31-a140-437c-99ec-a04bb8977f13 service nova] Lock "35b23303-e373-4f35-b7ee-76e6815073ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:32:02 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-14e2fff3-5d02-4dbe-934f-d5e68d64f627 req-02333e31-a140-437c-99ec-a04bb8977f13 service nova] Lock "35b23303-e373-4f35-b7ee-76e6815073ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:32:02 user nova-compute[71731]: DEBUG nova.compute.manager [req-14e2fff3-5d02-4dbe-934f-d5e68d64f627 req-02333e31-a140-437c-99ec-a04bb8977f13 service nova] [instance: 35b23303-e373-4f35-b7ee-76e6815073ce] No waiting events found dispatching network-vif-plugged-d3c66e4e-b15d-4bc9-a838-265ca07a6a66 {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:32:02 user nova-compute[71731]: WARNING nova.compute.manager [req-14e2fff3-5d02-4dbe-934f-d5e68d64f627 req-02333e31-a140-437c-99ec-a04bb8977f13 service nova] [instance: 35b23303-e373-4f35-b7ee-76e6815073ce] Received unexpected event network-vif-plugged-d3c66e4e-b15d-4bc9-a838-265ca07a6a66 for instance with vm_state building and task_state spawning.
Apr 13 16:32:03 user nova-compute[71731]: DEBUG nova.virt.driver [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Emitting event <LifecycleEvent: 1681403523.9632256, 35b23303-e373-4f35-b7ee-76e6815073ce => Resumed> {{(pid=71731) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 16:32:03 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 35b23303-e373-4f35-b7ee-76e6815073ce] VM Resumed (Lifecycle Event)
Apr 13 16:32:03 user nova-compute[71731]: DEBUG nova.compute.manager [None req-f5944cc3-0bfe-4afc-80f2-fb850e13932f tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] [instance: 35b23303-e373-4f35-b7ee-76e6815073ce] Instance event wait completed in 0 seconds for  {{(pid=71731) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 16:32:03 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-f5944cc3-0bfe-4afc-80f2-fb850e13932f tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] [instance: 35b23303-e373-4f35-b7ee-76e6815073ce] Guest created on hypervisor {{(pid=71731) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 16:32:03 user nova-compute[71731]: INFO nova.virt.libvirt.driver [-] [instance: 35b23303-e373-4f35-b7ee-76e6815073ce] Instance spawned successfully.
Apr 13 16:32:03 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-f5944cc3-0bfe-4afc-80f2-fb850e13932f tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] [instance: 35b23303-e373-4f35-b7ee-76e6815073ce] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 16:32:03 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 35b23303-e373-4f35-b7ee-76e6815073ce] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:32:03 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 35b23303-e373-4f35-b7ee-76e6815073ce] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71731) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 16:32:04 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-f5944cc3-0bfe-4afc-80f2-fb850e13932f tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] [instance: 35b23303-e373-4f35-b7ee-76e6815073ce] Found default for hw_cdrom_bus of ide {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:32:04 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-f5944cc3-0bfe-4afc-80f2-fb850e13932f tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] [instance: 35b23303-e373-4f35-b7ee-76e6815073ce] Found default for hw_disk_bus of virtio {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:32:04 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-f5944cc3-0bfe-4afc-80f2-fb850e13932f tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] [instance: 35b23303-e373-4f35-b7ee-76e6815073ce] Found default for hw_input_bus of None {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:32:04 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-f5944cc3-0bfe-4afc-80f2-fb850e13932f tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] [instance: 35b23303-e373-4f35-b7ee-76e6815073ce] Found default for hw_pointer_model of None {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:32:04 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-f5944cc3-0bfe-4afc-80f2-fb850e13932f tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] [instance: 35b23303-e373-4f35-b7ee-76e6815073ce] Found default for hw_video_model of virtio {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:32:04 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-f5944cc3-0bfe-4afc-80f2-fb850e13932f tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] [instance: 35b23303-e373-4f35-b7ee-76e6815073ce] Found default for hw_vif_model of virtio {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:32:04 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 35b23303-e373-4f35-b7ee-76e6815073ce] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 16:32:04 user nova-compute[71731]: DEBUG nova.virt.driver [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Emitting event <LifecycleEvent: 1681403523.96662, 35b23303-e373-4f35-b7ee-76e6815073ce => Started> {{(pid=71731) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 16:32:04 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 35b23303-e373-4f35-b7ee-76e6815073ce] VM Started (Lifecycle Event)
Apr 13 16:32:04 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 35b23303-e373-4f35-b7ee-76e6815073ce] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:32:04 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 35b23303-e373-4f35-b7ee-76e6815073ce] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71731) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 16:32:04 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 35b23303-e373-4f35-b7ee-76e6815073ce] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 16:32:04 user nova-compute[71731]: INFO nova.compute.manager [None req-f5944cc3-0bfe-4afc-80f2-fb850e13932f tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] [instance: 35b23303-e373-4f35-b7ee-76e6815073ce] Took 8.43 seconds to spawn the instance on the hypervisor.
Apr 13 16:32:04 user nova-compute[71731]: DEBUG nova.compute.manager [None req-f5944cc3-0bfe-4afc-80f2-fb850e13932f tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] [instance: 35b23303-e373-4f35-b7ee-76e6815073ce] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:32:04 user nova-compute[71731]: INFO nova.compute.manager [None req-f5944cc3-0bfe-4afc-80f2-fb850e13932f tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] [instance: 35b23303-e373-4f35-b7ee-76e6815073ce] Took 9.31 seconds to build instance.
Apr 13 16:32:04 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-f5944cc3-0bfe-4afc-80f2-fb850e13932f tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lock "35b23303-e373-4f35-b7ee-76e6815073ce" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.425s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:32:04 user nova-compute[71731]: DEBUG nova.virt.driver [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Emitting event <LifecycleEvent: 1681403524.4864368, 2956ab05-28ff-4c9e-b646-dbb83b3db278 => Resumed> {{(pid=71731) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 16:32:04 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 2956ab05-28ff-4c9e-b646-dbb83b3db278] VM Resumed (Lifecycle Event)
Apr 13 16:32:04 user nova-compute[71731]: DEBUG nova.compute.manager [None req-b347c3f9-ba96-4152-b346-ddd7bd69468d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: 2956ab05-28ff-4c9e-b646-dbb83b3db278] Instance event wait completed in 0 seconds for  {{(pid=71731) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 16:32:04 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-b347c3f9-ba96-4152-b346-ddd7bd69468d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: 2956ab05-28ff-4c9e-b646-dbb83b3db278] Guest created on hypervisor {{(pid=71731) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 16:32:04 user nova-compute[71731]: INFO nova.virt.libvirt.driver [-] [instance: 2956ab05-28ff-4c9e-b646-dbb83b3db278] Instance spawned successfully.
Apr 13 16:32:04 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-b347c3f9-ba96-4152-b346-ddd7bd69468d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: 2956ab05-28ff-4c9e-b646-dbb83b3db278] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 16:32:04 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 2956ab05-28ff-4c9e-b646-dbb83b3db278] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:32:04 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 2956ab05-28ff-4c9e-b646-dbb83b3db278] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71731) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 16:32:04 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-b347c3f9-ba96-4152-b346-ddd7bd69468d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: 2956ab05-28ff-4c9e-b646-dbb83b3db278] Found default for hw_cdrom_bus of ide {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:32:04 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-b347c3f9-ba96-4152-b346-ddd7bd69468d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: 2956ab05-28ff-4c9e-b646-dbb83b3db278] Found default for hw_disk_bus of virtio {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:32:04 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-b347c3f9-ba96-4152-b346-ddd7bd69468d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: 2956ab05-28ff-4c9e-b646-dbb83b3db278] Found default for hw_input_bus of None {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:32:04 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-b347c3f9-ba96-4152-b346-ddd7bd69468d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: 2956ab05-28ff-4c9e-b646-dbb83b3db278] Found default for hw_pointer_model of None {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:32:04 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-b347c3f9-ba96-4152-b346-ddd7bd69468d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: 2956ab05-28ff-4c9e-b646-dbb83b3db278] Found default for hw_video_model of virtio {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:32:04 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-b347c3f9-ba96-4152-b346-ddd7bd69468d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: 2956ab05-28ff-4c9e-b646-dbb83b3db278] Found default for hw_vif_model of virtio {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:32:04 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 2956ab05-28ff-4c9e-b646-dbb83b3db278] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 16:32:04 user nova-compute[71731]: DEBUG nova.virt.driver [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Emitting event <LifecycleEvent: 1681403524.4903133, 2956ab05-28ff-4c9e-b646-dbb83b3db278 => Started> {{(pid=71731) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 16:32:04 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 2956ab05-28ff-4c9e-b646-dbb83b3db278] VM Started (Lifecycle Event)
Apr 13 16:32:04 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 2956ab05-28ff-4c9e-b646-dbb83b3db278] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:32:04 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 2956ab05-28ff-4c9e-b646-dbb83b3db278] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71731) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 16:32:04 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 2956ab05-28ff-4c9e-b646-dbb83b3db278] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 16:32:04 user nova-compute[71731]: INFO nova.compute.manager [None req-b347c3f9-ba96-4152-b346-ddd7bd69468d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: 2956ab05-28ff-4c9e-b646-dbb83b3db278] Took 6.24 seconds to spawn the instance on the hypervisor.
Apr 13 16:32:04 user nova-compute[71731]: DEBUG nova.compute.manager [None req-b347c3f9-ba96-4152-b346-ddd7bd69468d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: 2956ab05-28ff-4c9e-b646-dbb83b3db278] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:32:04 user nova-compute[71731]: INFO nova.compute.manager [None req-b347c3f9-ba96-4152-b346-ddd7bd69468d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: 2956ab05-28ff-4c9e-b646-dbb83b3db278] Took 17.95 seconds to build instance.
Apr 13 16:32:04 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-b347c3f9-ba96-4152-b346-ddd7bd69468d tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lock "2956ab05-28ff-4c9e-b646-dbb83b3db278" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.078s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:32:04 user nova-compute[71731]: DEBUG nova.compute.manager [req-8b8335ff-aed3-4906-8daa-1bcda6e6f4e4 req-6d87c5e2-2cd8-40d1-a301-691f9321fb00 service nova] [instance: 2956ab05-28ff-4c9e-b646-dbb83b3db278] Received event network-vif-plugged-84df62e9-af7c-4e62-83da-b43b511be2a0 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:32:04 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-8b8335ff-aed3-4906-8daa-1bcda6e6f4e4 req-6d87c5e2-2cd8-40d1-a301-691f9321fb00 service nova] Acquiring lock "2956ab05-28ff-4c9e-b646-dbb83b3db278-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:32:04 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-8b8335ff-aed3-4906-8daa-1bcda6e6f4e4 req-6d87c5e2-2cd8-40d1-a301-691f9321fb00 service nova] Lock "2956ab05-28ff-4c9e-b646-dbb83b3db278-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:32:04 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-8b8335ff-aed3-4906-8daa-1bcda6e6f4e4 req-6d87c5e2-2cd8-40d1-a301-691f9321fb00 service nova] Lock "2956ab05-28ff-4c9e-b646-dbb83b3db278-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:32:04 user nova-compute[71731]: DEBUG nova.compute.manager [req-8b8335ff-aed3-4906-8daa-1bcda6e6f4e4 req-6d87c5e2-2cd8-40d1-a301-691f9321fb00 service nova] [instance: 2956ab05-28ff-4c9e-b646-dbb83b3db278] No waiting events found dispatching network-vif-plugged-84df62e9-af7c-4e62-83da-b43b511be2a0 {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:32:04 user nova-compute[71731]: WARNING nova.compute.manager [req-8b8335ff-aed3-4906-8daa-1bcda6e6f4e4 req-6d87c5e2-2cd8-40d1-a301-691f9321fb00 service nova] [instance: 2956ab05-28ff-4c9e-b646-dbb83b3db278] Received unexpected event network-vif-plugged-84df62e9-af7c-4e62-83da-b43b511be2a0 for instance with vm_state active and task_state None.
Apr 13 16:32:05 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:32:06 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:32:10 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:32:11 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:32:13 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:32:14 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager.update_available_resource {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:32:14 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:32:14 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:32:14 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:32:14 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Auditing locally available compute resources for user (node: user) {{(pid=71731) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 16:32:14 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64a9c052-89a9-48ba-80c9-13fb5ef22f0e/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:32:14 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64a9c052-89a9-48ba-80c9-13fb5ef22f0e/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:32:14 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64a9c052-89a9-48ba-80c9-13fb5ef22f0e/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:32:14 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64a9c052-89a9-48ba-80c9-13fb5ef22f0e/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:32:14 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35b23303-e373-4f35-b7ee-76e6815073ce/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:32:14 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35b23303-e373-4f35-b7ee-76e6815073ce/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:32:14 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35b23303-e373-4f35-b7ee-76e6815073ce/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:32:14 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35b23303-e373-4f35-b7ee-76e6815073ce/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:32:14 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acbcaee0-a47b-4fee-8765-9b1c9597d515/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:32:15 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acbcaee0-a47b-4fee-8765-9b1c9597d515/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:32:15 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acbcaee0-a47b-4fee-8765-9b1c9597d515/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:32:15 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acbcaee0-a47b-4fee-8765-9b1c9597d515/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:32:15 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:32:15 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66553f5-5e1b-4f1d-8c5a-63bc340f7586/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:32:15 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66553f5-5e1b-4f1d-8c5a-63bc340f7586/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:32:15 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66553f5-5e1b-4f1d-8c5a-63bc340f7586/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:32:15 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66553f5-5e1b-4f1d-8c5a-63bc340f7586/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:32:15 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71731) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 16:32:15 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eaae47b9-a059-49f6-9ae6-d7147003e2f2/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:32:15 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eaae47b9-a059-49f6-9ae6-d7147003e2f2/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:32:15 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eaae47b9-a059-49f6-9ae6-d7147003e2f2/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:32:15 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eaae47b9-a059-49f6-9ae6-d7147003e2f2/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:32:15 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71731) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 16:32:15 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf98c3a2-dbeb-4ae4-8423-ce55964c4258/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:32:16 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf98c3a2-dbeb-4ae4-8423-ce55964c4258/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:32:16 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf98c3a2-dbeb-4ae4-8423-ce55964c4258/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:32:16 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf98c3a2-dbeb-4ae4-8423-ce55964c4258/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:32:16 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/650427bd-4dad-4bcd-922d-c17e60b36807/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:32:16 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/650427bd-4dad-4bcd-922d-c17e60b36807/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:32:16 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/650427bd-4dad-4bcd-922d-c17e60b36807/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:32:16 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/650427bd-4dad-4bcd-922d-c17e60b36807/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:32:16 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32b18558-8bf2-4def-bc70-81c4e38fcc6f/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:32:16 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32b18558-8bf2-4def-bc70-81c4e38fcc6f/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:32:16 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32b18558-8bf2-4def-bc70-81c4e38fcc6f/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:32:16 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:32:16 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32b18558-8bf2-4def-bc70-81c4e38fcc6f/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:32:16 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=71731) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 16:32:17 user nova-compute[71731]: WARNING nova.virt.libvirt.driver [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 16:32:17 user nova-compute[71731]: WARNING nova.virt.libvirt.driver [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 16:32:17 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Hypervisor/Node resource view: name=user free_ram=7551MB free_disk=26.06429672241211GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71731) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 16:32:17 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:32:17 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:32:17 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance f66553f5-5e1b-4f1d-8c5a-63bc340f7586 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 16:32:17 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance 235f827c-7116-48e9-84c5-0c9761c18e1e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 16:32:17 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance acbcaee0-a47b-4fee-8765-9b1c9597d515 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 16:32:17 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance eaae47b9-a059-49f6-9ae6-d7147003e2f2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 16:32:17 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance bf98c3a2-dbeb-4ae4-8423-ce55964c4258 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 16:32:17 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance 32b18558-8bf2-4def-bc70-81c4e38fcc6f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 16:32:17 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance 650427bd-4dad-4bcd-922d-c17e60b36807 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 16:32:17 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance 03200054-c651-4333-acce-3bea3defe22a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 16:32:17 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance 2956ab05-28ff-4c9e-b646-dbb83b3db278 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 16:32:17 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance 64a9c052-89a9-48ba-80c9-13fb5ef22f0e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 16:32:17 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance 35b23303-e373-4f35-b7ee-76e6815073ce actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 16:32:17 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=71731) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 16:32:17 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Final resource view: name=user phys_ram=16023MB used_ram=1920MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=71731) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 16:32:18 user nova-compute[71731]: DEBUG nova.compute.provider_tree [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Inventory has not changed in ProviderTree for provider: cb6b1a64-0c24-4e2d-af1e-16576ca9165c {{(pid=71731) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 16:32:18 user nova-compute[71731]: DEBUG nova.scheduler.client.report [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Inventory has not changed for provider cb6b1a64-0c24-4e2d-af1e-16576ca9165c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71731) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 16:32:18 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Compute_service record updated for user:user {{(pid=71731) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 16:32:18 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.617s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:32:19 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:32:19 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:32:19 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Starting heal instance info cache {{(pid=71731) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 16:32:19 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Rebuilding the list of instances to heal {{(pid=71731) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 13 16:32:19 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Acquiring lock "refresh_cache-f66553f5-5e1b-4f1d-8c5a-63bc340f7586" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 16:32:19 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Acquired lock "refresh_cache-f66553f5-5e1b-4f1d-8c5a-63bc340f7586" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 16:32:19 user nova-compute[71731]: DEBUG nova.network.neutron [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] [instance: f66553f5-5e1b-4f1d-8c5a-63bc340f7586] Forcefully refreshing network info cache for instance {{(pid=71731) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 16:32:19 user nova-compute[71731]: DEBUG nova.objects.instance [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lazy-loading 'info_cache' on Instance uuid f66553f5-5e1b-4f1d-8c5a-63bc340f7586 {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:32:19 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-a6339626-7d39-47bc-b91a-1f64ac6bf7f3 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Acquiring lock "acbcaee0-a47b-4fee-8765-9b1c9597d515" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:32:19 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-a6339626-7d39-47bc-b91a-1f64ac6bf7f3 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "acbcaee0-a47b-4fee-8765-9b1c9597d515" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:32:19 user nova-compute[71731]: DEBUG nova.objects.instance [None req-a6339626-7d39-47bc-b91a-1f64ac6bf7f3 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lazy-loading 'flavor' on Instance uuid acbcaee0-a47b-4fee-8765-9b1c9597d515 {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:32:19 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-a6339626-7d39-47bc-b91a-1f64ac6bf7f3 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "acbcaee0-a47b-4fee-8765-9b1c9597d515" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:32:19 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-a6339626-7d39-47bc-b91a-1f64ac6bf7f3 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Acquiring lock "acbcaee0-a47b-4fee-8765-9b1c9597d515" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:32:19 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-a6339626-7d39-47bc-b91a-1f64ac6bf7f3 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "acbcaee0-a47b-4fee-8765-9b1c9597d515" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:32:19 user nova-compute[71731]: INFO nova.compute.manager [None req-a6339626-7d39-47bc-b91a-1f64ac6bf7f3 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] Attaching volume 651ea766-ffda-42a1-9b3c-7be05a92c85f to /dev/vdb
Apr 13 16:32:19 user nova-compute[71731]: DEBUG os_brick.utils [None req-a6339626-7d39-47bc-b91a-1f64ac6bf7f3 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 16:32:19 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:32:19 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:32:19 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0726729-d24c-4140-8c19-f22703da84f3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:81501d91421\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:32:19 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:32:19 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:32:19 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[64f1db6f-4cc3-4eb2-a6a1-0d4f2965d936]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:32:19 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:32:19 user nova-compute[71731]: DEBUG nova.network.neutron [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] [instance: f66553f5-5e1b-4f1d-8c5a-63bc340f7586] Updating instance_info_cache with network_info: [{"id": "27d05b76-8556-4365-9050-6bf871e85502", "address": "fa:16:3e:0d:13:8a", "network": {"id": "5a7877ff-8230-470b-90b5-e5dcfc8f0cee", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-779403873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2d09a74bf684a9fb1dd1e95d6c23f3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27d05b76-85", "ovs_interfaceid": "27d05b76-8556-4365-9050-6bf871e85502", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:32:19 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:32:19 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[42db24a2-874a-4744-9504-7884251ec086]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:32:19 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[80976914-c252-4430-9ff2-bf9c8a560c2b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:32:19 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-a6339626-7d39-47bc-b91a-1f64ac6bf7f3 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Running cmd (subprocess): nvme version {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:32:19 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-a6339626-7d39-47bc-b91a-1f64ac6bf7f3 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] 'nvme version' failed. Not Retrying. {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 16:32:19 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a6339626-7d39-47bc-b91a-1f64ac6bf7f3 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] nvme not present on system {{(pid=71731) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 16:32:19 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Releasing lock "refresh_cache-f66553f5-5e1b-4f1d-8c5a-63bc340f7586" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 16:32:19 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] [instance: f66553f5-5e1b-4f1d-8c5a-63bc340f7586] Updated the network info_cache for instance {{(pid=71731) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 16:32:19 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:32:19 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:32:19 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:32:19 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:32:19 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:32:19 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71731) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 16:32:19 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 16:32:19 user nova-compute[71731]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 16:32:19 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[0560c35e-ae98-4bdc-b412-6b29082904dc]: (4, '') {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:32:19 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.lightos [None req-a6339626-7d39-47bc-b91a-1f64ac6bf7f3 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71731) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 16:32:19 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.lightos [None req-a6339626-7d39-47bc-b91a-1f64ac6bf7f3 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71731) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 16:32:19 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.lightos [None req-a6339626-7d39-47bc-b91a-1f64ac6bf7f3 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] LIGHTOS: no hostnqn found. {{(pid=71731) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 16:32:19 user nova-compute[71731]: DEBUG os_brick.utils [None req-a6339626-7d39-47bc-b91a-1f64ac6bf7f3 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:81501d91421', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 16:32:19 user nova-compute[71731]: DEBUG nova.virt.block_device [None req-a6339626-7d39-47bc-b91a-1f64ac6bf7f3 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] Updating existing volume attachment record: 8d4b63c9-3a18-475c-a49c-d142ccbfb42a {{(pid=71731) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 16:32:20 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:32:20 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:32:21 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:32:22 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:32:24 user nova-compute[71731]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a6339626-7d39-47bc-b91a-1f64ac6bf7f3 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] Calling os-brick to attach iSCSI Volume {{(pid=71731) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 16:32:24 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6339626-7d39-47bc-b91a-1f64ac6bf7f3 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8cf0118790>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:651ea766-ffda-42a1-9b3c-7be05a92c85f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ufUqtxTm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 16:32:24 user nova-compute[71731]: WARNING os_brick.initiator.connectors.base [None req-a6339626-7d39-47bc-b91a-1f64ac6bf7f3 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 16:32:24 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-a6339626-7d39-47bc-b91a-1f64ac6bf7f3 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 16:32:24 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-a6339626-7d39-47bc-b91a-1f64ac6bf7f3 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 16:32:24 user nova-compute[71731]: WARNING os_brick.initiator.connectors.base [None req-a6339626-7d39-47bc-b91a-1f64ac6bf7f3 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 16:32:24 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-a6339626-7d39-47bc-b91a-1f64ac6bf7f3 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:651ea766-ffda-42a1-9b3c-7be05a92c85f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 16:32:24 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-a6339626-7d39-47bc-b91a-1f64ac6bf7f3 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:651ea766-ffda-42a1-9b3c-7be05a92c85f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 16:32:24 user nova-compute[71731]: INFO os_brick.initiator.connectors.iscsi [None req-a6339626-7d39-47bc-b91a-1f64ac6bf7f3 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 16:32:24 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:651ea766-ffda-42a1-9b3c-7be05a92c85f -p 172.16.0.220:3260 {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:32:24 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:651ea766-ffda-42a1-9b3c-7be05a92c85f -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:32:24 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0be5a69-aa60-48a8-9fec-9e8c2231fe72]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:32:24 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6339626-7d39-47bc-b91a-1f64ac6bf7f3 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 16:32:24 user nova-compute[71731]:  {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:32:24 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:651ea766-ffda-42a1-9b3c-7be05a92c85f -p 172.16.0.220:3260 --interface default --op new {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:32:24 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:651ea766-ffda-42a1-9b3c-7be05a92c85f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:32:24 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5ee180a-d20e-42c4-9273-b0e69ec8d70a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:651ea766-ffda-42a1-9b3c-7be05a92c85f] added\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:32:24 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6339626-7d39-47bc-b91a-1f64ac6bf7f3 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:651ea766-ffda-42a1-9b3c-7be05a92c85f] added
Apr 13 16:32:24 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:32:24 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:651ea766-ffda-42a1-9b3c-7be05a92c85f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:32:24 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:651ea766-ffda-42a1-9b3c-7be05a92c85f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:32:24 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d7eb24d-9cb5-4082-8b27-459b7abef9a9]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:32:24 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6339626-7d39-47bc-b91a-1f64ac6bf7f3 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:32:24 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:651ea766-ffda-42a1-9b3c-7be05a92c85f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:32:24 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:651ea766-ffda-42a1-9b3c-7be05a92c85f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:32:24 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[07a39980-8832-4c74-ac5e-9e774021d076]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:32:24 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6339626-7d39-47bc-b91a-1f64ac6bf7f3 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:32:24 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:651ea766-ffda-42a1-9b3c-7be05a92c85f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ufUqtxTm {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:32:24 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:651ea766-ffda-42a1-9b3c-7be05a92c85f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ufUqtxTm" returned: 0 in 0.018s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:32:24 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[d975659e-1c73-47e3-a445-97107671d6df]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:32:24 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6339626-7d39-47bc-b91a-1f64ac6bf7f3 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ufUqtxTm'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:32:24 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:651ea766-ffda-42a1-9b3c-7be05a92c85f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:32:24 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:651ea766-ffda-42a1-9b3c-7be05a92c85f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:32:24 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[b625d879-44af-4ef6-9752-b0f6292b1172]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:32:24 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6339626-7d39-47bc-b91a-1f64ac6bf7f3 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:32:24 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:32:24 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:32:24 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a6c1f99-164c-4ffb-b94b-61793b61222a]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2088266-1d33-4bb1-ac5b-1de832ff7985 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25c3dc97-c9cb-4529-ab32-26ef7fd94fc6 (non-flash)\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:32:24 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6339626-7d39-47bc-b91a-1f64ac6bf7f3 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)
Apr 13 16:32:24 user nova-compute[71731]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2088266-1d33-4bb1-ac5b-1de832ff7985 (non-flash)
Apr 13 16:32:24 user nova-compute[71731]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25c3dc97-c9cb-4529-ab32-26ef7fd94fc6 (non-flash)
Apr 13 16:32:24 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 16:32:24 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6339626-7d39-47bc-b91a-1f64ac6bf7f3 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)
Apr 13 16:32:24 user nova-compute[71731]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2088266-1d33-4bb1-ac5b-1de832ff7985 (non-flash)
Apr 13 16:32:24 user nova-compute[71731]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25c3dc97-c9cb-4529-ab32-26ef7fd94fc6 (non-flash)
Apr 13 16:32:24 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 16:32:24 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:651ea766-ffda-42a1-9b3c-7be05a92c85f -p 172.16.0.220:3260 --login {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:32:24 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:651ea766-ffda-42a1-9b3c-7be05a92c85f -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:32:24 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dc03f41-088a-45fe-9af1-b504f41c4e0d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:651ea766-ffda-42a1-9b3c-7be05a92c85f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:651ea766-ffda-42a1-9b3c-7be05a92c85f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:32:24 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6339626-7d39-47bc-b91a-1f64ac6bf7f3 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:651ea766-ffda-42a1-9b3c-7be05a92c85f, portal: 172.16.0.220,3260]
Apr 13 16:32:24 user nova-compute[71731]: Login to [iface: default, target: iqn.2010-10.org.openstack:651ea766-ffda-42a1-9b3c-7be05a92c85f, portal: 172.16.0.220,3260] successful.
Apr 13 16:32:24 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:32:24 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:651ea766-ffda-42a1-9b3c-7be05a92c85f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:32:24 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:651ea766-ffda-42a1-9b3c-7be05a92c85f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:32:24 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1380e9a-482c-497d-bbef-21411bf01739]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:32:24 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6339626-7d39-47bc-b91a-1f64ac6bf7f3 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:32:24 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:32:24 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:32:24 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab806961-9610-42ff-bc12-7a6504f47757]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2088266-1d33-4bb1-ac5b-1de832ff7985 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25c3dc97-c9cb-4529-ab32-26ef7fd94fc6 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:651ea766-ffda-42a1-9b3c-7be05a92c85f (non-flash)\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:32:24 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6339626-7d39-47bc-b91a-1f64ac6bf7f3 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)
Apr 13 16:32:24 user nova-compute[71731]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2088266-1d33-4bb1-ac5b-1de832ff7985 (non-flash)
Apr 13 16:32:24 user nova-compute[71731]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25c3dc97-c9cb-4529-ab32-26ef7fd94fc6 (non-flash)
Apr 13 16:32:24 user nova-compute[71731]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:651ea766-ffda-42a1-9b3c-7be05a92c85f (non-flash)
Apr 13 16:32:24 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 16:32:24 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6339626-7d39-47bc-b91a-1f64ac6bf7f3 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)
Apr 13 16:32:24 user nova-compute[71731]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2088266-1d33-4bb1-ac5b-1de832ff7985 (non-flash)
Apr 13 16:32:24 user nova-compute[71731]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25c3dc97-c9cb-4529-ab32-26ef7fd94fc6 (non-flash)
Apr 13 16:32:24 user nova-compute[71731]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:651ea766-ffda-42a1-9b3c-7be05a92c85f (non-flash)
Apr 13 16:32:24 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 16:32:24 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-a6339626-7d39-47bc-b91a-1f64ac6bf7f3 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:651ea766-ffda-42a1-9b3c-7be05a92c85f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.306s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 16:32:24 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6339626-7d39-47bc-b91a-1f64ac6bf7f3 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Connected to 172.16.0.220:3260 {{(pid=71731) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 16:32:24 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-a6339626-7d39-47bc-b91a-1f64ac6bf7f3 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] HCTL ('36', '-', '-', 0) found on session 33 with lun 0 {{(pid=71731) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 16:32:24 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-a6339626-7d39-47bc-b91a-1f64ac6bf7f3 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=71731) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 16:32:24 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:32:24 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.022s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:32:24 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[58f6f295-4ae0-41ba-beb7-011e3200408c]: (4, ('- - 0', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:32:24 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-a6339626-7d39-47bc-b91a-1f64ac6bf7f3 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Searching for a device in session 33 and hctl ['36', '*', '*', 0] yield: sde {{(pid=71731) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 16:32:24 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6339626-7d39-47bc-b91a-1f64ac6bf7f3 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:651ea766-ffda-42a1-9b3c-7be05a92c85f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ufUqtxTm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71731) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 16:32:25 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:32:25 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-a6339626-7d39-47bc-b91a-1f64ac6bf7f3 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.352s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 16:32:25 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6339626-7d39-47bc-b91a-1f64ac6bf7f3 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] <== connect_volume: return (1355ms) {'type': 'block', 'scsi_wwn': '26238616634396438', 'path': '/dev/sde'} {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 16:32:25 user nova-compute[71731]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a6339626-7d39-47bc-b91a-1f64ac6bf7f3 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26238616634396438', 'path': '/dev/sde'} {{(pid=71731) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 16:32:25 user nova-compute[71731]: DEBUG nova.objects.instance [None req-a6339626-7d39-47bc-b91a-1f64ac6bf7f3 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lazy-loading 'flavor' on Instance uuid acbcaee0-a47b-4fee-8765-9b1c9597d515 {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:32:25 user nova-compute[71731]: DEBUG nova.virt.libvirt.guest [None req-a6339626-7d39-47bc-b91a-1f64ac6bf7f3 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] attach device xml: <disk type="block" device="disk">
Apr 13 16:32:25 user nova-compute[71731]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 16:32:25 user nova-compute[71731]:   <source dev="/dev/sde"/>
Apr 13 16:32:25 user nova-compute[71731]:   <target dev="vdb" bus="virtio"/>
Apr 13 16:32:25 user nova-compute[71731]:   <serial>651ea766-ffda-42a1-9b3c-7be05a92c85f</serial>
Apr 13 16:32:25 user nova-compute[71731]: </disk>
Apr 13 16:32:25 user nova-compute[71731]:  {{(pid=71731) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 13 16:32:26 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-a6339626-7d39-47bc-b91a-1f64ac6bf7f3 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] No BDM found with device name vda, not building metadata. {{(pid=71731) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 16:32:26 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-a6339626-7d39-47bc-b91a-1f64ac6bf7f3 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71731) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 16:32:26 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-a6339626-7d39-47bc-b91a-1f64ac6bf7f3 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] No VIF found with MAC fa:16:3e:62:32:7f, not building metadata {{(pid=71731) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 16:32:26 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-a6339626-7d39-47bc-b91a-1f64ac6bf7f3 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "acbcaee0-a47b-4fee-8765-9b1c9597d515" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.663s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:32:26 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:32:28 user nova-compute[71731]: DEBUG nova.compute.manager [None req-2c13abc6-6cb9-4d7a-87ae-2dd707a8632a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] Stashing vm_state: active {{(pid=71731) _prep_resize /opt/stack/nova/nova/compute/manager.py:5499}}
Apr 13 16:32:28 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-2c13abc6-6cb9-4d7a-87ae-2dd707a8632a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:32:28 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-2c13abc6-6cb9-4d7a-87ae-2dd707a8632a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:32:28 user nova-compute[71731]: DEBUG nova.objects.instance [None req-2c13abc6-6cb9-4d7a-87ae-2dd707a8632a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lazy-loading 'pci_requests' on Instance uuid acbcaee0-a47b-4fee-8765-9b1c9597d515 {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:32:28 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-2c13abc6-6cb9-4d7a-87ae-2dd707a8632a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71731) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 16:32:28 user nova-compute[71731]: INFO nova.compute.claims [None req-2c13abc6-6cb9-4d7a-87ae-2dd707a8632a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] Claim successful on node user
Apr 13 16:32:28 user nova-compute[71731]: DEBUG nova.objects.instance [None req-2c13abc6-6cb9-4d7a-87ae-2dd707a8632a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lazy-loading 'resources' on Instance uuid acbcaee0-a47b-4fee-8765-9b1c9597d515 {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:32:28 user nova-compute[71731]: DEBUG nova.objects.instance [None req-2c13abc6-6cb9-4d7a-87ae-2dd707a8632a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lazy-loading 'pci_devices' on Instance uuid acbcaee0-a47b-4fee-8765-9b1c9597d515 {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:32:28 user nova-compute[71731]: INFO nova.compute.resource_tracker [None req-2c13abc6-6cb9-4d7a-87ae-2dd707a8632a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] Updating resource usage from migration f95a8bc3-801a-4447-b4ea-330328feac3a
Apr 13 16:32:29 user nova-compute[71731]: DEBUG nova.compute.provider_tree [None req-2c13abc6-6cb9-4d7a-87ae-2dd707a8632a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Inventory has not changed in ProviderTree for provider: cb6b1a64-0c24-4e2d-af1e-16576ca9165c {{(pid=71731) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 16:32:29 user nova-compute[71731]: DEBUG nova.scheduler.client.report [None req-2c13abc6-6cb9-4d7a-87ae-2dd707a8632a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Inventory has not changed for provider cb6b1a64-0c24-4e2d-af1e-16576ca9165c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71731) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 16:32:29 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-2c13abc6-6cb9-4d7a-87ae-2dd707a8632a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.472s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:32:29 user nova-compute[71731]: INFO nova.compute.manager [None req-2c13abc6-6cb9-4d7a-87ae-2dd707a8632a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] Migrating
Apr 13 16:32:29 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-2c13abc6-6cb9-4d7a-87ae-2dd707a8632a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 16:32:29 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-2c13abc6-6cb9-4d7a-87ae-2dd707a8632a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Acquired lock "compute-rpcapi-router" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 16:32:29 user nova-compute[71731]: INFO nova.compute.rpcapi [None req-2c13abc6-6cb9-4d7a-87ae-2dd707a8632a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Apr 13 16:32:29 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-2c13abc6-6cb9-4d7a-87ae-2dd707a8632a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Releasing lock "compute-rpcapi-router" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 16:32:29 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-2c13abc6-6cb9-4d7a-87ae-2dd707a8632a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Acquiring lock "refresh_cache-acbcaee0-a47b-4fee-8765-9b1c9597d515" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 16:32:29 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-2c13abc6-6cb9-4d7a-87ae-2dd707a8632a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Acquired lock "refresh_cache-acbcaee0-a47b-4fee-8765-9b1c9597d515" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 16:32:29 user nova-compute[71731]: DEBUG nova.network.neutron [None req-2c13abc6-6cb9-4d7a-87ae-2dd707a8632a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] Building network info cache for instance {{(pid=71731) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 16:32:29 user nova-compute[71731]: DEBUG nova.network.neutron [None req-2c13abc6-6cb9-4d7a-87ae-2dd707a8632a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] Updating instance_info_cache with network_info: [{"id": "13471516-9514-4b85-938f-69657c2990e5", "address": "fa:16:3e:62:32:7f", "network": {"id": "cf1fef97-9ef1-449f-a302-b38110024547", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1138167711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "980559734a504574a83224deb7423c77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13471516-95", "ovs_interfaceid": "13471516-9514-4b85-938f-69657c2990e5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:32:29 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-2c13abc6-6cb9-4d7a-87ae-2dd707a8632a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Releasing lock "refresh_cache-acbcaee0-a47b-4fee-8765-9b1c9597d515" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 16:32:30 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-2c13abc6-6cb9-4d7a-87ae-2dd707a8632a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] Starting migrate_disk_and_power_off {{(pid=71731) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11460}}
Apr 13 16:32:30 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:32:30 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:32:30 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:32:30 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:32:30 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:32:30 user nova-compute[71731]: DEBUG nova.compute.manager [req-3e32545d-c30c-4719-9ff1-6886344135f5 req-84972a66-9f46-4517-8aa8-9931353885d1 service nova] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] Received event network-vif-unplugged-13471516-9514-4b85-938f-69657c2990e5 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:32:30 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-3e32545d-c30c-4719-9ff1-6886344135f5 req-84972a66-9f46-4517-8aa8-9931353885d1 service nova] Acquiring lock "acbcaee0-a47b-4fee-8765-9b1c9597d515-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:32:30 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-3e32545d-c30c-4719-9ff1-6886344135f5 req-84972a66-9f46-4517-8aa8-9931353885d1 service nova] Lock "acbcaee0-a47b-4fee-8765-9b1c9597d515-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:32:30 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-3e32545d-c30c-4719-9ff1-6886344135f5 req-84972a66-9f46-4517-8aa8-9931353885d1 service nova] Lock "acbcaee0-a47b-4fee-8765-9b1c9597d515-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:32:30 user nova-compute[71731]: DEBUG nova.compute.manager [req-3e32545d-c30c-4719-9ff1-6886344135f5 req-84972a66-9f46-4517-8aa8-9931353885d1 service nova] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] No waiting events found dispatching network-vif-unplugged-13471516-9514-4b85-938f-69657c2990e5 {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:32:30 user nova-compute[71731]: WARNING nova.compute.manager [req-3e32545d-c30c-4719-9ff1-6886344135f5 req-84972a66-9f46-4517-8aa8-9931353885d1 service nova] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] Received unexpected event network-vif-unplugged-13471516-9514-4b85-938f-69657c2990e5 for instance with vm_state active and task_state resize_migrating.
Apr 13 16:32:30 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:32:30 user nova-compute[71731]: INFO nova.virt.libvirt.driver [-] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] Instance destroyed successfully.
Apr 13 16:32:30 user nova-compute[71731]: DEBUG nova.virt.libvirt.vif [None req-2c13abc6-6cb9-4d7a-87ae-2dd707a8632a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-13T16:23:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1986504733',display_name='tempest-ServerActionsTestJSON-server-376598631',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1986504733',id=16,image_ref='708622a9-7465-4492-ade8-b827198f7e30',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPaDda4gTmMbkxKfok8i4i1XcNLza5lOVYjCPDEGVTF1JRQKderq80DnIN4GAkaZiBV5U44gvdu3wadL/M5wOH7VDSuEghHchow1mC9TB1xgdo8GoXeM279SVAyu08uhIQ==',key_name='tempest-keypair-1700037342',keypairs=<?>,launch_index=0,launched_at=2023-04-13T16:27:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={rebuild='server'},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='980559734a504574a83224deb7423c77',ramdisk_id='',reservation_id='r-3vv5sptg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='708622a9-7465-4492-ade8-b827198f7e30',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-713402718',owner_user_name='tempest-ServerActionsTestJSON-713402718-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T16:32:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1b3df1c5c5d441819bcef89ed6966815',uuid=acbcaee0-a47b-4fee-8765-9b1c9597d515,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "13471516-9514-4b85-938f-69657c2990e5", "address": "fa:16:3e:62:32:7f", "network": {"id": "cf1fef97-9ef1-449f-a302-b38110024547", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1138167711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-1138167711-network", "vif_mac": "fa:16:3e:62:32:7f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "980559734a504574a83224deb7423c77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13471516-95", "ovs_interfaceid": "13471516-9514-4b85-938f-69657c2990e5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 16:32:30 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-2c13abc6-6cb9-4d7a-87ae-2dd707a8632a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Converting VIF {"id": "13471516-9514-4b85-938f-69657c2990e5", "address": "fa:16:3e:62:32:7f", "network": {"id": "cf1fef97-9ef1-449f-a302-b38110024547", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1138167711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-1138167711-network", "vif_mac": "fa:16:3e:62:32:7f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "980559734a504574a83224deb7423c77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13471516-95", "ovs_interfaceid": "13471516-9514-4b85-938f-69657c2990e5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 16:32:30 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-2c13abc6-6cb9-4d7a-87ae-2dd707a8632a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:62:32:7f,bridge_name='br-int',has_traffic_filtering=True,id=13471516-9514-4b85-938f-69657c2990e5,network=Network(cf1fef97-9ef1-449f-a302-b38110024547),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13471516-95') {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 16:32:30 user nova-compute[71731]: DEBUG os_vif [None req-2c13abc6-6cb9-4d7a-87ae-2dd707a8632a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:62:32:7f,bridge_name='br-int',has_traffic_filtering=True,id=13471516-9514-4b85-938f-69657c2990e5,network=Network(cf1fef97-9ef1-449f-a302-b38110024547),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13471516-95') {{(pid=71731) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 16:32:30 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:32:30 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap13471516-95, bridge=br-int, if_exists=True) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:32:30 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:32:30 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 16:32:30 user nova-compute[71731]: INFO os_vif [None req-2c13abc6-6cb9-4d7a-87ae-2dd707a8632a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:62:32:7f,bridge_name='br-int',has_traffic_filtering=True,id=13471516-9514-4b85-938f-69657c2990e5,network=Network(cf1fef97-9ef1-449f-a302-b38110024547),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13471516-95')
Apr 13 16:32:30 user nova-compute[71731]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2c13abc6-6cb9-4d7a-87ae-2dd707a8632a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] calling os-brick to detach iSCSI Volume {{(pid=71731) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 16:32:30 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c13abc6-6cb9-4d7a-87ae-2dd707a8632a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8cf0118790>, {'target_iqn': 'iqn.2010-10.org.openstack:651ea766-ffda-42a1-9b3c-7be05a92c85f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ufUqtxTm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde': {}}" {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 16:32:30 user nova-compute[71731]: WARNING os_brick.initiator.connectors.base [None req-2c13abc6-6cb9-4d7a-87ae-2dd707a8632a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 16:32:30 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-2c13abc6-6cb9-4d7a-87ae-2dd707a8632a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 16:32:30 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-2c13abc6-6cb9-4d7a-87ae-2dd707a8632a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 16:32:30 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:32:30 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:32:30 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5594f66-1bbd-47a4-8d0e-c12cba1de40e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c2088266-1d33-4bb1-ac5b-1de832ff7985\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:25c3dc97-c9cb-4529-ab32-26ef7fd94fc6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:651ea766-ffda-42a1-9b3c-7be05a92c85f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:32:30 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c13abc6-6cb9-4d7a-87ae-2dd707a8632a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 16:32:30 user nova-compute[71731]: No targets found.
Apr 13 16:32:30 user nova-compute[71731]: iSNS:
Apr 13 16:32:30 user nova-compute[71731]: No targets found.
Apr 13 16:32:30 user nova-compute[71731]: STATIC:
Apr 13 16:32:30 user nova-compute[71731]: Target: iqn.2010-10.org.openstack:c2088266-1d33-4bb1-ac5b-1de832ff7985
Apr 13 16:32:30 user nova-compute[71731]:         Portal: 172.16.0.220:3260,-1
Apr 13 16:32:30 user nova-compute[71731]:                 Iface Name: default
Apr 13 16:32:30 user nova-compute[71731]: Target: iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97
Apr 13 16:32:30 user nova-compute[71731]:         Portal: 172.16.0.220:3260,-1
Apr 13 16:32:30 user nova-compute[71731]:                 Iface Name: default
Apr 13 16:32:30 user nova-compute[71731]: Target: iqn.2010-10.org.openstack:25c3dc97-c9cb-4529-ab32-26ef7fd94fc6
Apr 13 16:32:30 user nova-compute[71731]:         Portal: 172.16.0.220:3260,-1
Apr 13 16:32:30 user nova-compute[71731]:                 Iface Name: default
Apr 13 16:32:30 user nova-compute[71731]: Target: iqn.2010-10.org.openstack:651ea766-ffda-42a1-9b3c-7be05a92c85f
Apr 13 16:32:30 user nova-compute[71731]:         Portal: 172.16.0.220:3260,-1
Apr 13 16:32:30 user nova-compute[71731]:                 Iface Name: default
Apr 13 16:32:30 user nova-compute[71731]: FIRMWARE:
Apr 13 16:32:30 user nova-compute[71731]: No targets found.
Apr 13 16:32:30 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 16:32:30 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c13abc6-6cb9-4d7a-87ae-2dd707a8632a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 16:32:30 user nova-compute[71731]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 16:32:30 user nova-compute[71731]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71731) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 16:32:30 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c13abc6-6cb9-4d7a-87ae-2dd707a8632a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:651ea766-ffda-42a1-9b3c-7be05a92c85f', 0)] {{(pid=71731) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 16:32:30 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:32:30 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:32:30 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[685b67ea-7208-4f97-90a0-f6a611959b78]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:25c3dc97-c9cb-4529-ab32-26ef7fd94fc6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:651ea766-ffda-42a1-9b3c-7be05a92c85f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c2088266-1d33-4bb1-ac5b-1de832ff7985\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:32:30 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:32:30 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:32:30 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[829616f6-c9c3-4799-9e3c-d1292d3215aa]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2088266-1d33-4bb1-ac5b-1de832ff7985 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25c3dc97-c9cb-4529-ab32-26ef7fd94fc6 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:651ea766-ffda-42a1-9b3c-7be05a92c85f (non-flash)\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:32:30 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c13abc6-6cb9-4d7a-87ae-2dd707a8632a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)
Apr 13 16:32:30 user nova-compute[71731]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2088266-1d33-4bb1-ac5b-1de832ff7985 (non-flash)
Apr 13 16:32:30 user nova-compute[71731]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25c3dc97-c9cb-4529-ab32-26ef7fd94fc6 (non-flash)
Apr 13 16:32:30 user nova-compute[71731]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:651ea766-ffda-42a1-9b3c-7be05a92c85f (non-flash)
Apr 13 16:32:30 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 16:32:30 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c13abc6-6cb9-4d7a-87ae-2dd707a8632a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)
Apr 13 16:32:30 user nova-compute[71731]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2088266-1d33-4bb1-ac5b-1de832ff7985 (non-flash)
Apr 13 16:32:30 user nova-compute[71731]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25c3dc97-c9cb-4529-ab32-26ef7fd94fc6 (non-flash)
Apr 13 16:32:30 user nova-compute[71731]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:651ea766-ffda-42a1-9b3c-7be05a92c85f (non-flash)
Apr 13 16:32:30 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 16:32:30 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c13abc6-6cb9-4d7a-87ae-2dd707a8632a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8cb066a3b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:651ea766-ffda-42a1-9b3c-7be05a92c85f'): ({'sde'}, set())}) {{(pid=71731) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 16:32:30 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-2c13abc6-6cb9-4d7a-87ae-2dd707a8632a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Removing single pathed devices sde {{(pid=71731) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 16:32:30 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:32:30 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:32:30 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[d86194eb-463a-4432-8b34-7b6562c8a002]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:32:30 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:32:31 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.025s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:32:31 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[abe22742-022b-4c31-b4d5-af59c46cd295]: (4, ('ok\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:32:31 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-2c13abc6-6cb9-4d7a-87ae-2dd707a8632a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Flushing IO for device /dev/sde {{(pid=71731) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 16:32:31 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:32:31 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.022s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:32:31 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[137fce7d-2ba1-45e0-863a-2d14ee77ceae]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:32:31 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-2c13abc6-6cb9-4d7a-87ae-2dd707a8632a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=71731) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 16:32:31 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:32:31 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.052s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:32:31 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[45cd71e7-28b9-4189-8dc1-8b3c0141a70a]: (4, ('1', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:32:31 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-2c13abc6-6cb9-4d7a-87ae-2dd707a8632a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=71731) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 16:32:31 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-2c13abc6-6cb9-4d7a-87ae-2dd707a8632a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] SCSI volumes sde have been removed. {{(pid=71731) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 16:32:31 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c13abc6-6cb9-4d7a-87ae-2dd707a8632a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:651ea766-ffda-42a1-9b3c-7be05a92c85f')] {{(pid=71731) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 16:32:31 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:651ea766-ffda-42a1-9b3c-7be05a92c85f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:32:31 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:651ea766-ffda-42a1-9b3c-7be05a92c85f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:32:31 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[52ac50af-ba14-44e8-9233-60b503793732]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:32:31 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c13abc6-6cb9-4d7a-87ae-2dd707a8632a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:32:31 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:651ea766-ffda-42a1-9b3c-7be05a92c85f -p 172.16.0.220:3260 --logout {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:32:31 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:651ea766-ffda-42a1-9b3c-7be05a92c85f -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:32:31 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[2006735c-d3ec-4a43-9a37-17f19096ce83]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:651ea766-ffda-42a1-9b3c-7be05a92c85f, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:651ea766-ffda-42a1-9b3c-7be05a92c85f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:32:31 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c13abc6-6cb9-4d7a-87ae-2dd707a8632a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:651ea766-ffda-42a1-9b3c-7be05a92c85f, portal: 172.16.0.220,3260]
Apr 13 16:32:31 user nova-compute[71731]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:651ea766-ffda-42a1-9b3c-7be05a92c85f, portal: 172.16.0.220,3260] successful.
Apr 13 16:32:31 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:32:31 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:651ea766-ffda-42a1-9b3c-7be05a92c85f -p 172.16.0.220:3260 --op delete {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:32:31 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:651ea766-ffda-42a1-9b3c-7be05a92c85f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:32:31 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f22113f-55d0-4ae1-8071-192eea8ca505]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:32:31 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c13abc6-6cb9-4d7a-87ae-2dd707a8632a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:32:31 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-2c13abc6-6cb9-4d7a-87ae-2dd707a8632a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.450s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 16:32:31 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c13abc6-6cb9-4d7a-87ae-2dd707a8632a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] <== disconnect_volume: return (452ms) None {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 16:32:31 user nova-compute[71731]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2c13abc6-6cb9-4d7a-87ae-2dd707a8632a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] Disconnected iSCSI Volume {{(pid=71731) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 16:32:31 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-2c13abc6-6cb9-4d7a-87ae-2dd707a8632a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acbcaee0-a47b-4fee-8765-9b1c9597d515/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:32:31 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-2c13abc6-6cb9-4d7a-87ae-2dd707a8632a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acbcaee0-a47b-4fee-8765-9b1c9597d515/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:32:31 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-2c13abc6-6cb9-4d7a-87ae-2dd707a8632a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acbcaee0-a47b-4fee-8765-9b1c9597d515/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:32:31 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-2c13abc6-6cb9-4d7a-87ae-2dd707a8632a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acbcaee0-a47b-4fee-8765-9b1c9597d515/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:32:31 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-2c13abc6-6cb9-4d7a-87ae-2dd707a8632a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] skipping disk /dev/sde (vdb) as it is a volume {{(pid=71731) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 16:32:31 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-2c13abc6-6cb9-4d7a-87ae-2dd707a8632a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/acbcaee0-a47b-4fee-8765-9b1c9597d515_resize/disk /opt/stack/data/nova/instances/acbcaee0-a47b-4fee-8765-9b1c9597d515/disk {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:32:31 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:32:31 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-2c13abc6-6cb9-4d7a-87ae-2dd707a8632a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] CMD "cp -r /opt/stack/data/nova/instances/acbcaee0-a47b-4fee-8765-9b1c9597d515_resize/disk /opt/stack/data/nova/instances/acbcaee0-a47b-4fee-8765-9b1c9597d515/disk" returned: 0 in 0.322s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:32:31 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-2c13abc6-6cb9-4d7a-87ae-2dd707a8632a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/acbcaee0-a47b-4fee-8765-9b1c9597d515_resize/disk.info /opt/stack/data/nova/instances/acbcaee0-a47b-4fee-8765-9b1c9597d515/disk.info {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:32:32 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-2c13abc6-6cb9-4d7a-87ae-2dd707a8632a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] CMD "cp -r /opt/stack/data/nova/instances/acbcaee0-a47b-4fee-8765-9b1c9597d515_resize/disk.info /opt/stack/data/nova/instances/acbcaee0-a47b-4fee-8765-9b1c9597d515/disk.info" returned: 0 in 0.044s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:32:32 user nova-compute[71731]: DEBUG nova.compute.manager [req-d82dc912-fd75-4ecc-bd81-46a405c00ccb req-b46e6613-c7c0-47f0-bd8c-58990e163cf6 service nova] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] Received event network-vif-plugged-13471516-9514-4b85-938f-69657c2990e5 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:32:32 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-d82dc912-fd75-4ecc-bd81-46a405c00ccb req-b46e6613-c7c0-47f0-bd8c-58990e163cf6 service nova] Acquiring lock "acbcaee0-a47b-4fee-8765-9b1c9597d515-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:32:32 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-d82dc912-fd75-4ecc-bd81-46a405c00ccb req-b46e6613-c7c0-47f0-bd8c-58990e163cf6 service nova] Lock "acbcaee0-a47b-4fee-8765-9b1c9597d515-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:32:32 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-d82dc912-fd75-4ecc-bd81-46a405c00ccb req-b46e6613-c7c0-47f0-bd8c-58990e163cf6 service nova] Lock "acbcaee0-a47b-4fee-8765-9b1c9597d515-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:32:32 user nova-compute[71731]: DEBUG nova.compute.manager [req-d82dc912-fd75-4ecc-bd81-46a405c00ccb req-b46e6613-c7c0-47f0-bd8c-58990e163cf6 service nova] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] No waiting events found dispatching network-vif-plugged-13471516-9514-4b85-938f-69657c2990e5 {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:32:32 user nova-compute[71731]: WARNING nova.compute.manager [req-d82dc912-fd75-4ecc-bd81-46a405c00ccb req-b46e6613-c7c0-47f0-bd8c-58990e163cf6 service nova] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] Received unexpected event network-vif-plugged-13471516-9514-4b85-938f-69657c2990e5 for instance with vm_state active and task_state resize_migrating.
Apr 13 16:32:33 user nova-compute[71731]: DEBUG nova.network.neutron [None req-2c13abc6-6cb9-4d7a-87ae-2dd707a8632a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] Port 13471516-9514-4b85-938f-69657c2990e5 binding to destination host user is already ACTIVE {{(pid=71731) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3161}}
Apr 13 16:32:33 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-2c13abc6-6cb9-4d7a-87ae-2dd707a8632a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Acquiring lock "acbcaee0-a47b-4fee-8765-9b1c9597d515-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:32:33 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-2c13abc6-6cb9-4d7a-87ae-2dd707a8632a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "acbcaee0-a47b-4fee-8765-9b1c9597d515-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:32:33 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-2c13abc6-6cb9-4d7a-87ae-2dd707a8632a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "acbcaee0-a47b-4fee-8765-9b1c9597d515-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:32:33 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-2c13abc6-6cb9-4d7a-87ae-2dd707a8632a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Acquiring lock "refresh_cache-acbcaee0-a47b-4fee-8765-9b1c9597d515" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 16:32:33 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-2c13abc6-6cb9-4d7a-87ae-2dd707a8632a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Acquired lock "refresh_cache-acbcaee0-a47b-4fee-8765-9b1c9597d515" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 16:32:33 user nova-compute[71731]: DEBUG nova.network.neutron [None req-2c13abc6-6cb9-4d7a-87ae-2dd707a8632a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] Building network info cache for instance {{(pid=71731) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 16:32:34 user nova-compute[71731]: DEBUG nova.network.neutron [None req-2c13abc6-6cb9-4d7a-87ae-2dd707a8632a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] Updating instance_info_cache with network_info: [{"id": "13471516-9514-4b85-938f-69657c2990e5", "address": "fa:16:3e:62:32:7f", "network": {"id": "cf1fef97-9ef1-449f-a302-b38110024547", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1138167711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "980559734a504574a83224deb7423c77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13471516-95", "ovs_interfaceid": "13471516-9514-4b85-938f-69657c2990e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:32:34 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-2c13abc6-6cb9-4d7a-87ae-2dd707a8632a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Releasing lock "refresh_cache-acbcaee0-a47b-4fee-8765-9b1c9597d515" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 16:32:34 user nova-compute[71731]: DEBUG os_brick.utils [None req-2c13abc6-6cb9-4d7a-87ae-2dd707a8632a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 16:32:34 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:32:34 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:32:34 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[5682a96f-f8c2-48bf-baf1-c77432d8c31f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:81501d91421\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:32:34 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:32:34 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:32:34 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[553819af-33c6-454a-8c2b-7e75d7c0e6ad]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:32:34 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:32:34 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:32:34 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[df1a828e-7e52-4557-8122-de4a789b90f5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:32:34 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce81c02a-46bc-42b0-a4db-9fffcb9fa18d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:32:34 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-2c13abc6-6cb9-4d7a-87ae-2dd707a8632a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Running cmd (subprocess): nvme version {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:32:34 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-2c13abc6-6cb9-4d7a-87ae-2dd707a8632a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] 'nvme version' failed. Not Retrying. {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 16:32:34 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2c13abc6-6cb9-4d7a-87ae-2dd707a8632a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] nvme not present on system {{(pid=71731) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 16:32:34 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:32:34 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 16:32:34 user nova-compute[71731]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 16:32:34 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9b5e57c-cc1e-4f3d-8f43-dd63042f8b47]: (4, '') {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:32:34 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.lightos [None req-2c13abc6-6cb9-4d7a-87ae-2dd707a8632a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71731) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 16:32:34 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.lightos [None req-2c13abc6-6cb9-4d7a-87ae-2dd707a8632a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71731) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 16:32:34 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.lightos [None req-2c13abc6-6cb9-4d7a-87ae-2dd707a8632a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] LIGHTOS: no hostnqn found. {{(pid=71731) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 16:32:34 user nova-compute[71731]: DEBUG os_brick.utils [None req-2c13abc6-6cb9-4d7a-87ae-2dd707a8632a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] <== get_connector_properties: return (162ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:81501d91421', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 16:32:34 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-8769a397-3c19-4176-96a9-4eade9a1e9da tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Acquiring lock "bf98c3a2-dbeb-4ae4-8423-ce55964c4258" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:32:34 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-8769a397-3c19-4176-96a9-4eade9a1e9da tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Lock "bf98c3a2-dbeb-4ae4-8423-ce55964c4258" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:32:34 user nova-compute[71731]: DEBUG nova.objects.instance [None req-8769a397-3c19-4176-96a9-4eade9a1e9da tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Lazy-loading 'flavor' on Instance uuid bf98c3a2-dbeb-4ae4-8423-ce55964c4258 {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:32:34 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-8769a397-3c19-4176-96a9-4eade9a1e9da tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Lock "bf98c3a2-dbeb-4ae4-8423-ce55964c4258" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.064s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:32:34 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-8769a397-3c19-4176-96a9-4eade9a1e9da tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Acquiring lock "bf98c3a2-dbeb-4ae4-8423-ce55964c4258" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:32:34 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-8769a397-3c19-4176-96a9-4eade9a1e9da tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Lock "bf98c3a2-dbeb-4ae4-8423-ce55964c4258" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:32:34 user nova-compute[71731]: INFO nova.compute.manager [None req-8769a397-3c19-4176-96a9-4eade9a1e9da tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] [instance: bf98c3a2-dbeb-4ae4-8423-ce55964c4258] Attaching volume 30806b19-961b-4edd-941a-2ee293795bb1 to /dev/vdb
Apr 13 16:32:34 user nova-compute[71731]: DEBUG os_brick.utils [None req-8769a397-3c19-4176-96a9-4eade9a1e9da tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 16:32:34 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:32:34 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:32:34 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c9b93a4-e1bc-4458-b5ed-eaccab9fceaf]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:81501d91421\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:32:34 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:32:34 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:32:34 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[f29811fd-6a52-4867-b1c6-66f9aa7dac81]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:32:34 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:32:34 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:32:34 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8845fca-04b6-4bdd-bed5-d86afac172e5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:32:34 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d2fc2ec-3742-4b01-83d0-2ae3c57822f2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:32:34 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-8769a397-3c19-4176-96a9-4eade9a1e9da tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Running cmd (subprocess): nvme version {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:32:34 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-8769a397-3c19-4176-96a9-4eade9a1e9da tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] 'nvme version' failed. Not Retrying. {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 16:32:34 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8769a397-3c19-4176-96a9-4eade9a1e9da tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] nvme not present on system {{(pid=71731) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 16:32:34 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:32:34 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 16:32:34 user nova-compute[71731]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 16:32:34 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcd985b0-5290-48c0-92df-7ddc0b1a9391]: (4, '') {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:32:34 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.lightos [None req-8769a397-3c19-4176-96a9-4eade9a1e9da tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71731) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 16:32:34 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.lightos [None req-8769a397-3c19-4176-96a9-4eade9a1e9da tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71731) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 16:32:34 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.lightos [None req-8769a397-3c19-4176-96a9-4eade9a1e9da tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] LIGHTOS: no hostnqn found. {{(pid=71731) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 16:32:34 user nova-compute[71731]: DEBUG os_brick.utils [None req-8769a397-3c19-4176-96a9-4eade9a1e9da tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:81501d91421', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 16:32:34 user nova-compute[71731]: DEBUG nova.virt.block_device [None req-8769a397-3c19-4176-96a9-4eade9a1e9da tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] [instance: bf98c3a2-dbeb-4ae4-8423-ce55964c4258] Updating existing volume attachment record: 96c3f01e-8aac-4480-be78-b4dd33abbbbd {{(pid=71731) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 16:32:35 user nova-compute[71731]: DEBUG nova.compute.manager [req-0f195529-333b-4576-b0a9-f9406cbd7495 req-6c27cee0-a39c-4a83-b1de-5c442d6eb85e service nova] [instance: 03200054-c651-4333-acce-3bea3defe22a] Received event network-changed-b40a4a40-0a9a-42f8-8d44-41bf4042454b {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:32:35 user nova-compute[71731]: DEBUG nova.compute.manager [req-0f195529-333b-4576-b0a9-f9406cbd7495 req-6c27cee0-a39c-4a83-b1de-5c442d6eb85e service nova] [instance: 03200054-c651-4333-acce-3bea3defe22a] Refreshing instance network info cache due to event network-changed-b40a4a40-0a9a-42f8-8d44-41bf4042454b. {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 16:32:35 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-0f195529-333b-4576-b0a9-f9406cbd7495 req-6c27cee0-a39c-4a83-b1de-5c442d6eb85e service nova] Acquiring lock "refresh_cache-03200054-c651-4333-acce-3bea3defe22a" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 16:32:35 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-0f195529-333b-4576-b0a9-f9406cbd7495 req-6c27cee0-a39c-4a83-b1de-5c442d6eb85e service nova] Acquired lock "refresh_cache-03200054-c651-4333-acce-3bea3defe22a" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 16:32:35 user nova-compute[71731]: DEBUG nova.network.neutron [req-0f195529-333b-4576-b0a9-f9406cbd7495 req-6c27cee0-a39c-4a83-b1de-5c442d6eb85e service nova] [instance: 03200054-c651-4333-acce-3bea3defe22a] Refreshing network info cache for port b40a4a40-0a9a-42f8-8d44-41bf4042454b {{(pid=71731) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 16:32:35 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:32:36 user nova-compute[71731]: DEBUG nova.network.neutron [req-0f195529-333b-4576-b0a9-f9406cbd7495 req-6c27cee0-a39c-4a83-b1de-5c442d6eb85e service nova] [instance: 03200054-c651-4333-acce-3bea3defe22a] Updated VIF entry in instance network info cache for port b40a4a40-0a9a-42f8-8d44-41bf4042454b. {{(pid=71731) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 16:32:36 user nova-compute[71731]: DEBUG nova.network.neutron [req-0f195529-333b-4576-b0a9-f9406cbd7495 req-6c27cee0-a39c-4a83-b1de-5c442d6eb85e service nova] [instance: 03200054-c651-4333-acce-3bea3defe22a] Updating instance_info_cache with network_info: [{"id": "b40a4a40-0a9a-42f8-8d44-41bf4042454b", "address": "fa:16:3e:e7:02:ec", "network": {"id": "d36bc206-f629-4d6e-8a3f-458061d7b525", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-893271134-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d451e0e239f486aa2b3abe9e273eab3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb40a4a40-0a", "ovs_interfaceid": "b40a4a40-0a9a-42f8-8d44-41bf4042454b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:32:36 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-0f195529-333b-4576-b0a9-f9406cbd7495 req-6c27cee0-a39c-4a83-b1de-5c442d6eb85e service nova] Releasing lock "refresh_cache-03200054-c651-4333-acce-3bea3defe22a" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 16:32:36 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:32:36 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:32:37 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-0c723d89-c9c4-47ed-8ab6-829de7a08fe4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Acquiring lock "03200054-c651-4333-acce-3bea3defe22a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:32:37 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-0c723d89-c9c4-47ed-8ab6-829de7a08fe4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "03200054-c651-4333-acce-3bea3defe22a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:32:37 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-0c723d89-c9c4-47ed-8ab6-829de7a08fe4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Acquiring lock "03200054-c651-4333-acce-3bea3defe22a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:32:37 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-0c723d89-c9c4-47ed-8ab6-829de7a08fe4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "03200054-c651-4333-acce-3bea3defe22a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:32:37 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-0c723d89-c9c4-47ed-8ab6-829de7a08fe4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "03200054-c651-4333-acce-3bea3defe22a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:32:37 user nova-compute[71731]: INFO nova.compute.manager [None req-0c723d89-c9c4-47ed-8ab6-829de7a08fe4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 03200054-c651-4333-acce-3bea3defe22a] Terminating instance
Apr 13 16:32:37 user nova-compute[71731]: DEBUG nova.compute.manager [None req-0c723d89-c9c4-47ed-8ab6-829de7a08fe4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 03200054-c651-4333-acce-3bea3defe22a] Start destroying the instance on the hypervisor. {{(pid=71731) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 16:32:37 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:32:37 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:32:37 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:32:37 user nova-compute[71731]: DEBUG nova.compute.manager [req-777800c3-37c6-4584-a922-8bae30939ea1 req-69e8cec9-da93-4eca-b9e5-1ecf69efa56d service nova] [instance: 03200054-c651-4333-acce-3bea3defe22a] Received event network-vif-unplugged-b40a4a40-0a9a-42f8-8d44-41bf4042454b {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:32:37 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-777800c3-37c6-4584-a922-8bae30939ea1 req-69e8cec9-da93-4eca-b9e5-1ecf69efa56d service nova] Acquiring lock "03200054-c651-4333-acce-3bea3defe22a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:32:37 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-777800c3-37c6-4584-a922-8bae30939ea1 req-69e8cec9-da93-4eca-b9e5-1ecf69efa56d service nova] Lock "03200054-c651-4333-acce-3bea3defe22a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:32:37 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-777800c3-37c6-4584-a922-8bae30939ea1 req-69e8cec9-da93-4eca-b9e5-1ecf69efa56d service nova] Lock "03200054-c651-4333-acce-3bea3defe22a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:32:37 user nova-compute[71731]: DEBUG nova.compute.manager [req-777800c3-37c6-4584-a922-8bae30939ea1 req-69e8cec9-da93-4eca-b9e5-1ecf69efa56d service nova] [instance: 03200054-c651-4333-acce-3bea3defe22a] No waiting events found dispatching network-vif-unplugged-b40a4a40-0a9a-42f8-8d44-41bf4042454b {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:32:37 user nova-compute[71731]: DEBUG nova.compute.manager [req-777800c3-37c6-4584-a922-8bae30939ea1 req-69e8cec9-da93-4eca-b9e5-1ecf69efa56d service nova] [instance: 03200054-c651-4333-acce-3bea3defe22a] Received event network-vif-unplugged-b40a4a40-0a9a-42f8-8d44-41bf4042454b for instance with task_state deleting. {{(pid=71731) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 16:32:38 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:32:38 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:32:38 user nova-compute[71731]: INFO nova.virt.libvirt.driver [-] [instance: 03200054-c651-4333-acce-3bea3defe22a] Instance destroyed successfully.
Apr 13 16:32:38 user nova-compute[71731]: DEBUG nova.objects.instance [None req-0c723d89-c9c4-47ed-8ab6-829de7a08fe4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lazy-loading 'resources' on Instance uuid 03200054-c651-4333-acce-3bea3defe22a {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:32:38 user nova-compute[71731]: DEBUG nova.virt.libvirt.vif [None req-0c723d89-c9c4-47ed-8ab6-829de7a08fe4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T16:30:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1444057207',display_name='tempest-TestVolumeBootPattern-server-1444057207',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1444057207',id=26,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIspJuW0ouAVIXdRkaEFP67MIl/YPuQkC9G3HjohNK4Y6ERboR/Jfb2q58aDhzUN+56TLqbLCfdFh2NtWLgvjHOwe+zpPoSYOKAkWLX+NSuU860pg4Djj9vwVgJj/Bkydw==',key_name='tempest-TestVolumeBootPattern-1747083001',keypairs=<?>,launch_index=0,launched_at=2023-04-13T16:30:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8d451e0e239f486aa2b3abe9e273eab3',ramdisk_id='',reservation_id='r-d39s4kc5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-438786227',owner_user_name='tempest-TestVolumeBootPattern-438786227-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T16:30:54Z,user_data=None,user_id='d70e10f63cdd49a9a1ebe1fe4c9de0a2',uuid=03200054-c651-4333-acce-3bea3defe22a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b40a4a40-0a9a-42f8-8d44-41bf4042454b", "address": "fa:16:3e:e7:02:ec", "network": {"id": "d36bc206-f629-4d6e-8a3f-458061d7b525", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-893271134-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d451e0e239f486aa2b3abe9e273eab3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb40a4a40-0a", "ovs_interfaceid": "b40a4a40-0a9a-42f8-8d44-41bf4042454b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 16:32:38 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-0c723d89-c9c4-47ed-8ab6-829de7a08fe4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Converting VIF {"id": "b40a4a40-0a9a-42f8-8d44-41bf4042454b", "address": "fa:16:3e:e7:02:ec", "network": {"id": "d36bc206-f629-4d6e-8a3f-458061d7b525", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-893271134-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d451e0e239f486aa2b3abe9e273eab3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb40a4a40-0a", "ovs_interfaceid": "b40a4a40-0a9a-42f8-8d44-41bf4042454b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 16:32:38 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-0c723d89-c9c4-47ed-8ab6-829de7a08fe4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e7:02:ec,bridge_name='br-int',has_traffic_filtering=True,id=b40a4a40-0a9a-42f8-8d44-41bf4042454b,network=Network(d36bc206-f629-4d6e-8a3f-458061d7b525),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb40a4a40-0a') {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 16:32:38 user nova-compute[71731]: DEBUG os_vif [None req-0c723d89-c9c4-47ed-8ab6-829de7a08fe4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e7:02:ec,bridge_name='br-int',has_traffic_filtering=True,id=b40a4a40-0a9a-42f8-8d44-41bf4042454b,network=Network(d36bc206-f629-4d6e-8a3f-458061d7b525),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb40a4a40-0a') {{(pid=71731) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 16:32:38 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:32:38 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb40a4a40-0a, bridge=br-int, if_exists=True) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:32:38 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:32:38 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 16:32:38 user nova-compute[71731]: INFO os_vif [None req-0c723d89-c9c4-47ed-8ab6-829de7a08fe4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e7:02:ec,bridge_name='br-int',has_traffic_filtering=True,id=b40a4a40-0a9a-42f8-8d44-41bf4042454b,network=Network(d36bc206-f629-4d6e-8a3f-458061d7b525),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb40a4a40-0a')
Apr 13 16:32:38 user nova-compute[71731]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0c723d89-c9c4-47ed-8ab6-829de7a08fe4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 03200054-c651-4333-acce-3bea3defe22a] calling os-brick to detach iSCSI Volume {{(pid=71731) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 16:32:38 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c723d89-c9c4-47ed-8ab6-829de7a08fe4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8cf0118790>, {'target_iqn': 'iqn.2010-10.org.openstack:c2088266-1d33-4bb1-ac5b-1de832ff7985', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mePtryhb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 16:32:38 user nova-compute[71731]: WARNING os_brick.initiator.connectors.base [None req-0c723d89-c9c4-47ed-8ab6-829de7a08fe4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 16:32:38 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-0c723d89-c9c4-47ed-8ab6-829de7a08fe4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 16:32:38 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-0c723d89-c9c4-47ed-8ab6-829de7a08fe4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 16:32:38 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:32:38 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:32:38 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[aecd3836-d986-439a-86e9-5b6a4ab9921d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c2088266-1d33-4bb1-ac5b-1de832ff7985\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:25c3dc97-c9cb-4529-ab32-26ef7fd94fc6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:32:38 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c723d89-c9c4-47ed-8ab6-829de7a08fe4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 16:32:38 user nova-compute[71731]: No targets found.
Apr 13 16:32:38 user nova-compute[71731]: iSNS:
Apr 13 16:32:38 user nova-compute[71731]: No targets found.
Apr 13 16:32:38 user nova-compute[71731]: STATIC:
Apr 13 16:32:38 user nova-compute[71731]: Target: iqn.2010-10.org.openstack:c2088266-1d33-4bb1-ac5b-1de832ff7985
Apr 13 16:32:38 user nova-compute[71731]:         Portal: 172.16.0.220:3260,-1
Apr 13 16:32:38 user nova-compute[71731]:                 Iface Name: default
Apr 13 16:32:38 user nova-compute[71731]: Target: iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97
Apr 13 16:32:38 user nova-compute[71731]:         Portal: 172.16.0.220:3260,-1
Apr 13 16:32:38 user nova-compute[71731]:                 Iface Name: default
Apr 13 16:32:38 user nova-compute[71731]: Target: iqn.2010-10.org.openstack:25c3dc97-c9cb-4529-ab32-26ef7fd94fc6
Apr 13 16:32:38 user nova-compute[71731]:         Portal: 172.16.0.220:3260,-1
Apr 13 16:32:38 user nova-compute[71731]:                 Iface Name: default
Apr 13 16:32:38 user nova-compute[71731]: FIRMWARE:
Apr 13 16:32:38 user nova-compute[71731]: No targets found.
Apr 13 16:32:38 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 16:32:38 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c723d89-c9c4-47ed-8ab6-829de7a08fe4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 16:32:38 user nova-compute[71731]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 16:32:38 user nova-compute[71731]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71731) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 16:32:38 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c723d89-c9c4-47ed-8ab6-829de7a08fe4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c2088266-1d33-4bb1-ac5b-1de832ff7985', 0)] {{(pid=71731) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 16:32:38 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:32:38 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:32:38 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fd60ffe-5478-4b70-90d3-2539b40a0bf8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:25c3dc97-c9cb-4529-ab32-26ef7fd94fc6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c2088266-1d33-4bb1-ac5b-1de832ff7985\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:32:38 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:32:38 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:32:38 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[42cdb5c2-1c1f-4ce4-9057-cf98661dc670]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2088266-1d33-4bb1-ac5b-1de832ff7985 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25c3dc97-c9cb-4529-ab32-26ef7fd94fc6 (non-flash)\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:32:38 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c723d89-c9c4-47ed-8ab6-829de7a08fe4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)
Apr 13 16:32:38 user nova-compute[71731]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2088266-1d33-4bb1-ac5b-1de832ff7985 (non-flash)
Apr 13 16:32:38 user nova-compute[71731]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25c3dc97-c9cb-4529-ab32-26ef7fd94fc6 (non-flash)
Apr 13 16:32:38 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 16:32:38 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c723d89-c9c4-47ed-8ab6-829de7a08fe4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)
Apr 13 16:32:38 user nova-compute[71731]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2088266-1d33-4bb1-ac5b-1de832ff7985 (non-flash)
Apr 13 16:32:38 user nova-compute[71731]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25c3dc97-c9cb-4529-ab32-26ef7fd94fc6 (non-flash)
Apr 13 16:32:38 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 16:32:38 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c723d89-c9c4-47ed-8ab6-829de7a08fe4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8cf00e7880>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c2088266-1d33-4bb1-ac5b-1de832ff7985'): ({'sdb'}, set())}) {{(pid=71731) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 16:32:38 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-0c723d89-c9c4-47ed-8ab6-829de7a08fe4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Removing single pathed devices sdb {{(pid=71731) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 16:32:38 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:32:38 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:32:38 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6d84cf4-60ef-4bbc-9170-0175b7fa5b89]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:32:38 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:32:38 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:32:38 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6fcc8bc-c96a-4127-a471-e717eae4cbf8]: (4, ('ok\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:32:38 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-0c723d89-c9c4-47ed-8ab6-829de7a08fe4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Flushing IO for device /dev/sdb {{(pid=71731) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 16:32:38 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:32:38 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:32:38 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dd20815-969f-4c6b-8646-1d7a46e8dc0a]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:32:38 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-0c723d89-c9c4-47ed-8ab6-829de7a08fe4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71731) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 16:32:38 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:32:38 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:32:38 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8b05cf6-e436-443b-a501-8b25e7f30345]: (4, ('1', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:32:38 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-0c723d89-c9c4-47ed-8ab6-829de7a08fe4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71731) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 16:32:38 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-0c723d89-c9c4-47ed-8ab6-829de7a08fe4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] SCSI volumes sdb have been removed. {{(pid=71731) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 16:32:38 user nova-compute[71731]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIOff503e69-17d412863d1a79f9', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_ff503e69', '/dev/disk/by-id/scsi-23137643431323836') {{(pid=81776) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Apr 13 16:32:38 user nova-compute[71731]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIOff503e69-17d412863d1a79f9
Apr 13 16:32:38 user nova-compute[71731]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_ff503e69
Apr 13 16:32:38 user nova-compute[71731]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-23137643431323836
Apr 13 16:32:38 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbf3570a-1687-4a3a-9c87-09776ca20157]: (4, None) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:32:38 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c723d89-c9c4-47ed-8ab6-829de7a08fe4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c2088266-1d33-4bb1-ac5b-1de832ff7985')] {{(pid=71731) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 16:32:38 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2088266-1d33-4bb1-ac5b-1de832ff7985 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:32:38 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2088266-1d33-4bb1-ac5b-1de832ff7985 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:32:38 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4672526-7844-4c6b-9fd5-112f4e5d0a35]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:32:38 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c723d89-c9c4-47ed-8ab6-829de7a08fe4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:32:38 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2088266-1d33-4bb1-ac5b-1de832ff7985 -p 172.16.0.220:3260 --logout {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:32:38 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2088266-1d33-4bb1-ac5b-1de832ff7985 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:32:38 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fd500c8-fc02-4c05-84a2-532fa2bd1ed4]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:c2088266-1d33-4bb1-ac5b-1de832ff7985, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:c2088266-1d33-4bb1-ac5b-1de832ff7985, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:32:38 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c723d89-c9c4-47ed-8ab6-829de7a08fe4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:c2088266-1d33-4bb1-ac5b-1de832ff7985, portal: 172.16.0.220,3260]
Apr 13 16:32:38 user nova-compute[71731]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:c2088266-1d33-4bb1-ac5b-1de832ff7985, portal: 172.16.0.220,3260] successful.
Apr 13 16:32:38 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:32:38 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2088266-1d33-4bb1-ac5b-1de832ff7985 -p 172.16.0.220:3260 --op delete {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:32:38 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2088266-1d33-4bb1-ac5b-1de832ff7985 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:32:38 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[21bce4cf-9471-4d40-9656-9885e5518288]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:32:38 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c723d89-c9c4-47ed-8ab6-829de7a08fe4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:32:38 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-0c723d89-c9c4-47ed-8ab6-829de7a08fe4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.321s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 16:32:38 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c723d89-c9c4-47ed-8ab6-829de7a08fe4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] <== disconnect_volume: return (322ms) None {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 16:32:38 user nova-compute[71731]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0c723d89-c9c4-47ed-8ab6-829de7a08fe4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 03200054-c651-4333-acce-3bea3defe22a] Disconnected iSCSI Volume {{(pid=71731) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 16:32:38 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-0c723d89-c9c4-47ed-8ab6-829de7a08fe4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 03200054-c651-4333-acce-3bea3defe22a] Deleting instance files /opt/stack/data/nova/instances/03200054-c651-4333-acce-3bea3defe22a_del
Apr 13 16:32:38 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-0c723d89-c9c4-47ed-8ab6-829de7a08fe4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 03200054-c651-4333-acce-3bea3defe22a] Deletion of /opt/stack/data/nova/instances/03200054-c651-4333-acce-3bea3defe22a_del complete
Apr 13 16:32:38 user nova-compute[71731]: INFO nova.compute.manager [None req-0c723d89-c9c4-47ed-8ab6-829de7a08fe4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 03200054-c651-4333-acce-3bea3defe22a] Took 1.53 seconds to destroy the instance on the hypervisor.
Apr 13 16:32:38 user nova-compute[71731]: DEBUG oslo.service.loopingcall [None req-0c723d89-c9c4-47ed-8ab6-829de7a08fe4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71731) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 16:32:38 user nova-compute[71731]: DEBUG nova.compute.manager [-] [instance: 03200054-c651-4333-acce-3bea3defe22a] Deallocating network for instance {{(pid=71731) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 16:32:38 user nova-compute[71731]: DEBUG nova.network.neutron [-] [instance: 03200054-c651-4333-acce-3bea3defe22a] deallocate_for_instance() {{(pid=71731) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 16:32:39 user nova-compute[71731]: DEBUG nova.network.neutron [-] [instance: 03200054-c651-4333-acce-3bea3defe22a] Updating instance_info_cache with network_info: [] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:32:39 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-2c13abc6-6cb9-4d7a-87ae-2dd707a8632a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] Starting finish_migration {{(pid=71731) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11647}}
Apr 13 16:32:39 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-2c13abc6-6cb9-4d7a-87ae-2dd707a8632a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] Instance directory exists: not creating {{(pid=71731) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 13 16:32:39 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-2c13abc6-6cb9-4d7a-87ae-2dd707a8632a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] Creating image(s)
Apr 13 16:32:39 user nova-compute[71731]: DEBUG nova.objects.instance [None req-2c13abc6-6cb9-4d7a-87ae-2dd707a8632a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lazy-loading 'trusted_certs' on Instance uuid acbcaee0-a47b-4fee-8765-9b1c9597d515 {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:32:39 user nova-compute[71731]: DEBUG nova.compute.manager [req-fcc96bba-eb36-4f25-a86b-e048d0e9912f req-b34dd6e9-f673-46b2-9023-f635f1d08c31 service nova] [instance: 03200054-c651-4333-acce-3bea3defe22a] Received event network-vif-deleted-b40a4a40-0a9a-42f8-8d44-41bf4042454b {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:32:39 user nova-compute[71731]: INFO nova.compute.manager [req-fcc96bba-eb36-4f25-a86b-e048d0e9912f req-b34dd6e9-f673-46b2-9023-f635f1d08c31 service nova] [instance: 03200054-c651-4333-acce-3bea3defe22a] Neutron deleted interface b40a4a40-0a9a-42f8-8d44-41bf4042454b; detaching it from the instance and deleting it from the info cache
Apr 13 16:32:39 user nova-compute[71731]: DEBUG nova.network.neutron [req-fcc96bba-eb36-4f25-a86b-e048d0e9912f req-b34dd6e9-f673-46b2-9023-f635f1d08c31 service nova] [instance: 03200054-c651-4333-acce-3bea3defe22a] Updating instance_info_cache with network_info: [] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:32:39 user nova-compute[71731]: INFO nova.compute.manager [-] [instance: 03200054-c651-4333-acce-3bea3defe22a] Took 0.86 seconds to deallocate network for instance.
Apr 13 16:32:39 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-2c13abc6-6cb9-4d7a-87ae-2dd707a8632a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279 --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:32:39 user nova-compute[71731]: DEBUG nova.compute.manager [req-fcc96bba-eb36-4f25-a86b-e048d0e9912f req-b34dd6e9-f673-46b2-9023-f635f1d08c31 service nova] [instance: 03200054-c651-4333-acce-3bea3defe22a] Detach interface failed, port_id=b40a4a40-0a9a-42f8-8d44-41bf4042454b, reason: Instance 03200054-c651-4333-acce-3bea3defe22a could not be found. {{(pid=71731) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 13 16:32:39 user nova-compute[71731]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8769a397-3c19-4176-96a9-4eade9a1e9da tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] [instance: bf98c3a2-dbeb-4ae4-8423-ce55964c4258] Calling os-brick to attach iSCSI Volume {{(pid=71731) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 16:32:39 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-8769a397-3c19-4176-96a9-4eade9a1e9da tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8cf0118790>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:30806b19-961b-4edd-941a-2ee293795bb1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TayPiIRK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 16:32:39 user nova-compute[71731]: WARNING os_brick.initiator.connectors.base [None req-8769a397-3c19-4176-96a9-4eade9a1e9da tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 16:32:39 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-8769a397-3c19-4176-96a9-4eade9a1e9da tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 16:32:39 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-8769a397-3c19-4176-96a9-4eade9a1e9da tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 16:32:39 user nova-compute[71731]: WARNING os_brick.initiator.connectors.base [None req-8769a397-3c19-4176-96a9-4eade9a1e9da tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 16:32:39 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-8769a397-3c19-4176-96a9-4eade9a1e9da tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:30806b19-961b-4edd-941a-2ee293795bb1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 16:32:39 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-8769a397-3c19-4176-96a9-4eade9a1e9da tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:30806b19-961b-4edd-941a-2ee293795bb1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 16:32:39 user nova-compute[71731]: INFO os_brick.initiator.connectors.iscsi [None req-8769a397-3c19-4176-96a9-4eade9a1e9da tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 16:32:39 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30806b19-961b-4edd-941a-2ee293795bb1 -p 172.16.0.220:3260 {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:32:39 user nova-compute[71731]: DEBUG nova.compute.manager [req-93e06399-162e-44df-92b5-a8b67eac9d10 req-380e22e2-502f-4441-a42e-239cbb167031 service nova] [instance: 03200054-c651-4333-acce-3bea3defe22a] Received event network-vif-plugged-b40a4a40-0a9a-42f8-8d44-41bf4042454b {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:32:39 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-93e06399-162e-44df-92b5-a8b67eac9d10 req-380e22e2-502f-4441-a42e-239cbb167031 service nova] Acquiring lock "03200054-c651-4333-acce-3bea3defe22a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:32:39 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-93e06399-162e-44df-92b5-a8b67eac9d10 req-380e22e2-502f-4441-a42e-239cbb167031 service nova] Lock "03200054-c651-4333-acce-3bea3defe22a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:32:39 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-93e06399-162e-44df-92b5-a8b67eac9d10 req-380e22e2-502f-4441-a42e-239cbb167031 service nova] Lock "03200054-c651-4333-acce-3bea3defe22a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:32:39 user nova-compute[71731]: DEBUG nova.compute.manager [req-93e06399-162e-44df-92b5-a8b67eac9d10 req-380e22e2-502f-4441-a42e-239cbb167031 service nova] [instance: 03200054-c651-4333-acce-3bea3defe22a] No waiting events found dispatching network-vif-plugged-b40a4a40-0a9a-42f8-8d44-41bf4042454b {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:32:39 user nova-compute[71731]: WARNING nova.compute.manager [req-93e06399-162e-44df-92b5-a8b67eac9d10 req-380e22e2-502f-4441-a42e-239cbb167031 service nova] [instance: 03200054-c651-4333-acce-3bea3defe22a] Received unexpected event network-vif-plugged-b40a4a40-0a9a-42f8-8d44-41bf4042454b for instance with vm_state active and task_state deleting.
Apr 13 16:32:39 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30806b19-961b-4edd-941a-2ee293795bb1 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:32:39 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf9be2db-bdba-4166-80f7-372a8c88b093]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:32:39 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-8769a397-3c19-4176-96a9-4eade9a1e9da tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 16:32:39 user nova-compute[71731]:  {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:32:39 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-2c13abc6-6cb9-4d7a-87ae-2dd707a8632a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279 --force-share --output=json" returned: 0 in 0.144s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:32:39 user nova-compute[71731]: DEBUG nova.virt.disk.api [None req-2c13abc6-6cb9-4d7a-87ae-2dd707a8632a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Checking if we can resize image /opt/stack/data/nova/instances/acbcaee0-a47b-4fee-8765-9b1c9597d515/disk. size=1073741824 {{(pid=71731) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 16:32:39 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-2c13abc6-6cb9-4d7a-87ae-2dd707a8632a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acbcaee0-a47b-4fee-8765-9b1c9597d515/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:32:39 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30806b19-961b-4edd-941a-2ee293795bb1 -p 172.16.0.220:3260 --interface default --op new {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:32:39 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30806b19-961b-4edd-941a-2ee293795bb1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:32:39 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[3aa5428f-93f3-4e0d-ad9e-3456f04b52d8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:30806b19-961b-4edd-941a-2ee293795bb1] added\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:32:39 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-8769a397-3c19-4176-96a9-4eade9a1e9da tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:30806b19-961b-4edd-941a-2ee293795bb1] added
Apr 13 16:32:39 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:32:39 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30806b19-961b-4edd-941a-2ee293795bb1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:32:39 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30806b19-961b-4edd-941a-2ee293795bb1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:32:39 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c7c99f3-ec13-470f-ae3f-a3a4f8aeb26c]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:32:39 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-8769a397-3c19-4176-96a9-4eade9a1e9da tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:32:39 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30806b19-961b-4edd-941a-2ee293795bb1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:32:39 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30806b19-961b-4edd-941a-2ee293795bb1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:32:39 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[32f89329-5da6-498e-a531-4e21c6fb72f9]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:32:39 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-8769a397-3c19-4176-96a9-4eade9a1e9da tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:32:39 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30806b19-961b-4edd-941a-2ee293795bb1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TayPiIRK {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:32:39 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30806b19-961b-4edd-941a-2ee293795bb1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TayPiIRK" returned: 0 in 0.017s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:32:39 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[86547973-9cdf-48cb-b7dc-1d4e240656ca]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:32:39 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-8769a397-3c19-4176-96a9-4eade9a1e9da tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TayPiIRK'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:32:39 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30806b19-961b-4edd-941a-2ee293795bb1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:32:39 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30806b19-961b-4edd-941a-2ee293795bb1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:32:39 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[065311d2-7586-474a-85d7-7a98e35988f1]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:32:39 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-8769a397-3c19-4176-96a9-4eade9a1e9da tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:32:39 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:32:39 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-2c13abc6-6cb9-4d7a-87ae-2dd707a8632a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acbcaee0-a47b-4fee-8765-9b1c9597d515/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:32:39 user nova-compute[71731]: DEBUG nova.virt.disk.api [None req-2c13abc6-6cb9-4d7a-87ae-2dd707a8632a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Cannot resize image /opt/stack/data/nova/instances/acbcaee0-a47b-4fee-8765-9b1c9597d515/disk to a smaller size. {{(pid=71731) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 16:32:39 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:32:39 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf20045a-97fb-4215-8789-26b84984967d]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25c3dc97-c9cb-4529-ab32-26ef7fd94fc6 (non-flash)\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:32:39 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-8769a397-3c19-4176-96a9-4eade9a1e9da tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)
Apr 13 16:32:39 user nova-compute[71731]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25c3dc97-c9cb-4529-ab32-26ef7fd94fc6 (non-flash)
Apr 13 16:32:39 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 16:32:39 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-8769a397-3c19-4176-96a9-4eade9a1e9da tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)
Apr 13 16:32:39 user nova-compute[71731]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25c3dc97-c9cb-4529-ab32-26ef7fd94fc6 (non-flash)
Apr 13 16:32:39 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 16:32:39 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-2c13abc6-6cb9-4d7a-87ae-2dd707a8632a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] Did not create local disks {{(pid=71731) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 13 16:32:39 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-2c13abc6-6cb9-4d7a-87ae-2dd707a8632a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] Ensure instance console log exists: /opt/stack/data/nova/instances/acbcaee0-a47b-4fee-8765-9b1c9597d515/console.log {{(pid=71731) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 16:32:39 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-2c13abc6-6cb9-4d7a-87ae-2dd707a8632a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:32:39 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-2c13abc6-6cb9-4d7a-87ae-2dd707a8632a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:32:39 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-2c13abc6-6cb9-4d7a-87ae-2dd707a8632a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:32:39 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-2c13abc6-6cb9-4d7a-87ae-2dd707a8632a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] Start _get_guest_xml network_info=[{"id": "13471516-9514-4b85-938f-69657c2990e5", "address": "fa:16:3e:62:32:7f", "network": {"id": "cf1fef97-9ef1-449f-a302-b38110024547", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1138167711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-1138167711-network", "vif_mac": "fa:16:3e:62:32:7f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "980559734a504574a83224deb7423c77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13471516-95", "ovs_interfaceid": "13471516-9514-4b85-938f-69657c2990e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T16:16:31Z,direct_url=<?>,disk_format='qcow2',id=708622a9-7465-4492-ade8-b827198f7e30,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='0b29a975c552465aba0ac7d6288434bd',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T16:16:33Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'device_type': 'disk', 'encrypted': False, 'disk_bus': 'virtio', 'guest_format': None, 'encryption_options': None, 'image_id': '708622a9-7465-4492-ade8-b827198f7e30'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'attachment_id': '2e2342d4-9169-47c9-8019-d8ff9c74c97b', 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:651ea766-ffda-42a1-9b3c-7be05a92c85f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ufUqtxTm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'acbcaee0-a47b-4fee-8765-9b1c9597d515', 'attached_at': '2023-04-13T16:32:39.000000', 'detached_at': '', 'volume_id': '651ea766-ffda-42a1-9b3c-7be05a92c85f', 'serial': '651ea766-ffda-42a1-9b3c-7be05a92c85f'}, 'disk_bus': 'virtio', 'guest_format': None, 'volume_type': None} {{(pid=71731) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 16:32:39 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30806b19-961b-4edd-941a-2ee293795bb1 -p 172.16.0.220:3260 --login {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:32:39 user nova-compute[71731]: WARNING nova.virt.libvirt.driver [None req-2c13abc6-6cb9-4d7a-87ae-2dd707a8632a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 16:32:39 user nova-compute[71731]: WARNING nova.virt.libvirt.driver [None req-2c13abc6-6cb9-4d7a-87ae-2dd707a8632a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 16:32:39 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-2c13abc6-6cb9-4d7a-87ae-2dd707a8632a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71731) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 16:32:39 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-2c13abc6-6cb9-4d7a-87ae-2dd707a8632a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T16:17:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='84',id=12,is_public=True,memory_mb=192,name='m1.micro',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T16:16:31Z,direct_url=<?>,disk_format='qcow2',id=708622a9-7465-4492-ade8-b827198f7e30,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='0b29a975c552465aba0ac7d6288434bd',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T16:16:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 16:32:39 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-2c13abc6-6cb9-4d7a-87ae-2dd707a8632a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Flavor limits 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 16:32:39 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-2c13abc6-6cb9-4d7a-87ae-2dd707a8632a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Image limits 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 16:32:39 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-2c13abc6-6cb9-4d7a-87ae-2dd707a8632a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Flavor pref 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 16:32:39 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-2c13abc6-6cb9-4d7a-87ae-2dd707a8632a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Image pref 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 16:32:39 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-2c13abc6-6cb9-4d7a-87ae-2dd707a8632a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 16:32:39 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-2c13abc6-6cb9-4d7a-87ae-2dd707a8632a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 16:32:39 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-2c13abc6-6cb9-4d7a-87ae-2dd707a8632a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71731) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 16:32:39 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-2c13abc6-6cb9-4d7a-87ae-2dd707a8632a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Got 1 possible topologies {{(pid=71731) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 16:32:39 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-2c13abc6-6cb9-4d7a-87ae-2dd707a8632a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 16:32:39 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-2c13abc6-6cb9-4d7a-87ae-2dd707a8632a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 16:32:39 user nova-compute[71731]: DEBUG nova.objects.instance [None req-2c13abc6-6cb9-4d7a-87ae-2dd707a8632a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lazy-loading 'vcpu_model' on Instance uuid acbcaee0-a47b-4fee-8765-9b1c9597d515 {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:32:39 user nova-compute[71731]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2c13abc6-6cb9-4d7a-87ae-2dd707a8632a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] Calling os-brick to attach iSCSI Volume {{(pid=71731) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 16:32:39 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c13abc6-6cb9-4d7a-87ae-2dd707a8632a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8cf0118790>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:651ea766-ffda-42a1-9b3c-7be05a92c85f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ufUqtxTm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 16:32:39 user nova-compute[71731]: WARNING os_brick.initiator.connectors.base [None req-2c13abc6-6cb9-4d7a-87ae-2dd707a8632a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 16:32:39 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-2c13abc6-6cb9-4d7a-87ae-2dd707a8632a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 16:32:39 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30806b19-961b-4edd-941a-2ee293795bb1 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:32:39 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[48736f9c-3292-4725-8154-be350cefba61]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:30806b19-961b-4edd-941a-2ee293795bb1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:30806b19-961b-4edd-941a-2ee293795bb1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:32:39 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-8769a397-3c19-4176-96a9-4eade9a1e9da tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:30806b19-961b-4edd-941a-2ee293795bb1, portal: 172.16.0.220,3260]
Apr 13 16:32:39 user nova-compute[71731]: Login to [iface: default, target: iqn.2010-10.org.openstack:30806b19-961b-4edd-941a-2ee293795bb1, portal: 172.16.0.220,3260] successful.
Apr 13 16:32:39 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:32:39 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30806b19-961b-4edd-941a-2ee293795bb1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:32:39 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30806b19-961b-4edd-941a-2ee293795bb1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:32:39 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1f873d1-c0cf-4cff-937e-2d5aabb9d395]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:32:39 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-8769a397-3c19-4176-96a9-4eade9a1e9da tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:32:39 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:32:39 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:32:39 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dedf5be-97ec-42cc-bab1-c23b474ea165]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25c3dc97-c9cb-4529-ab32-26ef7fd94fc6 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30806b19-961b-4edd-941a-2ee293795bb1 (non-flash)\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:32:39 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-8769a397-3c19-4176-96a9-4eade9a1e9da tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)
Apr 13 16:32:39 user nova-compute[71731]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25c3dc97-c9cb-4529-ab32-26ef7fd94fc6 (non-flash)
Apr 13 16:32:39 user nova-compute[71731]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30806b19-961b-4edd-941a-2ee293795bb1 (non-flash)
Apr 13 16:32:39 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 16:32:39 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-8769a397-3c19-4176-96a9-4eade9a1e9da tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)
Apr 13 16:32:39 user nova-compute[71731]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25c3dc97-c9cb-4529-ab32-26ef7fd94fc6 (non-flash)
Apr 13 16:32:39 user nova-compute[71731]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30806b19-961b-4edd-941a-2ee293795bb1 (non-flash)
Apr 13 16:32:39 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 16:32:39 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-8769a397-3c19-4176-96a9-4eade9a1e9da tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:30806b19-961b-4edd-941a-2ee293795bb1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.328s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 16:32:39 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-8769a397-3c19-4176-96a9-4eade9a1e9da tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Connected to 172.16.0.220:3260 {{(pid=71731) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 16:32:39 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-8769a397-3c19-4176-96a9-4eade9a1e9da tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] HCTL ('33', '-', '-', 0) found on session 34 with lun 0 {{(pid=71731) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 16:32:39 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-8769a397-3c19-4176-96a9-4eade9a1e9da tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71731) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 16:32:39 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:32:39 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:32:39 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2528706-8de6-469f-bf18-2fb14839afb1]: (4, ('- - 0', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:32:39 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-8769a397-3c19-4176-96a9-4eade9a1e9da tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Searching for a device in session 34 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71731) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 16:32:39 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-8769a397-3c19-4176-96a9-4eade9a1e9da tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:30806b19-961b-4edd-941a-2ee293795bb1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TayPiIRK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71731) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 16:32:40 user nova-compute[71731]: INFO nova.compute.manager [None req-0c723d89-c9c4-47ed-8ab6-829de7a08fe4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 03200054-c651-4333-acce-3bea3defe22a] Took 0.80 seconds to detach 1 volumes for instance.
Apr 13 16:32:40 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-0c723d89-c9c4-47ed-8ab6-829de7a08fe4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:32:40 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-0c723d89-c9c4-47ed-8ab6-829de7a08fe4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:32:40 user nova-compute[71731]: DEBUG nova.compute.provider_tree [None req-0c723d89-c9c4-47ed-8ab6-829de7a08fe4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Inventory has not changed in ProviderTree for provider: cb6b1a64-0c24-4e2d-af1e-16576ca9165c {{(pid=71731) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 16:32:40 user nova-compute[71731]: DEBUG nova.scheduler.client.report [None req-0c723d89-c9c4-47ed-8ab6-829de7a08fe4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Inventory has not changed for provider cb6b1a64-0c24-4e2d-af1e-16576ca9165c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71731) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 16:32:40 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-0c723d89-c9c4-47ed-8ab6-829de7a08fe4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.344s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:32:40 user nova-compute[71731]: INFO nova.scheduler.client.report [None req-0c723d89-c9c4-47ed-8ab6-829de7a08fe4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Deleted allocations for instance 03200054-c651-4333-acce-3bea3defe22a
Apr 13 16:32:40 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-0c723d89-c9c4-47ed-8ab6-829de7a08fe4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "03200054-c651-4333-acce-3bea3defe22a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.755s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:32:40 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-8769a397-3c19-4176-96a9-4eade9a1e9da tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.361s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 16:32:40 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-8769a397-3c19-4176-96a9-4eade9a1e9da tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] <== connect_volume: return (1363ms) {'type': 'block', 'scsi_wwn': '23362663861663235', 'path': '/dev/sdb'} {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 16:32:40 user nova-compute[71731]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8769a397-3c19-4176-96a9-4eade9a1e9da tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] [instance: bf98c3a2-dbeb-4ae4-8423-ce55964c4258] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23362663861663235', 'path': '/dev/sdb'} {{(pid=71731) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 16:32:40 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-2c13abc6-6cb9-4d7a-87ae-2dd707a8632a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.094s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 16:32:40 user nova-compute[71731]: WARNING os_brick.initiator.connectors.base [None req-2c13abc6-6cb9-4d7a-87ae-2dd707a8632a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 16:32:40 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-2c13abc6-6cb9-4d7a-87ae-2dd707a8632a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:651ea766-ffda-42a1-9b3c-7be05a92c85f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 16:32:40 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-2c13abc6-6cb9-4d7a-87ae-2dd707a8632a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:651ea766-ffda-42a1-9b3c-7be05a92c85f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 16:32:40 user nova-compute[71731]: INFO os_brick.initiator.connectors.iscsi [None req-2c13abc6-6cb9-4d7a-87ae-2dd707a8632a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 16:32:40 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:651ea766-ffda-42a1-9b3c-7be05a92c85f -p 172.16.0.220:3260 {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:32:40 user nova-compute[71731]: DEBUG nova.objects.instance [None req-8769a397-3c19-4176-96a9-4eade9a1e9da tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Lazy-loading 'flavor' on Instance uuid bf98c3a2-dbeb-4ae4-8423-ce55964c4258 {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:32:41 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:651ea766-ffda-42a1-9b3c-7be05a92c85f -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:32:41 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[4035c7cc-a895-4d02-80e1-b3fd33be7424]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:32:41 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c13abc6-6cb9-4d7a-87ae-2dd707a8632a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 16:32:41 user nova-compute[71731]:  {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:32:41 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:651ea766-ffda-42a1-9b3c-7be05a92c85f -p 172.16.0.220:3260 --interface default --op new {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:32:41 user nova-compute[71731]: DEBUG nova.virt.libvirt.guest [None req-8769a397-3c19-4176-96a9-4eade9a1e9da tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] attach device xml: <disk type="block" device="disk">
Apr 13 16:32:41 user nova-compute[71731]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 16:32:41 user nova-compute[71731]:   <source dev="/dev/sdb"/>
Apr 13 16:32:41 user nova-compute[71731]:   <target dev="vdb" bus="virtio"/>
Apr 13 16:32:41 user nova-compute[71731]:   <serial>30806b19-961b-4edd-941a-2ee293795bb1</serial>
Apr 13 16:32:41 user nova-compute[71731]: </disk>
Apr 13 16:32:41 user nova-compute[71731]:  {{(pid=71731) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 13 16:32:41 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:651ea766-ffda-42a1-9b3c-7be05a92c85f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:32:41 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[86a03a02-bd31-4723-b2a9-b7e610557233]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:651ea766-ffda-42a1-9b3c-7be05a92c85f] added\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:32:41 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c13abc6-6cb9-4d7a-87ae-2dd707a8632a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:651ea766-ffda-42a1-9b3c-7be05a92c85f] added
Apr 13 16:32:41 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:32:41 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:651ea766-ffda-42a1-9b3c-7be05a92c85f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:32:41 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:651ea766-ffda-42a1-9b3c-7be05a92c85f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:32:41 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd65b36d-4c19-45a7-b559-760e2227470a]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:32:41 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c13abc6-6cb9-4d7a-87ae-2dd707a8632a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:32:41 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:651ea766-ffda-42a1-9b3c-7be05a92c85f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:32:41 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:651ea766-ffda-42a1-9b3c-7be05a92c85f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:32:41 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfd12d27-f482-4bc6-b69a-2fd2ca22a6ed]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:32:41 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c13abc6-6cb9-4d7a-87ae-2dd707a8632a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:32:41 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:651ea766-ffda-42a1-9b3c-7be05a92c85f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ufUqtxTm {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:32:41 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:651ea766-ffda-42a1-9b3c-7be05a92c85f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ufUqtxTm" returned: 0 in 0.017s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:32:41 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf7ac3de-85b4-42d2-a953-6e085a75fb48]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:32:41 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c13abc6-6cb9-4d7a-87ae-2dd707a8632a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ufUqtxTm'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:32:41 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:651ea766-ffda-42a1-9b3c-7be05a92c85f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:32:41 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:651ea766-ffda-42a1-9b3c-7be05a92c85f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:32:41 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[a81ac40a-15e9-425d-a21b-e156cfea137c]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:32:41 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c13abc6-6cb9-4d7a-87ae-2dd707a8632a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:32:41 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:32:41 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:32:41 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[60165881-0382-48c5-8964-c5d90244baae]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25c3dc97-c9cb-4529-ab32-26ef7fd94fc6 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30806b19-961b-4edd-941a-2ee293795bb1 (non-flash)\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:32:41 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c13abc6-6cb9-4d7a-87ae-2dd707a8632a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)
Apr 13 16:32:41 user nova-compute[71731]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25c3dc97-c9cb-4529-ab32-26ef7fd94fc6 (non-flash)
Apr 13 16:32:41 user nova-compute[71731]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30806b19-961b-4edd-941a-2ee293795bb1 (non-flash)
Apr 13 16:32:41 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 16:32:41 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c13abc6-6cb9-4d7a-87ae-2dd707a8632a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)
Apr 13 16:32:41 user nova-compute[71731]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25c3dc97-c9cb-4529-ab32-26ef7fd94fc6 (non-flash)
Apr 13 16:32:41 user nova-compute[71731]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30806b19-961b-4edd-941a-2ee293795bb1 (non-flash)
Apr 13 16:32:41 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 16:32:41 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:651ea766-ffda-42a1-9b3c-7be05a92c85f -p 172.16.0.220:3260 --login {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:32:41 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:651ea766-ffda-42a1-9b3c-7be05a92c85f -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:32:41 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[3db2d0c8-8474-4695-bad5-6b785c25cf5f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:651ea766-ffda-42a1-9b3c-7be05a92c85f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:651ea766-ffda-42a1-9b3c-7be05a92c85f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:32:41 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c13abc6-6cb9-4d7a-87ae-2dd707a8632a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:651ea766-ffda-42a1-9b3c-7be05a92c85f, portal: 172.16.0.220,3260]
Apr 13 16:32:41 user nova-compute[71731]: Login to [iface: default, target: iqn.2010-10.org.openstack:651ea766-ffda-42a1-9b3c-7be05a92c85f, portal: 172.16.0.220,3260] successful.
Apr 13 16:32:41 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:32:41 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:651ea766-ffda-42a1-9b3c-7be05a92c85f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:32:41 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:651ea766-ffda-42a1-9b3c-7be05a92c85f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:32:41 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8e5983c-010c-477f-bbb5-70a9c4614c56]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:32:41 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c13abc6-6cb9-4d7a-87ae-2dd707a8632a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:32:41 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:32:41 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:32:41 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ba53ed6-baa1-43dc-8a66-a28d5716941e]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25c3dc97-c9cb-4529-ab32-26ef7fd94fc6 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30806b19-961b-4edd-941a-2ee293795bb1 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:651ea766-ffda-42a1-9b3c-7be05a92c85f (non-flash)\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:32:41 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c13abc6-6cb9-4d7a-87ae-2dd707a8632a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)
Apr 13 16:32:41 user nova-compute[71731]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25c3dc97-c9cb-4529-ab32-26ef7fd94fc6 (non-flash)
Apr 13 16:32:41 user nova-compute[71731]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30806b19-961b-4edd-941a-2ee293795bb1 (non-flash)
Apr 13 16:32:41 user nova-compute[71731]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:651ea766-ffda-42a1-9b3c-7be05a92c85f (non-flash)
Apr 13 16:32:41 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 16:32:41 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c13abc6-6cb9-4d7a-87ae-2dd707a8632a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)
Apr 13 16:32:41 user nova-compute[71731]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25c3dc97-c9cb-4529-ab32-26ef7fd94fc6 (non-flash)
Apr 13 16:32:41 user nova-compute[71731]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30806b19-961b-4edd-941a-2ee293795bb1 (non-flash)
Apr 13 16:32:41 user nova-compute[71731]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:651ea766-ffda-42a1-9b3c-7be05a92c85f (non-flash)
Apr 13 16:32:41 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 16:32:41 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-2c13abc6-6cb9-4d7a-87ae-2dd707a8632a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:651ea766-ffda-42a1-9b3c-7be05a92c85f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.276s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 16:32:41 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c13abc6-6cb9-4d7a-87ae-2dd707a8632a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Connected to 172.16.0.220:3260 {{(pid=71731) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 16:32:41 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-2c13abc6-6cb9-4d7a-87ae-2dd707a8632a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] HCTL ('36', '-', '-', 0) found on session 35 with lun 0 {{(pid=71731) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 16:32:41 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-2c13abc6-6cb9-4d7a-87ae-2dd707a8632a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=71731) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 16:32:41 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:32:41 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.019s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:32:41 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[7781d6bc-a29a-4caf-8d23-ed89d46d12ed]: (4, ('- - 0', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:32:41 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-2c13abc6-6cb9-4d7a-87ae-2dd707a8632a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Searching for a device in session 35 and hctl ['36', '*', '*', 0] yield: sde {{(pid=71731) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 16:32:41 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c13abc6-6cb9-4d7a-87ae-2dd707a8632a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:651ea766-ffda-42a1-9b3c-7be05a92c85f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ufUqtxTm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71731) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 16:32:41 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-8769a397-3c19-4176-96a9-4eade9a1e9da tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] No BDM found with device name vda, not building metadata. {{(pid=71731) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 16:32:41 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-8769a397-3c19-4176-96a9-4eade9a1e9da tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71731) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 16:32:41 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-8769a397-3c19-4176-96a9-4eade9a1e9da tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] No VIF found with MAC fa:16:3e:76:1a:b3, not building metadata {{(pid=71731) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 16:32:41 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-8769a397-3c19-4176-96a9-4eade9a1e9da tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Lock "bf98c3a2-dbeb-4ae4-8423-ce55964c4258" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.771s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:32:41 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:32:42 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-2c13abc6-6cb9-4d7a-87ae-2dd707a8632a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.310s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 16:32:42 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c13abc6-6cb9-4d7a-87ae-2dd707a8632a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] <== connect_volume: return (2404ms) {'type': 'block', 'scsi_wwn': '26238616634396438', 'path': '/dev/sde'} {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 16:32:42 user nova-compute[71731]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2c13abc6-6cb9-4d7a-87ae-2dd707a8632a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26238616634396438', 'path': '/dev/sde'} {{(pid=71731) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 16:32:42 user nova-compute[71731]: DEBUG nova.virt.libvirt.vif [None req-2c13abc6-6cb9-4d7a-87ae-2dd707a8632a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-13T16:23:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1986504733',display_name='tempest-ServerActionsTestJSON-server-376598631',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1986504733',id=16,image_ref='708622a9-7465-4492-ade8-b827198f7e30',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPaDda4gTmMbkxKfok8i4i1XcNLza5lOVYjCPDEGVTF1JRQKderq80DnIN4GAkaZiBV5U44gvdu3wadL/M5wOH7VDSuEghHchow1mC9TB1xgdo8GoXeM279SVAyu08uhIQ==',key_name='tempest-keypair-1700037342',keypairs=<?>,launch_index=0,launched_at=2023-04-13T16:27:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='980559734a504574a83224deb7423c77',ramdisk_id='',reservation_id='r-3vv5sptg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='708622a9-7465-4492-ade8-b827198f7e30',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-713402718',owner_user_name='tempest-ServerActionsTestJSON-713402718-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T16:32:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1b3df1c5c5d441819bcef89ed6966815',uuid=acbcaee0-a47b-4fee-8765-9b1c9597d515,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "13471516-9514-4b85-938f-69657c2990e5", "address": "fa:16:3e:62:32:7f", "network": {"id": "cf1fef97-9ef1-449f-a302-b38110024547", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1138167711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-1138167711-network", "vif_mac": "fa:16:3e:62:32:7f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "980559734a504574a83224deb7423c77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13471516-95", "ovs_interfaceid": "13471516-9514-4b85-938f-69657c2990e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71731) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 16:32:42 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-2c13abc6-6cb9-4d7a-87ae-2dd707a8632a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Converting VIF {"id": "13471516-9514-4b85-938f-69657c2990e5", "address": "fa:16:3e:62:32:7f", "network": {"id": "cf1fef97-9ef1-449f-a302-b38110024547", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1138167711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-1138167711-network", "vif_mac": "fa:16:3e:62:32:7f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "980559734a504574a83224deb7423c77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13471516-95", "ovs_interfaceid": "13471516-9514-4b85-938f-69657c2990e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 16:32:42 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-2c13abc6-6cb9-4d7a-87ae-2dd707a8632a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:62:32:7f,bridge_name='br-int',has_traffic_filtering=True,id=13471516-9514-4b85-938f-69657c2990e5,network=Network(cf1fef97-9ef1-449f-a302-b38110024547),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13471516-95') {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 16:32:42 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-2c13abc6-6cb9-4d7a-87ae-2dd707a8632a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] End _get_guest_xml xml=<domain type="kvm">
Apr 13 16:32:42 user nova-compute[71731]:   <uuid>acbcaee0-a47b-4fee-8765-9b1c9597d515</uuid>
Apr 13 16:32:42 user nova-compute[71731]:   <name>instance-00000010</name>
Apr 13 16:32:42 user nova-compute[71731]:   <memory>196608</memory>
Apr 13 16:32:42 user nova-compute[71731]:   <vcpu>1</vcpu>
Apr 13 16:32:42 user nova-compute[71731]:   <metadata>
Apr 13 16:32:42 user nova-compute[71731]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 16:32:42 user nova-compute[71731]:       <nova:package version="0.0.0"/>
Apr 13 16:32:42 user nova-compute[71731]:       <nova:name>tempest-ServerActionsTestJSON-server-376598631</nova:name>
Apr 13 16:32:42 user nova-compute[71731]:       <nova:creationTime>2023-04-13 16:32:39</nova:creationTime>
Apr 13 16:32:42 user nova-compute[71731]:       <nova:flavor name="m1.micro">
Apr 13 16:32:42 user nova-compute[71731]:         <nova:memory>192</nova:memory>
Apr 13 16:32:42 user nova-compute[71731]:         <nova:disk>1</nova:disk>
Apr 13 16:32:42 user nova-compute[71731]:         <nova:swap>0</nova:swap>
Apr 13 16:32:42 user nova-compute[71731]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 16:32:42 user nova-compute[71731]:         <nova:vcpus>1</nova:vcpus>
Apr 13 16:32:42 user nova-compute[71731]:       </nova:flavor>
Apr 13 16:32:42 user nova-compute[71731]:       <nova:owner>
Apr 13 16:32:42 user nova-compute[71731]:         <nova:user uuid="1b3df1c5c5d441819bcef89ed6966815">tempest-ServerActionsTestJSON-713402718-project-member</nova:user>
Apr 13 16:32:42 user nova-compute[71731]:         <nova:project uuid="980559734a504574a83224deb7423c77">tempest-ServerActionsTestJSON-713402718</nova:project>
Apr 13 16:32:42 user nova-compute[71731]:       </nova:owner>
Apr 13 16:32:42 user nova-compute[71731]:       <nova:root type="image" uuid="708622a9-7465-4492-ade8-b827198f7e30"/>
Apr 13 16:32:42 user nova-compute[71731]:       <nova:ports>
Apr 13 16:32:42 user nova-compute[71731]:         <nova:port uuid="13471516-9514-4b85-938f-69657c2990e5">
Apr 13 16:32:42 user nova-compute[71731]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Apr 13 16:32:42 user nova-compute[71731]:         </nova:port>
Apr 13 16:32:42 user nova-compute[71731]:       </nova:ports>
Apr 13 16:32:42 user nova-compute[71731]:     </nova:instance>
Apr 13 16:32:42 user nova-compute[71731]:   </metadata>
Apr 13 16:32:42 user nova-compute[71731]:   <sysinfo type="smbios">
Apr 13 16:32:42 user nova-compute[71731]:     <system>
Apr 13 16:32:42 user nova-compute[71731]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 16:32:42 user nova-compute[71731]:       <entry name="product">OpenStack Nova</entry>
Apr 13 16:32:42 user nova-compute[71731]:       <entry name="version">0.0.0</entry>
Apr 13 16:32:42 user nova-compute[71731]:       <entry name="serial">acbcaee0-a47b-4fee-8765-9b1c9597d515</entry>
Apr 13 16:32:42 user nova-compute[71731]:       <entry name="uuid">acbcaee0-a47b-4fee-8765-9b1c9597d515</entry>
Apr 13 16:32:42 user nova-compute[71731]:       <entry name="family">Virtual Machine</entry>
Apr 13 16:32:42 user nova-compute[71731]:     </system>
Apr 13 16:32:42 user nova-compute[71731]:   </sysinfo>
Apr 13 16:32:42 user nova-compute[71731]:   <os>
Apr 13 16:32:42 user nova-compute[71731]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 16:32:42 user nova-compute[71731]:     <boot dev="hd"/>
Apr 13 16:32:42 user nova-compute[71731]:     <smbios mode="sysinfo"/>
Apr 13 16:32:42 user nova-compute[71731]:   </os>
Apr 13 16:32:42 user nova-compute[71731]:   <features>
Apr 13 16:32:42 user nova-compute[71731]:     <acpi/>
Apr 13 16:32:42 user nova-compute[71731]:     <apic/>
Apr 13 16:32:42 user nova-compute[71731]:     <vmcoreinfo/>
Apr 13 16:32:42 user nova-compute[71731]:   </features>
Apr 13 16:32:42 user nova-compute[71731]:   <clock offset="utc">
Apr 13 16:32:42 user nova-compute[71731]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 16:32:42 user nova-compute[71731]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 16:32:42 user nova-compute[71731]:     <timer name="hpet" present="no"/>
Apr 13 16:32:42 user nova-compute[71731]:   </clock>
Apr 13 16:32:42 user nova-compute[71731]:   <cpu mode="custom" match="exact">
Apr 13 16:32:42 user nova-compute[71731]:     <model>Nehalem</model>
Apr 13 16:32:42 user nova-compute[71731]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 16:32:42 user nova-compute[71731]:   </cpu>
Apr 13 16:32:42 user nova-compute[71731]:   <devices>
Apr 13 16:32:42 user nova-compute[71731]:     <disk type="file" device="disk">
Apr 13 16:32:42 user nova-compute[71731]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 16:32:42 user nova-compute[71731]:       <source file="/opt/stack/data/nova/instances/acbcaee0-a47b-4fee-8765-9b1c9597d515/disk"/>
Apr 13 16:32:42 user nova-compute[71731]:       <target dev="vda" bus="virtio"/>
Apr 13 16:32:42 user nova-compute[71731]:     </disk>
Apr 13 16:32:42 user nova-compute[71731]:     <disk type="block" device="disk">
Apr 13 16:32:42 user nova-compute[71731]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 16:32:42 user nova-compute[71731]:       <source dev="/dev/sde"/>
Apr 13 16:32:42 user nova-compute[71731]:       <target dev="vdb" bus="virtio"/>
Apr 13 16:32:42 user nova-compute[71731]:       <serial>651ea766-ffda-42a1-9b3c-7be05a92c85f</serial>
Apr 13 16:32:42 user nova-compute[71731]:     </disk>
Apr 13 16:32:42 user nova-compute[71731]:     <interface type="ethernet">
Apr 13 16:32:42 user nova-compute[71731]:       <mac address="fa:16:3e:62:32:7f"/>
Apr 13 16:32:42 user nova-compute[71731]:       <model type="virtio"/>
Apr 13 16:32:42 user nova-compute[71731]:       <mtu size="1442"/>
Apr 13 16:32:42 user nova-compute[71731]:       <target dev="tap13471516-95"/>
Apr 13 16:32:42 user nova-compute[71731]:     </interface>
Apr 13 16:32:42 user nova-compute[71731]:     <serial type="pty">
Apr 13 16:32:42 user nova-compute[71731]:       <log file="/opt/stack/data/nova/instances/acbcaee0-a47b-4fee-8765-9b1c9597d515/console.log" append="off"/>
Apr 13 16:32:42 user nova-compute[71731]:     </serial>
Apr 13 16:32:42 user nova-compute[71731]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 16:32:42 user nova-compute[71731]:     <video>
Apr 13 16:32:42 user nova-compute[71731]:       <model type="virtio"/>
Apr 13 16:32:42 user nova-compute[71731]:     </video>
Apr 13 16:32:42 user nova-compute[71731]:     <rng model="virtio">
Apr 13 16:32:42 user nova-compute[71731]:       <backend model="random">/dev/urandom</backend>
Apr 13 16:32:42 user nova-compute[71731]:     </rng>
Apr 13 16:32:42 user nova-compute[71731]:     <controller type="usb" index="0" model="none"/>
Apr 13 16:32:42 user nova-compute[71731]:     <memballoon model="virtio">
Apr 13 16:32:42 user nova-compute[71731]:       <stats period="10"/>
Apr 13 16:32:42 user nova-compute[71731]:     </memballoon>
Apr 13 16:32:42 user nova-compute[71731]:   </devices>
Apr 13 16:32:42 user nova-compute[71731]: </domain>
Apr 13 16:32:42 user nova-compute[71731]:  {{(pid=71731) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 16:32:42 user nova-compute[71731]: DEBUG nova.virt.libvirt.vif [None req-2c13abc6-6cb9-4d7a-87ae-2dd707a8632a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-13T16:23:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1986504733',display_name='tempest-ServerActionsTestJSON-server-376598631',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1986504733',id=16,image_ref='708622a9-7465-4492-ade8-b827198f7e30',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPaDda4gTmMbkxKfok8i4i1XcNLza5lOVYjCPDEGVTF1JRQKderq80DnIN4GAkaZiBV5U44gvdu3wadL/M5wOH7VDSuEghHchow1mC9TB1xgdo8GoXeM279SVAyu08uhIQ==',key_name='tempest-keypair-1700037342',keypairs=<?>,launch_index=0,launched_at=2023-04-13T16:27:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='980559734a504574a83224deb7423c77',ramdisk_id='',reservation_id='r-3vv5sptg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='708622a9-7465-4492-ade8-b827198f7e30',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-713402718',owner_user_name='tempest-ServerActionsTestJSON-713402718-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T16:32:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1b3df1c5c5d441819bcef89ed6966815',uuid=acbcaee0-a47b-4fee-8765-9b1c9597d515,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "13471516-9514-4b85-938f-69657c2990e5", "address": "fa:16:3e:62:32:7f", "network": {"id": "cf1fef97-9ef1-449f-a302-b38110024547", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1138167711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-1138167711-network", "vif_mac": "fa:16:3e:62:32:7f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "980559734a504574a83224deb7423c77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13471516-95", "ovs_interfaceid": "13471516-9514-4b85-938f-69657c2990e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 16:32:42 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-2c13abc6-6cb9-4d7a-87ae-2dd707a8632a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Converting VIF {"id": "13471516-9514-4b85-938f-69657c2990e5", "address": "fa:16:3e:62:32:7f", "network": {"id": "cf1fef97-9ef1-449f-a302-b38110024547", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1138167711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-1138167711-network", "vif_mac": "fa:16:3e:62:32:7f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "980559734a504574a83224deb7423c77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13471516-95", "ovs_interfaceid": "13471516-9514-4b85-938f-69657c2990e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 16:32:42 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-2c13abc6-6cb9-4d7a-87ae-2dd707a8632a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:62:32:7f,bridge_name='br-int',has_traffic_filtering=True,id=13471516-9514-4b85-938f-69657c2990e5,network=Network(cf1fef97-9ef1-449f-a302-b38110024547),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13471516-95') {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 16:32:42 user nova-compute[71731]: DEBUG os_vif [None req-2c13abc6-6cb9-4d7a-87ae-2dd707a8632a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:32:7f,bridge_name='br-int',has_traffic_filtering=True,id=13471516-9514-4b85-938f-69657c2990e5,network=Network(cf1fef97-9ef1-449f-a302-b38110024547),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13471516-95') {{(pid=71731) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 16:32:42 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:32:42 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:32:42 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 16:32:42 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:32:42 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap13471516-95, may_exist=True) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:32:42 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap13471516-95, col_values=(('external_ids', {'iface-id': '13471516-9514-4b85-938f-69657c2990e5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:62:32:7f', 'vm-uuid': 'acbcaee0-a47b-4fee-8765-9b1c9597d515'}),)) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:32:42 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:32:42 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 16:32:42 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:32:42 user nova-compute[71731]: INFO os_vif [None req-2c13abc6-6cb9-4d7a-87ae-2dd707a8632a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:32:7f,bridge_name='br-int',has_traffic_filtering=True,id=13471516-9514-4b85-938f-69657c2990e5,network=Network(cf1fef97-9ef1-449f-a302-b38110024547),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13471516-95')
Apr 13 16:32:42 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-2c13abc6-6cb9-4d7a-87ae-2dd707a8632a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] No BDM found with device name vda, not building metadata. {{(pid=71731) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 16:32:42 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-2c13abc6-6cb9-4d7a-87ae-2dd707a8632a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71731) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 16:32:42 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-2c13abc6-6cb9-4d7a-87ae-2dd707a8632a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] No VIF found with MAC fa:16:3e:62:32:7f, not building metadata {{(pid=71731) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 16:32:42 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-74626626-d59d-432e-b32a-a449dcbf0ec0 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Acquiring lock "bf98c3a2-dbeb-4ae4-8423-ce55964c4258" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:32:42 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-74626626-d59d-432e-b32a-a449dcbf0ec0 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Lock "bf98c3a2-dbeb-4ae4-8423-ce55964c4258" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:32:43 user nova-compute[71731]: INFO nova.compute.manager [None req-74626626-d59d-432e-b32a-a449dcbf0ec0 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] [instance: bf98c3a2-dbeb-4ae4-8423-ce55964c4258] Detaching volume 30806b19-961b-4edd-941a-2ee293795bb1
Apr 13 16:32:43 user nova-compute[71731]: INFO nova.virt.block_device [None req-74626626-d59d-432e-b32a-a449dcbf0ec0 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] [instance: bf98c3a2-dbeb-4ae4-8423-ce55964c4258] Attempting to driver detach volume 30806b19-961b-4edd-941a-2ee293795bb1 from mountpoint /dev/vdb
Apr 13 16:32:43 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-74626626-d59d-432e-b32a-a449dcbf0ec0 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Attempting to detach device vdb from instance bf98c3a2-dbeb-4ae4-8423-ce55964c4258 from the persistent domain config. {{(pid=71731) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 13 16:32:43 user nova-compute[71731]: DEBUG nova.virt.libvirt.guest [None req-74626626-d59d-432e-b32a-a449dcbf0ec0 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 16:32:43 user nova-compute[71731]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 16:32:43 user nova-compute[71731]:   <source dev="/dev/sdb"/>
Apr 13 16:32:43 user nova-compute[71731]:   <target dev="vdb" bus="virtio"/>
Apr 13 16:32:43 user nova-compute[71731]:   <serial>30806b19-961b-4edd-941a-2ee293795bb1</serial>
Apr 13 16:32:43 user nova-compute[71731]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 13 16:32:43 user nova-compute[71731]: </disk>
Apr 13 16:32:43 user nova-compute[71731]:  {{(pid=71731) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 16:32:43 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-74626626-d59d-432e-b32a-a449dcbf0ec0 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Successfully detached device vdb from instance bf98c3a2-dbeb-4ae4-8423-ce55964c4258 from the persistent domain config.
Apr 13 16:32:43 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-74626626-d59d-432e-b32a-a449dcbf0ec0 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance bf98c3a2-dbeb-4ae4-8423-ce55964c4258 from the live domain config. {{(pid=71731) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 13 16:32:43 user nova-compute[71731]: DEBUG nova.virt.libvirt.guest [None req-74626626-d59d-432e-b32a-a449dcbf0ec0 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 16:32:43 user nova-compute[71731]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 16:32:43 user nova-compute[71731]:   <source dev="/dev/sdb"/>
Apr 13 16:32:43 user nova-compute[71731]:   <target dev="vdb" bus="virtio"/>
Apr 13 16:32:43 user nova-compute[71731]:   <serial>30806b19-961b-4edd-941a-2ee293795bb1</serial>
Apr 13 16:32:43 user nova-compute[71731]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 13 16:32:43 user nova-compute[71731]: </disk>
Apr 13 16:32:43 user nova-compute[71731]:  {{(pid=71731) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 16:32:43 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Received event <DeviceRemovedEvent: 1681403563.6148303, bf98c3a2-dbeb-4ae4-8423-ce55964c4258 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71731) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 13 16:32:43 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-74626626-d59d-432e-b32a-a449dcbf0ec0 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance bf98c3a2-dbeb-4ae4-8423-ce55964c4258 {{(pid=71731) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 13 16:32:43 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-74626626-d59d-432e-b32a-a449dcbf0ec0 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Successfully detached device vdb from instance bf98c3a2-dbeb-4ae4-8423-ce55964c4258 from the live domain config.
Apr 13 16:32:43 user nova-compute[71731]: DEBUG nova.virt.libvirt.volume.iscsi [None req-74626626-d59d-432e-b32a-a449dcbf0ec0 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] [instance: bf98c3a2-dbeb-4ae4-8423-ce55964c4258] calling os-brick to detach iSCSI Volume {{(pid=71731) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 16:32:43 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-74626626-d59d-432e-b32a-a449dcbf0ec0 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8cf0118790>, {'target_iqn': 'iqn.2010-10.org.openstack:30806b19-961b-4edd-941a-2ee293795bb1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TayPiIRK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 16:32:43 user nova-compute[71731]: WARNING os_brick.initiator.connectors.base [None req-74626626-d59d-432e-b32a-a449dcbf0ec0 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 16:32:43 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-74626626-d59d-432e-b32a-a449dcbf0ec0 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 16:32:43 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-74626626-d59d-432e-b32a-a449dcbf0ec0 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 16:32:43 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:32:43 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:32:43 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[47c03268-82b2-45b3-9812-0bfeb7d75a1e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:25c3dc97-c9cb-4529-ab32-26ef7fd94fc6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:651ea766-ffda-42a1-9b3c-7be05a92c85f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:30806b19-961b-4edd-941a-2ee293795bb1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:32:43 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-74626626-d59d-432e-b32a-a449dcbf0ec0 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 16:32:43 user nova-compute[71731]: No targets found.
Apr 13 16:32:43 user nova-compute[71731]: iSNS:
Apr 13 16:32:43 user nova-compute[71731]: No targets found.
Apr 13 16:32:43 user nova-compute[71731]: STATIC:
Apr 13 16:32:43 user nova-compute[71731]: Target: iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97
Apr 13 16:32:43 user nova-compute[71731]:         Portal: 172.16.0.220:3260,-1
Apr 13 16:32:43 user nova-compute[71731]:                 Iface Name: default
Apr 13 16:32:43 user nova-compute[71731]: Target: iqn.2010-10.org.openstack:25c3dc97-c9cb-4529-ab32-26ef7fd94fc6
Apr 13 16:32:43 user nova-compute[71731]:         Portal: 172.16.0.220:3260,-1
Apr 13 16:32:43 user nova-compute[71731]:                 Iface Name: default
Apr 13 16:32:43 user nova-compute[71731]: Target: iqn.2010-10.org.openstack:651ea766-ffda-42a1-9b3c-7be05a92c85f
Apr 13 16:32:43 user nova-compute[71731]:         Portal: 172.16.0.220:3260,-1
Apr 13 16:32:43 user nova-compute[71731]:                 Iface Name: default
Apr 13 16:32:43 user nova-compute[71731]: Target: iqn.2010-10.org.openstack:30806b19-961b-4edd-941a-2ee293795bb1
Apr 13 16:32:43 user nova-compute[71731]:         Portal: 172.16.0.220:3260,-1
Apr 13 16:32:43 user nova-compute[71731]:                 Iface Name: default
Apr 13 16:32:43 user nova-compute[71731]: FIRMWARE:
Apr 13 16:32:43 user nova-compute[71731]: No targets found.
Apr 13 16:32:43 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 16:32:43 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-74626626-d59d-432e-b32a-a449dcbf0ec0 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 16:32:43 user nova-compute[71731]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 16:32:43 user nova-compute[71731]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71731) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 16:32:43 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-74626626-d59d-432e-b32a-a449dcbf0ec0 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:30806b19-961b-4edd-941a-2ee293795bb1', 0)] {{(pid=71731) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 16:32:43 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:32:43 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:32:43 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[9763b846-1825-46e2-b35c-6660e64aee6f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:25c3dc97-c9cb-4529-ab32-26ef7fd94fc6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:30806b19-961b-4edd-941a-2ee293795bb1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:651ea766-ffda-42a1-9b3c-7be05a92c85f\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:32:43 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:32:43 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:32:43 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[90801630-cce6-41ad-98f0-6efbf864a5fa]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25c3dc97-c9cb-4529-ab32-26ef7fd94fc6 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30806b19-961b-4edd-941a-2ee293795bb1 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:651ea766-ffda-42a1-9b3c-7be05a92c85f (non-flash)\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:32:43 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-74626626-d59d-432e-b32a-a449dcbf0ec0 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)
Apr 13 16:32:43 user nova-compute[71731]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25c3dc97-c9cb-4529-ab32-26ef7fd94fc6 (non-flash)
Apr 13 16:32:43 user nova-compute[71731]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30806b19-961b-4edd-941a-2ee293795bb1 (non-flash)
Apr 13 16:32:43 user nova-compute[71731]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:651ea766-ffda-42a1-9b3c-7be05a92c85f (non-flash)
Apr 13 16:32:43 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 16:32:43 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-74626626-d59d-432e-b32a-a449dcbf0ec0 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)
Apr 13 16:32:43 user nova-compute[71731]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25c3dc97-c9cb-4529-ab32-26ef7fd94fc6 (non-flash)
Apr 13 16:32:43 user nova-compute[71731]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30806b19-961b-4edd-941a-2ee293795bb1 (non-flash)
Apr 13 16:32:43 user nova-compute[71731]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:651ea766-ffda-42a1-9b3c-7be05a92c85f (non-flash)
Apr 13 16:32:43 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 16:32:43 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-74626626-d59d-432e-b32a-a449dcbf0ec0 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8cf01e2950>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:30806b19-961b-4edd-941a-2ee293795bb1'): ({'sdb'}, set())}) {{(pid=71731) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 16:32:43 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-74626626-d59d-432e-b32a-a449dcbf0ec0 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Removing single pathed devices sdb {{(pid=71731) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 16:32:43 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:32:43 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:32:43 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d21bc56-3dd2-4581-a980-9e669d7c891f]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:32:43 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:32:43 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:32:43 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9d1a389-bd58-4328-8d52-a8e9293515f9]: (4, ('ok\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:32:43 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-74626626-d59d-432e-b32a-a449dcbf0ec0 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Flushing IO for device /dev/sdb {{(pid=71731) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 16:32:43 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:32:43 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:32:43 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[92dc0071-affb-4207-b54d-75e213a76057]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:32:43 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-74626626-d59d-432e-b32a-a449dcbf0ec0 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71731) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 16:32:43 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:32:43 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.031s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:32:43 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[515ba6bf-3940-4cae-a2ec-a4c5a368bbc6]: (4, ('1', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:32:43 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-74626626-d59d-432e-b32a-a449dcbf0ec0 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71731) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 16:32:43 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-74626626-d59d-432e-b32a-a449dcbf0ec0 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] SCSI volumes sdb have been removed. {{(pid=71731) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 16:32:43 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-74626626-d59d-432e-b32a-a449dcbf0ec0 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:30806b19-961b-4edd-941a-2ee293795bb1')] {{(pid=71731) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 16:32:43 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30806b19-961b-4edd-941a-2ee293795bb1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:32:43 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30806b19-961b-4edd-941a-2ee293795bb1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:32:43 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d5e1d8c-66e6-4b94-b91a-522c46f120f3]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:32:43 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-74626626-d59d-432e-b32a-a449dcbf0ec0 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:32:43 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30806b19-961b-4edd-941a-2ee293795bb1 -p 172.16.0.220:3260 --logout {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:32:43 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30806b19-961b-4edd-941a-2ee293795bb1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:32:43 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[814b4ffa-2c93-41b5-837a-1a4afd0f814f]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:30806b19-961b-4edd-941a-2ee293795bb1, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:30806b19-961b-4edd-941a-2ee293795bb1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:32:43 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-74626626-d59d-432e-b32a-a449dcbf0ec0 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:30806b19-961b-4edd-941a-2ee293795bb1, portal: 172.16.0.220,3260]
Apr 13 16:32:43 user nova-compute[71731]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:30806b19-961b-4edd-941a-2ee293795bb1, portal: 172.16.0.220,3260] successful.
Apr 13 16:32:43 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:32:43 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30806b19-961b-4edd-941a-2ee293795bb1 -p 172.16.0.220:3260 --op delete {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:32:43 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30806b19-961b-4edd-941a-2ee293795bb1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:32:43 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[2698c27f-dfd9-4d8f-bcca-38e0c338039a]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:32:43 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-74626626-d59d-432e-b32a-a449dcbf0ec0 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:32:43 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-74626626-d59d-432e-b32a-a449dcbf0ec0 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.276s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 16:32:43 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-74626626-d59d-432e-b32a-a449dcbf0ec0 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] <== disconnect_volume: return (278ms) None {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 16:32:43 user nova-compute[71731]: DEBUG nova.virt.libvirt.volume.iscsi [None req-74626626-d59d-432e-b32a-a449dcbf0ec0 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] [instance: bf98c3a2-dbeb-4ae4-8423-ce55964c4258] Disconnected iSCSI Volume {{(pid=71731) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 16:32:43 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:32:43 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:32:43 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:32:44 user nova-compute[71731]: DEBUG nova.compute.manager [req-2b8f9e47-b224-452b-adc0-641b351a7afe req-fa89aafa-acd6-46c7-81ff-c937be8a4e21 service nova] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] Received event network-vif-plugged-13471516-9514-4b85-938f-69657c2990e5 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:32:44 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-2b8f9e47-b224-452b-adc0-641b351a7afe req-fa89aafa-acd6-46c7-81ff-c937be8a4e21 service nova] Acquiring lock "acbcaee0-a47b-4fee-8765-9b1c9597d515-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:32:44 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-2b8f9e47-b224-452b-adc0-641b351a7afe req-fa89aafa-acd6-46c7-81ff-c937be8a4e21 service nova] Lock "acbcaee0-a47b-4fee-8765-9b1c9597d515-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:32:44 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-2b8f9e47-b224-452b-adc0-641b351a7afe req-fa89aafa-acd6-46c7-81ff-c937be8a4e21 service nova] Lock "acbcaee0-a47b-4fee-8765-9b1c9597d515-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:32:44 user nova-compute[71731]: DEBUG nova.compute.manager [req-2b8f9e47-b224-452b-adc0-641b351a7afe req-fa89aafa-acd6-46c7-81ff-c937be8a4e21 service nova] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] No waiting events found dispatching network-vif-plugged-13471516-9514-4b85-938f-69657c2990e5 {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:32:44 user nova-compute[71731]: WARNING nova.compute.manager [req-2b8f9e47-b224-452b-adc0-641b351a7afe req-fa89aafa-acd6-46c7-81ff-c937be8a4e21 service nova] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] Received unexpected event network-vif-plugged-13471516-9514-4b85-938f-69657c2990e5 for instance with vm_state active and task_state resize_finish.
Apr 13 16:32:44 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:32:44 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:32:44 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:32:44 user nova-compute[71731]: DEBUG nova.objects.instance [None req-74626626-d59d-432e-b32a-a449dcbf0ec0 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Lazy-loading 'flavor' on Instance uuid bf98c3a2-dbeb-4ae4-8423-ce55964c4258 {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:32:44 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-74626626-d59d-432e-b32a-a449dcbf0ec0 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Lock "bf98c3a2-dbeb-4ae4-8423-ce55964c4258" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.809s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:32:45 user nova-compute[71731]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681403550.7800026, acbcaee0-a47b-4fee-8765-9b1c9597d515 => Stopped> {{(pid=71731) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 16:32:45 user nova-compute[71731]: INFO nova.compute.manager [-] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] VM Stopped (Lifecycle Event)
Apr 13 16:32:45 user nova-compute[71731]: DEBUG nova.compute.manager [None req-010686eb-bc0d-4b8e-a998-7b338decc68b None None] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:32:46 user nova-compute[71731]: DEBUG nova.virt.driver [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Emitting event <LifecycleEvent: 1681403566.0925663, acbcaee0-a47b-4fee-8765-9b1c9597d515 => Resumed> {{(pid=71731) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 16:32:46 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] VM Resumed (Lifecycle Event)
Apr 13 16:32:46 user nova-compute[71731]: DEBUG nova.compute.manager [None req-2c13abc6-6cb9-4d7a-87ae-2dd707a8632a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] Instance event wait completed in 0 seconds for  {{(pid=71731) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 16:32:46 user nova-compute[71731]: INFO nova.virt.libvirt.driver [-] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] Instance running successfully.
Apr 13 16:32:46 user nova-compute[71731]: DEBUG nova.virt.libvirt.guest [None req-2c13abc6-6cb9-4d7a-87ae-2dd707a8632a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] Failed to set time: agent not configured {{(pid=71731) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Apr 13 16:32:46 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-2c13abc6-6cb9-4d7a-87ae-2dd707a8632a tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] finish_migration finished successfully. {{(pid=71731) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11742}}
Apr 13 16:32:46 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:32:46 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=71731) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 16:32:46 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] During sync_power_state the instance has a pending task (resize_finish). Skip.
Apr 13 16:32:46 user nova-compute[71731]: DEBUG nova.virt.driver [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Emitting event <LifecycleEvent: 1681403566.0959635, acbcaee0-a47b-4fee-8765-9b1c9597d515 => Started> {{(pid=71731) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 16:32:46 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] VM Started (Lifecycle Event)
Apr 13 16:32:46 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:32:46 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=71731) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 16:32:46 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] During sync_power_state the instance has a pending task (resize_finish). Skip.
Apr 13 16:32:46 user nova-compute[71731]: DEBUG nova.compute.manager [req-47d19ea1-4195-4ce9-905d-bcfa0000ff8d req-dd618d33-75d8-400f-8def-7b6115918385 service nova] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] Received event network-vif-plugged-13471516-9514-4b85-938f-69657c2990e5 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:32:46 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-47d19ea1-4195-4ce9-905d-bcfa0000ff8d req-dd618d33-75d8-400f-8def-7b6115918385 service nova] Acquiring lock "acbcaee0-a47b-4fee-8765-9b1c9597d515-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:32:46 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-47d19ea1-4195-4ce9-905d-bcfa0000ff8d req-dd618d33-75d8-400f-8def-7b6115918385 service nova] Lock "acbcaee0-a47b-4fee-8765-9b1c9597d515-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:32:46 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-47d19ea1-4195-4ce9-905d-bcfa0000ff8d req-dd618d33-75d8-400f-8def-7b6115918385 service nova] Lock "acbcaee0-a47b-4fee-8765-9b1c9597d515-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:32:46 user nova-compute[71731]: DEBUG nova.compute.manager [req-47d19ea1-4195-4ce9-905d-bcfa0000ff8d req-dd618d33-75d8-400f-8def-7b6115918385 service nova] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] No waiting events found dispatching network-vif-plugged-13471516-9514-4b85-938f-69657c2990e5 {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:32:46 user nova-compute[71731]: WARNING nova.compute.manager [req-47d19ea1-4195-4ce9-905d-bcfa0000ff8d req-dd618d33-75d8-400f-8def-7b6115918385 service nova] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] Received unexpected event network-vif-plugged-13471516-9514-4b85-938f-69657c2990e5 for instance with vm_state active and task_state resize_finish.
Apr 13 16:32:46 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:32:47 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:32:51 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:32:52 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:32:53 user nova-compute[71731]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681403558.1891234, 03200054-c651-4333-acce-3bea3defe22a => Stopped> {{(pid=71731) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 16:32:53 user nova-compute[71731]: INFO nova.compute.manager [-] [instance: 03200054-c651-4333-acce-3bea3defe22a] VM Stopped (Lifecycle Event)
Apr 13 16:32:53 user nova-compute[71731]: DEBUG nova.compute.manager [None req-c3f00d3d-2377-42e4-89a4-3fbbc630f1fc None None] [instance: 03200054-c651-4333-acce-3bea3defe22a] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:32:57 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 16:32:57 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 16:32:57 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71731) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 16:32:57 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71731) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 16:32:57 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71731) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 16:32:57 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:33:01 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:33:02 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:33:06 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:33:07 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:33:11 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:33:12 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:33:13 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:33:15 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager.update_available_resource {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:33:15 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:33:15 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:33:15 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:33:15 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Auditing locally available compute resources for user (node: user) {{(pid=71731) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 16:33:15 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64a9c052-89a9-48ba-80c9-13fb5ef22f0e/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:33:15 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64a9c052-89a9-48ba-80c9-13fb5ef22f0e/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:33:15 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64a9c052-89a9-48ba-80c9-13fb5ef22f0e/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:33:15 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64a9c052-89a9-48ba-80c9-13fb5ef22f0e/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:33:15 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35b23303-e373-4f35-b7ee-76e6815073ce/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:33:15 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35b23303-e373-4f35-b7ee-76e6815073ce/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:33:15 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35b23303-e373-4f35-b7ee-76e6815073ce/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:33:15 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35b23303-e373-4f35-b7ee-76e6815073ce/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:33:15 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acbcaee0-a47b-4fee-8765-9b1c9597d515/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:33:16 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acbcaee0-a47b-4fee-8765-9b1c9597d515/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:33:16 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acbcaee0-a47b-4fee-8765-9b1c9597d515/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:33:16 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acbcaee0-a47b-4fee-8765-9b1c9597d515/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:33:16 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=71731) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 16:33:16 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66553f5-5e1b-4f1d-8c5a-63bc340f7586/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:33:16 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66553f5-5e1b-4f1d-8c5a-63bc340f7586/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:33:16 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66553f5-5e1b-4f1d-8c5a-63bc340f7586/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:33:16 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66553f5-5e1b-4f1d-8c5a-63bc340f7586/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:33:16 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eaae47b9-a059-49f6-9ae6-d7147003e2f2/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:33:16 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eaae47b9-a059-49f6-9ae6-d7147003e2f2/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:33:16 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eaae47b9-a059-49f6-9ae6-d7147003e2f2/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:33:16 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eaae47b9-a059-49f6-9ae6-d7147003e2f2/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:33:16 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71731) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 16:33:16 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf98c3a2-dbeb-4ae4-8423-ce55964c4258/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:33:16 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf98c3a2-dbeb-4ae4-8423-ce55964c4258/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:33:16 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf98c3a2-dbeb-4ae4-8423-ce55964c4258/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:33:17 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf98c3a2-dbeb-4ae4-8423-ce55964c4258/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:33:17 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/650427bd-4dad-4bcd-922d-c17e60b36807/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:33:17 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/650427bd-4dad-4bcd-922d-c17e60b36807/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:33:17 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/650427bd-4dad-4bcd-922d-c17e60b36807/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:33:17 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/650427bd-4dad-4bcd-922d-c17e60b36807/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:33:17 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32b18558-8bf2-4def-bc70-81c4e38fcc6f/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:33:17 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:33:17 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32b18558-8bf2-4def-bc70-81c4e38fcc6f/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:33:17 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32b18558-8bf2-4def-bc70-81c4e38fcc6f/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:33:17 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32b18558-8bf2-4def-bc70-81c4e38fcc6f/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:33:17 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=71731) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 16:33:18 user nova-compute[71731]: WARNING nova.virt.libvirt.driver [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 16:33:18 user nova-compute[71731]: WARNING nova.virt.libvirt.driver [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 16:33:18 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Hypervisor/Node resource view: name=user free_ram=7630MB free_disk=26.02114486694336GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71731) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 16:33:18 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:33:18 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:33:18 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Applying migration context for instance acbcaee0-a47b-4fee-8765-9b1c9597d515 as it has an incoming, in-progress migration f95a8bc3-801a-4447-b4ea-330328feac3a. Migration status is finished {{(pid=71731) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:950}}
Apr 13 16:33:18 user nova-compute[71731]: INFO nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] Updating resource usage from migration f95a8bc3-801a-4447-b4ea-330328feac3a
Apr 13 16:33:18 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance f66553f5-5e1b-4f1d-8c5a-63bc340f7586 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 16:33:18 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance 235f827c-7116-48e9-84c5-0c9761c18e1e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 16:33:18 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance eaae47b9-a059-49f6-9ae6-d7147003e2f2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 16:33:18 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance bf98c3a2-dbeb-4ae4-8423-ce55964c4258 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 16:33:18 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance 32b18558-8bf2-4def-bc70-81c4e38fcc6f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 16:33:18 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance 650427bd-4dad-4bcd-922d-c17e60b36807 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 16:33:18 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance 2956ab05-28ff-4c9e-b646-dbb83b3db278 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 16:33:18 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance 64a9c052-89a9-48ba-80c9-13fb5ef22f0e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 16:33:18 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance 35b23303-e373-4f35-b7ee-76e6815073ce actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 16:33:18 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Migration f95a8bc3-801a-4447-b4ea-330328feac3a is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 128, 'DISK_GB': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1637}}
Apr 13 16:33:18 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance acbcaee0-a47b-4fee-8765-9b1c9597d515 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 16:33:18 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=71731) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 16:33:18 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Final resource view: name=user phys_ram=16023MB used_ram=1984MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=71731) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 16:33:18 user nova-compute[71731]: DEBUG nova.compute.provider_tree [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Inventory has not changed in ProviderTree for provider: cb6b1a64-0c24-4e2d-af1e-16576ca9165c {{(pid=71731) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 16:33:18 user nova-compute[71731]: DEBUG nova.scheduler.client.report [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Inventory has not changed for provider cb6b1a64-0c24-4e2d-af1e-16576ca9165c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71731) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 16:33:18 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Compute_service record updated for user:user {{(pid=71731) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 16:33:18 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.532s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:33:19 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:33:19 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Starting heal instance info cache {{(pid=71731) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 16:33:19 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Acquiring lock "refresh_cache-235f827c-7116-48e9-84c5-0c9761c18e1e" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 16:33:19 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Acquired lock "refresh_cache-235f827c-7116-48e9-84c5-0c9761c18e1e" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 16:33:19 user nova-compute[71731]: DEBUG nova.network.neutron [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] [instance: 235f827c-7116-48e9-84c5-0c9761c18e1e] Forcefully refreshing network info cache for instance {{(pid=71731) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 16:33:20 user nova-compute[71731]: DEBUG nova.network.neutron [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] [instance: 235f827c-7116-48e9-84c5-0c9761c18e1e] Updating instance_info_cache with network_info: [{"id": "b72a6c8b-7244-41c2-a4f7-6da43b4944b8", "address": "fa:16:3e:e3:62:b0", "network": {"id": "5a7877ff-8230-470b-90b5-e5dcfc8f0cee", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-779403873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2d09a74bf684a9fb1dd1e95d6c23f3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb72a6c8b-72", "ovs_interfaceid": "b72a6c8b-7244-41c2-a4f7-6da43b4944b8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:33:20 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Releasing lock "refresh_cache-235f827c-7116-48e9-84c5-0c9761c18e1e" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 16:33:20 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] [instance: 235f827c-7116-48e9-84c5-0c9761c18e1e] Updated the network info_cache for instance {{(pid=71731) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 16:33:20 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:33:20 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:33:20 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:33:20 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:33:20 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71731) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 16:33:21 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:33:22 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:33:22 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:33:24 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:33:26 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:33:27 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:33:28 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-c59af704-0b42-4249-a4ee-aacbbd4b64ce tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Acquiring lock "220e1c3e-1378-46fc-acc1-ee1bafac7722" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:33:28 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-c59af704-0b42-4249-a4ee-aacbbd4b64ce tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "220e1c3e-1378-46fc-acc1-ee1bafac7722" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:33:28 user nova-compute[71731]: DEBUG nova.compute.manager [None req-c59af704-0b42-4249-a4ee-aacbbd4b64ce tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 220e1c3e-1378-46fc-acc1-ee1bafac7722] Starting instance... {{(pid=71731) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 16:33:28 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-c59af704-0b42-4249-a4ee-aacbbd4b64ce tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:33:28 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-c59af704-0b42-4249-a4ee-aacbbd4b64ce tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:33:28 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-c59af704-0b42-4249-a4ee-aacbbd4b64ce tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71731) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 16:33:28 user nova-compute[71731]: INFO nova.compute.claims [None req-c59af704-0b42-4249-a4ee-aacbbd4b64ce tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 220e1c3e-1378-46fc-acc1-ee1bafac7722] Claim successful on node user
Apr 13 16:33:29 user nova-compute[71731]: DEBUG nova.compute.provider_tree [None req-c59af704-0b42-4249-a4ee-aacbbd4b64ce tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Inventory has not changed in ProviderTree for provider: cb6b1a64-0c24-4e2d-af1e-16576ca9165c {{(pid=71731) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 16:33:29 user nova-compute[71731]: DEBUG nova.scheduler.client.report [None req-c59af704-0b42-4249-a4ee-aacbbd4b64ce tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Inventory has not changed for provider cb6b1a64-0c24-4e2d-af1e-16576ca9165c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71731) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 16:33:29 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-c59af704-0b42-4249-a4ee-aacbbd4b64ce tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.476s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:33:29 user nova-compute[71731]: DEBUG nova.compute.manager [None req-c59af704-0b42-4249-a4ee-aacbbd4b64ce tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 220e1c3e-1378-46fc-acc1-ee1bafac7722] Start building networks asynchronously for instance. {{(pid=71731) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 16:33:29 user nova-compute[71731]: DEBUG nova.compute.manager [None req-c59af704-0b42-4249-a4ee-aacbbd4b64ce tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 220e1c3e-1378-46fc-acc1-ee1bafac7722] Allocating IP information in the background. {{(pid=71731) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 16:33:29 user nova-compute[71731]: DEBUG nova.network.neutron [None req-c59af704-0b42-4249-a4ee-aacbbd4b64ce tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 220e1c3e-1378-46fc-acc1-ee1bafac7722] allocate_for_instance() {{(pid=71731) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 16:33:29 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-c59af704-0b42-4249-a4ee-aacbbd4b64ce tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 220e1c3e-1378-46fc-acc1-ee1bafac7722] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 16:33:29 user nova-compute[71731]: DEBUG nova.compute.manager [None req-c59af704-0b42-4249-a4ee-aacbbd4b64ce tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 220e1c3e-1378-46fc-acc1-ee1bafac7722] Start building block device mappings for instance. {{(pid=71731) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 16:33:29 user nova-compute[71731]: INFO nova.virt.block_device [None req-c59af704-0b42-4249-a4ee-aacbbd4b64ce tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 220e1c3e-1378-46fc-acc1-ee1bafac7722] Booting with volume c2088266-1d33-4bb1-ac5b-1de832ff7985 at /dev/vda
Apr 13 16:33:29 user nova-compute[71731]: DEBUG nova.policy [None req-c59af704-0b42-4249-a4ee-aacbbd4b64ce tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd70e10f63cdd49a9a1ebe1fe4c9de0a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d451e0e239f486aa2b3abe9e273eab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71731) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 16:33:29 user nova-compute[71731]: DEBUG os_brick.utils [None req-c59af704-0b42-4249-a4ee-aacbbd4b64ce tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 16:33:29 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:33:29 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:33:29 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ee406f1-a380-47a0-8c94-d709785062fc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:81501d91421\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:33:29 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:33:29 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:33:29 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[84e69311-35cc-49e0-84ad-324bfb7c8a81]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:33:29 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:33:29 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:33:29 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[a790c958-5b32-4f1c-ba3d-362194f89bba]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:33:29 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[81739504-f549-460f-a15a-c1f9398cd1b7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:33:29 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-c59af704-0b42-4249-a4ee-aacbbd4b64ce tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Running cmd (subprocess): nvme version {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:33:29 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-c59af704-0b42-4249-a4ee-aacbbd4b64ce tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] 'nvme version' failed. Not Retrying. {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 16:33:29 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c59af704-0b42-4249-a4ee-aacbbd4b64ce tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] nvme not present on system {{(pid=71731) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 16:33:29 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:33:29 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 16:33:29 user nova-compute[71731]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 16:33:29 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[f71ccd07-54b5-45b2-9f14-f62e8a199f9d]: (4, '') {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:33:29 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.lightos [None req-c59af704-0b42-4249-a4ee-aacbbd4b64ce tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71731) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 16:33:29 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.lightos [None req-c59af704-0b42-4249-a4ee-aacbbd4b64ce tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71731) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 16:33:29 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.lightos [None req-c59af704-0b42-4249-a4ee-aacbbd4b64ce tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] LIGHTOS: no hostnqn found. {{(pid=71731) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 16:33:29 user nova-compute[71731]: DEBUG os_brick.utils [None req-c59af704-0b42-4249-a4ee-aacbbd4b64ce tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] <== get_connector_properties: return (144ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:81501d91421', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 16:33:29 user nova-compute[71731]: DEBUG nova.virt.block_device [None req-c59af704-0b42-4249-a4ee-aacbbd4b64ce tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 220e1c3e-1378-46fc-acc1-ee1bafac7722] Updating existing volume attachment record: 21d79244-c062-4ab5-bc05-a04c132975e3 {{(pid=71731) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 16:33:30 user nova-compute[71731]: DEBUG nova.network.neutron [None req-c59af704-0b42-4249-a4ee-aacbbd4b64ce tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 220e1c3e-1378-46fc-acc1-ee1bafac7722] Successfully created port: 96415b19-4e1b-41c6-a070-cff24e7b20ab {{(pid=71731) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 16:33:30 user nova-compute[71731]: DEBUG nova.network.neutron [None req-c59af704-0b42-4249-a4ee-aacbbd4b64ce tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 220e1c3e-1378-46fc-acc1-ee1bafac7722] Successfully updated port: 96415b19-4e1b-41c6-a070-cff24e7b20ab {{(pid=71731) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 16:33:30 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-c59af704-0b42-4249-a4ee-aacbbd4b64ce tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Acquiring lock "refresh_cache-220e1c3e-1378-46fc-acc1-ee1bafac7722" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 16:33:30 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-c59af704-0b42-4249-a4ee-aacbbd4b64ce tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Acquired lock "refresh_cache-220e1c3e-1378-46fc-acc1-ee1bafac7722" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 16:33:30 user nova-compute[71731]: DEBUG nova.network.neutron [None req-c59af704-0b42-4249-a4ee-aacbbd4b64ce tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 220e1c3e-1378-46fc-acc1-ee1bafac7722] Building network info cache for instance {{(pid=71731) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 16:33:30 user nova-compute[71731]: DEBUG nova.compute.manager [req-5269aa61-bd51-4e85-a281-ff5243f6d7af req-5cca74f5-dd25-4224-b3d1-fa2f6129c6ba service nova] [instance: 220e1c3e-1378-46fc-acc1-ee1bafac7722] Received event network-changed-96415b19-4e1b-41c6-a070-cff24e7b20ab {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:33:30 user nova-compute[71731]: DEBUG nova.compute.manager [req-5269aa61-bd51-4e85-a281-ff5243f6d7af req-5cca74f5-dd25-4224-b3d1-fa2f6129c6ba service nova] [instance: 220e1c3e-1378-46fc-acc1-ee1bafac7722] Refreshing instance network info cache due to event network-changed-96415b19-4e1b-41c6-a070-cff24e7b20ab. {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 16:33:30 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-5269aa61-bd51-4e85-a281-ff5243f6d7af req-5cca74f5-dd25-4224-b3d1-fa2f6129c6ba service nova] Acquiring lock "refresh_cache-220e1c3e-1378-46fc-acc1-ee1bafac7722" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 16:33:30 user nova-compute[71731]: DEBUG nova.network.neutron [None req-c59af704-0b42-4249-a4ee-aacbbd4b64ce tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 220e1c3e-1378-46fc-acc1-ee1bafac7722] Instance cache missing network info. {{(pid=71731) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 16:33:31 user nova-compute[71731]: DEBUG nova.network.neutron [None req-c59af704-0b42-4249-a4ee-aacbbd4b64ce tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 220e1c3e-1378-46fc-acc1-ee1bafac7722] Updating instance_info_cache with network_info: [{"id": "96415b19-4e1b-41c6-a070-cff24e7b20ab", "address": "fa:16:3e:c0:2c:aa", "network": {"id": "d36bc206-f629-4d6e-8a3f-458061d7b525", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-893271134-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d451e0e239f486aa2b3abe9e273eab3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96415b19-4e", "ovs_interfaceid": "96415b19-4e1b-41c6-a070-cff24e7b20ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:33:31 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-c59af704-0b42-4249-a4ee-aacbbd4b64ce tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Releasing lock "refresh_cache-220e1c3e-1378-46fc-acc1-ee1bafac7722" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 16:33:31 user nova-compute[71731]: DEBUG nova.compute.manager [None req-c59af704-0b42-4249-a4ee-aacbbd4b64ce tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 220e1c3e-1378-46fc-acc1-ee1bafac7722] Instance network_info: |[{"id": "96415b19-4e1b-41c6-a070-cff24e7b20ab", "address": "fa:16:3e:c0:2c:aa", "network": {"id": "d36bc206-f629-4d6e-8a3f-458061d7b525", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-893271134-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d451e0e239f486aa2b3abe9e273eab3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96415b19-4e", "ovs_interfaceid": "96415b19-4e1b-41c6-a070-cff24e7b20ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71731) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 16:33:31 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-5269aa61-bd51-4e85-a281-ff5243f6d7af req-5cca74f5-dd25-4224-b3d1-fa2f6129c6ba service nova] Acquired lock "refresh_cache-220e1c3e-1378-46fc-acc1-ee1bafac7722" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 16:33:31 user nova-compute[71731]: DEBUG nova.network.neutron [req-5269aa61-bd51-4e85-a281-ff5243f6d7af req-5cca74f5-dd25-4224-b3d1-fa2f6129c6ba service nova] [instance: 220e1c3e-1378-46fc-acc1-ee1bafac7722] Refreshing network info cache for port 96415b19-4e1b-41c6-a070-cff24e7b20ab {{(pid=71731) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 16:33:32 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 16:33:32 user nova-compute[71731]: DEBUG nova.network.neutron [req-5269aa61-bd51-4e85-a281-ff5243f6d7af req-5cca74f5-dd25-4224-b3d1-fa2f6129c6ba service nova] [instance: 220e1c3e-1378-46fc-acc1-ee1bafac7722] Updated VIF entry in instance network info cache for port 96415b19-4e1b-41c6-a070-cff24e7b20ab. {{(pid=71731) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 16:33:32 user nova-compute[71731]: DEBUG nova.network.neutron [req-5269aa61-bd51-4e85-a281-ff5243f6d7af req-5cca74f5-dd25-4224-b3d1-fa2f6129c6ba service nova] [instance: 220e1c3e-1378-46fc-acc1-ee1bafac7722] Updating instance_info_cache with network_info: [{"id": "96415b19-4e1b-41c6-a070-cff24e7b20ab", "address": "fa:16:3e:c0:2c:aa", "network": {"id": "d36bc206-f629-4d6e-8a3f-458061d7b525", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-893271134-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d451e0e239f486aa2b3abe9e273eab3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96415b19-4e", "ovs_interfaceid": "96415b19-4e1b-41c6-a070-cff24e7b20ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:33:32 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-5269aa61-bd51-4e85-a281-ff5243f6d7af req-5cca74f5-dd25-4224-b3d1-fa2f6129c6ba service nova] Releasing lock "refresh_cache-220e1c3e-1378-46fc-acc1-ee1bafac7722" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 16:33:34 user nova-compute[71731]: DEBUG nova.compute.manager [None req-c59af704-0b42-4249-a4ee-aacbbd4b64ce tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 220e1c3e-1378-46fc-acc1-ee1bafac7722] Start spawning the instance on the hypervisor. {{(pid=71731) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 16:33:34 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-c59af704-0b42-4249-a4ee-aacbbd4b64ce tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 220e1c3e-1378-46fc-acc1-ee1bafac7722] Creating instance directory {{(pid=71731) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 16:33:34 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-c59af704-0b42-4249-a4ee-aacbbd4b64ce tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 220e1c3e-1378-46fc-acc1-ee1bafac7722] Creating image(s)
Apr 13 16:33:34 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-c59af704-0b42-4249-a4ee-aacbbd4b64ce tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 220e1c3e-1378-46fc-acc1-ee1bafac7722] Did not create local disks {{(pid=71731) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 13 16:33:34 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-c59af704-0b42-4249-a4ee-aacbbd4b64ce tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 220e1c3e-1378-46fc-acc1-ee1bafac7722] Ensure instance console log exists: /opt/stack/data/nova/instances/220e1c3e-1378-46fc-acc1-ee1bafac7722/console.log {{(pid=71731) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 16:33:34 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-c59af704-0b42-4249-a4ee-aacbbd4b64ce tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:33:34 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-c59af704-0b42-4249-a4ee-aacbbd4b64ce tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:33:34 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-c59af704-0b42-4249-a4ee-aacbbd4b64ce tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:33:34 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-c59af704-0b42-4249-a4ee-aacbbd4b64ce tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 220e1c3e-1378-46fc-acc1-ee1bafac7722] Start _get_guest_xml network_info=[{"id": "96415b19-4e1b-41c6-a070-cff24e7b20ab", "address": "fa:16:3e:c0:2c:aa", "network": {"id": "d36bc206-f629-4d6e-8a3f-458061d7b525", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-893271134-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d451e0e239f486aa2b3abe9e273eab3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96415b19-4e", "ovs_interfaceid": "96415b19-4e1b-41c6-a070-cff24e7b20ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'attachment_id': '21d79244-c062-4ab5-bc05-a04c132975e3', 'mount_device': '/dev/vda', 'delete_on_termination': False, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c2088266-1d33-4bb1-ac5b-1de832ff7985', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mePtryhb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '220e1c3e-1378-46fc-acc1-ee1bafac7722', 'attached_at': '', 'detached_at': '', 'volume_id': 'c2088266-1d33-4bb1-ac5b-1de832ff7985', 'serial': 'c2088266-1d33-4bb1-ac5b-1de832ff7985'}, 'disk_bus': 'virtio', 'guest_format': None, 'volume_type': None} {{(pid=71731) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 16:33:34 user nova-compute[71731]: WARNING nova.virt.libvirt.driver [None req-c59af704-0b42-4249-a4ee-aacbbd4b64ce tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 16:33:34 user nova-compute[71731]: WARNING nova.virt.libvirt.driver [None req-c59af704-0b42-4249-a4ee-aacbbd4b64ce tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 16:33:34 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-c59af704-0b42-4249-a4ee-aacbbd4b64ce tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71731) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 16:33:34 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-c59af704-0b42-4249-a4ee-aacbbd4b64ce tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T16:17:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 16:33:34 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-c59af704-0b42-4249-a4ee-aacbbd4b64ce tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Flavor limits 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 16:33:34 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-c59af704-0b42-4249-a4ee-aacbbd4b64ce tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Image limits 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 16:33:34 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-c59af704-0b42-4249-a4ee-aacbbd4b64ce tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Flavor pref 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 16:33:34 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-c59af704-0b42-4249-a4ee-aacbbd4b64ce tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Image pref 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 16:33:34 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-c59af704-0b42-4249-a4ee-aacbbd4b64ce tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 16:33:34 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-c59af704-0b42-4249-a4ee-aacbbd4b64ce tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 16:33:34 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-c59af704-0b42-4249-a4ee-aacbbd4b64ce tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71731) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 16:33:34 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-c59af704-0b42-4249-a4ee-aacbbd4b64ce tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Got 1 possible topologies {{(pid=71731) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 16:33:34 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-c59af704-0b42-4249-a4ee-aacbbd4b64ce tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 16:33:34 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-c59af704-0b42-4249-a4ee-aacbbd4b64ce tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 16:33:34 user nova-compute[71731]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c59af704-0b42-4249-a4ee-aacbbd4b64ce tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 220e1c3e-1378-46fc-acc1-ee1bafac7722] Calling os-brick to attach iSCSI Volume {{(pid=71731) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 16:33:34 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-c59af704-0b42-4249-a4ee-aacbbd4b64ce tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8cf0118790>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c2088266-1d33-4bb1-ac5b-1de832ff7985', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mePtryhb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 16:33:34 user nova-compute[71731]: WARNING os_brick.initiator.connectors.base [None req-c59af704-0b42-4249-a4ee-aacbbd4b64ce tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 16:33:34 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-c59af704-0b42-4249-a4ee-aacbbd4b64ce tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 16:33:34 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-c59af704-0b42-4249-a4ee-aacbbd4b64ce tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 16:33:34 user nova-compute[71731]: WARNING os_brick.initiator.connectors.base [None req-c59af704-0b42-4249-a4ee-aacbbd4b64ce tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 16:33:34 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-c59af704-0b42-4249-a4ee-aacbbd4b64ce tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c2088266-1d33-4bb1-ac5b-1de832ff7985" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 16:33:34 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-c59af704-0b42-4249-a4ee-aacbbd4b64ce tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c2088266-1d33-4bb1-ac5b-1de832ff7985" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 16:33:34 user nova-compute[71731]: INFO os_brick.initiator.connectors.iscsi [None req-c59af704-0b42-4249-a4ee-aacbbd4b64ce tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 16:33:34 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2088266-1d33-4bb1-ac5b-1de832ff7985 -p 172.16.0.220:3260 {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:33:34 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2088266-1d33-4bb1-ac5b-1de832ff7985 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:33:34 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[b096dabe-8d1b-4d79-ab24-b7ad9ee61a50]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:33:34 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-c59af704-0b42-4249-a4ee-aacbbd4b64ce tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 16:33:34 user nova-compute[71731]:  {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:33:34 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2088266-1d33-4bb1-ac5b-1de832ff7985 -p 172.16.0.220:3260 --interface default --op new {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:33:34 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2088266-1d33-4bb1-ac5b-1de832ff7985 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:33:34 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[d106d186-14c2-420e-8300-292676294a3e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c2088266-1d33-4bb1-ac5b-1de832ff7985] added\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:33:34 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-c59af704-0b42-4249-a4ee-aacbbd4b64ce tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c2088266-1d33-4bb1-ac5b-1de832ff7985] added
Apr 13 16:33:34 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:33:34 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2088266-1d33-4bb1-ac5b-1de832ff7985 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:33:34 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2088266-1d33-4bb1-ac5b-1de832ff7985 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:33:34 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[46184057-9303-40ed-91a2-7866a24c7344]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:33:34 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-c59af704-0b42-4249-a4ee-aacbbd4b64ce tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:33:34 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2088266-1d33-4bb1-ac5b-1de832ff7985 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:33:34 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2088266-1d33-4bb1-ac5b-1de832ff7985 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:33:34 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[56d58c60-bacb-4c20-8b4b-90a49fd83250]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:33:34 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-c59af704-0b42-4249-a4ee-aacbbd4b64ce tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:33:34 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2088266-1d33-4bb1-ac5b-1de832ff7985 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mePtryhb {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:33:34 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2088266-1d33-4bb1-ac5b-1de832ff7985 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mePtryhb" returned: 0 in 0.022s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:33:34 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[71d95aa8-e7ff-4cd5-a87a-083896b21fe2]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:33:34 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-c59af704-0b42-4249-a4ee-aacbbd4b64ce tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mePtryhb'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:33:34 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2088266-1d33-4bb1-ac5b-1de832ff7985 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:33:34 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2088266-1d33-4bb1-ac5b-1de832ff7985 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.132s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:33:34 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[8819d30a-cab0-4bfb-9dd7-1e33a006ce4d]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:33:34 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-c59af704-0b42-4249-a4ee-aacbbd4b64ce tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:33:34 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:33:34 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:33:34 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ec3ad57-c142-424d-b399-e906b18a2538]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25c3dc97-c9cb-4529-ab32-26ef7fd94fc6 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:651ea766-ffda-42a1-9b3c-7be05a92c85f (non-flash)\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:33:34 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-c59af704-0b42-4249-a4ee-aacbbd4b64ce tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)
Apr 13 16:33:34 user nova-compute[71731]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25c3dc97-c9cb-4529-ab32-26ef7fd94fc6 (non-flash)
Apr 13 16:33:34 user nova-compute[71731]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:651ea766-ffda-42a1-9b3c-7be05a92c85f (non-flash)
Apr 13 16:33:34 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 16:33:34 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-c59af704-0b42-4249-a4ee-aacbbd4b64ce tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)
Apr 13 16:33:34 user nova-compute[71731]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25c3dc97-c9cb-4529-ab32-26ef7fd94fc6 (non-flash)
Apr 13 16:33:34 user nova-compute[71731]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:651ea766-ffda-42a1-9b3c-7be05a92c85f (non-flash)
Apr 13 16:33:34 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 16:33:34 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2088266-1d33-4bb1-ac5b-1de832ff7985 -p 172.16.0.220:3260 --login {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:33:34 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2088266-1d33-4bb1-ac5b-1de832ff7985 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:33:34 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[d56a64bf-3b86-4878-9d42-e45edff62b77]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c2088266-1d33-4bb1-ac5b-1de832ff7985, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c2088266-1d33-4bb1-ac5b-1de832ff7985, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:33:34 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-c59af704-0b42-4249-a4ee-aacbbd4b64ce tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c2088266-1d33-4bb1-ac5b-1de832ff7985, portal: 172.16.0.220,3260]
Apr 13 16:33:34 user nova-compute[71731]: Login to [iface: default, target: iqn.2010-10.org.openstack:c2088266-1d33-4bb1-ac5b-1de832ff7985, portal: 172.16.0.220,3260] successful.
Apr 13 16:33:34 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:33:34 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2088266-1d33-4bb1-ac5b-1de832ff7985 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:33:34 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2088266-1d33-4bb1-ac5b-1de832ff7985 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:33:34 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[34874872-2c9f-47b9-b7e9-8e18aa57801e]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:33:34 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-c59af704-0b42-4249-a4ee-aacbbd4b64ce tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:33:34 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:33:34 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:33:34 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[acb34297-880e-416d-9aa0-b2a03ca3d1ec]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25c3dc97-c9cb-4529-ab32-26ef7fd94fc6 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:651ea766-ffda-42a1-9b3c-7be05a92c85f (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2088266-1d33-4bb1-ac5b-1de832ff7985 (non-flash)\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:33:34 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-c59af704-0b42-4249-a4ee-aacbbd4b64ce tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)
Apr 13 16:33:34 user nova-compute[71731]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25c3dc97-c9cb-4529-ab32-26ef7fd94fc6 (non-flash)
Apr 13 16:33:34 user nova-compute[71731]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:651ea766-ffda-42a1-9b3c-7be05a92c85f (non-flash)
Apr 13 16:33:34 user nova-compute[71731]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2088266-1d33-4bb1-ac5b-1de832ff7985 (non-flash)
Apr 13 16:33:34 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 16:33:34 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-c59af704-0b42-4249-a4ee-aacbbd4b64ce tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)
Apr 13 16:33:34 user nova-compute[71731]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25c3dc97-c9cb-4529-ab32-26ef7fd94fc6 (non-flash)
Apr 13 16:33:34 user nova-compute[71731]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:651ea766-ffda-42a1-9b3c-7be05a92c85f (non-flash)
Apr 13 16:33:34 user nova-compute[71731]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2088266-1d33-4bb1-ac5b-1de832ff7985 (non-flash)
Apr 13 16:33:34 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 16:33:34 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-c59af704-0b42-4249-a4ee-aacbbd4b64ce tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c2088266-1d33-4bb1-ac5b-1de832ff7985" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.399s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 16:33:34 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-c59af704-0b42-4249-a4ee-aacbbd4b64ce tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Connected to 172.16.0.220:3260 {{(pid=71731) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 16:33:34 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-c59af704-0b42-4249-a4ee-aacbbd4b64ce tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] HCTL ('33', '-', '-', 0) found on session 36 with lun 0 {{(pid=71731) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 16:33:34 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-c59af704-0b42-4249-a4ee-aacbbd4b64ce tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71731) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 16:33:34 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:33:34 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.023s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:33:34 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[36593e05-0e21-4cc0-b8e8-770e66afe6bb]: (4, ('- - 0', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:33:34 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-c59af704-0b42-4249-a4ee-aacbbd4b64ce tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Searching for a device in session 36 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71731) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 16:33:34 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-c59af704-0b42-4249-a4ee-aacbbd4b64ce tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:c2088266-1d33-4bb1-ac5b-1de832ff7985', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mePtryhb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71731) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 16:33:35 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-c59af704-0b42-4249-a4ee-aacbbd4b64ce tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.440s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 16:33:35 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-c59af704-0b42-4249-a4ee-aacbbd4b64ce tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] <== connect_volume: return (1441ms) {'type': 'block', 'scsi_wwn': '23137643431323836', 'path': '/dev/sdb'} {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 16:33:35 user nova-compute[71731]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c59af704-0b42-4249-a4ee-aacbbd4b64ce tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 220e1c3e-1378-46fc-acc1-ee1bafac7722] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23137643431323836', 'path': '/dev/sdb'} {{(pid=71731) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 16:33:35 user nova-compute[71731]: DEBUG nova.virt.libvirt.vif [None req-c59af704-0b42-4249-a4ee-aacbbd4b64ce tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T16:33:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-811215132',display_name='tempest-TestVolumeBootPattern-server-811215132',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-811215132',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIspJuW0ouAVIXdRkaEFP67MIl/YPuQkC9G3HjohNK4Y6ERboR/Jfb2q58aDhzUN+56TLqbLCfdFh2NtWLgvjHOwe+zpPoSYOKAkWLX+NSuU860pg4Djj9vwVgJj/Bkydw==',key_name='tempest-TestVolumeBootPattern-1747083001',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8d451e0e239f486aa2b3abe9e273eab3',ramdisk_id='',reservation_id='r-8mcq0v5v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-438786227',owner_user_name='tempest-TestVolumeBootPattern-438786227-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T16:33:29Z,user_data=None,user_id='d70e10f63cdd49a9a1ebe1fe4c9de0a2',uuid=220e1c3e-1378-46fc-acc1-ee1bafac7722,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "96415b19-4e1b-41c6-a070-cff24e7b20ab", "address": "fa:16:3e:c0:2c:aa", "network": {"id": "d36bc206-f629-4d6e-8a3f-458061d7b525", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-893271134-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d451e0e239f486aa2b3abe9e273eab3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96415b19-4e", "ovs_interfaceid": "96415b19-4e1b-41c6-a070-cff24e7b20ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71731) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 16:33:35 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-c59af704-0b42-4249-a4ee-aacbbd4b64ce tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Converting VIF {"id": "96415b19-4e1b-41c6-a070-cff24e7b20ab", "address": "fa:16:3e:c0:2c:aa", "network": {"id": "d36bc206-f629-4d6e-8a3f-458061d7b525", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-893271134-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d451e0e239f486aa2b3abe9e273eab3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96415b19-4e", "ovs_interfaceid": "96415b19-4e1b-41c6-a070-cff24e7b20ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 16:33:35 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-c59af704-0b42-4249-a4ee-aacbbd4b64ce tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c0:2c:aa,bridge_name='br-int',has_traffic_filtering=True,id=96415b19-4e1b-41c6-a070-cff24e7b20ab,network=Network(d36bc206-f629-4d6e-8a3f-458061d7b525),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96415b19-4e') {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 16:33:35 user nova-compute[71731]: DEBUG nova.objects.instance [None req-c59af704-0b42-4249-a4ee-aacbbd4b64ce tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lazy-loading 'pci_devices' on Instance uuid 220e1c3e-1378-46fc-acc1-ee1bafac7722 {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:33:35 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-c59af704-0b42-4249-a4ee-aacbbd4b64ce tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 220e1c3e-1378-46fc-acc1-ee1bafac7722] End _get_guest_xml xml=<domain type="kvm">
Apr 13 16:33:35 user nova-compute[71731]:   <uuid>220e1c3e-1378-46fc-acc1-ee1bafac7722</uuid>
Apr 13 16:33:35 user nova-compute[71731]:   <name>instance-0000001e</name>
Apr 13 16:33:35 user nova-compute[71731]:   <memory>131072</memory>
Apr 13 16:33:35 user nova-compute[71731]:   <vcpu>1</vcpu>
Apr 13 16:33:35 user nova-compute[71731]:   <metadata>
Apr 13 16:33:35 user nova-compute[71731]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 16:33:35 user nova-compute[71731]:       <nova:package version="0.0.0"/>
Apr 13 16:33:35 user nova-compute[71731]:       <nova:name>tempest-TestVolumeBootPattern-server-811215132</nova:name>
Apr 13 16:33:35 user nova-compute[71731]:       <nova:creationTime>2023-04-13 16:33:34</nova:creationTime>
Apr 13 16:33:35 user nova-compute[71731]:       <nova:flavor name="m1.nano">
Apr 13 16:33:35 user nova-compute[71731]:         <nova:memory>128</nova:memory>
Apr 13 16:33:35 user nova-compute[71731]:         <nova:disk>1</nova:disk>
Apr 13 16:33:35 user nova-compute[71731]:         <nova:swap>0</nova:swap>
Apr 13 16:33:35 user nova-compute[71731]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 16:33:35 user nova-compute[71731]:         <nova:vcpus>1</nova:vcpus>
Apr 13 16:33:35 user nova-compute[71731]:       </nova:flavor>
Apr 13 16:33:35 user nova-compute[71731]:       <nova:owner>
Apr 13 16:33:35 user nova-compute[71731]:         <nova:user uuid="d70e10f63cdd49a9a1ebe1fe4c9de0a2">tempest-TestVolumeBootPattern-438786227-project-member</nova:user>
Apr 13 16:33:35 user nova-compute[71731]:         <nova:project uuid="8d451e0e239f486aa2b3abe9e273eab3">tempest-TestVolumeBootPattern-438786227</nova:project>
Apr 13 16:33:35 user nova-compute[71731]:       </nova:owner>
Apr 13 16:33:35 user nova-compute[71731]:       <nova:ports>
Apr 13 16:33:35 user nova-compute[71731]:         <nova:port uuid="96415b19-4e1b-41c6-a070-cff24e7b20ab">
Apr 13 16:33:35 user nova-compute[71731]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Apr 13 16:33:35 user nova-compute[71731]:         </nova:port>
Apr 13 16:33:35 user nova-compute[71731]:       </nova:ports>
Apr 13 16:33:35 user nova-compute[71731]:     </nova:instance>
Apr 13 16:33:35 user nova-compute[71731]:   </metadata>
Apr 13 16:33:35 user nova-compute[71731]:   <sysinfo type="smbios">
Apr 13 16:33:35 user nova-compute[71731]:     <system>
Apr 13 16:33:35 user nova-compute[71731]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 16:33:35 user nova-compute[71731]:       <entry name="product">OpenStack Nova</entry>
Apr 13 16:33:35 user nova-compute[71731]:       <entry name="version">0.0.0</entry>
Apr 13 16:33:35 user nova-compute[71731]:       <entry name="serial">220e1c3e-1378-46fc-acc1-ee1bafac7722</entry>
Apr 13 16:33:35 user nova-compute[71731]:       <entry name="uuid">220e1c3e-1378-46fc-acc1-ee1bafac7722</entry>
Apr 13 16:33:35 user nova-compute[71731]:       <entry name="family">Virtual Machine</entry>
Apr 13 16:33:35 user nova-compute[71731]:     </system>
Apr 13 16:33:35 user nova-compute[71731]:   </sysinfo>
Apr 13 16:33:35 user nova-compute[71731]:   <os>
Apr 13 16:33:35 user nova-compute[71731]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 16:33:35 user nova-compute[71731]:     <boot dev="hd"/>
Apr 13 16:33:35 user nova-compute[71731]:     <smbios mode="sysinfo"/>
Apr 13 16:33:35 user nova-compute[71731]:   </os>
Apr 13 16:33:35 user nova-compute[71731]:   <features>
Apr 13 16:33:35 user nova-compute[71731]:     <acpi/>
Apr 13 16:33:35 user nova-compute[71731]:     <apic/>
Apr 13 16:33:35 user nova-compute[71731]:     <vmcoreinfo/>
Apr 13 16:33:35 user nova-compute[71731]:   </features>
Apr 13 16:33:35 user nova-compute[71731]:   <clock offset="utc">
Apr 13 16:33:35 user nova-compute[71731]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 16:33:35 user nova-compute[71731]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 16:33:35 user nova-compute[71731]:     <timer name="hpet" present="no"/>
Apr 13 16:33:35 user nova-compute[71731]:   </clock>
Apr 13 16:33:35 user nova-compute[71731]:   <cpu mode="custom" match="exact">
Apr 13 16:33:35 user nova-compute[71731]:     <model>Nehalem</model>
Apr 13 16:33:35 user nova-compute[71731]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 16:33:35 user nova-compute[71731]:   </cpu>
Apr 13 16:33:35 user nova-compute[71731]:   <devices>
Apr 13 16:33:35 user nova-compute[71731]:     <disk type="block" device="disk">
Apr 13 16:33:35 user nova-compute[71731]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 16:33:35 user nova-compute[71731]:       <source dev="/dev/sdb"/>
Apr 13 16:33:35 user nova-compute[71731]:       <target dev="vda" bus="virtio"/>
Apr 13 16:33:35 user nova-compute[71731]:       <serial>c2088266-1d33-4bb1-ac5b-1de832ff7985</serial>
Apr 13 16:33:35 user nova-compute[71731]:     </disk>
Apr 13 16:33:35 user nova-compute[71731]:     <interface type="ethernet">
Apr 13 16:33:35 user nova-compute[71731]:       <mac address="fa:16:3e:c0:2c:aa"/>
Apr 13 16:33:35 user nova-compute[71731]:       <model type="virtio"/>
Apr 13 16:33:35 user nova-compute[71731]:       <mtu size="1442"/>
Apr 13 16:33:35 user nova-compute[71731]:       <target dev="tap96415b19-4e"/>
Apr 13 16:33:35 user nova-compute[71731]:     </interface>
Apr 13 16:33:35 user nova-compute[71731]:     <serial type="pty">
Apr 13 16:33:35 user nova-compute[71731]:       <log file="/opt/stack/data/nova/instances/220e1c3e-1378-46fc-acc1-ee1bafac7722/console.log" append="off"/>
Apr 13 16:33:35 user nova-compute[71731]:     </serial>
Apr 13 16:33:35 user nova-compute[71731]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 16:33:35 user nova-compute[71731]:     <video>
Apr 13 16:33:35 user nova-compute[71731]:       <model type="virtio"/>
Apr 13 16:33:35 user nova-compute[71731]:     </video>
Apr 13 16:33:35 user nova-compute[71731]:     <rng model="virtio">
Apr 13 16:33:35 user nova-compute[71731]:       <backend model="random">/dev/urandom</backend>
Apr 13 16:33:35 user nova-compute[71731]:     </rng>
Apr 13 16:33:35 user nova-compute[71731]:     <controller type="usb" index="0" model="none"/>
Apr 13 16:33:35 user nova-compute[71731]:     <memballoon model="virtio">
Apr 13 16:33:35 user nova-compute[71731]:       <stats period="10"/>
Apr 13 16:33:35 user nova-compute[71731]:     </memballoon>
Apr 13 16:33:35 user nova-compute[71731]:   </devices>
Apr 13 16:33:35 user nova-compute[71731]: </domain>
Apr 13 16:33:35 user nova-compute[71731]:  {{(pid=71731) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 16:33:35 user nova-compute[71731]: DEBUG nova.virt.libvirt.vif [None req-c59af704-0b42-4249-a4ee-aacbbd4b64ce tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T16:33:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-811215132',display_name='tempest-TestVolumeBootPattern-server-811215132',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-811215132',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIspJuW0ouAVIXdRkaEFP67MIl/YPuQkC9G3HjohNK4Y6ERboR/Jfb2q58aDhzUN+56TLqbLCfdFh2NtWLgvjHOwe+zpPoSYOKAkWLX+NSuU860pg4Djj9vwVgJj/Bkydw==',key_name='tempest-TestVolumeBootPattern-1747083001',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8d451e0e239f486aa2b3abe9e273eab3',ramdisk_id='',reservation_id='r-8mcq0v5v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-438786227',owner_user_name='tempest-TestVolumeBootPattern-438786227-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T16:33:29Z,user_data=None,user_id='d70e10f63cdd49a9a1ebe1fe4c9de0a2',uuid=220e1c3e-1378-46fc-acc1-ee1bafac7722,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "96415b19-4e1b-41c6-a070-cff24e7b20ab", "address": "fa:16:3e:c0:2c:aa", "network": {"id": "d36bc206-f629-4d6e-8a3f-458061d7b525", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-893271134-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d451e0e239f486aa2b3abe9e273eab3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96415b19-4e", "ovs_interfaceid": "96415b19-4e1b-41c6-a070-cff24e7b20ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 16:33:35 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-c59af704-0b42-4249-a4ee-aacbbd4b64ce tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Converting VIF {"id": "96415b19-4e1b-41c6-a070-cff24e7b20ab", "address": "fa:16:3e:c0:2c:aa", "network": {"id": "d36bc206-f629-4d6e-8a3f-458061d7b525", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-893271134-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d451e0e239f486aa2b3abe9e273eab3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96415b19-4e", "ovs_interfaceid": "96415b19-4e1b-41c6-a070-cff24e7b20ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 16:33:35 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-c59af704-0b42-4249-a4ee-aacbbd4b64ce tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c0:2c:aa,bridge_name='br-int',has_traffic_filtering=True,id=96415b19-4e1b-41c6-a070-cff24e7b20ab,network=Network(d36bc206-f629-4d6e-8a3f-458061d7b525),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96415b19-4e') {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 16:33:35 user nova-compute[71731]: DEBUG os_vif [None req-c59af704-0b42-4249-a4ee-aacbbd4b64ce tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c0:2c:aa,bridge_name='br-int',has_traffic_filtering=True,id=96415b19-4e1b-41c6-a070-cff24e7b20ab,network=Network(d36bc206-f629-4d6e-8a3f-458061d7b525),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96415b19-4e') {{(pid=71731) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 16:33:35 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:33:35 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:33:35 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 16:33:35 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:33:35 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap96415b19-4e, may_exist=True) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:33:35 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap96415b19-4e, col_values=(('external_ids', {'iface-id': '96415b19-4e1b-41c6-a070-cff24e7b20ab', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c0:2c:aa', 'vm-uuid': '220e1c3e-1378-46fc-acc1-ee1bafac7722'}),)) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:33:35 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:33:35 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 16:33:35 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:33:35 user nova-compute[71731]: INFO os_vif [None req-c59af704-0b42-4249-a4ee-aacbbd4b64ce tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c0:2c:aa,bridge_name='br-int',has_traffic_filtering=True,id=96415b19-4e1b-41c6-a070-cff24e7b20ab,network=Network(d36bc206-f629-4d6e-8a3f-458061d7b525),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96415b19-4e')
Apr 13 16:33:35 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-c59af704-0b42-4249-a4ee-aacbbd4b64ce tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] No BDM found with device name vda, not building metadata. {{(pid=71731) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 16:33:35 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-c59af704-0b42-4249-a4ee-aacbbd4b64ce tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] No VIF found with MAC fa:16:3e:c0:2c:aa, not building metadata {{(pid=71731) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 16:33:36 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-bfd24b75-e454-49de-89a1-812ee7937e6e tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Acquiring lock "bf98c3a2-dbeb-4ae4-8423-ce55964c4258" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:33:36 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-bfd24b75-e454-49de-89a1-812ee7937e6e tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Lock "bf98c3a2-dbeb-4ae4-8423-ce55964c4258" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:33:36 user nova-compute[71731]: DEBUG nova.objects.instance [None req-bfd24b75-e454-49de-89a1-812ee7937e6e tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Lazy-loading 'flavor' on Instance uuid bf98c3a2-dbeb-4ae4-8423-ce55964c4258 {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:33:36 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-bfd24b75-e454-49de-89a1-812ee7937e6e tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Lock "bf98c3a2-dbeb-4ae4-8423-ce55964c4258" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.049s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:33:36 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-bfd24b75-e454-49de-89a1-812ee7937e6e tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Acquiring lock "bf98c3a2-dbeb-4ae4-8423-ce55964c4258" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:33:36 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-bfd24b75-e454-49de-89a1-812ee7937e6e tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Lock "bf98c3a2-dbeb-4ae4-8423-ce55964c4258" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:33:36 user nova-compute[71731]: INFO nova.compute.manager [None req-bfd24b75-e454-49de-89a1-812ee7937e6e tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] [instance: bf98c3a2-dbeb-4ae4-8423-ce55964c4258] Attaching volume 83d71596-07bc-438e-a163-92acd11239d8 to /dev/vdb
Apr 13 16:33:36 user nova-compute[71731]: DEBUG os_brick.utils [None req-bfd24b75-e454-49de-89a1-812ee7937e6e tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 16:33:36 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:33:36 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:33:36 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0b6389d-0be8-4f78-b910-1e25e96e189a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:81501d91421\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:33:36 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:33:36 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:33:36 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[06e7278a-8197-4e40-8e1c-fc007ab177b4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:33:36 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:33:36 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:33:36 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa034ac9-a9fe-4b54-8ab1-9694d6c7f671]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:33:36 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[3043ee8b-1cc7-4736-8e3d-ed6760058ff3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:33:36 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-bfd24b75-e454-49de-89a1-812ee7937e6e tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Running cmd (subprocess): nvme version {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:33:36 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-bfd24b75-e454-49de-89a1-812ee7937e6e tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] 'nvme version' failed. Not Retrying. {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 16:33:36 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bfd24b75-e454-49de-89a1-812ee7937e6e tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] nvme not present on system {{(pid=71731) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 16:33:36 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:33:36 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 16:33:36 user nova-compute[71731]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 16:33:36 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[800ca257-9f9b-4aad-b2cb-7eaf5891d840]: (4, '') {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:33:36 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.lightos [None req-bfd24b75-e454-49de-89a1-812ee7937e6e tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71731) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 16:33:36 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.lightos [None req-bfd24b75-e454-49de-89a1-812ee7937e6e tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71731) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 16:33:36 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.lightos [None req-bfd24b75-e454-49de-89a1-812ee7937e6e tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] LIGHTOS: no hostnqn found. {{(pid=71731) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 16:33:36 user nova-compute[71731]: DEBUG os_brick.utils [None req-bfd24b75-e454-49de-89a1-812ee7937e6e tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:81501d91421', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 16:33:36 user nova-compute[71731]: DEBUG nova.virt.block_device [None req-bfd24b75-e454-49de-89a1-812ee7937e6e tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] [instance: bf98c3a2-dbeb-4ae4-8423-ce55964c4258] Updating existing volume attachment record: eada4f6b-3767-4bf3-99a0-98a869792e6f {{(pid=71731) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 16:33:36 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:33:37 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:33:37 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:33:37 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:33:37 user nova-compute[71731]: DEBUG nova.compute.manager [req-e45a2263-2980-49d1-8bcc-6745818f592b req-b2d9ab13-6bf2-429d-95b5-d6d606e1f01f service nova] [instance: 220e1c3e-1378-46fc-acc1-ee1bafac7722] Received event network-vif-plugged-96415b19-4e1b-41c6-a070-cff24e7b20ab {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:33:37 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-e45a2263-2980-49d1-8bcc-6745818f592b req-b2d9ab13-6bf2-429d-95b5-d6d606e1f01f service nova] Acquiring lock "220e1c3e-1378-46fc-acc1-ee1bafac7722-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:33:37 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-e45a2263-2980-49d1-8bcc-6745818f592b req-b2d9ab13-6bf2-429d-95b5-d6d606e1f01f service nova] Lock "220e1c3e-1378-46fc-acc1-ee1bafac7722-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:33:37 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-e45a2263-2980-49d1-8bcc-6745818f592b req-b2d9ab13-6bf2-429d-95b5-d6d606e1f01f service nova] Lock "220e1c3e-1378-46fc-acc1-ee1bafac7722-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:33:37 user nova-compute[71731]: DEBUG nova.compute.manager [req-e45a2263-2980-49d1-8bcc-6745818f592b req-b2d9ab13-6bf2-429d-95b5-d6d606e1f01f service nova] [instance: 220e1c3e-1378-46fc-acc1-ee1bafac7722] No waiting events found dispatching network-vif-plugged-96415b19-4e1b-41c6-a070-cff24e7b20ab {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:33:37 user nova-compute[71731]: WARNING nova.compute.manager [req-e45a2263-2980-49d1-8bcc-6745818f592b req-b2d9ab13-6bf2-429d-95b5-d6d606e1f01f service nova] [instance: 220e1c3e-1378-46fc-acc1-ee1bafac7722] Received unexpected event network-vif-plugged-96415b19-4e1b-41c6-a070-cff24e7b20ab for instance with vm_state building and task_state spawning.
Apr 13 16:33:37 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:33:37 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:33:37 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:33:37 user nova-compute[71731]: INFO nova.compute.manager [None req-783f65e2-4244-4675-8e98-3254f212235f tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: 2956ab05-28ff-4c9e-b646-dbb83b3db278] Rescuing
Apr 13 16:33:37 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-783f65e2-4244-4675-8e98-3254f212235f tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Acquiring lock "refresh_cache-2956ab05-28ff-4c9e-b646-dbb83b3db278" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 16:33:37 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-783f65e2-4244-4675-8e98-3254f212235f tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Acquired lock "refresh_cache-2956ab05-28ff-4c9e-b646-dbb83b3db278" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 16:33:37 user nova-compute[71731]: DEBUG nova.network.neutron [None req-783f65e2-4244-4675-8e98-3254f212235f tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: 2956ab05-28ff-4c9e-b646-dbb83b3db278] Building network info cache for instance {{(pid=71731) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 16:33:37 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:33:38 user nova-compute[71731]: DEBUG nova.network.neutron [None req-783f65e2-4244-4675-8e98-3254f212235f tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: 2956ab05-28ff-4c9e-b646-dbb83b3db278] Updating instance_info_cache with network_info: [{"id": "84df62e9-af7c-4e62-83da-b43b511be2a0", "address": "fa:16:3e:66:e8:40", "network": {"id": "5a7877ff-8230-470b-90b5-e5dcfc8f0cee", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-779403873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2d09a74bf684a9fb1dd1e95d6c23f3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84df62e9-af", "ovs_interfaceid": "84df62e9-af7c-4e62-83da-b43b511be2a0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:33:38 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-783f65e2-4244-4675-8e98-3254f212235f tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Releasing lock "refresh_cache-2956ab05-28ff-4c9e-b646-dbb83b3db278" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 16:33:38 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:33:38 user nova-compute[71731]: DEBUG nova.compute.manager [req-da2de663-5baa-4ad3-af21-cf67cb8b5666 req-3e9e6050-8f27-404d-aead-82232b75f4db service nova] [instance: 2956ab05-28ff-4c9e-b646-dbb83b3db278] Received event network-vif-unplugged-84df62e9-af7c-4e62-83da-b43b511be2a0 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:33:38 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-da2de663-5baa-4ad3-af21-cf67cb8b5666 req-3e9e6050-8f27-404d-aead-82232b75f4db service nova] Acquiring lock "2956ab05-28ff-4c9e-b646-dbb83b3db278-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:33:38 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-da2de663-5baa-4ad3-af21-cf67cb8b5666 req-3e9e6050-8f27-404d-aead-82232b75f4db service nova] Lock "2956ab05-28ff-4c9e-b646-dbb83b3db278-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:33:38 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-da2de663-5baa-4ad3-af21-cf67cb8b5666 req-3e9e6050-8f27-404d-aead-82232b75f4db service nova] Lock "2956ab05-28ff-4c9e-b646-dbb83b3db278-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:33:38 user nova-compute[71731]: DEBUG nova.compute.manager [req-da2de663-5baa-4ad3-af21-cf67cb8b5666 req-3e9e6050-8f27-404d-aead-82232b75f4db service nova] [instance: 2956ab05-28ff-4c9e-b646-dbb83b3db278] No waiting events found dispatching network-vif-unplugged-84df62e9-af7c-4e62-83da-b43b511be2a0 {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:33:38 user nova-compute[71731]: WARNING nova.compute.manager [req-da2de663-5baa-4ad3-af21-cf67cb8b5666 req-3e9e6050-8f27-404d-aead-82232b75f4db service nova] [instance: 2956ab05-28ff-4c9e-b646-dbb83b3db278] Received unexpected event network-vif-unplugged-84df62e9-af7c-4e62-83da-b43b511be2a0 for instance with vm_state active and task_state rescuing.
Apr 13 16:33:38 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:33:38 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:33:39 user nova-compute[71731]: INFO nova.virt.libvirt.driver [-] [instance: 2956ab05-28ff-4c9e-b646-dbb83b3db278] Instance destroyed successfully.
Apr 13 16:33:39 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-783f65e2-4244-4675-8e98-3254f212235f tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: 2956ab05-28ff-4c9e-b646-dbb83b3db278] Attempting a stable device rescue
Apr 13 16:33:39 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-783f65e2-4244-4675-8e98-3254f212235f tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=71731) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4289}}
Apr 13 16:33:39 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-783f65e2-4244-4675-8e98-3254f212235f tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: 2956ab05-28ff-4c9e-b646-dbb83b3db278] Instance directory exists: not creating {{(pid=71731) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 13 16:33:39 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-783f65e2-4244-4675-8e98-3254f212235f tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: 2956ab05-28ff-4c9e-b646-dbb83b3db278] Creating image(s)
Apr 13 16:33:39 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-783f65e2-4244-4675-8e98-3254f212235f tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Acquiring lock "/opt/stack/data/nova/instances/2956ab05-28ff-4c9e-b646-dbb83b3db278/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:33:39 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-783f65e2-4244-4675-8e98-3254f212235f tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lock "/opt/stack/data/nova/instances/2956ab05-28ff-4c9e-b646-dbb83b3db278/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:33:39 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-783f65e2-4244-4675-8e98-3254f212235f tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lock "/opt/stack/data/nova/instances/2956ab05-28ff-4c9e-b646-dbb83b3db278/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:33:39 user nova-compute[71731]: DEBUG nova.objects.instance [None req-783f65e2-4244-4675-8e98-3254f212235f tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lazy-loading 'trusted_certs' on Instance uuid 2956ab05-28ff-4c9e-b646-dbb83b3db278 {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:33:39 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-783f65e2-4244-4675-8e98-3254f212235f tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Acquiring lock "832132f66b5e60a24bd4fcc9f0ffbb286fc9ce5e" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:33:39 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-783f65e2-4244-4675-8e98-3254f212235f tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lock "832132f66b5e60a24bd4fcc9f0ffbb286fc9ce5e" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:33:40 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-783f65e2-4244-4675-8e98-3254f212235f tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/832132f66b5e60a24bd4fcc9f0ffbb286fc9ce5e.part --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:33:40 user nova-compute[71731]: DEBUG nova.virt.driver [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Emitting event <LifecycleEvent: 1681403619.4536793, 220e1c3e-1378-46fc-acc1-ee1bafac7722 => Resumed> {{(pid=71731) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 16:33:40 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 220e1c3e-1378-46fc-acc1-ee1bafac7722] VM Resumed (Lifecycle Event)
Apr 13 16:33:40 user nova-compute[71731]: DEBUG nova.compute.manager [req-9a9a585e-5037-4fbc-bfea-5abba6557a84 req-f995a7b3-e117-40c4-b471-6c3173d877f6 service nova] [instance: 220e1c3e-1378-46fc-acc1-ee1bafac7722] Received event network-vif-plugged-96415b19-4e1b-41c6-a070-cff24e7b20ab {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:33:40 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-9a9a585e-5037-4fbc-bfea-5abba6557a84 req-f995a7b3-e117-40c4-b471-6c3173d877f6 service nova] Acquiring lock "220e1c3e-1378-46fc-acc1-ee1bafac7722-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:33:40 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-9a9a585e-5037-4fbc-bfea-5abba6557a84 req-f995a7b3-e117-40c4-b471-6c3173d877f6 service nova] Lock "220e1c3e-1378-46fc-acc1-ee1bafac7722-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:33:40 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-9a9a585e-5037-4fbc-bfea-5abba6557a84 req-f995a7b3-e117-40c4-b471-6c3173d877f6 service nova] Lock "220e1c3e-1378-46fc-acc1-ee1bafac7722-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:33:40 user nova-compute[71731]: DEBUG nova.compute.manager [req-9a9a585e-5037-4fbc-bfea-5abba6557a84 req-f995a7b3-e117-40c4-b471-6c3173d877f6 service nova] [instance: 220e1c3e-1378-46fc-acc1-ee1bafac7722] No waiting events found dispatching network-vif-plugged-96415b19-4e1b-41c6-a070-cff24e7b20ab {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:33:40 user nova-compute[71731]: WARNING nova.compute.manager [req-9a9a585e-5037-4fbc-bfea-5abba6557a84 req-f995a7b3-e117-40c4-b471-6c3173d877f6 service nova] [instance: 220e1c3e-1378-46fc-acc1-ee1bafac7722] Received unexpected event network-vif-plugged-96415b19-4e1b-41c6-a070-cff24e7b20ab for instance with vm_state building and task_state spawning.
Apr 13 16:33:40 user nova-compute[71731]: DEBUG nova.compute.manager [None req-c59af704-0b42-4249-a4ee-aacbbd4b64ce tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 220e1c3e-1378-46fc-acc1-ee1bafac7722] Instance event wait completed in 0 seconds for  {{(pid=71731) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 16:33:40 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-c59af704-0b42-4249-a4ee-aacbbd4b64ce tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 220e1c3e-1378-46fc-acc1-ee1bafac7722] Guest created on hypervisor {{(pid=71731) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 16:33:40 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-718d595e-b7dc-41e9-bd0f-369b92692f39 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Acquiring lock "eaae47b9-a059-49f6-9ae6-d7147003e2f2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:33:40 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-718d595e-b7dc-41e9-bd0f-369b92692f39 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lock "eaae47b9-a059-49f6-9ae6-d7147003e2f2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:33:40 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-718d595e-b7dc-41e9-bd0f-369b92692f39 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Acquiring lock "eaae47b9-a059-49f6-9ae6-d7147003e2f2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:33:40 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-718d595e-b7dc-41e9-bd0f-369b92692f39 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lock "eaae47b9-a059-49f6-9ae6-d7147003e2f2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:33:40 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-718d595e-b7dc-41e9-bd0f-369b92692f39 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lock "eaae47b9-a059-49f6-9ae6-d7147003e2f2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:33:40 user nova-compute[71731]: INFO nova.compute.manager [None req-718d595e-b7dc-41e9-bd0f-369b92692f39 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] [instance: eaae47b9-a059-49f6-9ae6-d7147003e2f2] Terminating instance
Apr 13 16:33:40 user nova-compute[71731]: DEBUG nova.compute.manager [None req-718d595e-b7dc-41e9-bd0f-369b92692f39 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] [instance: eaae47b9-a059-49f6-9ae6-d7147003e2f2] Start destroying the instance on the hypervisor. {{(pid=71731) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 16:33:40 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 220e1c3e-1378-46fc-acc1-ee1bafac7722] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:33:40 user nova-compute[71731]: INFO nova.virt.libvirt.driver [-] [instance: 220e1c3e-1378-46fc-acc1-ee1bafac7722] Instance spawned successfully.
Apr 13 16:33:40 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-c59af704-0b42-4249-a4ee-aacbbd4b64ce tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 220e1c3e-1378-46fc-acc1-ee1bafac7722] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 16:33:40 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 220e1c3e-1378-46fc-acc1-ee1bafac7722] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71731) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 16:33:40 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-c59af704-0b42-4249-a4ee-aacbbd4b64ce tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 220e1c3e-1378-46fc-acc1-ee1bafac7722] Found default for hw_cdrom_bus of ide {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:33:40 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-c59af704-0b42-4249-a4ee-aacbbd4b64ce tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 220e1c3e-1378-46fc-acc1-ee1bafac7722] Found default for hw_disk_bus of virtio {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:33:40 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-c59af704-0b42-4249-a4ee-aacbbd4b64ce tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 220e1c3e-1378-46fc-acc1-ee1bafac7722] Found default for hw_input_bus of None {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:33:40 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-c59af704-0b42-4249-a4ee-aacbbd4b64ce tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 220e1c3e-1378-46fc-acc1-ee1bafac7722] Found default for hw_pointer_model of None {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:33:40 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-c59af704-0b42-4249-a4ee-aacbbd4b64ce tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 220e1c3e-1378-46fc-acc1-ee1bafac7722] Found default for hw_video_model of virtio {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:33:40 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-c59af704-0b42-4249-a4ee-aacbbd4b64ce tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 220e1c3e-1378-46fc-acc1-ee1bafac7722] Found default for hw_vif_model of virtio {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:33:40 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 220e1c3e-1378-46fc-acc1-ee1bafac7722] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 16:33:40 user nova-compute[71731]: DEBUG nova.virt.driver [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Emitting event <LifecycleEvent: 1681403619.4539266, 220e1c3e-1378-46fc-acc1-ee1bafac7722 => Started> {{(pid=71731) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 16:33:40 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 220e1c3e-1378-46fc-acc1-ee1bafac7722] VM Started (Lifecycle Event)
Apr 13 16:33:40 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-783f65e2-4244-4675-8e98-3254f212235f tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/832132f66b5e60a24bd4fcc9f0ffbb286fc9ce5e.part --force-share --output=json" returned: 0 in 0.164s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:33:40 user nova-compute[71731]: DEBUG nova.virt.images [None req-783f65e2-4244-4675-8e98-3254f212235f tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] ce43bf2e-c302-4d95-b406-8685800afdec was qcow2, converting to raw {{(pid=71731) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 13 16:33:40 user nova-compute[71731]: DEBUG nova.privsep.utils [None req-783f65e2-4244-4675-8e98-3254f212235f tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71731) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 13 16:33:40 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-783f65e2-4244-4675-8e98-3254f212235f tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/832132f66b5e60a24bd4fcc9f0ffbb286fc9ce5e.part /opt/stack/data/nova/instances/_base/832132f66b5e60a24bd4fcc9f0ffbb286fc9ce5e.converted {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:33:40 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:33:40 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 220e1c3e-1378-46fc-acc1-ee1bafac7722] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:33:40 user nova-compute[71731]: INFO nova.compute.manager [None req-c59af704-0b42-4249-a4ee-aacbbd4b64ce tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 220e1c3e-1378-46fc-acc1-ee1bafac7722] Took 6.21 seconds to spawn the instance on the hypervisor.
Apr 13 16:33:40 user nova-compute[71731]: DEBUG nova.compute.manager [None req-c59af704-0b42-4249-a4ee-aacbbd4b64ce tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 220e1c3e-1378-46fc-acc1-ee1bafac7722] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:33:40 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:33:40 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:33:40 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 220e1c3e-1378-46fc-acc1-ee1bafac7722] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71731) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 16:33:40 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:33:40 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 220e1c3e-1378-46fc-acc1-ee1bafac7722] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 16:33:40 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:33:40 user nova-compute[71731]: INFO nova.compute.manager [None req-c59af704-0b42-4249-a4ee-aacbbd4b64ce tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 220e1c3e-1378-46fc-acc1-ee1bafac7722] Took 12.13 seconds to build instance.
Apr 13 16:33:40 user nova-compute[71731]: DEBUG nova.compute.manager [req-ab69fec4-9f34-4768-87e5-737ded0288f4 req-592dd3c5-8926-42c8-9df8-4cf8d3c8c8ec service nova] [instance: 2956ab05-28ff-4c9e-b646-dbb83b3db278] Received event network-vif-plugged-84df62e9-af7c-4e62-83da-b43b511be2a0 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:33:40 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-ab69fec4-9f34-4768-87e5-737ded0288f4 req-592dd3c5-8926-42c8-9df8-4cf8d3c8c8ec service nova] Acquiring lock "2956ab05-28ff-4c9e-b646-dbb83b3db278-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:33:40 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-ab69fec4-9f34-4768-87e5-737ded0288f4 req-592dd3c5-8926-42c8-9df8-4cf8d3c8c8ec service nova] Lock "2956ab05-28ff-4c9e-b646-dbb83b3db278-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:33:40 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-ab69fec4-9f34-4768-87e5-737ded0288f4 req-592dd3c5-8926-42c8-9df8-4cf8d3c8c8ec service nova] Lock "2956ab05-28ff-4c9e-b646-dbb83b3db278-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:33:40 user nova-compute[71731]: DEBUG nova.compute.manager [req-ab69fec4-9f34-4768-87e5-737ded0288f4 req-592dd3c5-8926-42c8-9df8-4cf8d3c8c8ec service nova] [instance: 2956ab05-28ff-4c9e-b646-dbb83b3db278] No waiting events found dispatching network-vif-plugged-84df62e9-af7c-4e62-83da-b43b511be2a0 {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:33:40 user nova-compute[71731]: WARNING nova.compute.manager [req-ab69fec4-9f34-4768-87e5-737ded0288f4 req-592dd3c5-8926-42c8-9df8-4cf8d3c8c8ec service nova] [instance: 2956ab05-28ff-4c9e-b646-dbb83b3db278] Received unexpected event network-vif-plugged-84df62e9-af7c-4e62-83da-b43b511be2a0 for instance with vm_state active and task_state rescuing.
Apr 13 16:33:40 user nova-compute[71731]: DEBUG nova.compute.manager [req-ab69fec4-9f34-4768-87e5-737ded0288f4 req-592dd3c5-8926-42c8-9df8-4cf8d3c8c8ec service nova] [instance: eaae47b9-a059-49f6-9ae6-d7147003e2f2] Received event network-vif-unplugged-e9b2fcaa-f77b-4e5c-ad3c-797ce804a9ae {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:33:40 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-ab69fec4-9f34-4768-87e5-737ded0288f4 req-592dd3c5-8926-42c8-9df8-4cf8d3c8c8ec service nova] Acquiring lock "eaae47b9-a059-49f6-9ae6-d7147003e2f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:33:40 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-ab69fec4-9f34-4768-87e5-737ded0288f4 req-592dd3c5-8926-42c8-9df8-4cf8d3c8c8ec service nova] Lock "eaae47b9-a059-49f6-9ae6-d7147003e2f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:33:40 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-ab69fec4-9f34-4768-87e5-737ded0288f4 req-592dd3c5-8926-42c8-9df8-4cf8d3c8c8ec service nova] Lock "eaae47b9-a059-49f6-9ae6-d7147003e2f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:33:40 user nova-compute[71731]: DEBUG nova.compute.manager [req-ab69fec4-9f34-4768-87e5-737ded0288f4 req-592dd3c5-8926-42c8-9df8-4cf8d3c8c8ec service nova] [instance: eaae47b9-a059-49f6-9ae6-d7147003e2f2] No waiting events found dispatching network-vif-unplugged-e9b2fcaa-f77b-4e5c-ad3c-797ce804a9ae {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:33:40 user nova-compute[71731]: DEBUG nova.compute.manager [req-ab69fec4-9f34-4768-87e5-737ded0288f4 req-592dd3c5-8926-42c8-9df8-4cf8d3c8c8ec service nova] [instance: eaae47b9-a059-49f6-9ae6-d7147003e2f2] Received event network-vif-unplugged-e9b2fcaa-f77b-4e5c-ad3c-797ce804a9ae for instance with task_state deleting. {{(pid=71731) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 16:33:40 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-c59af704-0b42-4249-a4ee-aacbbd4b64ce tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "220e1c3e-1378-46fc-acc1-ee1bafac7722" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.298s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:33:41 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-783f65e2-4244-4675-8e98-3254f212235f tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/832132f66b5e60a24bd4fcc9f0ffbb286fc9ce5e.part /opt/stack/data/nova/instances/_base/832132f66b5e60a24bd4fcc9f0ffbb286fc9ce5e.converted" returned: 0 in 0.585s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:33:41 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-783f65e2-4244-4675-8e98-3254f212235f tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/832132f66b5e60a24bd4fcc9f0ffbb286fc9ce5e.converted --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:33:41 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-783f65e2-4244-4675-8e98-3254f212235f tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/832132f66b5e60a24bd4fcc9f0ffbb286fc9ce5e.converted --force-share --output=json" returned: 0 in 0.166s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:33:41 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-783f65e2-4244-4675-8e98-3254f212235f tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lock "832132f66b5e60a24bd4fcc9f0ffbb286fc9ce5e" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.918s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:33:41 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-783f65e2-4244-4675-8e98-3254f212235f tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Acquiring lock "832132f66b5e60a24bd4fcc9f0ffbb286fc9ce5e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:33:41 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-783f65e2-4244-4675-8e98-3254f212235f tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lock "832132f66b5e60a24bd4fcc9f0ffbb286fc9ce5e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:33:41 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-783f65e2-4244-4675-8e98-3254f212235f tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/832132f66b5e60a24bd4fcc9f0ffbb286fc9ce5e --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:33:41 user nova-compute[71731]: INFO nova.virt.libvirt.driver [-] [instance: eaae47b9-a059-49f6-9ae6-d7147003e2f2] Instance destroyed successfully.
Apr 13 16:33:41 user nova-compute[71731]: DEBUG nova.objects.instance [None req-718d595e-b7dc-41e9-bd0f-369b92692f39 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lazy-loading 'resources' on Instance uuid eaae47b9-a059-49f6-9ae6-d7147003e2f2 {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:33:41 user nova-compute[71731]: DEBUG nova.virt.libvirt.vif [None req-718d595e-b7dc-41e9-bd0f-369b92692f39 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T16:24:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1335647489',display_name='tempest-AttachVolumeTestJSON-server-1335647489',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1335647489',id=17,image_ref='708622a9-7465-4492-ade8-b827198f7e30',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBWOy0oVQ9hC0pTOafixaz1QU1E5DFmqkYHL4O9l7OLTdaq0+Nt41+fxYUKgEMEMs0o2pxQBhqAzayIAyGV1IIb01ym4tkG3pd4D4/xbjIzoE586YH9dqYrXgxzYqNSiRA==',key_name='tempest-keypair-1534458766',keypairs=<?>,launch_index=0,launched_at=2023-04-13T16:24:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='24904988cf334657b084fd726c7ecf8f',ramdisk_id='',reservation_id='r-aer2ghdf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='708622a9-7465-4492-ade8-b827198f7e30',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-836650657',owner_user_name='tempest-AttachVolumeTestJSON-836650657-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T16:31:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='47fab402fb794a5a9281cfb7fe188813',uuid=eaae47b9-a059-49f6-9ae6-d7147003e2f2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e9b2fcaa-f77b-4e5c-ad3c-797ce804a9ae", "address": "fa:16:3e:ff:85:92", "network": {"id": "79e9ef20-b14d-4850-b298-9d3ed4d10b90", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1756253617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24904988cf334657b084fd726c7ecf8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9b2fcaa-f7", "ovs_interfaceid": "e9b2fcaa-f77b-4e5c-ad3c-797ce804a9ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 16:33:41 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-718d595e-b7dc-41e9-bd0f-369b92692f39 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Converting VIF {"id": "e9b2fcaa-f77b-4e5c-ad3c-797ce804a9ae", "address": "fa:16:3e:ff:85:92", "network": {"id": "79e9ef20-b14d-4850-b298-9d3ed4d10b90", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1756253617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24904988cf334657b084fd726c7ecf8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9b2fcaa-f7", "ovs_interfaceid": "e9b2fcaa-f77b-4e5c-ad3c-797ce804a9ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 16:33:41 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-718d595e-b7dc-41e9-bd0f-369b92692f39 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ff:85:92,bridge_name='br-int',has_traffic_filtering=True,id=e9b2fcaa-f77b-4e5c-ad3c-797ce804a9ae,network=Network(79e9ef20-b14d-4850-b298-9d3ed4d10b90),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9b2fcaa-f7') {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 16:33:41 user nova-compute[71731]: DEBUG os_vif [None req-718d595e-b7dc-41e9-bd0f-369b92692f39 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:85:92,bridge_name='br-int',has_traffic_filtering=True,id=e9b2fcaa-f77b-4e5c-ad3c-797ce804a9ae,network=Network(79e9ef20-b14d-4850-b298-9d3ed4d10b90),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9b2fcaa-f7') {{(pid=71731) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 16:33:41 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:33:41 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape9b2fcaa-f7, bridge=br-int, if_exists=True) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:33:41 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:33:41 user nova-compute[71731]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bfd24b75-e454-49de-89a1-812ee7937e6e tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] [instance: bf98c3a2-dbeb-4ae4-8423-ce55964c4258] Calling os-brick to attach iSCSI Volume {{(pid=71731) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 16:33:41 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfd24b75-e454-49de-89a1-812ee7937e6e tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8cf0118790>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:83d71596-07bc-438e-a163-92acd11239d8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aYMBOhep', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 16:33:41 user nova-compute[71731]: WARNING os_brick.initiator.connectors.base [None req-bfd24b75-e454-49de-89a1-812ee7937e6e tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 16:33:41 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-bfd24b75-e454-49de-89a1-812ee7937e6e tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 16:33:41 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-bfd24b75-e454-49de-89a1-812ee7937e6e tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 16:33:41 user nova-compute[71731]: WARNING os_brick.initiator.connectors.base [None req-bfd24b75-e454-49de-89a1-812ee7937e6e tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 16:33:41 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-bfd24b75-e454-49de-89a1-812ee7937e6e tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:83d71596-07bc-438e-a163-92acd11239d8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 16:33:41 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-bfd24b75-e454-49de-89a1-812ee7937e6e tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:83d71596-07bc-438e-a163-92acd11239d8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 16:33:41 user nova-compute[71731]: INFO os_brick.initiator.connectors.iscsi [None req-bfd24b75-e454-49de-89a1-812ee7937e6e tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 16:33:41 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 16:33:41 user nova-compute[71731]: INFO os_vif [None req-718d595e-b7dc-41e9-bd0f-369b92692f39 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:85:92,bridge_name='br-int',has_traffic_filtering=True,id=e9b2fcaa-f77b-4e5c-ad3c-797ce804a9ae,network=Network(79e9ef20-b14d-4850-b298-9d3ed4d10b90),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9b2fcaa-f7')
Apr 13 16:33:41 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-718d595e-b7dc-41e9-bd0f-369b92692f39 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] [instance: eaae47b9-a059-49f6-9ae6-d7147003e2f2] Deleting instance files /opt/stack/data/nova/instances/eaae47b9-a059-49f6-9ae6-d7147003e2f2_del
Apr 13 16:33:41 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-718d595e-b7dc-41e9-bd0f-369b92692f39 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] [instance: eaae47b9-a059-49f6-9ae6-d7147003e2f2] Deletion of /opt/stack/data/nova/instances/eaae47b9-a059-49f6-9ae6-d7147003e2f2_del complete
Apr 13 16:33:41 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83d71596-07bc-438e-a163-92acd11239d8 -p 172.16.0.220:3260 {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:33:41 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83d71596-07bc-438e-a163-92acd11239d8 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:33:41 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf963f8e-9ebd-4903-9462-268c34fa5fd9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:33:41 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfd24b75-e454-49de-89a1-812ee7937e6e tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 16:33:41 user nova-compute[71731]:  {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:33:41 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-783f65e2-4244-4675-8e98-3254f212235f tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/832132f66b5e60a24bd4fcc9f0ffbb286fc9ce5e --force-share --output=json" returned: 0 in 0.148s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:33:41 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-783f65e2-4244-4675-8e98-3254f212235f tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/832132f66b5e60a24bd4fcc9f0ffbb286fc9ce5e,backing_fmt=raw /opt/stack/data/nova/instances/2956ab05-28ff-4c9e-b646-dbb83b3db278/disk.rescue {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:33:41 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83d71596-07bc-438e-a163-92acd11239d8 -p 172.16.0.220:3260 --interface default --op new {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:33:41 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83d71596-07bc-438e-a163-92acd11239d8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:33:41 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[50763994-9950-475c-bae3-ee02d89e5f97]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:83d71596-07bc-438e-a163-92acd11239d8] added\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:33:41 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfd24b75-e454-49de-89a1-812ee7937e6e tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:83d71596-07bc-438e-a163-92acd11239d8] added
Apr 13 16:33:41 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:33:41 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-783f65e2-4244-4675-8e98-3254f212235f tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/832132f66b5e60a24bd4fcc9f0ffbb286fc9ce5e,backing_fmt=raw /opt/stack/data/nova/instances/2956ab05-28ff-4c9e-b646-dbb83b3db278/disk.rescue" returned: 0 in 0.056s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:33:41 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83d71596-07bc-438e-a163-92acd11239d8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:33:41 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-783f65e2-4244-4675-8e98-3254f212235f tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lock "832132f66b5e60a24bd4fcc9f0ffbb286fc9ce5e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.208s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:33:41 user nova-compute[71731]: DEBUG nova.objects.instance [None req-783f65e2-4244-4675-8e98-3254f212235f tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lazy-loading 'migration_context' on Instance uuid 2956ab05-28ff-4c9e-b646-dbb83b3db278 {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:33:41 user nova-compute[71731]: INFO nova.compute.manager [None req-718d595e-b7dc-41e9-bd0f-369b92692f39 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] [instance: eaae47b9-a059-49f6-9ae6-d7147003e2f2] Took 1.07 seconds to destroy the instance on the hypervisor.
Apr 13 16:33:41 user nova-compute[71731]: DEBUG oslo.service.loopingcall [None req-718d595e-b7dc-41e9-bd0f-369b92692f39 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71731) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 16:33:41 user nova-compute[71731]: DEBUG nova.compute.manager [-] [instance: eaae47b9-a059-49f6-9ae6-d7147003e2f2] Deallocating network for instance {{(pid=71731) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 16:33:41 user nova-compute[71731]: DEBUG nova.network.neutron [-] [instance: eaae47b9-a059-49f6-9ae6-d7147003e2f2] deallocate_for_instance() {{(pid=71731) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 16:33:41 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-783f65e2-4244-4675-8e98-3254f212235f tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: 2956ab05-28ff-4c9e-b646-dbb83b3db278] Created local disks {{(pid=71731) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 16:33:41 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-783f65e2-4244-4675-8e98-3254f212235f tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: 2956ab05-28ff-4c9e-b646-dbb83b3db278] Start _get_guest_xml network_info=[{"id": "84df62e9-af7c-4e62-83da-b43b511be2a0", "address": "fa:16:3e:66:e8:40", "network": {"id": "5a7877ff-8230-470b-90b5-e5dcfc8f0cee", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-779403873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-779403873-network", "vif_mac": "fa:16:3e:66:e8:40"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2d09a74bf684a9fb1dd1e95d6c23f3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84df62e9-af", "ovs_interfaceid": "84df62e9-af7c-4e62-83da-b43b511be2a0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T16:16:31Z,direct_url=<?>,disk_format='qcow2',id=708622a9-7465-4492-ade8-b827198f7e30,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='0b29a975c552465aba0ac7d6288434bd',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T16:16:33Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'ce43bf2e-c302-4d95-b406-8685800afdec', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'attachment_id': '37249968-badc-4f49-a9e0-ad66fe289877', 'mount_device': '/dev/vda', 'delete_on_termination': False, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:25c3dc97-c9cb-4529-ab32-26ef7fd94fc6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZFsWRaGN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': '2956ab05-28ff-4c9e-b646-dbb83b3db278', 'attached_at': '', 'detached_at': '', 'volume_id': '25c3dc97-c9cb-4529-ab32-26ef7fd94fc6', 'serial': '25c3dc97-c9cb-4529-ab32-26ef7fd94fc6'}, 'disk_bus': 'virtio', 'guest_format': None, 'volume_type': None} {{(pid=71731) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 16:33:41 user nova-compute[71731]: DEBUG nova.objects.instance [None req-783f65e2-4244-4675-8e98-3254f212235f tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lazy-loading 'resources' on Instance uuid 2956ab05-28ff-4c9e-b646-dbb83b3db278 {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:33:41 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83d71596-07bc-438e-a163-92acd11239d8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.029s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:33:41 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1f5375b-038f-4653-984d-4f359c758700]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:33:41 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfd24b75-e454-49de-89a1-812ee7937e6e tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:33:41 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83d71596-07bc-438e-a163-92acd11239d8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:33:41 user nova-compute[71731]: DEBUG nova.objects.instance [None req-783f65e2-4244-4675-8e98-3254f212235f tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lazy-loading 'numa_topology' on Instance uuid 2956ab05-28ff-4c9e-b646-dbb83b3db278 {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:33:41 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83d71596-07bc-438e-a163-92acd11239d8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:33:41 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[50e42abb-240e-496b-afa7-733ff8643dde]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:33:41 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfd24b75-e454-49de-89a1-812ee7937e6e tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:33:41 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83d71596-07bc-438e-a163-92acd11239d8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aYMBOhep {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:33:41 user nova-compute[71731]: WARNING nova.virt.libvirt.driver [None req-783f65e2-4244-4675-8e98-3254f212235f tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 16:33:41 user nova-compute[71731]: WARNING nova.virt.libvirt.driver [None req-783f65e2-4244-4675-8e98-3254f212235f tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 16:33:41 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-783f65e2-4244-4675-8e98-3254f212235f tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71731) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 16:33:41 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-783f65e2-4244-4675-8e98-3254f212235f tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T16:17:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T16:16:31Z,direct_url=<?>,disk_format='qcow2',id=708622a9-7465-4492-ade8-b827198f7e30,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='0b29a975c552465aba0ac7d6288434bd',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T16:16:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 16:33:41 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-783f65e2-4244-4675-8e98-3254f212235f tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Flavor limits 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 16:33:41 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-783f65e2-4244-4675-8e98-3254f212235f tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Image limits 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 16:33:41 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-783f65e2-4244-4675-8e98-3254f212235f tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Flavor pref 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 16:33:41 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-783f65e2-4244-4675-8e98-3254f212235f tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Image pref 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 16:33:41 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-783f65e2-4244-4675-8e98-3254f212235f tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 16:33:41 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-783f65e2-4244-4675-8e98-3254f212235f tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 16:33:41 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-783f65e2-4244-4675-8e98-3254f212235f tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71731) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 16:33:41 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-783f65e2-4244-4675-8e98-3254f212235f tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Got 1 possible topologies {{(pid=71731) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 16:33:41 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-783f65e2-4244-4675-8e98-3254f212235f tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 16:33:41 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-783f65e2-4244-4675-8e98-3254f212235f tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 16:33:41 user nova-compute[71731]: DEBUG nova.objects.instance [None req-783f65e2-4244-4675-8e98-3254f212235f tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lazy-loading 'vcpu_model' on Instance uuid 2956ab05-28ff-4c9e-b646-dbb83b3db278 {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:33:41 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83d71596-07bc-438e-a163-92acd11239d8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aYMBOhep" returned: 0 in 0.023s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:33:41 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[57876677-7088-4893-81e5-b609b70a2662]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:33:41 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfd24b75-e454-49de-89a1-812ee7937e6e tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'aYMBOhep'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:33:41 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83d71596-07bc-438e-a163-92acd11239d8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:33:41 user nova-compute[71731]: DEBUG nova.virt.libvirt.volume.iscsi [None req-783f65e2-4244-4675-8e98-3254f212235f tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: 2956ab05-28ff-4c9e-b646-dbb83b3db278] Calling os-brick to attach iSCSI Volume {{(pid=71731) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 16:33:41 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-783f65e2-4244-4675-8e98-3254f212235f tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8cf0118790>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:25c3dc97-c9cb-4529-ab32-26ef7fd94fc6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZFsWRaGN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 16:33:41 user nova-compute[71731]: WARNING os_brick.initiator.connectors.base [None req-783f65e2-4244-4675-8e98-3254f212235f tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 16:33:41 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-783f65e2-4244-4675-8e98-3254f212235f tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 16:33:41 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83d71596-07bc-438e-a163-92acd11239d8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:33:41 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[a704aeec-a7b4-45f9-b460-2dfacb349362]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:33:41 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfd24b75-e454-49de-89a1-812ee7937e6e tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:33:41 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:33:41 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:33:41 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd16678e-196b-4045-8a49-3c64ec64d8ff]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25c3dc97-c9cb-4529-ab32-26ef7fd94fc6 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:651ea766-ffda-42a1-9b3c-7be05a92c85f (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2088266-1d33-4bb1-ac5b-1de832ff7985 (non-flash)\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:33:41 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfd24b75-e454-49de-89a1-812ee7937e6e tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)
Apr 13 16:33:41 user nova-compute[71731]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25c3dc97-c9cb-4529-ab32-26ef7fd94fc6 (non-flash)
Apr 13 16:33:41 user nova-compute[71731]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:651ea766-ffda-42a1-9b3c-7be05a92c85f (non-flash)
Apr 13 16:33:41 user nova-compute[71731]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2088266-1d33-4bb1-ac5b-1de832ff7985 (non-flash)
Apr 13 16:33:41 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 16:33:41 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfd24b75-e454-49de-89a1-812ee7937e6e tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)
Apr 13 16:33:41 user nova-compute[71731]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25c3dc97-c9cb-4529-ab32-26ef7fd94fc6 (non-flash)
Apr 13 16:33:41 user nova-compute[71731]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:651ea766-ffda-42a1-9b3c-7be05a92c85f (non-flash)
Apr 13 16:33:41 user nova-compute[71731]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2088266-1d33-4bb1-ac5b-1de832ff7985 (non-flash)
Apr 13 16:33:41 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 16:33:41 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83d71596-07bc-438e-a163-92acd11239d8 -p 172.16.0.220:3260 --login {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:33:41 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:33:42 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83d71596-07bc-438e-a163-92acd11239d8 -p 172.16.0.220:3260 --login" returned: 0 in 1.073s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:33:42 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2062758-14cf-4448-aabb-d7370e23ab58]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:83d71596-07bc-438e-a163-92acd11239d8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:83d71596-07bc-438e-a163-92acd11239d8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:33:42 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfd24b75-e454-49de-89a1-812ee7937e6e tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:83d71596-07bc-438e-a163-92acd11239d8, portal: 172.16.0.220,3260]
Apr 13 16:33:42 user nova-compute[71731]: Login to [iface: default, target: iqn.2010-10.org.openstack:83d71596-07bc-438e-a163-92acd11239d8, portal: 172.16.0.220,3260] successful.
Apr 13 16:33:42 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:33:42 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83d71596-07bc-438e-a163-92acd11239d8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:33:42 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83d71596-07bc-438e-a163-92acd11239d8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:33:42 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f045084-df79-4265-ac8d-4181eb159dcf]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:33:42 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfd24b75-e454-49de-89a1-812ee7937e6e tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:33:42 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:33:42 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:33:42 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c170ba7-3d75-4749-9593-ec5b797f61de]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25c3dc97-c9cb-4529-ab32-26ef7fd94fc6 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:651ea766-ffda-42a1-9b3c-7be05a92c85f (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2088266-1d33-4bb1-ac5b-1de832ff7985 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83d71596-07bc-438e-a163-92acd11239d8 (non-flash)\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:33:42 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfd24b75-e454-49de-89a1-812ee7937e6e tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)
Apr 13 16:33:42 user nova-compute[71731]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25c3dc97-c9cb-4529-ab32-26ef7fd94fc6 (non-flash)
Apr 13 16:33:42 user nova-compute[71731]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:651ea766-ffda-42a1-9b3c-7be05a92c85f (non-flash)
Apr 13 16:33:42 user nova-compute[71731]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2088266-1d33-4bb1-ac5b-1de832ff7985 (non-flash)
Apr 13 16:33:42 user nova-compute[71731]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83d71596-07bc-438e-a163-92acd11239d8 (non-flash)
Apr 13 16:33:42 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 16:33:42 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfd24b75-e454-49de-89a1-812ee7937e6e tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)
Apr 13 16:33:42 user nova-compute[71731]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25c3dc97-c9cb-4529-ab32-26ef7fd94fc6 (non-flash)
Apr 13 16:33:42 user nova-compute[71731]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:651ea766-ffda-42a1-9b3c-7be05a92c85f (non-flash)
Apr 13 16:33:42 user nova-compute[71731]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2088266-1d33-4bb1-ac5b-1de832ff7985 (non-flash)
Apr 13 16:33:42 user nova-compute[71731]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83d71596-07bc-438e-a163-92acd11239d8 (non-flash)
Apr 13 16:33:42 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 16:33:42 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-bfd24b75-e454-49de-89a1-812ee7937e6e tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:83d71596-07bc-438e-a163-92acd11239d8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.405s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 16:33:42 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfd24b75-e454-49de-89a1-812ee7937e6e tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Connected to 172.16.0.220:3260 {{(pid=71731) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 16:33:42 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-bfd24b75-e454-49de-89a1-812ee7937e6e tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] HCTL ('37', '-', '-', 0) found on session 37 with lun 0 {{(pid=71731) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 16:33:42 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-bfd24b75-e454-49de-89a1-812ee7937e6e tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=71731) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 16:33:42 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:33:42 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.016s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:33:42 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e20fc69-243a-47bd-aa9a-b002ac8340c5]: (4, ('- - 0', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:33:42 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-bfd24b75-e454-49de-89a1-812ee7937e6e tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Searching for a device in session 37 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=71731) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 16:33:42 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfd24b75-e454-49de-89a1-812ee7937e6e tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:83d71596-07bc-438e-a163-92acd11239d8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aYMBOhep', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71731) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 16:33:43 user nova-compute[71731]: DEBUG nova.compute.manager [req-b0fe32ba-c72e-4947-9389-dbdca0f60432 req-1447865c-30be-4bc2-80c9-3da089d31705 service nova] [instance: eaae47b9-a059-49f6-9ae6-d7147003e2f2] Received event network-vif-plugged-e9b2fcaa-f77b-4e5c-ad3c-797ce804a9ae {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:33:43 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-b0fe32ba-c72e-4947-9389-dbdca0f60432 req-1447865c-30be-4bc2-80c9-3da089d31705 service nova] Acquiring lock "eaae47b9-a059-49f6-9ae6-d7147003e2f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:33:43 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-b0fe32ba-c72e-4947-9389-dbdca0f60432 req-1447865c-30be-4bc2-80c9-3da089d31705 service nova] Lock "eaae47b9-a059-49f6-9ae6-d7147003e2f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:33:43 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-b0fe32ba-c72e-4947-9389-dbdca0f60432 req-1447865c-30be-4bc2-80c9-3da089d31705 service nova] Lock "eaae47b9-a059-49f6-9ae6-d7147003e2f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:33:43 user nova-compute[71731]: DEBUG nova.compute.manager [req-b0fe32ba-c72e-4947-9389-dbdca0f60432 req-1447865c-30be-4bc2-80c9-3da089d31705 service nova] [instance: eaae47b9-a059-49f6-9ae6-d7147003e2f2] No waiting events found dispatching network-vif-plugged-e9b2fcaa-f77b-4e5c-ad3c-797ce804a9ae {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:33:43 user nova-compute[71731]: WARNING nova.compute.manager [req-b0fe32ba-c72e-4947-9389-dbdca0f60432 req-1447865c-30be-4bc2-80c9-3da089d31705 service nova] [instance: eaae47b9-a059-49f6-9ae6-d7147003e2f2] Received unexpected event network-vif-plugged-e9b2fcaa-f77b-4e5c-ad3c-797ce804a9ae for instance with vm_state active and task_state deleting.
Apr 13 16:33:43 user nova-compute[71731]: DEBUG nova.network.neutron [-] [instance: eaae47b9-a059-49f6-9ae6-d7147003e2f2] Updating instance_info_cache with network_info: [] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:33:43 user nova-compute[71731]: INFO nova.compute.manager [-] [instance: eaae47b9-a059-49f6-9ae6-d7147003e2f2] Took 1.70 seconds to deallocate network for instance.
Apr 13 16:33:43 user nova-compute[71731]: DEBUG nova.compute.manager [req-219757be-0d8d-4b96-b107-3bbe16b33509 req-6ef5c367-88de-4631-876f-8ea487826925 service nova] [instance: eaae47b9-a059-49f6-9ae6-d7147003e2f2] Received event network-vif-deleted-e9b2fcaa-f77b-4e5c-ad3c-797ce804a9ae {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:33:43 user nova-compute[71731]: INFO nova.compute.manager [req-219757be-0d8d-4b96-b107-3bbe16b33509 req-6ef5c367-88de-4631-876f-8ea487826925 service nova] [instance: eaae47b9-a059-49f6-9ae6-d7147003e2f2] Neutron deleted interface e9b2fcaa-f77b-4e5c-ad3c-797ce804a9ae; detaching it from the instance and deleting it from the info cache
Apr 13 16:33:43 user nova-compute[71731]: DEBUG nova.network.neutron [req-219757be-0d8d-4b96-b107-3bbe16b33509 req-6ef5c367-88de-4631-876f-8ea487826925 service nova] [instance: eaae47b9-a059-49f6-9ae6-d7147003e2f2] Updating instance_info_cache with network_info: [] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:33:43 user nova-compute[71731]: DEBUG nova.compute.manager [req-219757be-0d8d-4b96-b107-3bbe16b33509 req-6ef5c367-88de-4631-876f-8ea487826925 service nova] [instance: eaae47b9-a059-49f6-9ae6-d7147003e2f2] Detach interface failed, port_id=e9b2fcaa-f77b-4e5c-ad3c-797ce804a9ae, reason: Instance eaae47b9-a059-49f6-9ae6-d7147003e2f2 could not be found. {{(pid=71731) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 13 16:33:43 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-718d595e-b7dc-41e9-bd0f-369b92692f39 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:33:43 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-718d595e-b7dc-41e9-bd0f-369b92692f39 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:33:43 user nova-compute[71731]: DEBUG nova.compute.provider_tree [None req-718d595e-b7dc-41e9-bd0f-369b92692f39 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Inventory has not changed in ProviderTree for provider: cb6b1a64-0c24-4e2d-af1e-16576ca9165c {{(pid=71731) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 16:33:43 user nova-compute[71731]: DEBUG nova.scheduler.client.report [None req-718d595e-b7dc-41e9-bd0f-369b92692f39 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Inventory has not changed for provider cb6b1a64-0c24-4e2d-af1e-16576ca9165c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71731) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 16:33:43 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-718d595e-b7dc-41e9-bd0f-369b92692f39 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.404s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:33:43 user nova-compute[71731]: INFO nova.scheduler.client.report [None req-718d595e-b7dc-41e9-bd0f-369b92692f39 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Deleted allocations for instance eaae47b9-a059-49f6-9ae6-d7147003e2f2
Apr 13 16:33:43 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-bfd24b75-e454-49de-89a1-812ee7937e6e tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.444s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 16:33:43 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfd24b75-e454-49de-89a1-812ee7937e6e tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] <== connect_volume: return (2447ms) {'type': 'block', 'scsi_wwn': '26439306233653562', 'path': '/dev/sdf'} {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 16:33:43 user nova-compute[71731]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bfd24b75-e454-49de-89a1-812ee7937e6e tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] [instance: bf98c3a2-dbeb-4ae4-8423-ce55964c4258] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26439306233653562', 'path': '/dev/sdf'} {{(pid=71731) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 16:33:43 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-718d595e-b7dc-41e9-bd0f-369b92692f39 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lock "eaae47b9-a059-49f6-9ae6-d7147003e2f2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.414s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:33:43 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-783f65e2-4244-4675-8e98-3254f212235f tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 2.221s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 16:33:43 user nova-compute[71731]: WARNING os_brick.initiator.connectors.base [None req-783f65e2-4244-4675-8e98-3254f212235f tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 16:33:43 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-783f65e2-4244-4675-8e98-3254f212235f tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:25c3dc97-c9cb-4529-ab32-26ef7fd94fc6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 16:33:43 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-783f65e2-4244-4675-8e98-3254f212235f tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:25c3dc97-c9cb-4529-ab32-26ef7fd94fc6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 16:33:43 user nova-compute[71731]: INFO os_brick.initiator.connectors.iscsi [None req-783f65e2-4244-4675-8e98-3254f212235f tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 16:33:43 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25c3dc97-c9cb-4529-ab32-26ef7fd94fc6 -p 172.16.0.220:3260 {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:33:43 user nova-compute[71731]: DEBUG nova.objects.instance [None req-bfd24b75-e454-49de-89a1-812ee7937e6e tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Lazy-loading 'flavor' on Instance uuid bf98c3a2-dbeb-4ae4-8423-ce55964c4258 {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:33:43 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25c3dc97-c9cb-4529-ab32-26ef7fd94fc6 -p 172.16.0.220:3260" returned: 0 in 0.019s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:33:43 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a6aed3b-d214-4dcf-8882-6991b40ad63d]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:25c3dc97-c9cb-4529-ab32-26ef7fd94fc6\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = ZFsWRaGN\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:33:43 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-783f65e2-4244-4675-8e98-3254f212235f tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Apr 13 16:33:43 user nova-compute[71731]: node.name = iqn.2010-10.org.openstack:25c3dc97-c9cb-4529-ab32-26ef7fd94fc6
Apr 13 16:33:43 user nova-compute[71731]: node.tpgt = -1
Apr 13 16:33:43 user nova-compute[71731]: node.startup = automatic
Apr 13 16:33:43 user nova-compute[71731]: node.leading_login = No
Apr 13 16:33:43 user nova-compute[71731]: iface.iscsi_ifacename = default
Apr 13 16:33:43 user nova-compute[71731]: iface.net_ifacename = <empty>
Apr 13 16:33:43 user nova-compute[71731]: iface.ipaddress = <empty>
Apr 13 16:33:43 user nova-compute[71731]: iface.prefix_len = 0
Apr 13 16:33:43 user nova-compute[71731]: iface.hwaddress = <empty>
Apr 13 16:33:43 user nova-compute[71731]: iface.transport_name = tcp
Apr 13 16:33:43 user nova-compute[71731]: iface.initiatorname = <empty>
Apr 13 16:33:43 user nova-compute[71731]: iface.state = <empty>
Apr 13 16:33:43 user nova-compute[71731]: iface.vlan_id = 0
Apr 13 16:33:43 user nova-compute[71731]: iface.vlan_priority = 0
Apr 13 16:33:43 user nova-compute[71731]: iface.vlan_state = <empty>
Apr 13 16:33:43 user nova-compute[71731]: iface.iface_num = 0
Apr 13 16:33:43 user nova-compute[71731]: iface.mtu = 0
Apr 13 16:33:43 user nova-compute[71731]: iface.port = 0
Apr 13 16:33:43 user nova-compute[71731]: iface.bootproto = <empty>
Apr 13 16:33:43 user nova-compute[71731]: iface.subnet_mask = <empty>
Apr 13 16:33:43 user nova-compute[71731]: iface.gateway = <empty>
Apr 13 16:33:43 user nova-compute[71731]: iface.dhcp_alt_client_id_state = <empty>
Apr 13 16:33:43 user nova-compute[71731]: iface.dhcp_alt_client_id = <empty>
Apr 13 16:33:43 user nova-compute[71731]: iface.dhcp_dns = <empty>
Apr 13 16:33:43 user nova-compute[71731]: iface.dhcp_learn_iqn = <empty>
Apr 13 16:33:43 user nova-compute[71731]: iface.dhcp_req_vendor_id_state = <empty>
Apr 13 16:33:43 user nova-compute[71731]: iface.dhcp_vendor_id_state = <empty>
Apr 13 16:33:43 user nova-compute[71731]: iface.dhcp_vendor_id = <empty>
Apr 13 16:33:43 user nova-compute[71731]: iface.dhcp_slp_da = <empty>
Apr 13 16:33:43 user nova-compute[71731]: iface.fragmentation = <empty>
Apr 13 16:33:43 user nova-compute[71731]: iface.gratuitous_arp = <empty>
Apr 13 16:33:43 user nova-compute[71731]: iface.incoming_forwarding = <empty>
Apr 13 16:33:43 user nova-compute[71731]: iface.tos_state = <empty>
Apr 13 16:33:43 user nova-compute[71731]: iface.tos = 0
Apr 13 16:33:43 user nova-compute[71731]: iface.ttl = 0
Apr 13 16:33:43 user nova-compute[71731]: iface.delayed_ack = <empty>
Apr 13 16:33:43 user nova-compute[71731]: iface.tcp_nagle = <empty>
Apr 13 16:33:43 user nova-compute[71731]: iface.tcp_wsf_state = <empty>
Apr 13 16:33:43 user nova-compute[71731]: iface.tcp_wsf = 0
Apr 13 16:33:43 user nova-compute[71731]: iface.tcp_timer_scale = 0
Apr 13 16:33:43 user nova-compute[71731]: iface.tcp_timestamp = <empty>
Apr 13 16:33:43 user nova-compute[71731]: iface.redirect = <empty>
Apr 13 16:33:43 user nova-compute[71731]: iface.def_task_mgmt_timeout = 0
Apr 13 16:33:43 user nova-compute[71731]: iface.header_digest = <empty>
Apr 13 16:33:43 user nova-compute[71731]: iface.data_digest = <empty>
Apr 13 16:33:43 user nova-compute[71731]: iface.immediate_data = <empty>
Apr 13 16:33:43 user nova-compute[71731]: iface.initial_r2t = <empty>
Apr 13 16:33:43 user nova-compute[71731]: iface.data_seq_inorder = <empty>
Apr 13 16:33:43 user nova-compute[71731]: iface.data_pdu_inorder = <empty>
Apr 13 16:33:43 user nova-compute[71731]: iface.erl = 0
Apr 13 16:33:43 user nova-compute[71731]: iface.max_receive_data_len = 0
Apr 13 16:33:43 user nova-compute[71731]: iface.first_burst_len = 0
Apr 13 16:33:43 user nova-compute[71731]: iface.max_outstanding_r2t = 0
Apr 13 16:33:43 user nova-compute[71731]: iface.max_burst_len = 0
Apr 13 16:33:43 user nova-compute[71731]: iface.chap_auth = <empty>
Apr 13 16:33:43 user nova-compute[71731]: iface.bidi_chap = <empty>
Apr 13 16:33:43 user nova-compute[71731]: iface.strict_login_compliance = <empty>
Apr 13 16:33:43 user nova-compute[71731]: iface.discovery_auth = <empty>
Apr 13 16:33:43 user nova-compute[71731]: iface.discovery_logout = <empty>
Apr 13 16:33:43 user nova-compute[71731]: node.discovery_address = <empty>
Apr 13 16:33:43 user nova-compute[71731]: node.discovery_port = 0
Apr 13 16:33:43 user nova-compute[71731]: node.discovery_type = static
Apr 13 16:33:43 user nova-compute[71731]: node.session.initial_cmdsn = 0
Apr 13 16:33:43 user nova-compute[71731]: node.session.initial_login_retry_max = 8
Apr 13 16:33:43 user nova-compute[71731]: node.session.xmit_thread_priority = -20
Apr 13 16:33:43 user nova-compute[71731]: node.session.cmds_max = 128
Apr 13 16:33:43 user nova-compute[71731]: node.session.queue_depth = 32
Apr 13 16:33:43 user nova-compute[71731]: node.session.nr_sessions = 1
Apr 13 16:33:43 user nova-compute[71731]: node.session.auth.authmethod = CHAP
Apr 13 16:33:43 user nova-compute[71731]: node.session.auth.username = ZFsWRaGN
Apr 13 16:33:43 user nova-compute[71731]: node.session.auth.password = ***
Apr 13 16:33:43 user nova-compute[71731]: node.session.auth.username_in = <empty>
Apr 13 16:33:43 user nova-compute[71731]: node.session.auth.password_in = <empty>
Apr 13 16:33:43 user nova-compute[71731]: node.session.auth.chap_algs = MD5
Apr 13 16:33:43 user nova-compute[71731]: node.session.timeo.replacement_timeout = 120
Apr 13 16:33:43 user nova-compute[71731]: node.session.err_timeo.abort_timeout = 15
Apr 13 16:33:43 user nova-compute[71731]: node.session.err_timeo.lu_reset_timeout = 30
Apr 13 16:33:43 user nova-compute[71731]: node.session.err_timeo.tgt_reset_timeout = 30
Apr 13 16:33:43 user nova-compute[71731]: node.session.err_timeo.host_reset_timeout = 60
Apr 13 16:33:43 user nova-compute[71731]: node.session.iscsi.FastAbort = Yes
Apr 13 16:33:43 user nova-compute[71731]: node.session.iscsi.InitialR2T = No
Apr 13 16:33:43 user nova-compute[71731]: node.session.iscsi.ImmediateData = Yes
Apr 13 16:33:43 user nova-compute[71731]: node.session.iscsi.FirstBurstLength = 262144
Apr 13 16:33:43 user nova-compute[71731]: node.session.iscsi.MaxBurstLength = 16776192
Apr 13 16:33:43 user nova-compute[71731]: node.session.iscsi.DefaultTime2Retain = 0
Apr 13 16:33:43 user nova-compute[71731]: node.session.iscsi.DefaultTime2Wait = 2
Apr 13 16:33:43 user nova-compute[71731]: node.session.iscsi.MaxConnections = 1
Apr 13 16:33:43 user nova-compute[71731]: node.session.iscsi.MaxOutstandingR2T = 1
Apr 13 16:33:43 user nova-compute[71731]: node.session.iscsi.ERL = 0
Apr 13 16:33:43 user nova-compute[71731]: node.session.scan = manual
Apr 13 16:33:43 user nova-compute[71731]: node.session.reopen_max = 0
Apr 13 16:33:43 user nova-compute[71731]: node.conn[0].address = 172.16.0.220
Apr 13 16:33:43 user nova-compute[71731]: node.conn[0].port = 3260
Apr 13 16:33:43 user nova-compute[71731]: node.conn[0].startup = manual
Apr 13 16:33:43 user nova-compute[71731]: node.conn[0].tcp.window_size = 524288
Apr 13 16:33:43 user nova-compute[71731]: node.conn[0].tcp.type_of_service = 0
Apr 13 16:33:43 user nova-compute[71731]: node.conn[0].timeo.logout_timeout = 15
Apr 13 16:33:43 user nova-compute[71731]: node.conn[0].timeo.login_timeout = 15
Apr 13 16:33:43 user nova-compute[71731]: node.conn[0].timeo.auth_timeout = 45
Apr 13 16:33:43 user nova-compute[71731]: node.conn[0].timeo.noop_out_interval = 5
Apr 13 16:33:43 user nova-compute[71731]: node.conn[0].timeo.noop_out_timeout = 5
Apr 13 16:33:43 user nova-compute[71731]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Apr 13 16:33:43 user nova-compute[71731]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Apr 13 16:33:43 user nova-compute[71731]: node.conn[0].iscsi.HeaderDigest = None
Apr 13 16:33:43 user nova-compute[71731]: node.conn[0].iscsi.DataDigest = None
Apr 13 16:33:43 user nova-compute[71731]: node.conn[0].iscsi.IFMarker = No
Apr 13 16:33:43 user nova-compute[71731]: node.conn[0].iscsi.OFMarker = No
Apr 13 16:33:43 user nova-compute[71731]: # END RECORD
Apr 13 16:33:43 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:33:43 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25c3dc97-c9cb-4529-ab32-26ef7fd94fc6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:33:43 user nova-compute[71731]: DEBUG nova.virt.libvirt.guest [None req-bfd24b75-e454-49de-89a1-812ee7937e6e tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] attach device xml: <disk type="block" device="disk">
Apr 13 16:33:43 user nova-compute[71731]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 16:33:43 user nova-compute[71731]:   <source dev="/dev/sdf"/>
Apr 13 16:33:43 user nova-compute[71731]:   <target dev="vdb" bus="virtio"/>
Apr 13 16:33:43 user nova-compute[71731]:   <serial>83d71596-07bc-438e-a163-92acd11239d8</serial>
Apr 13 16:33:43 user nova-compute[71731]: </disk>
Apr 13 16:33:43 user nova-compute[71731]:  {{(pid=71731) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 13 16:33:43 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-7a4228be-7d95-4c80-9921-33ea02b45ca4 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Acquiring lock "64a9c052-89a9-48ba-80c9-13fb5ef22f0e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:33:43 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-7a4228be-7d95-4c80-9921-33ea02b45ca4 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Lock "64a9c052-89a9-48ba-80c9-13fb5ef22f0e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:33:43 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25c3dc97-c9cb-4529-ab32-26ef7fd94fc6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:33:43 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[2487c4e9-bbee-4ce5-83e0-507cf15a24b9]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:33:43 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-783f65e2-4244-4675-8e98-3254f212235f tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:33:43 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25c3dc97-c9cb-4529-ab32-26ef7fd94fc6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:33:43 user nova-compute[71731]: DEBUG nova.objects.instance [None req-7a4228be-7d95-4c80-9921-33ea02b45ca4 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Lazy-loading 'flavor' on Instance uuid 64a9c052-89a9-48ba-80c9-13fb5ef22f0e {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:33:43 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25c3dc97-c9cb-4529-ab32-26ef7fd94fc6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:33:43 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[71847ee7-c89d-4569-9384-e0df32aeb78e]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:33:43 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-783f65e2-4244-4675-8e98-3254f212235f tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:33:43 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25c3dc97-c9cb-4529-ab32-26ef7fd94fc6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZFsWRaGN {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:33:43 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-7a4228be-7d95-4c80-9921-33ea02b45ca4 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Lock "64a9c052-89a9-48ba-80c9-13fb5ef22f0e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:33:43 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25c3dc97-c9cb-4529-ab32-26ef7fd94fc6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZFsWRaGN" returned: 0 in 0.027s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:33:43 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[069dac63-252b-4d28-ac22-91a1b2f3909f]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:33:43 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-783f65e2-4244-4675-8e98-3254f212235f tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZFsWRaGN'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:33:43 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25c3dc97-c9cb-4529-ab32-26ef7fd94fc6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:33:43 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25c3dc97-c9cb-4529-ab32-26ef7fd94fc6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:33:43 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[62714c6f-1846-4f0a-90b9-ba73c0ad60ef]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:33:43 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-783f65e2-4244-4675-8e98-3254f212235f tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:33:43 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:33:43 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:33:43 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc122329-fba0-41e2-b9c1-14de870ea6bd]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25c3dc97-c9cb-4529-ab32-26ef7fd94fc6 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:651ea766-ffda-42a1-9b3c-7be05a92c85f (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2088266-1d33-4bb1-ac5b-1de832ff7985 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83d71596-07bc-438e-a163-92acd11239d8 (non-flash)\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:33:43 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-783f65e2-4244-4675-8e98-3254f212235f tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)
Apr 13 16:33:43 user nova-compute[71731]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25c3dc97-c9cb-4529-ab32-26ef7fd94fc6 (non-flash)
Apr 13 16:33:43 user nova-compute[71731]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:651ea766-ffda-42a1-9b3c-7be05a92c85f (non-flash)
Apr 13 16:33:43 user nova-compute[71731]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2088266-1d33-4bb1-ac5b-1de832ff7985 (non-flash)
Apr 13 16:33:43 user nova-compute[71731]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83d71596-07bc-438e-a163-92acd11239d8 (non-flash)
Apr 13 16:33:43 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 16:33:43 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-783f65e2-4244-4675-8e98-3254f212235f tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)
Apr 13 16:33:43 user nova-compute[71731]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25c3dc97-c9cb-4529-ab32-26ef7fd94fc6 (non-flash)
Apr 13 16:33:43 user nova-compute[71731]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:651ea766-ffda-42a1-9b3c-7be05a92c85f (non-flash)
Apr 13 16:33:43 user nova-compute[71731]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2088266-1d33-4bb1-ac5b-1de832ff7985 (non-flash)
Apr 13 16:33:43 user nova-compute[71731]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83d71596-07bc-438e-a163-92acd11239d8 (non-flash)
Apr 13 16:33:43 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 16:33:43 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-783f65e2-4244-4675-8e98-3254f212235f tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:25c3dc97-c9cb-4529-ab32-26ef7fd94fc6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.177s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 16:33:43 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-783f65e2-4244-4675-8e98-3254f212235f tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Connected to 172.16.0.220:3260 {{(pid=71731) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 16:33:43 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-783f65e2-4244-4675-8e98-3254f212235f tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] HCTL ('35', '0', '0', 0) found on session 32 with lun 0 {{(pid=71731) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 16:33:43 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-783f65e2-4244-4675-8e98-3254f212235f tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Scanning host 35 c: 0, t: 0, l: 0) {{(pid=71731) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 16:33:43 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:33:43 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.013s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:33:43 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[49a83cb2-64c1-4a50-887f-8ae47edd34ec]: (4, ('0 0 0', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:33:43 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-783f65e2-4244-4675-8e98-3254f212235f tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Searching for a device in session 32 and hctl ('35', '0', '0', 0) yield: sdd {{(pid=71731) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 16:33:43 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-783f65e2-4244-4675-8e98-3254f212235f tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:25c3dc97-c9cb-4529-ab32-26ef7fd94fc6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZFsWRaGN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=71731) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 16:33:43 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-783f65e2-4244-4675-8e98-3254f212235f tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.200s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 16:33:43 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-783f65e2-4244-4675-8e98-3254f212235f tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] <== connect_volume: return (2422ms) {'type': 'block', 'scsi_wwn': '23838303333626134', 'path': '/dev/sdd'} {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 16:33:43 user nova-compute[71731]: DEBUG nova.virt.libvirt.volume.iscsi [None req-783f65e2-4244-4675-8e98-3254f212235f tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: 2956ab05-28ff-4c9e-b646-dbb83b3db278] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23838303333626134', 'path': '/dev/sdd'} {{(pid=71731) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 16:33:44 user nova-compute[71731]: DEBUG nova.virt.libvirt.vif [None req-783f65e2-4244-4675-8e98-3254f212235f tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T16:31:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1531186020',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1531186020',id=27,image_ref='708622a9-7465-4492-ade8-b827198f7e30',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-13T16:32:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b2d09a74bf684a9fb1dd1e95d6c23f3c',ramdisk_id='',reservation_id='r-ijjf8jor',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='708622a9-7465-4492-ade8-b827198f7e30',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1960261099',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T16:32:05Z,user_data=None,user_id='e45a882dbafb4ea4976e4f45289eb2b8',uuid=2956ab05-28ff-4c9e-b646-dbb83b3db278,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "84df62e9-af7c-4e62-83da-b43b511be2a0", "address": "fa:16:3e:66:e8:40", "network": {"id": "5a7877ff-8230-470b-90b5-e5dcfc8f0cee", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-779403873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-779403873-network", "vif_mac": "fa:16:3e:66:e8:40"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2d09a74bf684a9fb1dd1e95d6c23f3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84df62e9-af", "ovs_interfaceid": "84df62e9-af7c-4e62-83da-b43b511be2a0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71731) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 16:33:44 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-783f65e2-4244-4675-8e98-3254f212235f tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Converting VIF {"id": "84df62e9-af7c-4e62-83da-b43b511be2a0", "address": "fa:16:3e:66:e8:40", "network": {"id": "5a7877ff-8230-470b-90b5-e5dcfc8f0cee", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-779403873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-779403873-network", "vif_mac": "fa:16:3e:66:e8:40"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2d09a74bf684a9fb1dd1e95d6c23f3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84df62e9-af", "ovs_interfaceid": "84df62e9-af7c-4e62-83da-b43b511be2a0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 16:33:44 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-783f65e2-4244-4675-8e98-3254f212235f tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:66:e8:40,bridge_name='br-int',has_traffic_filtering=True,id=84df62e9-af7c-4e62-83da-b43b511be2a0,network=Network(5a7877ff-8230-470b-90b5-e5dcfc8f0cee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84df62e9-af') {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 16:33:44 user nova-compute[71731]: DEBUG nova.objects.instance [None req-783f65e2-4244-4675-8e98-3254f212235f tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lazy-loading 'pci_devices' on Instance uuid 2956ab05-28ff-4c9e-b646-dbb83b3db278 {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:33:44 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-783f65e2-4244-4675-8e98-3254f212235f tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: 2956ab05-28ff-4c9e-b646-dbb83b3db278] End _get_guest_xml xml=<domain type="kvm">
Apr 13 16:33:44 user nova-compute[71731]:   <uuid>2956ab05-28ff-4c9e-b646-dbb83b3db278</uuid>
Apr 13 16:33:44 user nova-compute[71731]:   <name>instance-0000001b</name>
Apr 13 16:33:44 user nova-compute[71731]:   <memory>131072</memory>
Apr 13 16:33:44 user nova-compute[71731]:   <vcpu>1</vcpu>
Apr 13 16:33:44 user nova-compute[71731]:   <metadata>
Apr 13 16:33:44 user nova-compute[71731]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 16:33:44 user nova-compute[71731]:       <nova:package version="0.0.0"/>
Apr 13 16:33:44 user nova-compute[71731]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1531186020</nova:name>
Apr 13 16:33:44 user nova-compute[71731]:       <nova:creationTime>2023-04-13 16:33:41</nova:creationTime>
Apr 13 16:33:44 user nova-compute[71731]:       <nova:flavor name="m1.nano">
Apr 13 16:33:44 user nova-compute[71731]:         <nova:memory>128</nova:memory>
Apr 13 16:33:44 user nova-compute[71731]:         <nova:disk>1</nova:disk>
Apr 13 16:33:44 user nova-compute[71731]:         <nova:swap>0</nova:swap>
Apr 13 16:33:44 user nova-compute[71731]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 16:33:44 user nova-compute[71731]:         <nova:vcpus>1</nova:vcpus>
Apr 13 16:33:44 user nova-compute[71731]:       </nova:flavor>
Apr 13 16:33:44 user nova-compute[71731]:       <nova:owner>
Apr 13 16:33:44 user nova-compute[71731]:         <nova:user uuid="e45a882dbafb4ea4976e4f45289eb2b8">tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member</nova:user>
Apr 13 16:33:44 user nova-compute[71731]:         <nova:project uuid="b2d09a74bf684a9fb1dd1e95d6c23f3c">tempest-ServerBootFromVolumeStableRescueTest-1960261099</nova:project>
Apr 13 16:33:44 user nova-compute[71731]:       </nova:owner>
Apr 13 16:33:44 user nova-compute[71731]:       <nova:root type="image" uuid="708622a9-7465-4492-ade8-b827198f7e30"/>
Apr 13 16:33:44 user nova-compute[71731]:       <nova:ports>
Apr 13 16:33:44 user nova-compute[71731]:         <nova:port uuid="84df62e9-af7c-4e62-83da-b43b511be2a0">
Apr 13 16:33:44 user nova-compute[71731]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Apr 13 16:33:44 user nova-compute[71731]:         </nova:port>
Apr 13 16:33:44 user nova-compute[71731]:       </nova:ports>
Apr 13 16:33:44 user nova-compute[71731]:     </nova:instance>
Apr 13 16:33:44 user nova-compute[71731]:   </metadata>
Apr 13 16:33:44 user nova-compute[71731]:   <sysinfo type="smbios">
Apr 13 16:33:44 user nova-compute[71731]:     <system>
Apr 13 16:33:44 user nova-compute[71731]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 16:33:44 user nova-compute[71731]:       <entry name="product">OpenStack Nova</entry>
Apr 13 16:33:44 user nova-compute[71731]:       <entry name="version">0.0.0</entry>
Apr 13 16:33:44 user nova-compute[71731]:       <entry name="serial">2956ab05-28ff-4c9e-b646-dbb83b3db278</entry>
Apr 13 16:33:44 user nova-compute[71731]:       <entry name="uuid">2956ab05-28ff-4c9e-b646-dbb83b3db278</entry>
Apr 13 16:33:44 user nova-compute[71731]:       <entry name="family">Virtual Machine</entry>
Apr 13 16:33:44 user nova-compute[71731]:     </system>
Apr 13 16:33:44 user nova-compute[71731]:   </sysinfo>
Apr 13 16:33:44 user nova-compute[71731]:   <os>
Apr 13 16:33:44 user nova-compute[71731]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 16:33:44 user nova-compute[71731]:     <smbios mode="sysinfo"/>
Apr 13 16:33:44 user nova-compute[71731]:   </os>
Apr 13 16:33:44 user nova-compute[71731]:   <features>
Apr 13 16:33:44 user nova-compute[71731]:     <acpi/>
Apr 13 16:33:44 user nova-compute[71731]:     <apic/>
Apr 13 16:33:44 user nova-compute[71731]:     <vmcoreinfo/>
Apr 13 16:33:44 user nova-compute[71731]:   </features>
Apr 13 16:33:44 user nova-compute[71731]:   <clock offset="utc">
Apr 13 16:33:44 user nova-compute[71731]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 16:33:44 user nova-compute[71731]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 16:33:44 user nova-compute[71731]:     <timer name="hpet" present="no"/>
Apr 13 16:33:44 user nova-compute[71731]:   </clock>
Apr 13 16:33:44 user nova-compute[71731]:   <cpu mode="custom" match="exact">
Apr 13 16:33:44 user nova-compute[71731]:     <model>Nehalem</model>
Apr 13 16:33:44 user nova-compute[71731]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 16:33:44 user nova-compute[71731]:   </cpu>
Apr 13 16:33:44 user nova-compute[71731]:   <devices>
Apr 13 16:33:44 user nova-compute[71731]:     <disk type="block" device="disk">
Apr 13 16:33:44 user nova-compute[71731]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 16:33:44 user nova-compute[71731]:       <source dev="/dev/sdd"/>
Apr 13 16:33:44 user nova-compute[71731]:       <target dev="vda" bus="virtio"/>
Apr 13 16:33:44 user nova-compute[71731]:       <serial>25c3dc97-c9cb-4529-ab32-26ef7fd94fc6</serial>
Apr 13 16:33:44 user nova-compute[71731]:     </disk>
Apr 13 16:33:44 user nova-compute[71731]:     <disk type="file" device="disk">
Apr 13 16:33:44 user nova-compute[71731]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 16:33:44 user nova-compute[71731]:       <source file="/opt/stack/data/nova/instances/2956ab05-28ff-4c9e-b646-dbb83b3db278/disk.rescue"/>
Apr 13 16:33:44 user nova-compute[71731]:       <target dev="vdb" bus="virtio"/>
Apr 13 16:33:44 user nova-compute[71731]:       <boot order="1"/>
Apr 13 16:33:44 user nova-compute[71731]:     </disk>
Apr 13 16:33:44 user nova-compute[71731]:     <interface type="ethernet">
Apr 13 16:33:44 user nova-compute[71731]:       <mac address="fa:16:3e:66:e8:40"/>
Apr 13 16:33:44 user nova-compute[71731]:       <model type="virtio"/>
Apr 13 16:33:44 user nova-compute[71731]:       <mtu size="1442"/>
Apr 13 16:33:44 user nova-compute[71731]:       <target dev="tap84df62e9-af"/>
Apr 13 16:33:44 user nova-compute[71731]:     </interface>
Apr 13 16:33:44 user nova-compute[71731]:     <serial type="pty">
Apr 13 16:33:44 user nova-compute[71731]:       <log file="/opt/stack/data/nova/instances/2956ab05-28ff-4c9e-b646-dbb83b3db278/console.log" append="off"/>
Apr 13 16:33:44 user nova-compute[71731]:     </serial>
Apr 13 16:33:44 user nova-compute[71731]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 16:33:44 user nova-compute[71731]:     <video>
Apr 13 16:33:44 user nova-compute[71731]:       <model type="virtio"/>
Apr 13 16:33:44 user nova-compute[71731]:     </video>
Apr 13 16:33:44 user nova-compute[71731]:     <rng model="virtio">
Apr 13 16:33:44 user nova-compute[71731]:       <backend model="random">/dev/urandom</backend>
Apr 13 16:33:44 user nova-compute[71731]:     </rng>
Apr 13 16:33:44 user nova-compute[71731]:     <controller type="usb" index="0" model="none"/>
Apr 13 16:33:44 user nova-compute[71731]:     <memballoon model="virtio">
Apr 13 16:33:44 user nova-compute[71731]:       <stats period="10"/>
Apr 13 16:33:44 user nova-compute[71731]:     </memballoon>
Apr 13 16:33:44 user nova-compute[71731]:   </devices>
Apr 13 16:33:44 user nova-compute[71731]: </domain>
Apr 13 16:33:44 user nova-compute[71731]:  {{(pid=71731) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 16:33:44 user nova-compute[71731]: INFO nova.virt.libvirt.driver [-] [instance: 2956ab05-28ff-4c9e-b646-dbb83b3db278] Instance destroyed successfully.
Apr 13 16:33:44 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-7a4228be-7d95-4c80-9921-33ea02b45ca4 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Acquiring lock "64a9c052-89a9-48ba-80c9-13fb5ef22f0e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:33:44 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-7a4228be-7d95-4c80-9921-33ea02b45ca4 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Lock "64a9c052-89a9-48ba-80c9-13fb5ef22f0e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:33:44 user nova-compute[71731]: INFO nova.compute.manager [None req-7a4228be-7d95-4c80-9921-33ea02b45ca4 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] [instance: 64a9c052-89a9-48ba-80c9-13fb5ef22f0e] Attaching volume f98a26ac-2506-4887-9d1d-277e6593f3ed to /dev/vdb
Apr 13 16:33:44 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-783f65e2-4244-4675-8e98-3254f212235f tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] No BDM found with device name vda, not building metadata. {{(pid=71731) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 16:33:44 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-783f65e2-4244-4675-8e98-3254f212235f tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71731) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 16:33:44 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-783f65e2-4244-4675-8e98-3254f212235f tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] No VIF found with MAC fa:16:3e:66:e8:40, not building metadata {{(pid=71731) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 16:33:44 user nova-compute[71731]: DEBUG os_brick.utils [None req-7a4228be-7d95-4c80-9921-33ea02b45ca4 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 16:33:44 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:33:44 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:33:44 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cdc782a-0952-4694-a5cb-16859186c84b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:81501d91421\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:33:44 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:33:44 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:33:44 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[481faeb8-b8f9-4ebf-9e5b-98f89e3c1b81]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:33:44 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:33:44 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:33:44 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[735563e7-a175-4f9f-a3d4-6504e105b869]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:33:44 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[2312cc8c-552c-4429-aae7-7f9671071fbe]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:33:44 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-7a4228be-7d95-4c80-9921-33ea02b45ca4 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Running cmd (subprocess): nvme version {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:33:44 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-7a4228be-7d95-4c80-9921-33ea02b45ca4 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] 'nvme version' failed. Not Retrying. {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 16:33:44 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7a4228be-7d95-4c80-9921-33ea02b45ca4 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] nvme not present on system {{(pid=71731) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 16:33:44 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:33:44 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 16:33:44 user nova-compute[71731]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 16:33:44 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fe92f38-65f8-4d9d-8b50-db5100525f60]: (4, '') {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:33:44 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.lightos [None req-7a4228be-7d95-4c80-9921-33ea02b45ca4 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71731) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 16:33:44 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.lightos [None req-7a4228be-7d95-4c80-9921-33ea02b45ca4 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71731) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 16:33:44 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.lightos [None req-7a4228be-7d95-4c80-9921-33ea02b45ca4 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] LIGHTOS: no hostnqn found. {{(pid=71731) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 16:33:44 user nova-compute[71731]: DEBUG os_brick.utils [None req-7a4228be-7d95-4c80-9921-33ea02b45ca4 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] <== get_connector_properties: return (146ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:81501d91421', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 16:33:44 user nova-compute[71731]: DEBUG nova.virt.block_device [None req-7a4228be-7d95-4c80-9921-33ea02b45ca4 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] [instance: 64a9c052-89a9-48ba-80c9-13fb5ef22f0e] Updating existing volume attachment record: c3d368b2-e1f4-46a2-ba5a-10564e68290c {{(pid=71731) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 16:33:44 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-bfd24b75-e454-49de-89a1-812ee7937e6e tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] No BDM found with device name vda, not building metadata. {{(pid=71731) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 16:33:44 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-bfd24b75-e454-49de-89a1-812ee7937e6e tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71731) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 16:33:44 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-bfd24b75-e454-49de-89a1-812ee7937e6e tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] No VIF found with MAC fa:16:3e:76:1a:b3, not building metadata {{(pid=71731) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 16:33:44 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-bfd24b75-e454-49de-89a1-812ee7937e6e tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Lock "bf98c3a2-dbeb-4ae4-8423-ce55964c4258" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.246s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:33:45 user nova-compute[71731]: DEBUG nova.compute.manager [req-e75b9d45-9f78-4134-ae79-a904a979308b req-c5d37fe3-2c91-496d-9d2b-b9e8988442eb service nova] [instance: 64a9c052-89a9-48ba-80c9-13fb5ef22f0e] Received event network-changed-5128334f-7255-4a56-9e8b-1151027d219b {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:33:45 user nova-compute[71731]: DEBUG nova.compute.manager [req-e75b9d45-9f78-4134-ae79-a904a979308b req-c5d37fe3-2c91-496d-9d2b-b9e8988442eb service nova] [instance: 64a9c052-89a9-48ba-80c9-13fb5ef22f0e] Refreshing instance network info cache due to event network-changed-5128334f-7255-4a56-9e8b-1151027d219b. {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 16:33:45 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-e75b9d45-9f78-4134-ae79-a904a979308b req-c5d37fe3-2c91-496d-9d2b-b9e8988442eb service nova] Acquiring lock "refresh_cache-64a9c052-89a9-48ba-80c9-13fb5ef22f0e" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 16:33:45 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-e75b9d45-9f78-4134-ae79-a904a979308b req-c5d37fe3-2c91-496d-9d2b-b9e8988442eb service nova] Acquired lock "refresh_cache-64a9c052-89a9-48ba-80c9-13fb5ef22f0e" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 16:33:45 user nova-compute[71731]: DEBUG nova.network.neutron [req-e75b9d45-9f78-4134-ae79-a904a979308b req-c5d37fe3-2c91-496d-9d2b-b9e8988442eb service nova] [instance: 64a9c052-89a9-48ba-80c9-13fb5ef22f0e] Refreshing network info cache for port 5128334f-7255-4a56-9e8b-1151027d219b {{(pid=71731) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 16:33:45 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:33:45 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:33:45 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:33:45 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:33:45 user nova-compute[71731]: DEBUG nova.compute.manager [req-75e83c33-4e0a-4a39-beb3-6aa3856637b6 req-19b79c11-75e7-45dd-b5da-1695f432fc21 service nova] [instance: 35b23303-e373-4f35-b7ee-76e6815073ce] Received event network-changed-d3c66e4e-b15d-4bc9-a838-265ca07a6a66 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:33:45 user nova-compute[71731]: DEBUG nova.compute.manager [req-75e83c33-4e0a-4a39-beb3-6aa3856637b6 req-19b79c11-75e7-45dd-b5da-1695f432fc21 service nova] [instance: 35b23303-e373-4f35-b7ee-76e6815073ce] Refreshing instance network info cache due to event network-changed-d3c66e4e-b15d-4bc9-a838-265ca07a6a66. {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 16:33:45 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-75e83c33-4e0a-4a39-beb3-6aa3856637b6 req-19b79c11-75e7-45dd-b5da-1695f432fc21 service nova] Acquiring lock "refresh_cache-35b23303-e373-4f35-b7ee-76e6815073ce" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 16:33:45 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-75e83c33-4e0a-4a39-beb3-6aa3856637b6 req-19b79c11-75e7-45dd-b5da-1695f432fc21 service nova] Acquired lock "refresh_cache-35b23303-e373-4f35-b7ee-76e6815073ce" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 16:33:45 user nova-compute[71731]: DEBUG nova.network.neutron [req-75e83c33-4e0a-4a39-beb3-6aa3856637b6 req-19b79c11-75e7-45dd-b5da-1695f432fc21 service nova] [instance: 35b23303-e373-4f35-b7ee-76e6815073ce] Refreshing network info cache for port d3c66e4e-b15d-4bc9-a838-265ca07a6a66 {{(pid=71731) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 16:33:45 user nova-compute[71731]: DEBUG nova.network.neutron [req-e75b9d45-9f78-4134-ae79-a904a979308b req-c5d37fe3-2c91-496d-9d2b-b9e8988442eb service nova] [instance: 64a9c052-89a9-48ba-80c9-13fb5ef22f0e] Updated VIF entry in instance network info cache for port 5128334f-7255-4a56-9e8b-1151027d219b. {{(pid=71731) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 16:33:45 user nova-compute[71731]: DEBUG nova.network.neutron [req-e75b9d45-9f78-4134-ae79-a904a979308b req-c5d37fe3-2c91-496d-9d2b-b9e8988442eb service nova] [instance: 64a9c052-89a9-48ba-80c9-13fb5ef22f0e] Updating instance_info_cache with network_info: [{"id": "5128334f-7255-4a56-9e8b-1151027d219b", "address": "fa:16:3e:fe:54:1c", "network": {"id": "11386312-9ac6-4252-ab98-b3298a08599c", "bridge": "br-int", "label": "tempest-TestStampPattern-1747654565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb7100b359f341759cb6f6753e1539a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5128334f-72", "ovs_interfaceid": "5128334f-7255-4a56-9e8b-1151027d219b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:33:45 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-e75b9d45-9f78-4134-ae79-a904a979308b req-c5d37fe3-2c91-496d-9d2b-b9e8988442eb service nova] Releasing lock "refresh_cache-64a9c052-89a9-48ba-80c9-13fb5ef22f0e" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 16:33:46 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:33:46 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:33:46 user nova-compute[71731]: DEBUG nova.compute.manager [req-9b8e7169-1dde-4fdd-a9a1-1760fe3eb2c0 req-2cda6bcc-0081-4788-a3e0-903286da08f1 service nova] [instance: 2956ab05-28ff-4c9e-b646-dbb83b3db278] Received event network-vif-plugged-84df62e9-af7c-4e62-83da-b43b511be2a0 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:33:46 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-9b8e7169-1dde-4fdd-a9a1-1760fe3eb2c0 req-2cda6bcc-0081-4788-a3e0-903286da08f1 service nova] Acquiring lock "2956ab05-28ff-4c9e-b646-dbb83b3db278-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:33:46 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-9b8e7169-1dde-4fdd-a9a1-1760fe3eb2c0 req-2cda6bcc-0081-4788-a3e0-903286da08f1 service nova] Lock "2956ab05-28ff-4c9e-b646-dbb83b3db278-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:33:46 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-9b8e7169-1dde-4fdd-a9a1-1760fe3eb2c0 req-2cda6bcc-0081-4788-a3e0-903286da08f1 service nova] Lock "2956ab05-28ff-4c9e-b646-dbb83b3db278-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:33:46 user nova-compute[71731]: DEBUG nova.compute.manager [req-9b8e7169-1dde-4fdd-a9a1-1760fe3eb2c0 req-2cda6bcc-0081-4788-a3e0-903286da08f1 service nova] [instance: 2956ab05-28ff-4c9e-b646-dbb83b3db278] No waiting events found dispatching network-vif-plugged-84df62e9-af7c-4e62-83da-b43b511be2a0 {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:33:46 user nova-compute[71731]: WARNING nova.compute.manager [req-9b8e7169-1dde-4fdd-a9a1-1760fe3eb2c0 req-2cda6bcc-0081-4788-a3e0-903286da08f1 service nova] [instance: 2956ab05-28ff-4c9e-b646-dbb83b3db278] Received unexpected event network-vif-plugged-84df62e9-af7c-4e62-83da-b43b511be2a0 for instance with vm_state active and task_state rescuing.
Apr 13 16:33:46 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-40dab86b-81bd-4e34-8302-b3bcd09309bb tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Acquiring lock "bf98c3a2-dbeb-4ae4-8423-ce55964c4258" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:33:46 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-40dab86b-81bd-4e34-8302-b3bcd09309bb tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Lock "bf98c3a2-dbeb-4ae4-8423-ce55964c4258" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:33:46 user nova-compute[71731]: INFO nova.compute.manager [None req-40dab86b-81bd-4e34-8302-b3bcd09309bb tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] [instance: bf98c3a2-dbeb-4ae4-8423-ce55964c4258] Detaching volume 83d71596-07bc-438e-a163-92acd11239d8
Apr 13 16:33:46 user nova-compute[71731]: INFO nova.virt.block_device [None req-40dab86b-81bd-4e34-8302-b3bcd09309bb tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] [instance: bf98c3a2-dbeb-4ae4-8423-ce55964c4258] Attempting to driver detach volume 83d71596-07bc-438e-a163-92acd11239d8 from mountpoint /dev/vdb
Apr 13 16:33:46 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:33:46 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-40dab86b-81bd-4e34-8302-b3bcd09309bb tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Attempting to detach device vdb from instance bf98c3a2-dbeb-4ae4-8423-ce55964c4258 from the persistent domain config. {{(pid=71731) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 13 16:33:46 user nova-compute[71731]: DEBUG nova.virt.libvirt.guest [None req-40dab86b-81bd-4e34-8302-b3bcd09309bb tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 16:33:46 user nova-compute[71731]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 16:33:46 user nova-compute[71731]:   <source dev="/dev/sdf"/>
Apr 13 16:33:46 user nova-compute[71731]:   <target dev="vdb" bus="virtio"/>
Apr 13 16:33:46 user nova-compute[71731]:   <serial>83d71596-07bc-438e-a163-92acd11239d8</serial>
Apr 13 16:33:46 user nova-compute[71731]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 13 16:33:46 user nova-compute[71731]: </disk>
Apr 13 16:33:46 user nova-compute[71731]:  {{(pid=71731) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 16:33:46 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-40dab86b-81bd-4e34-8302-b3bcd09309bb tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Successfully detached device vdb from instance bf98c3a2-dbeb-4ae4-8423-ce55964c4258 from the persistent domain config.
Apr 13 16:33:46 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-40dab86b-81bd-4e34-8302-b3bcd09309bb tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance bf98c3a2-dbeb-4ae4-8423-ce55964c4258 from the live domain config. {{(pid=71731) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 13 16:33:46 user nova-compute[71731]: DEBUG nova.virt.libvirt.guest [None req-40dab86b-81bd-4e34-8302-b3bcd09309bb tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 16:33:46 user nova-compute[71731]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 16:33:46 user nova-compute[71731]:   <source dev="/dev/sdf"/>
Apr 13 16:33:46 user nova-compute[71731]:   <target dev="vdb" bus="virtio"/>
Apr 13 16:33:46 user nova-compute[71731]:   <serial>83d71596-07bc-438e-a163-92acd11239d8</serial>
Apr 13 16:33:46 user nova-compute[71731]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 13 16:33:46 user nova-compute[71731]: </disk>
Apr 13 16:33:46 user nova-compute[71731]:  {{(pid=71731) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 16:33:46 user nova-compute[71731]: DEBUG nova.network.neutron [req-75e83c33-4e0a-4a39-beb3-6aa3856637b6 req-19b79c11-75e7-45dd-b5da-1695f432fc21 service nova] [instance: 35b23303-e373-4f35-b7ee-76e6815073ce] Updated VIF entry in instance network info cache for port d3c66e4e-b15d-4bc9-a838-265ca07a6a66. {{(pid=71731) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 16:33:46 user nova-compute[71731]: DEBUG nova.network.neutron [req-75e83c33-4e0a-4a39-beb3-6aa3856637b6 req-19b79c11-75e7-45dd-b5da-1695f432fc21 service nova] [instance: 35b23303-e373-4f35-b7ee-76e6815073ce] Updating instance_info_cache with network_info: [{"id": "d3c66e4e-b15d-4bc9-a838-265ca07a6a66", "address": "fa:16:3e:3a:4e:db", "network": {"id": "5acc9a78-1127-46df-bb60-7544cdd2c1ef", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2143082515-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0653ab16660b46cea9c5af58ea0b1931", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3c66e4e-b1", "ovs_interfaceid": "d3c66e4e-b15d-4bc9-a838-265ca07a6a66", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:33:46 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-75e83c33-4e0a-4a39-beb3-6aa3856637b6 req-19b79c11-75e7-45dd-b5da-1695f432fc21 service nova] Releasing lock "refresh_cache-35b23303-e373-4f35-b7ee-76e6815073ce" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 16:33:46 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Received event <DeviceRemovedEvent: 1681403626.83617, bf98c3a2-dbeb-4ae4-8423-ce55964c4258 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71731) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 13 16:33:46 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-40dab86b-81bd-4e34-8302-b3bcd09309bb tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance bf98c3a2-dbeb-4ae4-8423-ce55964c4258 {{(pid=71731) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 13 16:33:46 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:33:46 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-40dab86b-81bd-4e34-8302-b3bcd09309bb tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Successfully detached device vdb from instance bf98c3a2-dbeb-4ae4-8423-ce55964c4258 from the live domain config.
Apr 13 16:33:46 user nova-compute[71731]: DEBUG nova.virt.libvirt.volume.iscsi [None req-40dab86b-81bd-4e34-8302-b3bcd09309bb tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] [instance: bf98c3a2-dbeb-4ae4-8423-ce55964c4258] calling os-brick to detach iSCSI Volume {{(pid=71731) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 16:33:46 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-40dab86b-81bd-4e34-8302-b3bcd09309bb tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8cf0118790>, {'target_iqn': 'iqn.2010-10.org.openstack:83d71596-07bc-438e-a163-92acd11239d8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aYMBOhep', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf': {}}" {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 16:33:46 user nova-compute[71731]: WARNING os_brick.initiator.connectors.base [None req-40dab86b-81bd-4e34-8302-b3bcd09309bb tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 16:33:46 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-40dab86b-81bd-4e34-8302-b3bcd09309bb tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 16:33:46 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-40dab86b-81bd-4e34-8302-b3bcd09309bb tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 16:33:46 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:33:46 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:33:46 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f71470a-409b-4110-b547-65b733f2266d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c2088266-1d33-4bb1-ac5b-1de832ff7985\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:25c3dc97-c9cb-4529-ab32-26ef7fd94fc6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:651ea766-ffda-42a1-9b3c-7be05a92c85f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:83d71596-07bc-438e-a163-92acd11239d8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:33:46 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-40dab86b-81bd-4e34-8302-b3bcd09309bb tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 16:33:46 user nova-compute[71731]: No targets found.
Apr 13 16:33:46 user nova-compute[71731]: iSNS:
Apr 13 16:33:46 user nova-compute[71731]: No targets found.
Apr 13 16:33:46 user nova-compute[71731]: STATIC:
Apr 13 16:33:46 user nova-compute[71731]: Target: iqn.2010-10.org.openstack:c2088266-1d33-4bb1-ac5b-1de832ff7985
Apr 13 16:33:46 user nova-compute[71731]:         Portal: 172.16.0.220:3260,-1
Apr 13 16:33:46 user nova-compute[71731]:                 Iface Name: default
Apr 13 16:33:46 user nova-compute[71731]: Target: iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97
Apr 13 16:33:46 user nova-compute[71731]:         Portal: 172.16.0.220:3260,-1
Apr 13 16:33:46 user nova-compute[71731]:                 Iface Name: default
Apr 13 16:33:46 user nova-compute[71731]: Target: iqn.2010-10.org.openstack:25c3dc97-c9cb-4529-ab32-26ef7fd94fc6
Apr 13 16:33:46 user nova-compute[71731]:         Portal: 172.16.0.220:3260,-1
Apr 13 16:33:46 user nova-compute[71731]:                 Iface Name: default
Apr 13 16:33:46 user nova-compute[71731]: Target: iqn.2010-10.org.openstack:651ea766-ffda-42a1-9b3c-7be05a92c85f
Apr 13 16:33:46 user nova-compute[71731]:         Portal: 172.16.0.220:3260,-1
Apr 13 16:33:46 user nova-compute[71731]:                 Iface Name: default
Apr 13 16:33:46 user nova-compute[71731]: Target: iqn.2010-10.org.openstack:83d71596-07bc-438e-a163-92acd11239d8
Apr 13 16:33:46 user nova-compute[71731]:         Portal: 172.16.0.220:3260,-1
Apr 13 16:33:46 user nova-compute[71731]:                 Iface Name: default
Apr 13 16:33:46 user nova-compute[71731]: FIRMWARE:
Apr 13 16:33:46 user nova-compute[71731]: No targets found.
Apr 13 16:33:46 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 16:33:46 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-40dab86b-81bd-4e34-8302-b3bcd09309bb tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 16:33:46 user nova-compute[71731]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 16:33:46 user nova-compute[71731]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71731) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 16:33:46 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-40dab86b-81bd-4e34-8302-b3bcd09309bb tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:83d71596-07bc-438e-a163-92acd11239d8', 0)] {{(pid=71731) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 16:33:46 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:33:46 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:33:46 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[85534851-8c0e-4f3a-b7a1-deef11491f7a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:25c3dc97-c9cb-4529-ab32-26ef7fd94fc6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:651ea766-ffda-42a1-9b3c-7be05a92c85f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:83d71596-07bc-438e-a163-92acd11239d8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c2088266-1d33-4bb1-ac5b-1de832ff7985\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:33:46 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:33:46 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:33:46 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f87dac1-677e-45f6-9e8c-0679a7e6b5e9]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25c3dc97-c9cb-4529-ab32-26ef7fd94fc6 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:651ea766-ffda-42a1-9b3c-7be05a92c85f (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2088266-1d33-4bb1-ac5b-1de832ff7985 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83d71596-07bc-438e-a163-92acd11239d8 (non-flash)\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:33:46 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-40dab86b-81bd-4e34-8302-b3bcd09309bb tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)
Apr 13 16:33:46 user nova-compute[71731]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25c3dc97-c9cb-4529-ab32-26ef7fd94fc6 (non-flash)
Apr 13 16:33:46 user nova-compute[71731]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:651ea766-ffda-42a1-9b3c-7be05a92c85f (non-flash)
Apr 13 16:33:46 user nova-compute[71731]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2088266-1d33-4bb1-ac5b-1de832ff7985 (non-flash)
Apr 13 16:33:46 user nova-compute[71731]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83d71596-07bc-438e-a163-92acd11239d8 (non-flash)
Apr 13 16:33:46 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 16:33:46 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-40dab86b-81bd-4e34-8302-b3bcd09309bb tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)
Apr 13 16:33:46 user nova-compute[71731]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25c3dc97-c9cb-4529-ab32-26ef7fd94fc6 (non-flash)
Apr 13 16:33:46 user nova-compute[71731]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:651ea766-ffda-42a1-9b3c-7be05a92c85f (non-flash)
Apr 13 16:33:46 user nova-compute[71731]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2088266-1d33-4bb1-ac5b-1de832ff7985 (non-flash)
Apr 13 16:33:46 user nova-compute[71731]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83d71596-07bc-438e-a163-92acd11239d8 (non-flash)
Apr 13 16:33:46 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 16:33:46 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-40dab86b-81bd-4e34-8302-b3bcd09309bb tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8cd02deb00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:83d71596-07bc-438e-a163-92acd11239d8'): ({'sdf'}, set())}) {{(pid=71731) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 16:33:46 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-40dab86b-81bd-4e34-8302-b3bcd09309bb tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Removing single pathed devices sdf {{(pid=71731) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 16:33:46 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:33:46 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.029s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:33:46 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c0441c1-197f-4b5a-85f4-9ec63683165f]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:33:46 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:33:47 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:33:47 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[87da4891-7811-4a4d-8a1f-d108bc34172b]: (4, ('ok\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:33:47 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-40dab86b-81bd-4e34-8302-b3bcd09309bb tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Flushing IO for device /dev/sdf {{(pid=71731) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 16:33:47 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:33:47 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.015s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:33:47 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0450414-9022-43a5-a0b5-867d1b6705b9]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:33:47 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-40dab86b-81bd-4e34-8302-b3bcd09309bb tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=71731) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 16:33:47 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:33:47 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.039s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:33:47 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[954f2f8b-c2d6-4b56-aa1f-da1cdbba44f2]: (4, ('1', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:33:47 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-40dab86b-81bd-4e34-8302-b3bcd09309bb tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=71731) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 16:33:47 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-40dab86b-81bd-4e34-8302-b3bcd09309bb tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] SCSI volumes sdf have been removed. {{(pid=71731) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 16:33:47 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-40dab86b-81bd-4e34-8302-b3bcd09309bb tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:83d71596-07bc-438e-a163-92acd11239d8')] {{(pid=71731) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 16:33:47 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83d71596-07bc-438e-a163-92acd11239d8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:33:47 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83d71596-07bc-438e-a163-92acd11239d8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:33:47 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dd4aa19-ee36-4ba5-b8ae-b1d5fbf38bfd]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:33:47 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-40dab86b-81bd-4e34-8302-b3bcd09309bb tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:33:47 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83d71596-07bc-438e-a163-92acd11239d8 -p 172.16.0.220:3260 --logout {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:33:47 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83d71596-07bc-438e-a163-92acd11239d8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:33:47 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6234f0d-3b88-4bc6-815c-2fbac615b313]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:83d71596-07bc-438e-a163-92acd11239d8, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:83d71596-07bc-438e-a163-92acd11239d8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:33:47 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-40dab86b-81bd-4e34-8302-b3bcd09309bb tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:83d71596-07bc-438e-a163-92acd11239d8, portal: 172.16.0.220,3260]
Apr 13 16:33:47 user nova-compute[71731]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:83d71596-07bc-438e-a163-92acd11239d8, portal: 172.16.0.220,3260] successful.
Apr 13 16:33:47 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:33:47 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83d71596-07bc-438e-a163-92acd11239d8 -p 172.16.0.220:3260 --op delete {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:33:47 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83d71596-07bc-438e-a163-92acd11239d8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:33:47 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c217191-7faf-4a57-9c3e-ef1606f89b7d]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:33:47 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-40dab86b-81bd-4e34-8302-b3bcd09309bb tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:33:47 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-40dab86b-81bd-4e34-8302-b3bcd09309bb tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.341s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 16:33:47 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-40dab86b-81bd-4e34-8302-b3bcd09309bb tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] <== disconnect_volume: return (343ms) None {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 16:33:47 user nova-compute[71731]: DEBUG nova.virt.libvirt.volume.iscsi [None req-40dab86b-81bd-4e34-8302-b3bcd09309bb tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] [instance: bf98c3a2-dbeb-4ae4-8423-ce55964c4258] Disconnected iSCSI Volume {{(pid=71731) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 16:33:48 user nova-compute[71731]: DEBUG nova.virt.libvirt.host [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Removed pending event for 2956ab05-28ff-4c9e-b646-dbb83b3db278 due to event {{(pid=71731) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 13 16:33:48 user nova-compute[71731]: DEBUG nova.virt.driver [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Emitting event <LifecycleEvent: 1681403628.0023537, 2956ab05-28ff-4c9e-b646-dbb83b3db278 => Resumed> {{(pid=71731) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 16:33:48 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 2956ab05-28ff-4c9e-b646-dbb83b3db278] VM Resumed (Lifecycle Event)
Apr 13 16:33:48 user nova-compute[71731]: DEBUG nova.compute.manager [None req-783f65e2-4244-4675-8e98-3254f212235f tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: 2956ab05-28ff-4c9e-b646-dbb83b3db278] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:33:48 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 2956ab05-28ff-4c9e-b646-dbb83b3db278] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:33:48 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 2956ab05-28ff-4c9e-b646-dbb83b3db278] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71731) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 16:33:48 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 2956ab05-28ff-4c9e-b646-dbb83b3db278] During sync_power_state the instance has a pending task (rescuing). Skip.
Apr 13 16:33:48 user nova-compute[71731]: DEBUG nova.virt.driver [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Emitting event <LifecycleEvent: 1681403628.005883, 2956ab05-28ff-4c9e-b646-dbb83b3db278 => Started> {{(pid=71731) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 16:33:48 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 2956ab05-28ff-4c9e-b646-dbb83b3db278] VM Started (Lifecycle Event)
Apr 13 16:33:48 user nova-compute[71731]: DEBUG nova.compute.manager [req-6e3fefb2-38ba-4428-a5cd-29028fca8089 req-36e7e696-006f-4a68-8414-b3c90ff26557 service nova] [instance: 2956ab05-28ff-4c9e-b646-dbb83b3db278] Received event network-vif-plugged-84df62e9-af7c-4e62-83da-b43b511be2a0 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:33:48 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-6e3fefb2-38ba-4428-a5cd-29028fca8089 req-36e7e696-006f-4a68-8414-b3c90ff26557 service nova] Acquiring lock "2956ab05-28ff-4c9e-b646-dbb83b3db278-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:33:48 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-6e3fefb2-38ba-4428-a5cd-29028fca8089 req-36e7e696-006f-4a68-8414-b3c90ff26557 service nova] Lock "2956ab05-28ff-4c9e-b646-dbb83b3db278-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:33:48 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-6e3fefb2-38ba-4428-a5cd-29028fca8089 req-36e7e696-006f-4a68-8414-b3c90ff26557 service nova] Lock "2956ab05-28ff-4c9e-b646-dbb83b3db278-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:33:48 user nova-compute[71731]: DEBUG nova.compute.manager [req-6e3fefb2-38ba-4428-a5cd-29028fca8089 req-36e7e696-006f-4a68-8414-b3c90ff26557 service nova] [instance: 2956ab05-28ff-4c9e-b646-dbb83b3db278] No waiting events found dispatching network-vif-plugged-84df62e9-af7c-4e62-83da-b43b511be2a0 {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:33:48 user nova-compute[71731]: WARNING nova.compute.manager [req-6e3fefb2-38ba-4428-a5cd-29028fca8089 req-36e7e696-006f-4a68-8414-b3c90ff26557 service nova] [instance: 2956ab05-28ff-4c9e-b646-dbb83b3db278] Received unexpected event network-vif-plugged-84df62e9-af7c-4e62-83da-b43b511be2a0 for instance with vm_state active and task_state rescuing.
Apr 13 16:33:48 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 2956ab05-28ff-4c9e-b646-dbb83b3db278] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:33:48 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 2956ab05-28ff-4c9e-b646-dbb83b3db278] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71731) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 16:33:48 user nova-compute[71731]: DEBUG nova.objects.instance [None req-40dab86b-81bd-4e34-8302-b3bcd09309bb tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Lazy-loading 'flavor' on Instance uuid bf98c3a2-dbeb-4ae4-8423-ce55964c4258 {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:33:48 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-40dab86b-81bd-4e34-8302-b3bcd09309bb tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Lock "bf98c3a2-dbeb-4ae4-8423-ce55964c4258" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.052s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:33:50 user nova-compute[71731]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7a4228be-7d95-4c80-9921-33ea02b45ca4 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] [instance: 64a9c052-89a9-48ba-80c9-13fb5ef22f0e] Calling os-brick to attach iSCSI Volume {{(pid=71731) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 16:33:50 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a4228be-7d95-4c80-9921-33ea02b45ca4 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8cf0118790>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f98a26ac-2506-4887-9d1d-277e6593f3ed', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AbJUhkur', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 16:33:50 user nova-compute[71731]: WARNING os_brick.initiator.connectors.base [None req-7a4228be-7d95-4c80-9921-33ea02b45ca4 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 16:33:50 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-7a4228be-7d95-4c80-9921-33ea02b45ca4 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 16:33:50 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-7a4228be-7d95-4c80-9921-33ea02b45ca4 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 16:33:50 user nova-compute[71731]: WARNING os_brick.initiator.connectors.base [None req-7a4228be-7d95-4c80-9921-33ea02b45ca4 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 16:33:50 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-7a4228be-7d95-4c80-9921-33ea02b45ca4 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f98a26ac-2506-4887-9d1d-277e6593f3ed" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 16:33:50 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-7a4228be-7d95-4c80-9921-33ea02b45ca4 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f98a26ac-2506-4887-9d1d-277e6593f3ed" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 16:33:50 user nova-compute[71731]: INFO os_brick.initiator.connectors.iscsi [None req-7a4228be-7d95-4c80-9921-33ea02b45ca4 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 16:33:50 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f98a26ac-2506-4887-9d1d-277e6593f3ed -p 172.16.0.220:3260 {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:33:50 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f98a26ac-2506-4887-9d1d-277e6593f3ed -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:33:50 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd9652c2-e5ff-423a-82b3-1390c94105ec]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:33:50 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a4228be-7d95-4c80-9921-33ea02b45ca4 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 16:33:50 user nova-compute[71731]:  {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:33:50 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f98a26ac-2506-4887-9d1d-277e6593f3ed -p 172.16.0.220:3260 --interface default --op new {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:33:50 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f98a26ac-2506-4887-9d1d-277e6593f3ed -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:33:50 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7335a38-8b36-4f6c-a910-fa20a82c73bc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f98a26ac-2506-4887-9d1d-277e6593f3ed] added\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:33:50 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a4228be-7d95-4c80-9921-33ea02b45ca4 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f98a26ac-2506-4887-9d1d-277e6593f3ed] added
Apr 13 16:33:50 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:33:50 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f98a26ac-2506-4887-9d1d-277e6593f3ed -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:33:50 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f98a26ac-2506-4887-9d1d-277e6593f3ed -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:33:50 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[36c18abe-71df-45df-8db5-53f2abe7f873]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:33:50 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a4228be-7d95-4c80-9921-33ea02b45ca4 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:33:50 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f98a26ac-2506-4887-9d1d-277e6593f3ed -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:33:50 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f98a26ac-2506-4887-9d1d-277e6593f3ed -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:33:50 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[c33322f2-1fcd-41ce-993a-cb1115002d9d]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:33:50 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a4228be-7d95-4c80-9921-33ea02b45ca4 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:33:50 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f98a26ac-2506-4887-9d1d-277e6593f3ed -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AbJUhkur {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:33:50 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f98a26ac-2506-4887-9d1d-277e6593f3ed -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AbJUhkur" returned: 0 in 0.021s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:33:50 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bc4ba43-9457-4161-a892-63bb05c48ee0]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:33:50 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a4228be-7d95-4c80-9921-33ea02b45ca4 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AbJUhkur'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:33:50 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f98a26ac-2506-4887-9d1d-277e6593f3ed -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:33:50 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f98a26ac-2506-4887-9d1d-277e6593f3ed -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:33:50 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[082cc810-021b-4be6-ab89-b3170167f87f]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:33:50 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a4228be-7d95-4c80-9921-33ea02b45ca4 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:33:50 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:33:50 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:33:50 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[676bf0f7-a242-49eb-9a33-cdd791bb8161]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25c3dc97-c9cb-4529-ab32-26ef7fd94fc6 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:651ea766-ffda-42a1-9b3c-7be05a92c85f (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2088266-1d33-4bb1-ac5b-1de832ff7985 (non-flash)\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:33:50 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a4228be-7d95-4c80-9921-33ea02b45ca4 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)
Apr 13 16:33:50 user nova-compute[71731]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25c3dc97-c9cb-4529-ab32-26ef7fd94fc6 (non-flash)
Apr 13 16:33:50 user nova-compute[71731]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:651ea766-ffda-42a1-9b3c-7be05a92c85f (non-flash)
Apr 13 16:33:50 user nova-compute[71731]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2088266-1d33-4bb1-ac5b-1de832ff7985 (non-flash)
Apr 13 16:33:50 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 16:33:50 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a4228be-7d95-4c80-9921-33ea02b45ca4 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)
Apr 13 16:33:50 user nova-compute[71731]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25c3dc97-c9cb-4529-ab32-26ef7fd94fc6 (non-flash)
Apr 13 16:33:50 user nova-compute[71731]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:651ea766-ffda-42a1-9b3c-7be05a92c85f (non-flash)
Apr 13 16:33:50 user nova-compute[71731]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2088266-1d33-4bb1-ac5b-1de832ff7985 (non-flash)
Apr 13 16:33:50 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 16:33:50 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f98a26ac-2506-4887-9d1d-277e6593f3ed -p 172.16.0.220:3260 --login {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:33:50 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f98a26ac-2506-4887-9d1d-277e6593f3ed -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:33:50 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd933824-6901-4ed8-837c-6e40ec2c3e85]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f98a26ac-2506-4887-9d1d-277e6593f3ed, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f98a26ac-2506-4887-9d1d-277e6593f3ed, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:33:50 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a4228be-7d95-4c80-9921-33ea02b45ca4 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f98a26ac-2506-4887-9d1d-277e6593f3ed, portal: 172.16.0.220,3260]
Apr 13 16:33:50 user nova-compute[71731]: Login to [iface: default, target: iqn.2010-10.org.openstack:f98a26ac-2506-4887-9d1d-277e6593f3ed, portal: 172.16.0.220,3260] successful.
Apr 13 16:33:50 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:33:50 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f98a26ac-2506-4887-9d1d-277e6593f3ed -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:33:50 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f98a26ac-2506-4887-9d1d-277e6593f3ed -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:33:50 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[e311e91f-ca0c-42a4-a2a7-20d6c775f9a9]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:33:50 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a4228be-7d95-4c80-9921-33ea02b45ca4 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:33:50 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:33:50 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:33:50 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[118c4394-9935-4f5d-9a65-12bd25b95ff4]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25c3dc97-c9cb-4529-ab32-26ef7fd94fc6 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:651ea766-ffda-42a1-9b3c-7be05a92c85f (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2088266-1d33-4bb1-ac5b-1de832ff7985 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f98a26ac-2506-4887-9d1d-277e6593f3ed (non-flash)\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:33:50 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a4228be-7d95-4c80-9921-33ea02b45ca4 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)
Apr 13 16:33:50 user nova-compute[71731]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25c3dc97-c9cb-4529-ab32-26ef7fd94fc6 (non-flash)
Apr 13 16:33:50 user nova-compute[71731]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:651ea766-ffda-42a1-9b3c-7be05a92c85f (non-flash)
Apr 13 16:33:50 user nova-compute[71731]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2088266-1d33-4bb1-ac5b-1de832ff7985 (non-flash)
Apr 13 16:33:50 user nova-compute[71731]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f98a26ac-2506-4887-9d1d-277e6593f3ed (non-flash)
Apr 13 16:33:50 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 16:33:50 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a4228be-7d95-4c80-9921-33ea02b45ca4 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)
Apr 13 16:33:50 user nova-compute[71731]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25c3dc97-c9cb-4529-ab32-26ef7fd94fc6 (non-flash)
Apr 13 16:33:50 user nova-compute[71731]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:651ea766-ffda-42a1-9b3c-7be05a92c85f (non-flash)
Apr 13 16:33:50 user nova-compute[71731]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2088266-1d33-4bb1-ac5b-1de832ff7985 (non-flash)
Apr 13 16:33:50 user nova-compute[71731]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f98a26ac-2506-4887-9d1d-277e6593f3ed (non-flash)
Apr 13 16:33:50 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 16:33:50 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-7a4228be-7d95-4c80-9921-33ea02b45ca4 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f98a26ac-2506-4887-9d1d-277e6593f3ed" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.315s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 16:33:50 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a4228be-7d95-4c80-9921-33ea02b45ca4 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Connected to 172.16.0.220:3260 {{(pid=71731) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 16:33:50 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-7a4228be-7d95-4c80-9921-33ea02b45ca4 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] HCTL ('37', '-', '-', 0) found on session 38 with lun 0 {{(pid=71731) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 16:33:50 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-7a4228be-7d95-4c80-9921-33ea02b45ca4 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=71731) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 16:33:50 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:33:50 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.021s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:33:50 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d471c03-16ee-4be8-88a5-4689f7d6d826]: (4, ('- - 0', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:33:50 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-7a4228be-7d95-4c80-9921-33ea02b45ca4 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Searching for a device in session 38 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=71731) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 16:33:50 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a4228be-7d95-4c80-9921-33ea02b45ca4 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:f98a26ac-2506-4887-9d1d-277e6593f3ed', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AbJUhkur', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71731) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 16:33:50 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-3f82f192-22ab-47df-b0d5-ea124a3c77a4 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Acquiring lock "35b23303-e373-4f35-b7ee-76e6815073ce" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:33:50 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-3f82f192-22ab-47df-b0d5-ea124a3c77a4 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lock "35b23303-e373-4f35-b7ee-76e6815073ce" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:33:50 user nova-compute[71731]: INFO nova.compute.manager [None req-3f82f192-22ab-47df-b0d5-ea124a3c77a4 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] [instance: 35b23303-e373-4f35-b7ee-76e6815073ce] Shelving
Apr 13 16:33:50 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:33:50 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:33:51 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:33:51 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:33:51 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:33:51 user nova-compute[71731]: DEBUG nova.compute.manager [req-1ad92e5e-0aee-4645-9b2f-d9ac5795cc3a req-c4f9ed23-da7c-4a78-bf5a-70ea91e07f86 service nova] [instance: 35b23303-e373-4f35-b7ee-76e6815073ce] Received event network-vif-unplugged-d3c66e4e-b15d-4bc9-a838-265ca07a6a66 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:33:51 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-1ad92e5e-0aee-4645-9b2f-d9ac5795cc3a req-c4f9ed23-da7c-4a78-bf5a-70ea91e07f86 service nova] Acquiring lock "35b23303-e373-4f35-b7ee-76e6815073ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:33:51 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-1ad92e5e-0aee-4645-9b2f-d9ac5795cc3a req-c4f9ed23-da7c-4a78-bf5a-70ea91e07f86 service nova] Lock "35b23303-e373-4f35-b7ee-76e6815073ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.005s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:33:51 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-1ad92e5e-0aee-4645-9b2f-d9ac5795cc3a req-c4f9ed23-da7c-4a78-bf5a-70ea91e07f86 service nova] Lock "35b23303-e373-4f35-b7ee-76e6815073ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:33:51 user nova-compute[71731]: DEBUG nova.compute.manager [req-1ad92e5e-0aee-4645-9b2f-d9ac5795cc3a req-c4f9ed23-da7c-4a78-bf5a-70ea91e07f86 service nova] [instance: 35b23303-e373-4f35-b7ee-76e6815073ce] No waiting events found dispatching network-vif-unplugged-d3c66e4e-b15d-4bc9-a838-265ca07a6a66 {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:33:51 user nova-compute[71731]: WARNING nova.compute.manager [req-1ad92e5e-0aee-4645-9b2f-d9ac5795cc3a req-c4f9ed23-da7c-4a78-bf5a-70ea91e07f86 service nova] [instance: 35b23303-e373-4f35-b7ee-76e6815073ce] Received unexpected event network-vif-unplugged-d3c66e4e-b15d-4bc9-a838-265ca07a6a66 for instance with vm_state active and task_state shelving.
Apr 13 16:33:51 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:33:51 user nova-compute[71731]: INFO nova.virt.libvirt.driver [-] [instance: 35b23303-e373-4f35-b7ee-76e6815073ce] Instance destroyed successfully.
Apr 13 16:33:51 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-3f82f192-22ab-47df-b0d5-ea124a3c77a4 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] [instance: 35b23303-e373-4f35-b7ee-76e6815073ce] Beginning cold snapshot process
Apr 13 16:33:51 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-7a4228be-7d95-4c80-9921-33ea02b45ca4 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.365s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 16:33:51 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a4228be-7d95-4c80-9921-33ea02b45ca4 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] <== connect_volume: return (1366ms) {'type': 'block', 'scsi_wwn': '26530333730336339', 'path': '/dev/sdf'} {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 16:33:51 user nova-compute[71731]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7a4228be-7d95-4c80-9921-33ea02b45ca4 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] [instance: 64a9c052-89a9-48ba-80c9-13fb5ef22f0e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26530333730336339', 'path': '/dev/sdf'} {{(pid=71731) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 16:33:51 user nova-compute[71731]: DEBUG nova.objects.instance [None req-7a4228be-7d95-4c80-9921-33ea02b45ca4 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Lazy-loading 'flavor' on Instance uuid 64a9c052-89a9-48ba-80c9-13fb5ef22f0e {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:33:51 user nova-compute[71731]: DEBUG nova.virt.libvirt.guest [None req-7a4228be-7d95-4c80-9921-33ea02b45ca4 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] attach device xml: <disk type="block" device="disk">
Apr 13 16:33:51 user nova-compute[71731]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 16:33:51 user nova-compute[71731]:   <source dev="/dev/sdf"/>
Apr 13 16:33:51 user nova-compute[71731]:   <target dev="vdb" bus="virtio"/>
Apr 13 16:33:51 user nova-compute[71731]:   <serial>f98a26ac-2506-4887-9d1d-277e6593f3ed</serial>
Apr 13 16:33:51 user nova-compute[71731]: </disk>
Apr 13 16:33:51 user nova-compute[71731]:  {{(pid=71731) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 13 16:33:51 user nova-compute[71731]: DEBUG nova.privsep.utils [None req-3f82f192-22ab-47df-b0d5-ea124a3c77a4 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71731) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 13 16:33:51 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-3f82f192-22ab-47df-b0d5-ea124a3c77a4 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/35b23303-e373-4f35-b7ee-76e6815073ce/disk /opt/stack/data/nova/instances/snapshots/tmpf2f5y5cj/385e46b3b3fe43fb948274b0f02df35b {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:33:51 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:33:52 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-7a4228be-7d95-4c80-9921-33ea02b45ca4 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] No BDM found with device name vda, not building metadata. {{(pid=71731) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 16:33:52 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-7a4228be-7d95-4c80-9921-33ea02b45ca4 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71731) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 16:33:52 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-7a4228be-7d95-4c80-9921-33ea02b45ca4 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] No VIF found with MAC fa:16:3e:fe:54:1c, not building metadata {{(pid=71731) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 16:33:52 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-3f82f192-22ab-47df-b0d5-ea124a3c77a4 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/35b23303-e373-4f35-b7ee-76e6815073ce/disk /opt/stack/data/nova/instances/snapshots/tmpf2f5y5cj/385e46b3b3fe43fb948274b0f02df35b" returned: 0 in 0.396s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:33:52 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-3f82f192-22ab-47df-b0d5-ea124a3c77a4 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] [instance: 35b23303-e373-4f35-b7ee-76e6815073ce] Snapshot extracted, beginning image upload
Apr 13 16:33:52 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-7a4228be-7d95-4c80-9921-33ea02b45ca4 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Lock "64a9c052-89a9-48ba-80c9-13fb5ef22f0e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.227s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:33:53 user nova-compute[71731]: DEBUG nova.compute.manager [req-87503cd9-8a18-4907-8563-6b1abdea6296 req-42f3c770-3814-457e-9482-90cbb1544e88 service nova] [instance: 35b23303-e373-4f35-b7ee-76e6815073ce] Received event network-vif-plugged-d3c66e4e-b15d-4bc9-a838-265ca07a6a66 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:33:53 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-87503cd9-8a18-4907-8563-6b1abdea6296 req-42f3c770-3814-457e-9482-90cbb1544e88 service nova] Acquiring lock "35b23303-e373-4f35-b7ee-76e6815073ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:33:53 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-87503cd9-8a18-4907-8563-6b1abdea6296 req-42f3c770-3814-457e-9482-90cbb1544e88 service nova] Lock "35b23303-e373-4f35-b7ee-76e6815073ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:33:53 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-87503cd9-8a18-4907-8563-6b1abdea6296 req-42f3c770-3814-457e-9482-90cbb1544e88 service nova] Lock "35b23303-e373-4f35-b7ee-76e6815073ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:33:53 user nova-compute[71731]: DEBUG nova.compute.manager [req-87503cd9-8a18-4907-8563-6b1abdea6296 req-42f3c770-3814-457e-9482-90cbb1544e88 service nova] [instance: 35b23303-e373-4f35-b7ee-76e6815073ce] No waiting events found dispatching network-vif-plugged-d3c66e4e-b15d-4bc9-a838-265ca07a6a66 {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:33:53 user nova-compute[71731]: WARNING nova.compute.manager [req-87503cd9-8a18-4907-8563-6b1abdea6296 req-42f3c770-3814-457e-9482-90cbb1544e88 service nova] [instance: 35b23303-e373-4f35-b7ee-76e6815073ce] Received unexpected event network-vif-plugged-d3c66e4e-b15d-4bc9-a838-265ca07a6a66 for instance with vm_state active and task_state shelving_image_uploading.
Apr 13 16:33:53 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-0f28435c-af41-41ff-9c5a-84cdcd8ab9b0 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Acquiring lock "64a9c052-89a9-48ba-80c9-13fb5ef22f0e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:33:53 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-0f28435c-af41-41ff-9c5a-84cdcd8ab9b0 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Lock "64a9c052-89a9-48ba-80c9-13fb5ef22f0e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:33:53 user nova-compute[71731]: INFO nova.compute.manager [None req-0f28435c-af41-41ff-9c5a-84cdcd8ab9b0 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] [instance: 64a9c052-89a9-48ba-80c9-13fb5ef22f0e] Detaching volume f98a26ac-2506-4887-9d1d-277e6593f3ed
Apr 13 16:33:53 user nova-compute[71731]: INFO nova.virt.block_device [None req-0f28435c-af41-41ff-9c5a-84cdcd8ab9b0 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] [instance: 64a9c052-89a9-48ba-80c9-13fb5ef22f0e] Attempting to driver detach volume f98a26ac-2506-4887-9d1d-277e6593f3ed from mountpoint /dev/vdb
Apr 13 16:33:53 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-0f28435c-af41-41ff-9c5a-84cdcd8ab9b0 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Attempting to detach device vdb from instance 64a9c052-89a9-48ba-80c9-13fb5ef22f0e from the persistent domain config. {{(pid=71731) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 13 16:33:53 user nova-compute[71731]: DEBUG nova.virt.libvirt.guest [None req-0f28435c-af41-41ff-9c5a-84cdcd8ab9b0 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 16:33:53 user nova-compute[71731]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 16:33:53 user nova-compute[71731]:   <source dev="/dev/sdf"/>
Apr 13 16:33:53 user nova-compute[71731]:   <target dev="vdb" bus="virtio"/>
Apr 13 16:33:53 user nova-compute[71731]:   <serial>f98a26ac-2506-4887-9d1d-277e6593f3ed</serial>
Apr 13 16:33:53 user nova-compute[71731]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 13 16:33:53 user nova-compute[71731]: </disk>
Apr 13 16:33:53 user nova-compute[71731]:  {{(pid=71731) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 16:33:53 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-0f28435c-af41-41ff-9c5a-84cdcd8ab9b0 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Successfully detached device vdb from instance 64a9c052-89a9-48ba-80c9-13fb5ef22f0e from the persistent domain config.
Apr 13 16:33:53 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-0f28435c-af41-41ff-9c5a-84cdcd8ab9b0 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 64a9c052-89a9-48ba-80c9-13fb5ef22f0e from the live domain config. {{(pid=71731) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 13 16:33:53 user nova-compute[71731]: DEBUG nova.virt.libvirt.guest [None req-0f28435c-af41-41ff-9c5a-84cdcd8ab9b0 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 16:33:53 user nova-compute[71731]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 16:33:53 user nova-compute[71731]:   <source dev="/dev/sdf"/>
Apr 13 16:33:53 user nova-compute[71731]:   <target dev="vdb" bus="virtio"/>
Apr 13 16:33:53 user nova-compute[71731]:   <serial>f98a26ac-2506-4887-9d1d-277e6593f3ed</serial>
Apr 13 16:33:53 user nova-compute[71731]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 13 16:33:53 user nova-compute[71731]: </disk>
Apr 13 16:33:53 user nova-compute[71731]:  {{(pid=71731) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 16:33:54 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-0f28435c-af41-41ff-9c5a-84cdcd8ab9b0 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 64a9c052-89a9-48ba-80c9-13fb5ef22f0e {{(pid=71731) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 13 16:33:54 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Received event <DeviceRemovedEvent: 1681403634.0791714, 64a9c052-89a9-48ba-80c9-13fb5ef22f0e => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71731) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 13 16:33:54 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-0f28435c-af41-41ff-9c5a-84cdcd8ab9b0 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Successfully detached device vdb from instance 64a9c052-89a9-48ba-80c9-13fb5ef22f0e from the live domain config.
Apr 13 16:33:54 user nova-compute[71731]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0f28435c-af41-41ff-9c5a-84cdcd8ab9b0 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] [instance: 64a9c052-89a9-48ba-80c9-13fb5ef22f0e] calling os-brick to detach iSCSI Volume {{(pid=71731) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 16:33:54 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f28435c-af41-41ff-9c5a-84cdcd8ab9b0 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8cf0118790>, {'target_iqn': 'iqn.2010-10.org.openstack:f98a26ac-2506-4887-9d1d-277e6593f3ed', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AbJUhkur', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf': {}}" {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 16:33:54 user nova-compute[71731]: WARNING os_brick.initiator.connectors.base [None req-0f28435c-af41-41ff-9c5a-84cdcd8ab9b0 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 16:33:54 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-0f28435c-af41-41ff-9c5a-84cdcd8ab9b0 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 16:33:54 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-0f28435c-af41-41ff-9c5a-84cdcd8ab9b0 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 16:33:54 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:33:54 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:33:54 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[b34f8cee-e345-4556-b5b1-d9508e367919]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f98a26ac-2506-4887-9d1d-277e6593f3ed\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c2088266-1d33-4bb1-ac5b-1de832ff7985\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:25c3dc97-c9cb-4529-ab32-26ef7fd94fc6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:651ea766-ffda-42a1-9b3c-7be05a92c85f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:33:54 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f28435c-af41-41ff-9c5a-84cdcd8ab9b0 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 16:33:54 user nova-compute[71731]: No targets found.
Apr 13 16:33:54 user nova-compute[71731]: iSNS:
Apr 13 16:33:54 user nova-compute[71731]: No targets found.
Apr 13 16:33:54 user nova-compute[71731]: STATIC:
Apr 13 16:33:54 user nova-compute[71731]: Target: iqn.2010-10.org.openstack:f98a26ac-2506-4887-9d1d-277e6593f3ed
Apr 13 16:33:54 user nova-compute[71731]:         Portal: 172.16.0.220:3260,-1
Apr 13 16:33:54 user nova-compute[71731]:                 Iface Name: default
Apr 13 16:33:54 user nova-compute[71731]: Target: iqn.2010-10.org.openstack:c2088266-1d33-4bb1-ac5b-1de832ff7985
Apr 13 16:33:54 user nova-compute[71731]:         Portal: 172.16.0.220:3260,-1
Apr 13 16:33:54 user nova-compute[71731]:                 Iface Name: default
Apr 13 16:33:54 user nova-compute[71731]: Target: iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97
Apr 13 16:33:54 user nova-compute[71731]:         Portal: 172.16.0.220:3260,-1
Apr 13 16:33:54 user nova-compute[71731]:                 Iface Name: default
Apr 13 16:33:54 user nova-compute[71731]: Target: iqn.2010-10.org.openstack:25c3dc97-c9cb-4529-ab32-26ef7fd94fc6
Apr 13 16:33:54 user nova-compute[71731]:         Portal: 172.16.0.220:3260,-1
Apr 13 16:33:54 user nova-compute[71731]:                 Iface Name: default
Apr 13 16:33:54 user nova-compute[71731]: Target: iqn.2010-10.org.openstack:651ea766-ffda-42a1-9b3c-7be05a92c85f
Apr 13 16:33:54 user nova-compute[71731]:         Portal: 172.16.0.220:3260,-1
Apr 13 16:33:54 user nova-compute[71731]:                 Iface Name: default
Apr 13 16:33:54 user nova-compute[71731]: FIRMWARE:
Apr 13 16:33:54 user nova-compute[71731]: No targets found.
Apr 13 16:33:54 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 16:33:54 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f28435c-af41-41ff-9c5a-84cdcd8ab9b0 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 16:33:54 user nova-compute[71731]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 16:33:54 user nova-compute[71731]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71731) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 16:33:54 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f28435c-af41-41ff-9c5a-84cdcd8ab9b0 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f98a26ac-2506-4887-9d1d-277e6593f3ed', 0)] {{(pid=71731) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 16:33:54 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:33:54 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:33:54 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb0171e9-1195-476a-b6cb-024c509c290f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:25c3dc97-c9cb-4529-ab32-26ef7fd94fc6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:651ea766-ffda-42a1-9b3c-7be05a92c85f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c2088266-1d33-4bb1-ac5b-1de832ff7985\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f98a26ac-2506-4887-9d1d-277e6593f3ed\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:33:54 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:33:54 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.055s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:33:54 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[14eb785a-0750-4b9b-96c2-6fe9cdb4b237]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25c3dc97-c9cb-4529-ab32-26ef7fd94fc6 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:651ea766-ffda-42a1-9b3c-7be05a92c85f (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2088266-1d33-4bb1-ac5b-1de832ff7985 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f98a26ac-2506-4887-9d1d-277e6593f3ed (non-flash)\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:33:54 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f28435c-af41-41ff-9c5a-84cdcd8ab9b0 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)
Apr 13 16:33:54 user nova-compute[71731]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25c3dc97-c9cb-4529-ab32-26ef7fd94fc6 (non-flash)
Apr 13 16:33:54 user nova-compute[71731]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:651ea766-ffda-42a1-9b3c-7be05a92c85f (non-flash)
Apr 13 16:33:54 user nova-compute[71731]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2088266-1d33-4bb1-ac5b-1de832ff7985 (non-flash)
Apr 13 16:33:54 user nova-compute[71731]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f98a26ac-2506-4887-9d1d-277e6593f3ed (non-flash)
Apr 13 16:33:54 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 16:33:54 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f28435c-af41-41ff-9c5a-84cdcd8ab9b0 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)
Apr 13 16:33:54 user nova-compute[71731]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25c3dc97-c9cb-4529-ab32-26ef7fd94fc6 (non-flash)
Apr 13 16:33:54 user nova-compute[71731]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:651ea766-ffda-42a1-9b3c-7be05a92c85f (non-flash)
Apr 13 16:33:54 user nova-compute[71731]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2088266-1d33-4bb1-ac5b-1de832ff7985 (non-flash)
Apr 13 16:33:54 user nova-compute[71731]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f98a26ac-2506-4887-9d1d-277e6593f3ed (non-flash)
Apr 13 16:33:54 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 16:33:54 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f28435c-af41-41ff-9c5a-84cdcd8ab9b0 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8cf04b91b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f98a26ac-2506-4887-9d1d-277e6593f3ed'): ({'sdf'}, set())}) {{(pid=71731) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 16:33:54 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-0f28435c-af41-41ff-9c5a-84cdcd8ab9b0 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Removing single pathed devices sdf {{(pid=71731) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 16:33:54 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:33:54 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:33:54 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[a719a4c9-ddec-43ce-a018-9ffd51c016a3]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:33:54 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:33:54 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.053s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:33:54 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4ba8ef8-27bd-4ed9-85e9-777ce1d14fa1]: (4, ('ok\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:33:54 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-0f28435c-af41-41ff-9c5a-84cdcd8ab9b0 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Flushing IO for device /dev/sdf {{(pid=71731) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 16:33:54 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:33:54 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.050s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:33:54 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eaed810-43df-4b0c-963e-ee00bd76f78b]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:33:54 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-0f28435c-af41-41ff-9c5a-84cdcd8ab9b0 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=71731) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 16:33:54 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:33:54 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.040s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:33:54 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[329b26fa-2394-4366-833c-722508087f52]: (4, ('1', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:33:54 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-0f28435c-af41-41ff-9c5a-84cdcd8ab9b0 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=71731) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 16:33:54 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-0f28435c-af41-41ff-9c5a-84cdcd8ab9b0 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] SCSI volumes sdf have been removed. {{(pid=71731) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 16:33:54 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f28435c-af41-41ff-9c5a-84cdcd8ab9b0 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f98a26ac-2506-4887-9d1d-277e6593f3ed')] {{(pid=71731) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 16:33:54 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f98a26ac-2506-4887-9d1d-277e6593f3ed -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:33:54 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-3f82f192-22ab-47df-b0d5-ea124a3c77a4 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] [instance: 35b23303-e373-4f35-b7ee-76e6815073ce] Snapshot image upload complete
Apr 13 16:33:54 user nova-compute[71731]: DEBUG nova.compute.manager [None req-3f82f192-22ab-47df-b0d5-ea124a3c77a4 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] [instance: 35b23303-e373-4f35-b7ee-76e6815073ce] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:33:54 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f98a26ac-2506-4887-9d1d-277e6593f3ed -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:33:54 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[6defc5c0-463d-428d-9d09-8a016fb4f5ad]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:33:54 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f28435c-af41-41ff-9c5a-84cdcd8ab9b0 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:33:54 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f98a26ac-2506-4887-9d1d-277e6593f3ed -p 172.16.0.220:3260 --logout {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:33:54 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f98a26ac-2506-4887-9d1d-277e6593f3ed -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:33:54 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[78ddfabc-7176-4382-934d-69bb5a69640b]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:f98a26ac-2506-4887-9d1d-277e6593f3ed, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:f98a26ac-2506-4887-9d1d-277e6593f3ed, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:33:54 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f28435c-af41-41ff-9c5a-84cdcd8ab9b0 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:f98a26ac-2506-4887-9d1d-277e6593f3ed, portal: 172.16.0.220,3260]
Apr 13 16:33:54 user nova-compute[71731]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:f98a26ac-2506-4887-9d1d-277e6593f3ed, portal: 172.16.0.220,3260] successful.
Apr 13 16:33:54 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:33:54 user nova-compute[71731]: INFO nova.compute.manager [None req-3f82f192-22ab-47df-b0d5-ea124a3c77a4 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] [instance: 35b23303-e373-4f35-b7ee-76e6815073ce] Shelve offloading
Apr 13 16:33:54 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f98a26ac-2506-4887-9d1d-277e6593f3ed -p 172.16.0.220:3260 --op delete {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:33:54 user nova-compute[71731]: INFO nova.virt.libvirt.driver [-] [instance: 35b23303-e373-4f35-b7ee-76e6815073ce] Instance destroyed successfully.
Apr 13 16:33:54 user nova-compute[71731]: DEBUG nova.compute.manager [None req-3f82f192-22ab-47df-b0d5-ea124a3c77a4 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] [instance: 35b23303-e373-4f35-b7ee-76e6815073ce] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:33:54 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-3f82f192-22ab-47df-b0d5-ea124a3c77a4 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Acquiring lock "refresh_cache-35b23303-e373-4f35-b7ee-76e6815073ce" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 16:33:54 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-3f82f192-22ab-47df-b0d5-ea124a3c77a4 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Acquired lock "refresh_cache-35b23303-e373-4f35-b7ee-76e6815073ce" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 16:33:54 user nova-compute[71731]: DEBUG nova.network.neutron [None req-3f82f192-22ab-47df-b0d5-ea124a3c77a4 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] [instance: 35b23303-e373-4f35-b7ee-76e6815073ce] Building network info cache for instance {{(pid=71731) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 16:33:54 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f98a26ac-2506-4887-9d1d-277e6593f3ed -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:33:54 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[31d9776d-cc6e-47c1-805a-03780164fc3a]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:33:54 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f28435c-af41-41ff-9c5a-84cdcd8ab9b0 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:33:54 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-0f28435c-af41-41ff-9c5a-84cdcd8ab9b0 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.453s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 16:33:54 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f28435c-af41-41ff-9c5a-84cdcd8ab9b0 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] <== disconnect_volume: return (455ms) None {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 16:33:54 user nova-compute[71731]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0f28435c-af41-41ff-9c5a-84cdcd8ab9b0 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] [instance: 64a9c052-89a9-48ba-80c9-13fb5ef22f0e] Disconnected iSCSI Volume {{(pid=71731) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 16:33:55 user nova-compute[71731]: DEBUG nova.network.neutron [None req-3f82f192-22ab-47df-b0d5-ea124a3c77a4 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] [instance: 35b23303-e373-4f35-b7ee-76e6815073ce] Updating instance_info_cache with network_info: [{"id": "d3c66e4e-b15d-4bc9-a838-265ca07a6a66", "address": "fa:16:3e:3a:4e:db", "network": {"id": "5acc9a78-1127-46df-bb60-7544cdd2c1ef", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2143082515-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0653ab16660b46cea9c5af58ea0b1931", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3c66e4e-b1", "ovs_interfaceid": "d3c66e4e-b15d-4bc9-a838-265ca07a6a66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:33:55 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-3f82f192-22ab-47df-b0d5-ea124a3c77a4 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Releasing lock "refresh_cache-35b23303-e373-4f35-b7ee-76e6815073ce" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 16:33:55 user nova-compute[71731]: DEBUG nova.objects.instance [None req-0f28435c-af41-41ff-9c5a-84cdcd8ab9b0 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Lazy-loading 'flavor' on Instance uuid 64a9c052-89a9-48ba-80c9-13fb5ef22f0e {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:33:55 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-0f28435c-af41-41ff-9c5a-84cdcd8ab9b0 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Lock "64a9c052-89a9-48ba-80c9-13fb5ef22f0e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.972s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:33:55 user nova-compute[71731]: INFO nova.virt.libvirt.driver [-] [instance: 35b23303-e373-4f35-b7ee-76e6815073ce] Instance destroyed successfully.
Apr 13 16:33:55 user nova-compute[71731]: DEBUG nova.objects.instance [None req-3f82f192-22ab-47df-b0d5-ea124a3c77a4 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lazy-loading 'resources' on Instance uuid 35b23303-e373-4f35-b7ee-76e6815073ce {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:33:55 user nova-compute[71731]: DEBUG nova.virt.libvirt.vif [None req-3f82f192-22ab-47df-b0d5-ea124a3c77a4 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T16:31:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1250036054',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1250036054',id=29,image_ref='708622a9-7465-4492-ade8-b827198f7e30',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLQeZ76om971CHhTZu4ReSq6QPGcHpR5nWHWtfdjAVD10KpB0WFrcOFE78MwJOBYC8dClsRGNG38ZB3wd8nDfZlZongElXTKw6yUyFEOVvzfdaLLX/bmjmfAtuiMX+ECkA==',key_name='tempest-keypair-179744772',keypairs=<?>,launch_index=0,launched_at=2023-04-13T16:32:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='0653ab16660b46cea9c5af58ea0b1931',ramdisk_id='',reservation_id='r-h5vfm9ar',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='708622a9-7465-4492-ade8-b827198f7e30',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1310775310',owner_user_name='tempest-AttachVolumeShelveTestJSON-1310775310-project-member',shelved_at='2023-04-13T16:33:54.480330',shelved_host='user',shelved_image_id='c2b93ad7-8a91-45b2-bd03-9510a5858375'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T16:33:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='48b4e972cd1049509fa899449961ab59',uuid=35b23303-e373-4f35-b7ee-76e6815073ce,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "d3c66e4e-b15d-4bc9-a838-265ca07a6a66", "address": "fa:16:3e:3a:4e:db", "network": {"id": "5acc9a78-1127-46df-bb60-7544cdd2c1ef", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2143082515-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0653ab16660b46cea9c5af58ea0b1931", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3c66e4e-b1", "ovs_interfaceid": "d3c66e4e-b15d-4bc9-a838-265ca07a6a66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 16:33:55 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-3f82f192-22ab-47df-b0d5-ea124a3c77a4 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Converting VIF {"id": "d3c66e4e-b15d-4bc9-a838-265ca07a6a66", "address": "fa:16:3e:3a:4e:db", "network": {"id": "5acc9a78-1127-46df-bb60-7544cdd2c1ef", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2143082515-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0653ab16660b46cea9c5af58ea0b1931", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3c66e4e-b1", "ovs_interfaceid": "d3c66e4e-b15d-4bc9-a838-265ca07a6a66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 16:33:55 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-3f82f192-22ab-47df-b0d5-ea124a3c77a4 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3a:4e:db,bridge_name='br-int',has_traffic_filtering=True,id=d3c66e4e-b15d-4bc9-a838-265ca07a6a66,network=Network(5acc9a78-1127-46df-bb60-7544cdd2c1ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3c66e4e-b1') {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 16:33:55 user nova-compute[71731]: DEBUG os_vif [None req-3f82f192-22ab-47df-b0d5-ea124a3c77a4 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:4e:db,bridge_name='br-int',has_traffic_filtering=True,id=d3c66e4e-b15d-4bc9-a838-265ca07a6a66,network=Network(5acc9a78-1127-46df-bb60-7544cdd2c1ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3c66e4e-b1') {{(pid=71731) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 16:33:55 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:33:55 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd3c66e4e-b1, bridge=br-int, if_exists=True) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:33:55 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:33:55 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 16:33:55 user nova-compute[71731]: INFO os_vif [None req-3f82f192-22ab-47df-b0d5-ea124a3c77a4 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:4e:db,bridge_name='br-int',has_traffic_filtering=True,id=d3c66e4e-b15d-4bc9-a838-265ca07a6a66,network=Network(5acc9a78-1127-46df-bb60-7544cdd2c1ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3c66e4e-b1')
Apr 13 16:33:55 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-3f82f192-22ab-47df-b0d5-ea124a3c77a4 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] [instance: 35b23303-e373-4f35-b7ee-76e6815073ce] Deleting instance files /opt/stack/data/nova/instances/35b23303-e373-4f35-b7ee-76e6815073ce_del
Apr 13 16:33:55 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-3f82f192-22ab-47df-b0d5-ea124a3c77a4 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] [instance: 35b23303-e373-4f35-b7ee-76e6815073ce] Deletion of /opt/stack/data/nova/instances/35b23303-e373-4f35-b7ee-76e6815073ce_del complete
Apr 13 16:33:55 user nova-compute[71731]: DEBUG nova.compute.manager [req-5e6278b4-16a9-4e1f-8cf5-584a46932ede req-6f68860c-7c20-4161-8091-632049709dec service nova] [instance: 35b23303-e373-4f35-b7ee-76e6815073ce] Received event network-changed-d3c66e4e-b15d-4bc9-a838-265ca07a6a66 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:33:55 user nova-compute[71731]: DEBUG nova.compute.manager [req-5e6278b4-16a9-4e1f-8cf5-584a46932ede req-6f68860c-7c20-4161-8091-632049709dec service nova] [instance: 35b23303-e373-4f35-b7ee-76e6815073ce] Refreshing instance network info cache due to event network-changed-d3c66e4e-b15d-4bc9-a838-265ca07a6a66. {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 16:33:55 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-5e6278b4-16a9-4e1f-8cf5-584a46932ede req-6f68860c-7c20-4161-8091-632049709dec service nova] Acquiring lock "refresh_cache-35b23303-e373-4f35-b7ee-76e6815073ce" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 16:33:55 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-5e6278b4-16a9-4e1f-8cf5-584a46932ede req-6f68860c-7c20-4161-8091-632049709dec service nova] Acquired lock "refresh_cache-35b23303-e373-4f35-b7ee-76e6815073ce" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 16:33:55 user nova-compute[71731]: DEBUG nova.network.neutron [req-5e6278b4-16a9-4e1f-8cf5-584a46932ede req-6f68860c-7c20-4161-8091-632049709dec service nova] [instance: 35b23303-e373-4f35-b7ee-76e6815073ce] Refreshing network info cache for port d3c66e4e-b15d-4bc9-a838-265ca07a6a66 {{(pid=71731) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 16:33:55 user nova-compute[71731]: INFO nova.scheduler.client.report [None req-3f82f192-22ab-47df-b0d5-ea124a3c77a4 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Deleted allocations for instance 35b23303-e373-4f35-b7ee-76e6815073ce
Apr 13 16:33:55 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-3f82f192-22ab-47df-b0d5-ea124a3c77a4 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:33:55 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-3f82f192-22ab-47df-b0d5-ea124a3c77a4 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:33:55 user nova-compute[71731]: DEBUG nova.objects.instance [None req-3f82f192-22ab-47df-b0d5-ea124a3c77a4 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lazy-loading 'numa_topology' on Instance uuid 35b23303-e373-4f35-b7ee-76e6815073ce {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:33:56 user nova-compute[71731]: DEBUG nova.network.neutron [req-5e6278b4-16a9-4e1f-8cf5-584a46932ede req-6f68860c-7c20-4161-8091-632049709dec service nova] [instance: 35b23303-e373-4f35-b7ee-76e6815073ce] Updated VIF entry in instance network info cache for port d3c66e4e-b15d-4bc9-a838-265ca07a6a66. {{(pid=71731) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 16:33:56 user nova-compute[71731]: DEBUG nova.network.neutron [req-5e6278b4-16a9-4e1f-8cf5-584a46932ede req-6f68860c-7c20-4161-8091-632049709dec service nova] [instance: 35b23303-e373-4f35-b7ee-76e6815073ce] Updating instance_info_cache with network_info: [{"id": "d3c66e4e-b15d-4bc9-a838-265ca07a6a66", "address": "fa:16:3e:3a:4e:db", "network": {"id": "5acc9a78-1127-46df-bb60-7544cdd2c1ef", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-2143082515-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0653ab16660b46cea9c5af58ea0b1931", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapd3c66e4e-b1", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:33:56 user nova-compute[71731]: DEBUG nova.compute.provider_tree [None req-3f82f192-22ab-47df-b0d5-ea124a3c77a4 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Inventory has not changed in ProviderTree for provider: cb6b1a64-0c24-4e2d-af1e-16576ca9165c {{(pid=71731) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 16:33:56 user nova-compute[71731]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681403621.2198904, eaae47b9-a059-49f6-9ae6-d7147003e2f2 => Stopped> {{(pid=71731) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 16:33:56 user nova-compute[71731]: INFO nova.compute.manager [-] [instance: eaae47b9-a059-49f6-9ae6-d7147003e2f2] VM Stopped (Lifecycle Event)
Apr 13 16:33:56 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-5e6278b4-16a9-4e1f-8cf5-584a46932ede req-6f68860c-7c20-4161-8091-632049709dec service nova] Releasing lock "refresh_cache-35b23303-e373-4f35-b7ee-76e6815073ce" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 16:33:56 user nova-compute[71731]: DEBUG nova.scheduler.client.report [None req-3f82f192-22ab-47df-b0d5-ea124a3c77a4 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Inventory has not changed for provider cb6b1a64-0c24-4e2d-af1e-16576ca9165c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71731) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 16:33:56 user nova-compute[71731]: DEBUG nova.compute.manager [None req-13d203c4-f441-47f8-a9a6-651c6abd7276 None None] [instance: eaae47b9-a059-49f6-9ae6-d7147003e2f2] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:33:56 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-3f82f192-22ab-47df-b0d5-ea124a3c77a4 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.329s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:33:56 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-3f82f192-22ab-47df-b0d5-ea124a3c77a4 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lock "35b23303-e373-4f35-b7ee-76e6815073ce" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 5.456s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:33:56 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:34:00 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:34:01 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:34:05 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:34:06 user nova-compute[71731]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681403631.4967306, 35b23303-e373-4f35-b7ee-76e6815073ce => Stopped> {{(pid=71731) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 16:34:06 user nova-compute[71731]: INFO nova.compute.manager [-] [instance: 35b23303-e373-4f35-b7ee-76e6815073ce] VM Stopped (Lifecycle Event)
Apr 13 16:34:06 user nova-compute[71731]: DEBUG nova.compute.manager [None req-e638243d-6d55-4ed0-8846-46e4463da556 None None] [instance: 35b23303-e373-4f35-b7ee-76e6815073ce] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:34:06 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:34:10 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:34:11 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:34:15 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:34:15 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:34:16 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager.update_available_resource {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:34:16 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:34:16 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:34:16 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:34:16 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Auditing locally available compute resources for user (node: user) {{(pid=71731) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 16:34:16 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64a9c052-89a9-48ba-80c9-13fb5ef22f0e/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:34:16 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64a9c052-89a9-48ba-80c9-13fb5ef22f0e/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:34:16 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64a9c052-89a9-48ba-80c9-13fb5ef22f0e/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:34:16 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64a9c052-89a9-48ba-80c9-13fb5ef22f0e/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:34:16 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acbcaee0-a47b-4fee-8765-9b1c9597d515/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:34:16 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acbcaee0-a47b-4fee-8765-9b1c9597d515/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:34:16 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acbcaee0-a47b-4fee-8765-9b1c9597d515/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:34:16 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acbcaee0-a47b-4fee-8765-9b1c9597d515/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:34:16 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=71731) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 16:34:16 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66553f5-5e1b-4f1d-8c5a-63bc340f7586/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:34:16 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:34:16 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66553f5-5e1b-4f1d-8c5a-63bc340f7586/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:34:16 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66553f5-5e1b-4f1d-8c5a-63bc340f7586/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:34:17 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66553f5-5e1b-4f1d-8c5a-63bc340f7586/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:34:17 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71731) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 16:34:17 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71731) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 16:34:17 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf98c3a2-dbeb-4ae4-8423-ce55964c4258/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:34:17 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf98c3a2-dbeb-4ae4-8423-ce55964c4258/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:34:17 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf98c3a2-dbeb-4ae4-8423-ce55964c4258/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:34:17 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf98c3a2-dbeb-4ae4-8423-ce55964c4258/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:34:17 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/650427bd-4dad-4bcd-922d-c17e60b36807/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:34:17 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/650427bd-4dad-4bcd-922d-c17e60b36807/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:34:17 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/650427bd-4dad-4bcd-922d-c17e60b36807/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:34:17 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/650427bd-4dad-4bcd-922d-c17e60b36807/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:34:17 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32b18558-8bf2-4def-bc70-81c4e38fcc6f/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:34:17 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32b18558-8bf2-4def-bc70-81c4e38fcc6f/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:34:17 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32b18558-8bf2-4def-bc70-81c4e38fcc6f/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:34:17 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32b18558-8bf2-4def-bc70-81c4e38fcc6f/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:34:17 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=71731) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 16:34:17 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2956ab05-28ff-4c9e-b646-dbb83b3db278/disk.rescue --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:34:18 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2956ab05-28ff-4c9e-b646-dbb83b3db278/disk.rescue --force-share --output=json" returned: 0 in 0.214s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:34:18 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2956ab05-28ff-4c9e-b646-dbb83b3db278/disk.rescue --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:34:18 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2956ab05-28ff-4c9e-b646-dbb83b3db278/disk.rescue --force-share --output=json" returned: 0 in 0.154s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:34:18 user nova-compute[71731]: WARNING nova.virt.libvirt.driver [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 16:34:18 user nova-compute[71731]: WARNING nova.virt.libvirt.driver [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 16:34:18 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Hypervisor/Node resource view: name=user free_ram=7703MB free_disk=25.944011688232422GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71731) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 16:34:18 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:34:18 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:34:18 user nova-compute[71731]: DEBUG nova.network.neutron [None req-aab9a7b9-9c31-4d45-beaf-7bf0d37c3af9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] Port 13471516-9514-4b85-938f-69657c2990e5 binding to destination host user is already ACTIVE {{(pid=71731) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3161}}
Apr 13 16:34:18 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-aab9a7b9-9c31-4d45-beaf-7bf0d37c3af9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Acquiring lock "refresh_cache-acbcaee0-a47b-4fee-8765-9b1c9597d515" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 16:34:18 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-aab9a7b9-9c31-4d45-beaf-7bf0d37c3af9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Acquired lock "refresh_cache-acbcaee0-a47b-4fee-8765-9b1c9597d515" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 16:34:18 user nova-compute[71731]: DEBUG nova.network.neutron [None req-aab9a7b9-9c31-4d45-beaf-7bf0d37c3af9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] Building network info cache for instance {{(pid=71731) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 16:34:18 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Applying migration context for instance acbcaee0-a47b-4fee-8765-9b1c9597d515 as it has an incoming, in-progress migration f95a8bc3-801a-4447-b4ea-330328feac3a. Migration status is reverting {{(pid=71731) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:950}}
Apr 13 16:34:18 user nova-compute[71731]: INFO nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] Updating resource usage from migration f95a8bc3-801a-4447-b4ea-330328feac3a
Apr 13 16:34:18 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance f66553f5-5e1b-4f1d-8c5a-63bc340f7586 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 16:34:18 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance 235f827c-7116-48e9-84c5-0c9761c18e1e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 16:34:18 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance bf98c3a2-dbeb-4ae4-8423-ce55964c4258 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 16:34:18 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance 32b18558-8bf2-4def-bc70-81c4e38fcc6f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 16:34:18 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance 650427bd-4dad-4bcd-922d-c17e60b36807 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 16:34:18 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance 2956ab05-28ff-4c9e-b646-dbb83b3db278 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 16:34:18 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance 64a9c052-89a9-48ba-80c9-13fb5ef22f0e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 16:34:18 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Migration f95a8bc3-801a-4447-b4ea-330328feac3a is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 128, 'DISK_GB': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1637}}
Apr 13 16:34:18 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance acbcaee0-a47b-4fee-8765-9b1c9597d515 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 16:34:18 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance 220e1c3e-1378-46fc-acc1-ee1bafac7722 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 16:34:18 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=71731) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 16:34:18 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Final resource view: name=user phys_ram=16023MB used_ram=1856MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=71731) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 16:34:19 user nova-compute[71731]: DEBUG nova.compute.provider_tree [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Inventory has not changed in ProviderTree for provider: cb6b1a64-0c24-4e2d-af1e-16576ca9165c {{(pid=71731) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 16:34:19 user nova-compute[71731]: DEBUG nova.scheduler.client.report [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Inventory has not changed for provider cb6b1a64-0c24-4e2d-af1e-16576ca9165c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71731) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 16:34:19 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Compute_service record updated for user:user {{(pid=71731) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 16:34:19 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.482s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:34:19 user nova-compute[71731]: DEBUG nova.network.neutron [None req-aab9a7b9-9c31-4d45-beaf-7bf0d37c3af9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] Updating instance_info_cache with network_info: [{"id": "13471516-9514-4b85-938f-69657c2990e5", "address": "fa:16:3e:62:32:7f", "network": {"id": "cf1fef97-9ef1-449f-a302-b38110024547", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1138167711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "980559734a504574a83224deb7423c77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13471516-95", "ovs_interfaceid": "13471516-9514-4b85-938f-69657c2990e5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:34:19 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-aab9a7b9-9c31-4d45-beaf-7bf0d37c3af9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Releasing lock "refresh_cache-acbcaee0-a47b-4fee-8765-9b1c9597d515" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 16:34:19 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-aab9a7b9-9c31-4d45-beaf-7bf0d37c3af9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] Creating tmpfile /opt/stack/data/nova/instances/acbcaee0-a47b-4fee-8765-9b1c9597d515/tmpieb5_gso to verify with other compute node that the instance is on the same shared storage. {{(pid=71731) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9595}}
Apr 13 16:34:20 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:34:20 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:34:20 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:34:20 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:34:20 user nova-compute[71731]: DEBUG nova.compute.manager [req-700403dd-d6c5-43bb-8843-6db09a213c74 req-6709353b-1bcc-41f6-8ef0-a998cc2018da service nova] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] Received event network-vif-unplugged-13471516-9514-4b85-938f-69657c2990e5 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:34:20 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-700403dd-d6c5-43bb-8843-6db09a213c74 req-6709353b-1bcc-41f6-8ef0-a998cc2018da service nova] Acquiring lock "acbcaee0-a47b-4fee-8765-9b1c9597d515-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:34:20 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-700403dd-d6c5-43bb-8843-6db09a213c74 req-6709353b-1bcc-41f6-8ef0-a998cc2018da service nova] Lock "acbcaee0-a47b-4fee-8765-9b1c9597d515-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:34:20 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-700403dd-d6c5-43bb-8843-6db09a213c74 req-6709353b-1bcc-41f6-8ef0-a998cc2018da service nova] Lock "acbcaee0-a47b-4fee-8765-9b1c9597d515-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:34:20 user nova-compute[71731]: DEBUG nova.compute.manager [req-700403dd-d6c5-43bb-8843-6db09a213c74 req-6709353b-1bcc-41f6-8ef0-a998cc2018da service nova] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] No waiting events found dispatching network-vif-unplugged-13471516-9514-4b85-938f-69657c2990e5 {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:34:20 user nova-compute[71731]: WARNING nova.compute.manager [req-700403dd-d6c5-43bb-8843-6db09a213c74 req-6709353b-1bcc-41f6-8ef0-a998cc2018da service nova] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] Received unexpected event network-vif-unplugged-13471516-9514-4b85-938f-69657c2990e5 for instance with vm_state resized and task_state resize_reverting.
Apr 13 16:34:20 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:34:20 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Starting heal instance info cache {{(pid=71731) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 16:34:20 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Acquiring lock "refresh_cache-acbcaee0-a47b-4fee-8765-9b1c9597d515" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 16:34:20 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Acquired lock "refresh_cache-acbcaee0-a47b-4fee-8765-9b1c9597d515" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 16:34:20 user nova-compute[71731]: DEBUG nova.network.neutron [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] Forcefully refreshing network info cache for instance {{(pid=71731) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 16:34:20 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:34:20 user nova-compute[71731]: INFO nova.virt.libvirt.driver [-] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] Instance destroyed successfully.
Apr 13 16:34:20 user nova-compute[71731]: DEBUG nova.objects.instance [None req-aab9a7b9-9c31-4d45-beaf-7bf0d37c3af9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lazy-loading 'resources' on Instance uuid acbcaee0-a47b-4fee-8765-9b1c9597d515 {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:34:20 user nova-compute[71731]: DEBUG nova.virt.libvirt.vif [None req-aab9a7b9-9c31-4d45-beaf-7bf0d37c3af9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-13T16:23:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1986504733',display_name='tempest-ServerActionsTestJSON-server-376598631',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1986504733',id=16,image_ref='708622a9-7465-4492-ade8-b827198f7e30',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPaDda4gTmMbkxKfok8i4i1XcNLza5lOVYjCPDEGVTF1JRQKderq80DnIN4GAkaZiBV5U44gvdu3wadL/M5wOH7VDSuEghHchow1mC9TB1xgdo8GoXeM279SVAyu08uhIQ==',key_name='tempest-keypair-1700037342',keypairs=<?>,launch_index=0,launched_at=2023-04-13T16:32:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=<?>,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='980559734a504574a83224deb7423c77',ramdisk_id='',reservation_id='r-3vv5sptg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='708622a9-7465-4492-ade8-b827198f7e30',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-713402718',owner_user_name='tempest-ServerActionsTestJSON-713402718-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T16:32:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1b3df1c5c5d441819bcef89ed6966815',uuid=acbcaee0-a47b-4fee-8765-9b1c9597d515,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "13471516-9514-4b85-938f-69657c2990e5", "address": "fa:16:3e:62:32:7f", "network": {"id": "cf1fef97-9ef1-449f-a302-b38110024547", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1138167711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "980559734a504574a83224deb7423c77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13471516-95", "ovs_interfaceid": "13471516-9514-4b85-938f-69657c2990e5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 16:34:20 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-aab9a7b9-9c31-4d45-beaf-7bf0d37c3af9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Converting VIF {"id": "13471516-9514-4b85-938f-69657c2990e5", "address": "fa:16:3e:62:32:7f", "network": {"id": "cf1fef97-9ef1-449f-a302-b38110024547", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1138167711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "980559734a504574a83224deb7423c77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13471516-95", "ovs_interfaceid": "13471516-9514-4b85-938f-69657c2990e5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 16:34:20 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-aab9a7b9-9c31-4d45-beaf-7bf0d37c3af9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:62:32:7f,bridge_name='br-int',has_traffic_filtering=True,id=13471516-9514-4b85-938f-69657c2990e5,network=Network(cf1fef97-9ef1-449f-a302-b38110024547),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13471516-95') {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 16:34:20 user nova-compute[71731]: DEBUG os_vif [None req-aab9a7b9-9c31-4d45-beaf-7bf0d37c3af9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:62:32:7f,bridge_name='br-int',has_traffic_filtering=True,id=13471516-9514-4b85-938f-69657c2990e5,network=Network(cf1fef97-9ef1-449f-a302-b38110024547),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13471516-95') {{(pid=71731) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 16:34:20 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:34:20 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap13471516-95, bridge=br-int, if_exists=True) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:34:20 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:34:20 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 16:34:20 user nova-compute[71731]: INFO os_vif [None req-aab9a7b9-9c31-4d45-beaf-7bf0d37c3af9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:62:32:7f,bridge_name='br-int',has_traffic_filtering=True,id=13471516-9514-4b85-938f-69657c2990e5,network=Network(cf1fef97-9ef1-449f-a302-b38110024547),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13471516-95')
Apr 13 16:34:20 user nova-compute[71731]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aab9a7b9-9c31-4d45-beaf-7bf0d37c3af9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] calling os-brick to detach iSCSI Volume {{(pid=71731) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 16:34:20 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-aab9a7b9-9c31-4d45-beaf-7bf0d37c3af9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8cf0118790>, {'target_iqn': 'iqn.2010-10.org.openstack:651ea766-ffda-42a1-9b3c-7be05a92c85f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ufUqtxTm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde': {}}" {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 16:34:20 user nova-compute[71731]: WARNING os_brick.initiator.connectors.base [None req-aab9a7b9-9c31-4d45-beaf-7bf0d37c3af9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 16:34:20 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-aab9a7b9-9c31-4d45-beaf-7bf0d37c3af9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 16:34:20 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-aab9a7b9-9c31-4d45-beaf-7bf0d37c3af9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 16:34:20 user nova-compute[71731]: DEBUG nova.network.neutron [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] Updating instance_info_cache with network_info: [{"id": "13471516-9514-4b85-938f-69657c2990e5", "address": "fa:16:3e:62:32:7f", "network": {"id": "cf1fef97-9ef1-449f-a302-b38110024547", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1138167711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "980559734a504574a83224deb7423c77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13471516-95", "ovs_interfaceid": "13471516-9514-4b85-938f-69657c2990e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:34:20 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:34:20 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Releasing lock "refresh_cache-acbcaee0-a47b-4fee-8765-9b1c9597d515" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 16:34:20 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] Updated the network info_cache for instance {{(pid=71731) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 16:34:20 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:34:20 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:34:20 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:34:20 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[369c7cc8-686c-475c-8cdc-908bda79aeb6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c2088266-1d33-4bb1-ac5b-1de832ff7985\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:25c3dc97-c9cb-4529-ab32-26ef7fd94fc6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:651ea766-ffda-42a1-9b3c-7be05a92c85f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:34:20 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:34:20 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71731) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 16:34:20 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-aab9a7b9-9c31-4d45-beaf-7bf0d37c3af9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 16:34:20 user nova-compute[71731]: No targets found.
Apr 13 16:34:20 user nova-compute[71731]: iSNS:
Apr 13 16:34:20 user nova-compute[71731]: No targets found.
Apr 13 16:34:20 user nova-compute[71731]: STATIC:
Apr 13 16:34:20 user nova-compute[71731]: Target: iqn.2010-10.org.openstack:c2088266-1d33-4bb1-ac5b-1de832ff7985
Apr 13 16:34:20 user nova-compute[71731]:         Portal: 172.16.0.220:3260,-1
Apr 13 16:34:20 user nova-compute[71731]:                 Iface Name: default
Apr 13 16:34:20 user nova-compute[71731]: Target: iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97
Apr 13 16:34:20 user nova-compute[71731]:         Portal: 172.16.0.220:3260,-1
Apr 13 16:34:20 user nova-compute[71731]:                 Iface Name: default
Apr 13 16:34:20 user nova-compute[71731]: Target: iqn.2010-10.org.openstack:25c3dc97-c9cb-4529-ab32-26ef7fd94fc6
Apr 13 16:34:20 user nova-compute[71731]:         Portal: 172.16.0.220:3260,-1
Apr 13 16:34:20 user nova-compute[71731]:                 Iface Name: default
Apr 13 16:34:20 user nova-compute[71731]: Target: iqn.2010-10.org.openstack:651ea766-ffda-42a1-9b3c-7be05a92c85f
Apr 13 16:34:20 user nova-compute[71731]:         Portal: 172.16.0.220:3260,-1
Apr 13 16:34:20 user nova-compute[71731]:                 Iface Name: default
Apr 13 16:34:20 user nova-compute[71731]: FIRMWARE:
Apr 13 16:34:20 user nova-compute[71731]: No targets found.
Apr 13 16:34:20 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 16:34:20 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-aab9a7b9-9c31-4d45-beaf-7bf0d37c3af9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 16:34:20 user nova-compute[71731]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 16:34:20 user nova-compute[71731]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71731) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 16:34:20 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-aab9a7b9-9c31-4d45-beaf-7bf0d37c3af9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:651ea766-ffda-42a1-9b3c-7be05a92c85f', 0)] {{(pid=71731) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 16:34:20 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:34:20 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:34:20 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[60f14f2e-98aa-4925-8019-91916fac4d69]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:25c3dc97-c9cb-4529-ab32-26ef7fd94fc6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:651ea766-ffda-42a1-9b3c-7be05a92c85f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c2088266-1d33-4bb1-ac5b-1de832ff7985\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:34:20 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:34:20 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:34:20 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[71a978e1-804d-4a3d-b45c-d9fd328ff47d]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25c3dc97-c9cb-4529-ab32-26ef7fd94fc6 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:651ea766-ffda-42a1-9b3c-7be05a92c85f (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2088266-1d33-4bb1-ac5b-1de832ff7985 (non-flash)\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:34:20 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-aab9a7b9-9c31-4d45-beaf-7bf0d37c3af9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)
Apr 13 16:34:20 user nova-compute[71731]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25c3dc97-c9cb-4529-ab32-26ef7fd94fc6 (non-flash)
Apr 13 16:34:20 user nova-compute[71731]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:651ea766-ffda-42a1-9b3c-7be05a92c85f (non-flash)
Apr 13 16:34:20 user nova-compute[71731]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2088266-1d33-4bb1-ac5b-1de832ff7985 (non-flash)
Apr 13 16:34:20 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 16:34:20 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-aab9a7b9-9c31-4d45-beaf-7bf0d37c3af9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)
Apr 13 16:34:20 user nova-compute[71731]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25c3dc97-c9cb-4529-ab32-26ef7fd94fc6 (non-flash)
Apr 13 16:34:20 user nova-compute[71731]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:651ea766-ffda-42a1-9b3c-7be05a92c85f (non-flash)
Apr 13 16:34:20 user nova-compute[71731]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2088266-1d33-4bb1-ac5b-1de832ff7985 (non-flash)
Apr 13 16:34:20 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 16:34:20 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-aab9a7b9-9c31-4d45-beaf-7bf0d37c3af9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8cff365c60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:651ea766-ffda-42a1-9b3c-7be05a92c85f'): ({'sde'}, set())}) {{(pid=71731) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 16:34:20 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-aab9a7b9-9c31-4d45-beaf-7bf0d37c3af9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Removing single pathed devices sde {{(pid=71731) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 16:34:20 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:34:20 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:34:20 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[4497e070-8674-45e8-9f17-4f08583e521e]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:34:20 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:34:20 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:34:20 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7af9806-1a5e-43f1-afaf-a964b319a9dc]: (4, ('ok\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:34:20 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-aab9a7b9-9c31-4d45-beaf-7bf0d37c3af9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Flushing IO for device /dev/sde {{(pid=71731) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 16:34:20 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:34:20 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.012s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:34:20 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[88a36172-6fd2-4cea-af24-ad5902a3cf77]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:34:20 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-aab9a7b9-9c31-4d45-beaf-7bf0d37c3af9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=71731) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 16:34:20 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:34:21 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.049s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:34:21 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[cecb0699-791e-4479-b511-204405b58881]: (4, ('1', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:34:21 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-aab9a7b9-9c31-4d45-beaf-7bf0d37c3af9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=71731) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 16:34:21 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-aab9a7b9-9c31-4d45-beaf-7bf0d37c3af9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] SCSI volumes sde have been removed. {{(pid=71731) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 16:34:21 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-aab9a7b9-9c31-4d45-beaf-7bf0d37c3af9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:651ea766-ffda-42a1-9b3c-7be05a92c85f')] {{(pid=71731) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 16:34:21 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:651ea766-ffda-42a1-9b3c-7be05a92c85f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:34:21 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:34:21 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:651ea766-ffda-42a1-9b3c-7be05a92c85f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:34:21 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc08479e-6d11-4155-ac69-e4d8799ba8a1]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:34:21 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-aab9a7b9-9c31-4d45-beaf-7bf0d37c3af9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:34:21 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:651ea766-ffda-42a1-9b3c-7be05a92c85f -p 172.16.0.220:3260 --logout {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:34:21 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:651ea766-ffda-42a1-9b3c-7be05a92c85f -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:34:21 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[377cc265-ab9f-44ac-9291-ecf39ec09b7f]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:651ea766-ffda-42a1-9b3c-7be05a92c85f, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:651ea766-ffda-42a1-9b3c-7be05a92c85f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:34:21 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-aab9a7b9-9c31-4d45-beaf-7bf0d37c3af9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:651ea766-ffda-42a1-9b3c-7be05a92c85f, portal: 172.16.0.220,3260]
Apr 13 16:34:21 user nova-compute[71731]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:651ea766-ffda-42a1-9b3c-7be05a92c85f, portal: 172.16.0.220,3260] successful.
Apr 13 16:34:21 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:34:21 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:651ea766-ffda-42a1-9b3c-7be05a92c85f -p 172.16.0.220:3260 --op delete {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:34:21 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:651ea766-ffda-42a1-9b3c-7be05a92c85f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:34:21 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1410727-f15a-4617-8462-e58509f7ddaf]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:34:21 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-aab9a7b9-9c31-4d45-beaf-7bf0d37c3af9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:34:21 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-aab9a7b9-9c31-4d45-beaf-7bf0d37c3af9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.308s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 16:34:21 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-aab9a7b9-9c31-4d45-beaf-7bf0d37c3af9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] <== disconnect_volume: return (310ms) None {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 16:34:21 user nova-compute[71731]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aab9a7b9-9c31-4d45-beaf-7bf0d37c3af9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] Disconnected iSCSI Volume {{(pid=71731) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 16:34:22 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:34:22 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-aab9a7b9-9c31-4d45-beaf-7bf0d37c3af9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:34:22 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-aab9a7b9-9c31-4d45-beaf-7bf0d37c3af9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:34:22 user nova-compute[71731]: DEBUG nova.objects.instance [None req-aab9a7b9-9c31-4d45-beaf-7bf0d37c3af9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lazy-loading 'migration_context' on Instance uuid acbcaee0-a47b-4fee-8765-9b1c9597d515 {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:34:22 user nova-compute[71731]: DEBUG nova.compute.manager [req-528ade71-9a31-4267-8dd1-0adc1ac16522 req-36314a88-9c7f-4a63-b23d-f1f738af6640 service nova] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] Received event network-vif-plugged-13471516-9514-4b85-938f-69657c2990e5 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:34:22 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-528ade71-9a31-4267-8dd1-0adc1ac16522 req-36314a88-9c7f-4a63-b23d-f1f738af6640 service nova] Acquiring lock "acbcaee0-a47b-4fee-8765-9b1c9597d515-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:34:22 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-528ade71-9a31-4267-8dd1-0adc1ac16522 req-36314a88-9c7f-4a63-b23d-f1f738af6640 service nova] Lock "acbcaee0-a47b-4fee-8765-9b1c9597d515-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:34:22 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-528ade71-9a31-4267-8dd1-0adc1ac16522 req-36314a88-9c7f-4a63-b23d-f1f738af6640 service nova] Lock "acbcaee0-a47b-4fee-8765-9b1c9597d515-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:34:22 user nova-compute[71731]: DEBUG nova.compute.manager [req-528ade71-9a31-4267-8dd1-0adc1ac16522 req-36314a88-9c7f-4a63-b23d-f1f738af6640 service nova] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] No waiting events found dispatching network-vif-plugged-13471516-9514-4b85-938f-69657c2990e5 {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:34:22 user nova-compute[71731]: WARNING nova.compute.manager [req-528ade71-9a31-4267-8dd1-0adc1ac16522 req-36314a88-9c7f-4a63-b23d-f1f738af6640 service nova] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] Received unexpected event network-vif-plugged-13471516-9514-4b85-938f-69657c2990e5 for instance with vm_state resized and task_state resize_reverting.
Apr 13 16:34:22 user nova-compute[71731]: DEBUG nova.compute.provider_tree [None req-aab9a7b9-9c31-4d45-beaf-7bf0d37c3af9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Inventory has not changed in ProviderTree for provider: cb6b1a64-0c24-4e2d-af1e-16576ca9165c {{(pid=71731) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 16:34:22 user nova-compute[71731]: DEBUG nova.scheduler.client.report [None req-aab9a7b9-9c31-4d45-beaf-7bf0d37c3af9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Inventory has not changed for provider cb6b1a64-0c24-4e2d-af1e-16576ca9165c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71731) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 16:34:22 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-aab9a7b9-9c31-4d45-beaf-7bf0d37c3af9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.386s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:34:22 user nova-compute[71731]: INFO nova.compute.manager [None req-aab9a7b9-9c31-4d45-beaf-7bf0d37c3af9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] Swapping old allocation on dict_keys(['cb6b1a64-0c24-4e2d-af1e-16576ca9165c']) held by migration f95a8bc3-801a-4447-b4ea-330328feac3a for instance
Apr 13 16:34:22 user nova-compute[71731]: DEBUG nova.scheduler.client.report [None req-aab9a7b9-9c31-4d45-beaf-7bf0d37c3af9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Overwriting current allocation {'allocations': {'cb6b1a64-0c24-4e2d-af1e-16576ca9165c': {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}, 'generation': 35}}, 'project_id': '980559734a504574a83224deb7423c77', 'user_id': '1b3df1c5c5d441819bcef89ed6966815', 'consumer_generation': 1} on consumer acbcaee0-a47b-4fee-8765-9b1c9597d515 {{(pid=71731) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Apr 13 16:34:22 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-aab9a7b9-9c31-4d45-beaf-7bf0d37c3af9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Acquiring lock "refresh_cache-acbcaee0-a47b-4fee-8765-9b1c9597d515" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 16:34:22 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-aab9a7b9-9c31-4d45-beaf-7bf0d37c3af9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Acquired lock "refresh_cache-acbcaee0-a47b-4fee-8765-9b1c9597d515" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 16:34:22 user nova-compute[71731]: DEBUG nova.network.neutron [None req-aab9a7b9-9c31-4d45-beaf-7bf0d37c3af9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] Building network info cache for instance {{(pid=71731) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 16:34:23 user nova-compute[71731]: DEBUG nova.network.neutron [None req-aab9a7b9-9c31-4d45-beaf-7bf0d37c3af9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] Updating instance_info_cache with network_info: [{"id": "13471516-9514-4b85-938f-69657c2990e5", "address": "fa:16:3e:62:32:7f", "network": {"id": "cf1fef97-9ef1-449f-a302-b38110024547", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1138167711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "980559734a504574a83224deb7423c77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13471516-95", "ovs_interfaceid": "13471516-9514-4b85-938f-69657c2990e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:34:23 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-aab9a7b9-9c31-4d45-beaf-7bf0d37c3af9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Releasing lock "refresh_cache-acbcaee0-a47b-4fee-8765-9b1c9597d515" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 16:34:23 user nova-compute[71731]: DEBUG os_brick.utils [None req-aab9a7b9-9c31-4d45-beaf-7bf0d37c3af9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 16:34:23 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:34:23 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:34:23 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[dea0ef3f-f9c2-40a0-bbe7-64867e3b73b8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:81501d91421\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:34:23 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:34:23 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:34:23 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a06dcbe-ff58-4a04-8acb-3686a6c219b7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:34:23 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:34:23 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:34:23 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a1d1f1e-8d20-4775-8936-0c8e84780cb6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:34:23 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[09b1ddb2-2ab4-48b5-ab40-b436d4f7d97e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:34:23 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-aab9a7b9-9c31-4d45-beaf-7bf0d37c3af9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Running cmd (subprocess): nvme version {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:34:23 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-aab9a7b9-9c31-4d45-beaf-7bf0d37c3af9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] 'nvme version' failed. Not Retrying. {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 16:34:23 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.nvmeof [None req-aab9a7b9-9c31-4d45-beaf-7bf0d37c3af9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] nvme not present on system {{(pid=71731) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 16:34:23 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:34:23 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 16:34:23 user nova-compute[71731]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 16:34:23 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[f80e9597-4090-4165-b96c-c0f93e9310ed]: (4, '') {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:34:23 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.lightos [None req-aab9a7b9-9c31-4d45-beaf-7bf0d37c3af9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71731) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 16:34:23 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.lightos [None req-aab9a7b9-9c31-4d45-beaf-7bf0d37c3af9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71731) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 16:34:23 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.lightos [None req-aab9a7b9-9c31-4d45-beaf-7bf0d37c3af9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] LIGHTOS: no hostnqn found. {{(pid=71731) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 16:34:23 user nova-compute[71731]: DEBUG os_brick.utils [None req-aab9a7b9-9c31-4d45-beaf-7bf0d37c3af9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:81501d91421', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 16:34:24 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:34:25 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:34:25 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:34:26 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:34:27 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-aab9a7b9-9c31-4d45-beaf-7bf0d37c3af9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] Starting finish_revert_migration {{(pid=71731) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11792}}
Apr 13 16:34:27 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-aab9a7b9-9c31-4d45-beaf-7bf0d37c3af9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] Start _get_guest_xml network_info=[{"id": "13471516-9514-4b85-938f-69657c2990e5", "address": "fa:16:3e:62:32:7f", "network": {"id": "cf1fef97-9ef1-449f-a302-b38110024547", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1138167711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "980559734a504574a83224deb7423c77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13471516-95", "ovs_interfaceid": "13471516-9514-4b85-938f-69657c2990e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=708622a9-7465-4492-ade8-b827198f7e30,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'device_type': 'disk', 'encrypted': False, 'disk_bus': 'virtio', 'guest_format': None, 'encryption_options': None, 'image_id': '708622a9-7465-4492-ade8-b827198f7e30'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'attachment_id': '9ff81327-8bcb-4532-8807-c185e6b4ddf2', 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:651ea766-ffda-42a1-9b3c-7be05a92c85f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ufUqtxTm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'acbcaee0-a47b-4fee-8765-9b1c9597d515', 'attached_at': '2023-04-13T16:34:28.000000', 'detached_at': '', 'volume_id': '651ea766-ffda-42a1-9b3c-7be05a92c85f', 'serial': '651ea766-ffda-42a1-9b3c-7be05a92c85f'}, 'disk_bus': 'virtio', 'guest_format': None, 'volume_type': None} {{(pid=71731) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 16:34:27 user nova-compute[71731]: WARNING nova.virt.libvirt.driver [None req-aab9a7b9-9c31-4d45-beaf-7bf0d37c3af9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 16:34:27 user nova-compute[71731]: WARNING nova.virt.libvirt.driver [None req-aab9a7b9-9c31-4d45-beaf-7bf0d37c3af9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 16:34:27 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-aab9a7b9-9c31-4d45-beaf-7bf0d37c3af9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71731) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 16:34:27 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-aab9a7b9-9c31-4d45-beaf-7bf0d37c3af9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T16:17:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=708622a9-7465-4492-ade8-b827198f7e30,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 16:34:27 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-aab9a7b9-9c31-4d45-beaf-7bf0d37c3af9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Flavor limits 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 16:34:27 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-aab9a7b9-9c31-4d45-beaf-7bf0d37c3af9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Image limits 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 16:34:27 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-aab9a7b9-9c31-4d45-beaf-7bf0d37c3af9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Flavor pref 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 16:34:27 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-aab9a7b9-9c31-4d45-beaf-7bf0d37c3af9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Image pref 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 16:34:27 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-aab9a7b9-9c31-4d45-beaf-7bf0d37c3af9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 16:34:27 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-aab9a7b9-9c31-4d45-beaf-7bf0d37c3af9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 16:34:27 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-aab9a7b9-9c31-4d45-beaf-7bf0d37c3af9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71731) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 16:34:27 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-aab9a7b9-9c31-4d45-beaf-7bf0d37c3af9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Got 1 possible topologies {{(pid=71731) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 16:34:27 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-aab9a7b9-9c31-4d45-beaf-7bf0d37c3af9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 16:34:27 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-aab9a7b9-9c31-4d45-beaf-7bf0d37c3af9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 16:34:27 user nova-compute[71731]: DEBUG nova.objects.instance [None req-aab9a7b9-9c31-4d45-beaf-7bf0d37c3af9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lazy-loading 'vcpu_model' on Instance uuid acbcaee0-a47b-4fee-8765-9b1c9597d515 {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:34:28 user nova-compute[71731]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aab9a7b9-9c31-4d45-beaf-7bf0d37c3af9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] Calling os-brick to attach iSCSI Volume {{(pid=71731) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 16:34:28 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-aab9a7b9-9c31-4d45-beaf-7bf0d37c3af9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8cf0118790>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:651ea766-ffda-42a1-9b3c-7be05a92c85f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ufUqtxTm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 16:34:28 user nova-compute[71731]: WARNING os_brick.initiator.connectors.base [None req-aab9a7b9-9c31-4d45-beaf-7bf0d37c3af9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 16:34:28 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-aab9a7b9-9c31-4d45-beaf-7bf0d37c3af9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 16:34:28 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-aab9a7b9-9c31-4d45-beaf-7bf0d37c3af9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 16:34:28 user nova-compute[71731]: WARNING os_brick.initiator.connectors.base [None req-aab9a7b9-9c31-4d45-beaf-7bf0d37c3af9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 16:34:28 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-aab9a7b9-9c31-4d45-beaf-7bf0d37c3af9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:651ea766-ffda-42a1-9b3c-7be05a92c85f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 16:34:28 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-aab9a7b9-9c31-4d45-beaf-7bf0d37c3af9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:651ea766-ffda-42a1-9b3c-7be05a92c85f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 16:34:28 user nova-compute[71731]: INFO os_brick.initiator.connectors.iscsi [None req-aab9a7b9-9c31-4d45-beaf-7bf0d37c3af9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 16:34:28 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:651ea766-ffda-42a1-9b3c-7be05a92c85f -p 172.16.0.220:3260 {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:34:28 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:651ea766-ffda-42a1-9b3c-7be05a92c85f -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:34:28 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[be2dd7e4-1ef3-4dfd-9ea7-9965bc5931f5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:34:28 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-aab9a7b9-9c31-4d45-beaf-7bf0d37c3af9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 16:34:28 user nova-compute[71731]:  {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:34:28 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:651ea766-ffda-42a1-9b3c-7be05a92c85f -p 172.16.0.220:3260 --interface default --op new {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:34:28 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:651ea766-ffda-42a1-9b3c-7be05a92c85f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:34:28 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbb94c91-6d97-46cb-a8dd-10bb09716344]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:651ea766-ffda-42a1-9b3c-7be05a92c85f] added\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:34:28 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-aab9a7b9-9c31-4d45-beaf-7bf0d37c3af9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:651ea766-ffda-42a1-9b3c-7be05a92c85f] added
Apr 13 16:34:28 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:34:28 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:651ea766-ffda-42a1-9b3c-7be05a92c85f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:34:28 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:651ea766-ffda-42a1-9b3c-7be05a92c85f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:34:28 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e23974e-e71a-41dc-b2b7-94c266525f71]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:34:28 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-aab9a7b9-9c31-4d45-beaf-7bf0d37c3af9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:34:28 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:651ea766-ffda-42a1-9b3c-7be05a92c85f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:34:28 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:651ea766-ffda-42a1-9b3c-7be05a92c85f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:34:28 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[441a56b7-f14f-4bc0-b3fe-09cac8c3ffb3]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:34:28 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-aab9a7b9-9c31-4d45-beaf-7bf0d37c3af9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:34:28 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:651ea766-ffda-42a1-9b3c-7be05a92c85f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ufUqtxTm {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:34:28 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:651ea766-ffda-42a1-9b3c-7be05a92c85f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ufUqtxTm" returned: 0 in 0.018s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:34:28 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ebed366-1028-435a-8697-ba2904f19224]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:34:28 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-aab9a7b9-9c31-4d45-beaf-7bf0d37c3af9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ufUqtxTm'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:34:28 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:651ea766-ffda-42a1-9b3c-7be05a92c85f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:34:28 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:651ea766-ffda-42a1-9b3c-7be05a92c85f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:34:28 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed5530da-9e2c-4a36-948a-158437e34170]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:34:28 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-aab9a7b9-9c31-4d45-beaf-7bf0d37c3af9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:34:28 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:34:28 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:34:28 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[28015b7f-e704-4280-90b9-c6557859169b]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25c3dc97-c9cb-4529-ab32-26ef7fd94fc6 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2088266-1d33-4bb1-ac5b-1de832ff7985 (non-flash)\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:34:28 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-aab9a7b9-9c31-4d45-beaf-7bf0d37c3af9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)
Apr 13 16:34:28 user nova-compute[71731]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25c3dc97-c9cb-4529-ab32-26ef7fd94fc6 (non-flash)
Apr 13 16:34:28 user nova-compute[71731]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2088266-1d33-4bb1-ac5b-1de832ff7985 (non-flash)
Apr 13 16:34:28 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 16:34:28 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-aab9a7b9-9c31-4d45-beaf-7bf0d37c3af9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)
Apr 13 16:34:28 user nova-compute[71731]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25c3dc97-c9cb-4529-ab32-26ef7fd94fc6 (non-flash)
Apr 13 16:34:28 user nova-compute[71731]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2088266-1d33-4bb1-ac5b-1de832ff7985 (non-flash)
Apr 13 16:34:28 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 16:34:28 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:651ea766-ffda-42a1-9b3c-7be05a92c85f -p 172.16.0.220:3260 --login {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:34:28 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:651ea766-ffda-42a1-9b3c-7be05a92c85f -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:34:28 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9a7e6d3-d724-45c3-b723-15a5b5a5779b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:651ea766-ffda-42a1-9b3c-7be05a92c85f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:651ea766-ffda-42a1-9b3c-7be05a92c85f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:34:28 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-aab9a7b9-9c31-4d45-beaf-7bf0d37c3af9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:651ea766-ffda-42a1-9b3c-7be05a92c85f, portal: 172.16.0.220,3260]
Apr 13 16:34:28 user nova-compute[71731]: Login to [iface: default, target: iqn.2010-10.org.openstack:651ea766-ffda-42a1-9b3c-7be05a92c85f, portal: 172.16.0.220,3260] successful.
Apr 13 16:34:28 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:34:28 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:651ea766-ffda-42a1-9b3c-7be05a92c85f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:34:28 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:651ea766-ffda-42a1-9b3c-7be05a92c85f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:34:28 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9e1e11b-9ead-4f62-8800-ef4732c3cebc]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:34:28 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-aab9a7b9-9c31-4d45-beaf-7bf0d37c3af9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:34:28 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:34:28 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:34:28 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fee0a1a-d887-4e7c-b783-e1ba547df154]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25c3dc97-c9cb-4529-ab32-26ef7fd94fc6 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2088266-1d33-4bb1-ac5b-1de832ff7985 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:651ea766-ffda-42a1-9b3c-7be05a92c85f (non-flash)\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:34:28 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-aab9a7b9-9c31-4d45-beaf-7bf0d37c3af9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)
Apr 13 16:34:28 user nova-compute[71731]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25c3dc97-c9cb-4529-ab32-26ef7fd94fc6 (non-flash)
Apr 13 16:34:28 user nova-compute[71731]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2088266-1d33-4bb1-ac5b-1de832ff7985 (non-flash)
Apr 13 16:34:28 user nova-compute[71731]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:651ea766-ffda-42a1-9b3c-7be05a92c85f (non-flash)
Apr 13 16:34:28 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 16:34:28 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-aab9a7b9-9c31-4d45-beaf-7bf0d37c3af9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)
Apr 13 16:34:28 user nova-compute[71731]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25c3dc97-c9cb-4529-ab32-26ef7fd94fc6 (non-flash)
Apr 13 16:34:28 user nova-compute[71731]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2088266-1d33-4bb1-ac5b-1de832ff7985 (non-flash)
Apr 13 16:34:28 user nova-compute[71731]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:651ea766-ffda-42a1-9b3c-7be05a92c85f (non-flash)
Apr 13 16:34:28 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 16:34:28 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-aab9a7b9-9c31-4d45-beaf-7bf0d37c3af9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:651ea766-ffda-42a1-9b3c-7be05a92c85f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.267s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 16:34:28 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-aab9a7b9-9c31-4d45-beaf-7bf0d37c3af9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Connected to 172.16.0.220:3260 {{(pid=71731) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 16:34:28 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-aab9a7b9-9c31-4d45-beaf-7bf0d37c3af9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] HCTL ('36', '-', '-', 0) found on session 39 with lun 0 {{(pid=71731) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 16:34:28 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-aab9a7b9-9c31-4d45-beaf-7bf0d37c3af9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=71731) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 16:34:28 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:34:28 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:34:28 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[1df71dea-abf6-4942-a359-8776bb12c4a7]: (4, ('- - 0', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:34:28 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-aab9a7b9-9c31-4d45-beaf-7bf0d37c3af9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Searching for a device in session 39 and hctl ['36', '*', '*', 0] yield: None {{(pid=71731) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 16:34:29 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-aab9a7b9-9c31-4d45-beaf-7bf0d37c3af9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Searching for a device in session 39 and hctl ['36', '*', '*', 0] yield: sde {{(pid=71731) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 16:34:29 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-aab9a7b9-9c31-4d45-beaf-7bf0d37c3af9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:651ea766-ffda-42a1-9b3c-7be05a92c85f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ufUqtxTm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71731) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 16:34:29 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-aab9a7b9-9c31-4d45-beaf-7bf0d37c3af9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.296s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 16:34:29 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-aab9a7b9-9c31-4d45-beaf-7bf0d37c3af9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] <== connect_volume: return (1297ms) {'type': 'block', 'scsi_wwn': '26238616634396438', 'path': '/dev/sde'} {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 16:34:29 user nova-compute[71731]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aab9a7b9-9c31-4d45-beaf-7bf0d37c3af9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26238616634396438', 'path': '/dev/sde'} {{(pid=71731) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 16:34:29 user nova-compute[71731]: DEBUG nova.virt.libvirt.vif [None req-aab9a7b9-9c31-4d45-beaf-7bf0d37c3af9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-13T16:23:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1986504733',display_name='tempest-ServerActionsTestJSON-server-376598631',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1986504733',id=16,image_ref='708622a9-7465-4492-ade8-b827198f7e30',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPaDda4gTmMbkxKfok8i4i1XcNLza5lOVYjCPDEGVTF1JRQKderq80DnIN4GAkaZiBV5U44gvdu3wadL/M5wOH7VDSuEghHchow1mC9TB1xgdo8GoXeM279SVAyu08uhIQ==',key_name='tempest-keypair-1700037342',keypairs=<?>,launch_index=0,launched_at=2023-04-13T16:32:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={rebuild='server'},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='980559734a504574a83224deb7423c77',ramdisk_id='',reservation_id='r-3vv5sptg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='708622a9-7465-4492-ade8-b827198f7e30',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-713402718',owner_user_name='tempest-ServerActionsTestJSON-713402718-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T16:34:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1b3df1c5c5d441819bcef89ed6966815',uuid=acbcaee0-a47b-4fee-8765-9b1c9597d515,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "13471516-9514-4b85-938f-69657c2990e5", "address": "fa:16:3e:62:32:7f", "network": {"id": "cf1fef97-9ef1-449f-a302-b38110024547", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1138167711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "980559734a504574a83224deb7423c77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13471516-95", "ovs_interfaceid": "13471516-9514-4b85-938f-69657c2990e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71731) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 16:34:29 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-aab9a7b9-9c31-4d45-beaf-7bf0d37c3af9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Converting VIF {"id": "13471516-9514-4b85-938f-69657c2990e5", "address": "fa:16:3e:62:32:7f", "network": {"id": "cf1fef97-9ef1-449f-a302-b38110024547", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1138167711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "980559734a504574a83224deb7423c77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13471516-95", "ovs_interfaceid": "13471516-9514-4b85-938f-69657c2990e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 16:34:29 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-aab9a7b9-9c31-4d45-beaf-7bf0d37c3af9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:62:32:7f,bridge_name='br-int',has_traffic_filtering=True,id=13471516-9514-4b85-938f-69657c2990e5,network=Network(cf1fef97-9ef1-449f-a302-b38110024547),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13471516-95') {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 16:34:29 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-aab9a7b9-9c31-4d45-beaf-7bf0d37c3af9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] End _get_guest_xml xml=<domain type="kvm">
Apr 13 16:34:29 user nova-compute[71731]:   <uuid>acbcaee0-a47b-4fee-8765-9b1c9597d515</uuid>
Apr 13 16:34:29 user nova-compute[71731]:   <name>instance-00000010</name>
Apr 13 16:34:29 user nova-compute[71731]:   <memory>131072</memory>
Apr 13 16:34:29 user nova-compute[71731]:   <vcpu>1</vcpu>
Apr 13 16:34:29 user nova-compute[71731]:   <metadata>
Apr 13 16:34:29 user nova-compute[71731]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 16:34:29 user nova-compute[71731]:       <nova:package version="0.0.0"/>
Apr 13 16:34:29 user nova-compute[71731]:       <nova:name>tempest-ServerActionsTestJSON-server-376598631</nova:name>
Apr 13 16:34:29 user nova-compute[71731]:       <nova:creationTime>2023-04-13 16:34:27</nova:creationTime>
Apr 13 16:34:29 user nova-compute[71731]:       <nova:flavor name="m1.nano">
Apr 13 16:34:29 user nova-compute[71731]:         <nova:memory>128</nova:memory>
Apr 13 16:34:29 user nova-compute[71731]:         <nova:disk>1</nova:disk>
Apr 13 16:34:29 user nova-compute[71731]:         <nova:swap>0</nova:swap>
Apr 13 16:34:29 user nova-compute[71731]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 16:34:29 user nova-compute[71731]:         <nova:vcpus>1</nova:vcpus>
Apr 13 16:34:29 user nova-compute[71731]:       </nova:flavor>
Apr 13 16:34:29 user nova-compute[71731]:       <nova:owner>
Apr 13 16:34:29 user nova-compute[71731]:         <nova:user uuid="1b3df1c5c5d441819bcef89ed6966815">tempest-ServerActionsTestJSON-713402718-project-member</nova:user>
Apr 13 16:34:29 user nova-compute[71731]:         <nova:project uuid="980559734a504574a83224deb7423c77">tempest-ServerActionsTestJSON-713402718</nova:project>
Apr 13 16:34:29 user nova-compute[71731]:       </nova:owner>
Apr 13 16:34:29 user nova-compute[71731]:       <nova:root type="image" uuid="708622a9-7465-4492-ade8-b827198f7e30"/>
Apr 13 16:34:29 user nova-compute[71731]:       <nova:ports>
Apr 13 16:34:29 user nova-compute[71731]:         <nova:port uuid="13471516-9514-4b85-938f-69657c2990e5">
Apr 13 16:34:29 user nova-compute[71731]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Apr 13 16:34:29 user nova-compute[71731]:         </nova:port>
Apr 13 16:34:29 user nova-compute[71731]:       </nova:ports>
Apr 13 16:34:29 user nova-compute[71731]:     </nova:instance>
Apr 13 16:34:29 user nova-compute[71731]:   </metadata>
Apr 13 16:34:29 user nova-compute[71731]:   <sysinfo type="smbios">
Apr 13 16:34:29 user nova-compute[71731]:     <system>
Apr 13 16:34:29 user nova-compute[71731]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 16:34:29 user nova-compute[71731]:       <entry name="product">OpenStack Nova</entry>
Apr 13 16:34:29 user nova-compute[71731]:       <entry name="version">0.0.0</entry>
Apr 13 16:34:29 user nova-compute[71731]:       <entry name="serial">acbcaee0-a47b-4fee-8765-9b1c9597d515</entry>
Apr 13 16:34:29 user nova-compute[71731]:       <entry name="uuid">acbcaee0-a47b-4fee-8765-9b1c9597d515</entry>
Apr 13 16:34:29 user nova-compute[71731]:       <entry name="family">Virtual Machine</entry>
Apr 13 16:34:29 user nova-compute[71731]:     </system>
Apr 13 16:34:29 user nova-compute[71731]:   </sysinfo>
Apr 13 16:34:29 user nova-compute[71731]:   <os>
Apr 13 16:34:29 user nova-compute[71731]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 16:34:29 user nova-compute[71731]:     <boot dev="hd"/>
Apr 13 16:34:29 user nova-compute[71731]:     <smbios mode="sysinfo"/>
Apr 13 16:34:29 user nova-compute[71731]:   </os>
Apr 13 16:34:29 user nova-compute[71731]:   <features>
Apr 13 16:34:29 user nova-compute[71731]:     <acpi/>
Apr 13 16:34:29 user nova-compute[71731]:     <apic/>
Apr 13 16:34:29 user nova-compute[71731]:     <vmcoreinfo/>
Apr 13 16:34:29 user nova-compute[71731]:   </features>
Apr 13 16:34:29 user nova-compute[71731]:   <clock offset="utc">
Apr 13 16:34:29 user nova-compute[71731]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 16:34:29 user nova-compute[71731]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 16:34:29 user nova-compute[71731]:     <timer name="hpet" present="no"/>
Apr 13 16:34:29 user nova-compute[71731]:   </clock>
Apr 13 16:34:29 user nova-compute[71731]:   <cpu mode="custom" match="exact">
Apr 13 16:34:29 user nova-compute[71731]:     <model>Nehalem</model>
Apr 13 16:34:29 user nova-compute[71731]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 16:34:29 user nova-compute[71731]:   </cpu>
Apr 13 16:34:29 user nova-compute[71731]:   <devices>
Apr 13 16:34:29 user nova-compute[71731]:     <disk type="file" device="disk">
Apr 13 16:34:29 user nova-compute[71731]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 16:34:29 user nova-compute[71731]:       <source file="/opt/stack/data/nova/instances/acbcaee0-a47b-4fee-8765-9b1c9597d515/disk"/>
Apr 13 16:34:29 user nova-compute[71731]:       <target dev="vda" bus="virtio"/>
Apr 13 16:34:29 user nova-compute[71731]:     </disk>
Apr 13 16:34:29 user nova-compute[71731]:     <disk type="block" device="disk">
Apr 13 16:34:29 user nova-compute[71731]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 16:34:29 user nova-compute[71731]:       <source dev="/dev/sde"/>
Apr 13 16:34:29 user nova-compute[71731]:       <target dev="vdb" bus="virtio"/>
Apr 13 16:34:29 user nova-compute[71731]:       <serial>651ea766-ffda-42a1-9b3c-7be05a92c85f</serial>
Apr 13 16:34:29 user nova-compute[71731]:     </disk>
Apr 13 16:34:29 user nova-compute[71731]:     <interface type="ethernet">
Apr 13 16:34:29 user nova-compute[71731]:       <mac address="fa:16:3e:62:32:7f"/>
Apr 13 16:34:29 user nova-compute[71731]:       <model type="virtio"/>
Apr 13 16:34:29 user nova-compute[71731]:       <mtu size="1442"/>
Apr 13 16:34:29 user nova-compute[71731]:       <target dev="tap13471516-95"/>
Apr 13 16:34:29 user nova-compute[71731]:     </interface>
Apr 13 16:34:29 user nova-compute[71731]:     <serial type="pty">
Apr 13 16:34:29 user nova-compute[71731]:       <log file="/opt/stack/data/nova/instances/acbcaee0-a47b-4fee-8765-9b1c9597d515/console.log" append="off"/>
Apr 13 16:34:29 user nova-compute[71731]:     </serial>
Apr 13 16:34:29 user nova-compute[71731]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 16:34:29 user nova-compute[71731]:     <video>
Apr 13 16:34:29 user nova-compute[71731]:       <model type="virtio"/>
Apr 13 16:34:29 user nova-compute[71731]:     </video>
Apr 13 16:34:29 user nova-compute[71731]:     <rng model="virtio">
Apr 13 16:34:29 user nova-compute[71731]:       <backend model="random">/dev/urandom</backend>
Apr 13 16:34:29 user nova-compute[71731]:     </rng>
Apr 13 16:34:29 user nova-compute[71731]:     <controller type="usb" index="0" model="none"/>
Apr 13 16:34:29 user nova-compute[71731]:     <memballoon model="virtio">
Apr 13 16:34:29 user nova-compute[71731]:       <stats period="10"/>
Apr 13 16:34:29 user nova-compute[71731]:     </memballoon>
Apr 13 16:34:29 user nova-compute[71731]:   </devices>
Apr 13 16:34:29 user nova-compute[71731]: </domain>
Apr 13 16:34:29 user nova-compute[71731]:  {{(pid=71731) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 16:34:29 user nova-compute[71731]: DEBUG nova.virt.libvirt.vif [None req-aab9a7b9-9c31-4d45-beaf-7bf0d37c3af9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-13T16:23:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1986504733',display_name='tempest-ServerActionsTestJSON-server-376598631',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1986504733',id=16,image_ref='708622a9-7465-4492-ade8-b827198f7e30',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPaDda4gTmMbkxKfok8i4i1XcNLza5lOVYjCPDEGVTF1JRQKderq80DnIN4GAkaZiBV5U44gvdu3wadL/M5wOH7VDSuEghHchow1mC9TB1xgdo8GoXeM279SVAyu08uhIQ==',key_name='tempest-keypair-1700037342',keypairs=<?>,launch_index=0,launched_at=2023-04-13T16:32:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={rebuild='server'},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='980559734a504574a83224deb7423c77',ramdisk_id='',reservation_id='r-3vv5sptg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='708622a9-7465-4492-ade8-b827198f7e30',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-713402718',owner_user_name='tempest-ServerActionsTestJSON-713402718-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T16:34:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1b3df1c5c5d441819bcef89ed6966815',uuid=acbcaee0-a47b-4fee-8765-9b1c9597d515,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "13471516-9514-4b85-938f-69657c2990e5", "address": "fa:16:3e:62:32:7f", "network": {"id": "cf1fef97-9ef1-449f-a302-b38110024547", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1138167711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "980559734a504574a83224deb7423c77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13471516-95", "ovs_interfaceid": "13471516-9514-4b85-938f-69657c2990e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 16:34:29 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-aab9a7b9-9c31-4d45-beaf-7bf0d37c3af9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Converting VIF {"id": "13471516-9514-4b85-938f-69657c2990e5", "address": "fa:16:3e:62:32:7f", "network": {"id": "cf1fef97-9ef1-449f-a302-b38110024547", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1138167711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "980559734a504574a83224deb7423c77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13471516-95", "ovs_interfaceid": "13471516-9514-4b85-938f-69657c2990e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 16:34:29 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-aab9a7b9-9c31-4d45-beaf-7bf0d37c3af9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:62:32:7f,bridge_name='br-int',has_traffic_filtering=True,id=13471516-9514-4b85-938f-69657c2990e5,network=Network(cf1fef97-9ef1-449f-a302-b38110024547),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13471516-95') {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 16:34:29 user nova-compute[71731]: DEBUG os_vif [None req-aab9a7b9-9c31-4d45-beaf-7bf0d37c3af9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:32:7f,bridge_name='br-int',has_traffic_filtering=True,id=13471516-9514-4b85-938f-69657c2990e5,network=Network(cf1fef97-9ef1-449f-a302-b38110024547),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13471516-95') {{(pid=71731) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 16:34:29 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:34:29 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:34:29 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 16:34:29 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:34:29 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap13471516-95, may_exist=True) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:34:29 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap13471516-95, col_values=(('external_ids', {'iface-id': '13471516-9514-4b85-938f-69657c2990e5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:62:32:7f', 'vm-uuid': 'acbcaee0-a47b-4fee-8765-9b1c9597d515'}),)) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:34:29 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:34:29 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 16:34:29 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:34:29 user nova-compute[71731]: INFO os_vif [None req-aab9a7b9-9c31-4d45-beaf-7bf0d37c3af9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:32:7f,bridge_name='br-int',has_traffic_filtering=True,id=13471516-9514-4b85-938f-69657c2990e5,network=Network(cf1fef97-9ef1-449f-a302-b38110024547),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13471516-95')
Apr 13 16:34:30 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:34:30 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:34:30 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:34:31 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:34:31 user nova-compute[71731]: DEBUG nova.compute.manager [req-92fb30e8-2fbb-4266-91f1-20ffcf3c6906 req-4a538fb8-1106-472f-9b00-659288884249 service nova] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] Received event network-vif-plugged-13471516-9514-4b85-938f-69657c2990e5 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:34:31 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-92fb30e8-2fbb-4266-91f1-20ffcf3c6906 req-4a538fb8-1106-472f-9b00-659288884249 service nova] Acquiring lock "acbcaee0-a47b-4fee-8765-9b1c9597d515-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:34:31 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-92fb30e8-2fbb-4266-91f1-20ffcf3c6906 req-4a538fb8-1106-472f-9b00-659288884249 service nova] Lock "acbcaee0-a47b-4fee-8765-9b1c9597d515-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:34:31 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-92fb30e8-2fbb-4266-91f1-20ffcf3c6906 req-4a538fb8-1106-472f-9b00-659288884249 service nova] Lock "acbcaee0-a47b-4fee-8765-9b1c9597d515-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:34:31 user nova-compute[71731]: DEBUG nova.compute.manager [req-92fb30e8-2fbb-4266-91f1-20ffcf3c6906 req-4a538fb8-1106-472f-9b00-659288884249 service nova] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] No waiting events found dispatching network-vif-plugged-13471516-9514-4b85-938f-69657c2990e5 {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:34:31 user nova-compute[71731]: WARNING nova.compute.manager [req-92fb30e8-2fbb-4266-91f1-20ffcf3c6906 req-4a538fb8-1106-472f-9b00-659288884249 service nova] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] Received unexpected event network-vif-plugged-13471516-9514-4b85-938f-69657c2990e5 for instance with vm_state resized and task_state resize_reverting.
Apr 13 16:34:31 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:34:31 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:34:33 user nova-compute[71731]: DEBUG nova.virt.libvirt.host [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Removed pending event for acbcaee0-a47b-4fee-8765-9b1c9597d515 due to event {{(pid=71731) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 13 16:34:33 user nova-compute[71731]: DEBUG nova.virt.driver [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Emitting event <LifecycleEvent: 1681403673.230968, acbcaee0-a47b-4fee-8765-9b1c9597d515 => Resumed> {{(pid=71731) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 16:34:33 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] VM Resumed (Lifecycle Event)
Apr 13 16:34:33 user nova-compute[71731]: DEBUG nova.compute.manager [None req-aab9a7b9-9c31-4d45-beaf-7bf0d37c3af9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] Instance event wait completed in 0 seconds for  {{(pid=71731) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 16:34:33 user nova-compute[71731]: INFO nova.virt.libvirt.driver [-] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] Instance running successfully.
Apr 13 16:34:33 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-aab9a7b9-9c31-4d45-beaf-7bf0d37c3af9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] finish_revert_migration finished successfully. {{(pid=71731) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11836}}
Apr 13 16:34:33 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:34:33 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=71731) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 16:34:33 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Apr 13 16:34:33 user nova-compute[71731]: DEBUG nova.virt.driver [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Emitting event <LifecycleEvent: 1681403673.2321227, acbcaee0-a47b-4fee-8765-9b1c9597d515 => Started> {{(pid=71731) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 16:34:33 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] VM Started (Lifecycle Event)
Apr 13 16:34:33 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:34:33 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] Synchronizing instance power state after lifecycle event "Started"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=71731) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 16:34:33 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Apr 13 16:34:33 user nova-compute[71731]: INFO nova.compute.manager [None req-aab9a7b9-9c31-4d45-beaf-7bf0d37c3af9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] Updating instance to original state: 'active'
Apr 13 16:34:33 user nova-compute[71731]: DEBUG nova.compute.manager [req-e8501dca-8974-43be-b569-1b2566b4ca8e req-740b804e-45b6-4f53-9b0c-9e9195fb07e6 service nova] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] Received event network-vif-plugged-13471516-9514-4b85-938f-69657c2990e5 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:34:33 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-e8501dca-8974-43be-b569-1b2566b4ca8e req-740b804e-45b6-4f53-9b0c-9e9195fb07e6 service nova] Acquiring lock "acbcaee0-a47b-4fee-8765-9b1c9597d515-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:34:33 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-e8501dca-8974-43be-b569-1b2566b4ca8e req-740b804e-45b6-4f53-9b0c-9e9195fb07e6 service nova] Lock "acbcaee0-a47b-4fee-8765-9b1c9597d515-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:34:33 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-e8501dca-8974-43be-b569-1b2566b4ca8e req-740b804e-45b6-4f53-9b0c-9e9195fb07e6 service nova] Lock "acbcaee0-a47b-4fee-8765-9b1c9597d515-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:34:33 user nova-compute[71731]: DEBUG nova.compute.manager [req-e8501dca-8974-43be-b569-1b2566b4ca8e req-740b804e-45b6-4f53-9b0c-9e9195fb07e6 service nova] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] No waiting events found dispatching network-vif-plugged-13471516-9514-4b85-938f-69657c2990e5 {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:34:33 user nova-compute[71731]: WARNING nova.compute.manager [req-e8501dca-8974-43be-b569-1b2566b4ca8e req-740b804e-45b6-4f53-9b0c-9e9195fb07e6 service nova] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] Received unexpected event network-vif-plugged-13471516-9514-4b85-938f-69657c2990e5 for instance with vm_state active and task_state None.
Apr 13 16:34:34 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:34:34 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-3cab85d0-2217-48f7-9c24-00a036b66a84 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Acquiring lock "bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:34:34 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-3cab85d0-2217-48f7-9c24-00a036b66a84 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lock "bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:34:34 user nova-compute[71731]: DEBUG nova.compute.manager [None req-3cab85d0-2217-48f7-9c24-00a036b66a84 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] [instance: bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f] Starting instance... {{(pid=71731) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 16:34:34 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-3cab85d0-2217-48f7-9c24-00a036b66a84 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:34:34 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-3cab85d0-2217-48f7-9c24-00a036b66a84 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:34:34 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-3cab85d0-2217-48f7-9c24-00a036b66a84 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71731) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 16:34:34 user nova-compute[71731]: INFO nova.compute.claims [None req-3cab85d0-2217-48f7-9c24-00a036b66a84 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] [instance: bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f] Claim successful on node user
Apr 13 16:34:34 user nova-compute[71731]: DEBUG nova.compute.provider_tree [None req-3cab85d0-2217-48f7-9c24-00a036b66a84 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Inventory has not changed in ProviderTree for provider: cb6b1a64-0c24-4e2d-af1e-16576ca9165c {{(pid=71731) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 16:34:34 user nova-compute[71731]: DEBUG nova.scheduler.client.report [None req-3cab85d0-2217-48f7-9c24-00a036b66a84 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Inventory has not changed for provider cb6b1a64-0c24-4e2d-af1e-16576ca9165c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71731) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 16:34:35 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-3cab85d0-2217-48f7-9c24-00a036b66a84 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.461s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:34:35 user nova-compute[71731]: DEBUG nova.compute.manager [None req-3cab85d0-2217-48f7-9c24-00a036b66a84 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] [instance: bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f] Start building networks asynchronously for instance. {{(pid=71731) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 16:34:35 user nova-compute[71731]: DEBUG nova.compute.manager [None req-3cab85d0-2217-48f7-9c24-00a036b66a84 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] [instance: bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f] Allocating IP information in the background. {{(pid=71731) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 16:34:35 user nova-compute[71731]: DEBUG nova.network.neutron [None req-3cab85d0-2217-48f7-9c24-00a036b66a84 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] [instance: bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f] allocate_for_instance() {{(pid=71731) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 16:34:35 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-3cab85d0-2217-48f7-9c24-00a036b66a84 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] [instance: bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 16:34:35 user nova-compute[71731]: DEBUG nova.compute.manager [None req-3cab85d0-2217-48f7-9c24-00a036b66a84 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] [instance: bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f] Start building block device mappings for instance. {{(pid=71731) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 16:34:35 user nova-compute[71731]: DEBUG nova.policy [None req-3cab85d0-2217-48f7-9c24-00a036b66a84 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '47fab402fb794a5a9281cfb7fe188813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24904988cf334657b084fd726c7ecf8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71731) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 16:34:35 user nova-compute[71731]: DEBUG nova.compute.manager [None req-3cab85d0-2217-48f7-9c24-00a036b66a84 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] [instance: bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f] Start spawning the instance on the hypervisor. {{(pid=71731) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 16:34:35 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-3cab85d0-2217-48f7-9c24-00a036b66a84 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] [instance: bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f] Creating instance directory {{(pid=71731) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 16:34:35 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-3cab85d0-2217-48f7-9c24-00a036b66a84 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] [instance: bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f] Creating image(s)
Apr 13 16:34:35 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-3cab85d0-2217-48f7-9c24-00a036b66a84 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Acquiring lock "/opt/stack/data/nova/instances/bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:34:35 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-3cab85d0-2217-48f7-9c24-00a036b66a84 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lock "/opt/stack/data/nova/instances/bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:34:35 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-3cab85d0-2217-48f7-9c24-00a036b66a84 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lock "/opt/stack/data/nova/instances/bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:34:35 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-3cab85d0-2217-48f7-9c24-00a036b66a84 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279 --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:34:35 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-3cab85d0-2217-48f7-9c24-00a036b66a84 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279 --force-share --output=json" returned: 0 in 0.138s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:34:35 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-3cab85d0-2217-48f7-9c24-00a036b66a84 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Acquiring lock "9524227dd898575c3099d3976f096cd935414279" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:34:35 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-3cab85d0-2217-48f7-9c24-00a036b66a84 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lock "9524227dd898575c3099d3976f096cd935414279" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:34:35 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-3cab85d0-2217-48f7-9c24-00a036b66a84 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279 --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:34:35 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-3cab85d0-2217-48f7-9c24-00a036b66a84 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279 --force-share --output=json" returned: 0 in 0.134s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:34:35 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-3cab85d0-2217-48f7-9c24-00a036b66a84 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279,backing_fmt=raw /opt/stack/data/nova/instances/bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f/disk 1073741824 {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:34:35 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-3cab85d0-2217-48f7-9c24-00a036b66a84 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279,backing_fmt=raw /opt/stack/data/nova/instances/bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f/disk 1073741824" returned: 0 in 0.050s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:34:35 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-3cab85d0-2217-48f7-9c24-00a036b66a84 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lock "9524227dd898575c3099d3976f096cd935414279" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.191s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:34:35 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-3cab85d0-2217-48f7-9c24-00a036b66a84 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279 --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:34:35 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-3cab85d0-2217-48f7-9c24-00a036b66a84 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279 --force-share --output=json" returned: 0 in 0.132s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:34:35 user nova-compute[71731]: DEBUG nova.virt.disk.api [None req-3cab85d0-2217-48f7-9c24-00a036b66a84 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f/disk. size=1073741824 {{(pid=71731) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 16:34:35 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-3cab85d0-2217-48f7-9c24-00a036b66a84 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:34:35 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-3cab85d0-2217-48f7-9c24-00a036b66a84 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:34:35 user nova-compute[71731]: DEBUG nova.virt.disk.api [None req-3cab85d0-2217-48f7-9c24-00a036b66a84 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Cannot resize image /opt/stack/data/nova/instances/bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f/disk to a smaller size. {{(pid=71731) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 16:34:35 user nova-compute[71731]: DEBUG nova.objects.instance [None req-3cab85d0-2217-48f7-9c24-00a036b66a84 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lazy-loading 'migration_context' on Instance uuid bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:34:35 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-3cab85d0-2217-48f7-9c24-00a036b66a84 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] [instance: bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f] Created local disks {{(pid=71731) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 16:34:35 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-3cab85d0-2217-48f7-9c24-00a036b66a84 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] [instance: bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f] Ensure instance console log exists: /opt/stack/data/nova/instances/bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f/console.log {{(pid=71731) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 16:34:35 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-3cab85d0-2217-48f7-9c24-00a036b66a84 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:34:35 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-3cab85d0-2217-48f7-9c24-00a036b66a84 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:34:35 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-3cab85d0-2217-48f7-9c24-00a036b66a84 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:34:35 user nova-compute[71731]: DEBUG nova.network.neutron [None req-3cab85d0-2217-48f7-9c24-00a036b66a84 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] [instance: bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f] Successfully created port: adf9438c-79e3-494a-8650-1b7377eb1062 {{(pid=71731) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 16:34:36 user nova-compute[71731]: DEBUG nova.network.neutron [None req-3cab85d0-2217-48f7-9c24-00a036b66a84 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] [instance: bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f] Successfully updated port: adf9438c-79e3-494a-8650-1b7377eb1062 {{(pid=71731) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 16:34:36 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-3cab85d0-2217-48f7-9c24-00a036b66a84 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Acquiring lock "refresh_cache-bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 16:34:36 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-3cab85d0-2217-48f7-9c24-00a036b66a84 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Acquired lock "refresh_cache-bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 16:34:36 user nova-compute[71731]: DEBUG nova.network.neutron [None req-3cab85d0-2217-48f7-9c24-00a036b66a84 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] [instance: bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f] Building network info cache for instance {{(pid=71731) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 16:34:36 user nova-compute[71731]: DEBUG nova.compute.manager [req-d9432d90-3e8d-44e3-a70d-8fc8e83997ce req-bdf29c99-281b-4b1c-a8f0-41d165d2e511 service nova] [instance: bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f] Received event network-changed-adf9438c-79e3-494a-8650-1b7377eb1062 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:34:36 user nova-compute[71731]: DEBUG nova.compute.manager [req-d9432d90-3e8d-44e3-a70d-8fc8e83997ce req-bdf29c99-281b-4b1c-a8f0-41d165d2e511 service nova] [instance: bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f] Refreshing instance network info cache due to event network-changed-adf9438c-79e3-494a-8650-1b7377eb1062. {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 16:34:36 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-d9432d90-3e8d-44e3-a70d-8fc8e83997ce req-bdf29c99-281b-4b1c-a8f0-41d165d2e511 service nova] Acquiring lock "refresh_cache-bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 16:34:36 user nova-compute[71731]: DEBUG nova.network.neutron [None req-3cab85d0-2217-48f7-9c24-00a036b66a84 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] [instance: bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f] Instance cache missing network info. {{(pid=71731) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 16:34:36 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:34:37 user nova-compute[71731]: DEBUG nova.network.neutron [None req-3cab85d0-2217-48f7-9c24-00a036b66a84 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] [instance: bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f] Updating instance_info_cache with network_info: [{"id": "adf9438c-79e3-494a-8650-1b7377eb1062", "address": "fa:16:3e:b9:56:b4", "network": {"id": "79e9ef20-b14d-4850-b298-9d3ed4d10b90", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1756253617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24904988cf334657b084fd726c7ecf8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadf9438c-79", "ovs_interfaceid": "adf9438c-79e3-494a-8650-1b7377eb1062", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:34:37 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-3cab85d0-2217-48f7-9c24-00a036b66a84 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Releasing lock "refresh_cache-bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 16:34:37 user nova-compute[71731]: DEBUG nova.compute.manager [None req-3cab85d0-2217-48f7-9c24-00a036b66a84 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] [instance: bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f] Instance network_info: |[{"id": "adf9438c-79e3-494a-8650-1b7377eb1062", "address": "fa:16:3e:b9:56:b4", "network": {"id": "79e9ef20-b14d-4850-b298-9d3ed4d10b90", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1756253617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24904988cf334657b084fd726c7ecf8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadf9438c-79", "ovs_interfaceid": "adf9438c-79e3-494a-8650-1b7377eb1062", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71731) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 16:34:37 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-d9432d90-3e8d-44e3-a70d-8fc8e83997ce req-bdf29c99-281b-4b1c-a8f0-41d165d2e511 service nova] Acquired lock "refresh_cache-bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 16:34:37 user nova-compute[71731]: DEBUG nova.network.neutron [req-d9432d90-3e8d-44e3-a70d-8fc8e83997ce req-bdf29c99-281b-4b1c-a8f0-41d165d2e511 service nova] [instance: bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f] Refreshing network info cache for port adf9438c-79e3-494a-8650-1b7377eb1062 {{(pid=71731) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 16:34:37 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-3cab85d0-2217-48f7-9c24-00a036b66a84 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] [instance: bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f] Start _get_guest_xml network_info=[{"id": "adf9438c-79e3-494a-8650-1b7377eb1062", "address": "fa:16:3e:b9:56:b4", "network": {"id": "79e9ef20-b14d-4850-b298-9d3ed4d10b90", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1756253617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24904988cf334657b084fd726c7ecf8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadf9438c-79", "ovs_interfaceid": "adf9438c-79e3-494a-8650-1b7377eb1062", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T16:16:31Z,direct_url=<?>,disk_format='qcow2',id=708622a9-7465-4492-ade8-b827198f7e30,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='0b29a975c552465aba0ac7d6288434bd',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T16:16:33Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'device_type': 'disk', 'encrypted': False, 'disk_bus': 'virtio', 'guest_format': None, 'encryption_options': None, 'image_id': '708622a9-7465-4492-ade8-b827198f7e30'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71731) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 16:34:37 user nova-compute[71731]: WARNING nova.virt.libvirt.driver [None req-3cab85d0-2217-48f7-9c24-00a036b66a84 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 16:34:37 user nova-compute[71731]: WARNING nova.virt.libvirt.driver [None req-3cab85d0-2217-48f7-9c24-00a036b66a84 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 16:34:37 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-3cab85d0-2217-48f7-9c24-00a036b66a84 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71731) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 16:34:37 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-3cab85d0-2217-48f7-9c24-00a036b66a84 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T16:17:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T16:16:31Z,direct_url=<?>,disk_format='qcow2',id=708622a9-7465-4492-ade8-b827198f7e30,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='0b29a975c552465aba0ac7d6288434bd',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T16:16:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 16:34:37 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-3cab85d0-2217-48f7-9c24-00a036b66a84 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Flavor limits 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 16:34:37 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-3cab85d0-2217-48f7-9c24-00a036b66a84 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Image limits 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 16:34:37 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-3cab85d0-2217-48f7-9c24-00a036b66a84 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Flavor pref 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 16:34:37 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-3cab85d0-2217-48f7-9c24-00a036b66a84 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Image pref 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 16:34:37 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-3cab85d0-2217-48f7-9c24-00a036b66a84 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 16:34:37 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-3cab85d0-2217-48f7-9c24-00a036b66a84 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 16:34:37 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-3cab85d0-2217-48f7-9c24-00a036b66a84 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71731) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 16:34:37 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-3cab85d0-2217-48f7-9c24-00a036b66a84 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Got 1 possible topologies {{(pid=71731) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 16:34:37 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-3cab85d0-2217-48f7-9c24-00a036b66a84 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 16:34:37 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-3cab85d0-2217-48f7-9c24-00a036b66a84 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 16:34:37 user nova-compute[71731]: DEBUG nova.virt.libvirt.vif [None req-3cab85d0-2217-48f7-9c24-00a036b66a84 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T16:34:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1992841975',display_name='tempest-AttachVolumeTestJSON-server-1992841975',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1992841975',id=31,image_ref='708622a9-7465-4492-ade8-b827198f7e30',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLg/aZ/97WQm57BWlEGmEo0ZDYs6AZHEJTQdcUXAw6+zT4F/07+PSqHmlqw9dViVyDHhb8Ilq3sNANdJ79ikkzymwHsi3VIfAMe6DINfLbAXFmb5kKQf4wM+nlJI9ERH2Q==',key_name='tempest-keypair-2008404613',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='24904988cf334657b084fd726c7ecf8f',ramdisk_id='',reservation_id='r-el8qhxg7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='708622a9-7465-4492-ade8-b827198f7e30',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-836650657',owner_user_name='tempest-AttachVolumeTestJSON-836650657-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T16:34:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='47fab402fb794a5a9281cfb7fe188813',uuid=bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "adf9438c-79e3-494a-8650-1b7377eb1062", "address": "fa:16:3e:b9:56:b4", "network": {"id": "79e9ef20-b14d-4850-b298-9d3ed4d10b90", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1756253617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24904988cf334657b084fd726c7ecf8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadf9438c-79", "ovs_interfaceid": "adf9438c-79e3-494a-8650-1b7377eb1062", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71731) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 16:34:37 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-3cab85d0-2217-48f7-9c24-00a036b66a84 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Converting VIF {"id": "adf9438c-79e3-494a-8650-1b7377eb1062", "address": "fa:16:3e:b9:56:b4", "network": {"id": "79e9ef20-b14d-4850-b298-9d3ed4d10b90", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1756253617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24904988cf334657b084fd726c7ecf8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadf9438c-79", "ovs_interfaceid": "adf9438c-79e3-494a-8650-1b7377eb1062", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 16:34:37 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-3cab85d0-2217-48f7-9c24-00a036b66a84 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:56:b4,bridge_name='br-int',has_traffic_filtering=True,id=adf9438c-79e3-494a-8650-1b7377eb1062,network=Network(79e9ef20-b14d-4850-b298-9d3ed4d10b90),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapadf9438c-79') {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 16:34:37 user nova-compute[71731]: DEBUG nova.objects.instance [None req-3cab85d0-2217-48f7-9c24-00a036b66a84 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lazy-loading 'pci_devices' on Instance uuid bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:34:37 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-3cab85d0-2217-48f7-9c24-00a036b66a84 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] [instance: bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f] End _get_guest_xml xml=<domain type="kvm">
Apr 13 16:34:37 user nova-compute[71731]:   <uuid>bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f</uuid>
Apr 13 16:34:37 user nova-compute[71731]:   <name>instance-0000001f</name>
Apr 13 16:34:37 user nova-compute[71731]:   <memory>131072</memory>
Apr 13 16:34:37 user nova-compute[71731]:   <vcpu>1</vcpu>
Apr 13 16:34:37 user nova-compute[71731]:   <metadata>
Apr 13 16:34:37 user nova-compute[71731]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 16:34:37 user nova-compute[71731]:       <nova:package version="0.0.0"/>
Apr 13 16:34:37 user nova-compute[71731]:       <nova:name>tempest-AttachVolumeTestJSON-server-1992841975</nova:name>
Apr 13 16:34:37 user nova-compute[71731]:       <nova:creationTime>2023-04-13 16:34:37</nova:creationTime>
Apr 13 16:34:37 user nova-compute[71731]:       <nova:flavor name="m1.nano">
Apr 13 16:34:37 user nova-compute[71731]:         <nova:memory>128</nova:memory>
Apr 13 16:34:37 user nova-compute[71731]:         <nova:disk>1</nova:disk>
Apr 13 16:34:37 user nova-compute[71731]:         <nova:swap>0</nova:swap>
Apr 13 16:34:37 user nova-compute[71731]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 16:34:37 user nova-compute[71731]:         <nova:vcpus>1</nova:vcpus>
Apr 13 16:34:37 user nova-compute[71731]:       </nova:flavor>
Apr 13 16:34:37 user nova-compute[71731]:       <nova:owner>
Apr 13 16:34:37 user nova-compute[71731]:         <nova:user uuid="47fab402fb794a5a9281cfb7fe188813">tempest-AttachVolumeTestJSON-836650657-project-member</nova:user>
Apr 13 16:34:37 user nova-compute[71731]:         <nova:project uuid="24904988cf334657b084fd726c7ecf8f">tempest-AttachVolumeTestJSON-836650657</nova:project>
Apr 13 16:34:37 user nova-compute[71731]:       </nova:owner>
Apr 13 16:34:37 user nova-compute[71731]:       <nova:root type="image" uuid="708622a9-7465-4492-ade8-b827198f7e30"/>
Apr 13 16:34:37 user nova-compute[71731]:       <nova:ports>
Apr 13 16:34:37 user nova-compute[71731]:         <nova:port uuid="adf9438c-79e3-494a-8650-1b7377eb1062">
Apr 13 16:34:37 user nova-compute[71731]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Apr 13 16:34:37 user nova-compute[71731]:         </nova:port>
Apr 13 16:34:37 user nova-compute[71731]:       </nova:ports>
Apr 13 16:34:37 user nova-compute[71731]:     </nova:instance>
Apr 13 16:34:37 user nova-compute[71731]:   </metadata>
Apr 13 16:34:37 user nova-compute[71731]:   <sysinfo type="smbios">
Apr 13 16:34:37 user nova-compute[71731]:     <system>
Apr 13 16:34:37 user nova-compute[71731]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 16:34:37 user nova-compute[71731]:       <entry name="product">OpenStack Nova</entry>
Apr 13 16:34:37 user nova-compute[71731]:       <entry name="version">0.0.0</entry>
Apr 13 16:34:37 user nova-compute[71731]:       <entry name="serial">bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f</entry>
Apr 13 16:34:37 user nova-compute[71731]:       <entry name="uuid">bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f</entry>
Apr 13 16:34:37 user nova-compute[71731]:       <entry name="family">Virtual Machine</entry>
Apr 13 16:34:37 user nova-compute[71731]:     </system>
Apr 13 16:34:37 user nova-compute[71731]:   </sysinfo>
Apr 13 16:34:37 user nova-compute[71731]:   <os>
Apr 13 16:34:37 user nova-compute[71731]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 16:34:37 user nova-compute[71731]:     <boot dev="hd"/>
Apr 13 16:34:37 user nova-compute[71731]:     <smbios mode="sysinfo"/>
Apr 13 16:34:37 user nova-compute[71731]:   </os>
Apr 13 16:34:37 user nova-compute[71731]:   <features>
Apr 13 16:34:37 user nova-compute[71731]:     <acpi/>
Apr 13 16:34:37 user nova-compute[71731]:     <apic/>
Apr 13 16:34:37 user nova-compute[71731]:     <vmcoreinfo/>
Apr 13 16:34:37 user nova-compute[71731]:   </features>
Apr 13 16:34:37 user nova-compute[71731]:   <clock offset="utc">
Apr 13 16:34:37 user nova-compute[71731]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 16:34:37 user nova-compute[71731]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 16:34:37 user nova-compute[71731]:     <timer name="hpet" present="no"/>
Apr 13 16:34:37 user nova-compute[71731]:   </clock>
Apr 13 16:34:37 user nova-compute[71731]:   <cpu mode="custom" match="exact">
Apr 13 16:34:37 user nova-compute[71731]:     <model>Nehalem</model>
Apr 13 16:34:37 user nova-compute[71731]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 16:34:37 user nova-compute[71731]:   </cpu>
Apr 13 16:34:37 user nova-compute[71731]:   <devices>
Apr 13 16:34:37 user nova-compute[71731]:     <disk type="file" device="disk">
Apr 13 16:34:37 user nova-compute[71731]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 16:34:37 user nova-compute[71731]:       <source file="/opt/stack/data/nova/instances/bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f/disk"/>
Apr 13 16:34:37 user nova-compute[71731]:       <target dev="vda" bus="virtio"/>
Apr 13 16:34:37 user nova-compute[71731]:     </disk>
Apr 13 16:34:37 user nova-compute[71731]:     <interface type="ethernet">
Apr 13 16:34:37 user nova-compute[71731]:       <mac address="fa:16:3e:b9:56:b4"/>
Apr 13 16:34:37 user nova-compute[71731]:       <model type="virtio"/>
Apr 13 16:34:37 user nova-compute[71731]:       <mtu size="1442"/>
Apr 13 16:34:37 user nova-compute[71731]:       <target dev="tapadf9438c-79"/>
Apr 13 16:34:37 user nova-compute[71731]:     </interface>
Apr 13 16:34:37 user nova-compute[71731]:     <serial type="pty">
Apr 13 16:34:37 user nova-compute[71731]:       <log file="/opt/stack/data/nova/instances/bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f/console.log" append="off"/>
Apr 13 16:34:37 user nova-compute[71731]:     </serial>
Apr 13 16:34:37 user nova-compute[71731]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 16:34:37 user nova-compute[71731]:     <video>
Apr 13 16:34:37 user nova-compute[71731]:       <model type="virtio"/>
Apr 13 16:34:37 user nova-compute[71731]:     </video>
Apr 13 16:34:37 user nova-compute[71731]:     <rng model="virtio">
Apr 13 16:34:37 user nova-compute[71731]:       <backend model="random">/dev/urandom</backend>
Apr 13 16:34:37 user nova-compute[71731]:     </rng>
Apr 13 16:34:37 user nova-compute[71731]:     <controller type="usb" index="0" model="none"/>
Apr 13 16:34:37 user nova-compute[71731]:     <memballoon model="virtio">
Apr 13 16:34:37 user nova-compute[71731]:       <stats period="10"/>
Apr 13 16:34:37 user nova-compute[71731]:     </memballoon>
Apr 13 16:34:37 user nova-compute[71731]:   </devices>
Apr 13 16:34:37 user nova-compute[71731]: </domain>
Apr 13 16:34:37 user nova-compute[71731]:  {{(pid=71731) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 16:34:37 user nova-compute[71731]: DEBUG nova.virt.libvirt.vif [None req-3cab85d0-2217-48f7-9c24-00a036b66a84 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T16:34:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1992841975',display_name='tempest-AttachVolumeTestJSON-server-1992841975',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1992841975',id=31,image_ref='708622a9-7465-4492-ade8-b827198f7e30',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLg/aZ/97WQm57BWlEGmEo0ZDYs6AZHEJTQdcUXAw6+zT4F/07+PSqHmlqw9dViVyDHhb8Ilq3sNANdJ79ikkzymwHsi3VIfAMe6DINfLbAXFmb5kKQf4wM+nlJI9ERH2Q==',key_name='tempest-keypair-2008404613',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='24904988cf334657b084fd726c7ecf8f',ramdisk_id='',reservation_id='r-el8qhxg7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='708622a9-7465-4492-ade8-b827198f7e30',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-836650657',owner_user_name='tempest-AttachVolumeTestJSON-836650657-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T16:34:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='47fab402fb794a5a9281cfb7fe188813',uuid=bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "adf9438c-79e3-494a-8650-1b7377eb1062", "address": "fa:16:3e:b9:56:b4", "network": {"id": "79e9ef20-b14d-4850-b298-9d3ed4d10b90", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1756253617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24904988cf334657b084fd726c7ecf8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadf9438c-79", "ovs_interfaceid": "adf9438c-79e3-494a-8650-1b7377eb1062", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 16:34:37 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-3cab85d0-2217-48f7-9c24-00a036b66a84 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Converting VIF {"id": "adf9438c-79e3-494a-8650-1b7377eb1062", "address": "fa:16:3e:b9:56:b4", "network": {"id": "79e9ef20-b14d-4850-b298-9d3ed4d10b90", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1756253617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24904988cf334657b084fd726c7ecf8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadf9438c-79", "ovs_interfaceid": "adf9438c-79e3-494a-8650-1b7377eb1062", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 16:34:37 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-3cab85d0-2217-48f7-9c24-00a036b66a84 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:56:b4,bridge_name='br-int',has_traffic_filtering=True,id=adf9438c-79e3-494a-8650-1b7377eb1062,network=Network(79e9ef20-b14d-4850-b298-9d3ed4d10b90),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapadf9438c-79') {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 16:34:37 user nova-compute[71731]: DEBUG os_vif [None req-3cab85d0-2217-48f7-9c24-00a036b66a84 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:56:b4,bridge_name='br-int',has_traffic_filtering=True,id=adf9438c-79e3-494a-8650-1b7377eb1062,network=Network(79e9ef20-b14d-4850-b298-9d3ed4d10b90),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapadf9438c-79') {{(pid=71731) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 16:34:37 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:34:37 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:34:37 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 16:34:37 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:34:37 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapadf9438c-79, may_exist=True) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:34:37 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapadf9438c-79, col_values=(('external_ids', {'iface-id': 'adf9438c-79e3-494a-8650-1b7377eb1062', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b9:56:b4', 'vm-uuid': 'bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f'}),)) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:34:37 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:34:37 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 16:34:37 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:34:37 user nova-compute[71731]: INFO os_vif [None req-3cab85d0-2217-48f7-9c24-00a036b66a84 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:56:b4,bridge_name='br-int',has_traffic_filtering=True,id=adf9438c-79e3-494a-8650-1b7377eb1062,network=Network(79e9ef20-b14d-4850-b298-9d3ed4d10b90),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapadf9438c-79')
Apr 13 16:34:37 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-3cab85d0-2217-48f7-9c24-00a036b66a84 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] No BDM found with device name vda, not building metadata. {{(pid=71731) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 16:34:37 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-3cab85d0-2217-48f7-9c24-00a036b66a84 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] No VIF found with MAC fa:16:3e:b9:56:b4, not building metadata {{(pid=71731) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 16:34:37 user nova-compute[71731]: DEBUG nova.network.neutron [req-d9432d90-3e8d-44e3-a70d-8fc8e83997ce req-bdf29c99-281b-4b1c-a8f0-41d165d2e511 service nova] [instance: bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f] Updated VIF entry in instance network info cache for port adf9438c-79e3-494a-8650-1b7377eb1062. {{(pid=71731) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 16:34:37 user nova-compute[71731]: DEBUG nova.network.neutron [req-d9432d90-3e8d-44e3-a70d-8fc8e83997ce req-bdf29c99-281b-4b1c-a8f0-41d165d2e511 service nova] [instance: bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f] Updating instance_info_cache with network_info: [{"id": "adf9438c-79e3-494a-8650-1b7377eb1062", "address": "fa:16:3e:b9:56:b4", "network": {"id": "79e9ef20-b14d-4850-b298-9d3ed4d10b90", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1756253617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24904988cf334657b084fd726c7ecf8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadf9438c-79", "ovs_interfaceid": "adf9438c-79e3-494a-8650-1b7377eb1062", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:34:37 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-d9432d90-3e8d-44e3-a70d-8fc8e83997ce req-bdf29c99-281b-4b1c-a8f0-41d165d2e511 service nova] Releasing lock "refresh_cache-bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 16:34:38 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:34:38 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:34:38 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:34:38 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:34:38 user nova-compute[71731]: DEBUG nova.compute.manager [req-18a296b1-08cd-46ec-bb4b-4bf20fa8f76b req-0531d690-7b2e-4488-a5a2-5bbd6b93050f service nova] [instance: bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f] Received event network-vif-plugged-adf9438c-79e3-494a-8650-1b7377eb1062 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:34:38 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-18a296b1-08cd-46ec-bb4b-4bf20fa8f76b req-0531d690-7b2e-4488-a5a2-5bbd6b93050f service nova] Acquiring lock "bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:34:38 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-18a296b1-08cd-46ec-bb4b-4bf20fa8f76b req-0531d690-7b2e-4488-a5a2-5bbd6b93050f service nova] Lock "bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:34:38 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-18a296b1-08cd-46ec-bb4b-4bf20fa8f76b req-0531d690-7b2e-4488-a5a2-5bbd6b93050f service nova] Lock "bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:34:38 user nova-compute[71731]: DEBUG nova.compute.manager [req-18a296b1-08cd-46ec-bb4b-4bf20fa8f76b req-0531d690-7b2e-4488-a5a2-5bbd6b93050f service nova] [instance: bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f] No waiting events found dispatching network-vif-plugged-adf9438c-79e3-494a-8650-1b7377eb1062 {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:34:38 user nova-compute[71731]: WARNING nova.compute.manager [req-18a296b1-08cd-46ec-bb4b-4bf20fa8f76b req-0531d690-7b2e-4488-a5a2-5bbd6b93050f service nova] [instance: bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f] Received unexpected event network-vif-plugged-adf9438c-79e3-494a-8650-1b7377eb1062 for instance with vm_state building and task_state spawning.
Apr 13 16:34:39 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:34:39 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:34:39 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:34:39 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:34:40 user nova-compute[71731]: DEBUG nova.compute.manager [req-f1fd69ce-873d-4f6d-93ba-797f0dd579b4 req-6f07f75c-50d6-483f-bfdd-dbed1734a0ec service nova] [instance: bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f] Received event network-vif-plugged-adf9438c-79e3-494a-8650-1b7377eb1062 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:34:40 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-f1fd69ce-873d-4f6d-93ba-797f0dd579b4 req-6f07f75c-50d6-483f-bfdd-dbed1734a0ec service nova] Acquiring lock "bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:34:40 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-f1fd69ce-873d-4f6d-93ba-797f0dd579b4 req-6f07f75c-50d6-483f-bfdd-dbed1734a0ec service nova] Lock "bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:34:40 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-f1fd69ce-873d-4f6d-93ba-797f0dd579b4 req-6f07f75c-50d6-483f-bfdd-dbed1734a0ec service nova] Lock "bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:34:40 user nova-compute[71731]: DEBUG nova.compute.manager [req-f1fd69ce-873d-4f6d-93ba-797f0dd579b4 req-6f07f75c-50d6-483f-bfdd-dbed1734a0ec service nova] [instance: bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f] No waiting events found dispatching network-vif-plugged-adf9438c-79e3-494a-8650-1b7377eb1062 {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:34:40 user nova-compute[71731]: WARNING nova.compute.manager [req-f1fd69ce-873d-4f6d-93ba-797f0dd579b4 req-6f07f75c-50d6-483f-bfdd-dbed1734a0ec service nova] [instance: bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f] Received unexpected event network-vif-plugged-adf9438c-79e3-494a-8650-1b7377eb1062 for instance with vm_state building and task_state spawning.
Apr 13 16:34:40 user nova-compute[71731]: DEBUG nova.virt.driver [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Emitting event <LifecycleEvent: 1681403680.9578383, bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f => Resumed> {{(pid=71731) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 16:34:40 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f] VM Resumed (Lifecycle Event)
Apr 13 16:34:40 user nova-compute[71731]: DEBUG nova.compute.manager [None req-3cab85d0-2217-48f7-9c24-00a036b66a84 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] [instance: bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f] Instance event wait completed in 0 seconds for  {{(pid=71731) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 16:34:40 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-3cab85d0-2217-48f7-9c24-00a036b66a84 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] [instance: bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f] Guest created on hypervisor {{(pid=71731) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 16:34:40 user nova-compute[71731]: INFO nova.virt.libvirt.driver [-] [instance: bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f] Instance spawned successfully.
Apr 13 16:34:40 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-3cab85d0-2217-48f7-9c24-00a036b66a84 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] [instance: bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 16:34:40 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:34:40 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71731) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 16:34:41 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-3cab85d0-2217-48f7-9c24-00a036b66a84 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] [instance: bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f] Found default for hw_cdrom_bus of ide {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:34:41 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-3cab85d0-2217-48f7-9c24-00a036b66a84 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] [instance: bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f] Found default for hw_disk_bus of virtio {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:34:41 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-3cab85d0-2217-48f7-9c24-00a036b66a84 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] [instance: bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f] Found default for hw_input_bus of None {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:34:41 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-3cab85d0-2217-48f7-9c24-00a036b66a84 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] [instance: bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f] Found default for hw_pointer_model of None {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:34:41 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-3cab85d0-2217-48f7-9c24-00a036b66a84 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] [instance: bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f] Found default for hw_video_model of virtio {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:34:41 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-3cab85d0-2217-48f7-9c24-00a036b66a84 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] [instance: bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f] Found default for hw_vif_model of virtio {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:34:41 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 16:34:41 user nova-compute[71731]: DEBUG nova.virt.driver [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Emitting event <LifecycleEvent: 1681403680.9590952, bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f => Started> {{(pid=71731) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 16:34:41 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f] VM Started (Lifecycle Event)
Apr 13 16:34:41 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:34:41 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71731) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 16:34:41 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 16:34:41 user nova-compute[71731]: INFO nova.compute.manager [None req-3cab85d0-2217-48f7-9c24-00a036b66a84 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] [instance: bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f] Took 5.88 seconds to spawn the instance on the hypervisor.
Apr 13 16:34:41 user nova-compute[71731]: DEBUG nova.compute.manager [None req-3cab85d0-2217-48f7-9c24-00a036b66a84 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] [instance: bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:34:41 user nova-compute[71731]: INFO nova.compute.manager [None req-3cab85d0-2217-48f7-9c24-00a036b66a84 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] [instance: bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f] Took 6.71 seconds to build instance.
Apr 13 16:34:41 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-3cab85d0-2217-48f7-9c24-00a036b66a84 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lock "bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.814s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:34:41 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:34:42 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:34:44 user nova-compute[71731]: DEBUG nova.compute.manager [req-3c7c226d-8f7f-4b79-841e-a344af0b8994 req-192a5bb7-8683-4942-944d-e76634a99d73 service nova] [instance: 64a9c052-89a9-48ba-80c9-13fb5ef22f0e] Received event network-changed-5128334f-7255-4a56-9e8b-1151027d219b {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:34:44 user nova-compute[71731]: DEBUG nova.compute.manager [req-3c7c226d-8f7f-4b79-841e-a344af0b8994 req-192a5bb7-8683-4942-944d-e76634a99d73 service nova] [instance: 64a9c052-89a9-48ba-80c9-13fb5ef22f0e] Refreshing instance network info cache due to event network-changed-5128334f-7255-4a56-9e8b-1151027d219b. {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 16:34:44 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-3c7c226d-8f7f-4b79-841e-a344af0b8994 req-192a5bb7-8683-4942-944d-e76634a99d73 service nova] Acquiring lock "refresh_cache-64a9c052-89a9-48ba-80c9-13fb5ef22f0e" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 16:34:44 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-3c7c226d-8f7f-4b79-841e-a344af0b8994 req-192a5bb7-8683-4942-944d-e76634a99d73 service nova] Acquired lock "refresh_cache-64a9c052-89a9-48ba-80c9-13fb5ef22f0e" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 16:34:44 user nova-compute[71731]: DEBUG nova.network.neutron [req-3c7c226d-8f7f-4b79-841e-a344af0b8994 req-192a5bb7-8683-4942-944d-e76634a99d73 service nova] [instance: 64a9c052-89a9-48ba-80c9-13fb5ef22f0e] Refreshing network info cache for port 5128334f-7255-4a56-9e8b-1151027d219b {{(pid=71731) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 16:34:44 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-77e4f4c5-8794-4f04-af1c-9901bc637f9b tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Acquiring lock "64a9c052-89a9-48ba-80c9-13fb5ef22f0e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:34:44 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-77e4f4c5-8794-4f04-af1c-9901bc637f9b tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Lock "64a9c052-89a9-48ba-80c9-13fb5ef22f0e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:34:44 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-77e4f4c5-8794-4f04-af1c-9901bc637f9b tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Acquiring lock "64a9c052-89a9-48ba-80c9-13fb5ef22f0e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:34:44 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-77e4f4c5-8794-4f04-af1c-9901bc637f9b tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Lock "64a9c052-89a9-48ba-80c9-13fb5ef22f0e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:34:44 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-77e4f4c5-8794-4f04-af1c-9901bc637f9b tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Lock "64a9c052-89a9-48ba-80c9-13fb5ef22f0e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:34:44 user nova-compute[71731]: INFO nova.compute.manager [None req-77e4f4c5-8794-4f04-af1c-9901bc637f9b tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] [instance: 64a9c052-89a9-48ba-80c9-13fb5ef22f0e] Terminating instance
Apr 13 16:34:44 user nova-compute[71731]: DEBUG nova.compute.manager [None req-77e4f4c5-8794-4f04-af1c-9901bc637f9b tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] [instance: 64a9c052-89a9-48ba-80c9-13fb5ef22f0e] Start destroying the instance on the hypervisor. {{(pid=71731) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 16:34:44 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:34:44 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:34:44 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:34:44 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:34:44 user nova-compute[71731]: DEBUG nova.compute.manager [req-7b7ab909-85f1-48bc-9b6c-dd1bef58b795 req-64f4a14f-321b-4d2f-9b84-d9e59145c79e service nova] [instance: 64a9c052-89a9-48ba-80c9-13fb5ef22f0e] Received event network-vif-unplugged-5128334f-7255-4a56-9e8b-1151027d219b {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:34:44 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-7b7ab909-85f1-48bc-9b6c-dd1bef58b795 req-64f4a14f-321b-4d2f-9b84-d9e59145c79e service nova] Acquiring lock "64a9c052-89a9-48ba-80c9-13fb5ef22f0e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:34:44 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-7b7ab909-85f1-48bc-9b6c-dd1bef58b795 req-64f4a14f-321b-4d2f-9b84-d9e59145c79e service nova] Lock "64a9c052-89a9-48ba-80c9-13fb5ef22f0e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:34:44 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-7b7ab909-85f1-48bc-9b6c-dd1bef58b795 req-64f4a14f-321b-4d2f-9b84-d9e59145c79e service nova] Lock "64a9c052-89a9-48ba-80c9-13fb5ef22f0e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:34:44 user nova-compute[71731]: DEBUG nova.compute.manager [req-7b7ab909-85f1-48bc-9b6c-dd1bef58b795 req-64f4a14f-321b-4d2f-9b84-d9e59145c79e service nova] [instance: 64a9c052-89a9-48ba-80c9-13fb5ef22f0e] No waiting events found dispatching network-vif-unplugged-5128334f-7255-4a56-9e8b-1151027d219b {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:34:44 user nova-compute[71731]: DEBUG nova.compute.manager [req-7b7ab909-85f1-48bc-9b6c-dd1bef58b795 req-64f4a14f-321b-4d2f-9b84-d9e59145c79e service nova] [instance: 64a9c052-89a9-48ba-80c9-13fb5ef22f0e] Received event network-vif-unplugged-5128334f-7255-4a56-9e8b-1151027d219b for instance with task_state deleting. {{(pid=71731) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 16:34:45 user nova-compute[71731]: DEBUG nova.network.neutron [req-3c7c226d-8f7f-4b79-841e-a344af0b8994 req-192a5bb7-8683-4942-944d-e76634a99d73 service nova] [instance: 64a9c052-89a9-48ba-80c9-13fb5ef22f0e] Updated VIF entry in instance network info cache for port 5128334f-7255-4a56-9e8b-1151027d219b. {{(pid=71731) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 16:34:45 user nova-compute[71731]: DEBUG nova.network.neutron [req-3c7c226d-8f7f-4b79-841e-a344af0b8994 req-192a5bb7-8683-4942-944d-e76634a99d73 service nova] [instance: 64a9c052-89a9-48ba-80c9-13fb5ef22f0e] Updating instance_info_cache with network_info: [{"id": "5128334f-7255-4a56-9e8b-1151027d219b", "address": "fa:16:3e:fe:54:1c", "network": {"id": "11386312-9ac6-4252-ab98-b3298a08599c", "bridge": "br-int", "label": "tempest-TestStampPattern-1747654565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb7100b359f341759cb6f6753e1539a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5128334f-72", "ovs_interfaceid": "5128334f-7255-4a56-9e8b-1151027d219b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:34:45 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-3c7c226d-8f7f-4b79-841e-a344af0b8994 req-192a5bb7-8683-4942-944d-e76634a99d73 service nova] Releasing lock "refresh_cache-64a9c052-89a9-48ba-80c9-13fb5ef22f0e" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 16:34:45 user nova-compute[71731]: INFO nova.virt.libvirt.driver [-] [instance: 64a9c052-89a9-48ba-80c9-13fb5ef22f0e] Instance destroyed successfully.
Apr 13 16:34:45 user nova-compute[71731]: DEBUG nova.objects.instance [None req-77e4f4c5-8794-4f04-af1c-9901bc637f9b tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Lazy-loading 'resources' on Instance uuid 64a9c052-89a9-48ba-80c9-13fb5ef22f0e {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:34:45 user nova-compute[71731]: DEBUG nova.virt.libvirt.vif [None req-77e4f4c5-8794-4f04-af1c-9901bc637f9b tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T16:31:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-228552911',display_name='tempest-TestStampPattern-server-228552911',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-teststamppattern-server-228552911',id=28,image_ref='2d22499e-4681-4f01-8d24-292a6af73d70',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL2QPQmeuQ3QMNshoDoMdPG3OSftqyMCUtV3Pr6v+/rhaN+olW1hWBQn7y9Ew+sQSET4+DncPzqCVC4fuapQVvR4RUPvk9/ysi6s66mNzl8HmL0L6OHOtrjR4F2tcMOgTw==',key_name='tempest-TestStampPattern-792944514',keypairs=<?>,launch_index=0,launched_at=2023-04-13T16:31:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bb7100b359f341759cb6f6753e1539a8',ramdisk_id='',reservation_id='r-lplra19f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='708622a9-7465-4492-ade8-b827198f7e30',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='32b18558-8bf2-4def-bc70-81c4e38fcc6f',image_min_disk='1',image_min_ram='0',image_owner_id='bb7100b359f341759cb6f6753e1539a8',image_owner_project_name='tempest-TestStampPattern-96878995',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-96878995-project-member',image_user_id='f523740272844b6eb236477d0b116ddb',owner_project_name='tempest-TestStampPattern-96878995',owner_user_name='tempest-TestStampPattern-96878995-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T16:31:59Z,user_data=None,user_id='f523740272844b6eb236477d0b116ddb',uuid=64a9c052-89a9-48ba-80c9-13fb5ef22f0e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5128334f-7255-4a56-9e8b-1151027d219b", "address": "fa:16:3e:fe:54:1c", "network": {"id": "11386312-9ac6-4252-ab98-b3298a08599c", "bridge": "br-int", "label": "tempest-TestStampPattern-1747654565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb7100b359f341759cb6f6753e1539a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5128334f-72", "ovs_interfaceid": "5128334f-7255-4a56-9e8b-1151027d219b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 16:34:45 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-77e4f4c5-8794-4f04-af1c-9901bc637f9b tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Converting VIF {"id": "5128334f-7255-4a56-9e8b-1151027d219b", "address": "fa:16:3e:fe:54:1c", "network": {"id": "11386312-9ac6-4252-ab98-b3298a08599c", "bridge": "br-int", "label": "tempest-TestStampPattern-1747654565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb7100b359f341759cb6f6753e1539a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5128334f-72", "ovs_interfaceid": "5128334f-7255-4a56-9e8b-1151027d219b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 16:34:45 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-77e4f4c5-8794-4f04-af1c-9901bc637f9b tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fe:54:1c,bridge_name='br-int',has_traffic_filtering=True,id=5128334f-7255-4a56-9e8b-1151027d219b,network=Network(11386312-9ac6-4252-ab98-b3298a08599c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5128334f-72') {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 16:34:45 user nova-compute[71731]: DEBUG os_vif [None req-77e4f4c5-8794-4f04-af1c-9901bc637f9b tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fe:54:1c,bridge_name='br-int',has_traffic_filtering=True,id=5128334f-7255-4a56-9e8b-1151027d219b,network=Network(11386312-9ac6-4252-ab98-b3298a08599c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5128334f-72') {{(pid=71731) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 16:34:45 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:34:45 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5128334f-72, bridge=br-int, if_exists=True) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:34:45 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:34:45 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:34:45 user nova-compute[71731]: INFO os_vif [None req-77e4f4c5-8794-4f04-af1c-9901bc637f9b tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fe:54:1c,bridge_name='br-int',has_traffic_filtering=True,id=5128334f-7255-4a56-9e8b-1151027d219b,network=Network(11386312-9ac6-4252-ab98-b3298a08599c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5128334f-72')
Apr 13 16:34:45 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-77e4f4c5-8794-4f04-af1c-9901bc637f9b tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] [instance: 64a9c052-89a9-48ba-80c9-13fb5ef22f0e] Deleting instance files /opt/stack/data/nova/instances/64a9c052-89a9-48ba-80c9-13fb5ef22f0e_del
Apr 13 16:34:45 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-77e4f4c5-8794-4f04-af1c-9901bc637f9b tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] [instance: 64a9c052-89a9-48ba-80c9-13fb5ef22f0e] Deletion of /opt/stack/data/nova/instances/64a9c052-89a9-48ba-80c9-13fb5ef22f0e_del complete
Apr 13 16:34:45 user nova-compute[71731]: INFO nova.compute.manager [None req-77e4f4c5-8794-4f04-af1c-9901bc637f9b tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] [instance: 64a9c052-89a9-48ba-80c9-13fb5ef22f0e] Took 0.96 seconds to destroy the instance on the hypervisor.
Apr 13 16:34:45 user nova-compute[71731]: DEBUG oslo.service.loopingcall [None req-77e4f4c5-8794-4f04-af1c-9901bc637f9b tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71731) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 16:34:45 user nova-compute[71731]: DEBUG nova.compute.manager [-] [instance: 64a9c052-89a9-48ba-80c9-13fb5ef22f0e] Deallocating network for instance {{(pid=71731) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 16:34:45 user nova-compute[71731]: DEBUG nova.network.neutron [-] [instance: 64a9c052-89a9-48ba-80c9-13fb5ef22f0e] deallocate_for_instance() {{(pid=71731) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 16:34:46 user nova-compute[71731]: DEBUG nova.network.neutron [-] [instance: 64a9c052-89a9-48ba-80c9-13fb5ef22f0e] Updating instance_info_cache with network_info: [] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:34:46 user nova-compute[71731]: INFO nova.compute.manager [-] [instance: 64a9c052-89a9-48ba-80c9-13fb5ef22f0e] Took 0.86 seconds to deallocate network for instance.
Apr 13 16:34:46 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-77e4f4c5-8794-4f04-af1c-9901bc637f9b tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:34:46 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-77e4f4c5-8794-4f04-af1c-9901bc637f9b tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:34:46 user nova-compute[71731]: DEBUG nova.compute.provider_tree [None req-77e4f4c5-8794-4f04-af1c-9901bc637f9b tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Inventory has not changed in ProviderTree for provider: cb6b1a64-0c24-4e2d-af1e-16576ca9165c {{(pid=71731) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 16:34:46 user nova-compute[71731]: DEBUG nova.scheduler.client.report [None req-77e4f4c5-8794-4f04-af1c-9901bc637f9b tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Inventory has not changed for provider cb6b1a64-0c24-4e2d-af1e-16576ca9165c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71731) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 16:34:46 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-77e4f4c5-8794-4f04-af1c-9901bc637f9b tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.341s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:34:46 user nova-compute[71731]: INFO nova.scheduler.client.report [None req-77e4f4c5-8794-4f04-af1c-9901bc637f9b tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Deleted allocations for instance 64a9c052-89a9-48ba-80c9-13fb5ef22f0e
Apr 13 16:34:46 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-77e4f4c5-8794-4f04-af1c-9901bc637f9b tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Lock "64a9c052-89a9-48ba-80c9-13fb5ef22f0e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.384s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:34:46 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:34:46 user nova-compute[71731]: DEBUG nova.compute.manager [req-36829aff-60de-49c9-8895-f8ab421d9eb1 req-6d4a5704-e96c-4bb2-9618-b7cbd95a565d service nova] [instance: 64a9c052-89a9-48ba-80c9-13fb5ef22f0e] Received event network-vif-plugged-5128334f-7255-4a56-9e8b-1151027d219b {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:34:46 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-36829aff-60de-49c9-8895-f8ab421d9eb1 req-6d4a5704-e96c-4bb2-9618-b7cbd95a565d service nova] Acquiring lock "64a9c052-89a9-48ba-80c9-13fb5ef22f0e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:34:46 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-36829aff-60de-49c9-8895-f8ab421d9eb1 req-6d4a5704-e96c-4bb2-9618-b7cbd95a565d service nova] Lock "64a9c052-89a9-48ba-80c9-13fb5ef22f0e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:34:46 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-36829aff-60de-49c9-8895-f8ab421d9eb1 req-6d4a5704-e96c-4bb2-9618-b7cbd95a565d service nova] Lock "64a9c052-89a9-48ba-80c9-13fb5ef22f0e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:34:46 user nova-compute[71731]: DEBUG nova.compute.manager [req-36829aff-60de-49c9-8895-f8ab421d9eb1 req-6d4a5704-e96c-4bb2-9618-b7cbd95a565d service nova] [instance: 64a9c052-89a9-48ba-80c9-13fb5ef22f0e] No waiting events found dispatching network-vif-plugged-5128334f-7255-4a56-9e8b-1151027d219b {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:34:46 user nova-compute[71731]: WARNING nova.compute.manager [req-36829aff-60de-49c9-8895-f8ab421d9eb1 req-6d4a5704-e96c-4bb2-9618-b7cbd95a565d service nova] [instance: 64a9c052-89a9-48ba-80c9-13fb5ef22f0e] Received unexpected event network-vif-plugged-5128334f-7255-4a56-9e8b-1151027d219b for instance with vm_state deleted and task_state None.
Apr 13 16:34:46 user nova-compute[71731]: DEBUG nova.compute.manager [req-36829aff-60de-49c9-8895-f8ab421d9eb1 req-6d4a5704-e96c-4bb2-9618-b7cbd95a565d service nova] [instance: 64a9c052-89a9-48ba-80c9-13fb5ef22f0e] Received event network-vif-deleted-5128334f-7255-4a56-9e8b-1151027d219b {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:34:50 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:34:50 user nova-compute[71731]: DEBUG nova.compute.manager [req-44fd9452-378a-4056-b14c-6a6f8ad63b4d req-24f513e5-8e71-4473-b862-19bc234ae510 service nova] [instance: bf98c3a2-dbeb-4ae4-8423-ce55964c4258] Received event network-changed-58361670-0371-4eb7-83b9-ce67bf2a67bb {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:34:50 user nova-compute[71731]: DEBUG nova.compute.manager [req-44fd9452-378a-4056-b14c-6a6f8ad63b4d req-24f513e5-8e71-4473-b862-19bc234ae510 service nova] [instance: bf98c3a2-dbeb-4ae4-8423-ce55964c4258] Refreshing instance network info cache due to event network-changed-58361670-0371-4eb7-83b9-ce67bf2a67bb. {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 16:34:50 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-44fd9452-378a-4056-b14c-6a6f8ad63b4d req-24f513e5-8e71-4473-b862-19bc234ae510 service nova] Acquiring lock "refresh_cache-bf98c3a2-dbeb-4ae4-8423-ce55964c4258" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 16:34:50 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-44fd9452-378a-4056-b14c-6a6f8ad63b4d req-24f513e5-8e71-4473-b862-19bc234ae510 service nova] Acquired lock "refresh_cache-bf98c3a2-dbeb-4ae4-8423-ce55964c4258" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 16:34:50 user nova-compute[71731]: DEBUG nova.network.neutron [req-44fd9452-378a-4056-b14c-6a6f8ad63b4d req-24f513e5-8e71-4473-b862-19bc234ae510 service nova] [instance: bf98c3a2-dbeb-4ae4-8423-ce55964c4258] Refreshing network info cache for port 58361670-0371-4eb7-83b9-ce67bf2a67bb {{(pid=71731) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 16:34:51 user nova-compute[71731]: DEBUG nova.network.neutron [req-44fd9452-378a-4056-b14c-6a6f8ad63b4d req-24f513e5-8e71-4473-b862-19bc234ae510 service nova] [instance: bf98c3a2-dbeb-4ae4-8423-ce55964c4258] Updated VIF entry in instance network info cache for port 58361670-0371-4eb7-83b9-ce67bf2a67bb. {{(pid=71731) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 16:34:51 user nova-compute[71731]: DEBUG nova.network.neutron [req-44fd9452-378a-4056-b14c-6a6f8ad63b4d req-24f513e5-8e71-4473-b862-19bc234ae510 service nova] [instance: bf98c3a2-dbeb-4ae4-8423-ce55964c4258] Updating instance_info_cache with network_info: [{"id": "58361670-0371-4eb7-83b9-ce67bf2a67bb", "address": "fa:16:3e:76:1a:b3", "network": {"id": "531e0c0e-c7aa-4a8c-b994-cf304d6e9089", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-897460632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18e15bc7bee7466a840fb0d0e85d58bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58361670-03", "ovs_interfaceid": "58361670-0371-4eb7-83b9-ce67bf2a67bb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:34:51 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-44fd9452-378a-4056-b14c-6a6f8ad63b4d req-24f513e5-8e71-4473-b862-19bc234ae510 service nova] Releasing lock "refresh_cache-bf98c3a2-dbeb-4ae4-8423-ce55964c4258" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 16:34:51 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:34:52 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-e3154b08-c321-4ce5-bfbf-0842a35ded65 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Acquiring lock "bf98c3a2-dbeb-4ae4-8423-ce55964c4258" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:34:52 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-e3154b08-c321-4ce5-bfbf-0842a35ded65 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Lock "bf98c3a2-dbeb-4ae4-8423-ce55964c4258" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:34:52 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-e3154b08-c321-4ce5-bfbf-0842a35ded65 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Acquiring lock "bf98c3a2-dbeb-4ae4-8423-ce55964c4258-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:34:52 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-e3154b08-c321-4ce5-bfbf-0842a35ded65 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Lock "bf98c3a2-dbeb-4ae4-8423-ce55964c4258-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:34:52 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-e3154b08-c321-4ce5-bfbf-0842a35ded65 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Lock "bf98c3a2-dbeb-4ae4-8423-ce55964c4258-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:34:52 user nova-compute[71731]: INFO nova.compute.manager [None req-e3154b08-c321-4ce5-bfbf-0842a35ded65 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] [instance: bf98c3a2-dbeb-4ae4-8423-ce55964c4258] Terminating instance
Apr 13 16:34:52 user nova-compute[71731]: DEBUG nova.compute.manager [None req-e3154b08-c321-4ce5-bfbf-0842a35ded65 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] [instance: bf98c3a2-dbeb-4ae4-8423-ce55964c4258] Start destroying the instance on the hypervisor. {{(pid=71731) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 16:34:53 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:34:53 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:34:53 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:34:53 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:34:53 user nova-compute[71731]: DEBUG nova.compute.manager [req-8e2313fa-ee57-4759-8501-978c860c31ed req-9c33a0d4-c790-4692-baf3-4fd601b0a09a service nova] [instance: bf98c3a2-dbeb-4ae4-8423-ce55964c4258] Received event network-vif-unplugged-58361670-0371-4eb7-83b9-ce67bf2a67bb {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:34:53 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-8e2313fa-ee57-4759-8501-978c860c31ed req-9c33a0d4-c790-4692-baf3-4fd601b0a09a service nova] Acquiring lock "bf98c3a2-dbeb-4ae4-8423-ce55964c4258-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:34:53 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-8e2313fa-ee57-4759-8501-978c860c31ed req-9c33a0d4-c790-4692-baf3-4fd601b0a09a service nova] Lock "bf98c3a2-dbeb-4ae4-8423-ce55964c4258-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:34:53 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-8e2313fa-ee57-4759-8501-978c860c31ed req-9c33a0d4-c790-4692-baf3-4fd601b0a09a service nova] Lock "bf98c3a2-dbeb-4ae4-8423-ce55964c4258-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:34:53 user nova-compute[71731]: DEBUG nova.compute.manager [req-8e2313fa-ee57-4759-8501-978c860c31ed req-9c33a0d4-c790-4692-baf3-4fd601b0a09a service nova] [instance: bf98c3a2-dbeb-4ae4-8423-ce55964c4258] No waiting events found dispatching network-vif-unplugged-58361670-0371-4eb7-83b9-ce67bf2a67bb {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:34:53 user nova-compute[71731]: DEBUG nova.compute.manager [req-8e2313fa-ee57-4759-8501-978c860c31ed req-9c33a0d4-c790-4692-baf3-4fd601b0a09a service nova] [instance: bf98c3a2-dbeb-4ae4-8423-ce55964c4258] Received event network-vif-unplugged-58361670-0371-4eb7-83b9-ce67bf2a67bb for instance with task_state deleting. {{(pid=71731) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 16:34:53 user nova-compute[71731]: INFO nova.virt.libvirt.driver [-] [instance: bf98c3a2-dbeb-4ae4-8423-ce55964c4258] Instance destroyed successfully.
Apr 13 16:34:53 user nova-compute[71731]: DEBUG nova.objects.instance [None req-e3154b08-c321-4ce5-bfbf-0842a35ded65 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Lazy-loading 'resources' on Instance uuid bf98c3a2-dbeb-4ae4-8423-ce55964c4258 {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:34:53 user nova-compute[71731]: DEBUG nova.virt.libvirt.vif [None req-e3154b08-c321-4ce5-bfbf-0842a35ded65 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T16:28:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1023997191',display_name='tempest-SnapshotDataIntegrityTests-server-1023997191',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1023997191',id=22,image_ref='708622a9-7465-4492-ade8-b827198f7e30',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEWcfNxtsSrfqvopYusd+ZqI4KzA2ovArHxBPlxsew7LRP1txsdXHUeRRgEYzHNePmj25ZAs3NfqqgPBjo6KvTsbCCUknJjbmiyMs1ESu45VRGnYpt2phiwqtYQaA1tsdA==',key_name='tempest-SnapshotDataIntegrityTests-1768467450',keypairs=<?>,launch_index=0,launched_at=2023-04-13T16:28:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='18e15bc7bee7466a840fb0d0e85d58bd',ramdisk_id='',reservation_id='r-7hcnb6go',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='708622a9-7465-4492-ade8-b827198f7e30',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-1801153584',owner_user_name='tempest-SnapshotDataIntegrityTests-1801153584-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T16:28:37Z,user_data=None,user_id='1318d817c48e40988e043fa33e908312',uuid=bf98c3a2-dbeb-4ae4-8423-ce55964c4258,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "58361670-0371-4eb7-83b9-ce67bf2a67bb", "address": "fa:16:3e:76:1a:b3", "network": {"id": "531e0c0e-c7aa-4a8c-b994-cf304d6e9089", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-897460632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18e15bc7bee7466a840fb0d0e85d58bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58361670-03", "ovs_interfaceid": "58361670-0371-4eb7-83b9-ce67bf2a67bb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 16:34:53 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-e3154b08-c321-4ce5-bfbf-0842a35ded65 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Converting VIF {"id": "58361670-0371-4eb7-83b9-ce67bf2a67bb", "address": "fa:16:3e:76:1a:b3", "network": {"id": "531e0c0e-c7aa-4a8c-b994-cf304d6e9089", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-897460632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18e15bc7bee7466a840fb0d0e85d58bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58361670-03", "ovs_interfaceid": "58361670-0371-4eb7-83b9-ce67bf2a67bb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 16:34:53 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-e3154b08-c321-4ce5-bfbf-0842a35ded65 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:76:1a:b3,bridge_name='br-int',has_traffic_filtering=True,id=58361670-0371-4eb7-83b9-ce67bf2a67bb,network=Network(531e0c0e-c7aa-4a8c-b994-cf304d6e9089),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58361670-03') {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 16:34:53 user nova-compute[71731]: DEBUG os_vif [None req-e3154b08-c321-4ce5-bfbf-0842a35ded65 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:76:1a:b3,bridge_name='br-int',has_traffic_filtering=True,id=58361670-0371-4eb7-83b9-ce67bf2a67bb,network=Network(531e0c0e-c7aa-4a8c-b994-cf304d6e9089),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58361670-03') {{(pid=71731) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 16:34:53 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:34:53 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap58361670-03, bridge=br-int, if_exists=True) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:34:53 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:34:53 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 16:34:53 user nova-compute[71731]: INFO os_vif [None req-e3154b08-c321-4ce5-bfbf-0842a35ded65 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:76:1a:b3,bridge_name='br-int',has_traffic_filtering=True,id=58361670-0371-4eb7-83b9-ce67bf2a67bb,network=Network(531e0c0e-c7aa-4a8c-b994-cf304d6e9089),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58361670-03')
Apr 13 16:34:53 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-e3154b08-c321-4ce5-bfbf-0842a35ded65 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] [instance: bf98c3a2-dbeb-4ae4-8423-ce55964c4258] Deleting instance files /opt/stack/data/nova/instances/bf98c3a2-dbeb-4ae4-8423-ce55964c4258_del
Apr 13 16:34:53 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-e3154b08-c321-4ce5-bfbf-0842a35ded65 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] [instance: bf98c3a2-dbeb-4ae4-8423-ce55964c4258] Deletion of /opt/stack/data/nova/instances/bf98c3a2-dbeb-4ae4-8423-ce55964c4258_del complete
Apr 13 16:34:53 user nova-compute[71731]: INFO nova.compute.manager [None req-e3154b08-c321-4ce5-bfbf-0842a35ded65 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] [instance: bf98c3a2-dbeb-4ae4-8423-ce55964c4258] Took 0.92 seconds to destroy the instance on the hypervisor.
Apr 13 16:34:53 user nova-compute[71731]: DEBUG oslo.service.loopingcall [None req-e3154b08-c321-4ce5-bfbf-0842a35ded65 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71731) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 16:34:53 user nova-compute[71731]: DEBUG nova.compute.manager [-] [instance: bf98c3a2-dbeb-4ae4-8423-ce55964c4258] Deallocating network for instance {{(pid=71731) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 16:34:53 user nova-compute[71731]: DEBUG nova.network.neutron [-] [instance: bf98c3a2-dbeb-4ae4-8423-ce55964c4258] deallocate_for_instance() {{(pid=71731) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 16:34:54 user nova-compute[71731]: DEBUG nova.network.neutron [-] [instance: bf98c3a2-dbeb-4ae4-8423-ce55964c4258] Updating instance_info_cache with network_info: [] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:34:54 user nova-compute[71731]: DEBUG nova.compute.manager [req-82d59b6d-a7a4-4baf-a994-ccc311f124d8 req-5ff77f5e-1d51-4f79-974e-9af6e996b439 service nova] [instance: bf98c3a2-dbeb-4ae4-8423-ce55964c4258] Received event network-vif-deleted-58361670-0371-4eb7-83b9-ce67bf2a67bb {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:34:54 user nova-compute[71731]: INFO nova.compute.manager [req-82d59b6d-a7a4-4baf-a994-ccc311f124d8 req-5ff77f5e-1d51-4f79-974e-9af6e996b439 service nova] [instance: bf98c3a2-dbeb-4ae4-8423-ce55964c4258] Neutron deleted interface 58361670-0371-4eb7-83b9-ce67bf2a67bb; detaching it from the instance and deleting it from the info cache
Apr 13 16:34:54 user nova-compute[71731]: DEBUG nova.network.neutron [req-82d59b6d-a7a4-4baf-a994-ccc311f124d8 req-5ff77f5e-1d51-4f79-974e-9af6e996b439 service nova] [instance: bf98c3a2-dbeb-4ae4-8423-ce55964c4258] Updating instance_info_cache with network_info: [] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:34:54 user nova-compute[71731]: INFO nova.compute.manager [-] [instance: bf98c3a2-dbeb-4ae4-8423-ce55964c4258] Took 0.51 seconds to deallocate network for instance.
Apr 13 16:34:54 user nova-compute[71731]: DEBUG nova.compute.manager [req-82d59b6d-a7a4-4baf-a994-ccc311f124d8 req-5ff77f5e-1d51-4f79-974e-9af6e996b439 service nova] [instance: bf98c3a2-dbeb-4ae4-8423-ce55964c4258] Detach interface failed, port_id=58361670-0371-4eb7-83b9-ce67bf2a67bb, reason: Instance bf98c3a2-dbeb-4ae4-8423-ce55964c4258 could not be found. {{(pid=71731) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 13 16:34:54 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-e3154b08-c321-4ce5-bfbf-0842a35ded65 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:34:54 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-e3154b08-c321-4ce5-bfbf-0842a35ded65 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:34:54 user nova-compute[71731]: DEBUG nova.compute.provider_tree [None req-e3154b08-c321-4ce5-bfbf-0842a35ded65 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Inventory has not changed in ProviderTree for provider: cb6b1a64-0c24-4e2d-af1e-16576ca9165c {{(pid=71731) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 16:34:54 user nova-compute[71731]: DEBUG nova.scheduler.client.report [None req-e3154b08-c321-4ce5-bfbf-0842a35ded65 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Inventory has not changed for provider cb6b1a64-0c24-4e2d-af1e-16576ca9165c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71731) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 16:34:54 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-e3154b08-c321-4ce5-bfbf-0842a35ded65 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.316s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:34:54 user nova-compute[71731]: INFO nova.scheduler.client.report [None req-e3154b08-c321-4ce5-bfbf-0842a35ded65 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Deleted allocations for instance bf98c3a2-dbeb-4ae4-8423-ce55964c4258
Apr 13 16:34:54 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-e3154b08-c321-4ce5-bfbf-0842a35ded65 tempest-SnapshotDataIntegrityTests-1801153584 tempest-SnapshotDataIntegrityTests-1801153584-project-member] Lock "bf98c3a2-dbeb-4ae4-8423-ce55964c4258" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.927s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:34:55 user nova-compute[71731]: DEBUG nova.compute.manager [req-ea01cffd-8c6a-4e0a-8c09-ae28d6ac014c req-6118a450-ec52-46a3-9558-78d4e39ac448 service nova] [instance: bf98c3a2-dbeb-4ae4-8423-ce55964c4258] Received event network-vif-plugged-58361670-0371-4eb7-83b9-ce67bf2a67bb {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:34:55 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-ea01cffd-8c6a-4e0a-8c09-ae28d6ac014c req-6118a450-ec52-46a3-9558-78d4e39ac448 service nova] Acquiring lock "bf98c3a2-dbeb-4ae4-8423-ce55964c4258-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:34:55 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-ea01cffd-8c6a-4e0a-8c09-ae28d6ac014c req-6118a450-ec52-46a3-9558-78d4e39ac448 service nova] Lock "bf98c3a2-dbeb-4ae4-8423-ce55964c4258-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:34:55 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-ea01cffd-8c6a-4e0a-8c09-ae28d6ac014c req-6118a450-ec52-46a3-9558-78d4e39ac448 service nova] Lock "bf98c3a2-dbeb-4ae4-8423-ce55964c4258-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:34:55 user nova-compute[71731]: DEBUG nova.compute.manager [req-ea01cffd-8c6a-4e0a-8c09-ae28d6ac014c req-6118a450-ec52-46a3-9558-78d4e39ac448 service nova] [instance: bf98c3a2-dbeb-4ae4-8423-ce55964c4258] No waiting events found dispatching network-vif-plugged-58361670-0371-4eb7-83b9-ce67bf2a67bb {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:34:55 user nova-compute[71731]: WARNING nova.compute.manager [req-ea01cffd-8c6a-4e0a-8c09-ae28d6ac014c req-6118a450-ec52-46a3-9558-78d4e39ac448 service nova] [instance: bf98c3a2-dbeb-4ae4-8423-ce55964c4258] Received unexpected event network-vif-plugged-58361670-0371-4eb7-83b9-ce67bf2a67bb for instance with vm_state deleted and task_state None.
Apr 13 16:34:56 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:34:58 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:35:00 user nova-compute[71731]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681403685.2622256, 64a9c052-89a9-48ba-80c9-13fb5ef22f0e => Stopped> {{(pid=71731) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 16:35:00 user nova-compute[71731]: INFO nova.compute.manager [-] [instance: 64a9c052-89a9-48ba-80c9-13fb5ef22f0e] VM Stopped (Lifecycle Event)
Apr 13 16:35:00 user nova-compute[71731]: DEBUG nova.compute.manager [None req-20ac27d4-57f7-4454-a9a0-ae87064f77cf None None] [instance: 64a9c052-89a9-48ba-80c9-13fb5ef22f0e] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:35:01 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:35:03 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:35:06 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:35:08 user nova-compute[71731]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681403693.7511444, bf98c3a2-dbeb-4ae4-8423-ce55964c4258 => Stopped> {{(pid=71731) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 16:35:08 user nova-compute[71731]: INFO nova.compute.manager [-] [instance: bf98c3a2-dbeb-4ae4-8423-ce55964c4258] VM Stopped (Lifecycle Event)
Apr 13 16:35:08 user nova-compute[71731]: DEBUG nova.compute.manager [None req-574ee4aa-d212-4aa0-924d-1fed9a87803a None None] [instance: bf98c3a2-dbeb-4ae4-8423-ce55964c4258] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:35:08 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:35:13 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:35:15 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:35:16 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager.update_available_resource {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:35:16 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:35:16 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:35:16 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:35:16 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Auditing locally available compute resources for user (node: user) {{(pid=71731) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 16:35:16 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:35:16 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:35:16 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:35:16 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:35:16 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acbcaee0-a47b-4fee-8765-9b1c9597d515/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:35:16 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acbcaee0-a47b-4fee-8765-9b1c9597d515/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:35:16 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acbcaee0-a47b-4fee-8765-9b1c9597d515/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:35:16 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acbcaee0-a47b-4fee-8765-9b1c9597d515/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:35:16 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=71731) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 16:35:16 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66553f5-5e1b-4f1d-8c5a-63bc340f7586/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:35:16 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66553f5-5e1b-4f1d-8c5a-63bc340f7586/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:35:16 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66553f5-5e1b-4f1d-8c5a-63bc340f7586/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:35:17 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66553f5-5e1b-4f1d-8c5a-63bc340f7586/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:35:17 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71731) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 16:35:17 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71731) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 16:35:17 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/650427bd-4dad-4bcd-922d-c17e60b36807/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:35:17 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/650427bd-4dad-4bcd-922d-c17e60b36807/disk --force-share --output=json" returned: 0 in 0.267s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:35:17 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/650427bd-4dad-4bcd-922d-c17e60b36807/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:35:17 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/650427bd-4dad-4bcd-922d-c17e60b36807/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:35:17 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32b18558-8bf2-4def-bc70-81c4e38fcc6f/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:35:17 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32b18558-8bf2-4def-bc70-81c4e38fcc6f/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:35:17 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32b18558-8bf2-4def-bc70-81c4e38fcc6f/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:35:17 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32b18558-8bf2-4def-bc70-81c4e38fcc6f/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:35:17 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=71731) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 16:35:17 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2956ab05-28ff-4c9e-b646-dbb83b3db278/disk.rescue --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:35:17 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2956ab05-28ff-4c9e-b646-dbb83b3db278/disk.rescue --force-share --output=json" returned: 0 in 0.143s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:35:17 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2956ab05-28ff-4c9e-b646-dbb83b3db278/disk.rescue --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:35:18 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2956ab05-28ff-4c9e-b646-dbb83b3db278/disk.rescue --force-share --output=json" returned: 0 in 0.132s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:35:18 user nova-compute[71731]: WARNING nova.virt.libvirt.driver [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 16:35:18 user nova-compute[71731]: WARNING nova.virt.libvirt.driver [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 16:35:18 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Hypervisor/Node resource view: name=user free_ram=7845MB free_disk=25.961143493652344GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71731) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 16:35:18 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:35:18 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:35:18 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance f66553f5-5e1b-4f1d-8c5a-63bc340f7586 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 16:35:18 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance 235f827c-7116-48e9-84c5-0c9761c18e1e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 16:35:18 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance 32b18558-8bf2-4def-bc70-81c4e38fcc6f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 16:35:18 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance 650427bd-4dad-4bcd-922d-c17e60b36807 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 16:35:18 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance 2956ab05-28ff-4c9e-b646-dbb83b3db278 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 16:35:18 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance acbcaee0-a47b-4fee-8765-9b1c9597d515 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 128, 'DISK_GB': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 16:35:18 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance 220e1c3e-1378-46fc-acc1-ee1bafac7722 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 16:35:18 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 16:35:18 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=71731) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 16:35:18 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Final resource view: name=user phys_ram=16023MB used_ram=1536MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=71731) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 16:35:18 user nova-compute[71731]: DEBUG nova.compute.provider_tree [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Inventory has not changed in ProviderTree for provider: cb6b1a64-0c24-4e2d-af1e-16576ca9165c {{(pid=71731) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 16:35:18 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 16:35:18 user nova-compute[71731]: DEBUG nova.scheduler.client.report [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Inventory has not changed for provider cb6b1a64-0c24-4e2d-af1e-16576ca9165c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71731) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 16:35:18 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Compute_service record updated for user:user {{(pid=71731) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 16:35:18 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.380s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:35:19 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:35:19 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:35:19 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71731) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 16:35:20 user nova-compute[71731]: DEBUG nova.compute.manager [req-5b40abc7-df34-4f75-8ee1-5b9b4b2708ee req-a5a4ecc6-c41f-4ed5-9ddb-b439464600ac service nova] [instance: 220e1c3e-1378-46fc-acc1-ee1bafac7722] Received event network-changed-96415b19-4e1b-41c6-a070-cff24e7b20ab {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:35:20 user nova-compute[71731]: DEBUG nova.compute.manager [req-5b40abc7-df34-4f75-8ee1-5b9b4b2708ee req-a5a4ecc6-c41f-4ed5-9ddb-b439464600ac service nova] [instance: 220e1c3e-1378-46fc-acc1-ee1bafac7722] Refreshing instance network info cache due to event network-changed-96415b19-4e1b-41c6-a070-cff24e7b20ab. {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 16:35:20 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-5b40abc7-df34-4f75-8ee1-5b9b4b2708ee req-a5a4ecc6-c41f-4ed5-9ddb-b439464600ac service nova] Acquiring lock "refresh_cache-220e1c3e-1378-46fc-acc1-ee1bafac7722" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 16:35:20 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-5b40abc7-df34-4f75-8ee1-5b9b4b2708ee req-a5a4ecc6-c41f-4ed5-9ddb-b439464600ac service nova] Acquired lock "refresh_cache-220e1c3e-1378-46fc-acc1-ee1bafac7722" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 16:35:20 user nova-compute[71731]: DEBUG nova.network.neutron [req-5b40abc7-df34-4f75-8ee1-5b9b4b2708ee req-a5a4ecc6-c41f-4ed5-9ddb-b439464600ac service nova] [instance: 220e1c3e-1378-46fc-acc1-ee1bafac7722] Refreshing network info cache for port 96415b19-4e1b-41c6-a070-cff24e7b20ab {{(pid=71731) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 16:35:20 user nova-compute[71731]: DEBUG nova.network.neutron [req-5b40abc7-df34-4f75-8ee1-5b9b4b2708ee req-a5a4ecc6-c41f-4ed5-9ddb-b439464600ac service nova] [instance: 220e1c3e-1378-46fc-acc1-ee1bafac7722] Updated VIF entry in instance network info cache for port 96415b19-4e1b-41c6-a070-cff24e7b20ab. {{(pid=71731) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 16:35:20 user nova-compute[71731]: DEBUG nova.network.neutron [req-5b40abc7-df34-4f75-8ee1-5b9b4b2708ee req-a5a4ecc6-c41f-4ed5-9ddb-b439464600ac service nova] [instance: 220e1c3e-1378-46fc-acc1-ee1bafac7722] Updating instance_info_cache with network_info: [{"id": "96415b19-4e1b-41c6-a070-cff24e7b20ab", "address": "fa:16:3e:c0:2c:aa", "network": {"id": "d36bc206-f629-4d6e-8a3f-458061d7b525", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-893271134-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d451e0e239f486aa2b3abe9e273eab3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96415b19-4e", "ovs_interfaceid": "96415b19-4e1b-41c6-a070-cff24e7b20ab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:35:20 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-5b40abc7-df34-4f75-8ee1-5b9b4b2708ee req-a5a4ecc6-c41f-4ed5-9ddb-b439464600ac service nova] Releasing lock "refresh_cache-220e1c3e-1378-46fc-acc1-ee1bafac7722" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 16:35:21 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:35:21 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Starting heal instance info cache {{(pid=71731) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 16:35:21 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Acquiring lock "refresh_cache-32b18558-8bf2-4def-bc70-81c4e38fcc6f" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 16:35:21 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Acquired lock "refresh_cache-32b18558-8bf2-4def-bc70-81c4e38fcc6f" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 16:35:21 user nova-compute[71731]: DEBUG nova.network.neutron [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] [instance: 32b18558-8bf2-4def-bc70-81c4e38fcc6f] Forcefully refreshing network info cache for instance {{(pid=71731) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 16:35:21 user nova-compute[71731]: DEBUG nova.network.neutron [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] [instance: 32b18558-8bf2-4def-bc70-81c4e38fcc6f] Updating instance_info_cache with network_info: [{"id": "f9afb5f6-d601-4106-85c8-6d6179433f28", "address": "fa:16:3e:72:0a:63", "network": {"id": "11386312-9ac6-4252-ab98-b3298a08599c", "bridge": "br-int", "label": "tempest-TestStampPattern-1747654565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.41", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb7100b359f341759cb6f6753e1539a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9afb5f6-d6", "ovs_interfaceid": "f9afb5f6-d601-4106-85c8-6d6179433f28", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:35:21 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Releasing lock "refresh_cache-32b18558-8bf2-4def-bc70-81c4e38fcc6f" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 16:35:21 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] [instance: 32b18558-8bf2-4def-bc70-81c4e38fcc6f] Updated the network info_cache for instance {{(pid=71731) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 16:35:21 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:35:22 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:35:23 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:35:23 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:35:24 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:35:26 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-f0fee77d-5df3-49a9-b399-186a74b7ece1 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Acquiring lock "0a5c9b2c-fe1e-4a21-b213-c63e2c28748a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:35:26 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-f0fee77d-5df3-49a9-b399-186a74b7ece1 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "0a5c9b2c-fe1e-4a21-b213-c63e2c28748a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:35:26 user nova-compute[71731]: DEBUG nova.compute.manager [None req-f0fee77d-5df3-49a9-b399-186a74b7ece1 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 0a5c9b2c-fe1e-4a21-b213-c63e2c28748a] Starting instance... {{(pid=71731) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 16:35:26 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-f0fee77d-5df3-49a9-b399-186a74b7ece1 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:35:26 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-f0fee77d-5df3-49a9-b399-186a74b7ece1 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:35:26 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-f0fee77d-5df3-49a9-b399-186a74b7ece1 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71731) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 16:35:26 user nova-compute[71731]: INFO nova.compute.claims [None req-f0fee77d-5df3-49a9-b399-186a74b7ece1 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 0a5c9b2c-fe1e-4a21-b213-c63e2c28748a] Claim successful on node user
Apr 13 16:35:26 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:35:27 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:35:27 user nova-compute[71731]: DEBUG nova.compute.provider_tree [None req-f0fee77d-5df3-49a9-b399-186a74b7ece1 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Inventory has not changed in ProviderTree for provider: cb6b1a64-0c24-4e2d-af1e-16576ca9165c {{(pid=71731) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 16:35:27 user nova-compute[71731]: DEBUG nova.scheduler.client.report [None req-f0fee77d-5df3-49a9-b399-186a74b7ece1 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Inventory has not changed for provider cb6b1a64-0c24-4e2d-af1e-16576ca9165c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71731) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 16:35:27 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-f0fee77d-5df3-49a9-b399-186a74b7ece1 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.363s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:35:27 user nova-compute[71731]: DEBUG nova.compute.manager [None req-f0fee77d-5df3-49a9-b399-186a74b7ece1 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 0a5c9b2c-fe1e-4a21-b213-c63e2c28748a] Start building networks asynchronously for instance. {{(pid=71731) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 16:35:27 user nova-compute[71731]: DEBUG nova.compute.manager [None req-f0fee77d-5df3-49a9-b399-186a74b7ece1 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 0a5c9b2c-fe1e-4a21-b213-c63e2c28748a] Allocating IP information in the background. {{(pid=71731) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 16:35:27 user nova-compute[71731]: DEBUG nova.network.neutron [None req-f0fee77d-5df3-49a9-b399-186a74b7ece1 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 0a5c9b2c-fe1e-4a21-b213-c63e2c28748a] allocate_for_instance() {{(pid=71731) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 16:35:27 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-f0fee77d-5df3-49a9-b399-186a74b7ece1 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 0a5c9b2c-fe1e-4a21-b213-c63e2c28748a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 16:35:27 user nova-compute[71731]: DEBUG nova.compute.manager [None req-f0fee77d-5df3-49a9-b399-186a74b7ece1 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 0a5c9b2c-fe1e-4a21-b213-c63e2c28748a] Start building block device mappings for instance. {{(pid=71731) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 16:35:27 user nova-compute[71731]: INFO nova.virt.block_device [None req-f0fee77d-5df3-49a9-b399-186a74b7ece1 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 0a5c9b2c-fe1e-4a21-b213-c63e2c28748a] Booting with volume b4a5ced3-77ae-4bf5-8154-bd1645e470f2 at /dev/vda
Apr 13 16:35:27 user nova-compute[71731]: DEBUG os_brick.utils [None req-f0fee77d-5df3-49a9-b399-186a74b7ece1 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 16:35:27 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:35:27 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:35:27 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffed4e16-7d27-488f-8adc-04694d69f150]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:81501d91421\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:35:27 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:35:27 user nova-compute[71731]: DEBUG nova.policy [None req-f0fee77d-5df3-49a9-b399-186a74b7ece1 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd70e10f63cdd49a9a1ebe1fe4c9de0a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d451e0e239f486aa2b3abe9e273eab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71731) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 16:35:27 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:35:27 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[808bf191-9a7a-41dc-bc47-639ff0feb363]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:35:27 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:35:27 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:35:27 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[556362d5-e4a4-492e-a252-08e9c19bbcc4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:35:27 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[56689610-b332-42b0-be33-6beca4c1637a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:35:27 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-f0fee77d-5df3-49a9-b399-186a74b7ece1 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Running cmd (subprocess): nvme version {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:35:27 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-f0fee77d-5df3-49a9-b399-186a74b7ece1 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] 'nvme version' failed. Not Retrying. {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 16:35:27 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f0fee77d-5df3-49a9-b399-186a74b7ece1 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] nvme not present on system {{(pid=71731) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 16:35:27 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:35:27 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 16:35:27 user nova-compute[71731]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 16:35:27 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[a288862c-f32e-4d4f-898c-75b94bad2994]: (4, '') {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:35:27 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.lightos [None req-f0fee77d-5df3-49a9-b399-186a74b7ece1 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71731) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 16:35:27 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.lightos [None req-f0fee77d-5df3-49a9-b399-186a74b7ece1 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71731) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 16:35:27 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.lightos [None req-f0fee77d-5df3-49a9-b399-186a74b7ece1 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] LIGHTOS: no hostnqn found. {{(pid=71731) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 16:35:27 user nova-compute[71731]: DEBUG os_brick.utils [None req-f0fee77d-5df3-49a9-b399-186a74b7ece1 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:81501d91421', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 16:35:27 user nova-compute[71731]: DEBUG nova.virt.block_device [None req-f0fee77d-5df3-49a9-b399-186a74b7ece1 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 0a5c9b2c-fe1e-4a21-b213-c63e2c28748a] Updating existing volume attachment record: da77c568-cb1c-4469-87d0-360eb5f98343 {{(pid=71731) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 16:35:28 user nova-compute[71731]: DEBUG nova.network.neutron [None req-f0fee77d-5df3-49a9-b399-186a74b7ece1 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 0a5c9b2c-fe1e-4a21-b213-c63e2c28748a] Successfully created port: ee0eba83-c6e1-4415-96d1-e5b496ec0afe {{(pid=71731) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 16:35:28 user nova-compute[71731]: INFO nova.compute.manager [None req-2fccdc3f-0e9a-4471-9d2d-2ce5b7220492 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: 2956ab05-28ff-4c9e-b646-dbb83b3db278] Unrescuing
Apr 13 16:35:28 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-2fccdc3f-0e9a-4471-9d2d-2ce5b7220492 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Acquiring lock "refresh_cache-2956ab05-28ff-4c9e-b646-dbb83b3db278" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 16:35:28 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-2fccdc3f-0e9a-4471-9d2d-2ce5b7220492 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Acquired lock "refresh_cache-2956ab05-28ff-4c9e-b646-dbb83b3db278" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 16:35:28 user nova-compute[71731]: DEBUG nova.network.neutron [None req-2fccdc3f-0e9a-4471-9d2d-2ce5b7220492 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: 2956ab05-28ff-4c9e-b646-dbb83b3db278] Building network info cache for instance {{(pid=71731) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 16:35:28 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:35:29 user nova-compute[71731]: DEBUG nova.network.neutron [None req-f0fee77d-5df3-49a9-b399-186a74b7ece1 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 0a5c9b2c-fe1e-4a21-b213-c63e2c28748a] Successfully updated port: ee0eba83-c6e1-4415-96d1-e5b496ec0afe {{(pid=71731) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 16:35:29 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-f0fee77d-5df3-49a9-b399-186a74b7ece1 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Acquiring lock "refresh_cache-0a5c9b2c-fe1e-4a21-b213-c63e2c28748a" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 16:35:29 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-f0fee77d-5df3-49a9-b399-186a74b7ece1 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Acquired lock "refresh_cache-0a5c9b2c-fe1e-4a21-b213-c63e2c28748a" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 16:35:29 user nova-compute[71731]: DEBUG nova.network.neutron [None req-f0fee77d-5df3-49a9-b399-186a74b7ece1 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 0a5c9b2c-fe1e-4a21-b213-c63e2c28748a] Building network info cache for instance {{(pid=71731) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 16:35:29 user nova-compute[71731]: DEBUG nova.compute.manager [req-6fd26fb8-eb27-4700-bd47-3aee0dde1d1b req-e282047e-d934-4ade-8d51-522eaed35211 service nova] [instance: 0a5c9b2c-fe1e-4a21-b213-c63e2c28748a] Received event network-changed-ee0eba83-c6e1-4415-96d1-e5b496ec0afe {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:35:29 user nova-compute[71731]: DEBUG nova.compute.manager [req-6fd26fb8-eb27-4700-bd47-3aee0dde1d1b req-e282047e-d934-4ade-8d51-522eaed35211 service nova] [instance: 0a5c9b2c-fe1e-4a21-b213-c63e2c28748a] Refreshing instance network info cache due to event network-changed-ee0eba83-c6e1-4415-96d1-e5b496ec0afe. {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 16:35:29 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-6fd26fb8-eb27-4700-bd47-3aee0dde1d1b req-e282047e-d934-4ade-8d51-522eaed35211 service nova] Acquiring lock "refresh_cache-0a5c9b2c-fe1e-4a21-b213-c63e2c28748a" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 16:35:29 user nova-compute[71731]: DEBUG nova.network.neutron [None req-f0fee77d-5df3-49a9-b399-186a74b7ece1 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 0a5c9b2c-fe1e-4a21-b213-c63e2c28748a] Instance cache missing network info. {{(pid=71731) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 16:35:29 user nova-compute[71731]: DEBUG nova.network.neutron [None req-2fccdc3f-0e9a-4471-9d2d-2ce5b7220492 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: 2956ab05-28ff-4c9e-b646-dbb83b3db278] Updating instance_info_cache with network_info: [{"id": "84df62e9-af7c-4e62-83da-b43b511be2a0", "address": "fa:16:3e:66:e8:40", "network": {"id": "5a7877ff-8230-470b-90b5-e5dcfc8f0cee", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-779403873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2d09a74bf684a9fb1dd1e95d6c23f3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84df62e9-af", "ovs_interfaceid": "84df62e9-af7c-4e62-83da-b43b511be2a0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:35:29 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-2fccdc3f-0e9a-4471-9d2d-2ce5b7220492 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Releasing lock "refresh_cache-2956ab05-28ff-4c9e-b646-dbb83b3db278" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 16:35:29 user nova-compute[71731]: DEBUG nova.objects.instance [None req-2fccdc3f-0e9a-4471-9d2d-2ce5b7220492 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lazy-loading 'flavor' on Instance uuid 2956ab05-28ff-4c9e-b646-dbb83b3db278 {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:35:29 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:35:29 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:35:29 user nova-compute[71731]: DEBUG nova.network.neutron [None req-f0fee77d-5df3-49a9-b399-186a74b7ece1 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 0a5c9b2c-fe1e-4a21-b213-c63e2c28748a] Updating instance_info_cache with network_info: [{"id": "ee0eba83-c6e1-4415-96d1-e5b496ec0afe", "address": "fa:16:3e:9d:3c:e8", "network": {"id": "d36bc206-f629-4d6e-8a3f-458061d7b525", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-893271134-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d451e0e239f486aa2b3abe9e273eab3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee0eba83-c6", "ovs_interfaceid": "ee0eba83-c6e1-4415-96d1-e5b496ec0afe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:35:29 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-f0fee77d-5df3-49a9-b399-186a74b7ece1 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Releasing lock "refresh_cache-0a5c9b2c-fe1e-4a21-b213-c63e2c28748a" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 16:35:29 user nova-compute[71731]: DEBUG nova.compute.manager [None req-f0fee77d-5df3-49a9-b399-186a74b7ece1 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 0a5c9b2c-fe1e-4a21-b213-c63e2c28748a] Instance network_info: |[{"id": "ee0eba83-c6e1-4415-96d1-e5b496ec0afe", "address": "fa:16:3e:9d:3c:e8", "network": {"id": "d36bc206-f629-4d6e-8a3f-458061d7b525", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-893271134-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d451e0e239f486aa2b3abe9e273eab3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee0eba83-c6", "ovs_interfaceid": "ee0eba83-c6e1-4415-96d1-e5b496ec0afe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71731) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 16:35:29 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-6fd26fb8-eb27-4700-bd47-3aee0dde1d1b req-e282047e-d934-4ade-8d51-522eaed35211 service nova] Acquired lock "refresh_cache-0a5c9b2c-fe1e-4a21-b213-c63e2c28748a" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 16:35:29 user nova-compute[71731]: DEBUG nova.network.neutron [req-6fd26fb8-eb27-4700-bd47-3aee0dde1d1b req-e282047e-d934-4ade-8d51-522eaed35211 service nova] [instance: 0a5c9b2c-fe1e-4a21-b213-c63e2c28748a] Refreshing network info cache for port ee0eba83-c6e1-4415-96d1-e5b496ec0afe {{(pid=71731) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 16:35:29 user nova-compute[71731]: DEBUG nova.compute.manager [req-992f029e-e728-4137-aad4-a9a073f8c811 req-2643da4b-2acf-4b88-8b54-82bcc0529e28 service nova] [instance: 2956ab05-28ff-4c9e-b646-dbb83b3db278] Received event network-vif-unplugged-84df62e9-af7c-4e62-83da-b43b511be2a0 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:35:29 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-992f029e-e728-4137-aad4-a9a073f8c811 req-2643da4b-2acf-4b88-8b54-82bcc0529e28 service nova] Acquiring lock "2956ab05-28ff-4c9e-b646-dbb83b3db278-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:35:29 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-992f029e-e728-4137-aad4-a9a073f8c811 req-2643da4b-2acf-4b88-8b54-82bcc0529e28 service nova] Lock "2956ab05-28ff-4c9e-b646-dbb83b3db278-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:35:29 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-992f029e-e728-4137-aad4-a9a073f8c811 req-2643da4b-2acf-4b88-8b54-82bcc0529e28 service nova] Lock "2956ab05-28ff-4c9e-b646-dbb83b3db278-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:35:29 user nova-compute[71731]: DEBUG nova.compute.manager [req-992f029e-e728-4137-aad4-a9a073f8c811 req-2643da4b-2acf-4b88-8b54-82bcc0529e28 service nova] [instance: 2956ab05-28ff-4c9e-b646-dbb83b3db278] No waiting events found dispatching network-vif-unplugged-84df62e9-af7c-4e62-83da-b43b511be2a0 {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:35:29 user nova-compute[71731]: WARNING nova.compute.manager [req-992f029e-e728-4137-aad4-a9a073f8c811 req-2643da4b-2acf-4b88-8b54-82bcc0529e28 service nova] [instance: 2956ab05-28ff-4c9e-b646-dbb83b3db278] Received unexpected event network-vif-unplugged-84df62e9-af7c-4e62-83da-b43b511be2a0 for instance with vm_state rescued and task_state unrescuing.
Apr 13 16:35:29 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:35:29 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:35:29 user nova-compute[71731]: DEBUG nova.network.neutron [req-6fd26fb8-eb27-4700-bd47-3aee0dde1d1b req-e282047e-d934-4ade-8d51-522eaed35211 service nova] [instance: 0a5c9b2c-fe1e-4a21-b213-c63e2c28748a] Updated VIF entry in instance network info cache for port ee0eba83-c6e1-4415-96d1-e5b496ec0afe. {{(pid=71731) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 16:35:29 user nova-compute[71731]: DEBUG nova.network.neutron [req-6fd26fb8-eb27-4700-bd47-3aee0dde1d1b req-e282047e-d934-4ade-8d51-522eaed35211 service nova] [instance: 0a5c9b2c-fe1e-4a21-b213-c63e2c28748a] Updating instance_info_cache with network_info: [{"id": "ee0eba83-c6e1-4415-96d1-e5b496ec0afe", "address": "fa:16:3e:9d:3c:e8", "network": {"id": "d36bc206-f629-4d6e-8a3f-458061d7b525", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-893271134-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d451e0e239f486aa2b3abe9e273eab3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee0eba83-c6", "ovs_interfaceid": "ee0eba83-c6e1-4415-96d1-e5b496ec0afe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:35:29 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-6fd26fb8-eb27-4700-bd47-3aee0dde1d1b req-e282047e-d934-4ade-8d51-522eaed35211 service nova] Releasing lock "refresh_cache-0a5c9b2c-fe1e-4a21-b213-c63e2c28748a" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 16:35:30 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:35:30 user nova-compute[71731]: INFO nova.virt.libvirt.driver [-] [instance: 2956ab05-28ff-4c9e-b646-dbb83b3db278] Instance destroyed successfully.
Apr 13 16:35:31 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:35:31 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:35:31 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:35:31 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:35:31 user nova-compute[71731]: DEBUG nova.compute.manager [req-4ed0e005-71d2-4054-a957-4de40cffa5ef req-33a80acb-ecda-4218-883a-e5ef2efeec08 service nova] [instance: 2956ab05-28ff-4c9e-b646-dbb83b3db278] Received event network-vif-plugged-84df62e9-af7c-4e62-83da-b43b511be2a0 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:35:31 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-4ed0e005-71d2-4054-a957-4de40cffa5ef req-33a80acb-ecda-4218-883a-e5ef2efeec08 service nova] Acquiring lock "2956ab05-28ff-4c9e-b646-dbb83b3db278-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:35:31 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-4ed0e005-71d2-4054-a957-4de40cffa5ef req-33a80acb-ecda-4218-883a-e5ef2efeec08 service nova] Lock "2956ab05-28ff-4c9e-b646-dbb83b3db278-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:35:31 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-4ed0e005-71d2-4054-a957-4de40cffa5ef req-33a80acb-ecda-4218-883a-e5ef2efeec08 service nova] Lock "2956ab05-28ff-4c9e-b646-dbb83b3db278-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:35:31 user nova-compute[71731]: DEBUG nova.compute.manager [req-4ed0e005-71d2-4054-a957-4de40cffa5ef req-33a80acb-ecda-4218-883a-e5ef2efeec08 service nova] [instance: 2956ab05-28ff-4c9e-b646-dbb83b3db278] No waiting events found dispatching network-vif-plugged-84df62e9-af7c-4e62-83da-b43b511be2a0 {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:35:31 user nova-compute[71731]: WARNING nova.compute.manager [req-4ed0e005-71d2-4054-a957-4de40cffa5ef req-33a80acb-ecda-4218-883a-e5ef2efeec08 service nova] [instance: 2956ab05-28ff-4c9e-b646-dbb83b3db278] Received unexpected event network-vif-plugged-84df62e9-af7c-4e62-83da-b43b511be2a0 for instance with vm_state rescued and task_state unrescuing.
Apr 13 16:35:31 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:35:31 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:35:31 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:35:33 user nova-compute[71731]: DEBUG nova.compute.manager [req-fd087728-e4d8-4da5-9ad7-7b332b6250d3 req-268309bd-7dfa-405a-b9af-11a21adc0985 service nova] [instance: 2956ab05-28ff-4c9e-b646-dbb83b3db278] Received event network-vif-plugged-84df62e9-af7c-4e62-83da-b43b511be2a0 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:35:33 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-fd087728-e4d8-4da5-9ad7-7b332b6250d3 req-268309bd-7dfa-405a-b9af-11a21adc0985 service nova] Acquiring lock "2956ab05-28ff-4c9e-b646-dbb83b3db278-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:35:33 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-fd087728-e4d8-4da5-9ad7-7b332b6250d3 req-268309bd-7dfa-405a-b9af-11a21adc0985 service nova] Lock "2956ab05-28ff-4c9e-b646-dbb83b3db278-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:35:33 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-fd087728-e4d8-4da5-9ad7-7b332b6250d3 req-268309bd-7dfa-405a-b9af-11a21adc0985 service nova] Lock "2956ab05-28ff-4c9e-b646-dbb83b3db278-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:35:33 user nova-compute[71731]: DEBUG nova.compute.manager [req-fd087728-e4d8-4da5-9ad7-7b332b6250d3 req-268309bd-7dfa-405a-b9af-11a21adc0985 service nova] [instance: 2956ab05-28ff-4c9e-b646-dbb83b3db278] No waiting events found dispatching network-vif-plugged-84df62e9-af7c-4e62-83da-b43b511be2a0 {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:35:33 user nova-compute[71731]: WARNING nova.compute.manager [req-fd087728-e4d8-4da5-9ad7-7b332b6250d3 req-268309bd-7dfa-405a-b9af-11a21adc0985 service nova] [instance: 2956ab05-28ff-4c9e-b646-dbb83b3db278] Received unexpected event network-vif-plugged-84df62e9-af7c-4e62-83da-b43b511be2a0 for instance with vm_state rescued and task_state unrescuing.
Apr 13 16:35:33 user nova-compute[71731]: DEBUG nova.compute.manager [req-fd087728-e4d8-4da5-9ad7-7b332b6250d3 req-268309bd-7dfa-405a-b9af-11a21adc0985 service nova] [instance: 2956ab05-28ff-4c9e-b646-dbb83b3db278] Received event network-vif-plugged-84df62e9-af7c-4e62-83da-b43b511be2a0 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:35:33 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-fd087728-e4d8-4da5-9ad7-7b332b6250d3 req-268309bd-7dfa-405a-b9af-11a21adc0985 service nova] Acquiring lock "2956ab05-28ff-4c9e-b646-dbb83b3db278-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:35:33 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-fd087728-e4d8-4da5-9ad7-7b332b6250d3 req-268309bd-7dfa-405a-b9af-11a21adc0985 service nova] Lock "2956ab05-28ff-4c9e-b646-dbb83b3db278-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:35:33 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-fd087728-e4d8-4da5-9ad7-7b332b6250d3 req-268309bd-7dfa-405a-b9af-11a21adc0985 service nova] Lock "2956ab05-28ff-4c9e-b646-dbb83b3db278-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:35:33 user nova-compute[71731]: DEBUG nova.compute.manager [req-fd087728-e4d8-4da5-9ad7-7b332b6250d3 req-268309bd-7dfa-405a-b9af-11a21adc0985 service nova] [instance: 2956ab05-28ff-4c9e-b646-dbb83b3db278] No waiting events found dispatching network-vif-plugged-84df62e9-af7c-4e62-83da-b43b511be2a0 {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:35:33 user nova-compute[71731]: WARNING nova.compute.manager [req-fd087728-e4d8-4da5-9ad7-7b332b6250d3 req-268309bd-7dfa-405a-b9af-11a21adc0985 service nova] [instance: 2956ab05-28ff-4c9e-b646-dbb83b3db278] Received unexpected event network-vif-plugged-84df62e9-af7c-4e62-83da-b43b511be2a0 for instance with vm_state rescued and task_state unrescuing.
Apr 13 16:35:33 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:35:33 user nova-compute[71731]: DEBUG nova.compute.manager [None req-f0fee77d-5df3-49a9-b399-186a74b7ece1 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 0a5c9b2c-fe1e-4a21-b213-c63e2c28748a] Start spawning the instance on the hypervisor. {{(pid=71731) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 16:35:33 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-f0fee77d-5df3-49a9-b399-186a74b7ece1 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 0a5c9b2c-fe1e-4a21-b213-c63e2c28748a] Creating instance directory {{(pid=71731) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 16:35:33 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-f0fee77d-5df3-49a9-b399-186a74b7ece1 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 0a5c9b2c-fe1e-4a21-b213-c63e2c28748a] Creating image(s)
Apr 13 16:35:33 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-f0fee77d-5df3-49a9-b399-186a74b7ece1 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 0a5c9b2c-fe1e-4a21-b213-c63e2c28748a] Did not create local disks {{(pid=71731) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 13 16:35:33 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-f0fee77d-5df3-49a9-b399-186a74b7ece1 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 0a5c9b2c-fe1e-4a21-b213-c63e2c28748a] Ensure instance console log exists: /opt/stack/data/nova/instances/0a5c9b2c-fe1e-4a21-b213-c63e2c28748a/console.log {{(pid=71731) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 16:35:33 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-f0fee77d-5df3-49a9-b399-186a74b7ece1 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:35:33 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-f0fee77d-5df3-49a9-b399-186a74b7ece1 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:35:33 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-f0fee77d-5df3-49a9-b399-186a74b7ece1 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:35:33 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-f0fee77d-5df3-49a9-b399-186a74b7ece1 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 0a5c9b2c-fe1e-4a21-b213-c63e2c28748a] Start _get_guest_xml network_info=[{"id": "ee0eba83-c6e1-4415-96d1-e5b496ec0afe", "address": "fa:16:3e:9d:3c:e8", "network": {"id": "d36bc206-f629-4d6e-8a3f-458061d7b525", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-893271134-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d451e0e239f486aa2b3abe9e273eab3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee0eba83-c6", "ovs_interfaceid": "ee0eba83-c6e1-4415-96d1-e5b496ec0afe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'attachment_id': 'da77c568-cb1c-4469-87d0-360eb5f98343', 'mount_device': '/dev/vda', 'delete_on_termination': False, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b4a5ced3-77ae-4bf5-8154-bd1645e470f2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rpZnFCMW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '0a5c9b2c-fe1e-4a21-b213-c63e2c28748a', 'attached_at': '', 'detached_at': '', 'volume_id': 'b4a5ced3-77ae-4bf5-8154-bd1645e470f2', 'serial': 'b4a5ced3-77ae-4bf5-8154-bd1645e470f2'}, 'disk_bus': 'virtio', 'guest_format': None, 'volume_type': None} {{(pid=71731) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 16:35:33 user nova-compute[71731]: DEBUG nova.virt.libvirt.host [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Removed pending event for 2956ab05-28ff-4c9e-b646-dbb83b3db278 due to event {{(pid=71731) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 13 16:35:33 user nova-compute[71731]: DEBUG nova.virt.driver [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Emitting event <LifecycleEvent: 1681403733.8420413, 2956ab05-28ff-4c9e-b646-dbb83b3db278 => Resumed> {{(pid=71731) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 16:35:33 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 2956ab05-28ff-4c9e-b646-dbb83b3db278] VM Resumed (Lifecycle Event)
Apr 13 16:35:33 user nova-compute[71731]: DEBUG nova.compute.manager [None req-2fccdc3f-0e9a-4471-9d2d-2ce5b7220492 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: 2956ab05-28ff-4c9e-b646-dbb83b3db278] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:35:33 user nova-compute[71731]: WARNING nova.virt.libvirt.driver [None req-f0fee77d-5df3-49a9-b399-186a74b7ece1 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 16:35:33 user nova-compute[71731]: WARNING nova.virt.libvirt.driver [None req-f0fee77d-5df3-49a9-b399-186a74b7ece1 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 16:35:33 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-f0fee77d-5df3-49a9-b399-186a74b7ece1 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71731) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 16:35:33 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-f0fee77d-5df3-49a9-b399-186a74b7ece1 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T16:17:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 16:35:33 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-f0fee77d-5df3-49a9-b399-186a74b7ece1 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Flavor limits 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 16:35:33 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-f0fee77d-5df3-49a9-b399-186a74b7ece1 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Image limits 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 16:35:33 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-f0fee77d-5df3-49a9-b399-186a74b7ece1 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Flavor pref 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 16:35:33 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-f0fee77d-5df3-49a9-b399-186a74b7ece1 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Image pref 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 16:35:33 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-f0fee77d-5df3-49a9-b399-186a74b7ece1 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 16:35:33 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-f0fee77d-5df3-49a9-b399-186a74b7ece1 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 16:35:33 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-f0fee77d-5df3-49a9-b399-186a74b7ece1 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71731) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 16:35:33 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-f0fee77d-5df3-49a9-b399-186a74b7ece1 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Got 1 possible topologies {{(pid=71731) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 16:35:33 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-f0fee77d-5df3-49a9-b399-186a74b7ece1 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 16:35:33 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-f0fee77d-5df3-49a9-b399-186a74b7ece1 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 16:35:33 user nova-compute[71731]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f0fee77d-5df3-49a9-b399-186a74b7ece1 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 0a5c9b2c-fe1e-4a21-b213-c63e2c28748a] Calling os-brick to attach iSCSI Volume {{(pid=71731) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 16:35:33 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0fee77d-5df3-49a9-b399-186a74b7ece1 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8cf0118790>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b4a5ced3-77ae-4bf5-8154-bd1645e470f2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rpZnFCMW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 16:35:33 user nova-compute[71731]: WARNING os_brick.initiator.connectors.base [None req-f0fee77d-5df3-49a9-b399-186a74b7ece1 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 16:35:33 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-f0fee77d-5df3-49a9-b399-186a74b7ece1 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 16:35:33 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-f0fee77d-5df3-49a9-b399-186a74b7ece1 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 16:35:33 user nova-compute[71731]: WARNING os_brick.initiator.connectors.base [None req-f0fee77d-5df3-49a9-b399-186a74b7ece1 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 16:35:33 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-f0fee77d-5df3-49a9-b399-186a74b7ece1 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b4a5ced3-77ae-4bf5-8154-bd1645e470f2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 16:35:33 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-f0fee77d-5df3-49a9-b399-186a74b7ece1 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b4a5ced3-77ae-4bf5-8154-bd1645e470f2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 16:35:33 user nova-compute[71731]: INFO os_brick.initiator.connectors.iscsi [None req-f0fee77d-5df3-49a9-b399-186a74b7ece1 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 16:35:33 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 2956ab05-28ff-4c9e-b646-dbb83b3db278] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:35:33 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4a5ced3-77ae-4bf5-8154-bd1645e470f2 -p 172.16.0.220:3260 {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:35:33 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 2956ab05-28ff-4c9e-b646-dbb83b3db278] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71731) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 16:35:33 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4a5ced3-77ae-4bf5-8154-bd1645e470f2 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:35:33 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3ad12e7-29d3-4ab7-a931-f7d425c30ef3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:35:33 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0fee77d-5df3-49a9-b399-186a74b7ece1 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 16:35:33 user nova-compute[71731]:  {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:35:33 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4a5ced3-77ae-4bf5-8154-bd1645e470f2 -p 172.16.0.220:3260 --interface default --op new {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:35:33 user nova-compute[71731]: DEBUG nova.virt.driver [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Emitting event <LifecycleEvent: 1681403733.8425586, 2956ab05-28ff-4c9e-b646-dbb83b3db278 => Started> {{(pid=71731) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 16:35:33 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 2956ab05-28ff-4c9e-b646-dbb83b3db278] VM Started (Lifecycle Event)
Apr 13 16:35:33 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4a5ced3-77ae-4bf5-8154-bd1645e470f2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:35:33 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[97af6b3c-b309-47f5-8cb3-0ea1bdc25b8f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b4a5ced3-77ae-4bf5-8154-bd1645e470f2] added\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:35:33 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0fee77d-5df3-49a9-b399-186a74b7ece1 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b4a5ced3-77ae-4bf5-8154-bd1645e470f2] added
Apr 13 16:35:33 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:35:33 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4a5ced3-77ae-4bf5-8154-bd1645e470f2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:35:33 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 2956ab05-28ff-4c9e-b646-dbb83b3db278] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:35:33 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 2956ab05-28ff-4c9e-b646-dbb83b3db278] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=71731) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 16:35:33 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4a5ced3-77ae-4bf5-8154-bd1645e470f2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:35:33 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b55a79e-83be-4a7d-a8c1-513573b1248c]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:35:33 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0fee77d-5df3-49a9-b399-186a74b7ece1 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:35:33 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4a5ced3-77ae-4bf5-8154-bd1645e470f2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:35:33 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4a5ced3-77ae-4bf5-8154-bd1645e470f2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:35:33 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[78e565e6-e669-4d34-b181-f26d0ee2ca2e]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:35:33 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0fee77d-5df3-49a9-b399-186a74b7ece1 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:35:34 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4a5ced3-77ae-4bf5-8154-bd1645e470f2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rpZnFCMW {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:35:34 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4a5ced3-77ae-4bf5-8154-bd1645e470f2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rpZnFCMW" returned: 0 in 0.020s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:35:34 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b14a07b-5f9e-401c-875f-b4187a4789d1]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:35:34 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0fee77d-5df3-49a9-b399-186a74b7ece1 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rpZnFCMW'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:35:34 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4a5ced3-77ae-4bf5-8154-bd1645e470f2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:35:34 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4a5ced3-77ae-4bf5-8154-bd1645e470f2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:35:34 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aa4690f-51f7-42ef-bc0b-a4e4adb80353]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:35:34 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0fee77d-5df3-49a9-b399-186a74b7ece1 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:35:34 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:35:34 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:35:34 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ef4335e-9bb2-440c-8d08-ed993ef97f61]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25c3dc97-c9cb-4529-ab32-26ef7fd94fc6 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2088266-1d33-4bb1-ac5b-1de832ff7985 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:651ea766-ffda-42a1-9b3c-7be05a92c85f (non-flash)\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:35:34 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0fee77d-5df3-49a9-b399-186a74b7ece1 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)
Apr 13 16:35:34 user nova-compute[71731]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25c3dc97-c9cb-4529-ab32-26ef7fd94fc6 (non-flash)
Apr 13 16:35:34 user nova-compute[71731]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2088266-1d33-4bb1-ac5b-1de832ff7985 (non-flash)
Apr 13 16:35:34 user nova-compute[71731]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:651ea766-ffda-42a1-9b3c-7be05a92c85f (non-flash)
Apr 13 16:35:34 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 16:35:34 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0fee77d-5df3-49a9-b399-186a74b7ece1 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)
Apr 13 16:35:34 user nova-compute[71731]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25c3dc97-c9cb-4529-ab32-26ef7fd94fc6 (non-flash)
Apr 13 16:35:34 user nova-compute[71731]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2088266-1d33-4bb1-ac5b-1de832ff7985 (non-flash)
Apr 13 16:35:34 user nova-compute[71731]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:651ea766-ffda-42a1-9b3c-7be05a92c85f (non-flash)
Apr 13 16:35:34 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 16:35:34 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4a5ced3-77ae-4bf5-8154-bd1645e470f2 -p 172.16.0.220:3260 --login {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:35:34 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4a5ced3-77ae-4bf5-8154-bd1645e470f2 -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:35:34 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[07847a13-7ba5-4cdf-948e-9afe340c0e48]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b4a5ced3-77ae-4bf5-8154-bd1645e470f2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b4a5ced3-77ae-4bf5-8154-bd1645e470f2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:35:34 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0fee77d-5df3-49a9-b399-186a74b7ece1 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b4a5ced3-77ae-4bf5-8154-bd1645e470f2, portal: 172.16.0.220,3260]
Apr 13 16:35:34 user nova-compute[71731]: Login to [iface: default, target: iqn.2010-10.org.openstack:b4a5ced3-77ae-4bf5-8154-bd1645e470f2, portal: 172.16.0.220,3260] successful.
Apr 13 16:35:34 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:35:34 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4a5ced3-77ae-4bf5-8154-bd1645e470f2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:35:34 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4a5ced3-77ae-4bf5-8154-bd1645e470f2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:35:34 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[eac828c9-a784-4e3c-8044-c9b0090c2766]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:35:34 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0fee77d-5df3-49a9-b399-186a74b7ece1 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:35:34 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:35:34 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:35:34 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0d90ad5-b422-47d9-9e45-7d3430d5f5e4]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25c3dc97-c9cb-4529-ab32-26ef7fd94fc6 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2088266-1d33-4bb1-ac5b-1de832ff7985 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:651ea766-ffda-42a1-9b3c-7be05a92c85f (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4a5ced3-77ae-4bf5-8154-bd1645e470f2 (non-flash)\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:35:34 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0fee77d-5df3-49a9-b399-186a74b7ece1 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)
Apr 13 16:35:34 user nova-compute[71731]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25c3dc97-c9cb-4529-ab32-26ef7fd94fc6 (non-flash)
Apr 13 16:35:34 user nova-compute[71731]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2088266-1d33-4bb1-ac5b-1de832ff7985 (non-flash)
Apr 13 16:35:34 user nova-compute[71731]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:651ea766-ffda-42a1-9b3c-7be05a92c85f (non-flash)
Apr 13 16:35:34 user nova-compute[71731]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4a5ced3-77ae-4bf5-8154-bd1645e470f2 (non-flash)
Apr 13 16:35:34 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 16:35:34 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0fee77d-5df3-49a9-b399-186a74b7ece1 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)
Apr 13 16:35:34 user nova-compute[71731]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25c3dc97-c9cb-4529-ab32-26ef7fd94fc6 (non-flash)
Apr 13 16:35:34 user nova-compute[71731]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2088266-1d33-4bb1-ac5b-1de832ff7985 (non-flash)
Apr 13 16:35:34 user nova-compute[71731]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:651ea766-ffda-42a1-9b3c-7be05a92c85f (non-flash)
Apr 13 16:35:34 user nova-compute[71731]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4a5ced3-77ae-4bf5-8154-bd1645e470f2 (non-flash)
Apr 13 16:35:34 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 16:35:34 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-f0fee77d-5df3-49a9-b399-186a74b7ece1 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b4a5ced3-77ae-4bf5-8154-bd1645e470f2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.290s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 16:35:34 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0fee77d-5df3-49a9-b399-186a74b7ece1 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Connected to 172.16.0.220:3260 {{(pid=71731) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 16:35:34 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-f0fee77d-5df3-49a9-b399-186a74b7ece1 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] HCTL ('37', '-', '-', 0) found on session 40 with lun 0 {{(pid=71731) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 16:35:34 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-f0fee77d-5df3-49a9-b399-186a74b7ece1 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=71731) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 16:35:34 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:35:34 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.023s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:35:34 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[187b90a6-05f4-49d1-aa76-5f35835e7ce3]: (4, ('- - 0', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:35:34 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-f0fee77d-5df3-49a9-b399-186a74b7ece1 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Searching for a device in session 40 and hctl ['37', '*', '*', 0] yield: None {{(pid=71731) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 16:35:35 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-f0fee77d-5df3-49a9-b399-186a74b7ece1 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Searching for a device in session 40 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=71731) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 16:35:35 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0fee77d-5df3-49a9-b399-186a74b7ece1 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:b4a5ced3-77ae-4bf5-8154-bd1645e470f2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rpZnFCMW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71731) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 16:35:35 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-f0fee77d-5df3-49a9-b399-186a74b7ece1 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.324s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 16:35:35 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0fee77d-5df3-49a9-b399-186a74b7ece1 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] <== connect_volume: return (1326ms) {'type': 'block', 'scsi_wwn': '26465313636636536', 'path': '/dev/sdf'} {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 16:35:35 user nova-compute[71731]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f0fee77d-5df3-49a9-b399-186a74b7ece1 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 0a5c9b2c-fe1e-4a21-b213-c63e2c28748a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26465313636636536', 'path': '/dev/sdf'} {{(pid=71731) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 16:35:35 user nova-compute[71731]: DEBUG nova.virt.libvirt.vif [None req-f0fee77d-5df3-49a9-b399-186a74b7ece1 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T16:35:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1235436858',display_name='tempest-TestVolumeBootPattern-server-1235436858',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1235436858',id=32,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIspJuW0ouAVIXdRkaEFP67MIl/YPuQkC9G3HjohNK4Y6ERboR/Jfb2q58aDhzUN+56TLqbLCfdFh2NtWLgvjHOwe+zpPoSYOKAkWLX+NSuU860pg4Djj9vwVgJj/Bkydw==',key_name='tempest-TestVolumeBootPattern-1747083001',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8d451e0e239f486aa2b3abe9e273eab3',ramdisk_id='',reservation_id='r-0eo0gkk4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-438786227',owner_user_name='tempest-TestVolumeBootPattern-438786227-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T16:35:27Z,user_data=None,user_id='d70e10f63cdd49a9a1ebe1fe4c9de0a2',uuid=0a5c9b2c-fe1e-4a21-b213-c63e2c28748a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ee0eba83-c6e1-4415-96d1-e5b496ec0afe", "address": "fa:16:3e:9d:3c:e8", "network": {"id": "d36bc206-f629-4d6e-8a3f-458061d7b525", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-893271134-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d451e0e239f486aa2b3abe9e273eab3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee0eba83-c6", "ovs_interfaceid": "ee0eba83-c6e1-4415-96d1-e5b496ec0afe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71731) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 16:35:35 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-f0fee77d-5df3-49a9-b399-186a74b7ece1 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Converting VIF {"id": "ee0eba83-c6e1-4415-96d1-e5b496ec0afe", "address": "fa:16:3e:9d:3c:e8", "network": {"id": "d36bc206-f629-4d6e-8a3f-458061d7b525", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-893271134-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d451e0e239f486aa2b3abe9e273eab3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee0eba83-c6", "ovs_interfaceid": "ee0eba83-c6e1-4415-96d1-e5b496ec0afe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 16:35:35 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-f0fee77d-5df3-49a9-b399-186a74b7ece1 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9d:3c:e8,bridge_name='br-int',has_traffic_filtering=True,id=ee0eba83-c6e1-4415-96d1-e5b496ec0afe,network=Network(d36bc206-f629-4d6e-8a3f-458061d7b525),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee0eba83-c6') {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 16:35:35 user nova-compute[71731]: DEBUG nova.objects.instance [None req-f0fee77d-5df3-49a9-b399-186a74b7ece1 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lazy-loading 'pci_devices' on Instance uuid 0a5c9b2c-fe1e-4a21-b213-c63e2c28748a {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:35:35 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-f0fee77d-5df3-49a9-b399-186a74b7ece1 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 0a5c9b2c-fe1e-4a21-b213-c63e2c28748a] End _get_guest_xml xml=<domain type="kvm">
Apr 13 16:35:35 user nova-compute[71731]:   <uuid>0a5c9b2c-fe1e-4a21-b213-c63e2c28748a</uuid>
Apr 13 16:35:35 user nova-compute[71731]:   <name>instance-00000020</name>
Apr 13 16:35:35 user nova-compute[71731]:   <memory>131072</memory>
Apr 13 16:35:35 user nova-compute[71731]:   <vcpu>1</vcpu>
Apr 13 16:35:35 user nova-compute[71731]:   <metadata>
Apr 13 16:35:35 user nova-compute[71731]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 16:35:35 user nova-compute[71731]:       <nova:package version="0.0.0"/>
Apr 13 16:35:35 user nova-compute[71731]:       <nova:name>tempest-TestVolumeBootPattern-server-1235436858</nova:name>
Apr 13 16:35:35 user nova-compute[71731]:       <nova:creationTime>2023-04-13 16:35:33</nova:creationTime>
Apr 13 16:35:35 user nova-compute[71731]:       <nova:flavor name="m1.nano">
Apr 13 16:35:35 user nova-compute[71731]:         <nova:memory>128</nova:memory>
Apr 13 16:35:35 user nova-compute[71731]:         <nova:disk>1</nova:disk>
Apr 13 16:35:35 user nova-compute[71731]:         <nova:swap>0</nova:swap>
Apr 13 16:35:35 user nova-compute[71731]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 16:35:35 user nova-compute[71731]:         <nova:vcpus>1</nova:vcpus>
Apr 13 16:35:35 user nova-compute[71731]:       </nova:flavor>
Apr 13 16:35:35 user nova-compute[71731]:       <nova:owner>
Apr 13 16:35:35 user nova-compute[71731]:         <nova:user uuid="d70e10f63cdd49a9a1ebe1fe4c9de0a2">tempest-TestVolumeBootPattern-438786227-project-member</nova:user>
Apr 13 16:35:35 user nova-compute[71731]:         <nova:project uuid="8d451e0e239f486aa2b3abe9e273eab3">tempest-TestVolumeBootPattern-438786227</nova:project>
Apr 13 16:35:35 user nova-compute[71731]:       </nova:owner>
Apr 13 16:35:35 user nova-compute[71731]:       <nova:ports>
Apr 13 16:35:35 user nova-compute[71731]:         <nova:port uuid="ee0eba83-c6e1-4415-96d1-e5b496ec0afe">
Apr 13 16:35:35 user nova-compute[71731]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Apr 13 16:35:35 user nova-compute[71731]:         </nova:port>
Apr 13 16:35:35 user nova-compute[71731]:       </nova:ports>
Apr 13 16:35:35 user nova-compute[71731]:     </nova:instance>
Apr 13 16:35:35 user nova-compute[71731]:   </metadata>
Apr 13 16:35:35 user nova-compute[71731]:   <sysinfo type="smbios">
Apr 13 16:35:35 user nova-compute[71731]:     <system>
Apr 13 16:35:35 user nova-compute[71731]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 16:35:35 user nova-compute[71731]:       <entry name="product">OpenStack Nova</entry>
Apr 13 16:35:35 user nova-compute[71731]:       <entry name="version">0.0.0</entry>
Apr 13 16:35:35 user nova-compute[71731]:       <entry name="serial">0a5c9b2c-fe1e-4a21-b213-c63e2c28748a</entry>
Apr 13 16:35:35 user nova-compute[71731]:       <entry name="uuid">0a5c9b2c-fe1e-4a21-b213-c63e2c28748a</entry>
Apr 13 16:35:35 user nova-compute[71731]:       <entry name="family">Virtual Machine</entry>
Apr 13 16:35:35 user nova-compute[71731]:     </system>
Apr 13 16:35:35 user nova-compute[71731]:   </sysinfo>
Apr 13 16:35:35 user nova-compute[71731]:   <os>
Apr 13 16:35:35 user nova-compute[71731]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 16:35:35 user nova-compute[71731]:     <boot dev="hd"/>
Apr 13 16:35:35 user nova-compute[71731]:     <smbios mode="sysinfo"/>
Apr 13 16:35:35 user nova-compute[71731]:   </os>
Apr 13 16:35:35 user nova-compute[71731]:   <features>
Apr 13 16:35:35 user nova-compute[71731]:     <acpi/>
Apr 13 16:35:35 user nova-compute[71731]:     <apic/>
Apr 13 16:35:35 user nova-compute[71731]:     <vmcoreinfo/>
Apr 13 16:35:35 user nova-compute[71731]:   </features>
Apr 13 16:35:35 user nova-compute[71731]:   <clock offset="utc">
Apr 13 16:35:35 user nova-compute[71731]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 16:35:35 user nova-compute[71731]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 16:35:35 user nova-compute[71731]:     <timer name="hpet" present="no"/>
Apr 13 16:35:35 user nova-compute[71731]:   </clock>
Apr 13 16:35:35 user nova-compute[71731]:   <cpu mode="custom" match="exact">
Apr 13 16:35:35 user nova-compute[71731]:     <model>Nehalem</model>
Apr 13 16:35:35 user nova-compute[71731]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 16:35:35 user nova-compute[71731]:   </cpu>
Apr 13 16:35:35 user nova-compute[71731]:   <devices>
Apr 13 16:35:35 user nova-compute[71731]:     <disk type="block" device="disk">
Apr 13 16:35:35 user nova-compute[71731]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 16:35:35 user nova-compute[71731]:       <source dev="/dev/sdf"/>
Apr 13 16:35:35 user nova-compute[71731]:       <target dev="vda" bus="virtio"/>
Apr 13 16:35:35 user nova-compute[71731]:       <serial>b4a5ced3-77ae-4bf5-8154-bd1645e470f2</serial>
Apr 13 16:35:35 user nova-compute[71731]:     </disk>
Apr 13 16:35:35 user nova-compute[71731]:     <interface type="ethernet">
Apr 13 16:35:35 user nova-compute[71731]:       <mac address="fa:16:3e:9d:3c:e8"/>
Apr 13 16:35:35 user nova-compute[71731]:       <model type="virtio"/>
Apr 13 16:35:35 user nova-compute[71731]:       <mtu size="1442"/>
Apr 13 16:35:35 user nova-compute[71731]:       <target dev="tapee0eba83-c6"/>
Apr 13 16:35:35 user nova-compute[71731]:     </interface>
Apr 13 16:35:35 user nova-compute[71731]:     <serial type="pty">
Apr 13 16:35:35 user nova-compute[71731]:       <log file="/opt/stack/data/nova/instances/0a5c9b2c-fe1e-4a21-b213-c63e2c28748a/console.log" append="off"/>
Apr 13 16:35:35 user nova-compute[71731]:     </serial>
Apr 13 16:35:35 user nova-compute[71731]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 16:35:35 user nova-compute[71731]:     <video>
Apr 13 16:35:35 user nova-compute[71731]:       <model type="virtio"/>
Apr 13 16:35:35 user nova-compute[71731]:     </video>
Apr 13 16:35:35 user nova-compute[71731]:     <rng model="virtio">
Apr 13 16:35:35 user nova-compute[71731]:       <backend model="random">/dev/urandom</backend>
Apr 13 16:35:35 user nova-compute[71731]:     </rng>
Apr 13 16:35:35 user nova-compute[71731]:     <controller type="usb" index="0" model="none"/>
Apr 13 16:35:35 user nova-compute[71731]:     <memballoon model="virtio">
Apr 13 16:35:35 user nova-compute[71731]:       <stats period="10"/>
Apr 13 16:35:35 user nova-compute[71731]:     </memballoon>
Apr 13 16:35:35 user nova-compute[71731]:   </devices>
Apr 13 16:35:35 user nova-compute[71731]: </domain>
Apr 13 16:35:35 user nova-compute[71731]:  {{(pid=71731) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 16:35:35 user nova-compute[71731]: DEBUG nova.virt.libvirt.vif [None req-f0fee77d-5df3-49a9-b399-186a74b7ece1 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T16:35:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1235436858',display_name='tempest-TestVolumeBootPattern-server-1235436858',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1235436858',id=32,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIspJuW0ouAVIXdRkaEFP67MIl/YPuQkC9G3HjohNK4Y6ERboR/Jfb2q58aDhzUN+56TLqbLCfdFh2NtWLgvjHOwe+zpPoSYOKAkWLX+NSuU860pg4Djj9vwVgJj/Bkydw==',key_name='tempest-TestVolumeBootPattern-1747083001',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8d451e0e239f486aa2b3abe9e273eab3',ramdisk_id='',reservation_id='r-0eo0gkk4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-438786227',owner_user_name='tempest-TestVolumeBootPattern-438786227-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T16:35:27Z,user_data=None,user_id='d70e10f63cdd49a9a1ebe1fe4c9de0a2',uuid=0a5c9b2c-fe1e-4a21-b213-c63e2c28748a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ee0eba83-c6e1-4415-96d1-e5b496ec0afe", "address": "fa:16:3e:9d:3c:e8", "network": {"id": "d36bc206-f629-4d6e-8a3f-458061d7b525", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-893271134-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d451e0e239f486aa2b3abe9e273eab3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee0eba83-c6", "ovs_interfaceid": "ee0eba83-c6e1-4415-96d1-e5b496ec0afe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 16:35:35 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-f0fee77d-5df3-49a9-b399-186a74b7ece1 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Converting VIF {"id": "ee0eba83-c6e1-4415-96d1-e5b496ec0afe", "address": "fa:16:3e:9d:3c:e8", "network": {"id": "d36bc206-f629-4d6e-8a3f-458061d7b525", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-893271134-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d451e0e239f486aa2b3abe9e273eab3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee0eba83-c6", "ovs_interfaceid": "ee0eba83-c6e1-4415-96d1-e5b496ec0afe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 16:35:35 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-f0fee77d-5df3-49a9-b399-186a74b7ece1 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9d:3c:e8,bridge_name='br-int',has_traffic_filtering=True,id=ee0eba83-c6e1-4415-96d1-e5b496ec0afe,network=Network(d36bc206-f629-4d6e-8a3f-458061d7b525),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee0eba83-c6') {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 16:35:35 user nova-compute[71731]: DEBUG os_vif [None req-f0fee77d-5df3-49a9-b399-186a74b7ece1 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9d:3c:e8,bridge_name='br-int',has_traffic_filtering=True,id=ee0eba83-c6e1-4415-96d1-e5b496ec0afe,network=Network(d36bc206-f629-4d6e-8a3f-458061d7b525),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee0eba83-c6') {{(pid=71731) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 16:35:35 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:35:35 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:35:35 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 16:35:35 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:35:35 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapee0eba83-c6, may_exist=True) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:35:35 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapee0eba83-c6, col_values=(('external_ids', {'iface-id': 'ee0eba83-c6e1-4415-96d1-e5b496ec0afe', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9d:3c:e8', 'vm-uuid': '0a5c9b2c-fe1e-4a21-b213-c63e2c28748a'}),)) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:35:35 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:35:35 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 16:35:35 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:35:35 user nova-compute[71731]: INFO os_vif [None req-f0fee77d-5df3-49a9-b399-186a74b7ece1 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9d:3c:e8,bridge_name='br-int',has_traffic_filtering=True,id=ee0eba83-c6e1-4415-96d1-e5b496ec0afe,network=Network(d36bc206-f629-4d6e-8a3f-458061d7b525),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee0eba83-c6')
Apr 13 16:35:35 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-f0fee77d-5df3-49a9-b399-186a74b7ece1 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] No BDM found with device name vda, not building metadata. {{(pid=71731) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 16:35:35 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-f0fee77d-5df3-49a9-b399-186a74b7ece1 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] No VIF found with MAC fa:16:3e:9d:3c:e8, not building metadata {{(pid=71731) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 16:35:36 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:35:36 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:35:36 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:35:36 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:35:36 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:35:36 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:35:37 user nova-compute[71731]: DEBUG nova.compute.manager [req-6182628b-0788-4929-91a7-5b3d8f712147 req-9dc9c271-385f-4af7-9021-fdc8fc35a7e1 service nova] [instance: 0a5c9b2c-fe1e-4a21-b213-c63e2c28748a] Received event network-vif-plugged-ee0eba83-c6e1-4415-96d1-e5b496ec0afe {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:35:37 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-6182628b-0788-4929-91a7-5b3d8f712147 req-9dc9c271-385f-4af7-9021-fdc8fc35a7e1 service nova] Acquiring lock "0a5c9b2c-fe1e-4a21-b213-c63e2c28748a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:35:37 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-6182628b-0788-4929-91a7-5b3d8f712147 req-9dc9c271-385f-4af7-9021-fdc8fc35a7e1 service nova] Lock "0a5c9b2c-fe1e-4a21-b213-c63e2c28748a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:35:37 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-6182628b-0788-4929-91a7-5b3d8f712147 req-9dc9c271-385f-4af7-9021-fdc8fc35a7e1 service nova] Lock "0a5c9b2c-fe1e-4a21-b213-c63e2c28748a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:35:37 user nova-compute[71731]: DEBUG nova.compute.manager [req-6182628b-0788-4929-91a7-5b3d8f712147 req-9dc9c271-385f-4af7-9021-fdc8fc35a7e1 service nova] [instance: 0a5c9b2c-fe1e-4a21-b213-c63e2c28748a] No waiting events found dispatching network-vif-plugged-ee0eba83-c6e1-4415-96d1-e5b496ec0afe {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:35:37 user nova-compute[71731]: WARNING nova.compute.manager [req-6182628b-0788-4929-91a7-5b3d8f712147 req-9dc9c271-385f-4af7-9021-fdc8fc35a7e1 service nova] [instance: 0a5c9b2c-fe1e-4a21-b213-c63e2c28748a] Received unexpected event network-vif-plugged-ee0eba83-c6e1-4415-96d1-e5b496ec0afe for instance with vm_state building and task_state spawning.
Apr 13 16:35:38 user nova-compute[71731]: DEBUG nova.virt.driver [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Emitting event <LifecycleEvent: 1681403738.9053855, 0a5c9b2c-fe1e-4a21-b213-c63e2c28748a => Resumed> {{(pid=71731) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 16:35:38 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 0a5c9b2c-fe1e-4a21-b213-c63e2c28748a] VM Resumed (Lifecycle Event)
Apr 13 16:35:38 user nova-compute[71731]: DEBUG nova.compute.manager [None req-f0fee77d-5df3-49a9-b399-186a74b7ece1 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 0a5c9b2c-fe1e-4a21-b213-c63e2c28748a] Instance event wait completed in 0 seconds for  {{(pid=71731) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 16:35:38 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-f0fee77d-5df3-49a9-b399-186a74b7ece1 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 0a5c9b2c-fe1e-4a21-b213-c63e2c28748a] Guest created on hypervisor {{(pid=71731) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 16:35:38 user nova-compute[71731]: INFO nova.virt.libvirt.driver [-] [instance: 0a5c9b2c-fe1e-4a21-b213-c63e2c28748a] Instance spawned successfully.
Apr 13 16:35:38 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-f0fee77d-5df3-49a9-b399-186a74b7ece1 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 0a5c9b2c-fe1e-4a21-b213-c63e2c28748a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 16:35:38 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 0a5c9b2c-fe1e-4a21-b213-c63e2c28748a] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:35:38 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 0a5c9b2c-fe1e-4a21-b213-c63e2c28748a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71731) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 16:35:38 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-f0fee77d-5df3-49a9-b399-186a74b7ece1 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 0a5c9b2c-fe1e-4a21-b213-c63e2c28748a] Found default for hw_cdrom_bus of ide {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:35:38 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-f0fee77d-5df3-49a9-b399-186a74b7ece1 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 0a5c9b2c-fe1e-4a21-b213-c63e2c28748a] Found default for hw_disk_bus of virtio {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:35:38 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-f0fee77d-5df3-49a9-b399-186a74b7ece1 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 0a5c9b2c-fe1e-4a21-b213-c63e2c28748a] Found default for hw_input_bus of None {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:35:38 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-f0fee77d-5df3-49a9-b399-186a74b7ece1 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 0a5c9b2c-fe1e-4a21-b213-c63e2c28748a] Found default for hw_pointer_model of None {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:35:38 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-f0fee77d-5df3-49a9-b399-186a74b7ece1 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 0a5c9b2c-fe1e-4a21-b213-c63e2c28748a] Found default for hw_video_model of virtio {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:35:38 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-f0fee77d-5df3-49a9-b399-186a74b7ece1 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 0a5c9b2c-fe1e-4a21-b213-c63e2c28748a] Found default for hw_vif_model of virtio {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:35:38 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 0a5c9b2c-fe1e-4a21-b213-c63e2c28748a] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 16:35:38 user nova-compute[71731]: DEBUG nova.virt.driver [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Emitting event <LifecycleEvent: 1681403738.9063306, 0a5c9b2c-fe1e-4a21-b213-c63e2c28748a => Started> {{(pid=71731) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 16:35:38 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 0a5c9b2c-fe1e-4a21-b213-c63e2c28748a] VM Started (Lifecycle Event)
Apr 13 16:35:38 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 0a5c9b2c-fe1e-4a21-b213-c63e2c28748a] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:35:38 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 0a5c9b2c-fe1e-4a21-b213-c63e2c28748a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71731) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 16:35:39 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 0a5c9b2c-fe1e-4a21-b213-c63e2c28748a] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 16:35:39 user nova-compute[71731]: INFO nova.compute.manager [None req-f0fee77d-5df3-49a9-b399-186a74b7ece1 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 0a5c9b2c-fe1e-4a21-b213-c63e2c28748a] Took 5.19 seconds to spawn the instance on the hypervisor.
Apr 13 16:35:39 user nova-compute[71731]: DEBUG nova.compute.manager [None req-f0fee77d-5df3-49a9-b399-186a74b7ece1 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 0a5c9b2c-fe1e-4a21-b213-c63e2c28748a] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:35:39 user nova-compute[71731]: INFO nova.compute.manager [None req-f0fee77d-5df3-49a9-b399-186a74b7ece1 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 0a5c9b2c-fe1e-4a21-b213-c63e2c28748a] Took 12.30 seconds to build instance.
Apr 13 16:35:39 user nova-compute[71731]: DEBUG nova.compute.manager [req-15231421-7390-466c-84ed-48fcd824e509 req-9adb1589-5ab9-4a1c-b833-484f4f4645d2 service nova] [instance: 0a5c9b2c-fe1e-4a21-b213-c63e2c28748a] Received event network-vif-plugged-ee0eba83-c6e1-4415-96d1-e5b496ec0afe {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:35:39 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-15231421-7390-466c-84ed-48fcd824e509 req-9adb1589-5ab9-4a1c-b833-484f4f4645d2 service nova] Acquiring lock "0a5c9b2c-fe1e-4a21-b213-c63e2c28748a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:35:39 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-15231421-7390-466c-84ed-48fcd824e509 req-9adb1589-5ab9-4a1c-b833-484f4f4645d2 service nova] Lock "0a5c9b2c-fe1e-4a21-b213-c63e2c28748a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:35:39 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-15231421-7390-466c-84ed-48fcd824e509 req-9adb1589-5ab9-4a1c-b833-484f4f4645d2 service nova] Lock "0a5c9b2c-fe1e-4a21-b213-c63e2c28748a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:35:39 user nova-compute[71731]: DEBUG nova.compute.manager [req-15231421-7390-466c-84ed-48fcd824e509 req-9adb1589-5ab9-4a1c-b833-484f4f4645d2 service nova] [instance: 0a5c9b2c-fe1e-4a21-b213-c63e2c28748a] No waiting events found dispatching network-vif-plugged-ee0eba83-c6e1-4415-96d1-e5b496ec0afe {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:35:39 user nova-compute[71731]: WARNING nova.compute.manager [req-15231421-7390-466c-84ed-48fcd824e509 req-9adb1589-5ab9-4a1c-b833-484f4f4645d2 service nova] [instance: 0a5c9b2c-fe1e-4a21-b213-c63e2c28748a] Received unexpected event network-vif-plugged-ee0eba83-c6e1-4415-96d1-e5b496ec0afe for instance with vm_state active and task_state None.
Apr 13 16:35:39 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-f0fee77d-5df3-49a9-b399-186a74b7ece1 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "0a5c9b2c-fe1e-4a21-b213-c63e2c28748a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.388s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:35:40 user nova-compute[71731]: DEBUG nova.compute.manager [req-bfeb7616-4e9f-43f9-9e09-6106330b9b99 req-adfbe99b-ef7a-46df-a530-d7c6f742e700 service nova] [instance: 32b18558-8bf2-4def-bc70-81c4e38fcc6f] Received event network-changed-f9afb5f6-d601-4106-85c8-6d6179433f28 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:35:40 user nova-compute[71731]: DEBUG nova.compute.manager [req-bfeb7616-4e9f-43f9-9e09-6106330b9b99 req-adfbe99b-ef7a-46df-a530-d7c6f742e700 service nova] [instance: 32b18558-8bf2-4def-bc70-81c4e38fcc6f] Refreshing instance network info cache due to event network-changed-f9afb5f6-d601-4106-85c8-6d6179433f28. {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 16:35:40 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-bfeb7616-4e9f-43f9-9e09-6106330b9b99 req-adfbe99b-ef7a-46df-a530-d7c6f742e700 service nova] Acquiring lock "refresh_cache-32b18558-8bf2-4def-bc70-81c4e38fcc6f" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 16:35:40 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-bfeb7616-4e9f-43f9-9e09-6106330b9b99 req-adfbe99b-ef7a-46df-a530-d7c6f742e700 service nova] Acquired lock "refresh_cache-32b18558-8bf2-4def-bc70-81c4e38fcc6f" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 16:35:40 user nova-compute[71731]: DEBUG nova.network.neutron [req-bfeb7616-4e9f-43f9-9e09-6106330b9b99 req-adfbe99b-ef7a-46df-a530-d7c6f742e700 service nova] [instance: 32b18558-8bf2-4def-bc70-81c4e38fcc6f] Refreshing network info cache for port f9afb5f6-d601-4106-85c8-6d6179433f28 {{(pid=71731) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 16:35:40 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-66eac412-2f59-4f74-8599-c7b0132ea574 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Acquiring lock "32b18558-8bf2-4def-bc70-81c4e38fcc6f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:35:40 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-66eac412-2f59-4f74-8599-c7b0132ea574 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Lock "32b18558-8bf2-4def-bc70-81c4e38fcc6f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:35:40 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-66eac412-2f59-4f74-8599-c7b0132ea574 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Acquiring lock "32b18558-8bf2-4def-bc70-81c4e38fcc6f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:35:40 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-66eac412-2f59-4f74-8599-c7b0132ea574 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Lock "32b18558-8bf2-4def-bc70-81c4e38fcc6f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:35:40 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-66eac412-2f59-4f74-8599-c7b0132ea574 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Lock "32b18558-8bf2-4def-bc70-81c4e38fcc6f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:35:40 user nova-compute[71731]: INFO nova.compute.manager [None req-66eac412-2f59-4f74-8599-c7b0132ea574 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] [instance: 32b18558-8bf2-4def-bc70-81c4e38fcc6f] Terminating instance
Apr 13 16:35:40 user nova-compute[71731]: DEBUG nova.compute.manager [None req-66eac412-2f59-4f74-8599-c7b0132ea574 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] [instance: 32b18558-8bf2-4def-bc70-81c4e38fcc6f] Start destroying the instance on the hypervisor. {{(pid=71731) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 16:35:40 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:35:40 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:35:40 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:35:40 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:35:40 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:35:40 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:35:40 user nova-compute[71731]: DEBUG nova.network.neutron [req-bfeb7616-4e9f-43f9-9e09-6106330b9b99 req-adfbe99b-ef7a-46df-a530-d7c6f742e700 service nova] [instance: 32b18558-8bf2-4def-bc70-81c4e38fcc6f] Updated VIF entry in instance network info cache for port f9afb5f6-d601-4106-85c8-6d6179433f28. {{(pid=71731) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 16:35:40 user nova-compute[71731]: DEBUG nova.network.neutron [req-bfeb7616-4e9f-43f9-9e09-6106330b9b99 req-adfbe99b-ef7a-46df-a530-d7c6f742e700 service nova] [instance: 32b18558-8bf2-4def-bc70-81c4e38fcc6f] Updating instance_info_cache with network_info: [{"id": "f9afb5f6-d601-4106-85c8-6d6179433f28", "address": "fa:16:3e:72:0a:63", "network": {"id": "11386312-9ac6-4252-ab98-b3298a08599c", "bridge": "br-int", "label": "tempest-TestStampPattern-1747654565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb7100b359f341759cb6f6753e1539a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9afb5f6-d6", "ovs_interfaceid": "f9afb5f6-d601-4106-85c8-6d6179433f28", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:35:40 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:35:40 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-bfeb7616-4e9f-43f9-9e09-6106330b9b99 req-adfbe99b-ef7a-46df-a530-d7c6f742e700 service nova] Releasing lock "refresh_cache-32b18558-8bf2-4def-bc70-81c4e38fcc6f" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 16:35:41 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:35:41 user nova-compute[71731]: INFO nova.virt.libvirt.driver [-] [instance: 32b18558-8bf2-4def-bc70-81c4e38fcc6f] Instance destroyed successfully.
Apr 13 16:35:41 user nova-compute[71731]: DEBUG nova.objects.instance [None req-66eac412-2f59-4f74-8599-c7b0132ea574 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Lazy-loading 'resources' on Instance uuid 32b18558-8bf2-4def-bc70-81c4e38fcc6f {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:35:41 user nova-compute[71731]: DEBUG nova.virt.libvirt.vif [None req-66eac412-2f59-4f74-8599-c7b0132ea574 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T16:28:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1668766448',display_name='tempest-TestStampPattern-server-1668766448',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-teststamppattern-server-1668766448',id=23,image_ref='708622a9-7465-4492-ade8-b827198f7e30',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL2QPQmeuQ3QMNshoDoMdPG3OSftqyMCUtV3Pr6v+/rhaN+olW1hWBQn7y9Ew+sQSET4+DncPzqCVC4fuapQVvR4RUPvk9/ysi6s66mNzl8HmL0L6OHOtrjR4F2tcMOgTw==',key_name='tempest-TestStampPattern-792944514',keypairs=<?>,launch_index=0,launched_at=2023-04-13T16:28:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bb7100b359f341759cb6f6753e1539a8',ramdisk_id='',reservation_id='r-081plqh3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='708622a9-7465-4492-ade8-b827198f7e30',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-96878995',owner_user_name='tempest-TestStampPattern-96878995-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T16:31:45Z,user_data=None,user_id='f523740272844b6eb236477d0b116ddb',uuid=32b18558-8bf2-4def-bc70-81c4e38fcc6f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f9afb5f6-d601-4106-85c8-6d6179433f28", "address": "fa:16:3e:72:0a:63", "network": {"id": "11386312-9ac6-4252-ab98-b3298a08599c", "bridge": "br-int", "label": "tempest-TestStampPattern-1747654565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.41", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb7100b359f341759cb6f6753e1539a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9afb5f6-d6", "ovs_interfaceid": "f9afb5f6-d601-4106-85c8-6d6179433f28", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 16:35:41 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-66eac412-2f59-4f74-8599-c7b0132ea574 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Converting VIF {"id": "f9afb5f6-d601-4106-85c8-6d6179433f28", "address": "fa:16:3e:72:0a:63", "network": {"id": "11386312-9ac6-4252-ab98-b3298a08599c", "bridge": "br-int", "label": "tempest-TestStampPattern-1747654565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.41", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb7100b359f341759cb6f6753e1539a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9afb5f6-d6", "ovs_interfaceid": "f9afb5f6-d601-4106-85c8-6d6179433f28", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 16:35:41 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-66eac412-2f59-4f74-8599-c7b0132ea574 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:72:0a:63,bridge_name='br-int',has_traffic_filtering=True,id=f9afb5f6-d601-4106-85c8-6d6179433f28,network=Network(11386312-9ac6-4252-ab98-b3298a08599c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9afb5f6-d6') {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 16:35:41 user nova-compute[71731]: DEBUG os_vif [None req-66eac412-2f59-4f74-8599-c7b0132ea574 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:72:0a:63,bridge_name='br-int',has_traffic_filtering=True,id=f9afb5f6-d601-4106-85c8-6d6179433f28,network=Network(11386312-9ac6-4252-ab98-b3298a08599c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9afb5f6-d6') {{(pid=71731) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 16:35:41 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:35:41 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf9afb5f6-d6, bridge=br-int, if_exists=True) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:35:41 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:35:41 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 16:35:41 user nova-compute[71731]: INFO os_vif [None req-66eac412-2f59-4f74-8599-c7b0132ea574 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:72:0a:63,bridge_name='br-int',has_traffic_filtering=True,id=f9afb5f6-d601-4106-85c8-6d6179433f28,network=Network(11386312-9ac6-4252-ab98-b3298a08599c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9afb5f6-d6')
Apr 13 16:35:41 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-66eac412-2f59-4f74-8599-c7b0132ea574 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] [instance: 32b18558-8bf2-4def-bc70-81c4e38fcc6f] Deleting instance files /opt/stack/data/nova/instances/32b18558-8bf2-4def-bc70-81c4e38fcc6f_del
Apr 13 16:35:41 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-66eac412-2f59-4f74-8599-c7b0132ea574 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] [instance: 32b18558-8bf2-4def-bc70-81c4e38fcc6f] Deletion of /opt/stack/data/nova/instances/32b18558-8bf2-4def-bc70-81c4e38fcc6f_del complete
Apr 13 16:35:41 user nova-compute[71731]: INFO nova.compute.manager [None req-66eac412-2f59-4f74-8599-c7b0132ea574 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] [instance: 32b18558-8bf2-4def-bc70-81c4e38fcc6f] Took 0.88 seconds to destroy the instance on the hypervisor.
Apr 13 16:35:41 user nova-compute[71731]: DEBUG oslo.service.loopingcall [None req-66eac412-2f59-4f74-8599-c7b0132ea574 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71731) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 16:35:41 user nova-compute[71731]: DEBUG nova.compute.manager [-] [instance: 32b18558-8bf2-4def-bc70-81c4e38fcc6f] Deallocating network for instance {{(pid=71731) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 16:35:41 user nova-compute[71731]: DEBUG nova.network.neutron [-] [instance: 32b18558-8bf2-4def-bc70-81c4e38fcc6f] deallocate_for_instance() {{(pid=71731) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 16:35:41 user nova-compute[71731]: DEBUG nova.network.neutron [-] [instance: 32b18558-8bf2-4def-bc70-81c4e38fcc6f] Updating instance_info_cache with network_info: [] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:35:41 user nova-compute[71731]: INFO nova.compute.manager [-] [instance: 32b18558-8bf2-4def-bc70-81c4e38fcc6f] Took 0.72 seconds to deallocate network for instance.
Apr 13 16:35:41 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:35:41 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-66eac412-2f59-4f74-8599-c7b0132ea574 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:35:41 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-66eac412-2f59-4f74-8599-c7b0132ea574 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:35:42 user nova-compute[71731]: DEBUG nova.compute.provider_tree [None req-66eac412-2f59-4f74-8599-c7b0132ea574 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Inventory has not changed in ProviderTree for provider: cb6b1a64-0c24-4e2d-af1e-16576ca9165c {{(pid=71731) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 16:35:42 user nova-compute[71731]: DEBUG nova.scheduler.client.report [None req-66eac412-2f59-4f74-8599-c7b0132ea574 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Inventory has not changed for provider cb6b1a64-0c24-4e2d-af1e-16576ca9165c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71731) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 16:35:42 user nova-compute[71731]: DEBUG nova.compute.manager [req-a3300096-557c-4dff-a995-3bc2ae820672 req-cc2f75b1-8e44-479a-bfbe-ae32f95017ed service nova] [instance: 32b18558-8bf2-4def-bc70-81c4e38fcc6f] Received event network-vif-unplugged-f9afb5f6-d601-4106-85c8-6d6179433f28 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:35:42 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-a3300096-557c-4dff-a995-3bc2ae820672 req-cc2f75b1-8e44-479a-bfbe-ae32f95017ed service nova] Acquiring lock "32b18558-8bf2-4def-bc70-81c4e38fcc6f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:35:42 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-a3300096-557c-4dff-a995-3bc2ae820672 req-cc2f75b1-8e44-479a-bfbe-ae32f95017ed service nova] Lock "32b18558-8bf2-4def-bc70-81c4e38fcc6f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:35:42 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-a3300096-557c-4dff-a995-3bc2ae820672 req-cc2f75b1-8e44-479a-bfbe-ae32f95017ed service nova] Lock "32b18558-8bf2-4def-bc70-81c4e38fcc6f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:35:42 user nova-compute[71731]: DEBUG nova.compute.manager [req-a3300096-557c-4dff-a995-3bc2ae820672 req-cc2f75b1-8e44-479a-bfbe-ae32f95017ed service nova] [instance: 32b18558-8bf2-4def-bc70-81c4e38fcc6f] No waiting events found dispatching network-vif-unplugged-f9afb5f6-d601-4106-85c8-6d6179433f28 {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:35:42 user nova-compute[71731]: WARNING nova.compute.manager [req-a3300096-557c-4dff-a995-3bc2ae820672 req-cc2f75b1-8e44-479a-bfbe-ae32f95017ed service nova] [instance: 32b18558-8bf2-4def-bc70-81c4e38fcc6f] Received unexpected event network-vif-unplugged-f9afb5f6-d601-4106-85c8-6d6179433f28 for instance with vm_state deleted and task_state None.
Apr 13 16:35:42 user nova-compute[71731]: DEBUG nova.compute.manager [req-a3300096-557c-4dff-a995-3bc2ae820672 req-cc2f75b1-8e44-479a-bfbe-ae32f95017ed service nova] [instance: 32b18558-8bf2-4def-bc70-81c4e38fcc6f] Received event network-vif-plugged-f9afb5f6-d601-4106-85c8-6d6179433f28 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:35:42 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-a3300096-557c-4dff-a995-3bc2ae820672 req-cc2f75b1-8e44-479a-bfbe-ae32f95017ed service nova] Acquiring lock "32b18558-8bf2-4def-bc70-81c4e38fcc6f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:35:42 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-a3300096-557c-4dff-a995-3bc2ae820672 req-cc2f75b1-8e44-479a-bfbe-ae32f95017ed service nova] Lock "32b18558-8bf2-4def-bc70-81c4e38fcc6f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:35:42 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-a3300096-557c-4dff-a995-3bc2ae820672 req-cc2f75b1-8e44-479a-bfbe-ae32f95017ed service nova] Lock "32b18558-8bf2-4def-bc70-81c4e38fcc6f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:35:42 user nova-compute[71731]: DEBUG nova.compute.manager [req-a3300096-557c-4dff-a995-3bc2ae820672 req-cc2f75b1-8e44-479a-bfbe-ae32f95017ed service nova] [instance: 32b18558-8bf2-4def-bc70-81c4e38fcc6f] No waiting events found dispatching network-vif-plugged-f9afb5f6-d601-4106-85c8-6d6179433f28 {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:35:42 user nova-compute[71731]: WARNING nova.compute.manager [req-a3300096-557c-4dff-a995-3bc2ae820672 req-cc2f75b1-8e44-479a-bfbe-ae32f95017ed service nova] [instance: 32b18558-8bf2-4def-bc70-81c4e38fcc6f] Received unexpected event network-vif-plugged-f9afb5f6-d601-4106-85c8-6d6179433f28 for instance with vm_state deleted and task_state None.
Apr 13 16:35:42 user nova-compute[71731]: DEBUG nova.compute.manager [req-a3300096-557c-4dff-a995-3bc2ae820672 req-cc2f75b1-8e44-479a-bfbe-ae32f95017ed service nova] [instance: 32b18558-8bf2-4def-bc70-81c4e38fcc6f] Received event network-vif-deleted-f9afb5f6-d601-4106-85c8-6d6179433f28 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:35:42 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-66eac412-2f59-4f74-8599-c7b0132ea574 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.373s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:35:42 user nova-compute[71731]: INFO nova.scheduler.client.report [None req-66eac412-2f59-4f74-8599-c7b0132ea574 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Deleted allocations for instance 32b18558-8bf2-4def-bc70-81c4e38fcc6f
Apr 13 16:35:42 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-66eac412-2f59-4f74-8599-c7b0132ea574 tempest-TestStampPattern-96878995 tempest-TestStampPattern-96878995-project-member] Lock "32b18558-8bf2-4def-bc70-81c4e38fcc6f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.171s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:35:43 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-302e84c8-6585-4731-b122-449d101fc624 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Acquiring lock "35b23303-e373-4f35-b7ee-76e6815073ce" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:35:43 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-302e84c8-6585-4731-b122-449d101fc624 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lock "35b23303-e373-4f35-b7ee-76e6815073ce" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.002s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:35:43 user nova-compute[71731]: INFO nova.compute.manager [None req-302e84c8-6585-4731-b122-449d101fc624 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] [instance: 35b23303-e373-4f35-b7ee-76e6815073ce] Unshelving
Apr 13 16:35:43 user nova-compute[71731]: INFO nova.virt.block_device [None req-302e84c8-6585-4731-b122-449d101fc624 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] [instance: 35b23303-e373-4f35-b7ee-76e6815073ce] Booting with volume 8156a054-43ea-4eeb-bbec-a270a6779a43 at /dev/vdc
Apr 13 16:35:43 user nova-compute[71731]: DEBUG os_brick.utils [None req-302e84c8-6585-4731-b122-449d101fc624 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 16:35:43 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:35:43 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:35:43 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[408f1f09-61b8-4044-a2d2-5b7cfd80df45]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:81501d91421\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:35:43 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:35:43 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:35:43 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[026c2b29-5f44-4bc5-839f-54281d616f7c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:35:43 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:35:43 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:35:43 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ccac93f-135c-4842-bcc5-b5c95cc21f75]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:35:44 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[a26f62da-cc88-4800-8c81-f75a47f0623b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:35:44 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-302e84c8-6585-4731-b122-449d101fc624 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Running cmd (subprocess): nvme version {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:35:44 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-302e84c8-6585-4731-b122-449d101fc624 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] 'nvme version' failed. Not Retrying. {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 16:35:44 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.nvmeof [None req-302e84c8-6585-4731-b122-449d101fc624 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] nvme not present on system {{(pid=71731) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 16:35:44 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:35:44 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 16:35:44 user nova-compute[71731]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 16:35:44 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[18034854-8a52-4cfc-b4dc-4b467c8b4e0c]: (4, '') {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:35:44 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.lightos [None req-302e84c8-6585-4731-b122-449d101fc624 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71731) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 16:35:44 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.lightos [None req-302e84c8-6585-4731-b122-449d101fc624 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71731) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 16:35:44 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.lightos [None req-302e84c8-6585-4731-b122-449d101fc624 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] LIGHTOS: no hostnqn found. {{(pid=71731) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 16:35:44 user nova-compute[71731]: DEBUG os_brick.utils [None req-302e84c8-6585-4731-b122-449d101fc624 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:81501d91421', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 16:35:44 user nova-compute[71731]: DEBUG nova.virt.block_device [None req-302e84c8-6585-4731-b122-449d101fc624 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] [instance: 35b23303-e373-4f35-b7ee-76e6815073ce] Updating existing volume attachment record: 09c0a73e-5188-4f32-b2f3-29ce0b340357 {{(pid=71731) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 16:35:44 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:35:46 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:35:46 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:35:46 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:35:48 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-302e84c8-6585-4731-b122-449d101fc624 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:35:48 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-302e84c8-6585-4731-b122-449d101fc624 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:35:48 user nova-compute[71731]: DEBUG nova.objects.instance [None req-302e84c8-6585-4731-b122-449d101fc624 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lazy-loading 'pci_requests' on Instance uuid 35b23303-e373-4f35-b7ee-76e6815073ce {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:35:48 user nova-compute[71731]: DEBUG nova.objects.instance [None req-302e84c8-6585-4731-b122-449d101fc624 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lazy-loading 'numa_topology' on Instance uuid 35b23303-e373-4f35-b7ee-76e6815073ce {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:35:48 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-302e84c8-6585-4731-b122-449d101fc624 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71731) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 16:35:48 user nova-compute[71731]: INFO nova.compute.claims [None req-302e84c8-6585-4731-b122-449d101fc624 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] [instance: 35b23303-e373-4f35-b7ee-76e6815073ce] Claim successful on node user
Apr 13 16:35:49 user nova-compute[71731]: DEBUG nova.compute.provider_tree [None req-302e84c8-6585-4731-b122-449d101fc624 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Inventory has not changed in ProviderTree for provider: cb6b1a64-0c24-4e2d-af1e-16576ca9165c {{(pid=71731) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 16:35:49 user nova-compute[71731]: DEBUG nova.scheduler.client.report [None req-302e84c8-6585-4731-b122-449d101fc624 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Inventory has not changed for provider cb6b1a64-0c24-4e2d-af1e-16576ca9165c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71731) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 16:35:49 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-302e84c8-6585-4731-b122-449d101fc624 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.513s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:35:49 user nova-compute[71731]: INFO nova.network.neutron [None req-302e84c8-6585-4731-b122-449d101fc624 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] [instance: 35b23303-e373-4f35-b7ee-76e6815073ce] Updating port d3c66e4e-b15d-4bc9-a838-265ca07a6a66 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Apr 13 16:35:49 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:35:49 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-302e84c8-6585-4731-b122-449d101fc624 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Acquiring lock "refresh_cache-35b23303-e373-4f35-b7ee-76e6815073ce" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 16:35:49 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-302e84c8-6585-4731-b122-449d101fc624 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Acquired lock "refresh_cache-35b23303-e373-4f35-b7ee-76e6815073ce" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 16:35:49 user nova-compute[71731]: DEBUG nova.network.neutron [None req-302e84c8-6585-4731-b122-449d101fc624 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] [instance: 35b23303-e373-4f35-b7ee-76e6815073ce] Building network info cache for instance {{(pid=71731) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 16:35:50 user nova-compute[71731]: DEBUG nova.compute.manager [req-802a95ff-b50a-45f7-93dd-607ed3d285a8 req-cd171474-33b7-4976-bfa6-9458a7b25656 service nova] [instance: 35b23303-e373-4f35-b7ee-76e6815073ce] Received event network-changed-d3c66e4e-b15d-4bc9-a838-265ca07a6a66 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:35:50 user nova-compute[71731]: DEBUG nova.compute.manager [req-802a95ff-b50a-45f7-93dd-607ed3d285a8 req-cd171474-33b7-4976-bfa6-9458a7b25656 service nova] [instance: 35b23303-e373-4f35-b7ee-76e6815073ce] Refreshing instance network info cache due to event network-changed-d3c66e4e-b15d-4bc9-a838-265ca07a6a66. {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 16:35:50 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-802a95ff-b50a-45f7-93dd-607ed3d285a8 req-cd171474-33b7-4976-bfa6-9458a7b25656 service nova] Acquiring lock "refresh_cache-35b23303-e373-4f35-b7ee-76e6815073ce" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 16:35:50 user nova-compute[71731]: DEBUG nova.network.neutron [None req-302e84c8-6585-4731-b122-449d101fc624 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] [instance: 35b23303-e373-4f35-b7ee-76e6815073ce] Updating instance_info_cache with network_info: [{"id": "d3c66e4e-b15d-4bc9-a838-265ca07a6a66", "address": "fa:16:3e:3a:4e:db", "network": {"id": "5acc9a78-1127-46df-bb60-7544cdd2c1ef", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2143082515-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0653ab16660b46cea9c5af58ea0b1931", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3c66e4e-b1", "ovs_interfaceid": "d3c66e4e-b15d-4bc9-a838-265ca07a6a66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:35:50 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-302e84c8-6585-4731-b122-449d101fc624 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Releasing lock "refresh_cache-35b23303-e373-4f35-b7ee-76e6815073ce" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 16:35:50 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-302e84c8-6585-4731-b122-449d101fc624 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] [instance: 35b23303-e373-4f35-b7ee-76e6815073ce] Creating instance directory {{(pid=71731) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 16:35:50 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-302e84c8-6585-4731-b122-449d101fc624 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] [instance: 35b23303-e373-4f35-b7ee-76e6815073ce] Creating image(s)
Apr 13 16:35:50 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-302e84c8-6585-4731-b122-449d101fc624 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Acquiring lock "/opt/stack/data/nova/instances/35b23303-e373-4f35-b7ee-76e6815073ce/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:35:50 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-302e84c8-6585-4731-b122-449d101fc624 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lock "/opt/stack/data/nova/instances/35b23303-e373-4f35-b7ee-76e6815073ce/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:35:50 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-302e84c8-6585-4731-b122-449d101fc624 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lock "/opt/stack/data/nova/instances/35b23303-e373-4f35-b7ee-76e6815073ce/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:35:50 user nova-compute[71731]: DEBUG nova.objects.instance [None req-302e84c8-6585-4731-b122-449d101fc624 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lazy-loading 'trusted_certs' on Instance uuid 35b23303-e373-4f35-b7ee-76e6815073ce {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:35:50 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-802a95ff-b50a-45f7-93dd-607ed3d285a8 req-cd171474-33b7-4976-bfa6-9458a7b25656 service nova] Acquired lock "refresh_cache-35b23303-e373-4f35-b7ee-76e6815073ce" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 16:35:50 user nova-compute[71731]: DEBUG nova.network.neutron [req-802a95ff-b50a-45f7-93dd-607ed3d285a8 req-cd171474-33b7-4976-bfa6-9458a7b25656 service nova] [instance: 35b23303-e373-4f35-b7ee-76e6815073ce] Refreshing network info cache for port d3c66e4e-b15d-4bc9-a838-265ca07a6a66 {{(pid=71731) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 16:35:50 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-302e84c8-6585-4731-b122-449d101fc624 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Acquiring lock "007d2cff596f02e935e64ffbdcdeed367c4897db" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:35:50 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-302e84c8-6585-4731-b122-449d101fc624 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lock "007d2cff596f02e935e64ffbdcdeed367c4897db" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:35:51 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-302e84c8-6585-4731-b122-449d101fc624 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/007d2cff596f02e935e64ffbdcdeed367c4897db.part --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:35:51 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:35:51 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-302e84c8-6585-4731-b122-449d101fc624 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/007d2cff596f02e935e64ffbdcdeed367c4897db.part --force-share --output=json" returned: 0 in 0.143s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:35:51 user nova-compute[71731]: DEBUG nova.virt.images [None req-302e84c8-6585-4731-b122-449d101fc624 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] c2b93ad7-8a91-45b2-bd03-9510a5858375 was qcow2, converting to raw {{(pid=71731) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 13 16:35:51 user nova-compute[71731]: DEBUG nova.privsep.utils [None req-302e84c8-6585-4731-b122-449d101fc624 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71731) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 13 16:35:51 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-302e84c8-6585-4731-b122-449d101fc624 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/007d2cff596f02e935e64ffbdcdeed367c4897db.part /opt/stack/data/nova/instances/_base/007d2cff596f02e935e64ffbdcdeed367c4897db.converted {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:35:51 user nova-compute[71731]: DEBUG nova.network.neutron [req-802a95ff-b50a-45f7-93dd-607ed3d285a8 req-cd171474-33b7-4976-bfa6-9458a7b25656 service nova] [instance: 35b23303-e373-4f35-b7ee-76e6815073ce] Updated VIF entry in instance network info cache for port d3c66e4e-b15d-4bc9-a838-265ca07a6a66. {{(pid=71731) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 16:35:51 user nova-compute[71731]: DEBUG nova.network.neutron [req-802a95ff-b50a-45f7-93dd-607ed3d285a8 req-cd171474-33b7-4976-bfa6-9458a7b25656 service nova] [instance: 35b23303-e373-4f35-b7ee-76e6815073ce] Updating instance_info_cache with network_info: [{"id": "d3c66e4e-b15d-4bc9-a838-265ca07a6a66", "address": "fa:16:3e:3a:4e:db", "network": {"id": "5acc9a78-1127-46df-bb60-7544cdd2c1ef", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2143082515-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0653ab16660b46cea9c5af58ea0b1931", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3c66e4e-b1", "ovs_interfaceid": "d3c66e4e-b15d-4bc9-a838-265ca07a6a66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:35:51 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:35:51 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-802a95ff-b50a-45f7-93dd-607ed3d285a8 req-cd171474-33b7-4976-bfa6-9458a7b25656 service nova] Releasing lock "refresh_cache-35b23303-e373-4f35-b7ee-76e6815073ce" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 16:35:52 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-302e84c8-6585-4731-b122-449d101fc624 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/007d2cff596f02e935e64ffbdcdeed367c4897db.part /opt/stack/data/nova/instances/_base/007d2cff596f02e935e64ffbdcdeed367c4897db.converted" returned: 0 in 0.588s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:35:52 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-302e84c8-6585-4731-b122-449d101fc624 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/007d2cff596f02e935e64ffbdcdeed367c4897db.converted --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:35:52 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-302e84c8-6585-4731-b122-449d101fc624 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/007d2cff596f02e935e64ffbdcdeed367c4897db.converted --force-share --output=json" returned: 0 in 0.129s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:35:52 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-302e84c8-6585-4731-b122-449d101fc624 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lock "007d2cff596f02e935e64ffbdcdeed367c4897db" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.709s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:35:52 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-302e84c8-6585-4731-b122-449d101fc624 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/007d2cff596f02e935e64ffbdcdeed367c4897db --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:35:52 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-302e84c8-6585-4731-b122-449d101fc624 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/007d2cff596f02e935e64ffbdcdeed367c4897db --force-share --output=json" returned: 0 in 0.129s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:35:52 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-302e84c8-6585-4731-b122-449d101fc624 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Acquiring lock "007d2cff596f02e935e64ffbdcdeed367c4897db" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:35:52 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-302e84c8-6585-4731-b122-449d101fc624 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lock "007d2cff596f02e935e64ffbdcdeed367c4897db" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:35:52 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-302e84c8-6585-4731-b122-449d101fc624 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/007d2cff596f02e935e64ffbdcdeed367c4897db --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:35:52 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-302e84c8-6585-4731-b122-449d101fc624 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/007d2cff596f02e935e64ffbdcdeed367c4897db --force-share --output=json" returned: 0 in 0.150s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:35:52 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-302e84c8-6585-4731-b122-449d101fc624 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/007d2cff596f02e935e64ffbdcdeed367c4897db,backing_fmt=raw /opt/stack/data/nova/instances/35b23303-e373-4f35-b7ee-76e6815073ce/disk 1073741824 {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:35:52 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-302e84c8-6585-4731-b122-449d101fc624 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/007d2cff596f02e935e64ffbdcdeed367c4897db,backing_fmt=raw /opt/stack/data/nova/instances/35b23303-e373-4f35-b7ee-76e6815073ce/disk 1073741824" returned: 0 in 0.079s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:35:52 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-302e84c8-6585-4731-b122-449d101fc624 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lock "007d2cff596f02e935e64ffbdcdeed367c4897db" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.238s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:35:52 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-302e84c8-6585-4731-b122-449d101fc624 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/007d2cff596f02e935e64ffbdcdeed367c4897db --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:35:52 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-302e84c8-6585-4731-b122-449d101fc624 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/007d2cff596f02e935e64ffbdcdeed367c4897db --force-share --output=json" returned: 0 in 0.140s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:35:52 user nova-compute[71731]: DEBUG nova.objects.instance [None req-302e84c8-6585-4731-b122-449d101fc624 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lazy-loading 'migration_context' on Instance uuid 35b23303-e373-4f35-b7ee-76e6815073ce {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:35:52 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-302e84c8-6585-4731-b122-449d101fc624 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] [instance: 35b23303-e373-4f35-b7ee-76e6815073ce] Rebasing disk image.
Apr 13 16:35:52 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-302e84c8-6585-4731-b122-449d101fc624 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279 --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:35:52 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-302e84c8-6585-4731-b122-449d101fc624 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279 --force-share --output=json" returned: 0 in 0.139s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:35:52 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-302e84c8-6585-4731-b122-449d101fc624 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279 -F raw /opt/stack/data/nova/instances/35b23303-e373-4f35-b7ee-76e6815073ce/disk {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:35:55 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-302e84c8-6585-4731-b122-449d101fc624 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279 -F raw /opt/stack/data/nova/instances/35b23303-e373-4f35-b7ee-76e6815073ce/disk" returned: 0 in 2.210s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:35:55 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-302e84c8-6585-4731-b122-449d101fc624 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] [instance: 35b23303-e373-4f35-b7ee-76e6815073ce] Created local disks {{(pid=71731) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 16:35:55 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-302e84c8-6585-4731-b122-449d101fc624 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] [instance: 35b23303-e373-4f35-b7ee-76e6815073ce] Ensure instance console log exists: /opt/stack/data/nova/instances/35b23303-e373-4f35-b7ee-76e6815073ce/console.log {{(pid=71731) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 16:35:55 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-302e84c8-6585-4731-b122-449d101fc624 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:35:55 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-302e84c8-6585-4731-b122-449d101fc624 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:35:55 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-302e84c8-6585-4731-b122-449d101fc624 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:35:55 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-302e84c8-6585-4731-b122-449d101fc624 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] [instance: 35b23303-e373-4f35-b7ee-76e6815073ce] Start _get_guest_xml network_info=[{"id": "d3c66e4e-b15d-4bc9-a838-265ca07a6a66", "address": "fa:16:3e:3a:4e:db", "network": {"id": "5acc9a78-1127-46df-bb60-7544cdd2c1ef", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2143082515-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0653ab16660b46cea9c5af58ea0b1931", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3c66e4e-b1", "ovs_interfaceid": "d3c66e4e-b15d-4bc9-a838-265ca07a6a66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='26dc93c93f9192d35a356dd067f7894b',container_format='bare',created_at=2023-04-13T16:33:51Z,direct_url=<?>,disk_format='qcow2',id=c2b93ad7-8a91-45b2-bd03-9510a5858375,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1250036054-shelved',owner='0653ab16660b46cea9c5af58ea0b1931',properties=ImageMetaProps,protected=<?>,size=38600704,status='active',tags=<?>,updated_at=2023-04-13T16:33:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'device_type': 'disk', 'encrypted': False, 'disk_bus': 'virtio', 'guest_format': None, 'encryption_options': None, 'image_id': '708622a9-7465-4492-ade8-b827198f7e30'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'attachment_id': '09c0a73e-5188-4f32-b2f3-29ce0b340357', 'mount_device': '/dev/vdc', 'delete_on_termination': False, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:8156a054-43ea-4eeb-bbec-a270a6779a43', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fXgTqGKO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': '35b23303-e373-4f35-b7ee-76e6815073ce', 'attached_at': '', 'detached_at': '', 'volume_id': '8156a054-43ea-4eeb-bbec-a270a6779a43', 'serial': '8156a054-43ea-4eeb-bbec-a270a6779a43'}, 'disk_bus': 'virtio', 'guest_format': None, 'volume_type': None} {{(pid=71731) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 16:35:55 user nova-compute[71731]: WARNING nova.virt.libvirt.driver [None req-302e84c8-6585-4731-b122-449d101fc624 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 16:35:55 user nova-compute[71731]: WARNING nova.virt.libvirt.driver [None req-302e84c8-6585-4731-b122-449d101fc624 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 16:35:55 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-302e84c8-6585-4731-b122-449d101fc624 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71731) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 16:35:55 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-302e84c8-6585-4731-b122-449d101fc624 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T16:17:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='26dc93c93f9192d35a356dd067f7894b',container_format='bare',created_at=2023-04-13T16:33:51Z,direct_url=<?>,disk_format='qcow2',id=c2b93ad7-8a91-45b2-bd03-9510a5858375,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1250036054-shelved',owner='0653ab16660b46cea9c5af58ea0b1931',properties=ImageMetaProps,protected=<?>,size=38600704,status='active',tags=<?>,updated_at=2023-04-13T16:33:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 16:35:55 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-302e84c8-6585-4731-b122-449d101fc624 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Flavor limits 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 16:35:55 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-302e84c8-6585-4731-b122-449d101fc624 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Image limits 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 16:35:55 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-302e84c8-6585-4731-b122-449d101fc624 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Flavor pref 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 16:35:55 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-302e84c8-6585-4731-b122-449d101fc624 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Image pref 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 16:35:55 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-302e84c8-6585-4731-b122-449d101fc624 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 16:35:55 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-302e84c8-6585-4731-b122-449d101fc624 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 16:35:55 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-302e84c8-6585-4731-b122-449d101fc624 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71731) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 16:35:55 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-302e84c8-6585-4731-b122-449d101fc624 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Got 1 possible topologies {{(pid=71731) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 16:35:55 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-302e84c8-6585-4731-b122-449d101fc624 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 16:35:55 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-302e84c8-6585-4731-b122-449d101fc624 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 16:35:55 user nova-compute[71731]: DEBUG nova.objects.instance [None req-302e84c8-6585-4731-b122-449d101fc624 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lazy-loading 'vcpu_model' on Instance uuid 35b23303-e373-4f35-b7ee-76e6815073ce {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:35:55 user nova-compute[71731]: DEBUG nova.virt.libvirt.volume.iscsi [None req-302e84c8-6585-4731-b122-449d101fc624 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] [instance: 35b23303-e373-4f35-b7ee-76e6815073ce] Calling os-brick to attach iSCSI Volume {{(pid=71731) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 16:35:55 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-302e84c8-6585-4731-b122-449d101fc624 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8cf0118790>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8156a054-43ea-4eeb-bbec-a270a6779a43', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fXgTqGKO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 16:35:55 user nova-compute[71731]: WARNING os_brick.initiator.connectors.base [None req-302e84c8-6585-4731-b122-449d101fc624 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 16:35:55 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-302e84c8-6585-4731-b122-449d101fc624 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 16:35:55 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-302e84c8-6585-4731-b122-449d101fc624 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 16:35:55 user nova-compute[71731]: WARNING os_brick.initiator.connectors.base [None req-302e84c8-6585-4731-b122-449d101fc624 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 16:35:55 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-302e84c8-6585-4731-b122-449d101fc624 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8156a054-43ea-4eeb-bbec-a270a6779a43" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 16:35:55 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-302e84c8-6585-4731-b122-449d101fc624 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8156a054-43ea-4eeb-bbec-a270a6779a43" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 16:35:55 user nova-compute[71731]: INFO os_brick.initiator.connectors.iscsi [None req-302e84c8-6585-4731-b122-449d101fc624 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 16:35:55 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8156a054-43ea-4eeb-bbec-a270a6779a43 -p 172.16.0.220:3260 {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:35:55 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8156a054-43ea-4eeb-bbec-a270a6779a43 -p 172.16.0.220:3260" returned: 21 in 0.047s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:35:55 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[934d7409-29e8-472a-b699-e872007a49cc]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:35:55 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-302e84c8-6585-4731-b122-449d101fc624 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 16:35:55 user nova-compute[71731]:  {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:35:55 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8156a054-43ea-4eeb-bbec-a270a6779a43 -p 172.16.0.220:3260 --interface default --op new {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:35:55 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8156a054-43ea-4eeb-bbec-a270a6779a43 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:35:55 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[06edced8-fd2b-45e9-a7d2-e2cdcf25b0ff]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8156a054-43ea-4eeb-bbec-a270a6779a43] added\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:35:55 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-302e84c8-6585-4731-b122-449d101fc624 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8156a054-43ea-4eeb-bbec-a270a6779a43] added
Apr 13 16:35:55 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:35:55 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8156a054-43ea-4eeb-bbec-a270a6779a43 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:35:55 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8156a054-43ea-4eeb-bbec-a270a6779a43 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:35:55 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa9a3ab9-a4fc-4360-b029-493b83c18ade]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:35:55 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-302e84c8-6585-4731-b122-449d101fc624 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:35:55 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8156a054-43ea-4eeb-bbec-a270a6779a43 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:35:55 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8156a054-43ea-4eeb-bbec-a270a6779a43 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:35:55 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[48d285ef-e04b-4e7f-8647-23a17506ba67]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:35:55 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-302e84c8-6585-4731-b122-449d101fc624 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:35:55 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8156a054-43ea-4eeb-bbec-a270a6779a43 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fXgTqGKO {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:35:55 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8156a054-43ea-4eeb-bbec-a270a6779a43 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fXgTqGKO" returned: 0 in 0.019s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:35:55 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[15b4c4dd-e07c-403f-b373-209254f6a9b1]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:35:55 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-302e84c8-6585-4731-b122-449d101fc624 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fXgTqGKO'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:35:55 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8156a054-43ea-4eeb-bbec-a270a6779a43 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:35:55 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8156a054-43ea-4eeb-bbec-a270a6779a43 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:35:55 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[00a6d372-8796-48ad-b8c0-e6843fec6e13]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:35:55 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-302e84c8-6585-4731-b122-449d101fc624 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:35:55 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:35:55 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:35:55 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1a93a62-97ee-4b55-bb0d-68b82a91e0e8]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25c3dc97-c9cb-4529-ab32-26ef7fd94fc6 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2088266-1d33-4bb1-ac5b-1de832ff7985 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:651ea766-ffda-42a1-9b3c-7be05a92c85f (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4a5ced3-77ae-4bf5-8154-bd1645e470f2 (non-flash)\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:35:55 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-302e84c8-6585-4731-b122-449d101fc624 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)
Apr 13 16:35:55 user nova-compute[71731]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25c3dc97-c9cb-4529-ab32-26ef7fd94fc6 (non-flash)
Apr 13 16:35:55 user nova-compute[71731]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2088266-1d33-4bb1-ac5b-1de832ff7985 (non-flash)
Apr 13 16:35:55 user nova-compute[71731]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:651ea766-ffda-42a1-9b3c-7be05a92c85f (non-flash)
Apr 13 16:35:55 user nova-compute[71731]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4a5ced3-77ae-4bf5-8154-bd1645e470f2 (non-flash)
Apr 13 16:35:55 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 16:35:55 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-302e84c8-6585-4731-b122-449d101fc624 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)
Apr 13 16:35:55 user nova-compute[71731]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25c3dc97-c9cb-4529-ab32-26ef7fd94fc6 (non-flash)
Apr 13 16:35:55 user nova-compute[71731]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2088266-1d33-4bb1-ac5b-1de832ff7985 (non-flash)
Apr 13 16:35:55 user nova-compute[71731]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:651ea766-ffda-42a1-9b3c-7be05a92c85f (non-flash)
Apr 13 16:35:55 user nova-compute[71731]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4a5ced3-77ae-4bf5-8154-bd1645e470f2 (non-flash)
Apr 13 16:35:55 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 16:35:55 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8156a054-43ea-4eeb-bbec-a270a6779a43 -p 172.16.0.220:3260 --login {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:35:55 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8156a054-43ea-4eeb-bbec-a270a6779a43 -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:35:55 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[47e41a03-401b-4053-a58e-86ac46016825]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8156a054-43ea-4eeb-bbec-a270a6779a43, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8156a054-43ea-4eeb-bbec-a270a6779a43, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:35:55 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-302e84c8-6585-4731-b122-449d101fc624 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8156a054-43ea-4eeb-bbec-a270a6779a43, portal: 172.16.0.220,3260]
Apr 13 16:35:55 user nova-compute[71731]: Login to [iface: default, target: iqn.2010-10.org.openstack:8156a054-43ea-4eeb-bbec-a270a6779a43, portal: 172.16.0.220,3260] successful.
Apr 13 16:35:55 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:35:55 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8156a054-43ea-4eeb-bbec-a270a6779a43 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:35:55 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8156a054-43ea-4eeb-bbec-a270a6779a43 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:35:55 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[f94df6b4-4719-4e13-94f4-f6c92e555a26]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:35:55 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-302e84c8-6585-4731-b122-449d101fc624 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:35:55 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:35:55 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:35:55 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1a5bd09-a2d7-49d1-874e-65f65da9f4c0]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25c3dc97-c9cb-4529-ab32-26ef7fd94fc6 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2088266-1d33-4bb1-ac5b-1de832ff7985 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:651ea766-ffda-42a1-9b3c-7be05a92c85f (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4a5ced3-77ae-4bf5-8154-bd1645e470f2 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8156a054-43ea-4eeb-bbec-a270a6779a43 (non-flash)\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:35:55 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-302e84c8-6585-4731-b122-449d101fc624 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)
Apr 13 16:35:55 user nova-compute[71731]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25c3dc97-c9cb-4529-ab32-26ef7fd94fc6 (non-flash)
Apr 13 16:35:55 user nova-compute[71731]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2088266-1d33-4bb1-ac5b-1de832ff7985 (non-flash)
Apr 13 16:35:55 user nova-compute[71731]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:651ea766-ffda-42a1-9b3c-7be05a92c85f (non-flash)
Apr 13 16:35:55 user nova-compute[71731]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4a5ced3-77ae-4bf5-8154-bd1645e470f2 (non-flash)
Apr 13 16:35:55 user nova-compute[71731]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8156a054-43ea-4eeb-bbec-a270a6779a43 (non-flash)
Apr 13 16:35:55 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 16:35:55 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-302e84c8-6585-4731-b122-449d101fc624 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)
Apr 13 16:35:55 user nova-compute[71731]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25c3dc97-c9cb-4529-ab32-26ef7fd94fc6 (non-flash)
Apr 13 16:35:55 user nova-compute[71731]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2088266-1d33-4bb1-ac5b-1de832ff7985 (non-flash)
Apr 13 16:35:55 user nova-compute[71731]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:651ea766-ffda-42a1-9b3c-7be05a92c85f (non-flash)
Apr 13 16:35:55 user nova-compute[71731]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4a5ced3-77ae-4bf5-8154-bd1645e470f2 (non-flash)
Apr 13 16:35:55 user nova-compute[71731]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8156a054-43ea-4eeb-bbec-a270a6779a43 (non-flash)
Apr 13 16:35:55 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 16:35:55 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-302e84c8-6585-4731-b122-449d101fc624 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8156a054-43ea-4eeb-bbec-a270a6779a43" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.335s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 16:35:55 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-302e84c8-6585-4731-b122-449d101fc624 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Connected to 172.16.0.220:3260 {{(pid=71731) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 16:35:55 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-302e84c8-6585-4731-b122-449d101fc624 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] HCTL ('38', '-', '-', 0) found on session 41 with lun 0 {{(pid=71731) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 16:35:55 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-302e84c8-6585-4731-b122-449d101fc624 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=71731) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 16:35:55 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:35:55 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.017s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:35:55 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ee8b7b1-ed91-4d33-b0df-3357bbc74b7f]: (4, ('- - 0', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:35:55 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-302e84c8-6585-4731-b122-449d101fc624 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Searching for a device in session 41 and hctl ['38', '*', '*', 0] yield: None {{(pid=71731) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 16:35:56 user nova-compute[71731]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681403741.0158734, 32b18558-8bf2-4def-bc70-81c4e38fcc6f => Stopped> {{(pid=71731) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 16:35:56 user nova-compute[71731]: INFO nova.compute.manager [-] [instance: 32b18558-8bf2-4def-bc70-81c4e38fcc6f] VM Stopped (Lifecycle Event)
Apr 13 16:35:56 user nova-compute[71731]: DEBUG nova.compute.manager [None req-8f0a9b20-80ac-4765-9271-0a9fe69686d8 None None] [instance: 32b18558-8bf2-4def-bc70-81c4e38fcc6f] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:35:56 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:35:56 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-302e84c8-6585-4731-b122-449d101fc624 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Searching for a device in session 41 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=71731) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 16:35:56 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-302e84c8-6585-4731-b122-449d101fc624 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:8156a054-43ea-4eeb-bbec-a270a6779a43', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fXgTqGKO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71731) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 16:35:56 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-302e84c8-6585-4731-b122-449d101fc624 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.366s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 16:35:56 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-302e84c8-6585-4731-b122-449d101fc624 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] <== connect_volume: return (1367ms) {'type': 'block', 'scsi_wwn': '26436333038313334', 'path': '/dev/sdg'} {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 16:35:56 user nova-compute[71731]: DEBUG nova.virt.libvirt.volume.iscsi [None req-302e84c8-6585-4731-b122-449d101fc624 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] [instance: 35b23303-e373-4f35-b7ee-76e6815073ce] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26436333038313334', 'path': '/dev/sdg'} {{(pid=71731) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 16:35:56 user nova-compute[71731]: DEBUG nova.virt.libvirt.vif [None req-302e84c8-6585-4731-b122-449d101fc624 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-13T16:31:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1250036054',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1250036054',id=29,image_ref='c2b93ad7-8a91-45b2-bd03-9510a5858375',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-keypair-179744772',keypairs=<?>,launch_index=0,launched_at=2023-04-13T16:32:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='0653ab16660b46cea9c5af58ea0b1931',ramdisk_id='',reservation_id='r-h5vfm9ar',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='708622a9-7465-4492-ade8-b827198f7e30',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1310775310',owner_user_name='tempest-AttachVolumeShelveTestJSON-1310775310-project-member',shelved_at='2023-04-13T16:33:54.480330',shelved_host='user',shelved_image_id='c2b93ad7-8a91-45b2-bd03-9510a5858375'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T16:35:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='48b4e972cd1049509fa899449961ab59',uuid=35b23303-e373-4f35-b7ee-76e6815073ce,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "d3c66e4e-b15d-4bc9-a838-265ca07a6a66", "address": "fa:16:3e:3a:4e:db", "network": {"id": "5acc9a78-1127-46df-bb60-7544cdd2c1ef", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2143082515-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0653ab16660b46cea9c5af58ea0b1931", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3c66e4e-b1", "ovs_interfaceid": "d3c66e4e-b15d-4bc9-a838-265ca07a6a66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71731) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 16:35:56 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-302e84c8-6585-4731-b122-449d101fc624 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Converting VIF {"id": "d3c66e4e-b15d-4bc9-a838-265ca07a6a66", "address": "fa:16:3e:3a:4e:db", "network": {"id": "5acc9a78-1127-46df-bb60-7544cdd2c1ef", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2143082515-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0653ab16660b46cea9c5af58ea0b1931", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3c66e4e-b1", "ovs_interfaceid": "d3c66e4e-b15d-4bc9-a838-265ca07a6a66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 16:35:56 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-302e84c8-6585-4731-b122-449d101fc624 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3a:4e:db,bridge_name='br-int',has_traffic_filtering=True,id=d3c66e4e-b15d-4bc9-a838-265ca07a6a66,network=Network(5acc9a78-1127-46df-bb60-7544cdd2c1ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3c66e4e-b1') {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 16:35:56 user nova-compute[71731]: DEBUG nova.objects.instance [None req-302e84c8-6585-4731-b122-449d101fc624 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lazy-loading 'pci_devices' on Instance uuid 35b23303-e373-4f35-b7ee-76e6815073ce {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:35:56 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-302e84c8-6585-4731-b122-449d101fc624 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] [instance: 35b23303-e373-4f35-b7ee-76e6815073ce] End _get_guest_xml xml=<domain type="kvm">
Apr 13 16:35:56 user nova-compute[71731]:   <uuid>35b23303-e373-4f35-b7ee-76e6815073ce</uuid>
Apr 13 16:35:56 user nova-compute[71731]:   <name>instance-0000001d</name>
Apr 13 16:35:56 user nova-compute[71731]:   <memory>131072</memory>
Apr 13 16:35:56 user nova-compute[71731]:   <vcpu>1</vcpu>
Apr 13 16:35:56 user nova-compute[71731]:   <metadata>
Apr 13 16:35:56 user nova-compute[71731]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 16:35:56 user nova-compute[71731]:       <nova:package version="0.0.0"/>
Apr 13 16:35:56 user nova-compute[71731]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1250036054</nova:name>
Apr 13 16:35:56 user nova-compute[71731]:       <nova:creationTime>2023-04-13 16:35:55</nova:creationTime>
Apr 13 16:35:56 user nova-compute[71731]:       <nova:flavor name="m1.nano">
Apr 13 16:35:56 user nova-compute[71731]:         <nova:memory>128</nova:memory>
Apr 13 16:35:56 user nova-compute[71731]:         <nova:disk>1</nova:disk>
Apr 13 16:35:56 user nova-compute[71731]:         <nova:swap>0</nova:swap>
Apr 13 16:35:56 user nova-compute[71731]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 16:35:56 user nova-compute[71731]:         <nova:vcpus>1</nova:vcpus>
Apr 13 16:35:56 user nova-compute[71731]:       </nova:flavor>
Apr 13 16:35:56 user nova-compute[71731]:       <nova:owner>
Apr 13 16:35:56 user nova-compute[71731]:         <nova:user uuid="48b4e972cd1049509fa899449961ab59">tempest-AttachVolumeShelveTestJSON-1310775310-project-member</nova:user>
Apr 13 16:35:56 user nova-compute[71731]:         <nova:project uuid="0653ab16660b46cea9c5af58ea0b1931">tempest-AttachVolumeShelveTestJSON-1310775310</nova:project>
Apr 13 16:35:56 user nova-compute[71731]:       </nova:owner>
Apr 13 16:35:56 user nova-compute[71731]:       <nova:root type="image" uuid="c2b93ad7-8a91-45b2-bd03-9510a5858375"/>
Apr 13 16:35:56 user nova-compute[71731]:       <nova:ports>
Apr 13 16:35:56 user nova-compute[71731]:         <nova:port uuid="d3c66e4e-b15d-4bc9-a838-265ca07a6a66">
Apr 13 16:35:56 user nova-compute[71731]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Apr 13 16:35:56 user nova-compute[71731]:         </nova:port>
Apr 13 16:35:56 user nova-compute[71731]:       </nova:ports>
Apr 13 16:35:56 user nova-compute[71731]:     </nova:instance>
Apr 13 16:35:56 user nova-compute[71731]:   </metadata>
Apr 13 16:35:56 user nova-compute[71731]:   <sysinfo type="smbios">
Apr 13 16:35:56 user nova-compute[71731]:     <system>
Apr 13 16:35:56 user nova-compute[71731]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 16:35:56 user nova-compute[71731]:       <entry name="product">OpenStack Nova</entry>
Apr 13 16:35:56 user nova-compute[71731]:       <entry name="version">0.0.0</entry>
Apr 13 16:35:56 user nova-compute[71731]:       <entry name="serial">35b23303-e373-4f35-b7ee-76e6815073ce</entry>
Apr 13 16:35:56 user nova-compute[71731]:       <entry name="uuid">35b23303-e373-4f35-b7ee-76e6815073ce</entry>
Apr 13 16:35:56 user nova-compute[71731]:       <entry name="family">Virtual Machine</entry>
Apr 13 16:35:56 user nova-compute[71731]:     </system>
Apr 13 16:35:56 user nova-compute[71731]:   </sysinfo>
Apr 13 16:35:56 user nova-compute[71731]:   <os>
Apr 13 16:35:56 user nova-compute[71731]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 16:35:56 user nova-compute[71731]:     <boot dev="hd"/>
Apr 13 16:35:56 user nova-compute[71731]:     <smbios mode="sysinfo"/>
Apr 13 16:35:56 user nova-compute[71731]:   </os>
Apr 13 16:35:56 user nova-compute[71731]:   <features>
Apr 13 16:35:56 user nova-compute[71731]:     <acpi/>
Apr 13 16:35:56 user nova-compute[71731]:     <apic/>
Apr 13 16:35:56 user nova-compute[71731]:     <vmcoreinfo/>
Apr 13 16:35:56 user nova-compute[71731]:   </features>
Apr 13 16:35:56 user nova-compute[71731]:   <clock offset="utc">
Apr 13 16:35:56 user nova-compute[71731]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 16:35:56 user nova-compute[71731]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 16:35:56 user nova-compute[71731]:     <timer name="hpet" present="no"/>
Apr 13 16:35:56 user nova-compute[71731]:   </clock>
Apr 13 16:35:56 user nova-compute[71731]:   <cpu mode="custom" match="exact">
Apr 13 16:35:56 user nova-compute[71731]:     <model>Nehalem</model>
Apr 13 16:35:56 user nova-compute[71731]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 16:35:56 user nova-compute[71731]:   </cpu>
Apr 13 16:35:56 user nova-compute[71731]:   <devices>
Apr 13 16:35:56 user nova-compute[71731]:     <disk type="file" device="disk">
Apr 13 16:35:56 user nova-compute[71731]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 16:35:56 user nova-compute[71731]:       <source file="/opt/stack/data/nova/instances/35b23303-e373-4f35-b7ee-76e6815073ce/disk"/>
Apr 13 16:35:56 user nova-compute[71731]:       <target dev="vda" bus="virtio"/>
Apr 13 16:35:56 user nova-compute[71731]:     </disk>
Apr 13 16:35:56 user nova-compute[71731]:     <disk type="block" device="disk">
Apr 13 16:35:56 user nova-compute[71731]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 16:35:56 user nova-compute[71731]:       <source dev="/dev/sdg"/>
Apr 13 16:35:56 user nova-compute[71731]:       <target dev="vdc" bus="virtio"/>
Apr 13 16:35:56 user nova-compute[71731]:       <serial>8156a054-43ea-4eeb-bbec-a270a6779a43</serial>
Apr 13 16:35:56 user nova-compute[71731]:     </disk>
Apr 13 16:35:56 user nova-compute[71731]:     <interface type="ethernet">
Apr 13 16:35:56 user nova-compute[71731]:       <mac address="fa:16:3e:3a:4e:db"/>
Apr 13 16:35:56 user nova-compute[71731]:       <model type="virtio"/>
Apr 13 16:35:56 user nova-compute[71731]:       <mtu size="1442"/>
Apr 13 16:35:56 user nova-compute[71731]:       <target dev="tapd3c66e4e-b1"/>
Apr 13 16:35:56 user nova-compute[71731]:     </interface>
Apr 13 16:35:56 user nova-compute[71731]:     <serial type="pty">
Apr 13 16:35:56 user nova-compute[71731]:       <log file="/opt/stack/data/nova/instances/35b23303-e373-4f35-b7ee-76e6815073ce/console.log" append="off"/>
Apr 13 16:35:56 user nova-compute[71731]:     </serial>
Apr 13 16:35:56 user nova-compute[71731]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 16:35:56 user nova-compute[71731]:     <video>
Apr 13 16:35:56 user nova-compute[71731]:       <model type="virtio"/>
Apr 13 16:35:56 user nova-compute[71731]:     </video>
Apr 13 16:35:56 user nova-compute[71731]:     <rng model="virtio">
Apr 13 16:35:56 user nova-compute[71731]:       <backend model="random">/dev/urandom</backend>
Apr 13 16:35:56 user nova-compute[71731]:     </rng>
Apr 13 16:35:56 user nova-compute[71731]:     <controller type="usb" index="0" model="none"/>
Apr 13 16:35:56 user nova-compute[71731]:     <memballoon model="virtio">
Apr 13 16:35:56 user nova-compute[71731]:       <stats period="10"/>
Apr 13 16:35:56 user nova-compute[71731]:     </memballoon>
Apr 13 16:35:56 user nova-compute[71731]:   </devices>
Apr 13 16:35:56 user nova-compute[71731]: </domain>
Apr 13 16:35:56 user nova-compute[71731]:  {{(pid=71731) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 16:35:56 user nova-compute[71731]: DEBUG nova.virt.libvirt.vif [None req-302e84c8-6585-4731-b122-449d101fc624 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-13T16:31:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1250036054',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1250036054',id=29,image_ref='c2b93ad7-8a91-45b2-bd03-9510a5858375',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-keypair-179744772',keypairs=<?>,launch_index=0,launched_at=2023-04-13T16:32:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='0653ab16660b46cea9c5af58ea0b1931',ramdisk_id='',reservation_id='r-h5vfm9ar',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='708622a9-7465-4492-ade8-b827198f7e30',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1310775310',owner_user_name='tempest-AttachVolumeShelveTestJSON-1310775310-project-member',shelved_at='2023-04-13T16:33:54.480330',shelved_host='user',shelved_image_id='c2b93ad7-8a91-45b2-bd03-9510a5858375'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T16:35:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='48b4e972cd1049509fa899449961ab59',uuid=35b23303-e373-4f35-b7ee-76e6815073ce,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "d3c66e4e-b15d-4bc9-a838-265ca07a6a66", "address": "fa:16:3e:3a:4e:db", "network": {"id": "5acc9a78-1127-46df-bb60-7544cdd2c1ef", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2143082515-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0653ab16660b46cea9c5af58ea0b1931", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3c66e4e-b1", "ovs_interfaceid": "d3c66e4e-b15d-4bc9-a838-265ca07a6a66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 16:35:56 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-302e84c8-6585-4731-b122-449d101fc624 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Converting VIF {"id": "d3c66e4e-b15d-4bc9-a838-265ca07a6a66", "address": "fa:16:3e:3a:4e:db", "network": {"id": "5acc9a78-1127-46df-bb60-7544cdd2c1ef", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2143082515-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0653ab16660b46cea9c5af58ea0b1931", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3c66e4e-b1", "ovs_interfaceid": "d3c66e4e-b15d-4bc9-a838-265ca07a6a66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 16:35:56 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-302e84c8-6585-4731-b122-449d101fc624 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3a:4e:db,bridge_name='br-int',has_traffic_filtering=True,id=d3c66e4e-b15d-4bc9-a838-265ca07a6a66,network=Network(5acc9a78-1127-46df-bb60-7544cdd2c1ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3c66e4e-b1') {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 16:35:56 user nova-compute[71731]: DEBUG os_vif [None req-302e84c8-6585-4731-b122-449d101fc624 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:4e:db,bridge_name='br-int',has_traffic_filtering=True,id=d3c66e4e-b15d-4bc9-a838-265ca07a6a66,network=Network(5acc9a78-1127-46df-bb60-7544cdd2c1ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3c66e4e-b1') {{(pid=71731) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 16:35:56 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:35:56 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:35:56 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 16:35:56 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:35:56 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd3c66e4e-b1, may_exist=True) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:35:56 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd3c66e4e-b1, col_values=(('external_ids', {'iface-id': 'd3c66e4e-b15d-4bc9-a838-265ca07a6a66', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3a:4e:db', 'vm-uuid': '35b23303-e373-4f35-b7ee-76e6815073ce'}),)) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:35:56 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:35:56 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 16:35:56 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:35:56 user nova-compute[71731]: INFO os_vif [None req-302e84c8-6585-4731-b122-449d101fc624 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:4e:db,bridge_name='br-int',has_traffic_filtering=True,id=d3c66e4e-b15d-4bc9-a838-265ca07a6a66,network=Network(5acc9a78-1127-46df-bb60-7544cdd2c1ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3c66e4e-b1')
Apr 13 16:35:56 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-302e84c8-6585-4731-b122-449d101fc624 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] No BDM found with device name vda, not building metadata. {{(pid=71731) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 16:35:56 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-302e84c8-6585-4731-b122-449d101fc624 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] No BDM found with device name vdc, not building metadata. {{(pid=71731) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 16:35:56 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-302e84c8-6585-4731-b122-449d101fc624 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] No VIF found with MAC fa:16:3e:3a:4e:db, not building metadata {{(pid=71731) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 16:35:56 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:35:58 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:35:58 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:35:58 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:35:58 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:35:58 user nova-compute[71731]: DEBUG nova.compute.manager [req-06c51ef9-f72d-41f5-89f4-a62580b67455 req-1fc2ca2e-3efa-4903-a4ca-218bb5eb8a34 service nova] [instance: 35b23303-e373-4f35-b7ee-76e6815073ce] Received event network-vif-plugged-d3c66e4e-b15d-4bc9-a838-265ca07a6a66 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:35:58 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-06c51ef9-f72d-41f5-89f4-a62580b67455 req-1fc2ca2e-3efa-4903-a4ca-218bb5eb8a34 service nova] Acquiring lock "35b23303-e373-4f35-b7ee-76e6815073ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:35:58 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-06c51ef9-f72d-41f5-89f4-a62580b67455 req-1fc2ca2e-3efa-4903-a4ca-218bb5eb8a34 service nova] Lock "35b23303-e373-4f35-b7ee-76e6815073ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:35:58 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-06c51ef9-f72d-41f5-89f4-a62580b67455 req-1fc2ca2e-3efa-4903-a4ca-218bb5eb8a34 service nova] Lock "35b23303-e373-4f35-b7ee-76e6815073ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:35:58 user nova-compute[71731]: DEBUG nova.compute.manager [req-06c51ef9-f72d-41f5-89f4-a62580b67455 req-1fc2ca2e-3efa-4903-a4ca-218bb5eb8a34 service nova] [instance: 35b23303-e373-4f35-b7ee-76e6815073ce] No waiting events found dispatching network-vif-plugged-d3c66e4e-b15d-4bc9-a838-265ca07a6a66 {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:35:58 user nova-compute[71731]: WARNING nova.compute.manager [req-06c51ef9-f72d-41f5-89f4-a62580b67455 req-1fc2ca2e-3efa-4903-a4ca-218bb5eb8a34 service nova] [instance: 35b23303-e373-4f35-b7ee-76e6815073ce] Received unexpected event network-vif-plugged-d3c66e4e-b15d-4bc9-a838-265ca07a6a66 for instance with vm_state shelved_offloaded and task_state spawning.
Apr 13 16:35:58 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:35:58 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:35:58 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:36:00 user nova-compute[71731]: DEBUG nova.virt.driver [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Emitting event <LifecycleEvent: 1681403760.3275657, 35b23303-e373-4f35-b7ee-76e6815073ce => Resumed> {{(pid=71731) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 16:36:00 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 35b23303-e373-4f35-b7ee-76e6815073ce] VM Resumed (Lifecycle Event)
Apr 13 16:36:00 user nova-compute[71731]: DEBUG nova.compute.manager [None req-302e84c8-6585-4731-b122-449d101fc624 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] [instance: 35b23303-e373-4f35-b7ee-76e6815073ce] Instance event wait completed in 0 seconds for  {{(pid=71731) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 16:36:00 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-302e84c8-6585-4731-b122-449d101fc624 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] [instance: 35b23303-e373-4f35-b7ee-76e6815073ce] Guest created on hypervisor {{(pid=71731) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 16:36:00 user nova-compute[71731]: INFO nova.virt.libvirt.driver [-] [instance: 35b23303-e373-4f35-b7ee-76e6815073ce] Instance spawned successfully.
Apr 13 16:36:00 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 35b23303-e373-4f35-b7ee-76e6815073ce] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:36:00 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 35b23303-e373-4f35-b7ee-76e6815073ce] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=71731) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 16:36:00 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 35b23303-e373-4f35-b7ee-76e6815073ce] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 16:36:00 user nova-compute[71731]: DEBUG nova.virt.driver [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Emitting event <LifecycleEvent: 1681403760.3318138, 35b23303-e373-4f35-b7ee-76e6815073ce => Started> {{(pid=71731) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 16:36:00 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 35b23303-e373-4f35-b7ee-76e6815073ce] VM Started (Lifecycle Event)
Apr 13 16:36:00 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 35b23303-e373-4f35-b7ee-76e6815073ce] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:36:00 user nova-compute[71731]: DEBUG nova.compute.manager [req-1dbd953c-cd76-425a-aa35-93246235812c req-9f44d544-8b9e-43f6-ab68-5a6ecd6b4df4 service nova] [instance: 35b23303-e373-4f35-b7ee-76e6815073ce] Received event network-vif-plugged-d3c66e4e-b15d-4bc9-a838-265ca07a6a66 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:36:00 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-1dbd953c-cd76-425a-aa35-93246235812c req-9f44d544-8b9e-43f6-ab68-5a6ecd6b4df4 service nova] Acquiring lock "35b23303-e373-4f35-b7ee-76e6815073ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:36:00 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-1dbd953c-cd76-425a-aa35-93246235812c req-9f44d544-8b9e-43f6-ab68-5a6ecd6b4df4 service nova] Lock "35b23303-e373-4f35-b7ee-76e6815073ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:36:00 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-1dbd953c-cd76-425a-aa35-93246235812c req-9f44d544-8b9e-43f6-ab68-5a6ecd6b4df4 service nova] Lock "35b23303-e373-4f35-b7ee-76e6815073ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:36:00 user nova-compute[71731]: DEBUG nova.compute.manager [req-1dbd953c-cd76-425a-aa35-93246235812c req-9f44d544-8b9e-43f6-ab68-5a6ecd6b4df4 service nova] [instance: 35b23303-e373-4f35-b7ee-76e6815073ce] No waiting events found dispatching network-vif-plugged-d3c66e4e-b15d-4bc9-a838-265ca07a6a66 {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:36:00 user nova-compute[71731]: WARNING nova.compute.manager [req-1dbd953c-cd76-425a-aa35-93246235812c req-9f44d544-8b9e-43f6-ab68-5a6ecd6b4df4 service nova] [instance: 35b23303-e373-4f35-b7ee-76e6815073ce] Received unexpected event network-vif-plugged-d3c66e4e-b15d-4bc9-a838-265ca07a6a66 for instance with vm_state shelved_offloaded and task_state spawning.
Apr 13 16:36:00 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 35b23303-e373-4f35-b7ee-76e6815073ce] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=71731) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 16:36:00 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 35b23303-e373-4f35-b7ee-76e6815073ce] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 16:36:00 user nova-compute[71731]: DEBUG nova.compute.manager [None req-302e84c8-6585-4731-b122-449d101fc624 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] [instance: 35b23303-e373-4f35-b7ee-76e6815073ce] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:36:00 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-302e84c8-6585-4731-b122-449d101fc624 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lock "35b23303-e373-4f35-b7ee-76e6815073ce" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 16.859s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:36:01 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:36:01 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:36:06 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:36:06 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:36:11 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:36:11 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:36:15 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:36:16 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:36:16 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:36:17 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:36:17 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71731) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 16:36:18 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:36:18 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager.update_available_resource {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:36:18 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:36:18 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:36:18 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:36:18 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Auditing locally available compute resources for user (node: user) {{(pid=71731) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 16:36:18 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35b23303-e373-4f35-b7ee-76e6815073ce/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:36:18 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35b23303-e373-4f35-b7ee-76e6815073ce/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:36:18 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35b23303-e373-4f35-b7ee-76e6815073ce/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:36:18 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35b23303-e373-4f35-b7ee-76e6815073ce/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:36:18 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=71731) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 16:36:18 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:36:18 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:36:18 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:36:18 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:36:18 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acbcaee0-a47b-4fee-8765-9b1c9597d515/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:36:19 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acbcaee0-a47b-4fee-8765-9b1c9597d515/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:36:19 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acbcaee0-a47b-4fee-8765-9b1c9597d515/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:36:19 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acbcaee0-a47b-4fee-8765-9b1c9597d515/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:36:19 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=71731) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 16:36:19 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=71731) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 16:36:19 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66553f5-5e1b-4f1d-8c5a-63bc340f7586/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:36:19 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66553f5-5e1b-4f1d-8c5a-63bc340f7586/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:36:19 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66553f5-5e1b-4f1d-8c5a-63bc340f7586/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:36:19 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66553f5-5e1b-4f1d-8c5a-63bc340f7586/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:36:19 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71731) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 16:36:19 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71731) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 16:36:19 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/650427bd-4dad-4bcd-922d-c17e60b36807/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:36:19 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/650427bd-4dad-4bcd-922d-c17e60b36807/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:36:19 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/650427bd-4dad-4bcd-922d-c17e60b36807/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:36:19 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/650427bd-4dad-4bcd-922d-c17e60b36807/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:36:19 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=71731) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 16:36:20 user nova-compute[71731]: WARNING nova.virt.libvirt.driver [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 16:36:20 user nova-compute[71731]: WARNING nova.virt.libvirt.driver [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 16:36:20 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Hypervisor/Node resource view: name=user free_ram=7859MB free_disk=26.023597717285156GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71731) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 16:36:20 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:36:20 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:36:20 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance f66553f5-5e1b-4f1d-8c5a-63bc340f7586 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 16:36:20 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance 235f827c-7116-48e9-84c5-0c9761c18e1e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 16:36:20 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance 650427bd-4dad-4bcd-922d-c17e60b36807 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 16:36:20 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance 2956ab05-28ff-4c9e-b646-dbb83b3db278 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 16:36:20 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance acbcaee0-a47b-4fee-8765-9b1c9597d515 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 128, 'DISK_GB': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 16:36:20 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance 220e1c3e-1378-46fc-acc1-ee1bafac7722 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 16:36:20 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 16:36:20 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance 0a5c9b2c-fe1e-4a21-b213-c63e2c28748a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 16:36:20 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance 35b23303-e373-4f35-b7ee-76e6815073ce actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 16:36:20 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=71731) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 16:36:20 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Final resource view: name=user phys_ram=16023MB used_ram=1664MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=71731) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 16:36:20 user nova-compute[71731]: DEBUG nova.compute.provider_tree [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Inventory has not changed in ProviderTree for provider: cb6b1a64-0c24-4e2d-af1e-16576ca9165c {{(pid=71731) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 16:36:20 user nova-compute[71731]: DEBUG nova.scheduler.client.report [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Inventory has not changed for provider cb6b1a64-0c24-4e2d-af1e-16576ca9165c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71731) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 16:36:20 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Compute_service record updated for user:user {{(pid=71731) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 16:36:20 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.465s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:36:20 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:36:20 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Cleaning up deleted instances {{(pid=71731) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 13 16:36:20 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] There are 0 instances to clean {{(pid=71731) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 13 16:36:21 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:36:21 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:36:23 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:36:23 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Starting heal instance info cache {{(pid=71731) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 16:36:23 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Acquiring lock "refresh_cache-650427bd-4dad-4bcd-922d-c17e60b36807" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 16:36:23 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Acquired lock "refresh_cache-650427bd-4dad-4bcd-922d-c17e60b36807" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 16:36:23 user nova-compute[71731]: DEBUG nova.network.neutron [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] [instance: 650427bd-4dad-4bcd-922d-c17e60b36807] Forcefully refreshing network info cache for instance {{(pid=71731) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 16:36:24 user nova-compute[71731]: DEBUG nova.network.neutron [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] [instance: 650427bd-4dad-4bcd-922d-c17e60b36807] Updating instance_info_cache with network_info: [{"id": "c6fe8d62-f2ba-44d6-a5e3-da6f35679b3f", "address": "fa:16:3e:01:40:5b", "network": {"id": "5a7877ff-8230-470b-90b5-e5dcfc8f0cee", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-779403873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2d09a74bf684a9fb1dd1e95d6c23f3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6fe8d62-f2", "ovs_interfaceid": "c6fe8d62-f2ba-44d6-a5e3-da6f35679b3f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:36:24 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Releasing lock "refresh_cache-650427bd-4dad-4bcd-922d-c17e60b36807" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 16:36:24 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] [instance: 650427bd-4dad-4bcd-922d-c17e60b36807] Updated the network info_cache for instance {{(pid=71731) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 16:36:24 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:36:24 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:36:24 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:36:25 user nova-compute[71731]: DEBUG nova.compute.manager [req-d222c6da-9727-41b0-9441-b5d82c204c17 req-df74b76c-523d-437a-b525-7ae22f7266b4 service nova] [instance: bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f] Received event network-changed-adf9438c-79e3-494a-8650-1b7377eb1062 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:36:25 user nova-compute[71731]: DEBUG nova.compute.manager [req-d222c6da-9727-41b0-9441-b5d82c204c17 req-df74b76c-523d-437a-b525-7ae22f7266b4 service nova] [instance: bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f] Refreshing instance network info cache due to event network-changed-adf9438c-79e3-494a-8650-1b7377eb1062. {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 16:36:25 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-d222c6da-9727-41b0-9441-b5d82c204c17 req-df74b76c-523d-437a-b525-7ae22f7266b4 service nova] Acquiring lock "refresh_cache-bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 16:36:25 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-d222c6da-9727-41b0-9441-b5d82c204c17 req-df74b76c-523d-437a-b525-7ae22f7266b4 service nova] Acquired lock "refresh_cache-bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 16:36:25 user nova-compute[71731]: DEBUG nova.network.neutron [req-d222c6da-9727-41b0-9441-b5d82c204c17 req-df74b76c-523d-437a-b525-7ae22f7266b4 service nova] [instance: bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f] Refreshing network info cache for port adf9438c-79e3-494a-8650-1b7377eb1062 {{(pid=71731) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 16:36:25 user nova-compute[71731]: DEBUG nova.network.neutron [req-d222c6da-9727-41b0-9441-b5d82c204c17 req-df74b76c-523d-437a-b525-7ae22f7266b4 service nova] [instance: bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f] Updated VIF entry in instance network info cache for port adf9438c-79e3-494a-8650-1b7377eb1062. {{(pid=71731) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 16:36:25 user nova-compute[71731]: DEBUG nova.network.neutron [req-d222c6da-9727-41b0-9441-b5d82c204c17 req-df74b76c-523d-437a-b525-7ae22f7266b4 service nova] [instance: bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f] Updating instance_info_cache with network_info: [{"id": "adf9438c-79e3-494a-8650-1b7377eb1062", "address": "fa:16:3e:b9:56:b4", "network": {"id": "79e9ef20-b14d-4850-b298-9d3ed4d10b90", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1756253617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24904988cf334657b084fd726c7ecf8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadf9438c-79", "ovs_interfaceid": "adf9438c-79e3-494a-8650-1b7377eb1062", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:36:25 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-d222c6da-9727-41b0-9441-b5d82c204c17 req-df74b76c-523d-437a-b525-7ae22f7266b4 service nova] Releasing lock "refresh_cache-bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 16:36:26 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:36:26 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:36:26 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-fd58103c-ec7d-46d7-abaa-a56feb441a00 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Acquiring lock "bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:36:26 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-fd58103c-ec7d-46d7-abaa-a56feb441a00 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lock "bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:36:26 user nova-compute[71731]: DEBUG nova.objects.instance [None req-fd58103c-ec7d-46d7-abaa-a56feb441a00 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lazy-loading 'flavor' on Instance uuid bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:36:26 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:36:26 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-fd58103c-ec7d-46d7-abaa-a56feb441a00 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lock "bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:36:27 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:36:27 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-fd58103c-ec7d-46d7-abaa-a56feb441a00 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Acquiring lock "bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:36:27 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-fd58103c-ec7d-46d7-abaa-a56feb441a00 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lock "bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:36:27 user nova-compute[71731]: INFO nova.compute.manager [None req-fd58103c-ec7d-46d7-abaa-a56feb441a00 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] [instance: bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f] Attaching volume 548500fd-99a8-4cad-ade8-acd0fce2c8e8 to /dev/vdb
Apr 13 16:36:27 user nova-compute[71731]: DEBUG os_brick.utils [None req-fd58103c-ec7d-46d7-abaa-a56feb441a00 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 16:36:27 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:36:27 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:36:27 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc1a26f0-b068-48a5-8de8-a342ccc2a563]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:81501d91421\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:36:27 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:36:27 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:36:27 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[746309f1-bd45-43c1-965d-cf9af3f232e4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:36:27 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:36:27 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:36:27 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2b7fbd5-ae23-4a0c-9065-f4a3ab8e74d0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:36:27 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[e13522d7-44cf-48ce-981a-08170357805f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:36:27 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-fd58103c-ec7d-46d7-abaa-a56feb441a00 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Running cmd (subprocess): nvme version {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:36:27 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-fd58103c-ec7d-46d7-abaa-a56feb441a00 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] 'nvme version' failed. Not Retrying. {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 16:36:27 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fd58103c-ec7d-46d7-abaa-a56feb441a00 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] nvme not present on system {{(pid=71731) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 16:36:27 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:36:27 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 16:36:27 user nova-compute[71731]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 16:36:27 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b212b9e-f801-479a-9fca-185a4c8b56df]: (4, '') {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:36:27 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.lightos [None req-fd58103c-ec7d-46d7-abaa-a56feb441a00 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71731) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 16:36:27 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.lightos [None req-fd58103c-ec7d-46d7-abaa-a56feb441a00 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71731) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 16:36:27 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.lightos [None req-fd58103c-ec7d-46d7-abaa-a56feb441a00 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] LIGHTOS: no hostnqn found. {{(pid=71731) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 16:36:27 user nova-compute[71731]: DEBUG os_brick.utils [None req-fd58103c-ec7d-46d7-abaa-a56feb441a00 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:81501d91421', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 16:36:27 user nova-compute[71731]: DEBUG nova.virt.block_device [None req-fd58103c-ec7d-46d7-abaa-a56feb441a00 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] [instance: bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f] Updating existing volume attachment record: c6bc08eb-1944-477f-9d77-a9523975573c {{(pid=71731) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 16:36:29 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:36:31 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:36:31 user nova-compute[71731]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fd58103c-ec7d-46d7-abaa-a56feb441a00 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] [instance: bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f] Calling os-brick to attach iSCSI Volume {{(pid=71731) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 16:36:31 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd58103c-ec7d-46d7-abaa-a56feb441a00 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8cf0118790>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:548500fd-99a8-4cad-ade8-acd0fce2c8e8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zHAWmgtd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 16:36:31 user nova-compute[71731]: WARNING os_brick.initiator.connectors.base [None req-fd58103c-ec7d-46d7-abaa-a56feb441a00 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 16:36:31 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-fd58103c-ec7d-46d7-abaa-a56feb441a00 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 16:36:31 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-fd58103c-ec7d-46d7-abaa-a56feb441a00 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 16:36:31 user nova-compute[71731]: WARNING os_brick.initiator.connectors.base [None req-fd58103c-ec7d-46d7-abaa-a56feb441a00 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 16:36:31 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-fd58103c-ec7d-46d7-abaa-a56feb441a00 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:548500fd-99a8-4cad-ade8-acd0fce2c8e8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 16:36:31 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-fd58103c-ec7d-46d7-abaa-a56feb441a00 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:548500fd-99a8-4cad-ade8-acd0fce2c8e8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 16:36:31 user nova-compute[71731]: INFO os_brick.initiator.connectors.iscsi [None req-fd58103c-ec7d-46d7-abaa-a56feb441a00 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 16:36:31 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:548500fd-99a8-4cad-ade8-acd0fce2c8e8 -p 172.16.0.220:3260 {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:36:31 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:548500fd-99a8-4cad-ade8-acd0fce2c8e8 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:36:31 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdf72617-a9cd-40bb-b6ab-0889ae2d9b73]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:36:31 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd58103c-ec7d-46d7-abaa-a56feb441a00 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 16:36:31 user nova-compute[71731]:  {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:36:31 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:548500fd-99a8-4cad-ade8-acd0fce2c8e8 -p 172.16.0.220:3260 --interface default --op new {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:36:31 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:548500fd-99a8-4cad-ade8-acd0fce2c8e8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:36:31 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c9c74fa-30ad-41d5-b375-1446ea56afad]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:548500fd-99a8-4cad-ade8-acd0fce2c8e8] added\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:36:31 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd58103c-ec7d-46d7-abaa-a56feb441a00 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:548500fd-99a8-4cad-ade8-acd0fce2c8e8] added
Apr 13 16:36:31 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:36:31 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:548500fd-99a8-4cad-ade8-acd0fce2c8e8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:36:31 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:548500fd-99a8-4cad-ade8-acd0fce2c8e8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:36:31 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d1f1fc1-d0d8-4d7a-9d23-cf84746ffbcf]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:36:31 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd58103c-ec7d-46d7-abaa-a56feb441a00 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:36:31 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:548500fd-99a8-4cad-ade8-acd0fce2c8e8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:36:31 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:548500fd-99a8-4cad-ade8-acd0fce2c8e8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:36:31 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0ae0d97-4a01-4575-a1e9-46d283c61ba3]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:36:31 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd58103c-ec7d-46d7-abaa-a56feb441a00 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:36:31 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:548500fd-99a8-4cad-ade8-acd0fce2c8e8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zHAWmgtd {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:36:31 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:548500fd-99a8-4cad-ade8-acd0fce2c8e8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zHAWmgtd" returned: 0 in 0.020s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:36:31 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[42674ab4-0bb9-421f-afcc-3776d4f68e13]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:36:31 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd58103c-ec7d-46d7-abaa-a56feb441a00 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zHAWmgtd'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:36:31 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:548500fd-99a8-4cad-ade8-acd0fce2c8e8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:36:31 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:548500fd-99a8-4cad-ade8-acd0fce2c8e8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:36:31 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[b116dcd2-df7d-4d64-90fb-cf5a3759e907]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:36:31 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd58103c-ec7d-46d7-abaa-a56feb441a00 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:36:31 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:36:31 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:36:31 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[900544a0-ff24-4985-ab83-4b879e57616f]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25c3dc97-c9cb-4529-ab32-26ef7fd94fc6 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2088266-1d33-4bb1-ac5b-1de832ff7985 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:651ea766-ffda-42a1-9b3c-7be05a92c85f (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4a5ced3-77ae-4bf5-8154-bd1645e470f2 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8156a054-43ea-4eeb-bbec-a270a6779a43 (non-flash)\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:36:31 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd58103c-ec7d-46d7-abaa-a56feb441a00 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)
Apr 13 16:36:31 user nova-compute[71731]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25c3dc97-c9cb-4529-ab32-26ef7fd94fc6 (non-flash)
Apr 13 16:36:31 user nova-compute[71731]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2088266-1d33-4bb1-ac5b-1de832ff7985 (non-flash)
Apr 13 16:36:31 user nova-compute[71731]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:651ea766-ffda-42a1-9b3c-7be05a92c85f (non-flash)
Apr 13 16:36:31 user nova-compute[71731]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4a5ced3-77ae-4bf5-8154-bd1645e470f2 (non-flash)
Apr 13 16:36:31 user nova-compute[71731]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8156a054-43ea-4eeb-bbec-a270a6779a43 (non-flash)
Apr 13 16:36:31 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 16:36:31 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd58103c-ec7d-46d7-abaa-a56feb441a00 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)
Apr 13 16:36:31 user nova-compute[71731]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25c3dc97-c9cb-4529-ab32-26ef7fd94fc6 (non-flash)
Apr 13 16:36:31 user nova-compute[71731]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2088266-1d33-4bb1-ac5b-1de832ff7985 (non-flash)
Apr 13 16:36:31 user nova-compute[71731]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:651ea766-ffda-42a1-9b3c-7be05a92c85f (non-flash)
Apr 13 16:36:31 user nova-compute[71731]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4a5ced3-77ae-4bf5-8154-bd1645e470f2 (non-flash)
Apr 13 16:36:31 user nova-compute[71731]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8156a054-43ea-4eeb-bbec-a270a6779a43 (non-flash)
Apr 13 16:36:31 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 16:36:31 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:548500fd-99a8-4cad-ade8-acd0fce2c8e8 -p 172.16.0.220:3260 --login {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:36:31 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:36:32 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:548500fd-99a8-4cad-ade8-acd0fce2c8e8 -p 172.16.0.220:3260 --login" returned: 0 in 0.089s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:36:32 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[f899f2c4-e90e-4da2-9e84-3b8924174213]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:548500fd-99a8-4cad-ade8-acd0fce2c8e8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:548500fd-99a8-4cad-ade8-acd0fce2c8e8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:36:32 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd58103c-ec7d-46d7-abaa-a56feb441a00 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:548500fd-99a8-4cad-ade8-acd0fce2c8e8, portal: 172.16.0.220,3260]
Apr 13 16:36:32 user nova-compute[71731]: Login to [iface: default, target: iqn.2010-10.org.openstack:548500fd-99a8-4cad-ade8-acd0fce2c8e8, portal: 172.16.0.220,3260] successful.
Apr 13 16:36:32 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:36:32 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:548500fd-99a8-4cad-ade8-acd0fce2c8e8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:36:32 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:548500fd-99a8-4cad-ade8-acd0fce2c8e8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:36:32 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[64029177-17a9-47a9-94ba-8934739ad125]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:36:32 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd58103c-ec7d-46d7-abaa-a56feb441a00 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:36:32 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:36:32 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:36:32 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2dd7599-d06b-4636-98e0-2c2842ae92c4]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25c3dc97-c9cb-4529-ab32-26ef7fd94fc6 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2088266-1d33-4bb1-ac5b-1de832ff7985 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:651ea766-ffda-42a1-9b3c-7be05a92c85f (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4a5ced3-77ae-4bf5-8154-bd1645e470f2 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8156a054-43ea-4eeb-bbec-a270a6779a43 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:548500fd-99a8-4cad-ade8-acd0fce2c8e8 (non-flash)\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:36:32 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd58103c-ec7d-46d7-abaa-a56feb441a00 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)
Apr 13 16:36:32 user nova-compute[71731]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25c3dc97-c9cb-4529-ab32-26ef7fd94fc6 (non-flash)
Apr 13 16:36:32 user nova-compute[71731]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2088266-1d33-4bb1-ac5b-1de832ff7985 (non-flash)
Apr 13 16:36:32 user nova-compute[71731]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:651ea766-ffda-42a1-9b3c-7be05a92c85f (non-flash)
Apr 13 16:36:32 user nova-compute[71731]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4a5ced3-77ae-4bf5-8154-bd1645e470f2 (non-flash)
Apr 13 16:36:32 user nova-compute[71731]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8156a054-43ea-4eeb-bbec-a270a6779a43 (non-flash)
Apr 13 16:36:32 user nova-compute[71731]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:548500fd-99a8-4cad-ade8-acd0fce2c8e8 (non-flash)
Apr 13 16:36:32 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 16:36:32 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd58103c-ec7d-46d7-abaa-a56feb441a00 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)
Apr 13 16:36:32 user nova-compute[71731]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25c3dc97-c9cb-4529-ab32-26ef7fd94fc6 (non-flash)
Apr 13 16:36:32 user nova-compute[71731]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2088266-1d33-4bb1-ac5b-1de832ff7985 (non-flash)
Apr 13 16:36:32 user nova-compute[71731]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:651ea766-ffda-42a1-9b3c-7be05a92c85f (non-flash)
Apr 13 16:36:32 user nova-compute[71731]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4a5ced3-77ae-4bf5-8154-bd1645e470f2 (non-flash)
Apr 13 16:36:32 user nova-compute[71731]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8156a054-43ea-4eeb-bbec-a270a6779a43 (non-flash)
Apr 13 16:36:32 user nova-compute[71731]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:548500fd-99a8-4cad-ade8-acd0fce2c8e8 (non-flash)
Apr 13 16:36:32 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 16:36:32 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-fd58103c-ec7d-46d7-abaa-a56feb441a00 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:548500fd-99a8-4cad-ade8-acd0fce2c8e8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.347s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 16:36:32 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd58103c-ec7d-46d7-abaa-a56feb441a00 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Connected to 172.16.0.220:3260 {{(pid=71731) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 16:36:32 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-fd58103c-ec7d-46d7-abaa-a56feb441a00 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] HCTL ('39', '-', '-', 0) found on session 42 with lun 0 {{(pid=71731) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 16:36:32 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-fd58103c-ec7d-46d7-abaa-a56feb441a00 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=71731) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 16:36:32 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:36:32 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.017s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:36:32 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b0ecc00-8d30-431f-b736-3e40b57cc460]: (4, ('- - 0', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:36:32 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-fd58103c-ec7d-46d7-abaa-a56feb441a00 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Searching for a device in session 42 and hctl ['39', '*', '*', 0] yield: None {{(pid=71731) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 16:36:33 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-fd58103c-ec7d-46d7-abaa-a56feb441a00 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Searching for a device in session 42 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=71731) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 16:36:33 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd58103c-ec7d-46d7-abaa-a56feb441a00 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:548500fd-99a8-4cad-ade8-acd0fce2c8e8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zHAWmgtd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71731) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 16:36:33 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-fd58103c-ec7d-46d7-abaa-a56feb441a00 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.378s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 16:36:33 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd58103c-ec7d-46d7-abaa-a56feb441a00 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] <== connect_volume: return (1380ms) {'type': 'block', 'scsi_wwn': '23736623530333531', 'path': '/dev/sdh'} {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 16:36:33 user nova-compute[71731]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fd58103c-ec7d-46d7-abaa-a56feb441a00 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] [instance: bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23736623530333531', 'path': '/dev/sdh'} {{(pid=71731) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 16:36:33 user nova-compute[71731]: DEBUG nova.objects.instance [None req-fd58103c-ec7d-46d7-abaa-a56feb441a00 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lazy-loading 'flavor' on Instance uuid bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:36:33 user nova-compute[71731]: DEBUG nova.virt.libvirt.guest [None req-fd58103c-ec7d-46d7-abaa-a56feb441a00 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] attach device xml: <disk type="block" device="disk">
Apr 13 16:36:33 user nova-compute[71731]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 16:36:33 user nova-compute[71731]:   <source dev="/dev/sdh"/>
Apr 13 16:36:33 user nova-compute[71731]:   <target dev="vdb" bus="virtio"/>
Apr 13 16:36:33 user nova-compute[71731]:   <serial>548500fd-99a8-4cad-ade8-acd0fce2c8e8</serial>
Apr 13 16:36:33 user nova-compute[71731]: </disk>
Apr 13 16:36:33 user nova-compute[71731]:  {{(pid=71731) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 13 16:36:33 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-fd58103c-ec7d-46d7-abaa-a56feb441a00 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] No BDM found with device name vda, not building metadata. {{(pid=71731) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 16:36:33 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-fd58103c-ec7d-46d7-abaa-a56feb441a00 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71731) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 16:36:33 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-fd58103c-ec7d-46d7-abaa-a56feb441a00 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] No VIF found with MAC fa:16:3e:b9:56:b4, not building metadata {{(pid=71731) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 16:36:33 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-fd58103c-ec7d-46d7-abaa-a56feb441a00 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lock "bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.667s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:36:35 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:36:36 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-ca578feb-f4f8-4fa0-85f0-1c59b8e7b768 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Acquiring lock "bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:36:36 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-ca578feb-f4f8-4fa0-85f0-1c59b8e7b768 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lock "bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:36:36 user nova-compute[71731]: DEBUG nova.objects.instance [None req-ca578feb-f4f8-4fa0-85f0-1c59b8e7b768 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lazy-loading 'flavor' on Instance uuid bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:36:36 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-ca578feb-f4f8-4fa0-85f0-1c59b8e7b768 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lock "bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.073s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:36:36 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-ca578feb-f4f8-4fa0-85f0-1c59b8e7b768 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Acquiring lock "bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:36:36 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-ca578feb-f4f8-4fa0-85f0-1c59b8e7b768 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lock "bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:36:36 user nova-compute[71731]: INFO nova.compute.manager [None req-ca578feb-f4f8-4fa0-85f0-1c59b8e7b768 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] [instance: bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f] Attaching volume db98e2a6-2772-4d6b-80fc-67f564ded02b to /dev/vdc
Apr 13 16:36:36 user nova-compute[71731]: DEBUG os_brick.utils [None req-ca578feb-f4f8-4fa0-85f0-1c59b8e7b768 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 16:36:36 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:36:36 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:36:36 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[231aef3f-fe29-4c78-acb4-eb36b968c77a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:81501d91421\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:36:36 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:36:36 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:36:36 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[384136db-8005-4bdb-948f-666934ada3b9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:36:36 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:36:36 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:36:36 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c9c23c2-ddd6-4f10-a112-c0bbd190dce9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:36:36 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa95e8ff-26c9-41ef-934a-d15b182de150]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:36:36 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-ca578feb-f4f8-4fa0-85f0-1c59b8e7b768 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Running cmd (subprocess): nvme version {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:36:36 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-ca578feb-f4f8-4fa0-85f0-1c59b8e7b768 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] 'nvme version' failed. Not Retrying. {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 16:36:36 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:36:36 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ca578feb-f4f8-4fa0-85f0-1c59b8e7b768 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] nvme not present on system {{(pid=71731) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 16:36:36 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:36:36 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 16:36:36 user nova-compute[71731]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 16:36:36 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[84e4d852-f46c-4a3c-84f4-c2ed33d5c447]: (4, '') {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:36:36 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.lightos [None req-ca578feb-f4f8-4fa0-85f0-1c59b8e7b768 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71731) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 16:36:36 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.lightos [None req-ca578feb-f4f8-4fa0-85f0-1c59b8e7b768 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71731) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 16:36:36 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.lightos [None req-ca578feb-f4f8-4fa0-85f0-1c59b8e7b768 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] LIGHTOS: no hostnqn found. {{(pid=71731) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 16:36:36 user nova-compute[71731]: DEBUG os_brick.utils [None req-ca578feb-f4f8-4fa0-85f0-1c59b8e7b768 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:81501d91421', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 16:36:36 user nova-compute[71731]: DEBUG nova.virt.block_device [None req-ca578feb-f4f8-4fa0-85f0-1c59b8e7b768 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] [instance: bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f] Updating existing volume attachment record: 951bd504-1773-439d-8a67-eb740ea5894c {{(pid=71731) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 16:36:36 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:36:37 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:36:37 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Cleaning up deleted instances with incomplete migration  {{(pid=71731) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 13 16:36:38 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:36:41 user nova-compute[71731]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ca578feb-f4f8-4fa0-85f0-1c59b8e7b768 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] [instance: bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f] Calling os-brick to attach iSCSI Volume {{(pid=71731) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 16:36:41 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca578feb-f4f8-4fa0-85f0-1c59b8e7b768 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8cf0118790>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:db98e2a6-2772-4d6b-80fc-67f564ded02b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wqeIrFcC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 16:36:41 user nova-compute[71731]: WARNING os_brick.initiator.connectors.base [None req-ca578feb-f4f8-4fa0-85f0-1c59b8e7b768 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 16:36:41 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-ca578feb-f4f8-4fa0-85f0-1c59b8e7b768 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 16:36:41 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-ca578feb-f4f8-4fa0-85f0-1c59b8e7b768 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 16:36:41 user nova-compute[71731]: WARNING os_brick.initiator.connectors.base [None req-ca578feb-f4f8-4fa0-85f0-1c59b8e7b768 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 16:36:41 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-ca578feb-f4f8-4fa0-85f0-1c59b8e7b768 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:db98e2a6-2772-4d6b-80fc-67f564ded02b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 16:36:41 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-ca578feb-f4f8-4fa0-85f0-1c59b8e7b768 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:db98e2a6-2772-4d6b-80fc-67f564ded02b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 16:36:41 user nova-compute[71731]: INFO os_brick.initiator.connectors.iscsi [None req-ca578feb-f4f8-4fa0-85f0-1c59b8e7b768 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 16:36:41 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db98e2a6-2772-4d6b-80fc-67f564ded02b -p 172.16.0.220:3260 {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:36:41 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db98e2a6-2772-4d6b-80fc-67f564ded02b -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:36:41 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[29fb4fcc-3650-48f4-b421-f5c61cb88f69]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:36:41 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca578feb-f4f8-4fa0-85f0-1c59b8e7b768 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 16:36:41 user nova-compute[71731]:  {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:36:41 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db98e2a6-2772-4d6b-80fc-67f564ded02b -p 172.16.0.220:3260 --interface default --op new {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:36:41 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db98e2a6-2772-4d6b-80fc-67f564ded02b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:36:41 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a721e8f-6afe-4248-9b81-695963146a73]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:db98e2a6-2772-4d6b-80fc-67f564ded02b] added\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:36:41 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca578feb-f4f8-4fa0-85f0-1c59b8e7b768 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:db98e2a6-2772-4d6b-80fc-67f564ded02b] added
Apr 13 16:36:41 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:36:41 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db98e2a6-2772-4d6b-80fc-67f564ded02b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:36:41 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db98e2a6-2772-4d6b-80fc-67f564ded02b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:36:41 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6bce456-e0cc-4afe-b69b-bd285bc53a92]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:36:41 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca578feb-f4f8-4fa0-85f0-1c59b8e7b768 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:36:41 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db98e2a6-2772-4d6b-80fc-67f564ded02b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:36:41 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db98e2a6-2772-4d6b-80fc-67f564ded02b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:36:41 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[490649f7-5e70-41cb-a659-5aeeb19d1c9f]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:36:41 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca578feb-f4f8-4fa0-85f0-1c59b8e7b768 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:36:41 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db98e2a6-2772-4d6b-80fc-67f564ded02b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wqeIrFcC {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:36:41 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db98e2a6-2772-4d6b-80fc-67f564ded02b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wqeIrFcC" returned: 0 in 0.020s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:36:41 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[824cd977-05e4-49b4-b755-f2304c946d8e]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:36:41 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca578feb-f4f8-4fa0-85f0-1c59b8e7b768 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wqeIrFcC'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:36:41 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db98e2a6-2772-4d6b-80fc-67f564ded02b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:36:41 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db98e2a6-2772-4d6b-80fc-67f564ded02b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:36:41 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[a21e873f-4390-425d-a523-d0fa0a35ea2e]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:36:41 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca578feb-f4f8-4fa0-85f0-1c59b8e7b768 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:36:41 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:36:41 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:36:41 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dff4c0e-6c64-4cc8-8d32-04d2182990df]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25c3dc97-c9cb-4529-ab32-26ef7fd94fc6 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2088266-1d33-4bb1-ac5b-1de832ff7985 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:651ea766-ffda-42a1-9b3c-7be05a92c85f (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4a5ced3-77ae-4bf5-8154-bd1645e470f2 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8156a054-43ea-4eeb-bbec-a270a6779a43 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:548500fd-99a8-4cad-ade8-acd0fce2c8e8 (non-flash)\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:36:41 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca578feb-f4f8-4fa0-85f0-1c59b8e7b768 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)
Apr 13 16:36:41 user nova-compute[71731]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25c3dc97-c9cb-4529-ab32-26ef7fd94fc6 (non-flash)
Apr 13 16:36:41 user nova-compute[71731]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2088266-1d33-4bb1-ac5b-1de832ff7985 (non-flash)
Apr 13 16:36:41 user nova-compute[71731]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:651ea766-ffda-42a1-9b3c-7be05a92c85f (non-flash)
Apr 13 16:36:41 user nova-compute[71731]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4a5ced3-77ae-4bf5-8154-bd1645e470f2 (non-flash)
Apr 13 16:36:41 user nova-compute[71731]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8156a054-43ea-4eeb-bbec-a270a6779a43 (non-flash)
Apr 13 16:36:41 user nova-compute[71731]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:548500fd-99a8-4cad-ade8-acd0fce2c8e8 (non-flash)
Apr 13 16:36:41 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 16:36:41 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca578feb-f4f8-4fa0-85f0-1c59b8e7b768 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)
Apr 13 16:36:41 user nova-compute[71731]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25c3dc97-c9cb-4529-ab32-26ef7fd94fc6 (non-flash)
Apr 13 16:36:41 user nova-compute[71731]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2088266-1d33-4bb1-ac5b-1de832ff7985 (non-flash)
Apr 13 16:36:41 user nova-compute[71731]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:651ea766-ffda-42a1-9b3c-7be05a92c85f (non-flash)
Apr 13 16:36:41 user nova-compute[71731]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4a5ced3-77ae-4bf5-8154-bd1645e470f2 (non-flash)
Apr 13 16:36:41 user nova-compute[71731]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8156a054-43ea-4eeb-bbec-a270a6779a43 (non-flash)
Apr 13 16:36:41 user nova-compute[71731]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:548500fd-99a8-4cad-ade8-acd0fce2c8e8 (non-flash)
Apr 13 16:36:41 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 16:36:41 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db98e2a6-2772-4d6b-80fc-67f564ded02b -p 172.16.0.220:3260 --login {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:36:41 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db98e2a6-2772-4d6b-80fc-67f564ded02b -p 172.16.0.220:3260 --login" returned: 0 in 0.101s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:36:41 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[f52e3736-e8a0-41c2-b691-65572760b454]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:db98e2a6-2772-4d6b-80fc-67f564ded02b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:db98e2a6-2772-4d6b-80fc-67f564ded02b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:36:41 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca578feb-f4f8-4fa0-85f0-1c59b8e7b768 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:db98e2a6-2772-4d6b-80fc-67f564ded02b, portal: 172.16.0.220,3260]
Apr 13 16:36:41 user nova-compute[71731]: Login to [iface: default, target: iqn.2010-10.org.openstack:db98e2a6-2772-4d6b-80fc-67f564ded02b, portal: 172.16.0.220,3260] successful.
Apr 13 16:36:41 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:36:41 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db98e2a6-2772-4d6b-80fc-67f564ded02b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:36:41 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db98e2a6-2772-4d6b-80fc-67f564ded02b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:36:41 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[06ef9650-4c1f-4067-a75f-fa778b76a1ad]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:36:41 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca578feb-f4f8-4fa0-85f0-1c59b8e7b768 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:36:41 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:36:41 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:36:41 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[09cba015-23df-47b9-ae88-f0d426042871]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25c3dc97-c9cb-4529-ab32-26ef7fd94fc6 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2088266-1d33-4bb1-ac5b-1de832ff7985 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:651ea766-ffda-42a1-9b3c-7be05a92c85f (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4a5ced3-77ae-4bf5-8154-bd1645e470f2 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8156a054-43ea-4eeb-bbec-a270a6779a43 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:548500fd-99a8-4cad-ade8-acd0fce2c8e8 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db98e2a6-2772-4d6b-80fc-67f564ded02b (non-flash)\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:36:41 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca578feb-f4f8-4fa0-85f0-1c59b8e7b768 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)
Apr 13 16:36:41 user nova-compute[71731]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25c3dc97-c9cb-4529-ab32-26ef7fd94fc6 (non-flash)
Apr 13 16:36:41 user nova-compute[71731]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2088266-1d33-4bb1-ac5b-1de832ff7985 (non-flash)
Apr 13 16:36:41 user nova-compute[71731]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:651ea766-ffda-42a1-9b3c-7be05a92c85f (non-flash)
Apr 13 16:36:41 user nova-compute[71731]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4a5ced3-77ae-4bf5-8154-bd1645e470f2 (non-flash)
Apr 13 16:36:41 user nova-compute[71731]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8156a054-43ea-4eeb-bbec-a270a6779a43 (non-flash)
Apr 13 16:36:41 user nova-compute[71731]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:548500fd-99a8-4cad-ade8-acd0fce2c8e8 (non-flash)
Apr 13 16:36:41 user nova-compute[71731]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db98e2a6-2772-4d6b-80fc-67f564ded02b (non-flash)
Apr 13 16:36:41 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 16:36:41 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca578feb-f4f8-4fa0-85f0-1c59b8e7b768 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)
Apr 13 16:36:41 user nova-compute[71731]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25c3dc97-c9cb-4529-ab32-26ef7fd94fc6 (non-flash)
Apr 13 16:36:41 user nova-compute[71731]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2088266-1d33-4bb1-ac5b-1de832ff7985 (non-flash)
Apr 13 16:36:41 user nova-compute[71731]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:651ea766-ffda-42a1-9b3c-7be05a92c85f (non-flash)
Apr 13 16:36:41 user nova-compute[71731]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4a5ced3-77ae-4bf5-8154-bd1645e470f2 (non-flash)
Apr 13 16:36:41 user nova-compute[71731]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8156a054-43ea-4eeb-bbec-a270a6779a43 (non-flash)
Apr 13 16:36:41 user nova-compute[71731]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:548500fd-99a8-4cad-ade8-acd0fce2c8e8 (non-flash)
Apr 13 16:36:41 user nova-compute[71731]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db98e2a6-2772-4d6b-80fc-67f564ded02b (non-flash)
Apr 13 16:36:41 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 16:36:41 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-ca578feb-f4f8-4fa0-85f0-1c59b8e7b768 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:db98e2a6-2772-4d6b-80fc-67f564ded02b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.347s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 16:36:41 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca578feb-f4f8-4fa0-85f0-1c59b8e7b768 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Connected to 172.16.0.220:3260 {{(pid=71731) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 16:36:41 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-ca578feb-f4f8-4fa0-85f0-1c59b8e7b768 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] HCTL ('40', '-', '-', 0) found on session 43 with lun 0 {{(pid=71731) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 16:36:41 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-ca578feb-f4f8-4fa0-85f0-1c59b8e7b768 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=71731) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 16:36:41 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:36:41 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.017s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:36:41 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[503a5532-293e-45ef-a852-79b34dedd721]: (4, ('- - 0', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:36:41 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-ca578feb-f4f8-4fa0-85f0-1c59b8e7b768 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Searching for a device in session 43 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=71731) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 16:36:41 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca578feb-f4f8-4fa0-85f0-1c59b8e7b768 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:db98e2a6-2772-4d6b-80fc-67f564ded02b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wqeIrFcC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71731) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 16:36:41 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:36:41 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:36:42 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-ca578feb-f4f8-4fa0-85f0-1c59b8e7b768 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.387s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 16:36:42 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca578feb-f4f8-4fa0-85f0-1c59b8e7b768 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] <== connect_volume: return (1389ms) {'type': 'block', 'scsi_wwn': '23433386232643732', 'path': '/dev/sdi'} {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 16:36:42 user nova-compute[71731]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ca578feb-f4f8-4fa0-85f0-1c59b8e7b768 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] [instance: bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23433386232643732', 'path': '/dev/sdi'} {{(pid=71731) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 16:36:42 user nova-compute[71731]: DEBUG nova.objects.instance [None req-ca578feb-f4f8-4fa0-85f0-1c59b8e7b768 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lazy-loading 'flavor' on Instance uuid bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:36:42 user nova-compute[71731]: DEBUG nova.virt.libvirt.guest [None req-ca578feb-f4f8-4fa0-85f0-1c59b8e7b768 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] attach device xml: <disk type="block" device="disk">
Apr 13 16:36:42 user nova-compute[71731]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 16:36:42 user nova-compute[71731]:   <source dev="/dev/sdi"/>
Apr 13 16:36:42 user nova-compute[71731]:   <target dev="vdc" bus="virtio"/>
Apr 13 16:36:42 user nova-compute[71731]:   <serial>db98e2a6-2772-4d6b-80fc-67f564ded02b</serial>
Apr 13 16:36:42 user nova-compute[71731]: </disk>
Apr 13 16:36:42 user nova-compute[71731]:  {{(pid=71731) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 13 16:36:42 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-ca578feb-f4f8-4fa0-85f0-1c59b8e7b768 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] No BDM found with device name vda, not building metadata. {{(pid=71731) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 16:36:42 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-ca578feb-f4f8-4fa0-85f0-1c59b8e7b768 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71731) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 16:36:42 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-ca578feb-f4f8-4fa0-85f0-1c59b8e7b768 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] No BDM found with device name vdc, not building metadata. {{(pid=71731) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 16:36:42 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-ca578feb-f4f8-4fa0-85f0-1c59b8e7b768 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] No VIF found with MAC fa:16:3e:b9:56:b4, not building metadata {{(pid=71731) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 16:36:43 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-ca578feb-f4f8-4fa0-85f0-1c59b8e7b768 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lock "bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.503s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:36:44 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-80cb0e00-6cba-4c00-85a2-42ded02e5a22 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Acquiring lock "bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:36:44 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-80cb0e00-6cba-4c00-85a2-42ded02e5a22 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lock "bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:36:44 user nova-compute[71731]: INFO nova.compute.manager [None req-80cb0e00-6cba-4c00-85a2-42ded02e5a22 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] [instance: bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f] Detaching volume 548500fd-99a8-4cad-ade8-acd0fce2c8e8
Apr 13 16:36:44 user nova-compute[71731]: INFO nova.virt.block_device [None req-80cb0e00-6cba-4c00-85a2-42ded02e5a22 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] [instance: bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f] Attempting to driver detach volume 548500fd-99a8-4cad-ade8-acd0fce2c8e8 from mountpoint /dev/vdb
Apr 13 16:36:44 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-80cb0e00-6cba-4c00-85a2-42ded02e5a22 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Attempting to detach device vdb from instance bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f from the persistent domain config. {{(pid=71731) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 13 16:36:44 user nova-compute[71731]: DEBUG nova.virt.libvirt.guest [None req-80cb0e00-6cba-4c00-85a2-42ded02e5a22 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 16:36:44 user nova-compute[71731]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 16:36:44 user nova-compute[71731]:   <source dev="/dev/sdh"/>
Apr 13 16:36:44 user nova-compute[71731]:   <target dev="vdb" bus="virtio"/>
Apr 13 16:36:44 user nova-compute[71731]:   <serial>548500fd-99a8-4cad-ade8-acd0fce2c8e8</serial>
Apr 13 16:36:44 user nova-compute[71731]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 13 16:36:44 user nova-compute[71731]: </disk>
Apr 13 16:36:44 user nova-compute[71731]:  {{(pid=71731) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 16:36:44 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-80cb0e00-6cba-4c00-85a2-42ded02e5a22 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Successfully detached device vdb from instance bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f from the persistent domain config.
Apr 13 16:36:44 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-80cb0e00-6cba-4c00-85a2-42ded02e5a22 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f from the live domain config. {{(pid=71731) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 13 16:36:44 user nova-compute[71731]: DEBUG nova.virt.libvirt.guest [None req-80cb0e00-6cba-4c00-85a2-42ded02e5a22 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 16:36:44 user nova-compute[71731]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 16:36:44 user nova-compute[71731]:   <source dev="/dev/sdh"/>
Apr 13 16:36:44 user nova-compute[71731]:   <target dev="vdb" bus="virtio"/>
Apr 13 16:36:44 user nova-compute[71731]:   <serial>548500fd-99a8-4cad-ade8-acd0fce2c8e8</serial>
Apr 13 16:36:44 user nova-compute[71731]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 13 16:36:44 user nova-compute[71731]: </disk>
Apr 13 16:36:44 user nova-compute[71731]:  {{(pid=71731) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 16:36:44 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Received event <DeviceRemovedEvent: 1681403804.9313598, bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71731) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 13 16:36:44 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-80cb0e00-6cba-4c00-85a2-42ded02e5a22 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f {{(pid=71731) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 13 16:36:44 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-80cb0e00-6cba-4c00-85a2-42ded02e5a22 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Successfully detached device vdb from instance bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f from the live domain config.
Apr 13 16:36:44 user nova-compute[71731]: DEBUG nova.virt.libvirt.volume.iscsi [None req-80cb0e00-6cba-4c00-85a2-42ded02e5a22 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] [instance: bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f] calling os-brick to detach iSCSI Volume {{(pid=71731) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 16:36:44 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-80cb0e00-6cba-4c00-85a2-42ded02e5a22 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8cf0118790>, {'target_iqn': 'iqn.2010-10.org.openstack:548500fd-99a8-4cad-ade8-acd0fce2c8e8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zHAWmgtd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh': {}}" {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 16:36:44 user nova-compute[71731]: WARNING os_brick.initiator.connectors.base [None req-80cb0e00-6cba-4c00-85a2-42ded02e5a22 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 16:36:44 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-80cb0e00-6cba-4c00-85a2-42ded02e5a22 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 16:36:44 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-80cb0e00-6cba-4c00-85a2-42ded02e5a22 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 16:36:44 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:36:44 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:36:44 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[e839edc9-5d56-4d10-98c3-d12d5412a611]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c2088266-1d33-4bb1-ac5b-1de832ff7985\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b4a5ced3-77ae-4bf5-8154-bd1645e470f2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:548500fd-99a8-4cad-ade8-acd0fce2c8e8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:25c3dc97-c9cb-4529-ab32-26ef7fd94fc6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8156a054-43ea-4eeb-bbec-a270a6779a43\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:651ea766-ffda-42a1-9b3c-7be05a92c85f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:db98e2a6-2772-4d6b-80fc-67f564ded02b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:36:44 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-80cb0e00-6cba-4c00-85a2-42ded02e5a22 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 16:36:44 user nova-compute[71731]: No targets found.
Apr 13 16:36:44 user nova-compute[71731]: iSNS:
Apr 13 16:36:44 user nova-compute[71731]: No targets found.
Apr 13 16:36:44 user nova-compute[71731]: STATIC:
Apr 13 16:36:44 user nova-compute[71731]: Target: iqn.2010-10.org.openstack:c2088266-1d33-4bb1-ac5b-1de832ff7985
Apr 13 16:36:44 user nova-compute[71731]:         Portal: 172.16.0.220:3260,-1
Apr 13 16:36:44 user nova-compute[71731]:                 Iface Name: default
Apr 13 16:36:44 user nova-compute[71731]: Target: iqn.2010-10.org.openstack:b4a5ced3-77ae-4bf5-8154-bd1645e470f2
Apr 13 16:36:44 user nova-compute[71731]:         Portal: 172.16.0.220:3260,-1
Apr 13 16:36:44 user nova-compute[71731]:                 Iface Name: default
Apr 13 16:36:44 user nova-compute[71731]: Target: iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97
Apr 13 16:36:44 user nova-compute[71731]:         Portal: 172.16.0.220:3260,-1
Apr 13 16:36:44 user nova-compute[71731]:                 Iface Name: default
Apr 13 16:36:44 user nova-compute[71731]: Target: iqn.2010-10.org.openstack:548500fd-99a8-4cad-ade8-acd0fce2c8e8
Apr 13 16:36:44 user nova-compute[71731]:         Portal: 172.16.0.220:3260,-1
Apr 13 16:36:44 user nova-compute[71731]:                 Iface Name: default
Apr 13 16:36:44 user nova-compute[71731]: Target: iqn.2010-10.org.openstack:25c3dc97-c9cb-4529-ab32-26ef7fd94fc6
Apr 13 16:36:44 user nova-compute[71731]:         Portal: 172.16.0.220:3260,-1
Apr 13 16:36:44 user nova-compute[71731]:                 Iface Name: default
Apr 13 16:36:44 user nova-compute[71731]: Target: iqn.2010-10.org.openstack:8156a054-43ea-4eeb-bbec-a270a6779a43
Apr 13 16:36:44 user nova-compute[71731]:         Portal: 172.16.0.220:3260,-1
Apr 13 16:36:44 user nova-compute[71731]:                 Iface Name: default
Apr 13 16:36:44 user nova-compute[71731]: Target: iqn.2010-10.org.openstack:651ea766-ffda-42a1-9b3c-7be05a92c85f
Apr 13 16:36:44 user nova-compute[71731]:         Portal: 172.16.0.220:3260,-1
Apr 13 16:36:44 user nova-compute[71731]:                 Iface Name: default
Apr 13 16:36:44 user nova-compute[71731]: Target: iqn.2010-10.org.openstack:db98e2a6-2772-4d6b-80fc-67f564ded02b
Apr 13 16:36:44 user nova-compute[71731]:         Portal: 172.16.0.220:3260,-1
Apr 13 16:36:44 user nova-compute[71731]:                 Iface Name: default
Apr 13 16:36:44 user nova-compute[71731]: FIRMWARE:
Apr 13 16:36:44 user nova-compute[71731]: No targets found.
Apr 13 16:36:44 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 16:36:44 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-80cb0e00-6cba-4c00-85a2-42ded02e5a22 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 16:36:44 user nova-compute[71731]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 16:36:44 user nova-compute[71731]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71731) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 16:36:44 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-80cb0e00-6cba-4c00-85a2-42ded02e5a22 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:548500fd-99a8-4cad-ade8-acd0fce2c8e8', 0)] {{(pid=71731) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 16:36:44 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:36:44 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:36:44 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[b89682f5-4749-42cc-ac1b-c45651b1f0db]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:25c3dc97-c9cb-4529-ab32-26ef7fd94fc6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:548500fd-99a8-4cad-ade8-acd0fce2c8e8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:651ea766-ffda-42a1-9b3c-7be05a92c85f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8156a054-43ea-4eeb-bbec-a270a6779a43\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b4a5ced3-77ae-4bf5-8154-bd1645e470f2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c2088266-1d33-4bb1-ac5b-1de832ff7985\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:db98e2a6-2772-4d6b-80fc-67f564ded02b\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:36:44 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:36:45 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:36:45 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f3f2119-24c8-481f-99c6-297e192034c3]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25c3dc97-c9cb-4529-ab32-26ef7fd94fc6 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2088266-1d33-4bb1-ac5b-1de832ff7985 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:651ea766-ffda-42a1-9b3c-7be05a92c85f (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4a5ced3-77ae-4bf5-8154-bd1645e470f2 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8156a054-43ea-4eeb-bbec-a270a6779a43 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:548500fd-99a8-4cad-ade8-acd0fce2c8e8 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db98e2a6-2772-4d6b-80fc-67f564ded02b (non-flash)\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:36:45 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-80cb0e00-6cba-4c00-85a2-42ded02e5a22 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)
Apr 13 16:36:45 user nova-compute[71731]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25c3dc97-c9cb-4529-ab32-26ef7fd94fc6 (non-flash)
Apr 13 16:36:45 user nova-compute[71731]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2088266-1d33-4bb1-ac5b-1de832ff7985 (non-flash)
Apr 13 16:36:45 user nova-compute[71731]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:651ea766-ffda-42a1-9b3c-7be05a92c85f (non-flash)
Apr 13 16:36:45 user nova-compute[71731]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4a5ced3-77ae-4bf5-8154-bd1645e470f2 (non-flash)
Apr 13 16:36:45 user nova-compute[71731]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8156a054-43ea-4eeb-bbec-a270a6779a43 (non-flash)
Apr 13 16:36:45 user nova-compute[71731]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:548500fd-99a8-4cad-ade8-acd0fce2c8e8 (non-flash)
Apr 13 16:36:45 user nova-compute[71731]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db98e2a6-2772-4d6b-80fc-67f564ded02b (non-flash)
Apr 13 16:36:45 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 16:36:45 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-80cb0e00-6cba-4c00-85a2-42ded02e5a22 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)
Apr 13 16:36:45 user nova-compute[71731]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25c3dc97-c9cb-4529-ab32-26ef7fd94fc6 (non-flash)
Apr 13 16:36:45 user nova-compute[71731]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2088266-1d33-4bb1-ac5b-1de832ff7985 (non-flash)
Apr 13 16:36:45 user nova-compute[71731]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:651ea766-ffda-42a1-9b3c-7be05a92c85f (non-flash)
Apr 13 16:36:45 user nova-compute[71731]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4a5ced3-77ae-4bf5-8154-bd1645e470f2 (non-flash)
Apr 13 16:36:45 user nova-compute[71731]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8156a054-43ea-4eeb-bbec-a270a6779a43 (non-flash)
Apr 13 16:36:45 user nova-compute[71731]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:548500fd-99a8-4cad-ade8-acd0fce2c8e8 (non-flash)
Apr 13 16:36:45 user nova-compute[71731]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db98e2a6-2772-4d6b-80fc-67f564ded02b (non-flash)
Apr 13 16:36:45 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 16:36:45 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-80cb0e00-6cba-4c00-85a2-42ded02e5a22 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8cd019de10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:548500fd-99a8-4cad-ade8-acd0fce2c8e8'): ({'sdh'}, set())}) {{(pid=71731) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 16:36:45 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-80cb0e00-6cba-4c00-85a2-42ded02e5a22 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Removing single pathed devices sdh {{(pid=71731) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 16:36:45 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:36:45 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.030s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:36:45 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff6d121f-316c-4490-a5e8-1d709fed46f6]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:36:45 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:36:45 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.019s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:36:45 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b1b25ad-e68d-475e-8b64-d77b9501960a]: (4, ('ok\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:36:45 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-80cb0e00-6cba-4c00-85a2-42ded02e5a22 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Flushing IO for device /dev/sdh {{(pid=71731) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 16:36:45 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:36:45 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.017s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:36:45 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d396c6f-453f-44d5-9d28-fd20e02b5d0c]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:36:45 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-80cb0e00-6cba-4c00-85a2-42ded02e5a22 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=71731) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 16:36:45 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:36:45 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.040s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:36:45 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb74cc73-1d3c-4ec6-b49c-4d9d9c1d0dc0]: (4, ('1', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:36:45 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-80cb0e00-6cba-4c00-85a2-42ded02e5a22 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=71731) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 16:36:45 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-80cb0e00-6cba-4c00-85a2-42ded02e5a22 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] SCSI volumes sdh have been removed. {{(pid=71731) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 16:36:45 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-80cb0e00-6cba-4c00-85a2-42ded02e5a22 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:548500fd-99a8-4cad-ade8-acd0fce2c8e8')] {{(pid=71731) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 16:36:45 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:548500fd-99a8-4cad-ade8-acd0fce2c8e8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:36:45 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:548500fd-99a8-4cad-ade8-acd0fce2c8e8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:36:45 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[890cf167-84d1-4e22-8bd3-17ba2fcf972b]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:36:45 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-80cb0e00-6cba-4c00-85a2-42ded02e5a22 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:36:45 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:548500fd-99a8-4cad-ade8-acd0fce2c8e8 -p 172.16.0.220:3260 --logout {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:36:45 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:548500fd-99a8-4cad-ade8-acd0fce2c8e8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:36:45 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c32860f-9d4d-4f58-9fb5-df55930b842c]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:548500fd-99a8-4cad-ade8-acd0fce2c8e8, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:548500fd-99a8-4cad-ade8-acd0fce2c8e8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:36:45 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-80cb0e00-6cba-4c00-85a2-42ded02e5a22 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:548500fd-99a8-4cad-ade8-acd0fce2c8e8, portal: 172.16.0.220,3260]
Apr 13 16:36:45 user nova-compute[71731]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:548500fd-99a8-4cad-ade8-acd0fce2c8e8, portal: 172.16.0.220,3260] successful.
Apr 13 16:36:45 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:36:45 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:548500fd-99a8-4cad-ade8-acd0fce2c8e8 -p 172.16.0.220:3260 --op delete {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:36:45 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:548500fd-99a8-4cad-ade8-acd0fce2c8e8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:36:45 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3354ccd-7f03-402f-861e-81191b8874e8]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:36:45 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-80cb0e00-6cba-4c00-85a2-42ded02e5a22 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:36:45 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-80cb0e00-6cba-4c00-85a2-42ded02e5a22 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.346s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 16:36:45 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-80cb0e00-6cba-4c00-85a2-42ded02e5a22 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] <== disconnect_volume: return (347ms) None {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 16:36:45 user nova-compute[71731]: DEBUG nova.virt.libvirt.volume.iscsi [None req-80cb0e00-6cba-4c00-85a2-42ded02e5a22 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] [instance: bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f] Disconnected iSCSI Volume {{(pid=71731) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 16:36:46 user nova-compute[71731]: DEBUG nova.objects.instance [None req-80cb0e00-6cba-4c00-85a2-42ded02e5a22 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lazy-loading 'flavor' on Instance uuid bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:36:46 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-80cb0e00-6cba-4c00-85a2-42ded02e5a22 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lock "bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.671s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:36:46 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:36:46 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-a97a0e87-bc01-4de6-a4d6-805536885c9a tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Acquiring lock "bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:36:46 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-a97a0e87-bc01-4de6-a4d6-805536885c9a tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lock "bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:36:46 user nova-compute[71731]: INFO nova.compute.manager [None req-a97a0e87-bc01-4de6-a4d6-805536885c9a tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] [instance: bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f] Detaching volume db98e2a6-2772-4d6b-80fc-67f564ded02b
Apr 13 16:36:46 user nova-compute[71731]: INFO nova.virt.block_device [None req-a97a0e87-bc01-4de6-a4d6-805536885c9a tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] [instance: bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f] Attempting to driver detach volume db98e2a6-2772-4d6b-80fc-67f564ded02b from mountpoint /dev/vdc
Apr 13 16:36:46 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-a97a0e87-bc01-4de6-a4d6-805536885c9a tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Attempting to detach device vdc from instance bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f from the persistent domain config. {{(pid=71731) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 13 16:36:46 user nova-compute[71731]: DEBUG nova.virt.libvirt.guest [None req-a97a0e87-bc01-4de6-a4d6-805536885c9a tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 16:36:46 user nova-compute[71731]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 16:36:46 user nova-compute[71731]:   <source dev="/dev/sdi"/>
Apr 13 16:36:46 user nova-compute[71731]:   <target dev="vdc" bus="virtio"/>
Apr 13 16:36:46 user nova-compute[71731]:   <serial>db98e2a6-2772-4d6b-80fc-67f564ded02b</serial>
Apr 13 16:36:46 user nova-compute[71731]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Apr 13 16:36:46 user nova-compute[71731]: </disk>
Apr 13 16:36:46 user nova-compute[71731]:  {{(pid=71731) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 16:36:46 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-a97a0e87-bc01-4de6-a4d6-805536885c9a tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Successfully detached device vdc from instance bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f from the persistent domain config.
Apr 13 16:36:46 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-a97a0e87-bc01-4de6-a4d6-805536885c9a tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f from the live domain config. {{(pid=71731) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 13 16:36:46 user nova-compute[71731]: DEBUG nova.virt.libvirt.guest [None req-a97a0e87-bc01-4de6-a4d6-805536885c9a tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 16:36:46 user nova-compute[71731]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 16:36:46 user nova-compute[71731]:   <source dev="/dev/sdi"/>
Apr 13 16:36:46 user nova-compute[71731]:   <target dev="vdc" bus="virtio"/>
Apr 13 16:36:46 user nova-compute[71731]:   <serial>db98e2a6-2772-4d6b-80fc-67f564ded02b</serial>
Apr 13 16:36:46 user nova-compute[71731]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Apr 13 16:36:46 user nova-compute[71731]: </disk>
Apr 13 16:36:46 user nova-compute[71731]:  {{(pid=71731) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 16:36:46 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:36:47 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Received event <DeviceRemovedEvent: 1681403807.3196018, bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=71731) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 13 16:36:47 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-a97a0e87-bc01-4de6-a4d6-805536885c9a tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f {{(pid=71731) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 13 16:36:47 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-a97a0e87-bc01-4de6-a4d6-805536885c9a tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Successfully detached device vdc from instance bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f from the live domain config.
Apr 13 16:36:47 user nova-compute[71731]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a97a0e87-bc01-4de6-a4d6-805536885c9a tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] [instance: bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f] calling os-brick to detach iSCSI Volume {{(pid=71731) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 16:36:47 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-a97a0e87-bc01-4de6-a4d6-805536885c9a tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8cf0118790>, {'target_iqn': 'iqn.2010-10.org.openstack:db98e2a6-2772-4d6b-80fc-67f564ded02b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wqeIrFcC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi': {}}" {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 16:36:47 user nova-compute[71731]: WARNING os_brick.initiator.connectors.base [None req-a97a0e87-bc01-4de6-a4d6-805536885c9a tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 16:36:47 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-a97a0e87-bc01-4de6-a4d6-805536885c9a tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 16:36:47 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-a97a0e87-bc01-4de6-a4d6-805536885c9a tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 16:36:47 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:36:47 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:36:47 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[387a4dbd-8121-4819-a1e1-1524811e76b9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c2088266-1d33-4bb1-ac5b-1de832ff7985\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b4a5ced3-77ae-4bf5-8154-bd1645e470f2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:25c3dc97-c9cb-4529-ab32-26ef7fd94fc6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8156a054-43ea-4eeb-bbec-a270a6779a43\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:651ea766-ffda-42a1-9b3c-7be05a92c85f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:db98e2a6-2772-4d6b-80fc-67f564ded02b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:36:47 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-a97a0e87-bc01-4de6-a4d6-805536885c9a tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 16:36:47 user nova-compute[71731]: No targets found.
Apr 13 16:36:47 user nova-compute[71731]: iSNS:
Apr 13 16:36:47 user nova-compute[71731]: No targets found.
Apr 13 16:36:47 user nova-compute[71731]: STATIC:
Apr 13 16:36:47 user nova-compute[71731]: Target: iqn.2010-10.org.openstack:c2088266-1d33-4bb1-ac5b-1de832ff7985
Apr 13 16:36:47 user nova-compute[71731]:         Portal: 172.16.0.220:3260,-1
Apr 13 16:36:47 user nova-compute[71731]:                 Iface Name: default
Apr 13 16:36:47 user nova-compute[71731]: Target: iqn.2010-10.org.openstack:b4a5ced3-77ae-4bf5-8154-bd1645e470f2
Apr 13 16:36:47 user nova-compute[71731]:         Portal: 172.16.0.220:3260,-1
Apr 13 16:36:47 user nova-compute[71731]:                 Iface Name: default
Apr 13 16:36:47 user nova-compute[71731]: Target: iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97
Apr 13 16:36:47 user nova-compute[71731]:         Portal: 172.16.0.220:3260,-1
Apr 13 16:36:47 user nova-compute[71731]:                 Iface Name: default
Apr 13 16:36:47 user nova-compute[71731]: Target: iqn.2010-10.org.openstack:25c3dc97-c9cb-4529-ab32-26ef7fd94fc6
Apr 13 16:36:47 user nova-compute[71731]:         Portal: 172.16.0.220:3260,-1
Apr 13 16:36:47 user nova-compute[71731]:                 Iface Name: default
Apr 13 16:36:47 user nova-compute[71731]: Target: iqn.2010-10.org.openstack:8156a054-43ea-4eeb-bbec-a270a6779a43
Apr 13 16:36:47 user nova-compute[71731]:         Portal: 172.16.0.220:3260,-1
Apr 13 16:36:47 user nova-compute[71731]:                 Iface Name: default
Apr 13 16:36:47 user nova-compute[71731]: Target: iqn.2010-10.org.openstack:651ea766-ffda-42a1-9b3c-7be05a92c85f
Apr 13 16:36:47 user nova-compute[71731]:         Portal: 172.16.0.220:3260,-1
Apr 13 16:36:47 user nova-compute[71731]:                 Iface Name: default
Apr 13 16:36:47 user nova-compute[71731]: Target: iqn.2010-10.org.openstack:db98e2a6-2772-4d6b-80fc-67f564ded02b
Apr 13 16:36:47 user nova-compute[71731]:         Portal: 172.16.0.220:3260,-1
Apr 13 16:36:47 user nova-compute[71731]:                 Iface Name: default
Apr 13 16:36:47 user nova-compute[71731]: FIRMWARE:
Apr 13 16:36:47 user nova-compute[71731]: No targets found.
Apr 13 16:36:47 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 16:36:47 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-a97a0e87-bc01-4de6-a4d6-805536885c9a tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 16:36:47 user nova-compute[71731]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 16:36:47 user nova-compute[71731]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71731) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 16:36:47 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-a97a0e87-bc01-4de6-a4d6-805536885c9a tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:db98e2a6-2772-4d6b-80fc-67f564ded02b', 0)] {{(pid=71731) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 16:36:47 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:36:47 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:36:47 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5dec821-0afa-4797-9986-92fb761ee07f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:25c3dc97-c9cb-4529-ab32-26ef7fd94fc6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:651ea766-ffda-42a1-9b3c-7be05a92c85f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8156a054-43ea-4eeb-bbec-a270a6779a43\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b4a5ced3-77ae-4bf5-8154-bd1645e470f2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c2088266-1d33-4bb1-ac5b-1de832ff7985\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:db98e2a6-2772-4d6b-80fc-67f564ded02b\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:36:47 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:36:47 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:36:47 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3672f11-9408-4485-b6b5-3ee739d5a20a]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25c3dc97-c9cb-4529-ab32-26ef7fd94fc6 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2088266-1d33-4bb1-ac5b-1de832ff7985 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:651ea766-ffda-42a1-9b3c-7be05a92c85f (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4a5ced3-77ae-4bf5-8154-bd1645e470f2 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8156a054-43ea-4eeb-bbec-a270a6779a43 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db98e2a6-2772-4d6b-80fc-67f564ded02b (non-flash)\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:36:47 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-a97a0e87-bc01-4de6-a4d6-805536885c9a tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)
Apr 13 16:36:47 user nova-compute[71731]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25c3dc97-c9cb-4529-ab32-26ef7fd94fc6 (non-flash)
Apr 13 16:36:47 user nova-compute[71731]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2088266-1d33-4bb1-ac5b-1de832ff7985 (non-flash)
Apr 13 16:36:47 user nova-compute[71731]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:651ea766-ffda-42a1-9b3c-7be05a92c85f (non-flash)
Apr 13 16:36:47 user nova-compute[71731]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4a5ced3-77ae-4bf5-8154-bd1645e470f2 (non-flash)
Apr 13 16:36:47 user nova-compute[71731]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8156a054-43ea-4eeb-bbec-a270a6779a43 (non-flash)
Apr 13 16:36:47 user nova-compute[71731]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db98e2a6-2772-4d6b-80fc-67f564ded02b (non-flash)
Apr 13 16:36:47 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 16:36:47 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-a97a0e87-bc01-4de6-a4d6-805536885c9a tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)
Apr 13 16:36:47 user nova-compute[71731]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25c3dc97-c9cb-4529-ab32-26ef7fd94fc6 (non-flash)
Apr 13 16:36:47 user nova-compute[71731]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2088266-1d33-4bb1-ac5b-1de832ff7985 (non-flash)
Apr 13 16:36:47 user nova-compute[71731]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:651ea766-ffda-42a1-9b3c-7be05a92c85f (non-flash)
Apr 13 16:36:47 user nova-compute[71731]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4a5ced3-77ae-4bf5-8154-bd1645e470f2 (non-flash)
Apr 13 16:36:47 user nova-compute[71731]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8156a054-43ea-4eeb-bbec-a270a6779a43 (non-flash)
Apr 13 16:36:47 user nova-compute[71731]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db98e2a6-2772-4d6b-80fc-67f564ded02b (non-flash)
Apr 13 16:36:47 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 16:36:47 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-a97a0e87-bc01-4de6-a4d6-805536885c9a tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8cf0275870>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:db98e2a6-2772-4d6b-80fc-67f564ded02b'): ({'sdi'}, set())}) {{(pid=71731) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 16:36:47 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-a97a0e87-bc01-4de6-a4d6-805536885c9a tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Removing single pathed devices sdi {{(pid=71731) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 16:36:47 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:36:47 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:36:47 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ab76a51-4dd5-4a26-b811-3cebcbb8c16c]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:36:47 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:36:47 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.019s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:36:47 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dc84931-7ad4-4f06-b117-c47634c542ea]: (4, ('ok\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:36:47 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-a97a0e87-bc01-4de6-a4d6-805536885c9a tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Flushing IO for device /dev/sdi {{(pid=71731) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 16:36:47 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:36:47 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.014s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:36:47 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[157b776f-e595-4669-8cfa-ea41f73128c3]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:36:47 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-a97a0e87-bc01-4de6-a4d6-805536885c9a tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=71731) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 16:36:47 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:36:47 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.041s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:36:47 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[42e0a7a8-fd45-4812-81ec-16436061a4bf]: (4, ('1', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:36:47 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-a97a0e87-bc01-4de6-a4d6-805536885c9a tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=71731) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 16:36:47 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-a97a0e87-bc01-4de6-a4d6-805536885c9a tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] SCSI volumes sdi have been removed. {{(pid=71731) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 16:36:47 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-a97a0e87-bc01-4de6-a4d6-805536885c9a tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:db98e2a6-2772-4d6b-80fc-67f564ded02b')] {{(pid=71731) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 16:36:47 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db98e2a6-2772-4d6b-80fc-67f564ded02b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:36:47 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db98e2a6-2772-4d6b-80fc-67f564ded02b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:36:47 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fec8419-f959-4111-9a44-1b599af83f3f]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:36:47 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-a97a0e87-bc01-4de6-a4d6-805536885c9a tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:36:47 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db98e2a6-2772-4d6b-80fc-67f564ded02b -p 172.16.0.220:3260 --logout {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:36:47 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db98e2a6-2772-4d6b-80fc-67f564ded02b -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:36:47 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7da9994-357a-4ecf-be30-2a12843070ab]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:db98e2a6-2772-4d6b-80fc-67f564ded02b, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:db98e2a6-2772-4d6b-80fc-67f564ded02b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:36:47 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-a97a0e87-bc01-4de6-a4d6-805536885c9a tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:db98e2a6-2772-4d6b-80fc-67f564ded02b, portal: 172.16.0.220,3260]
Apr 13 16:36:47 user nova-compute[71731]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:db98e2a6-2772-4d6b-80fc-67f564ded02b, portal: 172.16.0.220,3260] successful.
Apr 13 16:36:47 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:36:47 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db98e2a6-2772-4d6b-80fc-67f564ded02b -p 172.16.0.220:3260 --op delete {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:36:47 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db98e2a6-2772-4d6b-80fc-67f564ded02b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:36:47 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[006905d7-721f-422e-bafe-839e69b6cf90]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:36:47 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-a97a0e87-bc01-4de6-a4d6-805536885c9a tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:36:47 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-a97a0e87-bc01-4de6-a4d6-805536885c9a tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.319s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 16:36:47 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-a97a0e87-bc01-4de6-a4d6-805536885c9a tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] <== disconnect_volume: return (320ms) None {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 16:36:47 user nova-compute[71731]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a97a0e87-bc01-4de6-a4d6-805536885c9a tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] [instance: bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f] Disconnected iSCSI Volume {{(pid=71731) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 16:36:48 user nova-compute[71731]: DEBUG nova.objects.instance [None req-a97a0e87-bc01-4de6-a4d6-805536885c9a tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lazy-loading 'flavor' on Instance uuid bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:36:48 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-a97a0e87-bc01-4de6-a4d6-805536885c9a tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lock "bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.621s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:36:49 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-df36a749-5094-4bbd-bdba-3ae092dc6127 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Acquiring lock "bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:36:49 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-df36a749-5094-4bbd-bdba-3ae092dc6127 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lock "bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:36:49 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-df36a749-5094-4bbd-bdba-3ae092dc6127 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Acquiring lock "bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:36:49 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-df36a749-5094-4bbd-bdba-3ae092dc6127 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lock "bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:36:49 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-df36a749-5094-4bbd-bdba-3ae092dc6127 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lock "bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:36:49 user nova-compute[71731]: INFO nova.compute.manager [None req-df36a749-5094-4bbd-bdba-3ae092dc6127 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] [instance: bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f] Terminating instance
Apr 13 16:36:49 user nova-compute[71731]: DEBUG nova.compute.manager [None req-df36a749-5094-4bbd-bdba-3ae092dc6127 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] [instance: bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f] Start destroying the instance on the hypervisor. {{(pid=71731) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 16:36:49 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:36:49 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:36:49 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:36:49 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:36:49 user nova-compute[71731]: DEBUG nova.compute.manager [req-c3ec3535-01aa-414b-8768-9e9d41efc98b req-31e77605-983e-45c2-932a-1133cf00b0dd service nova] [instance: bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f] Received event network-vif-unplugged-adf9438c-79e3-494a-8650-1b7377eb1062 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:36:49 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-c3ec3535-01aa-414b-8768-9e9d41efc98b req-31e77605-983e-45c2-932a-1133cf00b0dd service nova] Acquiring lock "bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:36:49 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-c3ec3535-01aa-414b-8768-9e9d41efc98b req-31e77605-983e-45c2-932a-1133cf00b0dd service nova] Lock "bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:36:49 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-c3ec3535-01aa-414b-8768-9e9d41efc98b req-31e77605-983e-45c2-932a-1133cf00b0dd service nova] Lock "bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:36:49 user nova-compute[71731]: DEBUG nova.compute.manager [req-c3ec3535-01aa-414b-8768-9e9d41efc98b req-31e77605-983e-45c2-932a-1133cf00b0dd service nova] [instance: bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f] No waiting events found dispatching network-vif-unplugged-adf9438c-79e3-494a-8650-1b7377eb1062 {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:36:49 user nova-compute[71731]: DEBUG nova.compute.manager [req-c3ec3535-01aa-414b-8768-9e9d41efc98b req-31e77605-983e-45c2-932a-1133cf00b0dd service nova] [instance: bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f] Received event network-vif-unplugged-adf9438c-79e3-494a-8650-1b7377eb1062 for instance with task_state deleting. {{(pid=71731) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 16:36:50 user nova-compute[71731]: INFO nova.virt.libvirt.driver [-] [instance: bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f] Instance destroyed successfully.
Apr 13 16:36:50 user nova-compute[71731]: DEBUG nova.objects.instance [None req-df36a749-5094-4bbd-bdba-3ae092dc6127 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lazy-loading 'resources' on Instance uuid bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:36:50 user nova-compute[71731]: DEBUG nova.virt.libvirt.vif [None req-df36a749-5094-4bbd-bdba-3ae092dc6127 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T16:34:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1992841975',display_name='tempest-AttachVolumeTestJSON-server-1992841975',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1992841975',id=31,image_ref='708622a9-7465-4492-ade8-b827198f7e30',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLg/aZ/97WQm57BWlEGmEo0ZDYs6AZHEJTQdcUXAw6+zT4F/07+PSqHmlqw9dViVyDHhb8Ilq3sNANdJ79ikkzymwHsi3VIfAMe6DINfLbAXFmb5kKQf4wM+nlJI9ERH2Q==',key_name='tempest-keypair-2008404613',keypairs=<?>,launch_index=0,launched_at=2023-04-13T16:34:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='24904988cf334657b084fd726c7ecf8f',ramdisk_id='',reservation_id='r-el8qhxg7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='708622a9-7465-4492-ade8-b827198f7e30',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-836650657',owner_user_name='tempest-AttachVolumeTestJSON-836650657-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T16:34:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='47fab402fb794a5a9281cfb7fe188813',uuid=bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "adf9438c-79e3-494a-8650-1b7377eb1062", "address": "fa:16:3e:b9:56:b4", "network": {"id": "79e9ef20-b14d-4850-b298-9d3ed4d10b90", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1756253617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24904988cf334657b084fd726c7ecf8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadf9438c-79", "ovs_interfaceid": "adf9438c-79e3-494a-8650-1b7377eb1062", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 16:36:50 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-df36a749-5094-4bbd-bdba-3ae092dc6127 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Converting VIF {"id": "adf9438c-79e3-494a-8650-1b7377eb1062", "address": "fa:16:3e:b9:56:b4", "network": {"id": "79e9ef20-b14d-4850-b298-9d3ed4d10b90", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1756253617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24904988cf334657b084fd726c7ecf8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadf9438c-79", "ovs_interfaceid": "adf9438c-79e3-494a-8650-1b7377eb1062", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 16:36:50 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-df36a749-5094-4bbd-bdba-3ae092dc6127 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b9:56:b4,bridge_name='br-int',has_traffic_filtering=True,id=adf9438c-79e3-494a-8650-1b7377eb1062,network=Network(79e9ef20-b14d-4850-b298-9d3ed4d10b90),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapadf9438c-79') {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 16:36:50 user nova-compute[71731]: DEBUG os_vif [None req-df36a749-5094-4bbd-bdba-3ae092dc6127 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b9:56:b4,bridge_name='br-int',has_traffic_filtering=True,id=adf9438c-79e3-494a-8650-1b7377eb1062,network=Network(79e9ef20-b14d-4850-b298-9d3ed4d10b90),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapadf9438c-79') {{(pid=71731) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 16:36:50 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:36:50 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapadf9438c-79, bridge=br-int, if_exists=True) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:36:50 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:36:50 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 16:36:50 user nova-compute[71731]: INFO os_vif [None req-df36a749-5094-4bbd-bdba-3ae092dc6127 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b9:56:b4,bridge_name='br-int',has_traffic_filtering=True,id=adf9438c-79e3-494a-8650-1b7377eb1062,network=Network(79e9ef20-b14d-4850-b298-9d3ed4d10b90),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapadf9438c-79')
Apr 13 16:36:50 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-df36a749-5094-4bbd-bdba-3ae092dc6127 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] [instance: bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f] Deleting instance files /opt/stack/data/nova/instances/bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f_del
Apr 13 16:36:50 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-df36a749-5094-4bbd-bdba-3ae092dc6127 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] [instance: bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f] Deletion of /opt/stack/data/nova/instances/bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f_del complete
Apr 13 16:36:50 user nova-compute[71731]: INFO nova.compute.manager [None req-df36a749-5094-4bbd-bdba-3ae092dc6127 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] [instance: bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f] Took 0.84 seconds to destroy the instance on the hypervisor.
Apr 13 16:36:50 user nova-compute[71731]: DEBUG oslo.service.loopingcall [None req-df36a749-5094-4bbd-bdba-3ae092dc6127 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71731) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 16:36:50 user nova-compute[71731]: DEBUG nova.compute.manager [-] [instance: bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f] Deallocating network for instance {{(pid=71731) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 16:36:50 user nova-compute[71731]: DEBUG nova.network.neutron [-] [instance: bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f] deallocate_for_instance() {{(pid=71731) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 16:36:50 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:36:51 user nova-compute[71731]: DEBUG nova.network.neutron [-] [instance: bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f] Updating instance_info_cache with network_info: [] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:36:51 user nova-compute[71731]: INFO nova.compute.manager [-] [instance: bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f] Took 0.70 seconds to deallocate network for instance.
Apr 13 16:36:51 user nova-compute[71731]: DEBUG nova.compute.manager [req-a39ec604-d119-4600-9f67-bc95efa24c7f req-27e51a92-71fe-4c84-93d2-6e36b73bebfe service nova] [instance: bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f] Received event network-vif-deleted-adf9438c-79e3-494a-8650-1b7377eb1062 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:36:51 user nova-compute[71731]: INFO nova.compute.manager [req-a39ec604-d119-4600-9f67-bc95efa24c7f req-27e51a92-71fe-4c84-93d2-6e36b73bebfe service nova] [instance: bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f] Neutron deleted interface adf9438c-79e3-494a-8650-1b7377eb1062; detaching it from the instance and deleting it from the info cache
Apr 13 16:36:51 user nova-compute[71731]: DEBUG nova.network.neutron [req-a39ec604-d119-4600-9f67-bc95efa24c7f req-27e51a92-71fe-4c84-93d2-6e36b73bebfe service nova] [instance: bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f] Updating instance_info_cache with network_info: [] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:36:51 user nova-compute[71731]: DEBUG nova.compute.manager [req-a39ec604-d119-4600-9f67-bc95efa24c7f req-27e51a92-71fe-4c84-93d2-6e36b73bebfe service nova] [instance: bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f] Detach interface failed, port_id=adf9438c-79e3-494a-8650-1b7377eb1062, reason: Instance bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f could not be found. {{(pid=71731) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 13 16:36:51 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-df36a749-5094-4bbd-bdba-3ae092dc6127 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:36:51 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-df36a749-5094-4bbd-bdba-3ae092dc6127 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:36:51 user nova-compute[71731]: DEBUG nova.scheduler.client.report [None req-df36a749-5094-4bbd-bdba-3ae092dc6127 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Refreshing inventories for resource provider cb6b1a64-0c24-4e2d-af1e-16576ca9165c {{(pid=71731) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 13 16:36:51 user nova-compute[71731]: DEBUG nova.scheduler.client.report [None req-df36a749-5094-4bbd-bdba-3ae092dc6127 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Updating ProviderTree inventory for provider cb6b1a64-0c24-4e2d-af1e-16576ca9165c from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71731) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 13 16:36:51 user nova-compute[71731]: DEBUG nova.compute.provider_tree [None req-df36a749-5094-4bbd-bdba-3ae092dc6127 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Updating inventory in ProviderTree for provider cb6b1a64-0c24-4e2d-af1e-16576ca9165c with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71731) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 13 16:36:51 user nova-compute[71731]: DEBUG nova.scheduler.client.report [None req-df36a749-5094-4bbd-bdba-3ae092dc6127 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Refreshing aggregate associations for resource provider cb6b1a64-0c24-4e2d-af1e-16576ca9165c, aggregates: None {{(pid=71731) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 13 16:36:51 user nova-compute[71731]: DEBUG nova.scheduler.client.report [None req-df36a749-5094-4bbd-bdba-3ae092dc6127 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Refreshing trait associations for resource provider cb6b1a64-0c24-4e2d-af1e-16576ca9165c, traits: COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSSE3,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_SATA,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_SSE,COMPUTE_RESCUE_BFV,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE41,HW_CPU_X86_MMX,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_RAW {{(pid=71731) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 13 16:36:51 user nova-compute[71731]: DEBUG nova.compute.provider_tree [None req-df36a749-5094-4bbd-bdba-3ae092dc6127 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Inventory has not changed in ProviderTree for provider: cb6b1a64-0c24-4e2d-af1e-16576ca9165c {{(pid=71731) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 16:36:51 user nova-compute[71731]: DEBUG nova.scheduler.client.report [None req-df36a749-5094-4bbd-bdba-3ae092dc6127 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Inventory has not changed for provider cb6b1a64-0c24-4e2d-af1e-16576ca9165c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71731) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 16:36:51 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-df36a749-5094-4bbd-bdba-3ae092dc6127 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.651s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:36:51 user nova-compute[71731]: INFO nova.scheduler.client.report [None req-df36a749-5094-4bbd-bdba-3ae092dc6127 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Deleted allocations for instance bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f
Apr 13 16:36:51 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-df36a749-5094-4bbd-bdba-3ae092dc6127 tempest-AttachVolumeTestJSON-836650657 tempest-AttachVolumeTestJSON-836650657-project-member] Lock "bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.386s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:36:52 user nova-compute[71731]: DEBUG nova.compute.manager [req-48ed2716-bda3-4553-9e9d-296d2579b5c5 req-6202ac3d-de8e-4426-ad53-ecb17238eff2 service nova] [instance: bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f] Received event network-vif-plugged-adf9438c-79e3-494a-8650-1b7377eb1062 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:36:52 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-48ed2716-bda3-4553-9e9d-296d2579b5c5 req-6202ac3d-de8e-4426-ad53-ecb17238eff2 service nova] Acquiring lock "bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:36:52 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-48ed2716-bda3-4553-9e9d-296d2579b5c5 req-6202ac3d-de8e-4426-ad53-ecb17238eff2 service nova] Lock "bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:36:52 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-48ed2716-bda3-4553-9e9d-296d2579b5c5 req-6202ac3d-de8e-4426-ad53-ecb17238eff2 service nova] Lock "bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:36:52 user nova-compute[71731]: DEBUG nova.compute.manager [req-48ed2716-bda3-4553-9e9d-296d2579b5c5 req-6202ac3d-de8e-4426-ad53-ecb17238eff2 service nova] [instance: bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f] No waiting events found dispatching network-vif-plugged-adf9438c-79e3-494a-8650-1b7377eb1062 {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:36:52 user nova-compute[71731]: WARNING nova.compute.manager [req-48ed2716-bda3-4553-9e9d-296d2579b5c5 req-6202ac3d-de8e-4426-ad53-ecb17238eff2 service nova] [instance: bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f] Received unexpected event network-vif-plugged-adf9438c-79e3-494a-8650-1b7377eb1062 for instance with vm_state deleted and task_state None.
Apr 13 16:36:55 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:36:56 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:37:00 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:37:01 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:37:05 user nova-compute[71731]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681403810.336327, bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f => Stopped> {{(pid=71731) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 16:37:05 user nova-compute[71731]: INFO nova.compute.manager [-] [instance: bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f] VM Stopped (Lifecycle Event)
Apr 13 16:37:05 user nova-compute[71731]: DEBUG nova.compute.manager [None req-b9edb2c2-4ebc-4d24-b597-77833efcdd85 None None] [instance: bd9b303d-a8f3-4c0e-b5f2-0fce49c2304f] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:37:05 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:37:06 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:37:09 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-ea6a7b68-19e1-45d8-bcdb-631184bc86b2 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Acquiring lock "acbcaee0-a47b-4fee-8765-9b1c9597d515" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:37:09 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-ea6a7b68-19e1-45d8-bcdb-631184bc86b2 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "acbcaee0-a47b-4fee-8765-9b1c9597d515" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:37:09 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-ea6a7b68-19e1-45d8-bcdb-631184bc86b2 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Acquiring lock "acbcaee0-a47b-4fee-8765-9b1c9597d515-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:37:09 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-ea6a7b68-19e1-45d8-bcdb-631184bc86b2 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "acbcaee0-a47b-4fee-8765-9b1c9597d515-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:37:09 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-ea6a7b68-19e1-45d8-bcdb-631184bc86b2 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "acbcaee0-a47b-4fee-8765-9b1c9597d515-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:37:09 user nova-compute[71731]: INFO nova.compute.manager [None req-ea6a7b68-19e1-45d8-bcdb-631184bc86b2 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] Terminating instance
Apr 13 16:37:09 user nova-compute[71731]: DEBUG nova.compute.manager [None req-ea6a7b68-19e1-45d8-bcdb-631184bc86b2 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] Start destroying the instance on the hypervisor. {{(pid=71731) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 16:37:09 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:37:09 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:37:09 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:37:09 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:37:10 user nova-compute[71731]: DEBUG nova.compute.manager [req-95003d2d-a2f4-4138-95f1-ae196af82a2a req-13eaa2ab-6ae3-4a60-a766-8a0ae82fcd2b service nova] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] Received event network-vif-unplugged-13471516-9514-4b85-938f-69657c2990e5 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:37:10 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-95003d2d-a2f4-4138-95f1-ae196af82a2a req-13eaa2ab-6ae3-4a60-a766-8a0ae82fcd2b service nova] Acquiring lock "acbcaee0-a47b-4fee-8765-9b1c9597d515-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:37:10 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-95003d2d-a2f4-4138-95f1-ae196af82a2a req-13eaa2ab-6ae3-4a60-a766-8a0ae82fcd2b service nova] Lock "acbcaee0-a47b-4fee-8765-9b1c9597d515-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:37:10 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-95003d2d-a2f4-4138-95f1-ae196af82a2a req-13eaa2ab-6ae3-4a60-a766-8a0ae82fcd2b service nova] Lock "acbcaee0-a47b-4fee-8765-9b1c9597d515-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:37:10 user nova-compute[71731]: DEBUG nova.compute.manager [req-95003d2d-a2f4-4138-95f1-ae196af82a2a req-13eaa2ab-6ae3-4a60-a766-8a0ae82fcd2b service nova] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] No waiting events found dispatching network-vif-unplugged-13471516-9514-4b85-938f-69657c2990e5 {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:37:10 user nova-compute[71731]: DEBUG nova.compute.manager [req-95003d2d-a2f4-4138-95f1-ae196af82a2a req-13eaa2ab-6ae3-4a60-a766-8a0ae82fcd2b service nova] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] Received event network-vif-unplugged-13471516-9514-4b85-938f-69657c2990e5 for instance with task_state deleting. {{(pid=71731) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 16:37:10 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:37:10 user nova-compute[71731]: INFO nova.virt.libvirt.driver [-] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] Instance destroyed successfully.
Apr 13 16:37:10 user nova-compute[71731]: DEBUG nova.objects.instance [None req-ea6a7b68-19e1-45d8-bcdb-631184bc86b2 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lazy-loading 'resources' on Instance uuid acbcaee0-a47b-4fee-8765-9b1c9597d515 {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:37:10 user nova-compute[71731]: DEBUG nova.virt.libvirt.vif [None req-ea6a7b68-19e1-45d8-bcdb-631184bc86b2 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-13T16:23:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1986504733',display_name='tempest-ServerActionsTestJSON-server-376598631',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1986504733',id=16,image_ref='708622a9-7465-4492-ade8-b827198f7e30',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPaDda4gTmMbkxKfok8i4i1XcNLza5lOVYjCPDEGVTF1JRQKderq80DnIN4GAkaZiBV5U44gvdu3wadL/M5wOH7VDSuEghHchow1mC9TB1xgdo8GoXeM279SVAyu08uhIQ==',key_name='tempest-keypair-1700037342',keypairs=<?>,launch_index=0,launched_at=2023-04-13T16:34:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='980559734a504574a83224deb7423c77',ramdisk_id='',reservation_id='r-3vv5sptg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='708622a9-7465-4492-ade8-b827198f7e30',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestJSON-713402718',owner_user_name='tempest-ServerActionsTestJSON-713402718-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T16:34:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1b3df1c5c5d441819bcef89ed6966815',uuid=acbcaee0-a47b-4fee-8765-9b1c9597d515,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "13471516-9514-4b85-938f-69657c2990e5", "address": "fa:16:3e:62:32:7f", "network": {"id": "cf1fef97-9ef1-449f-a302-b38110024547", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1138167711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "980559734a504574a83224deb7423c77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13471516-95", "ovs_interfaceid": "13471516-9514-4b85-938f-69657c2990e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 16:37:10 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-ea6a7b68-19e1-45d8-bcdb-631184bc86b2 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Converting VIF {"id": "13471516-9514-4b85-938f-69657c2990e5", "address": "fa:16:3e:62:32:7f", "network": {"id": "cf1fef97-9ef1-449f-a302-b38110024547", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1138167711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "980559734a504574a83224deb7423c77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13471516-95", "ovs_interfaceid": "13471516-9514-4b85-938f-69657c2990e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 16:37:10 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-ea6a7b68-19e1-45d8-bcdb-631184bc86b2 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:62:32:7f,bridge_name='br-int',has_traffic_filtering=True,id=13471516-9514-4b85-938f-69657c2990e5,network=Network(cf1fef97-9ef1-449f-a302-b38110024547),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13471516-95') {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 16:37:10 user nova-compute[71731]: DEBUG os_vif [None req-ea6a7b68-19e1-45d8-bcdb-631184bc86b2 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:32:7f,bridge_name='br-int',has_traffic_filtering=True,id=13471516-9514-4b85-938f-69657c2990e5,network=Network(cf1fef97-9ef1-449f-a302-b38110024547),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13471516-95') {{(pid=71731) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 16:37:10 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:37:10 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap13471516-95, bridge=br-int, if_exists=True) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:37:10 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:37:10 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 16:37:10 user nova-compute[71731]: INFO os_vif [None req-ea6a7b68-19e1-45d8-bcdb-631184bc86b2 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:32:7f,bridge_name='br-int',has_traffic_filtering=True,id=13471516-9514-4b85-938f-69657c2990e5,network=Network(cf1fef97-9ef1-449f-a302-b38110024547),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13471516-95')
Apr 13 16:37:10 user nova-compute[71731]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ea6a7b68-19e1-45d8-bcdb-631184bc86b2 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] calling os-brick to detach iSCSI Volume {{(pid=71731) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 16:37:10 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea6a7b68-19e1-45d8-bcdb-631184bc86b2 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8cf0118790>, {'target_iqn': 'iqn.2010-10.org.openstack:651ea766-ffda-42a1-9b3c-7be05a92c85f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ufUqtxTm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde': {}}" {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 16:37:10 user nova-compute[71731]: WARNING os_brick.initiator.connectors.base [None req-ea6a7b68-19e1-45d8-bcdb-631184bc86b2 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 16:37:10 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-ea6a7b68-19e1-45d8-bcdb-631184bc86b2 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 16:37:10 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-ea6a7b68-19e1-45d8-bcdb-631184bc86b2 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 16:37:10 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:37:10 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:37:10 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc2925bc-71e5-465e-b41f-aff70e68df3e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c2088266-1d33-4bb1-ac5b-1de832ff7985\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b4a5ced3-77ae-4bf5-8154-bd1645e470f2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:25c3dc97-c9cb-4529-ab32-26ef7fd94fc6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8156a054-43ea-4eeb-bbec-a270a6779a43\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:651ea766-ffda-42a1-9b3c-7be05a92c85f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:37:10 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea6a7b68-19e1-45d8-bcdb-631184bc86b2 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 16:37:10 user nova-compute[71731]: No targets found.
Apr 13 16:37:10 user nova-compute[71731]: iSNS:
Apr 13 16:37:10 user nova-compute[71731]: No targets found.
Apr 13 16:37:10 user nova-compute[71731]: STATIC:
Apr 13 16:37:10 user nova-compute[71731]: Target: iqn.2010-10.org.openstack:c2088266-1d33-4bb1-ac5b-1de832ff7985
Apr 13 16:37:10 user nova-compute[71731]:         Portal: 172.16.0.220:3260,-1
Apr 13 16:37:10 user nova-compute[71731]:                 Iface Name: default
Apr 13 16:37:10 user nova-compute[71731]: Target: iqn.2010-10.org.openstack:b4a5ced3-77ae-4bf5-8154-bd1645e470f2
Apr 13 16:37:10 user nova-compute[71731]:         Portal: 172.16.0.220:3260,-1
Apr 13 16:37:10 user nova-compute[71731]:                 Iface Name: default
Apr 13 16:37:10 user nova-compute[71731]: Target: iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97
Apr 13 16:37:10 user nova-compute[71731]:         Portal: 172.16.0.220:3260,-1
Apr 13 16:37:10 user nova-compute[71731]:                 Iface Name: default
Apr 13 16:37:10 user nova-compute[71731]: Target: iqn.2010-10.org.openstack:25c3dc97-c9cb-4529-ab32-26ef7fd94fc6
Apr 13 16:37:10 user nova-compute[71731]:         Portal: 172.16.0.220:3260,-1
Apr 13 16:37:10 user nova-compute[71731]:                 Iface Name: default
Apr 13 16:37:10 user nova-compute[71731]: Target: iqn.2010-10.org.openstack:8156a054-43ea-4eeb-bbec-a270a6779a43
Apr 13 16:37:10 user nova-compute[71731]:         Portal: 172.16.0.220:3260,-1
Apr 13 16:37:10 user nova-compute[71731]:                 Iface Name: default
Apr 13 16:37:10 user nova-compute[71731]: Target: iqn.2010-10.org.openstack:651ea766-ffda-42a1-9b3c-7be05a92c85f
Apr 13 16:37:10 user nova-compute[71731]:         Portal: 172.16.0.220:3260,-1
Apr 13 16:37:10 user nova-compute[71731]:                 Iface Name: default
Apr 13 16:37:10 user nova-compute[71731]: FIRMWARE:
Apr 13 16:37:10 user nova-compute[71731]: No targets found.
Apr 13 16:37:10 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 16:37:10 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea6a7b68-19e1-45d8-bcdb-631184bc86b2 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 16:37:10 user nova-compute[71731]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 16:37:10 user nova-compute[71731]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71731) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 16:37:10 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea6a7b68-19e1-45d8-bcdb-631184bc86b2 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:651ea766-ffda-42a1-9b3c-7be05a92c85f', 0)] {{(pid=71731) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 16:37:10 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:37:10 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:37:10 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[97d0d800-c91e-418e-bd52-de3cb53040f0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:25c3dc97-c9cb-4529-ab32-26ef7fd94fc6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:651ea766-ffda-42a1-9b3c-7be05a92c85f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8156a054-43ea-4eeb-bbec-a270a6779a43\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b4a5ced3-77ae-4bf5-8154-bd1645e470f2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c2088266-1d33-4bb1-ac5b-1de832ff7985\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:37:10 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:37:10 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:37:10 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[51d95a81-f970-4f5d-b9db-a1e97eff7baf]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25c3dc97-c9cb-4529-ab32-26ef7fd94fc6 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2088266-1d33-4bb1-ac5b-1de832ff7985 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:651ea766-ffda-42a1-9b3c-7be05a92c85f (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4a5ced3-77ae-4bf5-8154-bd1645e470f2 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8156a054-43ea-4eeb-bbec-a270a6779a43 (non-flash)\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:37:10 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea6a7b68-19e1-45d8-bcdb-631184bc86b2 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)
Apr 13 16:37:10 user nova-compute[71731]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25c3dc97-c9cb-4529-ab32-26ef7fd94fc6 (non-flash)
Apr 13 16:37:10 user nova-compute[71731]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2088266-1d33-4bb1-ac5b-1de832ff7985 (non-flash)
Apr 13 16:37:10 user nova-compute[71731]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:651ea766-ffda-42a1-9b3c-7be05a92c85f (non-flash)
Apr 13 16:37:10 user nova-compute[71731]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4a5ced3-77ae-4bf5-8154-bd1645e470f2 (non-flash)
Apr 13 16:37:10 user nova-compute[71731]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8156a054-43ea-4eeb-bbec-a270a6779a43 (non-flash)
Apr 13 16:37:10 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 16:37:10 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea6a7b68-19e1-45d8-bcdb-631184bc86b2 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)
Apr 13 16:37:10 user nova-compute[71731]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25c3dc97-c9cb-4529-ab32-26ef7fd94fc6 (non-flash)
Apr 13 16:37:10 user nova-compute[71731]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2088266-1d33-4bb1-ac5b-1de832ff7985 (non-flash)
Apr 13 16:37:10 user nova-compute[71731]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:651ea766-ffda-42a1-9b3c-7be05a92c85f (non-flash)
Apr 13 16:37:10 user nova-compute[71731]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4a5ced3-77ae-4bf5-8154-bd1645e470f2 (non-flash)
Apr 13 16:37:10 user nova-compute[71731]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8156a054-43ea-4eeb-bbec-a270a6779a43 (non-flash)
Apr 13 16:37:10 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 16:37:10 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea6a7b68-19e1-45d8-bcdb-631184bc86b2 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8cb06acca0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:651ea766-ffda-42a1-9b3c-7be05a92c85f'): ({'sde'}, set())}) {{(pid=71731) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 16:37:10 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-ea6a7b68-19e1-45d8-bcdb-631184bc86b2 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Removing single pathed devices sde {{(pid=71731) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 16:37:10 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:37:10 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:37:10 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[b53aa334-40c2-4ae3-b92c-db1b14d3a0de]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:37:10 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:37:10 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.021s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:37:10 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[8da966f2-f000-43dc-9c3f-fe6828378e79]: (4, ('ok\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:37:10 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-ea6a7b68-19e1-45d8-bcdb-631184bc86b2 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Flushing IO for device /dev/sde {{(pid=71731) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 16:37:10 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:37:10 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.017s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:37:10 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac53c497-3bc4-4804-9c3b-c5f329dab10e]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:37:10 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-ea6a7b68-19e1-45d8-bcdb-631184bc86b2 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=71731) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 16:37:10 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:37:10 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.037s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:37:10 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[28f779e3-c087-4d22-ad77-163a14cdd044]: (4, ('1', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:37:10 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-ea6a7b68-19e1-45d8-bcdb-631184bc86b2 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=71731) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 16:37:10 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-ea6a7b68-19e1-45d8-bcdb-631184bc86b2 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] SCSI volumes sde have been removed. {{(pid=71731) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 16:37:10 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea6a7b68-19e1-45d8-bcdb-631184bc86b2 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:651ea766-ffda-42a1-9b3c-7be05a92c85f')] {{(pid=71731) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 16:37:10 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:651ea766-ffda-42a1-9b3c-7be05a92c85f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:37:10 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:651ea766-ffda-42a1-9b3c-7be05a92c85f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:37:10 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[696dd827-bb4c-4639-8b82-429ee9caaf0d]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:37:10 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea6a7b68-19e1-45d8-bcdb-631184bc86b2 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:37:10 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:651ea766-ffda-42a1-9b3c-7be05a92c85f -p 172.16.0.220:3260 --logout {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:37:10 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:651ea766-ffda-42a1-9b3c-7be05a92c85f -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:37:10 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[9efc347c-8e12-4f32-b27b-7b4c5fc707d9]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:651ea766-ffda-42a1-9b3c-7be05a92c85f, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:651ea766-ffda-42a1-9b3c-7be05a92c85f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:37:10 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea6a7b68-19e1-45d8-bcdb-631184bc86b2 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:651ea766-ffda-42a1-9b3c-7be05a92c85f, portal: 172.16.0.220,3260]
Apr 13 16:37:10 user nova-compute[71731]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:651ea766-ffda-42a1-9b3c-7be05a92c85f, portal: 172.16.0.220,3260] successful.
Apr 13 16:37:10 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:37:10 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:651ea766-ffda-42a1-9b3c-7be05a92c85f -p 172.16.0.220:3260 --op delete {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:37:11 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:651ea766-ffda-42a1-9b3c-7be05a92c85f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:37:11 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[78bd0118-2717-4757-abdf-2f5203114e4b]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:37:11 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea6a7b68-19e1-45d8-bcdb-631184bc86b2 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:37:11 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-ea6a7b68-19e1-45d8-bcdb-631184bc86b2 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.335s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 16:37:11 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea6a7b68-19e1-45d8-bcdb-631184bc86b2 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] <== disconnect_volume: return (337ms) None {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 16:37:11 user nova-compute[71731]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ea6a7b68-19e1-45d8-bcdb-631184bc86b2 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] Disconnected iSCSI Volume {{(pid=71731) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 16:37:11 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-ea6a7b68-19e1-45d8-bcdb-631184bc86b2 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] Deleting instance files /opt/stack/data/nova/instances/acbcaee0-a47b-4fee-8765-9b1c9597d515_del
Apr 13 16:37:11 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-ea6a7b68-19e1-45d8-bcdb-631184bc86b2 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] Deletion of /opt/stack/data/nova/instances/acbcaee0-a47b-4fee-8765-9b1c9597d515_del complete
Apr 13 16:37:11 user nova-compute[71731]: INFO nova.compute.manager [None req-ea6a7b68-19e1-45d8-bcdb-631184bc86b2 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] Took 1.24 seconds to destroy the instance on the hypervisor.
Apr 13 16:37:11 user nova-compute[71731]: DEBUG oslo.service.loopingcall [None req-ea6a7b68-19e1-45d8-bcdb-631184bc86b2 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71731) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 16:37:11 user nova-compute[71731]: DEBUG nova.compute.manager [-] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] Deallocating network for instance {{(pid=71731) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 16:37:11 user nova-compute[71731]: DEBUG nova.network.neutron [-] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] deallocate_for_instance() {{(pid=71731) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 16:37:11 user nova-compute[71731]: DEBUG nova.network.neutron [-] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] Updating instance_info_cache with network_info: [] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:37:11 user nova-compute[71731]: INFO nova.compute.manager [-] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] Took 0.71 seconds to deallocate network for instance.
Apr 13 16:37:11 user nova-compute[71731]: DEBUG nova.compute.manager [req-47ddf54f-f433-42ac-a356-cdffa01b99ec req-6171d127-cbf4-446f-9fb4-3b90e3df7b69 service nova] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] Received event network-vif-deleted-13471516-9514-4b85-938f-69657c2990e5 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:37:11 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:37:12 user nova-compute[71731]: DEBUG nova.compute.manager [req-fd9216bd-474a-4c5b-bd34-6405ec987b37 req-5815fd47-5cf5-474c-869b-19f2633311d6 service nova] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] Received event network-vif-plugged-13471516-9514-4b85-938f-69657c2990e5 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:37:12 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-fd9216bd-474a-4c5b-bd34-6405ec987b37 req-5815fd47-5cf5-474c-869b-19f2633311d6 service nova] Acquiring lock "acbcaee0-a47b-4fee-8765-9b1c9597d515-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:37:12 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-fd9216bd-474a-4c5b-bd34-6405ec987b37 req-5815fd47-5cf5-474c-869b-19f2633311d6 service nova] Lock "acbcaee0-a47b-4fee-8765-9b1c9597d515-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:37:12 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-fd9216bd-474a-4c5b-bd34-6405ec987b37 req-5815fd47-5cf5-474c-869b-19f2633311d6 service nova] Lock "acbcaee0-a47b-4fee-8765-9b1c9597d515-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:37:12 user nova-compute[71731]: DEBUG nova.compute.manager [req-fd9216bd-474a-4c5b-bd34-6405ec987b37 req-5815fd47-5cf5-474c-869b-19f2633311d6 service nova] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] No waiting events found dispatching network-vif-plugged-13471516-9514-4b85-938f-69657c2990e5 {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:37:12 user nova-compute[71731]: WARNING nova.compute.manager [req-fd9216bd-474a-4c5b-bd34-6405ec987b37 req-5815fd47-5cf5-474c-869b-19f2633311d6 service nova] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] Received unexpected event network-vif-plugged-13471516-9514-4b85-938f-69657c2990e5 for instance with vm_state active and task_state deleting.
Apr 13 16:37:12 user nova-compute[71731]: INFO nova.compute.manager [None req-ea6a7b68-19e1-45d8-bcdb-631184bc86b2 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] Took 0.81 seconds to detach 1 volumes for instance.
Apr 13 16:37:12 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-ea6a7b68-19e1-45d8-bcdb-631184bc86b2 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:37:12 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-ea6a7b68-19e1-45d8-bcdb-631184bc86b2 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:37:12 user nova-compute[71731]: DEBUG nova.compute.provider_tree [None req-ea6a7b68-19e1-45d8-bcdb-631184bc86b2 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Inventory has not changed in ProviderTree for provider: cb6b1a64-0c24-4e2d-af1e-16576ca9165c {{(pid=71731) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 16:37:12 user nova-compute[71731]: DEBUG nova.scheduler.client.report [None req-ea6a7b68-19e1-45d8-bcdb-631184bc86b2 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Inventory has not changed for provider cb6b1a64-0c24-4e2d-af1e-16576ca9165c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71731) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 16:37:12 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-ea6a7b68-19e1-45d8-bcdb-631184bc86b2 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.263s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:37:12 user nova-compute[71731]: INFO nova.scheduler.client.report [None req-ea6a7b68-19e1-45d8-bcdb-631184bc86b2 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Deleted allocations for instance acbcaee0-a47b-4fee-8765-9b1c9597d515
Apr 13 16:37:13 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-ea6a7b68-19e1-45d8-bcdb-631184bc86b2 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "acbcaee0-a47b-4fee-8765-9b1c9597d515" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.217s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:37:13 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._sync_power_states {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:37:13 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Triggering sync for uuid f66553f5-5e1b-4f1d-8c5a-63bc340f7586 {{(pid=71731) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 13 16:37:13 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Triggering sync for uuid 235f827c-7116-48e9-84c5-0c9761c18e1e {{(pid=71731) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 13 16:37:13 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Triggering sync for uuid 650427bd-4dad-4bcd-922d-c17e60b36807 {{(pid=71731) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 13 16:37:13 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Triggering sync for uuid 2956ab05-28ff-4c9e-b646-dbb83b3db278 {{(pid=71731) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 13 16:37:13 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Triggering sync for uuid 35b23303-e373-4f35-b7ee-76e6815073ce {{(pid=71731) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 13 16:37:13 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Triggering sync for uuid 220e1c3e-1378-46fc-acc1-ee1bafac7722 {{(pid=71731) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 13 16:37:13 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Triggering sync for uuid 0a5c9b2c-fe1e-4a21-b213-c63e2c28748a {{(pid=71731) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 13 16:37:13 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Acquiring lock "f66553f5-5e1b-4f1d-8c5a-63bc340f7586" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:37:13 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "f66553f5-5e1b-4f1d-8c5a-63bc340f7586" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:37:13 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Acquiring lock "235f827c-7116-48e9-84c5-0c9761c18e1e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:37:13 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "235f827c-7116-48e9-84c5-0c9761c18e1e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:37:13 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Acquiring lock "650427bd-4dad-4bcd-922d-c17e60b36807" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:37:13 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "650427bd-4dad-4bcd-922d-c17e60b36807" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:37:13 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Acquiring lock "2956ab05-28ff-4c9e-b646-dbb83b3db278" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:37:13 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "2956ab05-28ff-4c9e-b646-dbb83b3db278" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:37:13 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Acquiring lock "35b23303-e373-4f35-b7ee-76e6815073ce" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:37:13 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "35b23303-e373-4f35-b7ee-76e6815073ce" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:37:13 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Acquiring lock "220e1c3e-1378-46fc-acc1-ee1bafac7722" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:37:13 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "220e1c3e-1378-46fc-acc1-ee1bafac7722" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:37:13 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Acquiring lock "0a5c9b2c-fe1e-4a21-b213-c63e2c28748a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:37:13 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "0a5c9b2c-fe1e-4a21-b213-c63e2c28748a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:37:13 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "f66553f5-5e1b-4f1d-8c5a-63bc340f7586" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.034s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:37:13 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "235f827c-7116-48e9-84c5-0c9761c18e1e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.039s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:37:13 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "35b23303-e373-4f35-b7ee-76e6815073ce" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.043s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:37:13 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "2956ab05-28ff-4c9e-b646-dbb83b3db278" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.048s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:37:13 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "0a5c9b2c-fe1e-4a21-b213-c63e2c28748a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.052s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:37:13 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "650427bd-4dad-4bcd-922d-c17e60b36807" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.080s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:37:13 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "220e1c3e-1378-46fc-acc1-ee1bafac7722" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.085s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:37:15 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:37:16 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:37:18 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:37:18 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71731) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 16:37:18 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager.update_available_resource {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:37:18 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:37:18 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:37:18 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:37:18 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Auditing locally available compute resources for user (node: user) {{(pid=71731) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 16:37:18 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35b23303-e373-4f35-b7ee-76e6815073ce/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:37:18 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35b23303-e373-4f35-b7ee-76e6815073ce/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:37:18 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35b23303-e373-4f35-b7ee-76e6815073ce/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:37:18 user nova-compute[71731]: DEBUG nova.compute.manager [req-762516f9-4908-427c-96ab-4142a5b92693 req-940f25e0-6777-4501-b689-90b5e4cfeba3 service nova] [instance: 0a5c9b2c-fe1e-4a21-b213-c63e2c28748a] Received event network-changed-ee0eba83-c6e1-4415-96d1-e5b496ec0afe {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:37:18 user nova-compute[71731]: DEBUG nova.compute.manager [req-762516f9-4908-427c-96ab-4142a5b92693 req-940f25e0-6777-4501-b689-90b5e4cfeba3 service nova] [instance: 0a5c9b2c-fe1e-4a21-b213-c63e2c28748a] Refreshing instance network info cache due to event network-changed-ee0eba83-c6e1-4415-96d1-e5b496ec0afe. {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 16:37:18 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-762516f9-4908-427c-96ab-4142a5b92693 req-940f25e0-6777-4501-b689-90b5e4cfeba3 service nova] Acquiring lock "refresh_cache-0a5c9b2c-fe1e-4a21-b213-c63e2c28748a" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 16:37:18 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-762516f9-4908-427c-96ab-4142a5b92693 req-940f25e0-6777-4501-b689-90b5e4cfeba3 service nova] Acquired lock "refresh_cache-0a5c9b2c-fe1e-4a21-b213-c63e2c28748a" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 16:37:18 user nova-compute[71731]: DEBUG nova.network.neutron [req-762516f9-4908-427c-96ab-4142a5b92693 req-940f25e0-6777-4501-b689-90b5e4cfeba3 service nova] [instance: 0a5c9b2c-fe1e-4a21-b213-c63e2c28748a] Refreshing network info cache for port ee0eba83-c6e1-4415-96d1-e5b496ec0afe {{(pid=71731) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 16:37:18 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35b23303-e373-4f35-b7ee-76e6815073ce/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:37:18 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=71731) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 16:37:18 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=71731) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 16:37:18 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66553f5-5e1b-4f1d-8c5a-63bc340f7586/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:37:18 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66553f5-5e1b-4f1d-8c5a-63bc340f7586/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:37:18 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66553f5-5e1b-4f1d-8c5a-63bc340f7586/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:37:18 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66553f5-5e1b-4f1d-8c5a-63bc340f7586/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:37:18 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71731) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 16:37:18 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71731) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 16:37:18 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/650427bd-4dad-4bcd-922d-c17e60b36807/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:37:18 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/650427bd-4dad-4bcd-922d-c17e60b36807/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:37:18 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/650427bd-4dad-4bcd-922d-c17e60b36807/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:37:18 user nova-compute[71731]: DEBUG nova.network.neutron [req-762516f9-4908-427c-96ab-4142a5b92693 req-940f25e0-6777-4501-b689-90b5e4cfeba3 service nova] [instance: 0a5c9b2c-fe1e-4a21-b213-c63e2c28748a] Updated VIF entry in instance network info cache for port ee0eba83-c6e1-4415-96d1-e5b496ec0afe. {{(pid=71731) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 16:37:18 user nova-compute[71731]: DEBUG nova.network.neutron [req-762516f9-4908-427c-96ab-4142a5b92693 req-940f25e0-6777-4501-b689-90b5e4cfeba3 service nova] [instance: 0a5c9b2c-fe1e-4a21-b213-c63e2c28748a] Updating instance_info_cache with network_info: [{"id": "ee0eba83-c6e1-4415-96d1-e5b496ec0afe", "address": "fa:16:3e:9d:3c:e8", "network": {"id": "d36bc206-f629-4d6e-8a3f-458061d7b525", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-893271134-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d451e0e239f486aa2b3abe9e273eab3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee0eba83-c6", "ovs_interfaceid": "ee0eba83-c6e1-4415-96d1-e5b496ec0afe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:37:19 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-762516f9-4908-427c-96ab-4142a5b92693 req-940f25e0-6777-4501-b689-90b5e4cfeba3 service nova] Releasing lock "refresh_cache-0a5c9b2c-fe1e-4a21-b213-c63e2c28748a" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 16:37:19 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/650427bd-4dad-4bcd-922d-c17e60b36807/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:37:19 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=71731) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 16:37:19 user nova-compute[71731]: WARNING nova.virt.libvirt.driver [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 16:37:19 user nova-compute[71731]: WARNING nova.virt.libvirt.driver [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 16:37:19 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Hypervisor/Node resource view: name=user free_ram=8137MB free_disk=26.060588836669922GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71731) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 16:37:19 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:37:19 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:37:19 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-9e938d63-1c66-4c4f-b8a1-1d6daf2d88e4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Acquiring lock "0a5c9b2c-fe1e-4a21-b213-c63e2c28748a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:37:19 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-9e938d63-1c66-4c4f-b8a1-1d6daf2d88e4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "0a5c9b2c-fe1e-4a21-b213-c63e2c28748a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:37:19 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-9e938d63-1c66-4c4f-b8a1-1d6daf2d88e4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Acquiring lock "0a5c9b2c-fe1e-4a21-b213-c63e2c28748a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:37:19 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-9e938d63-1c66-4c4f-b8a1-1d6daf2d88e4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "0a5c9b2c-fe1e-4a21-b213-c63e2c28748a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:37:19 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-9e938d63-1c66-4c4f-b8a1-1d6daf2d88e4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "0a5c9b2c-fe1e-4a21-b213-c63e2c28748a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:37:19 user nova-compute[71731]: INFO nova.compute.manager [None req-9e938d63-1c66-4c4f-b8a1-1d6daf2d88e4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 0a5c9b2c-fe1e-4a21-b213-c63e2c28748a] Terminating instance
Apr 13 16:37:19 user nova-compute[71731]: DEBUG nova.compute.manager [None req-9e938d63-1c66-4c4f-b8a1-1d6daf2d88e4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 0a5c9b2c-fe1e-4a21-b213-c63e2c28748a] Start destroying the instance on the hypervisor. {{(pid=71731) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 16:37:19 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:37:19 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-f95e880d-a93f-4116-b771-765b49c4f911 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Acquiring lock "2956ab05-28ff-4c9e-b646-dbb83b3db278" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:37:19 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-f95e880d-a93f-4116-b771-765b49c4f911 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lock "2956ab05-28ff-4c9e-b646-dbb83b3db278" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:37:19 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-f95e880d-a93f-4116-b771-765b49c4f911 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Acquiring lock "2956ab05-28ff-4c9e-b646-dbb83b3db278-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:37:19 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-f95e880d-a93f-4116-b771-765b49c4f911 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lock "2956ab05-28ff-4c9e-b646-dbb83b3db278-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:37:19 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-f95e880d-a93f-4116-b771-765b49c4f911 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lock "2956ab05-28ff-4c9e-b646-dbb83b3db278-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:37:19 user nova-compute[71731]: INFO nova.compute.manager [None req-f95e880d-a93f-4116-b771-765b49c4f911 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: 2956ab05-28ff-4c9e-b646-dbb83b3db278] Terminating instance
Apr 13 16:37:19 user nova-compute[71731]: DEBUG nova.compute.manager [None req-f95e880d-a93f-4116-b771-765b49c4f911 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: 2956ab05-28ff-4c9e-b646-dbb83b3db278] Start destroying the instance on the hypervisor. {{(pid=71731) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 16:37:19 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance f66553f5-5e1b-4f1d-8c5a-63bc340f7586 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 16:37:19 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance 235f827c-7116-48e9-84c5-0c9761c18e1e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 16:37:19 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance 650427bd-4dad-4bcd-922d-c17e60b36807 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 16:37:19 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance 2956ab05-28ff-4c9e-b646-dbb83b3db278 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 16:37:19 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance 220e1c3e-1378-46fc-acc1-ee1bafac7722 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 16:37:19 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance 0a5c9b2c-fe1e-4a21-b213-c63e2c28748a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 16:37:19 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance 35b23303-e373-4f35-b7ee-76e6815073ce actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 16:37:19 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=71731) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 16:37:19 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Final resource view: name=user phys_ram=16023MB used_ram=1408MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=71731) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 16:37:19 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:37:19 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:37:19 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:37:19 user nova-compute[71731]: DEBUG nova.compute.provider_tree [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Inventory has not changed in ProviderTree for provider: cb6b1a64-0c24-4e2d-af1e-16576ca9165c {{(pid=71731) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 16:37:19 user nova-compute[71731]: DEBUG nova.scheduler.client.report [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Inventory has not changed for provider cb6b1a64-0c24-4e2d-af1e-16576ca9165c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71731) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 16:37:19 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Compute_service record updated for user:user {{(pid=71731) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 16:37:19 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.416s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:37:20 user nova-compute[71731]: DEBUG nova.compute.manager [req-b27fbd26-e49b-4346-b8fe-bacce1aa81f9 req-2620bd19-dc7c-4e08-8d77-dc0702c5da5c service nova] [instance: 2956ab05-28ff-4c9e-b646-dbb83b3db278] Received event network-vif-unplugged-84df62e9-af7c-4e62-83da-b43b511be2a0 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:37:20 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-b27fbd26-e49b-4346-b8fe-bacce1aa81f9 req-2620bd19-dc7c-4e08-8d77-dc0702c5da5c service nova] Acquiring lock "2956ab05-28ff-4c9e-b646-dbb83b3db278-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:37:20 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-b27fbd26-e49b-4346-b8fe-bacce1aa81f9 req-2620bd19-dc7c-4e08-8d77-dc0702c5da5c service nova] Lock "2956ab05-28ff-4c9e-b646-dbb83b3db278-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:37:20 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-b27fbd26-e49b-4346-b8fe-bacce1aa81f9 req-2620bd19-dc7c-4e08-8d77-dc0702c5da5c service nova] Lock "2956ab05-28ff-4c9e-b646-dbb83b3db278-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:37:20 user nova-compute[71731]: DEBUG nova.compute.manager [req-b27fbd26-e49b-4346-b8fe-bacce1aa81f9 req-2620bd19-dc7c-4e08-8d77-dc0702c5da5c service nova] [instance: 2956ab05-28ff-4c9e-b646-dbb83b3db278] No waiting events found dispatching network-vif-unplugged-84df62e9-af7c-4e62-83da-b43b511be2a0 {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:37:20 user nova-compute[71731]: DEBUG nova.compute.manager [req-b27fbd26-e49b-4346-b8fe-bacce1aa81f9 req-2620bd19-dc7c-4e08-8d77-dc0702c5da5c service nova] [instance: 2956ab05-28ff-4c9e-b646-dbb83b3db278] Received event network-vif-unplugged-84df62e9-af7c-4e62-83da-b43b511be2a0 for instance with task_state deleting. {{(pid=71731) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 16:37:20 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:37:20 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:37:20 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:37:20 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:37:20 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:37:20 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:37:20 user nova-compute[71731]: DEBUG nova.compute.manager [req-c69676e0-71c2-4a15-99ae-418a37107556 req-c6ff3f62-2279-48a1-a86e-18f4b55616b0 service nova] [instance: 0a5c9b2c-fe1e-4a21-b213-c63e2c28748a] Received event network-changed-ee0eba83-c6e1-4415-96d1-e5b496ec0afe {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:37:20 user nova-compute[71731]: DEBUG nova.compute.manager [req-c69676e0-71c2-4a15-99ae-418a37107556 req-c6ff3f62-2279-48a1-a86e-18f4b55616b0 service nova] [instance: 0a5c9b2c-fe1e-4a21-b213-c63e2c28748a] Refreshing instance network info cache due to event network-changed-ee0eba83-c6e1-4415-96d1-e5b496ec0afe. {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 16:37:20 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-c69676e0-71c2-4a15-99ae-418a37107556 req-c6ff3f62-2279-48a1-a86e-18f4b55616b0 service nova] Acquiring lock "refresh_cache-0a5c9b2c-fe1e-4a21-b213-c63e2c28748a" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 16:37:20 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-c69676e0-71c2-4a15-99ae-418a37107556 req-c6ff3f62-2279-48a1-a86e-18f4b55616b0 service nova] Acquired lock "refresh_cache-0a5c9b2c-fe1e-4a21-b213-c63e2c28748a" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 16:37:20 user nova-compute[71731]: DEBUG nova.network.neutron [req-c69676e0-71c2-4a15-99ae-418a37107556 req-c6ff3f62-2279-48a1-a86e-18f4b55616b0 service nova] [instance: 0a5c9b2c-fe1e-4a21-b213-c63e2c28748a] Refreshing network info cache for port ee0eba83-c6e1-4415-96d1-e5b496ec0afe {{(pid=71731) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 16:37:20 user nova-compute[71731]: INFO nova.virt.libvirt.driver [-] [instance: 0a5c9b2c-fe1e-4a21-b213-c63e2c28748a] Instance destroyed successfully.
Apr 13 16:37:20 user nova-compute[71731]: DEBUG nova.objects.instance [None req-9e938d63-1c66-4c4f-b8a1-1d6daf2d88e4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lazy-loading 'resources' on Instance uuid 0a5c9b2c-fe1e-4a21-b213-c63e2c28748a {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:37:20 user nova-compute[71731]: INFO nova.virt.libvirt.driver [-] [instance: 2956ab05-28ff-4c9e-b646-dbb83b3db278] Instance destroyed successfully.
Apr 13 16:37:20 user nova-compute[71731]: DEBUG nova.objects.instance [None req-f95e880d-a93f-4116-b771-765b49c4f911 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lazy-loading 'resources' on Instance uuid 2956ab05-28ff-4c9e-b646-dbb83b3db278 {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:37:20 user nova-compute[71731]: DEBUG nova.virt.libvirt.vif [None req-f95e880d-a93f-4116-b771-765b49c4f911 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T16:31:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1531186020',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1531186020',id=27,image_ref='708622a9-7465-4492-ade8-b827198f7e30',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-13T16:33:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b2d09a74bf684a9fb1dd1e95d6c23f3c',ramdisk_id='',reservation_id='r-ijjf8jor',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='708622a9-7465-4492-ade8-b827198f7e30',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1960261099',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T16:35:34Z,user_data=None,user_id='e45a882dbafb4ea4976e4f45289eb2b8',uuid=2956ab05-28ff-4c9e-b646-dbb83b3db278,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "84df62e9-af7c-4e62-83da-b43b511be2a0", "address": "fa:16:3e:66:e8:40", "network": {"id": "5a7877ff-8230-470b-90b5-e5dcfc8f0cee", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-779403873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2d09a74bf684a9fb1dd1e95d6c23f3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84df62e9-af", "ovs_interfaceid": "84df62e9-af7c-4e62-83da-b43b511be2a0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 16:37:20 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-f95e880d-a93f-4116-b771-765b49c4f911 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Converting VIF {"id": "84df62e9-af7c-4e62-83da-b43b511be2a0", "address": "fa:16:3e:66:e8:40", "network": {"id": "5a7877ff-8230-470b-90b5-e5dcfc8f0cee", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-779403873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2d09a74bf684a9fb1dd1e95d6c23f3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84df62e9-af", "ovs_interfaceid": "84df62e9-af7c-4e62-83da-b43b511be2a0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 16:37:20 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-f95e880d-a93f-4116-b771-765b49c4f911 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:66:e8:40,bridge_name='br-int',has_traffic_filtering=True,id=84df62e9-af7c-4e62-83da-b43b511be2a0,network=Network(5a7877ff-8230-470b-90b5-e5dcfc8f0cee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84df62e9-af') {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 16:37:20 user nova-compute[71731]: DEBUG os_vif [None req-f95e880d-a93f-4116-b771-765b49c4f911 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:66:e8:40,bridge_name='br-int',has_traffic_filtering=True,id=84df62e9-af7c-4e62-83da-b43b511be2a0,network=Network(5a7877ff-8230-470b-90b5-e5dcfc8f0cee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84df62e9-af') {{(pid=71731) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 16:37:20 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:37:20 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap84df62e9-af, bridge=br-int, if_exists=True) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:37:20 user nova-compute[71731]: DEBUG nova.virt.libvirt.vif [None req-9e938d63-1c66-4c4f-b8a1-1d6daf2d88e4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T16:35:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1235436858',display_name='tempest-TestVolumeBootPattern-server-1235436858',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1235436858',id=32,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIspJuW0ouAVIXdRkaEFP67MIl/YPuQkC9G3HjohNK4Y6ERboR/Jfb2q58aDhzUN+56TLqbLCfdFh2NtWLgvjHOwe+zpPoSYOKAkWLX+NSuU860pg4Djj9vwVgJj/Bkydw==',key_name='tempest-TestVolumeBootPattern-1747083001',keypairs=<?>,launch_index=0,launched_at=2023-04-13T16:35:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8d451e0e239f486aa2b3abe9e273eab3',ramdisk_id='',reservation_id='r-0eo0gkk4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-438786227',owner_user_name='tempest-TestVolumeBootPattern-438786227-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T16:35:39Z,user_data=None,user_id='d70e10f63cdd49a9a1ebe1fe4c9de0a2',uuid=0a5c9b2c-fe1e-4a21-b213-c63e2c28748a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ee0eba83-c6e1-4415-96d1-e5b496ec0afe", "address": "fa:16:3e:9d:3c:e8", "network": {"id": "d36bc206-f629-4d6e-8a3f-458061d7b525", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-893271134-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d451e0e239f486aa2b3abe9e273eab3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee0eba83-c6", "ovs_interfaceid": "ee0eba83-c6e1-4415-96d1-e5b496ec0afe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 16:37:20 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-9e938d63-1c66-4c4f-b8a1-1d6daf2d88e4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Converting VIF {"id": "ee0eba83-c6e1-4415-96d1-e5b496ec0afe", "address": "fa:16:3e:9d:3c:e8", "network": {"id": "d36bc206-f629-4d6e-8a3f-458061d7b525", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-893271134-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d451e0e239f486aa2b3abe9e273eab3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee0eba83-c6", "ovs_interfaceid": "ee0eba83-c6e1-4415-96d1-e5b496ec0afe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 16:37:20 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-9e938d63-1c66-4c4f-b8a1-1d6daf2d88e4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9d:3c:e8,bridge_name='br-int',has_traffic_filtering=True,id=ee0eba83-c6e1-4415-96d1-e5b496ec0afe,network=Network(d36bc206-f629-4d6e-8a3f-458061d7b525),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee0eba83-c6') {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 16:37:20 user nova-compute[71731]: DEBUG os_vif [None req-9e938d63-1c66-4c4f-b8a1-1d6daf2d88e4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9d:3c:e8,bridge_name='br-int',has_traffic_filtering=True,id=ee0eba83-c6e1-4415-96d1-e5b496ec0afe,network=Network(d36bc206-f629-4d6e-8a3f-458061d7b525),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee0eba83-c6') {{(pid=71731) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 16:37:20 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:37:20 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 16:37:20 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:37:20 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapee0eba83-c6, bridge=br-int, if_exists=True) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:37:20 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:37:20 user nova-compute[71731]: INFO os_vif [None req-f95e880d-a93f-4116-b771-765b49c4f911 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:66:e8:40,bridge_name='br-int',has_traffic_filtering=True,id=84df62e9-af7c-4e62-83da-b43b511be2a0,network=Network(5a7877ff-8230-470b-90b5-e5dcfc8f0cee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84df62e9-af')
Apr 13 16:37:20 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 16:37:20 user nova-compute[71731]: INFO os_vif [None req-9e938d63-1c66-4c4f-b8a1-1d6daf2d88e4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9d:3c:e8,bridge_name='br-int',has_traffic_filtering=True,id=ee0eba83-c6e1-4415-96d1-e5b496ec0afe,network=Network(d36bc206-f629-4d6e-8a3f-458061d7b525),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee0eba83-c6')
Apr 13 16:37:20 user nova-compute[71731]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f95e880d-a93f-4116-b771-765b49c4f911 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: 2956ab05-28ff-4c9e-b646-dbb83b3db278] calling os-brick to detach iSCSI Volume {{(pid=71731) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 16:37:20 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-f95e880d-a93f-4116-b771-765b49c4f911 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8cf0118790>, {'target_iqn': 'iqn.2010-10.org.openstack:25c3dc97-c9cb-4529-ab32-26ef7fd94fc6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZFsWRaGN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 16:37:20 user nova-compute[71731]: WARNING os_brick.initiator.connectors.base [None req-f95e880d-a93f-4116-b771-765b49c4f911 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 16:37:20 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-f95e880d-a93f-4116-b771-765b49c4f911 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 16:37:20 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-f95e880d-a93f-4116-b771-765b49c4f911 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 16:37:20 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:37:20 user nova-compute[71731]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9e938d63-1c66-4c4f-b8a1-1d6daf2d88e4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 0a5c9b2c-fe1e-4a21-b213-c63e2c28748a] calling os-brick to detach iSCSI Volume {{(pid=71731) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 16:37:20 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e938d63-1c66-4c4f-b8a1-1d6daf2d88e4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8cf0118790>, {'target_iqn': 'iqn.2010-10.org.openstack:b4a5ced3-77ae-4bf5-8154-bd1645e470f2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rpZnFCMW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf': {}}" {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 16:37:20 user nova-compute[71731]: WARNING os_brick.initiator.connectors.base [None req-9e938d63-1c66-4c4f-b8a1-1d6daf2d88e4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 16:37:20 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-9e938d63-1c66-4c4f-b8a1-1d6daf2d88e4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 16:37:20 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:37:20 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[40331739-342b-4603-b594-1164f78b2816]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c2088266-1d33-4bb1-ac5b-1de832ff7985\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b4a5ced3-77ae-4bf5-8154-bd1645e470f2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:25c3dc97-c9cb-4529-ab32-26ef7fd94fc6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8156a054-43ea-4eeb-bbec-a270a6779a43\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:37:20 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-f95e880d-a93f-4116-b771-765b49c4f911 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 16:37:20 user nova-compute[71731]: No targets found.
Apr 13 16:37:20 user nova-compute[71731]: iSNS:
Apr 13 16:37:20 user nova-compute[71731]: No targets found.
Apr 13 16:37:20 user nova-compute[71731]: STATIC:
Apr 13 16:37:20 user nova-compute[71731]: Target: iqn.2010-10.org.openstack:c2088266-1d33-4bb1-ac5b-1de832ff7985
Apr 13 16:37:20 user nova-compute[71731]:         Portal: 172.16.0.220:3260,-1
Apr 13 16:37:20 user nova-compute[71731]:                 Iface Name: default
Apr 13 16:37:20 user nova-compute[71731]: Target: iqn.2010-10.org.openstack:b4a5ced3-77ae-4bf5-8154-bd1645e470f2
Apr 13 16:37:20 user nova-compute[71731]:         Portal: 172.16.0.220:3260,-1
Apr 13 16:37:20 user nova-compute[71731]:                 Iface Name: default
Apr 13 16:37:20 user nova-compute[71731]: Target: iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97
Apr 13 16:37:20 user nova-compute[71731]:         Portal: 172.16.0.220:3260,-1
Apr 13 16:37:20 user nova-compute[71731]:                 Iface Name: default
Apr 13 16:37:20 user nova-compute[71731]: Target: iqn.2010-10.org.openstack:25c3dc97-c9cb-4529-ab32-26ef7fd94fc6
Apr 13 16:37:20 user nova-compute[71731]:         Portal: 172.16.0.220:3260,-1
Apr 13 16:37:20 user nova-compute[71731]:                 Iface Name: default
Apr 13 16:37:20 user nova-compute[71731]: Target: iqn.2010-10.org.openstack:8156a054-43ea-4eeb-bbec-a270a6779a43
Apr 13 16:37:20 user nova-compute[71731]:         Portal: 172.16.0.220:3260,-1
Apr 13 16:37:20 user nova-compute[71731]:                 Iface Name: default
Apr 13 16:37:20 user nova-compute[71731]: FIRMWARE:
Apr 13 16:37:20 user nova-compute[71731]: No targets found.
Apr 13 16:37:20 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 16:37:20 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-f95e880d-a93f-4116-b771-765b49c4f911 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 16:37:20 user nova-compute[71731]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 16:37:20 user nova-compute[71731]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71731) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 16:37:20 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-f95e880d-a93f-4116-b771-765b49c4f911 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:25c3dc97-c9cb-4529-ab32-26ef7fd94fc6', 0)] {{(pid=71731) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 16:37:20 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:37:20 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:37:20 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[002b4f78-0448-4474-a2cc-095ef1b4a2ed]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:25c3dc97-c9cb-4529-ab32-26ef7fd94fc6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8156a054-43ea-4eeb-bbec-a270a6779a43\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b4a5ced3-77ae-4bf5-8154-bd1645e470f2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c2088266-1d33-4bb1-ac5b-1de832ff7985\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:37:20 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:37:20 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:37:20 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[db6d575e-a6e8-46d7-9dcd-a4a3a4db8f8c]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25c3dc97-c9cb-4529-ab32-26ef7fd94fc6 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2088266-1d33-4bb1-ac5b-1de832ff7985 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4a5ced3-77ae-4bf5-8154-bd1645e470f2 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8156a054-43ea-4eeb-bbec-a270a6779a43 (non-flash)\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:37:20 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-f95e880d-a93f-4116-b771-765b49c4f911 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)
Apr 13 16:37:20 user nova-compute[71731]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25c3dc97-c9cb-4529-ab32-26ef7fd94fc6 (non-flash)
Apr 13 16:37:20 user nova-compute[71731]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2088266-1d33-4bb1-ac5b-1de832ff7985 (non-flash)
Apr 13 16:37:20 user nova-compute[71731]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4a5ced3-77ae-4bf5-8154-bd1645e470f2 (non-flash)
Apr 13 16:37:20 user nova-compute[71731]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8156a054-43ea-4eeb-bbec-a270a6779a43 (non-flash)
Apr 13 16:37:20 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 16:37:20 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-f95e880d-a93f-4116-b771-765b49c4f911 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)
Apr 13 16:37:20 user nova-compute[71731]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25c3dc97-c9cb-4529-ab32-26ef7fd94fc6 (non-flash)
Apr 13 16:37:20 user nova-compute[71731]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2088266-1d33-4bb1-ac5b-1de832ff7985 (non-flash)
Apr 13 16:37:20 user nova-compute[71731]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4a5ced3-77ae-4bf5-8154-bd1645e470f2 (non-flash)
Apr 13 16:37:20 user nova-compute[71731]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8156a054-43ea-4eeb-bbec-a270a6779a43 (non-flash)
Apr 13 16:37:20 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 16:37:20 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-f95e880d-a93f-4116-b771-765b49c4f911 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8cd019c1f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:25c3dc97-c9cb-4529-ab32-26ef7fd94fc6'): ({'sdd'}, set())}) {{(pid=71731) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 16:37:20 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-f95e880d-a93f-4116-b771-765b49c4f911 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Removing single pathed devices sdd {{(pid=71731) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 16:37:20 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:37:20 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:37:20 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[23e8342a-9f43-4357-960c-985e537fb57c]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:37:20 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:37:20 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:37:20 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ad551a5-d60b-4986-86de-ca5f74477613]: (4, ('ok\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:37:20 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-f95e880d-a93f-4116-b771-765b49c4f911 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Flushing IO for device /dev/sdd {{(pid=71731) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 16:37:20 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:37:20 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:37:20 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:37:20 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:37:20 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[e00ce5fe-42a5-4b50-8e37-f038acf31504]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:37:20 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-f95e880d-a93f-4116-b771-765b49c4f911 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=71731) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 16:37:20 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:37:20 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:37:20 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.057s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:37:20 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[159b7ba2-a5bf-41ed-aeba-93d86ffc58f9]: (4, ('1', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:37:20 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-f95e880d-a93f-4116-b771-765b49c4f911 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=71731) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 16:37:20 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-f95e880d-a93f-4116-b771-765b49c4f911 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] SCSI volumes sdd have been removed. {{(pid=71731) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 16:37:20 user nova-compute[71731]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_9b3d3601', '/dev/disk/by-id/scsi-23838303333626134', '/dev/disk/by-id/scsi-1SCST_BIO9b3d3601-88033ba4647a9806') {{(pid=81776) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Apr 13 16:37:20 user nova-compute[71731]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_9b3d3601
Apr 13 16:37:20 user nova-compute[71731]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-23838303333626134
Apr 13 16:37:20 user nova-compute[71731]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIO9b3d3601-88033ba4647a9806
Apr 13 16:37:20 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[35bdfdf4-f9b9-45e5-84e6-e12ad17247ad]: (4, None) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:37:20 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-f95e880d-a93f-4116-b771-765b49c4f911 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:25c3dc97-c9cb-4529-ab32-26ef7fd94fc6')] {{(pid=71731) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 16:37:20 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25c3dc97-c9cb-4529-ab32-26ef7fd94fc6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:37:20 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25c3dc97-c9cb-4529-ab32-26ef7fd94fc6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:37:20 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[e15f4567-9845-48b9-99fe-e9d7fc8ae287]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:37:20 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-f95e880d-a93f-4116-b771-765b49c4f911 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:37:20 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25c3dc97-c9cb-4529-ab32-26ef7fd94fc6 -p 172.16.0.220:3260 --logout {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:37:21 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25c3dc97-c9cb-4529-ab32-26ef7fd94fc6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:37:21 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb380df3-e56f-427d-9a94-9a610f92362f]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:25c3dc97-c9cb-4529-ab32-26ef7fd94fc6, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:25c3dc97-c9cb-4529-ab32-26ef7fd94fc6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:37:21 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-f95e880d-a93f-4116-b771-765b49c4f911 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:25c3dc97-c9cb-4529-ab32-26ef7fd94fc6, portal: 172.16.0.220,3260]
Apr 13 16:37:21 user nova-compute[71731]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:25c3dc97-c9cb-4529-ab32-26ef7fd94fc6, portal: 172.16.0.220,3260] successful.
Apr 13 16:37:21 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:37:21 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25c3dc97-c9cb-4529-ab32-26ef7fd94fc6 -p 172.16.0.220:3260 --op delete {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:37:21 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25c3dc97-c9cb-4529-ab32-26ef7fd94fc6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:37:21 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[d35bf59a-6f1c-4086-83a1-7754eecd42d3]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:37:21 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-f95e880d-a93f-4116-b771-765b49c4f911 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:37:21 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-f95e880d-a93f-4116-b771-765b49c4f911 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.377s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 16:37:21 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-f95e880d-a93f-4116-b771-765b49c4f911 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] <== disconnect_volume: return (379ms) None {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 16:37:21 user nova-compute[71731]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f95e880d-a93f-4116-b771-765b49c4f911 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: 2956ab05-28ff-4c9e-b646-dbb83b3db278] Disconnected iSCSI Volume {{(pid=71731) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 16:37:21 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-f95e880d-a93f-4116-b771-765b49c4f911 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: 2956ab05-28ff-4c9e-b646-dbb83b3db278] Deleting instance files /opt/stack/data/nova/instances/2956ab05-28ff-4c9e-b646-dbb83b3db278_del
Apr 13 16:37:21 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-f95e880d-a93f-4116-b771-765b49c4f911 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: 2956ab05-28ff-4c9e-b646-dbb83b3db278] Deletion of /opt/stack/data/nova/instances/2956ab05-28ff-4c9e-b646-dbb83b3db278_del complete
Apr 13 16:37:21 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-9e938d63-1c66-4c4f-b8a1-1d6daf2d88e4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.370s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 16:37:21 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:37:21 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:37:21 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[22cd16c8-0d43-471a-85f6-89dbe7fe6f84]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c2088266-1d33-4bb1-ac5b-1de832ff7985\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b4a5ced3-77ae-4bf5-8154-bd1645e470f2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8156a054-43ea-4eeb-bbec-a270a6779a43\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:37:21 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e938d63-1c66-4c4f-b8a1-1d6daf2d88e4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 16:37:21 user nova-compute[71731]: No targets found.
Apr 13 16:37:21 user nova-compute[71731]: iSNS:
Apr 13 16:37:21 user nova-compute[71731]: No targets found.
Apr 13 16:37:21 user nova-compute[71731]: STATIC:
Apr 13 16:37:21 user nova-compute[71731]: Target: iqn.2010-10.org.openstack:c2088266-1d33-4bb1-ac5b-1de832ff7985
Apr 13 16:37:21 user nova-compute[71731]:         Portal: 172.16.0.220:3260,-1
Apr 13 16:37:21 user nova-compute[71731]:                 Iface Name: default
Apr 13 16:37:21 user nova-compute[71731]: Target: iqn.2010-10.org.openstack:b4a5ced3-77ae-4bf5-8154-bd1645e470f2
Apr 13 16:37:21 user nova-compute[71731]:         Portal: 172.16.0.220:3260,-1
Apr 13 16:37:21 user nova-compute[71731]:                 Iface Name: default
Apr 13 16:37:21 user nova-compute[71731]: Target: iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97
Apr 13 16:37:21 user nova-compute[71731]:         Portal: 172.16.0.220:3260,-1
Apr 13 16:37:21 user nova-compute[71731]:                 Iface Name: default
Apr 13 16:37:21 user nova-compute[71731]: Target: iqn.2010-10.org.openstack:8156a054-43ea-4eeb-bbec-a270a6779a43
Apr 13 16:37:21 user nova-compute[71731]:         Portal: 172.16.0.220:3260,-1
Apr 13 16:37:21 user nova-compute[71731]:                 Iface Name: default
Apr 13 16:37:21 user nova-compute[71731]: FIRMWARE:
Apr 13 16:37:21 user nova-compute[71731]: No targets found.
Apr 13 16:37:21 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 16:37:21 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e938d63-1c66-4c4f-b8a1-1d6daf2d88e4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 16:37:21 user nova-compute[71731]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 16:37:21 user nova-compute[71731]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71731) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 16:37:21 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e938d63-1c66-4c4f-b8a1-1d6daf2d88e4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b4a5ced3-77ae-4bf5-8154-bd1645e470f2', 0)] {{(pid=71731) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 16:37:21 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:37:21 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:37:21 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:37:21 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:37:21 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8474c56-9a2f-40a6-a280-607f1d2d0bb8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8156a054-43ea-4eeb-bbec-a270a6779a43\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b4a5ced3-77ae-4bf5-8154-bd1645e470f2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c2088266-1d33-4bb1-ac5b-1de832ff7985\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:37:21 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:37:21 user nova-compute[71731]: INFO nova.compute.manager [None req-f95e880d-a93f-4116-b771-765b49c4f911 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: 2956ab05-28ff-4c9e-b646-dbb83b3db278] Took 1.52 seconds to destroy the instance on the hypervisor.
Apr 13 16:37:21 user nova-compute[71731]: DEBUG oslo.service.loopingcall [None req-f95e880d-a93f-4116-b771-765b49c4f911 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71731) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 16:37:21 user nova-compute[71731]: DEBUG nova.compute.manager [-] [instance: 2956ab05-28ff-4c9e-b646-dbb83b3db278] Deallocating network for instance {{(pid=71731) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 16:37:21 user nova-compute[71731]: DEBUG nova.network.neutron [-] [instance: 2956ab05-28ff-4c9e-b646-dbb83b3db278] deallocate_for_instance() {{(pid=71731) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 16:37:21 user nova-compute[71731]: DEBUG nova.network.neutron [req-c69676e0-71c2-4a15-99ae-418a37107556 req-c6ff3f62-2279-48a1-a86e-18f4b55616b0 service nova] [instance: 0a5c9b2c-fe1e-4a21-b213-c63e2c28748a] Updated VIF entry in instance network info cache for port ee0eba83-c6e1-4415-96d1-e5b496ec0afe. {{(pid=71731) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 16:37:21 user nova-compute[71731]: DEBUG nova.network.neutron [req-c69676e0-71c2-4a15-99ae-418a37107556 req-c6ff3f62-2279-48a1-a86e-18f4b55616b0 service nova] [instance: 0a5c9b2c-fe1e-4a21-b213-c63e2c28748a] Updating instance_info_cache with network_info: [{"id": "ee0eba83-c6e1-4415-96d1-e5b496ec0afe", "address": "fa:16:3e:9d:3c:e8", "network": {"id": "d36bc206-f629-4d6e-8a3f-458061d7b525", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-893271134-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d451e0e239f486aa2b3abe9e273eab3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee0eba83-c6", "ovs_interfaceid": "ee0eba83-c6e1-4415-96d1-e5b496ec0afe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:37:21 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:37:21 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b432ee1-0c03-4f2e-996f-22853c23fcf3]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2088266-1d33-4bb1-ac5b-1de832ff7985 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4a5ced3-77ae-4bf5-8154-bd1645e470f2 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8156a054-43ea-4eeb-bbec-a270a6779a43 (non-flash)\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:37:21 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e938d63-1c66-4c4f-b8a1-1d6daf2d88e4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)
Apr 13 16:37:21 user nova-compute[71731]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2088266-1d33-4bb1-ac5b-1de832ff7985 (non-flash)
Apr 13 16:37:21 user nova-compute[71731]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4a5ced3-77ae-4bf5-8154-bd1645e470f2 (non-flash)
Apr 13 16:37:21 user nova-compute[71731]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8156a054-43ea-4eeb-bbec-a270a6779a43 (non-flash)
Apr 13 16:37:21 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 16:37:21 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e938d63-1c66-4c4f-b8a1-1d6daf2d88e4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)
Apr 13 16:37:21 user nova-compute[71731]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2088266-1d33-4bb1-ac5b-1de832ff7985 (non-flash)
Apr 13 16:37:21 user nova-compute[71731]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4a5ced3-77ae-4bf5-8154-bd1645e470f2 (non-flash)
Apr 13 16:37:21 user nova-compute[71731]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8156a054-43ea-4eeb-bbec-a270a6779a43 (non-flash)
Apr 13 16:37:21 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 16:37:21 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e938d63-1c66-4c4f-b8a1-1d6daf2d88e4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8cb0671fc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b4a5ced3-77ae-4bf5-8154-bd1645e470f2'): ({'sdf'}, set())}) {{(pid=71731) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 16:37:21 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-9e938d63-1c66-4c4f-b8a1-1d6daf2d88e4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Removing single pathed devices sdf {{(pid=71731) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 16:37:21 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-c69676e0-71c2-4a15-99ae-418a37107556 req-c6ff3f62-2279-48a1-a86e-18f4b55616b0 service nova] Releasing lock "refresh_cache-0a5c9b2c-fe1e-4a21-b213-c63e2c28748a" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 16:37:21 user nova-compute[71731]: DEBUG nova.compute.manager [req-c69676e0-71c2-4a15-99ae-418a37107556 req-c6ff3f62-2279-48a1-a86e-18f4b55616b0 service nova] [instance: 0a5c9b2c-fe1e-4a21-b213-c63e2c28748a] Received event network-vif-unplugged-ee0eba83-c6e1-4415-96d1-e5b496ec0afe {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:37:21 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-c69676e0-71c2-4a15-99ae-418a37107556 req-c6ff3f62-2279-48a1-a86e-18f4b55616b0 service nova] Acquiring lock "0a5c9b2c-fe1e-4a21-b213-c63e2c28748a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:37:21 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-c69676e0-71c2-4a15-99ae-418a37107556 req-c6ff3f62-2279-48a1-a86e-18f4b55616b0 service nova] Lock "0a5c9b2c-fe1e-4a21-b213-c63e2c28748a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:37:21 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-c69676e0-71c2-4a15-99ae-418a37107556 req-c6ff3f62-2279-48a1-a86e-18f4b55616b0 service nova] Lock "0a5c9b2c-fe1e-4a21-b213-c63e2c28748a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:37:21 user nova-compute[71731]: DEBUG nova.compute.manager [req-c69676e0-71c2-4a15-99ae-418a37107556 req-c6ff3f62-2279-48a1-a86e-18f4b55616b0 service nova] [instance: 0a5c9b2c-fe1e-4a21-b213-c63e2c28748a] No waiting events found dispatching network-vif-unplugged-ee0eba83-c6e1-4415-96d1-e5b496ec0afe {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:37:21 user nova-compute[71731]: DEBUG nova.compute.manager [req-c69676e0-71c2-4a15-99ae-418a37107556 req-c6ff3f62-2279-48a1-a86e-18f4b55616b0 service nova] [instance: 0a5c9b2c-fe1e-4a21-b213-c63e2c28748a] Received event network-vif-unplugged-ee0eba83-c6e1-4415-96d1-e5b496ec0afe for instance with task_state deleting. {{(pid=71731) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 16:37:21 user nova-compute[71731]: DEBUG nova.compute.manager [req-c69676e0-71c2-4a15-99ae-418a37107556 req-c6ff3f62-2279-48a1-a86e-18f4b55616b0 service nova] [instance: 0a5c9b2c-fe1e-4a21-b213-c63e2c28748a] Received event network-vif-plugged-ee0eba83-c6e1-4415-96d1-e5b496ec0afe {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:37:21 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-c69676e0-71c2-4a15-99ae-418a37107556 req-c6ff3f62-2279-48a1-a86e-18f4b55616b0 service nova] Acquiring lock "0a5c9b2c-fe1e-4a21-b213-c63e2c28748a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:37:21 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-c69676e0-71c2-4a15-99ae-418a37107556 req-c6ff3f62-2279-48a1-a86e-18f4b55616b0 service nova] Lock "0a5c9b2c-fe1e-4a21-b213-c63e2c28748a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:37:21 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-c69676e0-71c2-4a15-99ae-418a37107556 req-c6ff3f62-2279-48a1-a86e-18f4b55616b0 service nova] Lock "0a5c9b2c-fe1e-4a21-b213-c63e2c28748a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:37:21 user nova-compute[71731]: DEBUG nova.compute.manager [req-c69676e0-71c2-4a15-99ae-418a37107556 req-c6ff3f62-2279-48a1-a86e-18f4b55616b0 service nova] [instance: 0a5c9b2c-fe1e-4a21-b213-c63e2c28748a] No waiting events found dispatching network-vif-plugged-ee0eba83-c6e1-4415-96d1-e5b496ec0afe {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:37:21 user nova-compute[71731]: WARNING nova.compute.manager [req-c69676e0-71c2-4a15-99ae-418a37107556 req-c6ff3f62-2279-48a1-a86e-18f4b55616b0 service nova] [instance: 0a5c9b2c-fe1e-4a21-b213-c63e2c28748a] Received unexpected event network-vif-plugged-ee0eba83-c6e1-4415-96d1-e5b496ec0afe for instance with vm_state active and task_state deleting.
Apr 13 16:37:21 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:37:21 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:37:21 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[565e880b-a447-4f16-a402-aaaeb1c67b83]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:37:21 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:37:21 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.021s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:37:21 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7980a0d-7274-41b0-aec2-4c0c57d12deb]: (4, ('ok\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:37:21 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-9e938d63-1c66-4c4f-b8a1-1d6daf2d88e4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Flushing IO for device /dev/sdf {{(pid=71731) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 16:37:21 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:37:21 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.012s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:37:21 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[5095dff0-d5c7-462a-8f00-0bde9ea4968f]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:37:21 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-9e938d63-1c66-4c4f-b8a1-1d6daf2d88e4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=71731) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 16:37:21 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:37:21 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.052s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:37:21 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[0db79017-3860-4ffd-985c-00584742bd7f]: (4, ('1', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:37:21 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-9e938d63-1c66-4c4f-b8a1-1d6daf2d88e4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=71731) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 16:37:21 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-9e938d63-1c66-4c4f-b8a1-1d6daf2d88e4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] SCSI volumes sdf have been removed. {{(pid=71731) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 16:37:21 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e938d63-1c66-4c4f-b8a1-1d6daf2d88e4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b4a5ced3-77ae-4bf5-8154-bd1645e470f2')] {{(pid=71731) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 16:37:21 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4a5ced3-77ae-4bf5-8154-bd1645e470f2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:37:21 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4a5ced3-77ae-4bf5-8154-bd1645e470f2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:37:21 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c4d5280-2bd6-4377-af6e-cd5dc6fc0ce0]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:37:21 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e938d63-1c66-4c4f-b8a1-1d6daf2d88e4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:37:21 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4a5ced3-77ae-4bf5-8154-bd1645e470f2 -p 172.16.0.220:3260 --logout {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:37:21 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4a5ced3-77ae-4bf5-8154-bd1645e470f2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:37:21 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2f3bc1f-65b2-40d0-9148-8c0fb58a7ac7]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:b4a5ced3-77ae-4bf5-8154-bd1645e470f2, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:b4a5ced3-77ae-4bf5-8154-bd1645e470f2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:37:21 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e938d63-1c66-4c4f-b8a1-1d6daf2d88e4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:b4a5ced3-77ae-4bf5-8154-bd1645e470f2, portal: 172.16.0.220,3260]
Apr 13 16:37:21 user nova-compute[71731]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:b4a5ced3-77ae-4bf5-8154-bd1645e470f2, portal: 172.16.0.220,3260] successful.
Apr 13 16:37:21 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:37:21 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4a5ced3-77ae-4bf5-8154-bd1645e470f2 -p 172.16.0.220:3260 --op delete {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:37:21 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4a5ced3-77ae-4bf5-8154-bd1645e470f2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:37:21 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[0057ccfd-3b12-41bd-a95c-e8f5bef88667]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:37:21 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e938d63-1c66-4c4f-b8a1-1d6daf2d88e4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:37:21 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-9e938d63-1c66-4c4f-b8a1-1d6daf2d88e4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.329s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 16:37:21 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e938d63-1c66-4c4f-b8a1-1d6daf2d88e4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] <== disconnect_volume: return (699ms) None {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 16:37:21 user nova-compute[71731]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9e938d63-1c66-4c4f-b8a1-1d6daf2d88e4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 0a5c9b2c-fe1e-4a21-b213-c63e2c28748a] Disconnected iSCSI Volume {{(pid=71731) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 16:37:21 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-9e938d63-1c66-4c4f-b8a1-1d6daf2d88e4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 0a5c9b2c-fe1e-4a21-b213-c63e2c28748a] Deleting instance files /opt/stack/data/nova/instances/0a5c9b2c-fe1e-4a21-b213-c63e2c28748a_del
Apr 13 16:37:21 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-9e938d63-1c66-4c4f-b8a1-1d6daf2d88e4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 0a5c9b2c-fe1e-4a21-b213-c63e2c28748a] Deletion of /opt/stack/data/nova/instances/0a5c9b2c-fe1e-4a21-b213-c63e2c28748a_del complete
Apr 13 16:37:21 user nova-compute[71731]: INFO nova.compute.manager [None req-9e938d63-1c66-4c4f-b8a1-1d6daf2d88e4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 0a5c9b2c-fe1e-4a21-b213-c63e2c28748a] Took 1.96 seconds to destroy the instance on the hypervisor.
Apr 13 16:37:21 user nova-compute[71731]: DEBUG oslo.service.loopingcall [None req-9e938d63-1c66-4c4f-b8a1-1d6daf2d88e4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71731) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 16:37:21 user nova-compute[71731]: DEBUG nova.compute.manager [-] [instance: 0a5c9b2c-fe1e-4a21-b213-c63e2c28748a] Deallocating network for instance {{(pid=71731) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 16:37:21 user nova-compute[71731]: DEBUG nova.network.neutron [-] [instance: 0a5c9b2c-fe1e-4a21-b213-c63e2c28748a] deallocate_for_instance() {{(pid=71731) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 16:37:21 user nova-compute[71731]: DEBUG nova.network.neutron [-] [instance: 2956ab05-28ff-4c9e-b646-dbb83b3db278] Updating instance_info_cache with network_info: [] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:37:21 user nova-compute[71731]: INFO nova.compute.manager [-] [instance: 2956ab05-28ff-4c9e-b646-dbb83b3db278] Took 0.59 seconds to deallocate network for instance.
Apr 13 16:37:21 user nova-compute[71731]: DEBUG nova.compute.manager [req-0e2aeca1-6d67-4ca2-920e-83fb4ffb3781 req-b1050d80-26c0-476e-87d0-68bd033cf2f2 service nova] [instance: 2956ab05-28ff-4c9e-b646-dbb83b3db278] Received event network-vif-deleted-84df62e9-af7c-4e62-83da-b43b511be2a0 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:37:21 user nova-compute[71731]: DEBUG nova.network.neutron [-] [instance: 0a5c9b2c-fe1e-4a21-b213-c63e2c28748a] Updating instance_info_cache with network_info: [] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:37:21 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:37:22 user nova-compute[71731]: INFO nova.compute.manager [-] [instance: 0a5c9b2c-fe1e-4a21-b213-c63e2c28748a] Took 0.54 seconds to deallocate network for instance.
Apr 13 16:37:22 user nova-compute[71731]: DEBUG nova.compute.manager [req-a5ce26b7-b570-4fd1-95e8-b1d488656c98 req-7451037a-ba66-4544-b979-cdfa354193ea service nova] [instance: 2956ab05-28ff-4c9e-b646-dbb83b3db278] Received event network-vif-plugged-84df62e9-af7c-4e62-83da-b43b511be2a0 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:37:22 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-a5ce26b7-b570-4fd1-95e8-b1d488656c98 req-7451037a-ba66-4544-b979-cdfa354193ea service nova] Acquiring lock "2956ab05-28ff-4c9e-b646-dbb83b3db278-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:37:22 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-a5ce26b7-b570-4fd1-95e8-b1d488656c98 req-7451037a-ba66-4544-b979-cdfa354193ea service nova] Lock "2956ab05-28ff-4c9e-b646-dbb83b3db278-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:37:22 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-a5ce26b7-b570-4fd1-95e8-b1d488656c98 req-7451037a-ba66-4544-b979-cdfa354193ea service nova] Lock "2956ab05-28ff-4c9e-b646-dbb83b3db278-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:37:22 user nova-compute[71731]: DEBUG nova.compute.manager [req-a5ce26b7-b570-4fd1-95e8-b1d488656c98 req-7451037a-ba66-4544-b979-cdfa354193ea service nova] [instance: 2956ab05-28ff-4c9e-b646-dbb83b3db278] No waiting events found dispatching network-vif-plugged-84df62e9-af7c-4e62-83da-b43b511be2a0 {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:37:22 user nova-compute[71731]: WARNING nova.compute.manager [req-a5ce26b7-b570-4fd1-95e8-b1d488656c98 req-7451037a-ba66-4544-b979-cdfa354193ea service nova] [instance: 2956ab05-28ff-4c9e-b646-dbb83b3db278] Received unexpected event network-vif-plugged-84df62e9-af7c-4e62-83da-b43b511be2a0 for instance with vm_state active and task_state deleting.
Apr 13 16:37:22 user nova-compute[71731]: DEBUG nova.compute.manager [req-531e9256-cebc-433e-95c3-915fe30db6ba req-58563782-77be-4af6-9b2f-d8f481f9a4a5 service nova] [instance: 0a5c9b2c-fe1e-4a21-b213-c63e2c28748a] Received event network-vif-plugged-ee0eba83-c6e1-4415-96d1-e5b496ec0afe {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:37:22 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-531e9256-cebc-433e-95c3-915fe30db6ba req-58563782-77be-4af6-9b2f-d8f481f9a4a5 service nova] Acquiring lock "0a5c9b2c-fe1e-4a21-b213-c63e2c28748a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:37:22 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-531e9256-cebc-433e-95c3-915fe30db6ba req-58563782-77be-4af6-9b2f-d8f481f9a4a5 service nova] Lock "0a5c9b2c-fe1e-4a21-b213-c63e2c28748a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:37:22 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-531e9256-cebc-433e-95c3-915fe30db6ba req-58563782-77be-4af6-9b2f-d8f481f9a4a5 service nova] Lock "0a5c9b2c-fe1e-4a21-b213-c63e2c28748a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:37:22 user nova-compute[71731]: DEBUG nova.compute.manager [req-531e9256-cebc-433e-95c3-915fe30db6ba req-58563782-77be-4af6-9b2f-d8f481f9a4a5 service nova] [instance: 0a5c9b2c-fe1e-4a21-b213-c63e2c28748a] No waiting events found dispatching network-vif-plugged-ee0eba83-c6e1-4415-96d1-e5b496ec0afe {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:37:22 user nova-compute[71731]: WARNING nova.compute.manager [req-531e9256-cebc-433e-95c3-915fe30db6ba req-58563782-77be-4af6-9b2f-d8f481f9a4a5 service nova] [instance: 0a5c9b2c-fe1e-4a21-b213-c63e2c28748a] Received unexpected event network-vif-plugged-ee0eba83-c6e1-4415-96d1-e5b496ec0afe for instance with vm_state active and task_state deleting.
Apr 13 16:37:22 user nova-compute[71731]: DEBUG nova.compute.manager [req-531e9256-cebc-433e-95c3-915fe30db6ba req-58563782-77be-4af6-9b2f-d8f481f9a4a5 service nova] [instance: 0a5c9b2c-fe1e-4a21-b213-c63e2c28748a] Received event network-vif-plugged-ee0eba83-c6e1-4415-96d1-e5b496ec0afe {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:37:22 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-531e9256-cebc-433e-95c3-915fe30db6ba req-58563782-77be-4af6-9b2f-d8f481f9a4a5 service nova] Acquiring lock "0a5c9b2c-fe1e-4a21-b213-c63e2c28748a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:37:22 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-531e9256-cebc-433e-95c3-915fe30db6ba req-58563782-77be-4af6-9b2f-d8f481f9a4a5 service nova] Lock "0a5c9b2c-fe1e-4a21-b213-c63e2c28748a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:37:22 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-531e9256-cebc-433e-95c3-915fe30db6ba req-58563782-77be-4af6-9b2f-d8f481f9a4a5 service nova] Lock "0a5c9b2c-fe1e-4a21-b213-c63e2c28748a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:37:22 user nova-compute[71731]: DEBUG nova.compute.manager [req-531e9256-cebc-433e-95c3-915fe30db6ba req-58563782-77be-4af6-9b2f-d8f481f9a4a5 service nova] [instance: 0a5c9b2c-fe1e-4a21-b213-c63e2c28748a] No waiting events found dispatching network-vif-plugged-ee0eba83-c6e1-4415-96d1-e5b496ec0afe {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:37:22 user nova-compute[71731]: WARNING nova.compute.manager [req-531e9256-cebc-433e-95c3-915fe30db6ba req-58563782-77be-4af6-9b2f-d8f481f9a4a5 service nova] [instance: 0a5c9b2c-fe1e-4a21-b213-c63e2c28748a] Received unexpected event network-vif-plugged-ee0eba83-c6e1-4415-96d1-e5b496ec0afe for instance with vm_state active and task_state deleting.
Apr 13 16:37:22 user nova-compute[71731]: DEBUG nova.compute.manager [req-531e9256-cebc-433e-95c3-915fe30db6ba req-58563782-77be-4af6-9b2f-d8f481f9a4a5 service nova] [instance: 0a5c9b2c-fe1e-4a21-b213-c63e2c28748a] Received event network-vif-unplugged-ee0eba83-c6e1-4415-96d1-e5b496ec0afe {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:37:22 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-531e9256-cebc-433e-95c3-915fe30db6ba req-58563782-77be-4af6-9b2f-d8f481f9a4a5 service nova] Acquiring lock "0a5c9b2c-fe1e-4a21-b213-c63e2c28748a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:37:22 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-531e9256-cebc-433e-95c3-915fe30db6ba req-58563782-77be-4af6-9b2f-d8f481f9a4a5 service nova] Lock "0a5c9b2c-fe1e-4a21-b213-c63e2c28748a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:37:22 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-531e9256-cebc-433e-95c3-915fe30db6ba req-58563782-77be-4af6-9b2f-d8f481f9a4a5 service nova] Lock "0a5c9b2c-fe1e-4a21-b213-c63e2c28748a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:37:22 user nova-compute[71731]: DEBUG nova.compute.manager [req-531e9256-cebc-433e-95c3-915fe30db6ba req-58563782-77be-4af6-9b2f-d8f481f9a4a5 service nova] [instance: 0a5c9b2c-fe1e-4a21-b213-c63e2c28748a] No waiting events found dispatching network-vif-unplugged-ee0eba83-c6e1-4415-96d1-e5b496ec0afe {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:37:22 user nova-compute[71731]: DEBUG nova.compute.manager [req-531e9256-cebc-433e-95c3-915fe30db6ba req-58563782-77be-4af6-9b2f-d8f481f9a4a5 service nova] [instance: 0a5c9b2c-fe1e-4a21-b213-c63e2c28748a] Received event network-vif-unplugged-ee0eba83-c6e1-4415-96d1-e5b496ec0afe for instance with task_state deleting. {{(pid=71731) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 16:37:22 user nova-compute[71731]: DEBUG nova.compute.manager [req-531e9256-cebc-433e-95c3-915fe30db6ba req-58563782-77be-4af6-9b2f-d8f481f9a4a5 service nova] [instance: 0a5c9b2c-fe1e-4a21-b213-c63e2c28748a] Received event network-vif-plugged-ee0eba83-c6e1-4415-96d1-e5b496ec0afe {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:37:22 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-531e9256-cebc-433e-95c3-915fe30db6ba req-58563782-77be-4af6-9b2f-d8f481f9a4a5 service nova] Acquiring lock "0a5c9b2c-fe1e-4a21-b213-c63e2c28748a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:37:22 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-531e9256-cebc-433e-95c3-915fe30db6ba req-58563782-77be-4af6-9b2f-d8f481f9a4a5 service nova] Lock "0a5c9b2c-fe1e-4a21-b213-c63e2c28748a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:37:22 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-531e9256-cebc-433e-95c3-915fe30db6ba req-58563782-77be-4af6-9b2f-d8f481f9a4a5 service nova] Lock "0a5c9b2c-fe1e-4a21-b213-c63e2c28748a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:37:22 user nova-compute[71731]: DEBUG nova.compute.manager [req-531e9256-cebc-433e-95c3-915fe30db6ba req-58563782-77be-4af6-9b2f-d8f481f9a4a5 service nova] [instance: 0a5c9b2c-fe1e-4a21-b213-c63e2c28748a] No waiting events found dispatching network-vif-plugged-ee0eba83-c6e1-4415-96d1-e5b496ec0afe {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:37:22 user nova-compute[71731]: WARNING nova.compute.manager [req-531e9256-cebc-433e-95c3-915fe30db6ba req-58563782-77be-4af6-9b2f-d8f481f9a4a5 service nova] [instance: 0a5c9b2c-fe1e-4a21-b213-c63e2c28748a] Received unexpected event network-vif-plugged-ee0eba83-c6e1-4415-96d1-e5b496ec0afe for instance with vm_state active and task_state deleting.
Apr 13 16:37:22 user nova-compute[71731]: INFO nova.compute.manager [None req-f95e880d-a93f-4116-b771-765b49c4f911 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: 2956ab05-28ff-4c9e-b646-dbb83b3db278] Took 0.83 seconds to detach 1 volumes for instance.
Apr 13 16:37:22 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-f95e880d-a93f-4116-b771-765b49c4f911 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:37:22 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-f95e880d-a93f-4116-b771-765b49c4f911 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:37:22 user nova-compute[71731]: DEBUG nova.compute.provider_tree [None req-f95e880d-a93f-4116-b771-765b49c4f911 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Inventory has not changed in ProviderTree for provider: cb6b1a64-0c24-4e2d-af1e-16576ca9165c {{(pid=71731) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 16:37:22 user nova-compute[71731]: INFO nova.compute.manager [None req-9e938d63-1c66-4c4f-b8a1-1d6daf2d88e4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 0a5c9b2c-fe1e-4a21-b213-c63e2c28748a] Took 0.86 seconds to detach 1 volumes for instance.
Apr 13 16:37:22 user nova-compute[71731]: DEBUG nova.scheduler.client.report [None req-f95e880d-a93f-4116-b771-765b49c4f911 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Inventory has not changed for provider cb6b1a64-0c24-4e2d-af1e-16576ca9165c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71731) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 16:37:22 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-f95e880d-a93f-4116-b771-765b49c4f911 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.306s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:37:22 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-9e938d63-1c66-4c4f-b8a1-1d6daf2d88e4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:37:22 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-9e938d63-1c66-4c4f-b8a1-1d6daf2d88e4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:37:22 user nova-compute[71731]: INFO nova.scheduler.client.report [None req-f95e880d-a93f-4116-b771-765b49c4f911 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Deleted allocations for instance 2956ab05-28ff-4c9e-b646-dbb83b3db278
Apr 13 16:37:23 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-f95e880d-a93f-4116-b771-765b49c4f911 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lock "2956ab05-28ff-4c9e-b646-dbb83b3db278" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.444s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:37:23 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:37:23 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Starting heal instance info cache {{(pid=71731) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 16:37:23 user nova-compute[71731]: DEBUG nova.compute.provider_tree [None req-9e938d63-1c66-4c4f-b8a1-1d6daf2d88e4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Inventory has not changed in ProviderTree for provider: cb6b1a64-0c24-4e2d-af1e-16576ca9165c {{(pid=71731) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 16:37:23 user nova-compute[71731]: DEBUG nova.scheduler.client.report [None req-9e938d63-1c66-4c4f-b8a1-1d6daf2d88e4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Inventory has not changed for provider cb6b1a64-0c24-4e2d-af1e-16576ca9165c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71731) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 16:37:23 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Acquiring lock "refresh_cache-35b23303-e373-4f35-b7ee-76e6815073ce" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 16:37:23 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Acquired lock "refresh_cache-35b23303-e373-4f35-b7ee-76e6815073ce" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 16:37:23 user nova-compute[71731]: DEBUG nova.network.neutron [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] [instance: 35b23303-e373-4f35-b7ee-76e6815073ce] Forcefully refreshing network info cache for instance {{(pid=71731) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 16:37:23 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-9e938d63-1c66-4c4f-b8a1-1d6daf2d88e4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.246s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:37:23 user nova-compute[71731]: INFO nova.scheduler.client.report [None req-9e938d63-1c66-4c4f-b8a1-1d6daf2d88e4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Deleted allocations for instance 0a5c9b2c-fe1e-4a21-b213-c63e2c28748a
Apr 13 16:37:23 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-9e938d63-1c66-4c4f-b8a1-1d6daf2d88e4 tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "0a5c9b2c-fe1e-4a21-b213-c63e2c28748a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.773s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:37:23 user nova-compute[71731]: DEBUG nova.compute.manager [req-fd280422-69d8-49f2-99ca-227f05ecbd12 req-5dd067d2-5fd9-4f07-a7fd-34aa3665b019 service nova] [instance: 0a5c9b2c-fe1e-4a21-b213-c63e2c28748a] Received event network-vif-deleted-ee0eba83-c6e1-4415-96d1-e5b496ec0afe {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:37:24 user nova-compute[71731]: DEBUG nova.network.neutron [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] [instance: 35b23303-e373-4f35-b7ee-76e6815073ce] Updating instance_info_cache with network_info: [{"id": "d3c66e4e-b15d-4bc9-a838-265ca07a6a66", "address": "fa:16:3e:3a:4e:db", "network": {"id": "5acc9a78-1127-46df-bb60-7544cdd2c1ef", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2143082515-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0653ab16660b46cea9c5af58ea0b1931", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3c66e4e-b1", "ovs_interfaceid": "d3c66e4e-b15d-4bc9-a838-265ca07a6a66", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:37:24 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Releasing lock "refresh_cache-35b23303-e373-4f35-b7ee-76e6815073ce" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 16:37:24 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] [instance: 35b23303-e373-4f35-b7ee-76e6815073ce] Updated the network info_cache for instance {{(pid=71731) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 16:37:24 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:37:25 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:37:25 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:37:25 user nova-compute[71731]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681403830.6272135, acbcaee0-a47b-4fee-8765-9b1c9597d515 => Stopped> {{(pid=71731) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 16:37:25 user nova-compute[71731]: INFO nova.compute.manager [-] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] VM Stopped (Lifecycle Event)
Apr 13 16:37:25 user nova-compute[71731]: DEBUG nova.compute.manager [None req-483b83e1-2829-4a66-9c93-9d4d14174456 None None] [instance: acbcaee0-a47b-4fee-8765-9b1c9597d515] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:37:25 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:37:26 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:37:29 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:37:30 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:37:33 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-38df707c-b89b-46c5-8ea6-46e7adf2983b tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Acquiring lock "35b23303-e373-4f35-b7ee-76e6815073ce" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:37:33 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-38df707c-b89b-46c5-8ea6-46e7adf2983b tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lock "35b23303-e373-4f35-b7ee-76e6815073ce" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:37:33 user nova-compute[71731]: INFO nova.compute.manager [None req-38df707c-b89b-46c5-8ea6-46e7adf2983b tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] [instance: 35b23303-e373-4f35-b7ee-76e6815073ce] Detaching volume 8156a054-43ea-4eeb-bbec-a270a6779a43
Apr 13 16:37:33 user nova-compute[71731]: INFO nova.virt.block_device [None req-38df707c-b89b-46c5-8ea6-46e7adf2983b tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] [instance: 35b23303-e373-4f35-b7ee-76e6815073ce] Attempting to driver detach volume 8156a054-43ea-4eeb-bbec-a270a6779a43 from mountpoint /dev/vdc
Apr 13 16:37:33 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-38df707c-b89b-46c5-8ea6-46e7adf2983b tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Attempting to detach device vdc from instance 35b23303-e373-4f35-b7ee-76e6815073ce from the persistent domain config. {{(pid=71731) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 13 16:37:33 user nova-compute[71731]: DEBUG nova.virt.libvirt.guest [None req-38df707c-b89b-46c5-8ea6-46e7adf2983b tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 16:37:33 user nova-compute[71731]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 16:37:33 user nova-compute[71731]:   <source dev="/dev/sdg"/>
Apr 13 16:37:33 user nova-compute[71731]:   <target dev="vdc" bus="virtio"/>
Apr 13 16:37:33 user nova-compute[71731]:   <serial>8156a054-43ea-4eeb-bbec-a270a6779a43</serial>
Apr 13 16:37:33 user nova-compute[71731]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 13 16:37:33 user nova-compute[71731]: </disk>
Apr 13 16:37:33 user nova-compute[71731]:  {{(pid=71731) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 16:37:33 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-38df707c-b89b-46c5-8ea6-46e7adf2983b tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Successfully detached device vdc from instance 35b23303-e373-4f35-b7ee-76e6815073ce from the persistent domain config.
Apr 13 16:37:33 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-38df707c-b89b-46c5-8ea6-46e7adf2983b tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 35b23303-e373-4f35-b7ee-76e6815073ce from the live domain config. {{(pid=71731) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 13 16:37:33 user nova-compute[71731]: DEBUG nova.virt.libvirt.guest [None req-38df707c-b89b-46c5-8ea6-46e7adf2983b tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 16:37:33 user nova-compute[71731]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 16:37:33 user nova-compute[71731]:   <source dev="/dev/sdg"/>
Apr 13 16:37:33 user nova-compute[71731]:   <target dev="vdc" bus="virtio"/>
Apr 13 16:37:33 user nova-compute[71731]:   <serial>8156a054-43ea-4eeb-bbec-a270a6779a43</serial>
Apr 13 16:37:33 user nova-compute[71731]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 13 16:37:33 user nova-compute[71731]: </disk>
Apr 13 16:37:33 user nova-compute[71731]:  {{(pid=71731) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 16:37:34 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Received event <DeviceRemovedEvent: 1681403854.273291, 35b23303-e373-4f35-b7ee-76e6815073ce => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=71731) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 13 16:37:34 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-38df707c-b89b-46c5-8ea6-46e7adf2983b tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 35b23303-e373-4f35-b7ee-76e6815073ce {{(pid=71731) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 13 16:37:34 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-38df707c-b89b-46c5-8ea6-46e7adf2983b tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Successfully detached device vdc from instance 35b23303-e373-4f35-b7ee-76e6815073ce from the live domain config.
Apr 13 16:37:34 user nova-compute[71731]: DEBUG nova.virt.libvirt.volume.iscsi [None req-38df707c-b89b-46c5-8ea6-46e7adf2983b tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] [instance: 35b23303-e373-4f35-b7ee-76e6815073ce] calling os-brick to detach iSCSI Volume {{(pid=71731) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 16:37:34 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-38df707c-b89b-46c5-8ea6-46e7adf2983b tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8cf0118790>, {'target_iqn': 'iqn.2010-10.org.openstack:8156a054-43ea-4eeb-bbec-a270a6779a43', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fXgTqGKO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg': {}}" {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 16:37:34 user nova-compute[71731]: WARNING os_brick.initiator.connectors.base [None req-38df707c-b89b-46c5-8ea6-46e7adf2983b tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 16:37:34 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-38df707c-b89b-46c5-8ea6-46e7adf2983b tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 16:37:34 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-38df707c-b89b-46c5-8ea6-46e7adf2983b tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 16:37:34 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:37:34 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:37:34 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[9df2a14e-182f-425b-88e7-ee73bcf32105]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c2088266-1d33-4bb1-ac5b-1de832ff7985\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8156a054-43ea-4eeb-bbec-a270a6779a43\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:37:34 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-38df707c-b89b-46c5-8ea6-46e7adf2983b tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 16:37:34 user nova-compute[71731]: No targets found.
Apr 13 16:37:34 user nova-compute[71731]: iSNS:
Apr 13 16:37:34 user nova-compute[71731]: No targets found.
Apr 13 16:37:34 user nova-compute[71731]: STATIC:
Apr 13 16:37:34 user nova-compute[71731]: Target: iqn.2010-10.org.openstack:c2088266-1d33-4bb1-ac5b-1de832ff7985
Apr 13 16:37:34 user nova-compute[71731]:         Portal: 172.16.0.220:3260,-1
Apr 13 16:37:34 user nova-compute[71731]:                 Iface Name: default
Apr 13 16:37:34 user nova-compute[71731]: Target: iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97
Apr 13 16:37:34 user nova-compute[71731]:         Portal: 172.16.0.220:3260,-1
Apr 13 16:37:34 user nova-compute[71731]:                 Iface Name: default
Apr 13 16:37:34 user nova-compute[71731]: Target: iqn.2010-10.org.openstack:8156a054-43ea-4eeb-bbec-a270a6779a43
Apr 13 16:37:34 user nova-compute[71731]:         Portal: 172.16.0.220:3260,-1
Apr 13 16:37:34 user nova-compute[71731]:                 Iface Name: default
Apr 13 16:37:34 user nova-compute[71731]: FIRMWARE:
Apr 13 16:37:34 user nova-compute[71731]: No targets found.
Apr 13 16:37:34 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 16:37:34 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-38df707c-b89b-46c5-8ea6-46e7adf2983b tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 16:37:34 user nova-compute[71731]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 16:37:34 user nova-compute[71731]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71731) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 16:37:34 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-38df707c-b89b-46c5-8ea6-46e7adf2983b tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8156a054-43ea-4eeb-bbec-a270a6779a43', 0)] {{(pid=71731) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 16:37:34 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:37:34 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:37:34 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[7431220c-ffd9-481d-af80-d6b0f434bcf9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8156a054-43ea-4eeb-bbec-a270a6779a43\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c2088266-1d33-4bb1-ac5b-1de832ff7985\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:37:34 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:37:34 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:37:34 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[3566f862-4ee4-4a5a-9463-f42a7fad0872]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2088266-1d33-4bb1-ac5b-1de832ff7985 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8156a054-43ea-4eeb-bbec-a270a6779a43 (non-flash)\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:37:34 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-38df707c-b89b-46c5-8ea6-46e7adf2983b tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)
Apr 13 16:37:34 user nova-compute[71731]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2088266-1d33-4bb1-ac5b-1de832ff7985 (non-flash)
Apr 13 16:37:34 user nova-compute[71731]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8156a054-43ea-4eeb-bbec-a270a6779a43 (non-flash)
Apr 13 16:37:34 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 16:37:34 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-38df707c-b89b-46c5-8ea6-46e7adf2983b tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)
Apr 13 16:37:34 user nova-compute[71731]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2088266-1d33-4bb1-ac5b-1de832ff7985 (non-flash)
Apr 13 16:37:34 user nova-compute[71731]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8156a054-43ea-4eeb-bbec-a270a6779a43 (non-flash)
Apr 13 16:37:34 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 16:37:34 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-38df707c-b89b-46c5-8ea6-46e7adf2983b tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8cf0651360>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8156a054-43ea-4eeb-bbec-a270a6779a43'): ({'sdg'}, set())}) {{(pid=71731) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 16:37:34 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-38df707c-b89b-46c5-8ea6-46e7adf2983b tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Removing single pathed devices sdg {{(pid=71731) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 16:37:34 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:37:34 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:37:34 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9f9c56f-576f-44d7-95a8-8a81d1c507f5]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:37:34 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:37:34 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.021s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:37:34 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[c18da374-c6c2-42b2-b5b6-158edbe471eb]: (4, ('ok\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:37:34 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-38df707c-b89b-46c5-8ea6-46e7adf2983b tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Flushing IO for device /dev/sdg {{(pid=71731) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 16:37:34 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:37:34 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.013s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:37:34 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5879755-d71f-4ad0-abbd-45e477607ddd]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:37:34 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-38df707c-b89b-46c5-8ea6-46e7adf2983b tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=71731) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 16:37:34 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:37:34 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.045s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:37:34 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[34c61daa-864c-4a34-a8aa-dfeb78915982]: (4, ('1', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:37:34 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-38df707c-b89b-46c5-8ea6-46e7adf2983b tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=71731) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 16:37:34 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-38df707c-b89b-46c5-8ea6-46e7adf2983b tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] SCSI volumes sdg have been removed. {{(pid=71731) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 16:37:34 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-38df707c-b89b-46c5-8ea6-46e7adf2983b tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8156a054-43ea-4eeb-bbec-a270a6779a43')] {{(pid=71731) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 16:37:34 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8156a054-43ea-4eeb-bbec-a270a6779a43 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:37:34 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8156a054-43ea-4eeb-bbec-a270a6779a43 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.031s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:37:34 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[759a7e7e-cca6-4648-a308-dab00a4d33c8]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:37:34 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-38df707c-b89b-46c5-8ea6-46e7adf2983b tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:37:34 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8156a054-43ea-4eeb-bbec-a270a6779a43 -p 172.16.0.220:3260 --logout {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:37:34 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8156a054-43ea-4eeb-bbec-a270a6779a43 -p 172.16.0.220:3260 --logout" returned: 0 in 0.048s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:37:34 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[41acf0ad-57a7-447f-97d0-ef480545f0d6]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:8156a054-43ea-4eeb-bbec-a270a6779a43, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:8156a054-43ea-4eeb-bbec-a270a6779a43, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:37:34 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-38df707c-b89b-46c5-8ea6-46e7adf2983b tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:8156a054-43ea-4eeb-bbec-a270a6779a43, portal: 172.16.0.220,3260]
Apr 13 16:37:34 user nova-compute[71731]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:8156a054-43ea-4eeb-bbec-a270a6779a43, portal: 172.16.0.220,3260] successful.
Apr 13 16:37:34 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:37:34 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8156a054-43ea-4eeb-bbec-a270a6779a43 -p 172.16.0.220:3260 --op delete {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:37:34 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8156a054-43ea-4eeb-bbec-a270a6779a43 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:37:34 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4c2f977-dda2-4822-8af5-5d9206f37f04]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:37:34 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-38df707c-b89b-46c5-8ea6-46e7adf2983b tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:37:34 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-38df707c-b89b-46c5-8ea6-46e7adf2983b tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.307s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 16:37:34 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-38df707c-b89b-46c5-8ea6-46e7adf2983b tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] <== disconnect_volume: return (309ms) None {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 16:37:34 user nova-compute[71731]: DEBUG nova.virt.libvirt.volume.iscsi [None req-38df707c-b89b-46c5-8ea6-46e7adf2983b tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] [instance: 35b23303-e373-4f35-b7ee-76e6815073ce] Disconnected iSCSI Volume {{(pid=71731) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 16:37:35 user nova-compute[71731]: DEBUG nova.objects.instance [None req-38df707c-b89b-46c5-8ea6-46e7adf2983b tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lazy-loading 'flavor' on Instance uuid 35b23303-e373-4f35-b7ee-76e6815073ce {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:37:35 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-38df707c-b89b-46c5-8ea6-46e7adf2983b tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lock "35b23303-e373-4f35-b7ee-76e6815073ce" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.669s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:37:35 user nova-compute[71731]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681403840.5820298, 0a5c9b2c-fe1e-4a21-b213-c63e2c28748a => Stopped> {{(pid=71731) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 16:37:35 user nova-compute[71731]: INFO nova.compute.manager [-] [instance: 0a5c9b2c-fe1e-4a21-b213-c63e2c28748a] VM Stopped (Lifecycle Event)
Apr 13 16:37:35 user nova-compute[71731]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681403840.5824158, 2956ab05-28ff-4c9e-b646-dbb83b3db278 => Stopped> {{(pid=71731) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 16:37:35 user nova-compute[71731]: INFO nova.compute.manager [-] [instance: 2956ab05-28ff-4c9e-b646-dbb83b3db278] VM Stopped (Lifecycle Event)
Apr 13 16:37:35 user nova-compute[71731]: DEBUG nova.compute.manager [None req-72111ece-a3ba-441c-b3ee-40016cff51c4 None None] [instance: 0a5c9b2c-fe1e-4a21-b213-c63e2c28748a] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:37:35 user nova-compute[71731]: DEBUG nova.compute.manager [None req-7d425686-6778-4193-916e-f2b7ec318292 None None] [instance: 2956ab05-28ff-4c9e-b646-dbb83b3db278] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:37:35 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 16:37:37 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:37:40 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:37:42 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:37:45 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:37:47 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:37:50 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:37:50 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:37:51 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:37:55 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:38:00 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 16:38:01 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-06f62730-2b9d-4401-a973-dd3161e612ad tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Acquiring lock "5ed800fe-577d-4624-898c-c7f40da77376" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:38:01 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-06f62730-2b9d-4401-a973-dd3161e612ad tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "5ed800fe-577d-4624-898c-c7f40da77376" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:38:01 user nova-compute[71731]: DEBUG nova.compute.manager [None req-06f62730-2b9d-4401-a973-dd3161e612ad tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: 5ed800fe-577d-4624-898c-c7f40da77376] Starting instance... {{(pid=71731) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 16:38:01 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-06f62730-2b9d-4401-a973-dd3161e612ad tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:38:01 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-06f62730-2b9d-4401-a973-dd3161e612ad tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:38:01 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-06f62730-2b9d-4401-a973-dd3161e612ad tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71731) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 16:38:01 user nova-compute[71731]: INFO nova.compute.claims [None req-06f62730-2b9d-4401-a973-dd3161e612ad tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: 5ed800fe-577d-4624-898c-c7f40da77376] Claim successful on node user
Apr 13 16:38:02 user nova-compute[71731]: DEBUG nova.compute.provider_tree [None req-06f62730-2b9d-4401-a973-dd3161e612ad tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Inventory has not changed in ProviderTree for provider: cb6b1a64-0c24-4e2d-af1e-16576ca9165c {{(pid=71731) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 16:38:02 user nova-compute[71731]: DEBUG nova.scheduler.client.report [None req-06f62730-2b9d-4401-a973-dd3161e612ad tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Inventory has not changed for provider cb6b1a64-0c24-4e2d-af1e-16576ca9165c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71731) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 16:38:02 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-06f62730-2b9d-4401-a973-dd3161e612ad tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.364s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:38:02 user nova-compute[71731]: DEBUG nova.compute.manager [None req-06f62730-2b9d-4401-a973-dd3161e612ad tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: 5ed800fe-577d-4624-898c-c7f40da77376] Start building networks asynchronously for instance. {{(pid=71731) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 16:38:02 user nova-compute[71731]: DEBUG nova.compute.manager [None req-06f62730-2b9d-4401-a973-dd3161e612ad tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: 5ed800fe-577d-4624-898c-c7f40da77376] Allocating IP information in the background. {{(pid=71731) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 16:38:02 user nova-compute[71731]: DEBUG nova.network.neutron [None req-06f62730-2b9d-4401-a973-dd3161e612ad tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: 5ed800fe-577d-4624-898c-c7f40da77376] allocate_for_instance() {{(pid=71731) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 16:38:02 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-06f62730-2b9d-4401-a973-dd3161e612ad tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: 5ed800fe-577d-4624-898c-c7f40da77376] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 16:38:02 user nova-compute[71731]: DEBUG nova.compute.manager [None req-06f62730-2b9d-4401-a973-dd3161e612ad tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: 5ed800fe-577d-4624-898c-c7f40da77376] Start building block device mappings for instance. {{(pid=71731) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 16:38:02 user nova-compute[71731]: DEBUG nova.policy [None req-06f62730-2b9d-4401-a973-dd3161e612ad tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1b3df1c5c5d441819bcef89ed6966815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980559734a504574a83224deb7423c77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71731) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 16:38:02 user nova-compute[71731]: DEBUG nova.compute.manager [None req-06f62730-2b9d-4401-a973-dd3161e612ad tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: 5ed800fe-577d-4624-898c-c7f40da77376] Start spawning the instance on the hypervisor. {{(pid=71731) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 16:38:02 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-06f62730-2b9d-4401-a973-dd3161e612ad tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: 5ed800fe-577d-4624-898c-c7f40da77376] Creating instance directory {{(pid=71731) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 16:38:02 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-06f62730-2b9d-4401-a973-dd3161e612ad tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: 5ed800fe-577d-4624-898c-c7f40da77376] Creating image(s)
Apr 13 16:38:02 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-06f62730-2b9d-4401-a973-dd3161e612ad tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Acquiring lock "/opt/stack/data/nova/instances/5ed800fe-577d-4624-898c-c7f40da77376/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:38:02 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-06f62730-2b9d-4401-a973-dd3161e612ad tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "/opt/stack/data/nova/instances/5ed800fe-577d-4624-898c-c7f40da77376/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:38:02 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-06f62730-2b9d-4401-a973-dd3161e612ad tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "/opt/stack/data/nova/instances/5ed800fe-577d-4624-898c-c7f40da77376/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:38:02 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-06f62730-2b9d-4401-a973-dd3161e612ad tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279 --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:38:02 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-06f62730-2b9d-4401-a973-dd3161e612ad tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279 --force-share --output=json" returned: 0 in 0.144s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:38:02 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-06f62730-2b9d-4401-a973-dd3161e612ad tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Acquiring lock "9524227dd898575c3099d3976f096cd935414279" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:38:02 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-06f62730-2b9d-4401-a973-dd3161e612ad tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "9524227dd898575c3099d3976f096cd935414279" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:38:02 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-06f62730-2b9d-4401-a973-dd3161e612ad tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279 --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:38:02 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-06f62730-2b9d-4401-a973-dd3161e612ad tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279 --force-share --output=json" returned: 0 in 0.146s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:38:02 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-06f62730-2b9d-4401-a973-dd3161e612ad tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279,backing_fmt=raw /opt/stack/data/nova/instances/5ed800fe-577d-4624-898c-c7f40da77376/disk 1073741824 {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:38:02 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-06f62730-2b9d-4401-a973-dd3161e612ad tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279,backing_fmt=raw /opt/stack/data/nova/instances/5ed800fe-577d-4624-898c-c7f40da77376/disk 1073741824" returned: 0 in 0.052s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:38:02 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-06f62730-2b9d-4401-a973-dd3161e612ad tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "9524227dd898575c3099d3976f096cd935414279" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.206s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:38:02 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-06f62730-2b9d-4401-a973-dd3161e612ad tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279 --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:38:02 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-06f62730-2b9d-4401-a973-dd3161e612ad tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279 --force-share --output=json" returned: 0 in 0.137s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:38:02 user nova-compute[71731]: DEBUG nova.virt.disk.api [None req-06f62730-2b9d-4401-a973-dd3161e612ad tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5ed800fe-577d-4624-898c-c7f40da77376/disk. size=1073741824 {{(pid=71731) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 16:38:02 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-06f62730-2b9d-4401-a973-dd3161e612ad tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ed800fe-577d-4624-898c-c7f40da77376/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:38:03 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-06f62730-2b9d-4401-a973-dd3161e612ad tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ed800fe-577d-4624-898c-c7f40da77376/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:38:03 user nova-compute[71731]: DEBUG nova.virt.disk.api [None req-06f62730-2b9d-4401-a973-dd3161e612ad tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Cannot resize image /opt/stack/data/nova/instances/5ed800fe-577d-4624-898c-c7f40da77376/disk to a smaller size. {{(pid=71731) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 16:38:03 user nova-compute[71731]: DEBUG nova.objects.instance [None req-06f62730-2b9d-4401-a973-dd3161e612ad tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lazy-loading 'migration_context' on Instance uuid 5ed800fe-577d-4624-898c-c7f40da77376 {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:38:03 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-06f62730-2b9d-4401-a973-dd3161e612ad tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: 5ed800fe-577d-4624-898c-c7f40da77376] Created local disks {{(pid=71731) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 16:38:03 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-06f62730-2b9d-4401-a973-dd3161e612ad tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: 5ed800fe-577d-4624-898c-c7f40da77376] Ensure instance console log exists: /opt/stack/data/nova/instances/5ed800fe-577d-4624-898c-c7f40da77376/console.log {{(pid=71731) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 16:38:03 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-06f62730-2b9d-4401-a973-dd3161e612ad tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:38:03 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-06f62730-2b9d-4401-a973-dd3161e612ad tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:38:03 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-06f62730-2b9d-4401-a973-dd3161e612ad tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:38:03 user nova-compute[71731]: DEBUG nova.network.neutron [None req-06f62730-2b9d-4401-a973-dd3161e612ad tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: 5ed800fe-577d-4624-898c-c7f40da77376] Successfully created port: 09531419-c0ff-4d13-89bd-06caa28e019d {{(pid=71731) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 16:38:03 user nova-compute[71731]: DEBUG nova.network.neutron [None req-06f62730-2b9d-4401-a973-dd3161e612ad tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: 5ed800fe-577d-4624-898c-c7f40da77376] Successfully updated port: 09531419-c0ff-4d13-89bd-06caa28e019d {{(pid=71731) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 16:38:03 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-06f62730-2b9d-4401-a973-dd3161e612ad tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Acquiring lock "refresh_cache-5ed800fe-577d-4624-898c-c7f40da77376" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 16:38:03 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-06f62730-2b9d-4401-a973-dd3161e612ad tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Acquired lock "refresh_cache-5ed800fe-577d-4624-898c-c7f40da77376" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 16:38:03 user nova-compute[71731]: DEBUG nova.network.neutron [None req-06f62730-2b9d-4401-a973-dd3161e612ad tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: 5ed800fe-577d-4624-898c-c7f40da77376] Building network info cache for instance {{(pid=71731) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 16:38:03 user nova-compute[71731]: DEBUG nova.compute.manager [req-ffe055d4-4a14-4e6e-9566-7e84f35b21b5 req-f759de75-5186-4afe-bdb5-d7a96b6d4390 service nova] [instance: 5ed800fe-577d-4624-898c-c7f40da77376] Received event network-changed-09531419-c0ff-4d13-89bd-06caa28e019d {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:38:03 user nova-compute[71731]: DEBUG nova.compute.manager [req-ffe055d4-4a14-4e6e-9566-7e84f35b21b5 req-f759de75-5186-4afe-bdb5-d7a96b6d4390 service nova] [instance: 5ed800fe-577d-4624-898c-c7f40da77376] Refreshing instance network info cache due to event network-changed-09531419-c0ff-4d13-89bd-06caa28e019d. {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 16:38:03 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-ffe055d4-4a14-4e6e-9566-7e84f35b21b5 req-f759de75-5186-4afe-bdb5-d7a96b6d4390 service nova] Acquiring lock "refresh_cache-5ed800fe-577d-4624-898c-c7f40da77376" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 16:38:03 user nova-compute[71731]: DEBUG nova.network.neutron [None req-06f62730-2b9d-4401-a973-dd3161e612ad tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: 5ed800fe-577d-4624-898c-c7f40da77376] Instance cache missing network info. {{(pid=71731) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 16:38:04 user nova-compute[71731]: DEBUG nova.network.neutron [None req-06f62730-2b9d-4401-a973-dd3161e612ad tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: 5ed800fe-577d-4624-898c-c7f40da77376] Updating instance_info_cache with network_info: [{"id": "09531419-c0ff-4d13-89bd-06caa28e019d", "address": "fa:16:3e:13:b1:31", "network": {"id": "cf1fef97-9ef1-449f-a302-b38110024547", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1138167711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "980559734a504574a83224deb7423c77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09531419-c0", "ovs_interfaceid": "09531419-c0ff-4d13-89bd-06caa28e019d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:38:04 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-06f62730-2b9d-4401-a973-dd3161e612ad tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Releasing lock "refresh_cache-5ed800fe-577d-4624-898c-c7f40da77376" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 16:38:04 user nova-compute[71731]: DEBUG nova.compute.manager [None req-06f62730-2b9d-4401-a973-dd3161e612ad tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: 5ed800fe-577d-4624-898c-c7f40da77376] Instance network_info: |[{"id": "09531419-c0ff-4d13-89bd-06caa28e019d", "address": "fa:16:3e:13:b1:31", "network": {"id": "cf1fef97-9ef1-449f-a302-b38110024547", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1138167711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "980559734a504574a83224deb7423c77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09531419-c0", "ovs_interfaceid": "09531419-c0ff-4d13-89bd-06caa28e019d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71731) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 16:38:04 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-ffe055d4-4a14-4e6e-9566-7e84f35b21b5 req-f759de75-5186-4afe-bdb5-d7a96b6d4390 service nova] Acquired lock "refresh_cache-5ed800fe-577d-4624-898c-c7f40da77376" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 16:38:04 user nova-compute[71731]: DEBUG nova.network.neutron [req-ffe055d4-4a14-4e6e-9566-7e84f35b21b5 req-f759de75-5186-4afe-bdb5-d7a96b6d4390 service nova] [instance: 5ed800fe-577d-4624-898c-c7f40da77376] Refreshing network info cache for port 09531419-c0ff-4d13-89bd-06caa28e019d {{(pid=71731) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 16:38:04 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-06f62730-2b9d-4401-a973-dd3161e612ad tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: 5ed800fe-577d-4624-898c-c7f40da77376] Start _get_guest_xml network_info=[{"id": "09531419-c0ff-4d13-89bd-06caa28e019d", "address": "fa:16:3e:13:b1:31", "network": {"id": "cf1fef97-9ef1-449f-a302-b38110024547", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1138167711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "980559734a504574a83224deb7423c77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09531419-c0", "ovs_interfaceid": "09531419-c0ff-4d13-89bd-06caa28e019d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T16:16:31Z,direct_url=<?>,disk_format='qcow2',id=708622a9-7465-4492-ade8-b827198f7e30,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='0b29a975c552465aba0ac7d6288434bd',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T16:16:33Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'device_type': 'disk', 'encrypted': False, 'disk_bus': 'virtio', 'guest_format': None, 'encryption_options': None, 'image_id': '708622a9-7465-4492-ade8-b827198f7e30'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71731) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 16:38:04 user nova-compute[71731]: WARNING nova.virt.libvirt.driver [None req-06f62730-2b9d-4401-a973-dd3161e612ad tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 16:38:04 user nova-compute[71731]: WARNING nova.virt.libvirt.driver [None req-06f62730-2b9d-4401-a973-dd3161e612ad tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 16:38:04 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-06f62730-2b9d-4401-a973-dd3161e612ad tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71731) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 16:38:04 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-06f62730-2b9d-4401-a973-dd3161e612ad tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T16:17:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T16:16:31Z,direct_url=<?>,disk_format='qcow2',id=708622a9-7465-4492-ade8-b827198f7e30,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='0b29a975c552465aba0ac7d6288434bd',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T16:16:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 16:38:04 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-06f62730-2b9d-4401-a973-dd3161e612ad tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Flavor limits 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 16:38:04 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-06f62730-2b9d-4401-a973-dd3161e612ad tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Image limits 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 16:38:04 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-06f62730-2b9d-4401-a973-dd3161e612ad tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Flavor pref 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 16:38:04 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-06f62730-2b9d-4401-a973-dd3161e612ad tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Image pref 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 16:38:04 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-06f62730-2b9d-4401-a973-dd3161e612ad tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 16:38:04 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-06f62730-2b9d-4401-a973-dd3161e612ad tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 16:38:04 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-06f62730-2b9d-4401-a973-dd3161e612ad tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71731) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 16:38:04 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-06f62730-2b9d-4401-a973-dd3161e612ad tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Got 1 possible topologies {{(pid=71731) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 16:38:04 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-06f62730-2b9d-4401-a973-dd3161e612ad tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 16:38:04 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-06f62730-2b9d-4401-a973-dd3161e612ad tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 16:38:04 user nova-compute[71731]: DEBUG nova.virt.libvirt.vif [None req-06f62730-2b9d-4401-a973-dd3161e612ad tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T16:38:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-845961470',display_name='tempest-ServerActionsTestJSON-server-845961470',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-845961470',id=33,image_ref='708622a9-7465-4492-ade8-b827198f7e30',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPaDda4gTmMbkxKfok8i4i1XcNLza5lOVYjCPDEGVTF1JRQKderq80DnIN4GAkaZiBV5U44gvdu3wadL/M5wOH7VDSuEghHchow1mC9TB1xgdo8GoXeM279SVAyu08uhIQ==',key_name='tempest-keypair-1700037342',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='980559734a504574a83224deb7423c77',ramdisk_id='',reservation_id='r-1g3u1088',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='708622a9-7465-4492-ade8-b827198f7e30',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestJSON-713402718',owner_user_name='tempest-ServerActionsTestJSON-713402718-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T16:38:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1b3df1c5c5d441819bcef89ed6966815',uuid=5ed800fe-577d-4624-898c-c7f40da77376,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "09531419-c0ff-4d13-89bd-06caa28e019d", "address": "fa:16:3e:13:b1:31", "network": {"id": "cf1fef97-9ef1-449f-a302-b38110024547", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1138167711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "980559734a504574a83224deb7423c77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09531419-c0", "ovs_interfaceid": "09531419-c0ff-4d13-89bd-06caa28e019d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71731) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 16:38:04 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-06f62730-2b9d-4401-a973-dd3161e612ad tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Converting VIF {"id": "09531419-c0ff-4d13-89bd-06caa28e019d", "address": "fa:16:3e:13:b1:31", "network": {"id": "cf1fef97-9ef1-449f-a302-b38110024547", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1138167711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "980559734a504574a83224deb7423c77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09531419-c0", "ovs_interfaceid": "09531419-c0ff-4d13-89bd-06caa28e019d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 16:38:04 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-06f62730-2b9d-4401-a973-dd3161e612ad tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:13:b1:31,bridge_name='br-int',has_traffic_filtering=True,id=09531419-c0ff-4d13-89bd-06caa28e019d,network=Network(cf1fef97-9ef1-449f-a302-b38110024547),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09531419-c0') {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 16:38:04 user nova-compute[71731]: DEBUG nova.objects.instance [None req-06f62730-2b9d-4401-a973-dd3161e612ad tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lazy-loading 'pci_devices' on Instance uuid 5ed800fe-577d-4624-898c-c7f40da77376 {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:38:04 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-06f62730-2b9d-4401-a973-dd3161e612ad tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: 5ed800fe-577d-4624-898c-c7f40da77376] End _get_guest_xml xml=<domain type="kvm">
Apr 13 16:38:04 user nova-compute[71731]:   <uuid>5ed800fe-577d-4624-898c-c7f40da77376</uuid>
Apr 13 16:38:04 user nova-compute[71731]:   <name>instance-00000021</name>
Apr 13 16:38:04 user nova-compute[71731]:   <memory>131072</memory>
Apr 13 16:38:04 user nova-compute[71731]:   <vcpu>1</vcpu>
Apr 13 16:38:04 user nova-compute[71731]:   <metadata>
Apr 13 16:38:04 user nova-compute[71731]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 16:38:04 user nova-compute[71731]:       <nova:package version="0.0.0"/>
Apr 13 16:38:04 user nova-compute[71731]:       <nova:name>tempest-ServerActionsTestJSON-server-845961470</nova:name>
Apr 13 16:38:04 user nova-compute[71731]:       <nova:creationTime>2023-04-13 16:38:04</nova:creationTime>
Apr 13 16:38:04 user nova-compute[71731]:       <nova:flavor name="m1.nano">
Apr 13 16:38:04 user nova-compute[71731]:         <nova:memory>128</nova:memory>
Apr 13 16:38:04 user nova-compute[71731]:         <nova:disk>1</nova:disk>
Apr 13 16:38:04 user nova-compute[71731]:         <nova:swap>0</nova:swap>
Apr 13 16:38:04 user nova-compute[71731]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 16:38:04 user nova-compute[71731]:         <nova:vcpus>1</nova:vcpus>
Apr 13 16:38:04 user nova-compute[71731]:       </nova:flavor>
Apr 13 16:38:04 user nova-compute[71731]:       <nova:owner>
Apr 13 16:38:04 user nova-compute[71731]:         <nova:user uuid="1b3df1c5c5d441819bcef89ed6966815">tempest-ServerActionsTestJSON-713402718-project-member</nova:user>
Apr 13 16:38:04 user nova-compute[71731]:         <nova:project uuid="980559734a504574a83224deb7423c77">tempest-ServerActionsTestJSON-713402718</nova:project>
Apr 13 16:38:04 user nova-compute[71731]:       </nova:owner>
Apr 13 16:38:04 user nova-compute[71731]:       <nova:root type="image" uuid="708622a9-7465-4492-ade8-b827198f7e30"/>
Apr 13 16:38:04 user nova-compute[71731]:       <nova:ports>
Apr 13 16:38:04 user nova-compute[71731]:         <nova:port uuid="09531419-c0ff-4d13-89bd-06caa28e019d">
Apr 13 16:38:04 user nova-compute[71731]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Apr 13 16:38:04 user nova-compute[71731]:         </nova:port>
Apr 13 16:38:04 user nova-compute[71731]:       </nova:ports>
Apr 13 16:38:04 user nova-compute[71731]:     </nova:instance>
Apr 13 16:38:04 user nova-compute[71731]:   </metadata>
Apr 13 16:38:04 user nova-compute[71731]:   <sysinfo type="smbios">
Apr 13 16:38:04 user nova-compute[71731]:     <system>
Apr 13 16:38:04 user nova-compute[71731]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 16:38:04 user nova-compute[71731]:       <entry name="product">OpenStack Nova</entry>
Apr 13 16:38:04 user nova-compute[71731]:       <entry name="version">0.0.0</entry>
Apr 13 16:38:04 user nova-compute[71731]:       <entry name="serial">5ed800fe-577d-4624-898c-c7f40da77376</entry>
Apr 13 16:38:04 user nova-compute[71731]:       <entry name="uuid">5ed800fe-577d-4624-898c-c7f40da77376</entry>
Apr 13 16:38:04 user nova-compute[71731]:       <entry name="family">Virtual Machine</entry>
Apr 13 16:38:04 user nova-compute[71731]:     </system>
Apr 13 16:38:04 user nova-compute[71731]:   </sysinfo>
Apr 13 16:38:04 user nova-compute[71731]:   <os>
Apr 13 16:38:04 user nova-compute[71731]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 16:38:04 user nova-compute[71731]:     <boot dev="hd"/>
Apr 13 16:38:04 user nova-compute[71731]:     <smbios mode="sysinfo"/>
Apr 13 16:38:04 user nova-compute[71731]:   </os>
Apr 13 16:38:04 user nova-compute[71731]:   <features>
Apr 13 16:38:04 user nova-compute[71731]:     <acpi/>
Apr 13 16:38:04 user nova-compute[71731]:     <apic/>
Apr 13 16:38:04 user nova-compute[71731]:     <vmcoreinfo/>
Apr 13 16:38:04 user nova-compute[71731]:   </features>
Apr 13 16:38:04 user nova-compute[71731]:   <clock offset="utc">
Apr 13 16:38:04 user nova-compute[71731]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 16:38:04 user nova-compute[71731]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 16:38:04 user nova-compute[71731]:     <timer name="hpet" present="no"/>
Apr 13 16:38:04 user nova-compute[71731]:   </clock>
Apr 13 16:38:04 user nova-compute[71731]:   <cpu mode="custom" match="exact">
Apr 13 16:38:04 user nova-compute[71731]:     <model>Nehalem</model>
Apr 13 16:38:04 user nova-compute[71731]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 16:38:04 user nova-compute[71731]:   </cpu>
Apr 13 16:38:04 user nova-compute[71731]:   <devices>
Apr 13 16:38:04 user nova-compute[71731]:     <disk type="file" device="disk">
Apr 13 16:38:04 user nova-compute[71731]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 16:38:04 user nova-compute[71731]:       <source file="/opt/stack/data/nova/instances/5ed800fe-577d-4624-898c-c7f40da77376/disk"/>
Apr 13 16:38:04 user nova-compute[71731]:       <target dev="vda" bus="virtio"/>
Apr 13 16:38:04 user nova-compute[71731]:     </disk>
Apr 13 16:38:04 user nova-compute[71731]:     <interface type="ethernet">
Apr 13 16:38:04 user nova-compute[71731]:       <mac address="fa:16:3e:13:b1:31"/>
Apr 13 16:38:04 user nova-compute[71731]:       <model type="virtio"/>
Apr 13 16:38:04 user nova-compute[71731]:       <mtu size="1442"/>
Apr 13 16:38:04 user nova-compute[71731]:       <target dev="tap09531419-c0"/>
Apr 13 16:38:04 user nova-compute[71731]:     </interface>
Apr 13 16:38:04 user nova-compute[71731]:     <serial type="pty">
Apr 13 16:38:04 user nova-compute[71731]:       <log file="/opt/stack/data/nova/instances/5ed800fe-577d-4624-898c-c7f40da77376/console.log" append="off"/>
Apr 13 16:38:04 user nova-compute[71731]:     </serial>
Apr 13 16:38:04 user nova-compute[71731]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 16:38:04 user nova-compute[71731]:     <video>
Apr 13 16:38:04 user nova-compute[71731]:       <model type="virtio"/>
Apr 13 16:38:04 user nova-compute[71731]:     </video>
Apr 13 16:38:04 user nova-compute[71731]:     <rng model="virtio">
Apr 13 16:38:04 user nova-compute[71731]:       <backend model="random">/dev/urandom</backend>
Apr 13 16:38:04 user nova-compute[71731]:     </rng>
Apr 13 16:38:04 user nova-compute[71731]:     <controller type="usb" index="0" model="none"/>
Apr 13 16:38:04 user nova-compute[71731]:     <memballoon model="virtio">
Apr 13 16:38:04 user nova-compute[71731]:       <stats period="10"/>
Apr 13 16:38:04 user nova-compute[71731]:     </memballoon>
Apr 13 16:38:04 user nova-compute[71731]:   </devices>
Apr 13 16:38:04 user nova-compute[71731]: </domain>
Apr 13 16:38:04 user nova-compute[71731]:  {{(pid=71731) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 16:38:04 user nova-compute[71731]: DEBUG nova.virt.libvirt.vif [None req-06f62730-2b9d-4401-a973-dd3161e612ad tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T16:38:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-845961470',display_name='tempest-ServerActionsTestJSON-server-845961470',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-845961470',id=33,image_ref='708622a9-7465-4492-ade8-b827198f7e30',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPaDda4gTmMbkxKfok8i4i1XcNLza5lOVYjCPDEGVTF1JRQKderq80DnIN4GAkaZiBV5U44gvdu3wadL/M5wOH7VDSuEghHchow1mC9TB1xgdo8GoXeM279SVAyu08uhIQ==',key_name='tempest-keypair-1700037342',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='980559734a504574a83224deb7423c77',ramdisk_id='',reservation_id='r-1g3u1088',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='708622a9-7465-4492-ade8-b827198f7e30',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestJSON-713402718',owner_user_name='tempest-ServerActionsTestJSON-713402718-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T16:38:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1b3df1c5c5d441819bcef89ed6966815',uuid=5ed800fe-577d-4624-898c-c7f40da77376,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "09531419-c0ff-4d13-89bd-06caa28e019d", "address": "fa:16:3e:13:b1:31", "network": {"id": "cf1fef97-9ef1-449f-a302-b38110024547", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1138167711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "980559734a504574a83224deb7423c77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09531419-c0", "ovs_interfaceid": "09531419-c0ff-4d13-89bd-06caa28e019d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 16:38:04 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-06f62730-2b9d-4401-a973-dd3161e612ad tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Converting VIF {"id": "09531419-c0ff-4d13-89bd-06caa28e019d", "address": "fa:16:3e:13:b1:31", "network": {"id": "cf1fef97-9ef1-449f-a302-b38110024547", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1138167711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "980559734a504574a83224deb7423c77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09531419-c0", "ovs_interfaceid": "09531419-c0ff-4d13-89bd-06caa28e019d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 16:38:04 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-06f62730-2b9d-4401-a973-dd3161e612ad tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:13:b1:31,bridge_name='br-int',has_traffic_filtering=True,id=09531419-c0ff-4d13-89bd-06caa28e019d,network=Network(cf1fef97-9ef1-449f-a302-b38110024547),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09531419-c0') {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 16:38:04 user nova-compute[71731]: DEBUG os_vif [None req-06f62730-2b9d-4401-a973-dd3161e612ad tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:b1:31,bridge_name='br-int',has_traffic_filtering=True,id=09531419-c0ff-4d13-89bd-06caa28e019d,network=Network(cf1fef97-9ef1-449f-a302-b38110024547),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09531419-c0') {{(pid=71731) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 16:38:04 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:38:04 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:38:04 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 16:38:04 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:38:04 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap09531419-c0, may_exist=True) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:38:04 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap09531419-c0, col_values=(('external_ids', {'iface-id': '09531419-c0ff-4d13-89bd-06caa28e019d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:13:b1:31', 'vm-uuid': '5ed800fe-577d-4624-898c-c7f40da77376'}),)) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:38:04 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:38:04 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 16:38:04 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:38:04 user nova-compute[71731]: INFO os_vif [None req-06f62730-2b9d-4401-a973-dd3161e612ad tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:b1:31,bridge_name='br-int',has_traffic_filtering=True,id=09531419-c0ff-4d13-89bd-06caa28e019d,network=Network(cf1fef97-9ef1-449f-a302-b38110024547),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09531419-c0')
Apr 13 16:38:04 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-06f62730-2b9d-4401-a973-dd3161e612ad tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] No BDM found with device name vda, not building metadata. {{(pid=71731) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 16:38:04 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-06f62730-2b9d-4401-a973-dd3161e612ad tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] No VIF found with MAC fa:16:3e:13:b1:31, not building metadata {{(pid=71731) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 16:38:04 user nova-compute[71731]: DEBUG nova.network.neutron [req-ffe055d4-4a14-4e6e-9566-7e84f35b21b5 req-f759de75-5186-4afe-bdb5-d7a96b6d4390 service nova] [instance: 5ed800fe-577d-4624-898c-c7f40da77376] Updated VIF entry in instance network info cache for port 09531419-c0ff-4d13-89bd-06caa28e019d. {{(pid=71731) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 16:38:04 user nova-compute[71731]: DEBUG nova.network.neutron [req-ffe055d4-4a14-4e6e-9566-7e84f35b21b5 req-f759de75-5186-4afe-bdb5-d7a96b6d4390 service nova] [instance: 5ed800fe-577d-4624-898c-c7f40da77376] Updating instance_info_cache with network_info: [{"id": "09531419-c0ff-4d13-89bd-06caa28e019d", "address": "fa:16:3e:13:b1:31", "network": {"id": "cf1fef97-9ef1-449f-a302-b38110024547", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1138167711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "980559734a504574a83224deb7423c77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09531419-c0", "ovs_interfaceid": "09531419-c0ff-4d13-89bd-06caa28e019d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:38:04 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-ffe055d4-4a14-4e6e-9566-7e84f35b21b5 req-f759de75-5186-4afe-bdb5-d7a96b6d4390 service nova] Releasing lock "refresh_cache-5ed800fe-577d-4624-898c-c7f40da77376" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 16:38:05 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:38:05 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:38:06 user nova-compute[71731]: DEBUG nova.compute.manager [req-8aef0c70-a73e-4644-9367-d907b6cea322 req-48aab17e-982c-48e0-92c3-5d102052c3b2 service nova] [instance: 5ed800fe-577d-4624-898c-c7f40da77376] Received event network-vif-plugged-09531419-c0ff-4d13-89bd-06caa28e019d {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:38:06 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-8aef0c70-a73e-4644-9367-d907b6cea322 req-48aab17e-982c-48e0-92c3-5d102052c3b2 service nova] Acquiring lock "5ed800fe-577d-4624-898c-c7f40da77376-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:38:06 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-8aef0c70-a73e-4644-9367-d907b6cea322 req-48aab17e-982c-48e0-92c3-5d102052c3b2 service nova] Lock "5ed800fe-577d-4624-898c-c7f40da77376-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:38:06 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-8aef0c70-a73e-4644-9367-d907b6cea322 req-48aab17e-982c-48e0-92c3-5d102052c3b2 service nova] Lock "5ed800fe-577d-4624-898c-c7f40da77376-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:38:06 user nova-compute[71731]: DEBUG nova.compute.manager [req-8aef0c70-a73e-4644-9367-d907b6cea322 req-48aab17e-982c-48e0-92c3-5d102052c3b2 service nova] [instance: 5ed800fe-577d-4624-898c-c7f40da77376] No waiting events found dispatching network-vif-plugged-09531419-c0ff-4d13-89bd-06caa28e019d {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:38:06 user nova-compute[71731]: WARNING nova.compute.manager [req-8aef0c70-a73e-4644-9367-d907b6cea322 req-48aab17e-982c-48e0-92c3-5d102052c3b2 service nova] [instance: 5ed800fe-577d-4624-898c-c7f40da77376] Received unexpected event network-vif-plugged-09531419-c0ff-4d13-89bd-06caa28e019d for instance with vm_state building and task_state spawning.
Apr 13 16:38:06 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:38:06 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:38:06 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:38:07 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:38:07 user nova-compute[71731]: DEBUG nova.virt.driver [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Emitting event <LifecycleEvent: 1681403887.8770034, 5ed800fe-577d-4624-898c-c7f40da77376 => Resumed> {{(pid=71731) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 16:38:07 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 5ed800fe-577d-4624-898c-c7f40da77376] VM Resumed (Lifecycle Event)
Apr 13 16:38:07 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 5ed800fe-577d-4624-898c-c7f40da77376] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:38:07 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 5ed800fe-577d-4624-898c-c7f40da77376] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71731) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 16:38:07 user nova-compute[71731]: DEBUG nova.compute.manager [None req-06f62730-2b9d-4401-a973-dd3161e612ad tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: 5ed800fe-577d-4624-898c-c7f40da77376] Instance event wait completed in 0 seconds for  {{(pid=71731) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 16:38:07 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-06f62730-2b9d-4401-a973-dd3161e612ad tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: 5ed800fe-577d-4624-898c-c7f40da77376] Guest created on hypervisor {{(pid=71731) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 16:38:07 user nova-compute[71731]: INFO nova.virt.libvirt.driver [-] [instance: 5ed800fe-577d-4624-898c-c7f40da77376] Instance spawned successfully.
Apr 13 16:38:07 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-06f62730-2b9d-4401-a973-dd3161e612ad tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: 5ed800fe-577d-4624-898c-c7f40da77376] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 16:38:07 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 5ed800fe-577d-4624-898c-c7f40da77376] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 16:38:07 user nova-compute[71731]: DEBUG nova.virt.driver [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Emitting event <LifecycleEvent: 1681403887.9081016, 5ed800fe-577d-4624-898c-c7f40da77376 => Started> {{(pid=71731) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 16:38:07 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 5ed800fe-577d-4624-898c-c7f40da77376] VM Started (Lifecycle Event)
Apr 13 16:38:07 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-06f62730-2b9d-4401-a973-dd3161e612ad tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: 5ed800fe-577d-4624-898c-c7f40da77376] Found default for hw_cdrom_bus of ide {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:38:07 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-06f62730-2b9d-4401-a973-dd3161e612ad tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: 5ed800fe-577d-4624-898c-c7f40da77376] Found default for hw_disk_bus of virtio {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:38:07 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-06f62730-2b9d-4401-a973-dd3161e612ad tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: 5ed800fe-577d-4624-898c-c7f40da77376] Found default for hw_input_bus of None {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:38:07 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-06f62730-2b9d-4401-a973-dd3161e612ad tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: 5ed800fe-577d-4624-898c-c7f40da77376] Found default for hw_pointer_model of None {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:38:07 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-06f62730-2b9d-4401-a973-dd3161e612ad tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: 5ed800fe-577d-4624-898c-c7f40da77376] Found default for hw_video_model of virtio {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:38:07 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-06f62730-2b9d-4401-a973-dd3161e612ad tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: 5ed800fe-577d-4624-898c-c7f40da77376] Found default for hw_vif_model of virtio {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:38:07 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 5ed800fe-577d-4624-898c-c7f40da77376] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:38:07 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 5ed800fe-577d-4624-898c-c7f40da77376] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71731) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 16:38:07 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 5ed800fe-577d-4624-898c-c7f40da77376] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 16:38:08 user nova-compute[71731]: INFO nova.compute.manager [None req-06f62730-2b9d-4401-a973-dd3161e612ad tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: 5ed800fe-577d-4624-898c-c7f40da77376] Took 5.56 seconds to spawn the instance on the hypervisor.
Apr 13 16:38:08 user nova-compute[71731]: DEBUG nova.compute.manager [None req-06f62730-2b9d-4401-a973-dd3161e612ad tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: 5ed800fe-577d-4624-898c-c7f40da77376] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:38:08 user nova-compute[71731]: DEBUG nova.compute.manager [req-4507a3fb-c260-4521-a254-b1fa71ef67b9 req-1529ce1a-69b3-439c-bc44-bc5769ea5f28 service nova] [instance: 5ed800fe-577d-4624-898c-c7f40da77376] Received event network-vif-plugged-09531419-c0ff-4d13-89bd-06caa28e019d {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:38:08 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-4507a3fb-c260-4521-a254-b1fa71ef67b9 req-1529ce1a-69b3-439c-bc44-bc5769ea5f28 service nova] Acquiring lock "5ed800fe-577d-4624-898c-c7f40da77376-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:38:08 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-4507a3fb-c260-4521-a254-b1fa71ef67b9 req-1529ce1a-69b3-439c-bc44-bc5769ea5f28 service nova] Lock "5ed800fe-577d-4624-898c-c7f40da77376-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:38:08 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-4507a3fb-c260-4521-a254-b1fa71ef67b9 req-1529ce1a-69b3-439c-bc44-bc5769ea5f28 service nova] Lock "5ed800fe-577d-4624-898c-c7f40da77376-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:38:08 user nova-compute[71731]: DEBUG nova.compute.manager [req-4507a3fb-c260-4521-a254-b1fa71ef67b9 req-1529ce1a-69b3-439c-bc44-bc5769ea5f28 service nova] [instance: 5ed800fe-577d-4624-898c-c7f40da77376] No waiting events found dispatching network-vif-plugged-09531419-c0ff-4d13-89bd-06caa28e019d {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:38:08 user nova-compute[71731]: WARNING nova.compute.manager [req-4507a3fb-c260-4521-a254-b1fa71ef67b9 req-1529ce1a-69b3-439c-bc44-bc5769ea5f28 service nova] [instance: 5ed800fe-577d-4624-898c-c7f40da77376] Received unexpected event network-vif-plugged-09531419-c0ff-4d13-89bd-06caa28e019d for instance with vm_state building and task_state spawning.
Apr 13 16:38:08 user nova-compute[71731]: INFO nova.compute.manager [None req-06f62730-2b9d-4401-a973-dd3161e612ad tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: 5ed800fe-577d-4624-898c-c7f40da77376] Took 6.26 seconds to build instance.
Apr 13 16:38:08 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-06f62730-2b9d-4401-a973-dd3161e612ad tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "5ed800fe-577d-4624-898c-c7f40da77376" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.365s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:38:09 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:38:10 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-f1b92347-5061-44ee-b769-bb9b2ae2dcd8 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Acquiring lock "650427bd-4dad-4bcd-922d-c17e60b36807" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:38:10 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-f1b92347-5061-44ee-b769-bb9b2ae2dcd8 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lock "650427bd-4dad-4bcd-922d-c17e60b36807" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:38:10 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-f1b92347-5061-44ee-b769-bb9b2ae2dcd8 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Acquiring lock "650427bd-4dad-4bcd-922d-c17e60b36807-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:38:10 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-f1b92347-5061-44ee-b769-bb9b2ae2dcd8 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lock "650427bd-4dad-4bcd-922d-c17e60b36807-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:38:10 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-f1b92347-5061-44ee-b769-bb9b2ae2dcd8 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lock "650427bd-4dad-4bcd-922d-c17e60b36807-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:38:10 user nova-compute[71731]: INFO nova.compute.manager [None req-f1b92347-5061-44ee-b769-bb9b2ae2dcd8 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: 650427bd-4dad-4bcd-922d-c17e60b36807] Terminating instance
Apr 13 16:38:10 user nova-compute[71731]: DEBUG nova.compute.manager [None req-f1b92347-5061-44ee-b769-bb9b2ae2dcd8 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: 650427bd-4dad-4bcd-922d-c17e60b36807] Start destroying the instance on the hypervisor. {{(pid=71731) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 16:38:10 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:38:10 user nova-compute[71731]: DEBUG nova.compute.manager [req-856ec627-5381-4f9d-8dfe-aad58377ebed req-0e84b0cd-4c70-4ee7-ae2c-9b38d4f6fd75 service nova] [instance: 650427bd-4dad-4bcd-922d-c17e60b36807] Received event network-vif-unplugged-c6fe8d62-f2ba-44d6-a5e3-da6f35679b3f {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:38:10 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-856ec627-5381-4f9d-8dfe-aad58377ebed req-0e84b0cd-4c70-4ee7-ae2c-9b38d4f6fd75 service nova] Acquiring lock "650427bd-4dad-4bcd-922d-c17e60b36807-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:38:10 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-856ec627-5381-4f9d-8dfe-aad58377ebed req-0e84b0cd-4c70-4ee7-ae2c-9b38d4f6fd75 service nova] Lock "650427bd-4dad-4bcd-922d-c17e60b36807-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:38:10 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-856ec627-5381-4f9d-8dfe-aad58377ebed req-0e84b0cd-4c70-4ee7-ae2c-9b38d4f6fd75 service nova] Lock "650427bd-4dad-4bcd-922d-c17e60b36807-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:38:10 user nova-compute[71731]: DEBUG nova.compute.manager [req-856ec627-5381-4f9d-8dfe-aad58377ebed req-0e84b0cd-4c70-4ee7-ae2c-9b38d4f6fd75 service nova] [instance: 650427bd-4dad-4bcd-922d-c17e60b36807] No waiting events found dispatching network-vif-unplugged-c6fe8d62-f2ba-44d6-a5e3-da6f35679b3f {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:38:10 user nova-compute[71731]: DEBUG nova.compute.manager [req-856ec627-5381-4f9d-8dfe-aad58377ebed req-0e84b0cd-4c70-4ee7-ae2c-9b38d4f6fd75 service nova] [instance: 650427bd-4dad-4bcd-922d-c17e60b36807] Received event network-vif-unplugged-c6fe8d62-f2ba-44d6-a5e3-da6f35679b3f for instance with task_state deleting. {{(pid=71731) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 16:38:10 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:38:10 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:38:11 user nova-compute[71731]: INFO nova.virt.libvirt.driver [-] [instance: 650427bd-4dad-4bcd-922d-c17e60b36807] Instance destroyed successfully.
Apr 13 16:38:11 user nova-compute[71731]: DEBUG nova.objects.instance [None req-f1b92347-5061-44ee-b769-bb9b2ae2dcd8 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lazy-loading 'resources' on Instance uuid 650427bd-4dad-4bcd-922d-c17e60b36807 {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:38:11 user nova-compute[71731]: DEBUG nova.virt.libvirt.vif [None req-f1b92347-5061-44ee-b769-bb9b2ae2dcd8 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T16:28:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1877773095',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1877773095',id=24,image_ref='708622a9-7465-4492-ade8-b827198f7e30',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-13T16:28:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b2d09a74bf684a9fb1dd1e95d6c23f3c',ramdisk_id='',reservation_id='r-azgujbss',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='708622a9-7465-4492-ade8-b827198f7e30',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1960261099',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T16:30:45Z,user_data=None,user_id='e45a882dbafb4ea4976e4f45289eb2b8',uuid=650427bd-4dad-4bcd-922d-c17e60b36807,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c6fe8d62-f2ba-44d6-a5e3-da6f35679b3f", "address": "fa:16:3e:01:40:5b", "network": {"id": "5a7877ff-8230-470b-90b5-e5dcfc8f0cee", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-779403873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2d09a74bf684a9fb1dd1e95d6c23f3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6fe8d62-f2", "ovs_interfaceid": "c6fe8d62-f2ba-44d6-a5e3-da6f35679b3f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 16:38:11 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-f1b92347-5061-44ee-b769-bb9b2ae2dcd8 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Converting VIF {"id": "c6fe8d62-f2ba-44d6-a5e3-da6f35679b3f", "address": "fa:16:3e:01:40:5b", "network": {"id": "5a7877ff-8230-470b-90b5-e5dcfc8f0cee", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-779403873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2d09a74bf684a9fb1dd1e95d6c23f3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6fe8d62-f2", "ovs_interfaceid": "c6fe8d62-f2ba-44d6-a5e3-da6f35679b3f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 16:38:11 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-f1b92347-5061-44ee-b769-bb9b2ae2dcd8 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:01:40:5b,bridge_name='br-int',has_traffic_filtering=True,id=c6fe8d62-f2ba-44d6-a5e3-da6f35679b3f,network=Network(5a7877ff-8230-470b-90b5-e5dcfc8f0cee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc6fe8d62-f2') {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 16:38:11 user nova-compute[71731]: DEBUG os_vif [None req-f1b92347-5061-44ee-b769-bb9b2ae2dcd8 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:01:40:5b,bridge_name='br-int',has_traffic_filtering=True,id=c6fe8d62-f2ba-44d6-a5e3-da6f35679b3f,network=Network(5a7877ff-8230-470b-90b5-e5dcfc8f0cee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc6fe8d62-f2') {{(pid=71731) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 16:38:11 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:38:11 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc6fe8d62-f2, bridge=br-int, if_exists=True) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:38:11 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:38:11 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 16:38:11 user nova-compute[71731]: INFO os_vif [None req-f1b92347-5061-44ee-b769-bb9b2ae2dcd8 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:01:40:5b,bridge_name='br-int',has_traffic_filtering=True,id=c6fe8d62-f2ba-44d6-a5e3-da6f35679b3f,network=Network(5a7877ff-8230-470b-90b5-e5dcfc8f0cee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc6fe8d62-f2')
Apr 13 16:38:11 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-f1b92347-5061-44ee-b769-bb9b2ae2dcd8 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: 650427bd-4dad-4bcd-922d-c17e60b36807] Deleting instance files /opt/stack/data/nova/instances/650427bd-4dad-4bcd-922d-c17e60b36807_del
Apr 13 16:38:11 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-f1b92347-5061-44ee-b769-bb9b2ae2dcd8 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: 650427bd-4dad-4bcd-922d-c17e60b36807] Deletion of /opt/stack/data/nova/instances/650427bd-4dad-4bcd-922d-c17e60b36807_del complete
Apr 13 16:38:11 user nova-compute[71731]: INFO nova.compute.manager [None req-f1b92347-5061-44ee-b769-bb9b2ae2dcd8 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: 650427bd-4dad-4bcd-922d-c17e60b36807] Took 0.91 seconds to destroy the instance on the hypervisor.
Apr 13 16:38:11 user nova-compute[71731]: DEBUG oslo.service.loopingcall [None req-f1b92347-5061-44ee-b769-bb9b2ae2dcd8 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71731) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 16:38:11 user nova-compute[71731]: DEBUG nova.compute.manager [-] [instance: 650427bd-4dad-4bcd-922d-c17e60b36807] Deallocating network for instance {{(pid=71731) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 16:38:11 user nova-compute[71731]: DEBUG nova.network.neutron [-] [instance: 650427bd-4dad-4bcd-922d-c17e60b36807] deallocate_for_instance() {{(pid=71731) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 16:38:11 user nova-compute[71731]: DEBUG nova.network.neutron [-] [instance: 650427bd-4dad-4bcd-922d-c17e60b36807] Updating instance_info_cache with network_info: [] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:38:11 user nova-compute[71731]: DEBUG nova.compute.manager [req-c92c2357-6cb4-4b9f-b0ab-95beb6abce12 req-a14c4cd2-2d3f-47ac-a590-186066b2a277 service nova] [instance: 650427bd-4dad-4bcd-922d-c17e60b36807] Received event network-vif-deleted-c6fe8d62-f2ba-44d6-a5e3-da6f35679b3f {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:38:11 user nova-compute[71731]: INFO nova.compute.manager [req-c92c2357-6cb4-4b9f-b0ab-95beb6abce12 req-a14c4cd2-2d3f-47ac-a590-186066b2a277 service nova] [instance: 650427bd-4dad-4bcd-922d-c17e60b36807] Neutron deleted interface c6fe8d62-f2ba-44d6-a5e3-da6f35679b3f; detaching it from the instance and deleting it from the info cache
Apr 13 16:38:11 user nova-compute[71731]: DEBUG nova.network.neutron [req-c92c2357-6cb4-4b9f-b0ab-95beb6abce12 req-a14c4cd2-2d3f-47ac-a590-186066b2a277 service nova] [instance: 650427bd-4dad-4bcd-922d-c17e60b36807] Updating instance_info_cache with network_info: [] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:38:11 user nova-compute[71731]: INFO nova.compute.manager [-] [instance: 650427bd-4dad-4bcd-922d-c17e60b36807] Took 0.64 seconds to deallocate network for instance.
Apr 13 16:38:11 user nova-compute[71731]: DEBUG nova.compute.manager [req-c92c2357-6cb4-4b9f-b0ab-95beb6abce12 req-a14c4cd2-2d3f-47ac-a590-186066b2a277 service nova] [instance: 650427bd-4dad-4bcd-922d-c17e60b36807] Detach interface failed, port_id=c6fe8d62-f2ba-44d6-a5e3-da6f35679b3f, reason: Instance 650427bd-4dad-4bcd-922d-c17e60b36807 could not be found. {{(pid=71731) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 13 16:38:11 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-f1b92347-5061-44ee-b769-bb9b2ae2dcd8 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:38:11 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-f1b92347-5061-44ee-b769-bb9b2ae2dcd8 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:38:12 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:38:12 user nova-compute[71731]: DEBUG nova.compute.provider_tree [None req-f1b92347-5061-44ee-b769-bb9b2ae2dcd8 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Inventory has not changed in ProviderTree for provider: cb6b1a64-0c24-4e2d-af1e-16576ca9165c {{(pid=71731) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 16:38:12 user nova-compute[71731]: DEBUG nova.scheduler.client.report [None req-f1b92347-5061-44ee-b769-bb9b2ae2dcd8 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Inventory has not changed for provider cb6b1a64-0c24-4e2d-af1e-16576ca9165c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71731) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 16:38:12 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-f1b92347-5061-44ee-b769-bb9b2ae2dcd8 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.279s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:38:12 user nova-compute[71731]: INFO nova.scheduler.client.report [None req-f1b92347-5061-44ee-b769-bb9b2ae2dcd8 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Deleted allocations for instance 650427bd-4dad-4bcd-922d-c17e60b36807
Apr 13 16:38:12 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-f1b92347-5061-44ee-b769-bb9b2ae2dcd8 tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lock "650427bd-4dad-4bcd-922d-c17e60b36807" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.044s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:38:12 user nova-compute[71731]: DEBUG nova.compute.manager [req-8ffbe959-2369-4dff-a5d8-68369dee2d8e req-38248eba-4244-45d9-a845-9b1e1204fe08 service nova] [instance: 650427bd-4dad-4bcd-922d-c17e60b36807] Received event network-vif-plugged-c6fe8d62-f2ba-44d6-a5e3-da6f35679b3f {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:38:12 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-8ffbe959-2369-4dff-a5d8-68369dee2d8e req-38248eba-4244-45d9-a845-9b1e1204fe08 service nova] Acquiring lock "650427bd-4dad-4bcd-922d-c17e60b36807-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:38:12 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-8ffbe959-2369-4dff-a5d8-68369dee2d8e req-38248eba-4244-45d9-a845-9b1e1204fe08 service nova] Lock "650427bd-4dad-4bcd-922d-c17e60b36807-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:38:12 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-8ffbe959-2369-4dff-a5d8-68369dee2d8e req-38248eba-4244-45d9-a845-9b1e1204fe08 service nova] Lock "650427bd-4dad-4bcd-922d-c17e60b36807-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:38:12 user nova-compute[71731]: DEBUG nova.compute.manager [req-8ffbe959-2369-4dff-a5d8-68369dee2d8e req-38248eba-4244-45d9-a845-9b1e1204fe08 service nova] [instance: 650427bd-4dad-4bcd-922d-c17e60b36807] No waiting events found dispatching network-vif-plugged-c6fe8d62-f2ba-44d6-a5e3-da6f35679b3f {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:38:12 user nova-compute[71731]: WARNING nova.compute.manager [req-8ffbe959-2369-4dff-a5d8-68369dee2d8e req-38248eba-4244-45d9-a845-9b1e1204fe08 service nova] [instance: 650427bd-4dad-4bcd-922d-c17e60b36807] Received unexpected event network-vif-plugged-c6fe8d62-f2ba-44d6-a5e3-da6f35679b3f for instance with vm_state deleted and task_state None.
Apr 13 16:38:14 user nova-compute[71731]: DEBUG nova.compute.manager [req-4d3cfd7c-d18f-4950-9034-50ebdad205c2 req-5e6cd082-5e83-4c38-99b1-5e8b44c477f9 service nova] [instance: 220e1c3e-1378-46fc-acc1-ee1bafac7722] Received event network-changed-96415b19-4e1b-41c6-a070-cff24e7b20ab {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:38:14 user nova-compute[71731]: DEBUG nova.compute.manager [req-4d3cfd7c-d18f-4950-9034-50ebdad205c2 req-5e6cd082-5e83-4c38-99b1-5e8b44c477f9 service nova] [instance: 220e1c3e-1378-46fc-acc1-ee1bafac7722] Refreshing instance network info cache due to event network-changed-96415b19-4e1b-41c6-a070-cff24e7b20ab. {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 16:38:14 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-4d3cfd7c-d18f-4950-9034-50ebdad205c2 req-5e6cd082-5e83-4c38-99b1-5e8b44c477f9 service nova] Acquiring lock "refresh_cache-220e1c3e-1378-46fc-acc1-ee1bafac7722" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 16:38:14 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-4d3cfd7c-d18f-4950-9034-50ebdad205c2 req-5e6cd082-5e83-4c38-99b1-5e8b44c477f9 service nova] Acquired lock "refresh_cache-220e1c3e-1378-46fc-acc1-ee1bafac7722" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 16:38:14 user nova-compute[71731]: DEBUG nova.network.neutron [req-4d3cfd7c-d18f-4950-9034-50ebdad205c2 req-5e6cd082-5e83-4c38-99b1-5e8b44c477f9 service nova] [instance: 220e1c3e-1378-46fc-acc1-ee1bafac7722] Refreshing network info cache for port 96415b19-4e1b-41c6-a070-cff24e7b20ab {{(pid=71731) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 16:38:14 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-3e1e900b-b338-42e0-9d28-9c67756fd79d tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Acquiring lock "220e1c3e-1378-46fc-acc1-ee1bafac7722" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:38:14 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-3e1e900b-b338-42e0-9d28-9c67756fd79d tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "220e1c3e-1378-46fc-acc1-ee1bafac7722" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:38:14 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-3e1e900b-b338-42e0-9d28-9c67756fd79d tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Acquiring lock "220e1c3e-1378-46fc-acc1-ee1bafac7722-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:38:14 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-3e1e900b-b338-42e0-9d28-9c67756fd79d tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "220e1c3e-1378-46fc-acc1-ee1bafac7722-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:38:14 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-3e1e900b-b338-42e0-9d28-9c67756fd79d tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "220e1c3e-1378-46fc-acc1-ee1bafac7722-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:38:14 user nova-compute[71731]: INFO nova.compute.manager [None req-3e1e900b-b338-42e0-9d28-9c67756fd79d tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 220e1c3e-1378-46fc-acc1-ee1bafac7722] Terminating instance
Apr 13 16:38:14 user nova-compute[71731]: DEBUG nova.compute.manager [None req-3e1e900b-b338-42e0-9d28-9c67756fd79d tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 220e1c3e-1378-46fc-acc1-ee1bafac7722] Start destroying the instance on the hypervisor. {{(pid=71731) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 16:38:15 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:38:15 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:38:15 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:38:15 user nova-compute[71731]: DEBUG nova.compute.manager [req-8acee889-7dab-4491-97db-1a3166574d12 req-0a6f1d7f-13d5-4437-9b23-715a355e5a66 service nova] [instance: 220e1c3e-1378-46fc-acc1-ee1bafac7722] Received event network-vif-unplugged-96415b19-4e1b-41c6-a070-cff24e7b20ab {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:38:15 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-8acee889-7dab-4491-97db-1a3166574d12 req-0a6f1d7f-13d5-4437-9b23-715a355e5a66 service nova] Acquiring lock "220e1c3e-1378-46fc-acc1-ee1bafac7722-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:38:15 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-8acee889-7dab-4491-97db-1a3166574d12 req-0a6f1d7f-13d5-4437-9b23-715a355e5a66 service nova] Lock "220e1c3e-1378-46fc-acc1-ee1bafac7722-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:38:15 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-8acee889-7dab-4491-97db-1a3166574d12 req-0a6f1d7f-13d5-4437-9b23-715a355e5a66 service nova] Lock "220e1c3e-1378-46fc-acc1-ee1bafac7722-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:38:15 user nova-compute[71731]: DEBUG nova.compute.manager [req-8acee889-7dab-4491-97db-1a3166574d12 req-0a6f1d7f-13d5-4437-9b23-715a355e5a66 service nova] [instance: 220e1c3e-1378-46fc-acc1-ee1bafac7722] No waiting events found dispatching network-vif-unplugged-96415b19-4e1b-41c6-a070-cff24e7b20ab {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:38:15 user nova-compute[71731]: DEBUG nova.compute.manager [req-8acee889-7dab-4491-97db-1a3166574d12 req-0a6f1d7f-13d5-4437-9b23-715a355e5a66 service nova] [instance: 220e1c3e-1378-46fc-acc1-ee1bafac7722] Received event network-vif-unplugged-96415b19-4e1b-41c6-a070-cff24e7b20ab for instance with task_state deleting. {{(pid=71731) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 16:38:15 user nova-compute[71731]: DEBUG nova.network.neutron [req-4d3cfd7c-d18f-4950-9034-50ebdad205c2 req-5e6cd082-5e83-4c38-99b1-5e8b44c477f9 service nova] [instance: 220e1c3e-1378-46fc-acc1-ee1bafac7722] Updated VIF entry in instance network info cache for port 96415b19-4e1b-41c6-a070-cff24e7b20ab. {{(pid=71731) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 16:38:15 user nova-compute[71731]: DEBUG nova.network.neutron [req-4d3cfd7c-d18f-4950-9034-50ebdad205c2 req-5e6cd082-5e83-4c38-99b1-5e8b44c477f9 service nova] [instance: 220e1c3e-1378-46fc-acc1-ee1bafac7722] Updating instance_info_cache with network_info: [{"id": "96415b19-4e1b-41c6-a070-cff24e7b20ab", "address": "fa:16:3e:c0:2c:aa", "network": {"id": "d36bc206-f629-4d6e-8a3f-458061d7b525", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-893271134-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d451e0e239f486aa2b3abe9e273eab3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96415b19-4e", "ovs_interfaceid": "96415b19-4e1b-41c6-a070-cff24e7b20ab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:38:15 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-4d3cfd7c-d18f-4950-9034-50ebdad205c2 req-5e6cd082-5e83-4c38-99b1-5e8b44c477f9 service nova] Releasing lock "refresh_cache-220e1c3e-1378-46fc-acc1-ee1bafac7722" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 16:38:15 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:38:15 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:38:15 user nova-compute[71731]: INFO nova.virt.libvirt.driver [-] [instance: 220e1c3e-1378-46fc-acc1-ee1bafac7722] Instance destroyed successfully.
Apr 13 16:38:15 user nova-compute[71731]: DEBUG nova.objects.instance [None req-3e1e900b-b338-42e0-9d28-9c67756fd79d tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lazy-loading 'resources' on Instance uuid 220e1c3e-1378-46fc-acc1-ee1bafac7722 {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:38:15 user nova-compute[71731]: DEBUG nova.virt.libvirt.vif [None req-3e1e900b-b338-42e0-9d28-9c67756fd79d tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T16:33:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-811215132',display_name='tempest-TestVolumeBootPattern-server-811215132',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-811215132',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIspJuW0ouAVIXdRkaEFP67MIl/YPuQkC9G3HjohNK4Y6ERboR/Jfb2q58aDhzUN+56TLqbLCfdFh2NtWLgvjHOwe+zpPoSYOKAkWLX+NSuU860pg4Djj9vwVgJj/Bkydw==',key_name='tempest-TestVolumeBootPattern-1747083001',keypairs=<?>,launch_index=0,launched_at=2023-04-13T16:33:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8d451e0e239f486aa2b3abe9e273eab3',ramdisk_id='',reservation_id='r-8mcq0v5v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-438786227',owner_user_name='tempest-TestVolumeBootPattern-438786227-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T16:33:41Z,user_data=None,user_id='d70e10f63cdd49a9a1ebe1fe4c9de0a2',uuid=220e1c3e-1378-46fc-acc1-ee1bafac7722,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "96415b19-4e1b-41c6-a070-cff24e7b20ab", "address": "fa:16:3e:c0:2c:aa", "network": {"id": "d36bc206-f629-4d6e-8a3f-458061d7b525", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-893271134-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d451e0e239f486aa2b3abe9e273eab3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96415b19-4e", "ovs_interfaceid": "96415b19-4e1b-41c6-a070-cff24e7b20ab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 16:38:15 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-3e1e900b-b338-42e0-9d28-9c67756fd79d tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Converting VIF {"id": "96415b19-4e1b-41c6-a070-cff24e7b20ab", "address": "fa:16:3e:c0:2c:aa", "network": {"id": "d36bc206-f629-4d6e-8a3f-458061d7b525", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-893271134-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d451e0e239f486aa2b3abe9e273eab3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96415b19-4e", "ovs_interfaceid": "96415b19-4e1b-41c6-a070-cff24e7b20ab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 16:38:15 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-3e1e900b-b338-42e0-9d28-9c67756fd79d tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c0:2c:aa,bridge_name='br-int',has_traffic_filtering=True,id=96415b19-4e1b-41c6-a070-cff24e7b20ab,network=Network(d36bc206-f629-4d6e-8a3f-458061d7b525),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96415b19-4e') {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 16:38:15 user nova-compute[71731]: DEBUG os_vif [None req-3e1e900b-b338-42e0-9d28-9c67756fd79d tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c0:2c:aa,bridge_name='br-int',has_traffic_filtering=True,id=96415b19-4e1b-41c6-a070-cff24e7b20ab,network=Network(d36bc206-f629-4d6e-8a3f-458061d7b525),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96415b19-4e') {{(pid=71731) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 16:38:15 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:38:15 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap96415b19-4e, bridge=br-int, if_exists=True) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:38:15 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:38:15 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 16:38:15 user nova-compute[71731]: INFO os_vif [None req-3e1e900b-b338-42e0-9d28-9c67756fd79d tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c0:2c:aa,bridge_name='br-int',has_traffic_filtering=True,id=96415b19-4e1b-41c6-a070-cff24e7b20ab,network=Network(d36bc206-f629-4d6e-8a3f-458061d7b525),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96415b19-4e')
Apr 13 16:38:15 user nova-compute[71731]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3e1e900b-b338-42e0-9d28-9c67756fd79d tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 220e1c3e-1378-46fc-acc1-ee1bafac7722] calling os-brick to detach iSCSI Volume {{(pid=71731) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 16:38:15 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e1e900b-b338-42e0-9d28-9c67756fd79d tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8cf0118790>, {'target_iqn': 'iqn.2010-10.org.openstack:c2088266-1d33-4bb1-ac5b-1de832ff7985', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mePtryhb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 16:38:15 user nova-compute[71731]: WARNING os_brick.initiator.connectors.base [None req-3e1e900b-b338-42e0-9d28-9c67756fd79d tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 16:38:15 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-3e1e900b-b338-42e0-9d28-9c67756fd79d tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 16:38:15 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-3e1e900b-b338-42e0-9d28-9c67756fd79d tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 16:38:15 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:38:15 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:38:15 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[94179273-a52f-4e99-9dff-9fffff2f2bb4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c2088266-1d33-4bb1-ac5b-1de832ff7985\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:38:15 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e1e900b-b338-42e0-9d28-9c67756fd79d tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 16:38:15 user nova-compute[71731]: No targets found.
Apr 13 16:38:15 user nova-compute[71731]: iSNS:
Apr 13 16:38:15 user nova-compute[71731]: No targets found.
Apr 13 16:38:15 user nova-compute[71731]: STATIC:
Apr 13 16:38:15 user nova-compute[71731]: Target: iqn.2010-10.org.openstack:c2088266-1d33-4bb1-ac5b-1de832ff7985
Apr 13 16:38:15 user nova-compute[71731]:         Portal: 172.16.0.220:3260,-1
Apr 13 16:38:15 user nova-compute[71731]:                 Iface Name: default
Apr 13 16:38:15 user nova-compute[71731]: Target: iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97
Apr 13 16:38:15 user nova-compute[71731]:         Portal: 172.16.0.220:3260,-1
Apr 13 16:38:15 user nova-compute[71731]:                 Iface Name: default
Apr 13 16:38:15 user nova-compute[71731]: FIRMWARE:
Apr 13 16:38:15 user nova-compute[71731]: No targets found.
Apr 13 16:38:15 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 16:38:15 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e1e900b-b338-42e0-9d28-9c67756fd79d tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 16:38:15 user nova-compute[71731]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 16:38:15 user nova-compute[71731]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71731) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 16:38:15 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e1e900b-b338-42e0-9d28-9c67756fd79d tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c2088266-1d33-4bb1-ac5b-1de832ff7985', 0)] {{(pid=71731) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 16:38:15 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:38:15 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:38:15 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[94a8bc4b-736a-41ad-8111-65c9b19c9599]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c2088266-1d33-4bb1-ac5b-1de832ff7985\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:38:15 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:38:15 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:38:15 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[03efc16a-c212-46b6-9b02-2d579589a517]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2088266-1d33-4bb1-ac5b-1de832ff7985 (non-flash)\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:38:15 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e1e900b-b338-42e0-9d28-9c67756fd79d tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)
Apr 13 16:38:15 user nova-compute[71731]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2088266-1d33-4bb1-ac5b-1de832ff7985 (non-flash)
Apr 13 16:38:15 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 16:38:15 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e1e900b-b338-42e0-9d28-9c67756fd79d tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)
Apr 13 16:38:15 user nova-compute[71731]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2088266-1d33-4bb1-ac5b-1de832ff7985 (non-flash)
Apr 13 16:38:15 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 16:38:15 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e1e900b-b338-42e0-9d28-9c67756fd79d tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8cd022c1f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c2088266-1d33-4bb1-ac5b-1de832ff7985'): ({'sdb'}, set())}) {{(pid=71731) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 16:38:15 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-3e1e900b-b338-42e0-9d28-9c67756fd79d tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Removing single pathed devices sdb {{(pid=71731) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 16:38:15 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:38:15 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:38:15 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[06dfebcc-7f4c-4e17-bcfe-a205e8a6b291]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:38:15 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:38:15 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.027s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:38:15 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6369ec4-432c-4c78-9f5c-8381edb7a2ca]: (4, ('ok\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:38:15 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-3e1e900b-b338-42e0-9d28-9c67756fd79d tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Flushing IO for device /dev/sdb {{(pid=71731) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 16:38:15 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:38:16 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:38:16 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d7dcae4-f082-445e-9e7f-126bc0d494d4]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:38:16 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-3e1e900b-b338-42e0-9d28-9c67756fd79d tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71731) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 16:38:16 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:38:16 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:38:16 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.063s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:38:16 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[09064d1c-ade4-42a8-84c5-ae1d7c705b1e]: (4, ('1', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:38:16 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-3e1e900b-b338-42e0-9d28-9c67756fd79d tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71731) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 16:38:16 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-3e1e900b-b338-42e0-9d28-9c67756fd79d tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] SCSI volumes sdb have been removed. {{(pid=71731) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 16:38:16 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e1e900b-b338-42e0-9d28-9c67756fd79d tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c2088266-1d33-4bb1-ac5b-1de832ff7985')] {{(pid=71731) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 16:38:16 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2088266-1d33-4bb1-ac5b-1de832ff7985 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:38:16 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2088266-1d33-4bb1-ac5b-1de832ff7985 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:38:16 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3ae8f4d-a1eb-49eb-a9b9-764f6689a094]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:38:16 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e1e900b-b338-42e0-9d28-9c67756fd79d tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:38:16 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2088266-1d33-4bb1-ac5b-1de832ff7985 -p 172.16.0.220:3260 --logout {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:38:16 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2088266-1d33-4bb1-ac5b-1de832ff7985 -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:38:16 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[c26e3e23-73f2-403c-a61b-13ea647d368c]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:c2088266-1d33-4bb1-ac5b-1de832ff7985, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:c2088266-1d33-4bb1-ac5b-1de832ff7985, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:38:16 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e1e900b-b338-42e0-9d28-9c67756fd79d tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:c2088266-1d33-4bb1-ac5b-1de832ff7985, portal: 172.16.0.220,3260]
Apr 13 16:38:16 user nova-compute[71731]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:c2088266-1d33-4bb1-ac5b-1de832ff7985, portal: 172.16.0.220,3260] successful.
Apr 13 16:38:16 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:38:16 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2088266-1d33-4bb1-ac5b-1de832ff7985 -p 172.16.0.220:3260 --op delete {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:38:16 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2088266-1d33-4bb1-ac5b-1de832ff7985 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:38:16 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8517a0c-0740-45df-a375-3c362cec11f5]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:38:16 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e1e900b-b338-42e0-9d28-9c67756fd79d tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:38:16 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-3e1e900b-b338-42e0-9d28-9c67756fd79d tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.359s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 16:38:16 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e1e900b-b338-42e0-9d28-9c67756fd79d tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] <== disconnect_volume: return (360ms) None {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 16:38:16 user nova-compute[71731]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3e1e900b-b338-42e0-9d28-9c67756fd79d tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 220e1c3e-1378-46fc-acc1-ee1bafac7722] Disconnected iSCSI Volume {{(pid=71731) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 16:38:16 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-3e1e900b-b338-42e0-9d28-9c67756fd79d tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 220e1c3e-1378-46fc-acc1-ee1bafac7722] Deleting instance files /opt/stack/data/nova/instances/220e1c3e-1378-46fc-acc1-ee1bafac7722_del
Apr 13 16:38:16 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-3e1e900b-b338-42e0-9d28-9c67756fd79d tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 220e1c3e-1378-46fc-acc1-ee1bafac7722] Deletion of /opt/stack/data/nova/instances/220e1c3e-1378-46fc-acc1-ee1bafac7722_del complete
Apr 13 16:38:16 user nova-compute[71731]: INFO nova.compute.manager [None req-3e1e900b-b338-42e0-9d28-9c67756fd79d tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 220e1c3e-1378-46fc-acc1-ee1bafac7722] Took 1.25 seconds to destroy the instance on the hypervisor.
Apr 13 16:38:16 user nova-compute[71731]: DEBUG oslo.service.loopingcall [None req-3e1e900b-b338-42e0-9d28-9c67756fd79d tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71731) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 16:38:16 user nova-compute[71731]: DEBUG nova.compute.manager [-] [instance: 220e1c3e-1378-46fc-acc1-ee1bafac7722] Deallocating network for instance {{(pid=71731) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 16:38:16 user nova-compute[71731]: DEBUG nova.network.neutron [-] [instance: 220e1c3e-1378-46fc-acc1-ee1bafac7722] deallocate_for_instance() {{(pid=71731) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 16:38:16 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:38:16 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:38:16 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:38:16 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:38:16 user nova-compute[71731]: DEBUG nova.network.neutron [-] [instance: 220e1c3e-1378-46fc-acc1-ee1bafac7722] Updating instance_info_cache with network_info: [] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:38:16 user nova-compute[71731]: INFO nova.compute.manager [-] [instance: 220e1c3e-1378-46fc-acc1-ee1bafac7722] Took 0.51 seconds to deallocate network for instance.
Apr 13 16:38:16 user nova-compute[71731]: DEBUG nova.compute.manager [req-3f8463dd-de22-497c-9dc1-8518bf127f53 req-c0b6dfb7-14f1-4328-b32b-b96dae19d793 service nova] [instance: 220e1c3e-1378-46fc-acc1-ee1bafac7722] Received event network-vif-deleted-96415b19-4e1b-41c6-a070-cff24e7b20ab {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:38:16 user nova-compute[71731]: INFO nova.compute.manager [req-3f8463dd-de22-497c-9dc1-8518bf127f53 req-c0b6dfb7-14f1-4328-b32b-b96dae19d793 service nova] [instance: 220e1c3e-1378-46fc-acc1-ee1bafac7722] Neutron deleted interface 96415b19-4e1b-41c6-a070-cff24e7b20ab; detaching it from the instance and deleting it from the info cache
Apr 13 16:38:16 user nova-compute[71731]: DEBUG nova.network.neutron [req-3f8463dd-de22-497c-9dc1-8518bf127f53 req-c0b6dfb7-14f1-4328-b32b-b96dae19d793 service nova] [instance: 220e1c3e-1378-46fc-acc1-ee1bafac7722] Updating instance_info_cache with network_info: [] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:38:16 user nova-compute[71731]: DEBUG nova.compute.manager [req-3f8463dd-de22-497c-9dc1-8518bf127f53 req-c0b6dfb7-14f1-4328-b32b-b96dae19d793 service nova] [instance: 220e1c3e-1378-46fc-acc1-ee1bafac7722] Detach interface failed, port_id=96415b19-4e1b-41c6-a070-cff24e7b20ab, reason: Instance 220e1c3e-1378-46fc-acc1-ee1bafac7722 could not be found. {{(pid=71731) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 13 16:38:17 user nova-compute[71731]: DEBUG nova.compute.manager [req-50bfe0e1-0db9-45dd-9b95-8a94bf5370f0 req-aa646ece-bbc5-439e-8a10-86e85a6cd89e service nova] [instance: 220e1c3e-1378-46fc-acc1-ee1bafac7722] Received event network-vif-plugged-96415b19-4e1b-41c6-a070-cff24e7b20ab {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:38:17 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-50bfe0e1-0db9-45dd-9b95-8a94bf5370f0 req-aa646ece-bbc5-439e-8a10-86e85a6cd89e service nova] Acquiring lock "220e1c3e-1378-46fc-acc1-ee1bafac7722-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:38:17 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-50bfe0e1-0db9-45dd-9b95-8a94bf5370f0 req-aa646ece-bbc5-439e-8a10-86e85a6cd89e service nova] Lock "220e1c3e-1378-46fc-acc1-ee1bafac7722-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:38:17 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-50bfe0e1-0db9-45dd-9b95-8a94bf5370f0 req-aa646ece-bbc5-439e-8a10-86e85a6cd89e service nova] Lock "220e1c3e-1378-46fc-acc1-ee1bafac7722-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:38:17 user nova-compute[71731]: DEBUG nova.compute.manager [req-50bfe0e1-0db9-45dd-9b95-8a94bf5370f0 req-aa646ece-bbc5-439e-8a10-86e85a6cd89e service nova] [instance: 220e1c3e-1378-46fc-acc1-ee1bafac7722] No waiting events found dispatching network-vif-plugged-96415b19-4e1b-41c6-a070-cff24e7b20ab {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:38:17 user nova-compute[71731]: WARNING nova.compute.manager [req-50bfe0e1-0db9-45dd-9b95-8a94bf5370f0 req-aa646ece-bbc5-439e-8a10-86e85a6cd89e service nova] [instance: 220e1c3e-1378-46fc-acc1-ee1bafac7722] Received unexpected event network-vif-plugged-96415b19-4e1b-41c6-a070-cff24e7b20ab for instance with vm_state active and task_state deleting.
Apr 13 16:38:17 user nova-compute[71731]: DEBUG nova.compute.manager [req-50bfe0e1-0db9-45dd-9b95-8a94bf5370f0 req-aa646ece-bbc5-439e-8a10-86e85a6cd89e service nova] [instance: 220e1c3e-1378-46fc-acc1-ee1bafac7722] Received event network-vif-plugged-96415b19-4e1b-41c6-a070-cff24e7b20ab {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:38:17 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-50bfe0e1-0db9-45dd-9b95-8a94bf5370f0 req-aa646ece-bbc5-439e-8a10-86e85a6cd89e service nova] Acquiring lock "220e1c3e-1378-46fc-acc1-ee1bafac7722-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:38:17 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-50bfe0e1-0db9-45dd-9b95-8a94bf5370f0 req-aa646ece-bbc5-439e-8a10-86e85a6cd89e service nova] Lock "220e1c3e-1378-46fc-acc1-ee1bafac7722-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:38:17 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-50bfe0e1-0db9-45dd-9b95-8a94bf5370f0 req-aa646ece-bbc5-439e-8a10-86e85a6cd89e service nova] Lock "220e1c3e-1378-46fc-acc1-ee1bafac7722-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:38:17 user nova-compute[71731]: DEBUG nova.compute.manager [req-50bfe0e1-0db9-45dd-9b95-8a94bf5370f0 req-aa646ece-bbc5-439e-8a10-86e85a6cd89e service nova] [instance: 220e1c3e-1378-46fc-acc1-ee1bafac7722] No waiting events found dispatching network-vif-plugged-96415b19-4e1b-41c6-a070-cff24e7b20ab {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:38:17 user nova-compute[71731]: WARNING nova.compute.manager [req-50bfe0e1-0db9-45dd-9b95-8a94bf5370f0 req-aa646ece-bbc5-439e-8a10-86e85a6cd89e service nova] [instance: 220e1c3e-1378-46fc-acc1-ee1bafac7722] Received unexpected event network-vif-plugged-96415b19-4e1b-41c6-a070-cff24e7b20ab for instance with vm_state active and task_state deleting.
Apr 13 16:38:17 user nova-compute[71731]: DEBUG nova.compute.manager [req-50bfe0e1-0db9-45dd-9b95-8a94bf5370f0 req-aa646ece-bbc5-439e-8a10-86e85a6cd89e service nova] [instance: 220e1c3e-1378-46fc-acc1-ee1bafac7722] Received event network-vif-plugged-96415b19-4e1b-41c6-a070-cff24e7b20ab {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:38:17 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-50bfe0e1-0db9-45dd-9b95-8a94bf5370f0 req-aa646ece-bbc5-439e-8a10-86e85a6cd89e service nova] Acquiring lock "220e1c3e-1378-46fc-acc1-ee1bafac7722-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:38:17 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-50bfe0e1-0db9-45dd-9b95-8a94bf5370f0 req-aa646ece-bbc5-439e-8a10-86e85a6cd89e service nova] Lock "220e1c3e-1378-46fc-acc1-ee1bafac7722-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:38:17 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-50bfe0e1-0db9-45dd-9b95-8a94bf5370f0 req-aa646ece-bbc5-439e-8a10-86e85a6cd89e service nova] Lock "220e1c3e-1378-46fc-acc1-ee1bafac7722-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:38:17 user nova-compute[71731]: DEBUG nova.compute.manager [req-50bfe0e1-0db9-45dd-9b95-8a94bf5370f0 req-aa646ece-bbc5-439e-8a10-86e85a6cd89e service nova] [instance: 220e1c3e-1378-46fc-acc1-ee1bafac7722] No waiting events found dispatching network-vif-plugged-96415b19-4e1b-41c6-a070-cff24e7b20ab {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:38:17 user nova-compute[71731]: WARNING nova.compute.manager [req-50bfe0e1-0db9-45dd-9b95-8a94bf5370f0 req-aa646ece-bbc5-439e-8a10-86e85a6cd89e service nova] [instance: 220e1c3e-1378-46fc-acc1-ee1bafac7722] Received unexpected event network-vif-plugged-96415b19-4e1b-41c6-a070-cff24e7b20ab for instance with vm_state active and task_state deleting.
Apr 13 16:38:17 user nova-compute[71731]: DEBUG nova.compute.manager [req-50bfe0e1-0db9-45dd-9b95-8a94bf5370f0 req-aa646ece-bbc5-439e-8a10-86e85a6cd89e service nova] [instance: 220e1c3e-1378-46fc-acc1-ee1bafac7722] Received event network-vif-unplugged-96415b19-4e1b-41c6-a070-cff24e7b20ab {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:38:17 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-50bfe0e1-0db9-45dd-9b95-8a94bf5370f0 req-aa646ece-bbc5-439e-8a10-86e85a6cd89e service nova] Acquiring lock "220e1c3e-1378-46fc-acc1-ee1bafac7722-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:38:17 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-50bfe0e1-0db9-45dd-9b95-8a94bf5370f0 req-aa646ece-bbc5-439e-8a10-86e85a6cd89e service nova] Lock "220e1c3e-1378-46fc-acc1-ee1bafac7722-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:38:17 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-50bfe0e1-0db9-45dd-9b95-8a94bf5370f0 req-aa646ece-bbc5-439e-8a10-86e85a6cd89e service nova] Lock "220e1c3e-1378-46fc-acc1-ee1bafac7722-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:38:17 user nova-compute[71731]: DEBUG nova.compute.manager [req-50bfe0e1-0db9-45dd-9b95-8a94bf5370f0 req-aa646ece-bbc5-439e-8a10-86e85a6cd89e service nova] [instance: 220e1c3e-1378-46fc-acc1-ee1bafac7722] No waiting events found dispatching network-vif-unplugged-96415b19-4e1b-41c6-a070-cff24e7b20ab {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:38:17 user nova-compute[71731]: DEBUG nova.compute.manager [req-50bfe0e1-0db9-45dd-9b95-8a94bf5370f0 req-aa646ece-bbc5-439e-8a10-86e85a6cd89e service nova] [instance: 220e1c3e-1378-46fc-acc1-ee1bafac7722] Received event network-vif-unplugged-96415b19-4e1b-41c6-a070-cff24e7b20ab for instance with task_state deleting. {{(pid=71731) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 16:38:17 user nova-compute[71731]: DEBUG nova.compute.manager [req-50bfe0e1-0db9-45dd-9b95-8a94bf5370f0 req-aa646ece-bbc5-439e-8a10-86e85a6cd89e service nova] [instance: 220e1c3e-1378-46fc-acc1-ee1bafac7722] Received event network-vif-plugged-96415b19-4e1b-41c6-a070-cff24e7b20ab {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:38:17 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-50bfe0e1-0db9-45dd-9b95-8a94bf5370f0 req-aa646ece-bbc5-439e-8a10-86e85a6cd89e service nova] Acquiring lock "220e1c3e-1378-46fc-acc1-ee1bafac7722-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:38:17 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-50bfe0e1-0db9-45dd-9b95-8a94bf5370f0 req-aa646ece-bbc5-439e-8a10-86e85a6cd89e service nova] Lock "220e1c3e-1378-46fc-acc1-ee1bafac7722-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:38:17 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-50bfe0e1-0db9-45dd-9b95-8a94bf5370f0 req-aa646ece-bbc5-439e-8a10-86e85a6cd89e service nova] Lock "220e1c3e-1378-46fc-acc1-ee1bafac7722-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:38:17 user nova-compute[71731]: DEBUG nova.compute.manager [req-50bfe0e1-0db9-45dd-9b95-8a94bf5370f0 req-aa646ece-bbc5-439e-8a10-86e85a6cd89e service nova] [instance: 220e1c3e-1378-46fc-acc1-ee1bafac7722] No waiting events found dispatching network-vif-plugged-96415b19-4e1b-41c6-a070-cff24e7b20ab {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:38:17 user nova-compute[71731]: WARNING nova.compute.manager [req-50bfe0e1-0db9-45dd-9b95-8a94bf5370f0 req-aa646ece-bbc5-439e-8a10-86e85a6cd89e service nova] [instance: 220e1c3e-1378-46fc-acc1-ee1bafac7722] Received unexpected event network-vif-plugged-96415b19-4e1b-41c6-a070-cff24e7b20ab for instance with vm_state active and task_state deleting.
Apr 13 16:38:17 user nova-compute[71731]: INFO nova.compute.manager [None req-3e1e900b-b338-42e0-9d28-9c67756fd79d tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] [instance: 220e1c3e-1378-46fc-acc1-ee1bafac7722] Took 0.81 seconds to detach 1 volumes for instance.
Apr 13 16:38:17 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-3e1e900b-b338-42e0-9d28-9c67756fd79d tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:38:17 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-3e1e900b-b338-42e0-9d28-9c67756fd79d tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:38:17 user nova-compute[71731]: DEBUG nova.compute.provider_tree [None req-3e1e900b-b338-42e0-9d28-9c67756fd79d tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Inventory has not changed in ProviderTree for provider: cb6b1a64-0c24-4e2d-af1e-16576ca9165c {{(pid=71731) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 16:38:17 user nova-compute[71731]: DEBUG nova.scheduler.client.report [None req-3e1e900b-b338-42e0-9d28-9c67756fd79d tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Inventory has not changed for provider cb6b1a64-0c24-4e2d-af1e-16576ca9165c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71731) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 16:38:17 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-3e1e900b-b338-42e0-9d28-9c67756fd79d tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.193s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:38:17 user nova-compute[71731]: INFO nova.scheduler.client.report [None req-3e1e900b-b338-42e0-9d28-9c67756fd79d tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Deleted allocations for instance 220e1c3e-1378-46fc-acc1-ee1bafac7722
Apr 13 16:38:17 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-3e1e900b-b338-42e0-9d28-9c67756fd79d tempest-TestVolumeBootPattern-438786227 tempest-TestVolumeBootPattern-438786227-project-member] Lock "220e1c3e-1378-46fc-acc1-ee1bafac7722" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.929s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:38:20 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:38:20 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71731) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 16:38:20 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager.update_available_resource {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:38:20 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:38:20 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:38:20 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:38:20 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Auditing locally available compute resources for user (node: user) {{(pid=71731) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 16:38:20 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35b23303-e373-4f35-b7ee-76e6815073ce/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:38:20 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35b23303-e373-4f35-b7ee-76e6815073ce/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:38:20 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35b23303-e373-4f35-b7ee-76e6815073ce/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:38:20 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35b23303-e373-4f35-b7ee-76e6815073ce/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:38:20 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ed800fe-577d-4624-898c-c7f40da77376/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:38:20 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ed800fe-577d-4624-898c-c7f40da77376/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:38:20 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ed800fe-577d-4624-898c-c7f40da77376/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:38:20 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ed800fe-577d-4624-898c-c7f40da77376/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:38:20 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66553f5-5e1b-4f1d-8c5a-63bc340f7586/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:38:20 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:38:20 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66553f5-5e1b-4f1d-8c5a-63bc340f7586/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:38:20 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66553f5-5e1b-4f1d-8c5a-63bc340f7586/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:38:21 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66553f5-5e1b-4f1d-8c5a-63bc340f7586/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:38:21 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71731) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 16:38:21 user nova-compute[71731]: WARNING nova.virt.libvirt.driver [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 16:38:21 user nova-compute[71731]: WARNING nova.virt.libvirt.driver [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 16:38:21 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Hypervisor/Node resource view: name=user free_ram=8360MB free_disk=26.112995147705078GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71731) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 16:38:21 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:38:21 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:38:21 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance f66553f5-5e1b-4f1d-8c5a-63bc340f7586 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 16:38:21 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance 235f827c-7116-48e9-84c5-0c9761c18e1e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 16:38:21 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance 35b23303-e373-4f35-b7ee-76e6815073ce actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 16:38:21 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance 5ed800fe-577d-4624-898c-c7f40da77376 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 16:38:21 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=71731) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 16:38:21 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Final resource view: name=user phys_ram=16023MB used_ram=1024MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=71731) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 16:38:21 user nova-compute[71731]: DEBUG nova.compute.provider_tree [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Inventory has not changed in ProviderTree for provider: cb6b1a64-0c24-4e2d-af1e-16576ca9165c {{(pid=71731) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 16:38:21 user nova-compute[71731]: DEBUG nova.scheduler.client.report [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Inventory has not changed for provider cb6b1a64-0c24-4e2d-af1e-16576ca9165c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71731) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 16:38:21 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Compute_service record updated for user:user {{(pid=71731) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 16:38:21 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.261s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:38:22 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:38:22 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:38:24 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:38:24 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Starting heal instance info cache {{(pid=71731) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 16:38:24 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Rebuilding the list of instances to heal {{(pid=71731) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 13 16:38:24 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] [instance: 35b23303-e373-4f35-b7ee-76e6815073ce] Skipping network cache update for instance because it is being deleted. {{(pid=71731) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9809}}
Apr 13 16:38:24 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-b20e20d4-76db-4fc3-b798-f876fc7c242d tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Acquiring lock "35b23303-e373-4f35-b7ee-76e6815073ce" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:38:24 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-b20e20d4-76db-4fc3-b798-f876fc7c242d tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lock "35b23303-e373-4f35-b7ee-76e6815073ce" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:38:24 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-b20e20d4-76db-4fc3-b798-f876fc7c242d tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Acquiring lock "35b23303-e373-4f35-b7ee-76e6815073ce-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:38:24 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-b20e20d4-76db-4fc3-b798-f876fc7c242d tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lock "35b23303-e373-4f35-b7ee-76e6815073ce-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:38:24 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-b20e20d4-76db-4fc3-b798-f876fc7c242d tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lock "35b23303-e373-4f35-b7ee-76e6815073ce-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:38:24 user nova-compute[71731]: INFO nova.compute.manager [None req-b20e20d4-76db-4fc3-b798-f876fc7c242d tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] [instance: 35b23303-e373-4f35-b7ee-76e6815073ce] Terminating instance
Apr 13 16:38:24 user nova-compute[71731]: DEBUG nova.compute.manager [None req-b20e20d4-76db-4fc3-b798-f876fc7c242d tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] [instance: 35b23303-e373-4f35-b7ee-76e6815073ce] Start destroying the instance on the hypervisor. {{(pid=71731) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 16:38:24 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Acquiring lock "refresh_cache-f66553f5-5e1b-4f1d-8c5a-63bc340f7586" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 16:38:24 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Acquired lock "refresh_cache-f66553f5-5e1b-4f1d-8c5a-63bc340f7586" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 16:38:24 user nova-compute[71731]: DEBUG nova.network.neutron [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] [instance: f66553f5-5e1b-4f1d-8c5a-63bc340f7586] Forcefully refreshing network info cache for instance {{(pid=71731) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 16:38:24 user nova-compute[71731]: DEBUG nova.objects.instance [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lazy-loading 'info_cache' on Instance uuid f66553f5-5e1b-4f1d-8c5a-63bc340f7586 {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:38:24 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:38:24 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:38:24 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:38:24 user nova-compute[71731]: DEBUG nova.compute.manager [req-06ead680-0d61-48ad-87ab-51cc974245d0 req-95a876fe-9f65-4d52-8d20-e5913fac34f5 service nova] [instance: 35b23303-e373-4f35-b7ee-76e6815073ce] Received event network-vif-unplugged-d3c66e4e-b15d-4bc9-a838-265ca07a6a66 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:38:24 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-06ead680-0d61-48ad-87ab-51cc974245d0 req-95a876fe-9f65-4d52-8d20-e5913fac34f5 service nova] Acquiring lock "35b23303-e373-4f35-b7ee-76e6815073ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:38:24 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-06ead680-0d61-48ad-87ab-51cc974245d0 req-95a876fe-9f65-4d52-8d20-e5913fac34f5 service nova] Lock "35b23303-e373-4f35-b7ee-76e6815073ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:38:24 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-06ead680-0d61-48ad-87ab-51cc974245d0 req-95a876fe-9f65-4d52-8d20-e5913fac34f5 service nova] Lock "35b23303-e373-4f35-b7ee-76e6815073ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:38:24 user nova-compute[71731]: DEBUG nova.compute.manager [req-06ead680-0d61-48ad-87ab-51cc974245d0 req-95a876fe-9f65-4d52-8d20-e5913fac34f5 service nova] [instance: 35b23303-e373-4f35-b7ee-76e6815073ce] No waiting events found dispatching network-vif-unplugged-d3c66e4e-b15d-4bc9-a838-265ca07a6a66 {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:38:24 user nova-compute[71731]: DEBUG nova.compute.manager [req-06ead680-0d61-48ad-87ab-51cc974245d0 req-95a876fe-9f65-4d52-8d20-e5913fac34f5 service nova] [instance: 35b23303-e373-4f35-b7ee-76e6815073ce] Received event network-vif-unplugged-d3c66e4e-b15d-4bc9-a838-265ca07a6a66 for instance with task_state deleting. {{(pid=71731) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 16:38:24 user nova-compute[71731]: DEBUG nova.network.neutron [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] [instance: f66553f5-5e1b-4f1d-8c5a-63bc340f7586] Updating instance_info_cache with network_info: [{"id": "27d05b76-8556-4365-9050-6bf871e85502", "address": "fa:16:3e:0d:13:8a", "network": {"id": "5a7877ff-8230-470b-90b5-e5dcfc8f0cee", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-779403873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2d09a74bf684a9fb1dd1e95d6c23f3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27d05b76-85", "ovs_interfaceid": "27d05b76-8556-4365-9050-6bf871e85502", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:38:24 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Releasing lock "refresh_cache-f66553f5-5e1b-4f1d-8c5a-63bc340f7586" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 16:38:24 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] [instance: f66553f5-5e1b-4f1d-8c5a-63bc340f7586] Updated the network info_cache for instance {{(pid=71731) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 16:38:24 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:38:24 user nova-compute[71731]: INFO nova.virt.libvirt.driver [-] [instance: 35b23303-e373-4f35-b7ee-76e6815073ce] Instance destroyed successfully.
Apr 13 16:38:24 user nova-compute[71731]: DEBUG nova.objects.instance [None req-b20e20d4-76db-4fc3-b798-f876fc7c242d tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lazy-loading 'resources' on Instance uuid 35b23303-e373-4f35-b7ee-76e6815073ce {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:38:24 user nova-compute[71731]: DEBUG nova.virt.libvirt.vif [None req-b20e20d4-76db-4fc3-b798-f876fc7c242d tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-13T16:31:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1250036054',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1250036054',id=29,image_ref='708622a9-7465-4492-ade8-b827198f7e30',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLQeZ76om971CHhTZu4ReSq6QPGcHpR5nWHWtfdjAVD10KpB0WFrcOFE78MwJOBYC8dClsRGNG38ZB3wd8nDfZlZongElXTKw6yUyFEOVvzfdaLLX/bmjmfAtuiMX+ECkA==',key_name='tempest-keypair-179744772',keypairs=<?>,launch_index=0,launched_at=2023-04-13T16:36:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0653ab16660b46cea9c5af58ea0b1931',ramdisk_id='',reservation_id='r-h5vfm9ar',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='708622a9-7465-4492-ade8-b827198f7e30',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1310775310',owner_user_name='tempest-AttachVolumeShelveTestJSON-1310775310-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T16:36:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='48b4e972cd1049509fa899449961ab59',uuid=35b23303-e373-4f35-b7ee-76e6815073ce,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d3c66e4e-b15d-4bc9-a838-265ca07a6a66", "address": "fa:16:3e:3a:4e:db", "network": {"id": "5acc9a78-1127-46df-bb60-7544cdd2c1ef", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2143082515-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0653ab16660b46cea9c5af58ea0b1931", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3c66e4e-b1", "ovs_interfaceid": "d3c66e4e-b15d-4bc9-a838-265ca07a6a66", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 16:38:24 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-b20e20d4-76db-4fc3-b798-f876fc7c242d tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Converting VIF {"id": "d3c66e4e-b15d-4bc9-a838-265ca07a6a66", "address": "fa:16:3e:3a:4e:db", "network": {"id": "5acc9a78-1127-46df-bb60-7544cdd2c1ef", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2143082515-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0653ab16660b46cea9c5af58ea0b1931", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3c66e4e-b1", "ovs_interfaceid": "d3c66e4e-b15d-4bc9-a838-265ca07a6a66", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 16:38:24 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-b20e20d4-76db-4fc3-b798-f876fc7c242d tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3a:4e:db,bridge_name='br-int',has_traffic_filtering=True,id=d3c66e4e-b15d-4bc9-a838-265ca07a6a66,network=Network(5acc9a78-1127-46df-bb60-7544cdd2c1ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3c66e4e-b1') {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 16:38:24 user nova-compute[71731]: DEBUG os_vif [None req-b20e20d4-76db-4fc3-b798-f876fc7c242d tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3a:4e:db,bridge_name='br-int',has_traffic_filtering=True,id=d3c66e4e-b15d-4bc9-a838-265ca07a6a66,network=Network(5acc9a78-1127-46df-bb60-7544cdd2c1ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3c66e4e-b1') {{(pid=71731) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 16:38:24 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:38:24 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd3c66e4e-b1, bridge=br-int, if_exists=True) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:38:24 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:38:24 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 16:38:24 user nova-compute[71731]: INFO os_vif [None req-b20e20d4-76db-4fc3-b798-f876fc7c242d tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3a:4e:db,bridge_name='br-int',has_traffic_filtering=True,id=d3c66e4e-b15d-4bc9-a838-265ca07a6a66,network=Network(5acc9a78-1127-46df-bb60-7544cdd2c1ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3c66e4e-b1')
Apr 13 16:38:24 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-b20e20d4-76db-4fc3-b798-f876fc7c242d tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] [instance: 35b23303-e373-4f35-b7ee-76e6815073ce] Deleting instance files /opt/stack/data/nova/instances/35b23303-e373-4f35-b7ee-76e6815073ce_del
Apr 13 16:38:24 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-b20e20d4-76db-4fc3-b798-f876fc7c242d tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] [instance: 35b23303-e373-4f35-b7ee-76e6815073ce] Deletion of /opt/stack/data/nova/instances/35b23303-e373-4f35-b7ee-76e6815073ce_del complete
Apr 13 16:38:25 user nova-compute[71731]: INFO nova.compute.manager [None req-b20e20d4-76db-4fc3-b798-f876fc7c242d tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] [instance: 35b23303-e373-4f35-b7ee-76e6815073ce] Took 0.94 seconds to destroy the instance on the hypervisor.
Apr 13 16:38:25 user nova-compute[71731]: DEBUG oslo.service.loopingcall [None req-b20e20d4-76db-4fc3-b798-f876fc7c242d tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71731) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 16:38:25 user nova-compute[71731]: DEBUG nova.compute.manager [-] [instance: 35b23303-e373-4f35-b7ee-76e6815073ce] Deallocating network for instance {{(pid=71731) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 16:38:25 user nova-compute[71731]: DEBUG nova.network.neutron [-] [instance: 35b23303-e373-4f35-b7ee-76e6815073ce] deallocate_for_instance() {{(pid=71731) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 16:38:25 user nova-compute[71731]: DEBUG nova.network.neutron [-] [instance: 35b23303-e373-4f35-b7ee-76e6815073ce] Updating instance_info_cache with network_info: [] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:38:25 user nova-compute[71731]: INFO nova.compute.manager [-] [instance: 35b23303-e373-4f35-b7ee-76e6815073ce] Took 0.68 seconds to deallocate network for instance.
Apr 13 16:38:25 user nova-compute[71731]: DEBUG nova.compute.manager [req-708fae6c-67e6-4cb1-bfaf-058dc401831a req-da3147f1-628f-4635-8dcd-ef9d66f86f44 service nova] [instance: 35b23303-e373-4f35-b7ee-76e6815073ce] Received event network-vif-deleted-d3c66e4e-b15d-4bc9-a838-265ca07a6a66 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:38:25 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-b20e20d4-76db-4fc3-b798-f876fc7c242d tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:38:25 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-b20e20d4-76db-4fc3-b798-f876fc7c242d tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:38:25 user nova-compute[71731]: DEBUG nova.compute.provider_tree [None req-b20e20d4-76db-4fc3-b798-f876fc7c242d tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Inventory has not changed in ProviderTree for provider: cb6b1a64-0c24-4e2d-af1e-16576ca9165c {{(pid=71731) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 16:38:25 user nova-compute[71731]: DEBUG nova.scheduler.client.report [None req-b20e20d4-76db-4fc3-b798-f876fc7c242d tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Inventory has not changed for provider cb6b1a64-0c24-4e2d-af1e-16576ca9165c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71731) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 16:38:25 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-b20e20d4-76db-4fc3-b798-f876fc7c242d tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.183s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:38:25 user nova-compute[71731]: INFO nova.scheduler.client.report [None req-b20e20d4-76db-4fc3-b798-f876fc7c242d tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Deleted allocations for instance 35b23303-e373-4f35-b7ee-76e6815073ce
Apr 13 16:38:26 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:38:26 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:38:26 user nova-compute[71731]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681403891.076172, 650427bd-4dad-4bcd-922d-c17e60b36807 => Stopped> {{(pid=71731) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 16:38:26 user nova-compute[71731]: INFO nova.compute.manager [-] [instance: 650427bd-4dad-4bcd-922d-c17e60b36807] VM Stopped (Lifecycle Event)
Apr 13 16:38:26 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-b20e20d4-76db-4fc3-b798-f876fc7c242d tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lock "35b23303-e373-4f35-b7ee-76e6815073ce" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.004s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:38:26 user nova-compute[71731]: DEBUG nova.compute.manager [None req-a10a031f-e59c-4e3a-a480-948369cf3ac9 None None] [instance: 650427bd-4dad-4bcd-922d-c17e60b36807] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:38:26 user nova-compute[71731]: DEBUG nova.compute.manager [req-0df9ea84-77b5-4673-8186-cb89c16b1ee1 req-a84c394b-9b4d-46ba-a7ac-26e5eacc0381 service nova] [instance: 35b23303-e373-4f35-b7ee-76e6815073ce] Received event network-vif-plugged-d3c66e4e-b15d-4bc9-a838-265ca07a6a66 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:38:26 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-0df9ea84-77b5-4673-8186-cb89c16b1ee1 req-a84c394b-9b4d-46ba-a7ac-26e5eacc0381 service nova] Acquiring lock "35b23303-e373-4f35-b7ee-76e6815073ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:38:26 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-0df9ea84-77b5-4673-8186-cb89c16b1ee1 req-a84c394b-9b4d-46ba-a7ac-26e5eacc0381 service nova] Lock "35b23303-e373-4f35-b7ee-76e6815073ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:38:26 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-0df9ea84-77b5-4673-8186-cb89c16b1ee1 req-a84c394b-9b4d-46ba-a7ac-26e5eacc0381 service nova] Lock "35b23303-e373-4f35-b7ee-76e6815073ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:38:26 user nova-compute[71731]: DEBUG nova.compute.manager [req-0df9ea84-77b5-4673-8186-cb89c16b1ee1 req-a84c394b-9b4d-46ba-a7ac-26e5eacc0381 service nova] [instance: 35b23303-e373-4f35-b7ee-76e6815073ce] No waiting events found dispatching network-vif-plugged-d3c66e4e-b15d-4bc9-a838-265ca07a6a66 {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:38:26 user nova-compute[71731]: WARNING nova.compute.manager [req-0df9ea84-77b5-4673-8186-cb89c16b1ee1 req-a84c394b-9b4d-46ba-a7ac-26e5eacc0381 service nova] [instance: 35b23303-e373-4f35-b7ee-76e6815073ce] Received unexpected event network-vif-plugged-d3c66e4e-b15d-4bc9-a838-265ca07a6a66 for instance with vm_state deleted and task_state None.
Apr 13 16:38:27 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:38:29 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:38:29 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:38:30 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:38:30 user nova-compute[71731]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681403895.77681, 220e1c3e-1378-46fc-acc1-ee1bafac7722 => Stopped> {{(pid=71731) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 16:38:30 user nova-compute[71731]: INFO nova.compute.manager [-] [instance: 220e1c3e-1378-46fc-acc1-ee1bafac7722] VM Stopped (Lifecycle Event)
Apr 13 16:38:30 user nova-compute[71731]: DEBUG nova.compute.manager [None req-da912857-7eb3-4745-bf39-e01b4e70eb64 None None] [instance: 220e1c3e-1378-46fc-acc1-ee1bafac7722] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:38:34 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 16:38:37 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:38:39 user nova-compute[71731]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681403904.8895304, 35b23303-e373-4f35-b7ee-76e6815073ce => Stopped> {{(pid=71731) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 16:38:39 user nova-compute[71731]: INFO nova.compute.manager [-] [instance: 35b23303-e373-4f35-b7ee-76e6815073ce] VM Stopped (Lifecycle Event)
Apr 13 16:38:39 user nova-compute[71731]: DEBUG nova.compute.manager [None req-43ca551f-197c-4419-a7d4-1036f0bf7b90 None None] [instance: 35b23303-e373-4f35-b7ee-76e6815073ce] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:38:39 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:38:44 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:38:49 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 16:38:49 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:38:49 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71731) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 16:38:49 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71731) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 16:38:49 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71731) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 16:38:49 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 16:38:52 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:38:54 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:38:59 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:39:00 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-a17c6fd3-18bf-4d9c-894c-6b9e03d5976c tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Acquiring lock "235f827c-7116-48e9-84c5-0c9761c18e1e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:39:00 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-a17c6fd3-18bf-4d9c-894c-6b9e03d5976c tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lock "235f827c-7116-48e9-84c5-0c9761c18e1e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:39:00 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-a17c6fd3-18bf-4d9c-894c-6b9e03d5976c tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Acquiring lock "235f827c-7116-48e9-84c5-0c9761c18e1e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:39:00 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-a17c6fd3-18bf-4d9c-894c-6b9e03d5976c tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lock "235f827c-7116-48e9-84c5-0c9761c18e1e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:39:00 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-a17c6fd3-18bf-4d9c-894c-6b9e03d5976c tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lock "235f827c-7116-48e9-84c5-0c9761c18e1e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:39:00 user nova-compute[71731]: INFO nova.compute.manager [None req-a17c6fd3-18bf-4d9c-894c-6b9e03d5976c tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: 235f827c-7116-48e9-84c5-0c9761c18e1e] Terminating instance
Apr 13 16:39:00 user nova-compute[71731]: DEBUG nova.compute.manager [None req-a17c6fd3-18bf-4d9c-894c-6b9e03d5976c tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: 235f827c-7116-48e9-84c5-0c9761c18e1e] Start destroying the instance on the hypervisor. {{(pid=71731) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 16:39:00 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:39:01 user nova-compute[71731]: DEBUG nova.compute.manager [req-76edbd6f-14cf-484a-9efa-8281c370ab75 req-09ad0cd6-8f09-4e04-b0a9-d1f32602011a service nova] [instance: 235f827c-7116-48e9-84c5-0c9761c18e1e] Received event network-vif-unplugged-b72a6c8b-7244-41c2-a4f7-6da43b4944b8 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:39:01 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-76edbd6f-14cf-484a-9efa-8281c370ab75 req-09ad0cd6-8f09-4e04-b0a9-d1f32602011a service nova] Acquiring lock "235f827c-7116-48e9-84c5-0c9761c18e1e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:39:01 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-76edbd6f-14cf-484a-9efa-8281c370ab75 req-09ad0cd6-8f09-4e04-b0a9-d1f32602011a service nova] Lock "235f827c-7116-48e9-84c5-0c9761c18e1e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:39:01 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-76edbd6f-14cf-484a-9efa-8281c370ab75 req-09ad0cd6-8f09-4e04-b0a9-d1f32602011a service nova] Lock "235f827c-7116-48e9-84c5-0c9761c18e1e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:39:01 user nova-compute[71731]: DEBUG nova.compute.manager [req-76edbd6f-14cf-484a-9efa-8281c370ab75 req-09ad0cd6-8f09-4e04-b0a9-d1f32602011a service nova] [instance: 235f827c-7116-48e9-84c5-0c9761c18e1e] No waiting events found dispatching network-vif-unplugged-b72a6c8b-7244-41c2-a4f7-6da43b4944b8 {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:39:01 user nova-compute[71731]: DEBUG nova.compute.manager [req-76edbd6f-14cf-484a-9efa-8281c370ab75 req-09ad0cd6-8f09-4e04-b0a9-d1f32602011a service nova] [instance: 235f827c-7116-48e9-84c5-0c9761c18e1e] Received event network-vif-unplugged-b72a6c8b-7244-41c2-a4f7-6da43b4944b8 for instance with task_state deleting. {{(pid=71731) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 16:39:01 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:39:01 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:39:01 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:39:01 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:39:01 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:39:01 user nova-compute[71731]: INFO nova.virt.libvirt.driver [-] [instance: 235f827c-7116-48e9-84c5-0c9761c18e1e] Instance destroyed successfully.
Apr 13 16:39:01 user nova-compute[71731]: DEBUG nova.objects.instance [None req-a17c6fd3-18bf-4d9c-894c-6b9e03d5976c tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lazy-loading 'resources' on Instance uuid 235f827c-7116-48e9-84c5-0c9761c18e1e {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:39:01 user nova-compute[71731]: DEBUG nova.virt.libvirt.vif [None req-a17c6fd3-18bf-4d9c-894c-6b9e03d5976c tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T16:23:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1447697852',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1447697852',id=14,image_ref='708622a9-7465-4492-ade8-b827198f7e30',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-13T16:25:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b2d09a74bf684a9fb1dd1e95d6c23f3c',ramdisk_id='',reservation_id='r-6nx0xd0y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='708622a9-7465-4492-ade8-b827198f7e30',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1960261099',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T16:27:03Z,user_data=None,user_id='e45a882dbafb4ea4976e4f45289eb2b8',uuid=235f827c-7116-48e9-84c5-0c9761c18e1e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b72a6c8b-7244-41c2-a4f7-6da43b4944b8", "address": "fa:16:3e:e3:62:b0", "network": {"id": "5a7877ff-8230-470b-90b5-e5dcfc8f0cee", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-779403873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2d09a74bf684a9fb1dd1e95d6c23f3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb72a6c8b-72", "ovs_interfaceid": "b72a6c8b-7244-41c2-a4f7-6da43b4944b8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 16:39:01 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-a17c6fd3-18bf-4d9c-894c-6b9e03d5976c tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Converting VIF {"id": "b72a6c8b-7244-41c2-a4f7-6da43b4944b8", "address": "fa:16:3e:e3:62:b0", "network": {"id": "5a7877ff-8230-470b-90b5-e5dcfc8f0cee", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-779403873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2d09a74bf684a9fb1dd1e95d6c23f3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb72a6c8b-72", "ovs_interfaceid": "b72a6c8b-7244-41c2-a4f7-6da43b4944b8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 16:39:01 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-a17c6fd3-18bf-4d9c-894c-6b9e03d5976c tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e3:62:b0,bridge_name='br-int',has_traffic_filtering=True,id=b72a6c8b-7244-41c2-a4f7-6da43b4944b8,network=Network(5a7877ff-8230-470b-90b5-e5dcfc8f0cee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb72a6c8b-72') {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 16:39:01 user nova-compute[71731]: DEBUG os_vif [None req-a17c6fd3-18bf-4d9c-894c-6b9e03d5976c tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e3:62:b0,bridge_name='br-int',has_traffic_filtering=True,id=b72a6c8b-7244-41c2-a4f7-6da43b4944b8,network=Network(5a7877ff-8230-470b-90b5-e5dcfc8f0cee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb72a6c8b-72') {{(pid=71731) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 16:39:01 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:39:01 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb72a6c8b-72, bridge=br-int, if_exists=True) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:39:01 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:39:01 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 16:39:01 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:39:01 user nova-compute[71731]: INFO os_vif [None req-a17c6fd3-18bf-4d9c-894c-6b9e03d5976c tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e3:62:b0,bridge_name='br-int',has_traffic_filtering=True,id=b72a6c8b-7244-41c2-a4f7-6da43b4944b8,network=Network(5a7877ff-8230-470b-90b5-e5dcfc8f0cee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb72a6c8b-72')
Apr 13 16:39:01 user nova-compute[71731]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a17c6fd3-18bf-4d9c-894c-6b9e03d5976c tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: 235f827c-7116-48e9-84c5-0c9761c18e1e] calling os-brick to detach iSCSI Volume {{(pid=71731) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 16:39:01 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-a17c6fd3-18bf-4d9c-894c-6b9e03d5976c tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8cf0118790>, {'target_iqn': 'iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jqPGdnMb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 16:39:01 user nova-compute[71731]: WARNING os_brick.initiator.connectors.base [None req-a17c6fd3-18bf-4d9c-894c-6b9e03d5976c tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 16:39:01 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-a17c6fd3-18bf-4d9c-894c-6b9e03d5976c tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 16:39:01 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-a17c6fd3-18bf-4d9c-894c-6b9e03d5976c tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 16:39:01 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:39:01 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:39:01 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[d80db968-9e51-4552-a923-bce7de7d1c43]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:39:01 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-a17c6fd3-18bf-4d9c-894c-6b9e03d5976c tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 16:39:01 user nova-compute[71731]: No targets found.
Apr 13 16:39:01 user nova-compute[71731]: iSNS:
Apr 13 16:39:01 user nova-compute[71731]: No targets found.
Apr 13 16:39:01 user nova-compute[71731]: STATIC:
Apr 13 16:39:01 user nova-compute[71731]: Target: iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97
Apr 13 16:39:01 user nova-compute[71731]:         Portal: 172.16.0.220:3260,-1
Apr 13 16:39:01 user nova-compute[71731]:                 Iface Name: default
Apr 13 16:39:01 user nova-compute[71731]: FIRMWARE:
Apr 13 16:39:01 user nova-compute[71731]: No targets found.
Apr 13 16:39:01 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 16:39:01 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-a17c6fd3-18bf-4d9c-894c-6b9e03d5976c tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 16:39:01 user nova-compute[71731]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 16:39:01 user nova-compute[71731]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71731) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 16:39:01 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-a17c6fd3-18bf-4d9c-894c-6b9e03d5976c tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97', 0)] {{(pid=71731) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 16:39:01 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:39:01 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:39:01 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad240307-5d20-4351-a2fd-bd488356ad3e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:39:01 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:39:01 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:39:01 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[81841214-b807-444c-9f66-a3921985c101]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:39:01 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-a17c6fd3-18bf-4d9c-894c-6b9e03d5976c tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)
Apr 13 16:39:01 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 16:39:01 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-a17c6fd3-18bf-4d9c-894c-6b9e03d5976c tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 (non-flash)
Apr 13 16:39:01 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 16:39:01 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-a17c6fd3-18bf-4d9c-894c-6b9e03d5976c tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8cb056a830>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97'): ({'sdc'}, set())}) {{(pid=71731) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 16:39:01 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-a17c6fd3-18bf-4d9c-894c-6b9e03d5976c tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Removing single pathed devices sdc {{(pid=71731) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 16:39:01 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:39:01 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:39:01 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[aade0f55-25ef-488e-a5d3-90ceed191793]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:39:01 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:39:01 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:39:01 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[439eeaa0-94c2-42a6-bb58-8861d9927931]: (4, ('ok\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:39:01 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-a17c6fd3-18bf-4d9c-894c-6b9e03d5976c tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Flushing IO for device /dev/sdc {{(pid=71731) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 16:39:01 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:39:01 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:39:01 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[145ffff2-5802-4298-a4b2-3616ba47ade1]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:39:01 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-a17c6fd3-18bf-4d9c-894c-6b9e03d5976c tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71731) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 16:39:01 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:39:01 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.037s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:39:01 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[e20b7081-894f-448e-829e-c9c54ced4011]: (4, ('1', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:39:01 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-a17c6fd3-18bf-4d9c-894c-6b9e03d5976c tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71731) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 16:39:01 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-a17c6fd3-18bf-4d9c-894c-6b9e03d5976c tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] SCSI volumes sdc have been removed. {{(pid=71731) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 16:39:01 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-a17c6fd3-18bf-4d9c-894c-6b9e03d5976c tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97')] {{(pid=71731) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 16:39:01 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:39:01 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:39:01 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[3008eeec-a3cd-4be1-b7a6-4a27c31602c2]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:39:01 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-a17c6fd3-18bf-4d9c-894c-6b9e03d5976c tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:39:01 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 -p 172.16.0.220:3260 --logout {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:39:01 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:39:02 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9825438-7194-4a5b-918d-57652f12c3ef]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:39:02 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-a17c6fd3-18bf-4d9c-894c-6b9e03d5976c tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97, portal: 172.16.0.220,3260]
Apr 13 16:39:02 user nova-compute[71731]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97, portal: 172.16.0.220,3260] successful.
Apr 13 16:39:02 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:39:02 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 -p 172.16.0.220:3260 --op delete {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:39:02 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:417090c0-76a2-4277-9095-5c5095638b97 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:39:02 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[744dd3c8-5d53-496f-bf3e-c5a186671fc8]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:39:02 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-a17c6fd3-18bf-4d9c-894c-6b9e03d5976c tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:39:02 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-a17c6fd3-18bf-4d9c-894c-6b9e03d5976c tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.270s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 16:39:02 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-a17c6fd3-18bf-4d9c-894c-6b9e03d5976c tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] <== disconnect_volume: return (271ms) None {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 16:39:02 user nova-compute[71731]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a17c6fd3-18bf-4d9c-894c-6b9e03d5976c tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: 235f827c-7116-48e9-84c5-0c9761c18e1e] Disconnected iSCSI Volume {{(pid=71731) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 16:39:02 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-a17c6fd3-18bf-4d9c-894c-6b9e03d5976c tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: 235f827c-7116-48e9-84c5-0c9761c18e1e] Deleting instance files /opt/stack/data/nova/instances/235f827c-7116-48e9-84c5-0c9761c18e1e_del
Apr 13 16:39:02 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-a17c6fd3-18bf-4d9c-894c-6b9e03d5976c tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: 235f827c-7116-48e9-84c5-0c9761c18e1e] Deletion of /opt/stack/data/nova/instances/235f827c-7116-48e9-84c5-0c9761c18e1e_del complete
Apr 13 16:39:02 user nova-compute[71731]: INFO nova.compute.manager [None req-a17c6fd3-18bf-4d9c-894c-6b9e03d5976c tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: 235f827c-7116-48e9-84c5-0c9761c18e1e] Took 1.32 seconds to destroy the instance on the hypervisor.
Apr 13 16:39:02 user nova-compute[71731]: DEBUG oslo.service.loopingcall [None req-a17c6fd3-18bf-4d9c-894c-6b9e03d5976c tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71731) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 16:39:02 user nova-compute[71731]: DEBUG nova.compute.manager [-] [instance: 235f827c-7116-48e9-84c5-0c9761c18e1e] Deallocating network for instance {{(pid=71731) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 16:39:02 user nova-compute[71731]: DEBUG nova.network.neutron [-] [instance: 235f827c-7116-48e9-84c5-0c9761c18e1e] deallocate_for_instance() {{(pid=71731) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 16:39:02 user nova-compute[71731]: DEBUG nova.network.neutron [-] [instance: 235f827c-7116-48e9-84c5-0c9761c18e1e] Updating instance_info_cache with network_info: [] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:39:02 user nova-compute[71731]: INFO nova.compute.manager [-] [instance: 235f827c-7116-48e9-84c5-0c9761c18e1e] Took 0.45 seconds to deallocate network for instance.
Apr 13 16:39:02 user nova-compute[71731]: DEBUG nova.compute.manager [req-b3272faa-fae1-48fe-97f7-aae14982db2a req-764e0c49-eb0f-4be5-baec-bb742b5d2fef service nova] [instance: 235f827c-7116-48e9-84c5-0c9761c18e1e] Received event network-vif-deleted-b72a6c8b-7244-41c2-a4f7-6da43b4944b8 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:39:03 user nova-compute[71731]: DEBUG nova.compute.manager [req-4a5b58e1-2339-4f8c-aa1e-0ae3dd011b85 req-e4e3958d-a80b-4980-b30e-2a722bfd63a3 service nova] [instance: 235f827c-7116-48e9-84c5-0c9761c18e1e] Received event network-vif-plugged-b72a6c8b-7244-41c2-a4f7-6da43b4944b8 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:39:03 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-4a5b58e1-2339-4f8c-aa1e-0ae3dd011b85 req-e4e3958d-a80b-4980-b30e-2a722bfd63a3 service nova] Acquiring lock "235f827c-7116-48e9-84c5-0c9761c18e1e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:39:03 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-4a5b58e1-2339-4f8c-aa1e-0ae3dd011b85 req-e4e3958d-a80b-4980-b30e-2a722bfd63a3 service nova] Lock "235f827c-7116-48e9-84c5-0c9761c18e1e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:39:03 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-4a5b58e1-2339-4f8c-aa1e-0ae3dd011b85 req-e4e3958d-a80b-4980-b30e-2a722bfd63a3 service nova] Lock "235f827c-7116-48e9-84c5-0c9761c18e1e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:39:03 user nova-compute[71731]: DEBUG nova.compute.manager [req-4a5b58e1-2339-4f8c-aa1e-0ae3dd011b85 req-e4e3958d-a80b-4980-b30e-2a722bfd63a3 service nova] [instance: 235f827c-7116-48e9-84c5-0c9761c18e1e] No waiting events found dispatching network-vif-plugged-b72a6c8b-7244-41c2-a4f7-6da43b4944b8 {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:39:03 user nova-compute[71731]: WARNING nova.compute.manager [req-4a5b58e1-2339-4f8c-aa1e-0ae3dd011b85 req-e4e3958d-a80b-4980-b30e-2a722bfd63a3 service nova] [instance: 235f827c-7116-48e9-84c5-0c9761c18e1e] Received unexpected event network-vif-plugged-b72a6c8b-7244-41c2-a4f7-6da43b4944b8 for instance with vm_state active and task_state deleting.
Apr 13 16:39:03 user nova-compute[71731]: INFO nova.compute.manager [None req-a17c6fd3-18bf-4d9c-894c-6b9e03d5976c tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: 235f827c-7116-48e9-84c5-0c9761c18e1e] Took 0.79 seconds to detach 1 volumes for instance.
Apr 13 16:39:03 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-a17c6fd3-18bf-4d9c-894c-6b9e03d5976c tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:39:03 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-a17c6fd3-18bf-4d9c-894c-6b9e03d5976c tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:39:03 user nova-compute[71731]: DEBUG nova.compute.provider_tree [None req-a17c6fd3-18bf-4d9c-894c-6b9e03d5976c tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Inventory has not changed in ProviderTree for provider: cb6b1a64-0c24-4e2d-af1e-16576ca9165c {{(pid=71731) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 16:39:03 user nova-compute[71731]: DEBUG nova.scheduler.client.report [None req-a17c6fd3-18bf-4d9c-894c-6b9e03d5976c tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Inventory has not changed for provider cb6b1a64-0c24-4e2d-af1e-16576ca9165c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71731) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 16:39:03 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-a17c6fd3-18bf-4d9c-894c-6b9e03d5976c tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.204s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:39:03 user nova-compute[71731]: INFO nova.scheduler.client.report [None req-a17c6fd3-18bf-4d9c-894c-6b9e03d5976c tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Deleted allocations for instance 235f827c-7116-48e9-84c5-0c9761c18e1e
Apr 13 16:39:03 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-a17c6fd3-18bf-4d9c-894c-6b9e03d5976c tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lock "235f827c-7116-48e9-84c5-0c9761c18e1e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.952s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:39:06 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:39:10 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:39:11 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:39:13 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:39:16 user nova-compute[71731]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681403941.6748748, 235f827c-7116-48e9-84c5-0c9761c18e1e => Stopped> {{(pid=71731) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 16:39:16 user nova-compute[71731]: INFO nova.compute.manager [-] [instance: 235f827c-7116-48e9-84c5-0c9761c18e1e] VM Stopped (Lifecycle Event)
Apr 13 16:39:16 user nova-compute[71731]: DEBUG nova.compute.manager [None req-92c74439-c278-469f-ab96-b9b6ae5fe678 None None] [instance: 235f827c-7116-48e9-84c5-0c9761c18e1e] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:39:16 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:39:17 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:39:18 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-9d4a75ff-7dc2-4ac0-9cdf-6a24e5eea006 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Acquiring lock "1f6a693f-0a99-434f-871d-f535b71229b9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:39:18 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-9d4a75ff-7dc2-4ac0-9cdf-6a24e5eea006 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lock "1f6a693f-0a99-434f-871d-f535b71229b9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:39:18 user nova-compute[71731]: DEBUG nova.compute.manager [None req-9d4a75ff-7dc2-4ac0-9cdf-6a24e5eea006 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] [instance: 1f6a693f-0a99-434f-871d-f535b71229b9] Starting instance... {{(pid=71731) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 16:39:18 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-9d4a75ff-7dc2-4ac0-9cdf-6a24e5eea006 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:39:18 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-9d4a75ff-7dc2-4ac0-9cdf-6a24e5eea006 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:39:18 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-9d4a75ff-7dc2-4ac0-9cdf-6a24e5eea006 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71731) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 16:39:18 user nova-compute[71731]: INFO nova.compute.claims [None req-9d4a75ff-7dc2-4ac0-9cdf-6a24e5eea006 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] [instance: 1f6a693f-0a99-434f-871d-f535b71229b9] Claim successful on node user
Apr 13 16:39:18 user nova-compute[71731]: DEBUG nova.compute.provider_tree [None req-9d4a75ff-7dc2-4ac0-9cdf-6a24e5eea006 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Inventory has not changed in ProviderTree for provider: cb6b1a64-0c24-4e2d-af1e-16576ca9165c {{(pid=71731) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 16:39:18 user nova-compute[71731]: DEBUG nova.scheduler.client.report [None req-9d4a75ff-7dc2-4ac0-9cdf-6a24e5eea006 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Inventory has not changed for provider cb6b1a64-0c24-4e2d-af1e-16576ca9165c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71731) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 16:39:18 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-9d4a75ff-7dc2-4ac0-9cdf-6a24e5eea006 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.263s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:39:18 user nova-compute[71731]: DEBUG nova.compute.manager [None req-9d4a75ff-7dc2-4ac0-9cdf-6a24e5eea006 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] [instance: 1f6a693f-0a99-434f-871d-f535b71229b9] Start building networks asynchronously for instance. {{(pid=71731) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 16:39:18 user nova-compute[71731]: DEBUG nova.compute.manager [None req-9d4a75ff-7dc2-4ac0-9cdf-6a24e5eea006 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] [instance: 1f6a693f-0a99-434f-871d-f535b71229b9] Allocating IP information in the background. {{(pid=71731) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 16:39:18 user nova-compute[71731]: DEBUG nova.network.neutron [None req-9d4a75ff-7dc2-4ac0-9cdf-6a24e5eea006 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] [instance: 1f6a693f-0a99-434f-871d-f535b71229b9] allocate_for_instance() {{(pid=71731) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 16:39:18 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-9d4a75ff-7dc2-4ac0-9cdf-6a24e5eea006 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] [instance: 1f6a693f-0a99-434f-871d-f535b71229b9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 16:39:18 user nova-compute[71731]: DEBUG nova.compute.manager [None req-9d4a75ff-7dc2-4ac0-9cdf-6a24e5eea006 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] [instance: 1f6a693f-0a99-434f-871d-f535b71229b9] Start building block device mappings for instance. {{(pid=71731) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 16:39:18 user nova-compute[71731]: DEBUG nova.policy [None req-9d4a75ff-7dc2-4ac0-9cdf-6a24e5eea006 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '48b4e972cd1049509fa899449961ab59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0653ab16660b46cea9c5af58ea0b1931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71731) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 16:39:18 user nova-compute[71731]: DEBUG nova.compute.manager [None req-9d4a75ff-7dc2-4ac0-9cdf-6a24e5eea006 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] [instance: 1f6a693f-0a99-434f-871d-f535b71229b9] Start spawning the instance on the hypervisor. {{(pid=71731) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 16:39:18 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-9d4a75ff-7dc2-4ac0-9cdf-6a24e5eea006 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] [instance: 1f6a693f-0a99-434f-871d-f535b71229b9] Creating instance directory {{(pid=71731) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 16:39:18 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-9d4a75ff-7dc2-4ac0-9cdf-6a24e5eea006 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] [instance: 1f6a693f-0a99-434f-871d-f535b71229b9] Creating image(s)
Apr 13 16:39:19 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-9d4a75ff-7dc2-4ac0-9cdf-6a24e5eea006 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Acquiring lock "/opt/stack/data/nova/instances/1f6a693f-0a99-434f-871d-f535b71229b9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:39:19 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-9d4a75ff-7dc2-4ac0-9cdf-6a24e5eea006 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lock "/opt/stack/data/nova/instances/1f6a693f-0a99-434f-871d-f535b71229b9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:39:19 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-9d4a75ff-7dc2-4ac0-9cdf-6a24e5eea006 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lock "/opt/stack/data/nova/instances/1f6a693f-0a99-434f-871d-f535b71229b9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:39:19 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-9d4a75ff-7dc2-4ac0-9cdf-6a24e5eea006 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279 --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:39:19 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-9d4a75ff-7dc2-4ac0-9cdf-6a24e5eea006 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279 --force-share --output=json" returned: 0 in 0.135s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:39:19 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-9d4a75ff-7dc2-4ac0-9cdf-6a24e5eea006 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Acquiring lock "9524227dd898575c3099d3976f096cd935414279" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:39:19 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-9d4a75ff-7dc2-4ac0-9cdf-6a24e5eea006 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lock "9524227dd898575c3099d3976f096cd935414279" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:39:19 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-9d4a75ff-7dc2-4ac0-9cdf-6a24e5eea006 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279 --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:39:19 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-9d4a75ff-7dc2-4ac0-9cdf-6a24e5eea006 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279 --force-share --output=json" returned: 0 in 0.129s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:39:19 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-9d4a75ff-7dc2-4ac0-9cdf-6a24e5eea006 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279,backing_fmt=raw /opt/stack/data/nova/instances/1f6a693f-0a99-434f-871d-f535b71229b9/disk 1073741824 {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:39:19 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-9d4a75ff-7dc2-4ac0-9cdf-6a24e5eea006 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279,backing_fmt=raw /opt/stack/data/nova/instances/1f6a693f-0a99-434f-871d-f535b71229b9/disk 1073741824" returned: 0 in 0.046s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:39:19 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-9d4a75ff-7dc2-4ac0-9cdf-6a24e5eea006 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lock "9524227dd898575c3099d3976f096cd935414279" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.182s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:39:19 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-9d4a75ff-7dc2-4ac0-9cdf-6a24e5eea006 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279 --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:39:19 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-9d4a75ff-7dc2-4ac0-9cdf-6a24e5eea006 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279 --force-share --output=json" returned: 0 in 0.133s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:39:19 user nova-compute[71731]: DEBUG nova.virt.disk.api [None req-9d4a75ff-7dc2-4ac0-9cdf-6a24e5eea006 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1f6a693f-0a99-434f-871d-f535b71229b9/disk. size=1073741824 {{(pid=71731) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 16:39:19 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-9d4a75ff-7dc2-4ac0-9cdf-6a24e5eea006 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f6a693f-0a99-434f-871d-f535b71229b9/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:39:19 user nova-compute[71731]: DEBUG nova.network.neutron [None req-9d4a75ff-7dc2-4ac0-9cdf-6a24e5eea006 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] [instance: 1f6a693f-0a99-434f-871d-f535b71229b9] Successfully created port: 103a0c68-ffc7-4460-836e-0de6c0272d84 {{(pid=71731) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 16:39:19 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-9d4a75ff-7dc2-4ac0-9cdf-6a24e5eea006 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f6a693f-0a99-434f-871d-f535b71229b9/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:39:19 user nova-compute[71731]: DEBUG nova.virt.disk.api [None req-9d4a75ff-7dc2-4ac0-9cdf-6a24e5eea006 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Cannot resize image /opt/stack/data/nova/instances/1f6a693f-0a99-434f-871d-f535b71229b9/disk to a smaller size. {{(pid=71731) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 16:39:19 user nova-compute[71731]: DEBUG nova.objects.instance [None req-9d4a75ff-7dc2-4ac0-9cdf-6a24e5eea006 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lazy-loading 'migration_context' on Instance uuid 1f6a693f-0a99-434f-871d-f535b71229b9 {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:39:19 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-9d4a75ff-7dc2-4ac0-9cdf-6a24e5eea006 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] [instance: 1f6a693f-0a99-434f-871d-f535b71229b9] Created local disks {{(pid=71731) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 16:39:19 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-9d4a75ff-7dc2-4ac0-9cdf-6a24e5eea006 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] [instance: 1f6a693f-0a99-434f-871d-f535b71229b9] Ensure instance console log exists: /opt/stack/data/nova/instances/1f6a693f-0a99-434f-871d-f535b71229b9/console.log {{(pid=71731) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 16:39:19 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-9d4a75ff-7dc2-4ac0-9cdf-6a24e5eea006 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:39:19 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-9d4a75ff-7dc2-4ac0-9cdf-6a24e5eea006 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:39:19 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-9d4a75ff-7dc2-4ac0-9cdf-6a24e5eea006 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:39:20 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager.update_available_resource {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:39:20 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:39:20 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:39:20 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:39:20 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Auditing locally available compute resources for user (node: user) {{(pid=71731) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 16:39:20 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66553f5-5e1b-4f1d-8c5a-63bc340f7586/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:39:20 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66553f5-5e1b-4f1d-8c5a-63bc340f7586/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:39:20 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66553f5-5e1b-4f1d-8c5a-63bc340f7586/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:39:20 user nova-compute[71731]: DEBUG nova.network.neutron [None req-9d4a75ff-7dc2-4ac0-9cdf-6a24e5eea006 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] [instance: 1f6a693f-0a99-434f-871d-f535b71229b9] Successfully updated port: 103a0c68-ffc7-4460-836e-0de6c0272d84 {{(pid=71731) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 16:39:20 user nova-compute[71731]: DEBUG nova.compute.manager [req-47e0b637-f3cc-4e46-8528-4cc8c069cc10 req-14e5d3f8-fb4d-454a-9073-6e142b811ae5 service nova] [instance: 1f6a693f-0a99-434f-871d-f535b71229b9] Received event network-changed-103a0c68-ffc7-4460-836e-0de6c0272d84 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:39:20 user nova-compute[71731]: DEBUG nova.compute.manager [req-47e0b637-f3cc-4e46-8528-4cc8c069cc10 req-14e5d3f8-fb4d-454a-9073-6e142b811ae5 service nova] [instance: 1f6a693f-0a99-434f-871d-f535b71229b9] Refreshing instance network info cache due to event network-changed-103a0c68-ffc7-4460-836e-0de6c0272d84. {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 16:39:20 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-47e0b637-f3cc-4e46-8528-4cc8c069cc10 req-14e5d3f8-fb4d-454a-9073-6e142b811ae5 service nova] Acquiring lock "refresh_cache-1f6a693f-0a99-434f-871d-f535b71229b9" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 16:39:20 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-47e0b637-f3cc-4e46-8528-4cc8c069cc10 req-14e5d3f8-fb4d-454a-9073-6e142b811ae5 service nova] Acquired lock "refresh_cache-1f6a693f-0a99-434f-871d-f535b71229b9" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 16:39:20 user nova-compute[71731]: DEBUG nova.network.neutron [req-47e0b637-f3cc-4e46-8528-4cc8c069cc10 req-14e5d3f8-fb4d-454a-9073-6e142b811ae5 service nova] [instance: 1f6a693f-0a99-434f-871d-f535b71229b9] Refreshing network info cache for port 103a0c68-ffc7-4460-836e-0de6c0272d84 {{(pid=71731) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 16:39:20 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-9d4a75ff-7dc2-4ac0-9cdf-6a24e5eea006 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Acquiring lock "refresh_cache-1f6a693f-0a99-434f-871d-f535b71229b9" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 16:39:20 user nova-compute[71731]: DEBUG nova.network.neutron [req-47e0b637-f3cc-4e46-8528-4cc8c069cc10 req-14e5d3f8-fb4d-454a-9073-6e142b811ae5 service nova] [instance: 1f6a693f-0a99-434f-871d-f535b71229b9] Instance cache missing network info. {{(pid=71731) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 16:39:20 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66553f5-5e1b-4f1d-8c5a-63bc340f7586/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:39:20 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ed800fe-577d-4624-898c-c7f40da77376/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:39:20 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ed800fe-577d-4624-898c-c7f40da77376/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:39:20 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ed800fe-577d-4624-898c-c7f40da77376/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:39:20 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ed800fe-577d-4624-898c-c7f40da77376/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:39:21 user nova-compute[71731]: DEBUG nova.network.neutron [req-47e0b637-f3cc-4e46-8528-4cc8c069cc10 req-14e5d3f8-fb4d-454a-9073-6e142b811ae5 service nova] [instance: 1f6a693f-0a99-434f-871d-f535b71229b9] Updating instance_info_cache with network_info: [] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:39:21 user nova-compute[71731]: WARNING nova.virt.libvirt.driver [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 16:39:21 user nova-compute[71731]: WARNING nova.virt.libvirt.driver [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 16:39:21 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Hypervisor/Node resource view: name=user free_ram=8521MB free_disk=26.120803833007812GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71731) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 16:39:21 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:39:21 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:39:21 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-47e0b637-f3cc-4e46-8528-4cc8c069cc10 req-14e5d3f8-fb4d-454a-9073-6e142b811ae5 service nova] Releasing lock "refresh_cache-1f6a693f-0a99-434f-871d-f535b71229b9" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 16:39:21 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-9d4a75ff-7dc2-4ac0-9cdf-6a24e5eea006 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Acquired lock "refresh_cache-1f6a693f-0a99-434f-871d-f535b71229b9" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 16:39:21 user nova-compute[71731]: DEBUG nova.network.neutron [None req-9d4a75ff-7dc2-4ac0-9cdf-6a24e5eea006 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] [instance: 1f6a693f-0a99-434f-871d-f535b71229b9] Building network info cache for instance {{(pid=71731) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 16:39:21 user nova-compute[71731]: DEBUG nova.network.neutron [None req-9d4a75ff-7dc2-4ac0-9cdf-6a24e5eea006 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] [instance: 1f6a693f-0a99-434f-871d-f535b71229b9] Instance cache missing network info. {{(pid=71731) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 16:39:21 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance f66553f5-5e1b-4f1d-8c5a-63bc340f7586 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 16:39:21 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance 5ed800fe-577d-4624-898c-c7f40da77376 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 16:39:21 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance 1f6a693f-0a99-434f-871d-f535b71229b9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 16:39:21 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=71731) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 16:39:21 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Final resource view: name=user phys_ram=16023MB used_ram=896MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=71731) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 16:39:21 user nova-compute[71731]: DEBUG nova.compute.provider_tree [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Inventory has not changed in ProviderTree for provider: cb6b1a64-0c24-4e2d-af1e-16576ca9165c {{(pid=71731) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 16:39:21 user nova-compute[71731]: DEBUG nova.scheduler.client.report [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Inventory has not changed for provider cb6b1a64-0c24-4e2d-af1e-16576ca9165c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71731) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 16:39:21 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Compute_service record updated for user:user {{(pid=71731) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 16:39:21 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.257s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:39:21 user nova-compute[71731]: DEBUG nova.network.neutron [None req-9d4a75ff-7dc2-4ac0-9cdf-6a24e5eea006 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] [instance: 1f6a693f-0a99-434f-871d-f535b71229b9] Updating instance_info_cache with network_info: [{"id": "103a0c68-ffc7-4460-836e-0de6c0272d84", "address": "fa:16:3e:f5:d0:dc", "network": {"id": "5acc9a78-1127-46df-bb60-7544cdd2c1ef", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2143082515-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0653ab16660b46cea9c5af58ea0b1931", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap103a0c68-ff", "ovs_interfaceid": "103a0c68-ffc7-4460-836e-0de6c0272d84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:39:21 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-9d4a75ff-7dc2-4ac0-9cdf-6a24e5eea006 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Releasing lock "refresh_cache-1f6a693f-0a99-434f-871d-f535b71229b9" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 16:39:21 user nova-compute[71731]: DEBUG nova.compute.manager [None req-9d4a75ff-7dc2-4ac0-9cdf-6a24e5eea006 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] [instance: 1f6a693f-0a99-434f-871d-f535b71229b9] Instance network_info: |[{"id": "103a0c68-ffc7-4460-836e-0de6c0272d84", "address": "fa:16:3e:f5:d0:dc", "network": {"id": "5acc9a78-1127-46df-bb60-7544cdd2c1ef", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2143082515-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0653ab16660b46cea9c5af58ea0b1931", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap103a0c68-ff", "ovs_interfaceid": "103a0c68-ffc7-4460-836e-0de6c0272d84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71731) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 16:39:21 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-9d4a75ff-7dc2-4ac0-9cdf-6a24e5eea006 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] [instance: 1f6a693f-0a99-434f-871d-f535b71229b9] Start _get_guest_xml network_info=[{"id": "103a0c68-ffc7-4460-836e-0de6c0272d84", "address": "fa:16:3e:f5:d0:dc", "network": {"id": "5acc9a78-1127-46df-bb60-7544cdd2c1ef", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2143082515-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0653ab16660b46cea9c5af58ea0b1931", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap103a0c68-ff", "ovs_interfaceid": "103a0c68-ffc7-4460-836e-0de6c0272d84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T16:16:31Z,direct_url=<?>,disk_format='qcow2',id=708622a9-7465-4492-ade8-b827198f7e30,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='0b29a975c552465aba0ac7d6288434bd',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T16:16:33Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'device_type': 'disk', 'encrypted': False, 'disk_bus': 'virtio', 'guest_format': None, 'encryption_options': None, 'image_id': '708622a9-7465-4492-ade8-b827198f7e30'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71731) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 16:39:21 user nova-compute[71731]: WARNING nova.virt.libvirt.driver [None req-9d4a75ff-7dc2-4ac0-9cdf-6a24e5eea006 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 16:39:21 user nova-compute[71731]: WARNING nova.virt.libvirt.driver [None req-9d4a75ff-7dc2-4ac0-9cdf-6a24e5eea006 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 16:39:21 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-9d4a75ff-7dc2-4ac0-9cdf-6a24e5eea006 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71731) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 16:39:21 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-9d4a75ff-7dc2-4ac0-9cdf-6a24e5eea006 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T16:17:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T16:16:31Z,direct_url=<?>,disk_format='qcow2',id=708622a9-7465-4492-ade8-b827198f7e30,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='0b29a975c552465aba0ac7d6288434bd',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T16:16:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 16:39:21 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-9d4a75ff-7dc2-4ac0-9cdf-6a24e5eea006 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Flavor limits 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 16:39:21 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-9d4a75ff-7dc2-4ac0-9cdf-6a24e5eea006 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Image limits 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 16:39:21 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-9d4a75ff-7dc2-4ac0-9cdf-6a24e5eea006 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Flavor pref 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 16:39:21 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-9d4a75ff-7dc2-4ac0-9cdf-6a24e5eea006 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Image pref 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 16:39:21 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-9d4a75ff-7dc2-4ac0-9cdf-6a24e5eea006 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 16:39:21 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-9d4a75ff-7dc2-4ac0-9cdf-6a24e5eea006 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 16:39:21 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-9d4a75ff-7dc2-4ac0-9cdf-6a24e5eea006 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71731) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 16:39:21 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-9d4a75ff-7dc2-4ac0-9cdf-6a24e5eea006 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Got 1 possible topologies {{(pid=71731) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 16:39:21 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-9d4a75ff-7dc2-4ac0-9cdf-6a24e5eea006 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 16:39:21 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-9d4a75ff-7dc2-4ac0-9cdf-6a24e5eea006 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 16:39:21 user nova-compute[71731]: DEBUG nova.virt.libvirt.vif [None req-9d4a75ff-7dc2-4ac0-9cdf-6a24e5eea006 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T16:39:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-152363829',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-152363829',id=34,image_ref='708622a9-7465-4492-ade8-b827198f7e30',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEMeM+1/KnPrfHwYC3u+Lcza7snpR0t1GJvUaC1TzWStqRV08H+ksCdHvKc+nMr3bT0XCZGDg/vhmXMFwe7jGl2nfjwDh9ruSgNXBv0ppZMEtKuFitRCX7rOQL8v9bZcKA==',key_name='tempest-keypair-707123723',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0653ab16660b46cea9c5af58ea0b1931',ramdisk_id='',reservation_id='r-nynwey78',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='708622a9-7465-4492-ade8-b827198f7e30',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1310775310',owner_user_name='tempest-AttachVolumeShelveTestJSON-1310775310-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T16:39:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='48b4e972cd1049509fa899449961ab59',uuid=1f6a693f-0a99-434f-871d-f535b71229b9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "103a0c68-ffc7-4460-836e-0de6c0272d84", "address": "fa:16:3e:f5:d0:dc", "network": {"id": "5acc9a78-1127-46df-bb60-7544cdd2c1ef", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2143082515-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0653ab16660b46cea9c5af58ea0b1931", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap103a0c68-ff", "ovs_interfaceid": "103a0c68-ffc7-4460-836e-0de6c0272d84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71731) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 16:39:21 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-9d4a75ff-7dc2-4ac0-9cdf-6a24e5eea006 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Converting VIF {"id": "103a0c68-ffc7-4460-836e-0de6c0272d84", "address": "fa:16:3e:f5:d0:dc", "network": {"id": "5acc9a78-1127-46df-bb60-7544cdd2c1ef", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2143082515-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0653ab16660b46cea9c5af58ea0b1931", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap103a0c68-ff", "ovs_interfaceid": "103a0c68-ffc7-4460-836e-0de6c0272d84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 16:39:21 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-9d4a75ff-7dc2-4ac0-9cdf-6a24e5eea006 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:d0:dc,bridge_name='br-int',has_traffic_filtering=True,id=103a0c68-ffc7-4460-836e-0de6c0272d84,network=Network(5acc9a78-1127-46df-bb60-7544cdd2c1ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap103a0c68-ff') {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 16:39:21 user nova-compute[71731]: DEBUG nova.objects.instance [None req-9d4a75ff-7dc2-4ac0-9cdf-6a24e5eea006 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lazy-loading 'pci_devices' on Instance uuid 1f6a693f-0a99-434f-871d-f535b71229b9 {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:39:21 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-9d4a75ff-7dc2-4ac0-9cdf-6a24e5eea006 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] [instance: 1f6a693f-0a99-434f-871d-f535b71229b9] End _get_guest_xml xml=<domain type="kvm">
Apr 13 16:39:21 user nova-compute[71731]:   <uuid>1f6a693f-0a99-434f-871d-f535b71229b9</uuid>
Apr 13 16:39:21 user nova-compute[71731]:   <name>instance-00000022</name>
Apr 13 16:39:21 user nova-compute[71731]:   <memory>131072</memory>
Apr 13 16:39:21 user nova-compute[71731]:   <vcpu>1</vcpu>
Apr 13 16:39:21 user nova-compute[71731]:   <metadata>
Apr 13 16:39:21 user nova-compute[71731]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 16:39:21 user nova-compute[71731]:       <nova:package version="0.0.0"/>
Apr 13 16:39:21 user nova-compute[71731]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-152363829</nova:name>
Apr 13 16:39:21 user nova-compute[71731]:       <nova:creationTime>2023-04-13 16:39:21</nova:creationTime>
Apr 13 16:39:21 user nova-compute[71731]:       <nova:flavor name="m1.nano">
Apr 13 16:39:21 user nova-compute[71731]:         <nova:memory>128</nova:memory>
Apr 13 16:39:21 user nova-compute[71731]:         <nova:disk>1</nova:disk>
Apr 13 16:39:21 user nova-compute[71731]:         <nova:swap>0</nova:swap>
Apr 13 16:39:21 user nova-compute[71731]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 16:39:21 user nova-compute[71731]:         <nova:vcpus>1</nova:vcpus>
Apr 13 16:39:21 user nova-compute[71731]:       </nova:flavor>
Apr 13 16:39:21 user nova-compute[71731]:       <nova:owner>
Apr 13 16:39:21 user nova-compute[71731]:         <nova:user uuid="48b4e972cd1049509fa899449961ab59">tempest-AttachVolumeShelveTestJSON-1310775310-project-member</nova:user>
Apr 13 16:39:21 user nova-compute[71731]:         <nova:project uuid="0653ab16660b46cea9c5af58ea0b1931">tempest-AttachVolumeShelveTestJSON-1310775310</nova:project>
Apr 13 16:39:21 user nova-compute[71731]:       </nova:owner>
Apr 13 16:39:21 user nova-compute[71731]:       <nova:root type="image" uuid="708622a9-7465-4492-ade8-b827198f7e30"/>
Apr 13 16:39:21 user nova-compute[71731]:       <nova:ports>
Apr 13 16:39:21 user nova-compute[71731]:         <nova:port uuid="103a0c68-ffc7-4460-836e-0de6c0272d84">
Apr 13 16:39:21 user nova-compute[71731]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Apr 13 16:39:21 user nova-compute[71731]:         </nova:port>
Apr 13 16:39:21 user nova-compute[71731]:       </nova:ports>
Apr 13 16:39:21 user nova-compute[71731]:     </nova:instance>
Apr 13 16:39:21 user nova-compute[71731]:   </metadata>
Apr 13 16:39:21 user nova-compute[71731]:   <sysinfo type="smbios">
Apr 13 16:39:21 user nova-compute[71731]:     <system>
Apr 13 16:39:21 user nova-compute[71731]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 16:39:21 user nova-compute[71731]:       <entry name="product">OpenStack Nova</entry>
Apr 13 16:39:21 user nova-compute[71731]:       <entry name="version">0.0.0</entry>
Apr 13 16:39:21 user nova-compute[71731]:       <entry name="serial">1f6a693f-0a99-434f-871d-f535b71229b9</entry>
Apr 13 16:39:21 user nova-compute[71731]:       <entry name="uuid">1f6a693f-0a99-434f-871d-f535b71229b9</entry>
Apr 13 16:39:21 user nova-compute[71731]:       <entry name="family">Virtual Machine</entry>
Apr 13 16:39:21 user nova-compute[71731]:     </system>
Apr 13 16:39:21 user nova-compute[71731]:   </sysinfo>
Apr 13 16:39:21 user nova-compute[71731]:   <os>
Apr 13 16:39:21 user nova-compute[71731]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 16:39:21 user nova-compute[71731]:     <boot dev="hd"/>
Apr 13 16:39:21 user nova-compute[71731]:     <smbios mode="sysinfo"/>
Apr 13 16:39:21 user nova-compute[71731]:   </os>
Apr 13 16:39:21 user nova-compute[71731]:   <features>
Apr 13 16:39:21 user nova-compute[71731]:     <acpi/>
Apr 13 16:39:21 user nova-compute[71731]:     <apic/>
Apr 13 16:39:21 user nova-compute[71731]:     <vmcoreinfo/>
Apr 13 16:39:21 user nova-compute[71731]:   </features>
Apr 13 16:39:21 user nova-compute[71731]:   <clock offset="utc">
Apr 13 16:39:21 user nova-compute[71731]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 16:39:21 user nova-compute[71731]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 16:39:21 user nova-compute[71731]:     <timer name="hpet" present="no"/>
Apr 13 16:39:21 user nova-compute[71731]:   </clock>
Apr 13 16:39:21 user nova-compute[71731]:   <cpu mode="custom" match="exact">
Apr 13 16:39:21 user nova-compute[71731]:     <model>Nehalem</model>
Apr 13 16:39:21 user nova-compute[71731]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 16:39:21 user nova-compute[71731]:   </cpu>
Apr 13 16:39:21 user nova-compute[71731]:   <devices>
Apr 13 16:39:21 user nova-compute[71731]:     <disk type="file" device="disk">
Apr 13 16:39:21 user nova-compute[71731]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 16:39:21 user nova-compute[71731]:       <source file="/opt/stack/data/nova/instances/1f6a693f-0a99-434f-871d-f535b71229b9/disk"/>
Apr 13 16:39:21 user nova-compute[71731]:       <target dev="vda" bus="virtio"/>
Apr 13 16:39:21 user nova-compute[71731]:     </disk>
Apr 13 16:39:21 user nova-compute[71731]:     <interface type="ethernet">
Apr 13 16:39:21 user nova-compute[71731]:       <mac address="fa:16:3e:f5:d0:dc"/>
Apr 13 16:39:21 user nova-compute[71731]:       <model type="virtio"/>
Apr 13 16:39:21 user nova-compute[71731]:       <mtu size="1442"/>
Apr 13 16:39:21 user nova-compute[71731]:       <target dev="tap103a0c68-ff"/>
Apr 13 16:39:21 user nova-compute[71731]:     </interface>
Apr 13 16:39:21 user nova-compute[71731]:     <serial type="pty">
Apr 13 16:39:21 user nova-compute[71731]:       <log file="/opt/stack/data/nova/instances/1f6a693f-0a99-434f-871d-f535b71229b9/console.log" append="off"/>
Apr 13 16:39:21 user nova-compute[71731]:     </serial>
Apr 13 16:39:21 user nova-compute[71731]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 16:39:21 user nova-compute[71731]:     <video>
Apr 13 16:39:21 user nova-compute[71731]:       <model type="virtio"/>
Apr 13 16:39:21 user nova-compute[71731]:     </video>
Apr 13 16:39:21 user nova-compute[71731]:     <rng model="virtio">
Apr 13 16:39:21 user nova-compute[71731]:       <backend model="random">/dev/urandom</backend>
Apr 13 16:39:21 user nova-compute[71731]:     </rng>
Apr 13 16:39:21 user nova-compute[71731]:     <controller type="usb" index="0" model="none"/>
Apr 13 16:39:21 user nova-compute[71731]:     <memballoon model="virtio">
Apr 13 16:39:21 user nova-compute[71731]:       <stats period="10"/>
Apr 13 16:39:21 user nova-compute[71731]:     </memballoon>
Apr 13 16:39:21 user nova-compute[71731]:   </devices>
Apr 13 16:39:21 user nova-compute[71731]: </domain>
Apr 13 16:39:21 user nova-compute[71731]:  {{(pid=71731) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 16:39:21 user nova-compute[71731]: DEBUG nova.virt.libvirt.vif [None req-9d4a75ff-7dc2-4ac0-9cdf-6a24e5eea006 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T16:39:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-152363829',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-152363829',id=34,image_ref='708622a9-7465-4492-ade8-b827198f7e30',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEMeM+1/KnPrfHwYC3u+Lcza7snpR0t1GJvUaC1TzWStqRV08H+ksCdHvKc+nMr3bT0XCZGDg/vhmXMFwe7jGl2nfjwDh9ruSgNXBv0ppZMEtKuFitRCX7rOQL8v9bZcKA==',key_name='tempest-keypair-707123723',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0653ab16660b46cea9c5af58ea0b1931',ramdisk_id='',reservation_id='r-nynwey78',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='708622a9-7465-4492-ade8-b827198f7e30',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1310775310',owner_user_name='tempest-AttachVolumeShelveTestJSON-1310775310-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T16:39:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='48b4e972cd1049509fa899449961ab59',uuid=1f6a693f-0a99-434f-871d-f535b71229b9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "103a0c68-ffc7-4460-836e-0de6c0272d84", "address": "fa:16:3e:f5:d0:dc", "network": {"id": "5acc9a78-1127-46df-bb60-7544cdd2c1ef", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2143082515-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0653ab16660b46cea9c5af58ea0b1931", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap103a0c68-ff", "ovs_interfaceid": "103a0c68-ffc7-4460-836e-0de6c0272d84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 16:39:21 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-9d4a75ff-7dc2-4ac0-9cdf-6a24e5eea006 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Converting VIF {"id": "103a0c68-ffc7-4460-836e-0de6c0272d84", "address": "fa:16:3e:f5:d0:dc", "network": {"id": "5acc9a78-1127-46df-bb60-7544cdd2c1ef", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2143082515-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0653ab16660b46cea9c5af58ea0b1931", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap103a0c68-ff", "ovs_interfaceid": "103a0c68-ffc7-4460-836e-0de6c0272d84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 16:39:21 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-9d4a75ff-7dc2-4ac0-9cdf-6a24e5eea006 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:d0:dc,bridge_name='br-int',has_traffic_filtering=True,id=103a0c68-ffc7-4460-836e-0de6c0272d84,network=Network(5acc9a78-1127-46df-bb60-7544cdd2c1ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap103a0c68-ff') {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 16:39:21 user nova-compute[71731]: DEBUG os_vif [None req-9d4a75ff-7dc2-4ac0-9cdf-6a24e5eea006 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:d0:dc,bridge_name='br-int',has_traffic_filtering=True,id=103a0c68-ffc7-4460-836e-0de6c0272d84,network=Network(5acc9a78-1127-46df-bb60-7544cdd2c1ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap103a0c68-ff') {{(pid=71731) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 16:39:21 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:39:21 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:39:21 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 16:39:21 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:39:21 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap103a0c68-ff, may_exist=True) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:39:21 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap103a0c68-ff, col_values=(('external_ids', {'iface-id': '103a0c68-ffc7-4460-836e-0de6c0272d84', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f5:d0:dc', 'vm-uuid': '1f6a693f-0a99-434f-871d-f535b71229b9'}),)) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:39:21 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:39:21 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 16:39:21 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:39:21 user nova-compute[71731]: INFO os_vif [None req-9d4a75ff-7dc2-4ac0-9cdf-6a24e5eea006 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:d0:dc,bridge_name='br-int',has_traffic_filtering=True,id=103a0c68-ffc7-4460-836e-0de6c0272d84,network=Network(5acc9a78-1127-46df-bb60-7544cdd2c1ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap103a0c68-ff')
Apr 13 16:39:21 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-9d4a75ff-7dc2-4ac0-9cdf-6a24e5eea006 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] No BDM found with device name vda, not building metadata. {{(pid=71731) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 16:39:21 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-9d4a75ff-7dc2-4ac0-9cdf-6a24e5eea006 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] No VIF found with MAC fa:16:3e:f5:d0:dc, not building metadata {{(pid=71731) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 16:39:22 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:39:22 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:39:22 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:39:22 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:39:23 user nova-compute[71731]: DEBUG nova.compute.manager [req-77f907ab-2ff7-4103-ac1f-ce81eda6cc53 req-769706ea-6420-4c8f-9670-7da1aa1b9885 service nova] [instance: 1f6a693f-0a99-434f-871d-f535b71229b9] Received event network-vif-plugged-103a0c68-ffc7-4460-836e-0de6c0272d84 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:39:23 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-77f907ab-2ff7-4103-ac1f-ce81eda6cc53 req-769706ea-6420-4c8f-9670-7da1aa1b9885 service nova] Acquiring lock "1f6a693f-0a99-434f-871d-f535b71229b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:39:23 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-77f907ab-2ff7-4103-ac1f-ce81eda6cc53 req-769706ea-6420-4c8f-9670-7da1aa1b9885 service nova] Lock "1f6a693f-0a99-434f-871d-f535b71229b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:39:23 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-77f907ab-2ff7-4103-ac1f-ce81eda6cc53 req-769706ea-6420-4c8f-9670-7da1aa1b9885 service nova] Lock "1f6a693f-0a99-434f-871d-f535b71229b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:39:23 user nova-compute[71731]: DEBUG nova.compute.manager [req-77f907ab-2ff7-4103-ac1f-ce81eda6cc53 req-769706ea-6420-4c8f-9670-7da1aa1b9885 service nova] [instance: 1f6a693f-0a99-434f-871d-f535b71229b9] No waiting events found dispatching network-vif-plugged-103a0c68-ffc7-4460-836e-0de6c0272d84 {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:39:23 user nova-compute[71731]: WARNING nova.compute.manager [req-77f907ab-2ff7-4103-ac1f-ce81eda6cc53 req-769706ea-6420-4c8f-9670-7da1aa1b9885 service nova] [instance: 1f6a693f-0a99-434f-871d-f535b71229b9] Received unexpected event network-vif-plugged-103a0c68-ffc7-4460-836e-0de6c0272d84 for instance with vm_state building and task_state spawning.
Apr 13 16:39:23 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:39:23 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:39:23 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71731) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 16:39:23 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:39:23 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:39:23 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:39:23 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:39:25 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:39:25 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Starting heal instance info cache {{(pid=71731) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 16:39:25 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Acquiring lock "refresh_cache-5ed800fe-577d-4624-898c-c7f40da77376" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 16:39:25 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Acquired lock "refresh_cache-5ed800fe-577d-4624-898c-c7f40da77376" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 16:39:25 user nova-compute[71731]: DEBUG nova.network.neutron [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] [instance: 5ed800fe-577d-4624-898c-c7f40da77376] Forcefully refreshing network info cache for instance {{(pid=71731) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 16:39:25 user nova-compute[71731]: DEBUG nova.virt.driver [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Emitting event <LifecycleEvent: 1681403965.1301258, 1f6a693f-0a99-434f-871d-f535b71229b9 => Resumed> {{(pid=71731) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 16:39:25 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 1f6a693f-0a99-434f-871d-f535b71229b9] VM Resumed (Lifecycle Event)
Apr 13 16:39:25 user nova-compute[71731]: DEBUG nova.compute.manager [None req-9d4a75ff-7dc2-4ac0-9cdf-6a24e5eea006 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] [instance: 1f6a693f-0a99-434f-871d-f535b71229b9] Instance event wait completed in 0 seconds for  {{(pid=71731) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 16:39:25 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-9d4a75ff-7dc2-4ac0-9cdf-6a24e5eea006 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] [instance: 1f6a693f-0a99-434f-871d-f535b71229b9] Guest created on hypervisor {{(pid=71731) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 16:39:25 user nova-compute[71731]: INFO nova.virt.libvirt.driver [-] [instance: 1f6a693f-0a99-434f-871d-f535b71229b9] Instance spawned successfully.
Apr 13 16:39:25 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-9d4a75ff-7dc2-4ac0-9cdf-6a24e5eea006 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] [instance: 1f6a693f-0a99-434f-871d-f535b71229b9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 16:39:25 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 1f6a693f-0a99-434f-871d-f535b71229b9] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:39:25 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 1f6a693f-0a99-434f-871d-f535b71229b9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71731) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 16:39:25 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-9d4a75ff-7dc2-4ac0-9cdf-6a24e5eea006 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] [instance: 1f6a693f-0a99-434f-871d-f535b71229b9] Found default for hw_cdrom_bus of ide {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:39:25 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-9d4a75ff-7dc2-4ac0-9cdf-6a24e5eea006 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] [instance: 1f6a693f-0a99-434f-871d-f535b71229b9] Found default for hw_disk_bus of virtio {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:39:25 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-9d4a75ff-7dc2-4ac0-9cdf-6a24e5eea006 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] [instance: 1f6a693f-0a99-434f-871d-f535b71229b9] Found default for hw_input_bus of None {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:39:25 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-9d4a75ff-7dc2-4ac0-9cdf-6a24e5eea006 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] [instance: 1f6a693f-0a99-434f-871d-f535b71229b9] Found default for hw_pointer_model of None {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:39:25 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-9d4a75ff-7dc2-4ac0-9cdf-6a24e5eea006 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] [instance: 1f6a693f-0a99-434f-871d-f535b71229b9] Found default for hw_video_model of virtio {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:39:25 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-9d4a75ff-7dc2-4ac0-9cdf-6a24e5eea006 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] [instance: 1f6a693f-0a99-434f-871d-f535b71229b9] Found default for hw_vif_model of virtio {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:39:25 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 1f6a693f-0a99-434f-871d-f535b71229b9] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 16:39:25 user nova-compute[71731]: DEBUG nova.virt.driver [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Emitting event <LifecycleEvent: 1681403965.130772, 1f6a693f-0a99-434f-871d-f535b71229b9 => Started> {{(pid=71731) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 16:39:25 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 1f6a693f-0a99-434f-871d-f535b71229b9] VM Started (Lifecycle Event)
Apr 13 16:39:25 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 1f6a693f-0a99-434f-871d-f535b71229b9] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:39:25 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 1f6a693f-0a99-434f-871d-f535b71229b9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71731) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 16:39:25 user nova-compute[71731]: DEBUG nova.compute.manager [req-63b6c2f3-14d2-4fb3-a9b8-7f288e81a3ed req-2ca5b6e1-1f5f-4fc0-94a5-8274b311197a service nova] [instance: 1f6a693f-0a99-434f-871d-f535b71229b9] Received event network-vif-plugged-103a0c68-ffc7-4460-836e-0de6c0272d84 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:39:25 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-63b6c2f3-14d2-4fb3-a9b8-7f288e81a3ed req-2ca5b6e1-1f5f-4fc0-94a5-8274b311197a service nova] Acquiring lock "1f6a693f-0a99-434f-871d-f535b71229b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:39:25 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-63b6c2f3-14d2-4fb3-a9b8-7f288e81a3ed req-2ca5b6e1-1f5f-4fc0-94a5-8274b311197a service nova] Lock "1f6a693f-0a99-434f-871d-f535b71229b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:39:25 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-63b6c2f3-14d2-4fb3-a9b8-7f288e81a3ed req-2ca5b6e1-1f5f-4fc0-94a5-8274b311197a service nova] Lock "1f6a693f-0a99-434f-871d-f535b71229b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:39:25 user nova-compute[71731]: DEBUG nova.compute.manager [req-63b6c2f3-14d2-4fb3-a9b8-7f288e81a3ed req-2ca5b6e1-1f5f-4fc0-94a5-8274b311197a service nova] [instance: 1f6a693f-0a99-434f-871d-f535b71229b9] No waiting events found dispatching network-vif-plugged-103a0c68-ffc7-4460-836e-0de6c0272d84 {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:39:25 user nova-compute[71731]: WARNING nova.compute.manager [req-63b6c2f3-14d2-4fb3-a9b8-7f288e81a3ed req-2ca5b6e1-1f5f-4fc0-94a5-8274b311197a service nova] [instance: 1f6a693f-0a99-434f-871d-f535b71229b9] Received unexpected event network-vif-plugged-103a0c68-ffc7-4460-836e-0de6c0272d84 for instance with vm_state building and task_state spawning.
Apr 13 16:39:25 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 1f6a693f-0a99-434f-871d-f535b71229b9] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 16:39:25 user nova-compute[71731]: INFO nova.compute.manager [None req-9d4a75ff-7dc2-4ac0-9cdf-6a24e5eea006 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] [instance: 1f6a693f-0a99-434f-871d-f535b71229b9] Took 6.28 seconds to spawn the instance on the hypervisor.
Apr 13 16:39:25 user nova-compute[71731]: DEBUG nova.compute.manager [None req-9d4a75ff-7dc2-4ac0-9cdf-6a24e5eea006 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] [instance: 1f6a693f-0a99-434f-871d-f535b71229b9] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:39:25 user nova-compute[71731]: INFO nova.compute.manager [None req-9d4a75ff-7dc2-4ac0-9cdf-6a24e5eea006 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] [instance: 1f6a693f-0a99-434f-871d-f535b71229b9] Took 7.19 seconds to build instance.
Apr 13 16:39:25 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-9d4a75ff-7dc2-4ac0-9cdf-6a24e5eea006 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lock "1f6a693f-0a99-434f-871d-f535b71229b9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.295s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:39:25 user nova-compute[71731]: DEBUG nova.network.neutron [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] [instance: 5ed800fe-577d-4624-898c-c7f40da77376] Updating instance_info_cache with network_info: [{"id": "09531419-c0ff-4d13-89bd-06caa28e019d", "address": "fa:16:3e:13:b1:31", "network": {"id": "cf1fef97-9ef1-449f-a302-b38110024547", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1138167711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "980559734a504574a83224deb7423c77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09531419-c0", "ovs_interfaceid": "09531419-c0ff-4d13-89bd-06caa28e019d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:39:25 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Releasing lock "refresh_cache-5ed800fe-577d-4624-898c-c7f40da77376" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 16:39:25 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] [instance: 5ed800fe-577d-4624-898c-c7f40da77376] Updated the network info_cache for instance {{(pid=71731) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 16:39:26 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:39:26 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:39:27 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:39:27 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:39:28 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:39:30 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:39:31 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:39:36 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:39:41 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 16:39:41 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:39:41 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71731) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 16:39:41 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71731) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 16:39:41 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71731) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 16:39:41 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:39:42 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:39:46 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:39:47 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:39:51 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:39:51 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-bbb14a00-e67d-438f-901b-0ab20dfba5ae tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Acquiring lock "f66553f5-5e1b-4f1d-8c5a-63bc340f7586" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:39:51 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-bbb14a00-e67d-438f-901b-0ab20dfba5ae tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lock "f66553f5-5e1b-4f1d-8c5a-63bc340f7586" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:39:51 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-bbb14a00-e67d-438f-901b-0ab20dfba5ae tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Acquiring lock "f66553f5-5e1b-4f1d-8c5a-63bc340f7586-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:39:51 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-bbb14a00-e67d-438f-901b-0ab20dfba5ae tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lock "f66553f5-5e1b-4f1d-8c5a-63bc340f7586-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:39:51 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-bbb14a00-e67d-438f-901b-0ab20dfba5ae tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lock "f66553f5-5e1b-4f1d-8c5a-63bc340f7586-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:39:51 user nova-compute[71731]: INFO nova.compute.manager [None req-bbb14a00-e67d-438f-901b-0ab20dfba5ae tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: f66553f5-5e1b-4f1d-8c5a-63bc340f7586] Terminating instance
Apr 13 16:39:51 user nova-compute[71731]: DEBUG nova.compute.manager [None req-bbb14a00-e67d-438f-901b-0ab20dfba5ae tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: f66553f5-5e1b-4f1d-8c5a-63bc340f7586] Start destroying the instance on the hypervisor. {{(pid=71731) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 16:39:51 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:39:51 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:39:51 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:39:51 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:39:52 user nova-compute[71731]: DEBUG nova.compute.manager [req-9347a1e7-226a-48f5-82d1-d97d8651af6e req-a6be8187-4560-42c8-a054-e53592ed3bc1 service nova] [instance: f66553f5-5e1b-4f1d-8c5a-63bc340f7586] Received event network-vif-unplugged-27d05b76-8556-4365-9050-6bf871e85502 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:39:52 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-9347a1e7-226a-48f5-82d1-d97d8651af6e req-a6be8187-4560-42c8-a054-e53592ed3bc1 service nova] Acquiring lock "f66553f5-5e1b-4f1d-8c5a-63bc340f7586-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:39:52 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-9347a1e7-226a-48f5-82d1-d97d8651af6e req-a6be8187-4560-42c8-a054-e53592ed3bc1 service nova] Lock "f66553f5-5e1b-4f1d-8c5a-63bc340f7586-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:39:52 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-9347a1e7-226a-48f5-82d1-d97d8651af6e req-a6be8187-4560-42c8-a054-e53592ed3bc1 service nova] Lock "f66553f5-5e1b-4f1d-8c5a-63bc340f7586-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:39:52 user nova-compute[71731]: DEBUG nova.compute.manager [req-9347a1e7-226a-48f5-82d1-d97d8651af6e req-a6be8187-4560-42c8-a054-e53592ed3bc1 service nova] [instance: f66553f5-5e1b-4f1d-8c5a-63bc340f7586] No waiting events found dispatching network-vif-unplugged-27d05b76-8556-4365-9050-6bf871e85502 {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:39:52 user nova-compute[71731]: DEBUG nova.compute.manager [req-9347a1e7-226a-48f5-82d1-d97d8651af6e req-a6be8187-4560-42c8-a054-e53592ed3bc1 service nova] [instance: f66553f5-5e1b-4f1d-8c5a-63bc340f7586] Received event network-vif-unplugged-27d05b76-8556-4365-9050-6bf871e85502 for instance with task_state deleting. {{(pid=71731) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 16:39:52 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:39:52 user nova-compute[71731]: INFO nova.virt.libvirt.driver [-] [instance: f66553f5-5e1b-4f1d-8c5a-63bc340f7586] Instance destroyed successfully.
Apr 13 16:39:52 user nova-compute[71731]: DEBUG nova.objects.instance [None req-bbb14a00-e67d-438f-901b-0ab20dfba5ae tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lazy-loading 'resources' on Instance uuid f66553f5-5e1b-4f1d-8c5a-63bc340f7586 {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:39:52 user nova-compute[71731]: DEBUG nova.virt.libvirt.vif [None req-bbb14a00-e67d-438f-901b-0ab20dfba5ae tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T16:20:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1790980626',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1790980626',id=2,image_ref='708622a9-7465-4492-ade8-b827198f7e30',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-13T16:20:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b2d09a74bf684a9fb1dd1e95d6c23f3c',ramdisk_id='',reservation_id='r-z7buh83w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='708622a9-7465-4492-ade8-b827198f7e30',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1960261099',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T16:22:13Z,user_data=None,user_id='e45a882dbafb4ea4976e4f45289eb2b8',uuid=f66553f5-5e1b-4f1d-8c5a-63bc340f7586,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "27d05b76-8556-4365-9050-6bf871e85502", "address": "fa:16:3e:0d:13:8a", "network": {"id": "5a7877ff-8230-470b-90b5-e5dcfc8f0cee", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-779403873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2d09a74bf684a9fb1dd1e95d6c23f3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27d05b76-85", "ovs_interfaceid": "27d05b76-8556-4365-9050-6bf871e85502", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 16:39:52 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-bbb14a00-e67d-438f-901b-0ab20dfba5ae tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Converting VIF {"id": "27d05b76-8556-4365-9050-6bf871e85502", "address": "fa:16:3e:0d:13:8a", "network": {"id": "5a7877ff-8230-470b-90b5-e5dcfc8f0cee", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-779403873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2d09a74bf684a9fb1dd1e95d6c23f3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27d05b76-85", "ovs_interfaceid": "27d05b76-8556-4365-9050-6bf871e85502", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 16:39:52 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-bbb14a00-e67d-438f-901b-0ab20dfba5ae tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0d:13:8a,bridge_name='br-int',has_traffic_filtering=True,id=27d05b76-8556-4365-9050-6bf871e85502,network=Network(5a7877ff-8230-470b-90b5-e5dcfc8f0cee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27d05b76-85') {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 16:39:52 user nova-compute[71731]: DEBUG os_vif [None req-bbb14a00-e67d-438f-901b-0ab20dfba5ae tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0d:13:8a,bridge_name='br-int',has_traffic_filtering=True,id=27d05b76-8556-4365-9050-6bf871e85502,network=Network(5a7877ff-8230-470b-90b5-e5dcfc8f0cee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27d05b76-85') {{(pid=71731) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 16:39:52 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:39:52 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap27d05b76-85, bridge=br-int, if_exists=True) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:39:52 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:39:52 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 16:39:52 user nova-compute[71731]: INFO os_vif [None req-bbb14a00-e67d-438f-901b-0ab20dfba5ae tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0d:13:8a,bridge_name='br-int',has_traffic_filtering=True,id=27d05b76-8556-4365-9050-6bf871e85502,network=Network(5a7877ff-8230-470b-90b5-e5dcfc8f0cee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27d05b76-85')
Apr 13 16:39:52 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-bbb14a00-e67d-438f-901b-0ab20dfba5ae tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: f66553f5-5e1b-4f1d-8c5a-63bc340f7586] Deleting instance files /opt/stack/data/nova/instances/f66553f5-5e1b-4f1d-8c5a-63bc340f7586_del
Apr 13 16:39:52 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-bbb14a00-e67d-438f-901b-0ab20dfba5ae tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: f66553f5-5e1b-4f1d-8c5a-63bc340f7586] Deletion of /opt/stack/data/nova/instances/f66553f5-5e1b-4f1d-8c5a-63bc340f7586_del complete
Apr 13 16:39:52 user nova-compute[71731]: INFO nova.compute.manager [None req-bbb14a00-e67d-438f-901b-0ab20dfba5ae tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] [instance: f66553f5-5e1b-4f1d-8c5a-63bc340f7586] Took 0.84 seconds to destroy the instance on the hypervisor.
Apr 13 16:39:52 user nova-compute[71731]: DEBUG oslo.service.loopingcall [None req-bbb14a00-e67d-438f-901b-0ab20dfba5ae tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71731) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 16:39:52 user nova-compute[71731]: DEBUG nova.compute.manager [-] [instance: f66553f5-5e1b-4f1d-8c5a-63bc340f7586] Deallocating network for instance {{(pid=71731) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 16:39:52 user nova-compute[71731]: DEBUG nova.network.neutron [-] [instance: f66553f5-5e1b-4f1d-8c5a-63bc340f7586] deallocate_for_instance() {{(pid=71731) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 16:39:53 user nova-compute[71731]: DEBUG nova.compute.manager [req-dfce92aa-bb15-451a-b177-c940e74f8d9e req-de9e9cea-7f5e-4c73-8b08-ac35a8ffa11a service nova] [instance: 5ed800fe-577d-4624-898c-c7f40da77376] Received event network-changed-09531419-c0ff-4d13-89bd-06caa28e019d {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:39:53 user nova-compute[71731]: DEBUG nova.compute.manager [req-dfce92aa-bb15-451a-b177-c940e74f8d9e req-de9e9cea-7f5e-4c73-8b08-ac35a8ffa11a service nova] [instance: 5ed800fe-577d-4624-898c-c7f40da77376] Refreshing instance network info cache due to event network-changed-09531419-c0ff-4d13-89bd-06caa28e019d. {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 16:39:53 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-dfce92aa-bb15-451a-b177-c940e74f8d9e req-de9e9cea-7f5e-4c73-8b08-ac35a8ffa11a service nova] Acquiring lock "refresh_cache-5ed800fe-577d-4624-898c-c7f40da77376" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 16:39:53 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-dfce92aa-bb15-451a-b177-c940e74f8d9e req-de9e9cea-7f5e-4c73-8b08-ac35a8ffa11a service nova] Acquired lock "refresh_cache-5ed800fe-577d-4624-898c-c7f40da77376" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 16:39:53 user nova-compute[71731]: DEBUG nova.network.neutron [req-dfce92aa-bb15-451a-b177-c940e74f8d9e req-de9e9cea-7f5e-4c73-8b08-ac35a8ffa11a service nova] [instance: 5ed800fe-577d-4624-898c-c7f40da77376] Refreshing network info cache for port 09531419-c0ff-4d13-89bd-06caa28e019d {{(pid=71731) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 16:39:53 user nova-compute[71731]: DEBUG nova.network.neutron [-] [instance: f66553f5-5e1b-4f1d-8c5a-63bc340f7586] Updating instance_info_cache with network_info: [] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:39:53 user nova-compute[71731]: DEBUG nova.compute.manager [req-bfc0d012-d06d-4797-b835-85a85d14a279 req-f9ddca58-a8d8-42e3-a780-4f74a5071bb2 service nova] [instance: f66553f5-5e1b-4f1d-8c5a-63bc340f7586] Received event network-vif-deleted-27d05b76-8556-4365-9050-6bf871e85502 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:39:53 user nova-compute[71731]: INFO nova.compute.manager [req-bfc0d012-d06d-4797-b835-85a85d14a279 req-f9ddca58-a8d8-42e3-a780-4f74a5071bb2 service nova] [instance: f66553f5-5e1b-4f1d-8c5a-63bc340f7586] Neutron deleted interface 27d05b76-8556-4365-9050-6bf871e85502; detaching it from the instance and deleting it from the info cache
Apr 13 16:39:53 user nova-compute[71731]: DEBUG nova.network.neutron [req-bfc0d012-d06d-4797-b835-85a85d14a279 req-f9ddca58-a8d8-42e3-a780-4f74a5071bb2 service nova] [instance: f66553f5-5e1b-4f1d-8c5a-63bc340f7586] Updating instance_info_cache with network_info: [] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:39:53 user nova-compute[71731]: INFO nova.compute.manager [-] [instance: f66553f5-5e1b-4f1d-8c5a-63bc340f7586] Took 0.52 seconds to deallocate network for instance.
Apr 13 16:39:53 user nova-compute[71731]: DEBUG nova.compute.manager [req-bfc0d012-d06d-4797-b835-85a85d14a279 req-f9ddca58-a8d8-42e3-a780-4f74a5071bb2 service nova] [instance: f66553f5-5e1b-4f1d-8c5a-63bc340f7586] Detach interface failed, port_id=27d05b76-8556-4365-9050-6bf871e85502, reason: Instance f66553f5-5e1b-4f1d-8c5a-63bc340f7586 could not be found. {{(pid=71731) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 13 16:39:53 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-bbb14a00-e67d-438f-901b-0ab20dfba5ae tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:39:53 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-bbb14a00-e67d-438f-901b-0ab20dfba5ae tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:39:53 user nova-compute[71731]: DEBUG nova.compute.provider_tree [None req-bbb14a00-e67d-438f-901b-0ab20dfba5ae tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Inventory has not changed in ProviderTree for provider: cb6b1a64-0c24-4e2d-af1e-16576ca9165c {{(pid=71731) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 16:39:53 user nova-compute[71731]: DEBUG nova.scheduler.client.report [None req-bbb14a00-e67d-438f-901b-0ab20dfba5ae tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Inventory has not changed for provider cb6b1a64-0c24-4e2d-af1e-16576ca9165c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71731) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 16:39:53 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-bbb14a00-e67d-438f-901b-0ab20dfba5ae tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.178s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:39:53 user nova-compute[71731]: INFO nova.scheduler.client.report [None req-bbb14a00-e67d-438f-901b-0ab20dfba5ae tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Deleted allocations for instance f66553f5-5e1b-4f1d-8c5a-63bc340f7586
Apr 13 16:39:53 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-bbb14a00-e67d-438f-901b-0ab20dfba5ae tempest-ServerBootFromVolumeStableRescueTest-1960261099 tempest-ServerBootFromVolumeStableRescueTest-1960261099-project-member] Lock "f66553f5-5e1b-4f1d-8c5a-63bc340f7586" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.727s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:39:53 user nova-compute[71731]: DEBUG nova.network.neutron [req-dfce92aa-bb15-451a-b177-c940e74f8d9e req-de9e9cea-7f5e-4c73-8b08-ac35a8ffa11a service nova] [instance: 5ed800fe-577d-4624-898c-c7f40da77376] Updated VIF entry in instance network info cache for port 09531419-c0ff-4d13-89bd-06caa28e019d. {{(pid=71731) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 16:39:53 user nova-compute[71731]: DEBUG nova.network.neutron [req-dfce92aa-bb15-451a-b177-c940e74f8d9e req-de9e9cea-7f5e-4c73-8b08-ac35a8ffa11a service nova] [instance: 5ed800fe-577d-4624-898c-c7f40da77376] Updating instance_info_cache with network_info: [{"id": "09531419-c0ff-4d13-89bd-06caa28e019d", "address": "fa:16:3e:13:b1:31", "network": {"id": "cf1fef97-9ef1-449f-a302-b38110024547", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1138167711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "980559734a504574a83224deb7423c77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09531419-c0", "ovs_interfaceid": "09531419-c0ff-4d13-89bd-06caa28e019d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:39:53 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-dfce92aa-bb15-451a-b177-c940e74f8d9e req-de9e9cea-7f5e-4c73-8b08-ac35a8ffa11a service nova] Releasing lock "refresh_cache-5ed800fe-577d-4624-898c-c7f40da77376" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 16:39:54 user nova-compute[71731]: DEBUG nova.compute.manager [req-129026a1-7995-4a62-a1af-a8df1db11597 req-c16b8855-5071-484e-a181-21ba783edc2d service nova] [instance: f66553f5-5e1b-4f1d-8c5a-63bc340f7586] Received event network-vif-plugged-27d05b76-8556-4365-9050-6bf871e85502 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:39:54 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-129026a1-7995-4a62-a1af-a8df1db11597 req-c16b8855-5071-484e-a181-21ba783edc2d service nova] Acquiring lock "f66553f5-5e1b-4f1d-8c5a-63bc340f7586-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:39:54 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-129026a1-7995-4a62-a1af-a8df1db11597 req-c16b8855-5071-484e-a181-21ba783edc2d service nova] Lock "f66553f5-5e1b-4f1d-8c5a-63bc340f7586-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:39:54 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-129026a1-7995-4a62-a1af-a8df1db11597 req-c16b8855-5071-484e-a181-21ba783edc2d service nova] Lock "f66553f5-5e1b-4f1d-8c5a-63bc340f7586-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:39:54 user nova-compute[71731]: DEBUG nova.compute.manager [req-129026a1-7995-4a62-a1af-a8df1db11597 req-c16b8855-5071-484e-a181-21ba783edc2d service nova] [instance: f66553f5-5e1b-4f1d-8c5a-63bc340f7586] No waiting events found dispatching network-vif-plugged-27d05b76-8556-4365-9050-6bf871e85502 {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:39:54 user nova-compute[71731]: WARNING nova.compute.manager [req-129026a1-7995-4a62-a1af-a8df1db11597 req-c16b8855-5071-484e-a181-21ba783edc2d service nova] [instance: f66553f5-5e1b-4f1d-8c5a-63bc340f7586] Received unexpected event network-vif-plugged-27d05b76-8556-4365-9050-6bf871e85502 for instance with vm_state deleted and task_state None.
Apr 13 16:39:56 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-e4513be8-ac39-45ca-a2a3-0cc889a53198 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Acquiring lock "7ae7d3d9-54f7-4c64-8bf6-08fa5c526687" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:39:56 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-e4513be8-ac39-45ca-a2a3-0cc889a53198 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "7ae7d3d9-54f7-4c64-8bf6-08fa5c526687" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:39:56 user nova-compute[71731]: DEBUG nova.compute.manager [None req-e4513be8-ac39-45ca-a2a3-0cc889a53198 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: 7ae7d3d9-54f7-4c64-8bf6-08fa5c526687] Starting instance... {{(pid=71731) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 16:39:56 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-e4513be8-ac39-45ca-a2a3-0cc889a53198 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:39:56 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-e4513be8-ac39-45ca-a2a3-0cc889a53198 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:39:56 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-e4513be8-ac39-45ca-a2a3-0cc889a53198 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71731) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 16:39:56 user nova-compute[71731]: INFO nova.compute.claims [None req-e4513be8-ac39-45ca-a2a3-0cc889a53198 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: 7ae7d3d9-54f7-4c64-8bf6-08fa5c526687] Claim successful on node user
Apr 13 16:39:57 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:39:57 user nova-compute[71731]: DEBUG nova.compute.provider_tree [None req-e4513be8-ac39-45ca-a2a3-0cc889a53198 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Inventory has not changed in ProviderTree for provider: cb6b1a64-0c24-4e2d-af1e-16576ca9165c {{(pid=71731) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 16:39:57 user nova-compute[71731]: DEBUG nova.scheduler.client.report [None req-e4513be8-ac39-45ca-a2a3-0cc889a53198 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Inventory has not changed for provider cb6b1a64-0c24-4e2d-af1e-16576ca9165c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71731) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 16:39:57 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-e4513be8-ac39-45ca-a2a3-0cc889a53198 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.230s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:39:57 user nova-compute[71731]: DEBUG nova.compute.manager [None req-e4513be8-ac39-45ca-a2a3-0cc889a53198 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: 7ae7d3d9-54f7-4c64-8bf6-08fa5c526687] Start building networks asynchronously for instance. {{(pid=71731) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 16:39:57 user nova-compute[71731]: DEBUG nova.compute.manager [None req-e4513be8-ac39-45ca-a2a3-0cc889a53198 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: 7ae7d3d9-54f7-4c64-8bf6-08fa5c526687] Allocating IP information in the background. {{(pid=71731) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 16:39:57 user nova-compute[71731]: DEBUG nova.network.neutron [None req-e4513be8-ac39-45ca-a2a3-0cc889a53198 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: 7ae7d3d9-54f7-4c64-8bf6-08fa5c526687] allocate_for_instance() {{(pid=71731) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 16:39:57 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-e4513be8-ac39-45ca-a2a3-0cc889a53198 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: 7ae7d3d9-54f7-4c64-8bf6-08fa5c526687] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 16:39:57 user nova-compute[71731]: DEBUG nova.compute.manager [None req-e4513be8-ac39-45ca-a2a3-0cc889a53198 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: 7ae7d3d9-54f7-4c64-8bf6-08fa5c526687] Start building block device mappings for instance. {{(pid=71731) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 16:39:57 user nova-compute[71731]: INFO nova.virt.block_device [None req-e4513be8-ac39-45ca-a2a3-0cc889a53198 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: 7ae7d3d9-54f7-4c64-8bf6-08fa5c526687] Booting with volume bebf46c7-444f-475a-9c3f-615d66556271 at /dev/vda
Apr 13 16:39:57 user nova-compute[71731]: DEBUG nova.policy [None req-e4513be8-ac39-45ca-a2a3-0cc889a53198 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1b3df1c5c5d441819bcef89ed6966815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980559734a504574a83224deb7423c77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71731) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 16:39:57 user nova-compute[71731]: DEBUG os_brick.utils [None req-e4513be8-ac39-45ca-a2a3-0cc889a53198 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 16:39:57 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:39:57 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:39:57 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[9df651a0-aae8-4cb0-ae5a-9fe0ee9d09fb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:81501d91421\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:39:57 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:39:57 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:39:57 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[7651cf94-47b3-492f-8049-c6d8b90ee4d3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:39:57 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:39:57 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:39:57 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0badf02-2f89-44d1-a5c0-f4be6a983aa9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:39:57 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a16f98f-ae34-45d8-b360-7db17e257435]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:39:57 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-e4513be8-ac39-45ca-a2a3-0cc889a53198 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Running cmd (subprocess): nvme version {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:39:57 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-e4513be8-ac39-45ca-a2a3-0cc889a53198 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] 'nvme version' failed. Not Retrying. {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 16:39:57 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e4513be8-ac39-45ca-a2a3-0cc889a53198 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] nvme not present on system {{(pid=71731) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 16:39:57 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:39:57 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 16:39:57 user nova-compute[71731]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 16:39:57 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[47d2466b-f9ce-44a7-8520-814e43472082]: (4, '') {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:39:57 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.lightos [None req-e4513be8-ac39-45ca-a2a3-0cc889a53198 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71731) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 16:39:57 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.lightos [None req-e4513be8-ac39-45ca-a2a3-0cc889a53198 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71731) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 16:39:57 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.lightos [None req-e4513be8-ac39-45ca-a2a3-0cc889a53198 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] LIGHTOS: no hostnqn found. {{(pid=71731) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 16:39:57 user nova-compute[71731]: DEBUG os_brick.utils [None req-e4513be8-ac39-45ca-a2a3-0cc889a53198 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:81501d91421', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 16:39:57 user nova-compute[71731]: DEBUG nova.virt.block_device [None req-e4513be8-ac39-45ca-a2a3-0cc889a53198 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: 7ae7d3d9-54f7-4c64-8bf6-08fa5c526687] Updating existing volume attachment record: 0150555e-e427-4e39-9f41-d36953866c90 {{(pid=71731) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 16:39:57 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:39:57 user nova-compute[71731]: DEBUG nova.network.neutron [None req-e4513be8-ac39-45ca-a2a3-0cc889a53198 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: 7ae7d3d9-54f7-4c64-8bf6-08fa5c526687] Successfully created port: f7ec2f7f-f505-44ed-b40d-7b91b2248cea {{(pid=71731) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 16:39:58 user nova-compute[71731]: DEBUG nova.network.neutron [None req-e4513be8-ac39-45ca-a2a3-0cc889a53198 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: 7ae7d3d9-54f7-4c64-8bf6-08fa5c526687] Successfully updated port: f7ec2f7f-f505-44ed-b40d-7b91b2248cea {{(pid=71731) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 16:39:58 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-e4513be8-ac39-45ca-a2a3-0cc889a53198 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Acquiring lock "refresh_cache-7ae7d3d9-54f7-4c64-8bf6-08fa5c526687" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 16:39:58 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-e4513be8-ac39-45ca-a2a3-0cc889a53198 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Acquired lock "refresh_cache-7ae7d3d9-54f7-4c64-8bf6-08fa5c526687" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 16:39:58 user nova-compute[71731]: DEBUG nova.network.neutron [None req-e4513be8-ac39-45ca-a2a3-0cc889a53198 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: 7ae7d3d9-54f7-4c64-8bf6-08fa5c526687] Building network info cache for instance {{(pid=71731) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 16:39:58 user nova-compute[71731]: DEBUG nova.compute.manager [req-87c16332-9778-4642-b285-8b5e5efe42ce req-dbb9ce5c-014b-4ea5-bee9-2cbf0fea5f67 service nova] [instance: 7ae7d3d9-54f7-4c64-8bf6-08fa5c526687] Received event network-changed-f7ec2f7f-f505-44ed-b40d-7b91b2248cea {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:39:58 user nova-compute[71731]: DEBUG nova.compute.manager [req-87c16332-9778-4642-b285-8b5e5efe42ce req-dbb9ce5c-014b-4ea5-bee9-2cbf0fea5f67 service nova] [instance: 7ae7d3d9-54f7-4c64-8bf6-08fa5c526687] Refreshing instance network info cache due to event network-changed-f7ec2f7f-f505-44ed-b40d-7b91b2248cea. {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 16:39:58 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-87c16332-9778-4642-b285-8b5e5efe42ce req-dbb9ce5c-014b-4ea5-bee9-2cbf0fea5f67 service nova] Acquiring lock "refresh_cache-7ae7d3d9-54f7-4c64-8bf6-08fa5c526687" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 16:39:58 user nova-compute[71731]: DEBUG nova.network.neutron [None req-e4513be8-ac39-45ca-a2a3-0cc889a53198 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: 7ae7d3d9-54f7-4c64-8bf6-08fa5c526687] Instance cache missing network info. {{(pid=71731) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 16:39:58 user nova-compute[71731]: DEBUG nova.network.neutron [None req-e4513be8-ac39-45ca-a2a3-0cc889a53198 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: 7ae7d3d9-54f7-4c64-8bf6-08fa5c526687] Updating instance_info_cache with network_info: [{"id": "f7ec2f7f-f505-44ed-b40d-7b91b2248cea", "address": "fa:16:3e:e2:cd:35", "network": {"id": "cf1fef97-9ef1-449f-a302-b38110024547", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1138167711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "980559734a504574a83224deb7423c77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7ec2f7f-f5", "ovs_interfaceid": "f7ec2f7f-f505-44ed-b40d-7b91b2248cea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:39:58 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-e4513be8-ac39-45ca-a2a3-0cc889a53198 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Releasing lock "refresh_cache-7ae7d3d9-54f7-4c64-8bf6-08fa5c526687" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 16:39:59 user nova-compute[71731]: DEBUG nova.compute.manager [None req-e4513be8-ac39-45ca-a2a3-0cc889a53198 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: 7ae7d3d9-54f7-4c64-8bf6-08fa5c526687] Instance network_info: |[{"id": "f7ec2f7f-f505-44ed-b40d-7b91b2248cea", "address": "fa:16:3e:e2:cd:35", "network": {"id": "cf1fef97-9ef1-449f-a302-b38110024547", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1138167711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "980559734a504574a83224deb7423c77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7ec2f7f-f5", "ovs_interfaceid": "f7ec2f7f-f505-44ed-b40d-7b91b2248cea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71731) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 16:39:59 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-87c16332-9778-4642-b285-8b5e5efe42ce req-dbb9ce5c-014b-4ea5-bee9-2cbf0fea5f67 service nova] Acquired lock "refresh_cache-7ae7d3d9-54f7-4c64-8bf6-08fa5c526687" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 16:39:59 user nova-compute[71731]: DEBUG nova.network.neutron [req-87c16332-9778-4642-b285-8b5e5efe42ce req-dbb9ce5c-014b-4ea5-bee9-2cbf0fea5f67 service nova] [instance: 7ae7d3d9-54f7-4c64-8bf6-08fa5c526687] Refreshing network info cache for port f7ec2f7f-f505-44ed-b40d-7b91b2248cea {{(pid=71731) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 16:39:59 user nova-compute[71731]: DEBUG nova.network.neutron [req-87c16332-9778-4642-b285-8b5e5efe42ce req-dbb9ce5c-014b-4ea5-bee9-2cbf0fea5f67 service nova] [instance: 7ae7d3d9-54f7-4c64-8bf6-08fa5c526687] Updated VIF entry in instance network info cache for port f7ec2f7f-f505-44ed-b40d-7b91b2248cea. {{(pid=71731) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 16:39:59 user nova-compute[71731]: DEBUG nova.network.neutron [req-87c16332-9778-4642-b285-8b5e5efe42ce req-dbb9ce5c-014b-4ea5-bee9-2cbf0fea5f67 service nova] [instance: 7ae7d3d9-54f7-4c64-8bf6-08fa5c526687] Updating instance_info_cache with network_info: [{"id": "f7ec2f7f-f505-44ed-b40d-7b91b2248cea", "address": "fa:16:3e:e2:cd:35", "network": {"id": "cf1fef97-9ef1-449f-a302-b38110024547", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1138167711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "980559734a504574a83224deb7423c77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7ec2f7f-f5", "ovs_interfaceid": "f7ec2f7f-f505-44ed-b40d-7b91b2248cea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:39:59 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-87c16332-9778-4642-b285-8b5e5efe42ce req-dbb9ce5c-014b-4ea5-bee9-2cbf0fea5f67 service nova] Releasing lock "refresh_cache-7ae7d3d9-54f7-4c64-8bf6-08fa5c526687" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 16:40:01 user nova-compute[71731]: DEBUG nova.compute.manager [None req-e4513be8-ac39-45ca-a2a3-0cc889a53198 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: 7ae7d3d9-54f7-4c64-8bf6-08fa5c526687] Start spawning the instance on the hypervisor. {{(pid=71731) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 16:40:01 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-e4513be8-ac39-45ca-a2a3-0cc889a53198 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: 7ae7d3d9-54f7-4c64-8bf6-08fa5c526687] Creating instance directory {{(pid=71731) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 16:40:01 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-e4513be8-ac39-45ca-a2a3-0cc889a53198 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: 7ae7d3d9-54f7-4c64-8bf6-08fa5c526687] Creating image(s)
Apr 13 16:40:01 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-e4513be8-ac39-45ca-a2a3-0cc889a53198 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: 7ae7d3d9-54f7-4c64-8bf6-08fa5c526687] Did not create local disks {{(pid=71731) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 13 16:40:01 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-e4513be8-ac39-45ca-a2a3-0cc889a53198 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: 7ae7d3d9-54f7-4c64-8bf6-08fa5c526687] Ensure instance console log exists: /opt/stack/data/nova/instances/7ae7d3d9-54f7-4c64-8bf6-08fa5c526687/console.log {{(pid=71731) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 16:40:01 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-e4513be8-ac39-45ca-a2a3-0cc889a53198 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:40:01 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-e4513be8-ac39-45ca-a2a3-0cc889a53198 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:40:01 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-e4513be8-ac39-45ca-a2a3-0cc889a53198 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:40:01 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-e4513be8-ac39-45ca-a2a3-0cc889a53198 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: 7ae7d3d9-54f7-4c64-8bf6-08fa5c526687] Start _get_guest_xml network_info=[{"id": "f7ec2f7f-f505-44ed-b40d-7b91b2248cea", "address": "fa:16:3e:e2:cd:35", "network": {"id": "cf1fef97-9ef1-449f-a302-b38110024547", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1138167711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "980559734a504574a83224deb7423c77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7ec2f7f-f5", "ovs_interfaceid": "f7ec2f7f-f505-44ed-b40d-7b91b2248cea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'attachment_id': '0150555e-e427-4e39-9f41-d36953866c90', 'mount_device': '/dev/vda', 'delete_on_termination': True, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:bebf46c7-444f-475a-9c3f-615d66556271', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ErRsaBJd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '7ae7d3d9-54f7-4c64-8bf6-08fa5c526687', 'attached_at': '', 'detached_at': '', 'volume_id': 'bebf46c7-444f-475a-9c3f-615d66556271', 'serial': 'bebf46c7-444f-475a-9c3f-615d66556271'}, 'disk_bus': 'virtio', 'guest_format': None, 'volume_type': None} {{(pid=71731) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 16:40:01 user nova-compute[71731]: WARNING nova.virt.libvirt.driver [None req-e4513be8-ac39-45ca-a2a3-0cc889a53198 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 16:40:01 user nova-compute[71731]: WARNING nova.virt.libvirt.driver [None req-e4513be8-ac39-45ca-a2a3-0cc889a53198 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 16:40:01 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-e4513be8-ac39-45ca-a2a3-0cc889a53198 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71731) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 16:40:01 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-e4513be8-ac39-45ca-a2a3-0cc889a53198 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T16:17:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 16:40:01 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-e4513be8-ac39-45ca-a2a3-0cc889a53198 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Flavor limits 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 16:40:01 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-e4513be8-ac39-45ca-a2a3-0cc889a53198 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Image limits 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 16:40:01 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-e4513be8-ac39-45ca-a2a3-0cc889a53198 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Flavor pref 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 16:40:01 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-e4513be8-ac39-45ca-a2a3-0cc889a53198 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Image pref 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 16:40:01 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-e4513be8-ac39-45ca-a2a3-0cc889a53198 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 16:40:01 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-e4513be8-ac39-45ca-a2a3-0cc889a53198 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 16:40:01 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-e4513be8-ac39-45ca-a2a3-0cc889a53198 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71731) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 16:40:01 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-e4513be8-ac39-45ca-a2a3-0cc889a53198 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Got 1 possible topologies {{(pid=71731) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 16:40:01 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-e4513be8-ac39-45ca-a2a3-0cc889a53198 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 16:40:01 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-e4513be8-ac39-45ca-a2a3-0cc889a53198 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 16:40:01 user nova-compute[71731]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e4513be8-ac39-45ca-a2a3-0cc889a53198 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: 7ae7d3d9-54f7-4c64-8bf6-08fa5c526687] Calling os-brick to attach iSCSI Volume {{(pid=71731) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 16:40:01 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4513be8-ac39-45ca-a2a3-0cc889a53198 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8cf0118790>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:bebf46c7-444f-475a-9c3f-615d66556271', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ErRsaBJd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 16:40:01 user nova-compute[71731]: WARNING os_brick.initiator.connectors.base [None req-e4513be8-ac39-45ca-a2a3-0cc889a53198 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 16:40:01 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-e4513be8-ac39-45ca-a2a3-0cc889a53198 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 16:40:01 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-e4513be8-ac39-45ca-a2a3-0cc889a53198 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 16:40:01 user nova-compute[71731]: WARNING os_brick.initiator.connectors.base [None req-e4513be8-ac39-45ca-a2a3-0cc889a53198 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 16:40:01 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-e4513be8-ac39-45ca-a2a3-0cc889a53198 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bebf46c7-444f-475a-9c3f-615d66556271" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 16:40:01 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-e4513be8-ac39-45ca-a2a3-0cc889a53198 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bebf46c7-444f-475a-9c3f-615d66556271" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 16:40:01 user nova-compute[71731]: INFO os_brick.initiator.connectors.iscsi [None req-e4513be8-ac39-45ca-a2a3-0cc889a53198 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 16:40:01 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bebf46c7-444f-475a-9c3f-615d66556271 -p 172.16.0.220:3260 {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:40:01 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bebf46c7-444f-475a-9c3f-615d66556271 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:40:01 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[b25894ec-3578-41b4-ab14-964ce3f28216]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:40:01 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4513be8-ac39-45ca-a2a3-0cc889a53198 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 16:40:01 user nova-compute[71731]:  {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:40:01 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bebf46c7-444f-475a-9c3f-615d66556271 -p 172.16.0.220:3260 --interface default --op new {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:40:01 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bebf46c7-444f-475a-9c3f-615d66556271 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:40:01 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b92e023-8283-48d0-b62e-e82caa26c1a7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bebf46c7-444f-475a-9c3f-615d66556271] added\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:40:01 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4513be8-ac39-45ca-a2a3-0cc889a53198 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bebf46c7-444f-475a-9c3f-615d66556271] added
Apr 13 16:40:01 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:40:01 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bebf46c7-444f-475a-9c3f-615d66556271 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:40:01 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bebf46c7-444f-475a-9c3f-615d66556271 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:40:01 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[506c5f43-6c40-4792-bf6a-1c8d70a79526]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:40:01 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4513be8-ac39-45ca-a2a3-0cc889a53198 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:40:01 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bebf46c7-444f-475a-9c3f-615d66556271 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:40:01 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bebf46c7-444f-475a-9c3f-615d66556271 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:40:01 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6785735-2764-4d10-8234-89ca6a6da60a]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:40:01 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4513be8-ac39-45ca-a2a3-0cc889a53198 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:40:01 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bebf46c7-444f-475a-9c3f-615d66556271 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ErRsaBJd {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:40:01 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bebf46c7-444f-475a-9c3f-615d66556271 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ErRsaBJd" returned: 0 in 0.022s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:40:01 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c1467f4-6407-4936-8c3a-cf982a1e130a]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:40:01 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4513be8-ac39-45ca-a2a3-0cc889a53198 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ErRsaBJd'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:40:01 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bebf46c7-444f-475a-9c3f-615d66556271 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:40:01 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bebf46c7-444f-475a-9c3f-615d66556271 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:40:01 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6b82d21-ab05-443b-97c5-23149e8c4579]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:40:01 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4513be8-ac39-45ca-a2a3-0cc889a53198 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:40:01 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:40:01 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:40:01 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d4ceea9-2ef8-4cbf-8221-bc3b6bb0f2c2]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:40:01 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4513be8-ac39-45ca-a2a3-0cc889a53198 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Apr 13 16:40:01 user nova-compute[71731]:  {{(pid=71731) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 16:40:01 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4513be8-ac39-45ca-a2a3-0cc889a53198 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Apr 13 16:40:01 user nova-compute[71731]:  {{(pid=71731) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 16:40:01 user nova-compute[71731]: WARNING os_brick.initiator.connectors.iscsi [None req-e4513be8-ac39-45ca-a2a3-0cc889a53198 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Apr 13 16:40:01 user nova-compute[71731]: 
Apr 13 16:40:01 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bebf46c7-444f-475a-9c3f-615d66556271 -p 172.16.0.220:3260 --login {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:40:02 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bebf46c7-444f-475a-9c3f-615d66556271 -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:40:02 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[217ac1c9-f948-4906-b81b-8a84af8bb5f6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bebf46c7-444f-475a-9c3f-615d66556271, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bebf46c7-444f-475a-9c3f-615d66556271, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:40:02 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4513be8-ac39-45ca-a2a3-0cc889a53198 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bebf46c7-444f-475a-9c3f-615d66556271, portal: 172.16.0.220,3260]
Apr 13 16:40:02 user nova-compute[71731]: Login to [iface: default, target: iqn.2010-10.org.openstack:bebf46c7-444f-475a-9c3f-615d66556271, portal: 172.16.0.220,3260] successful.
Apr 13 16:40:02 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:40:02 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bebf46c7-444f-475a-9c3f-615d66556271 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:40:02 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bebf46c7-444f-475a-9c3f-615d66556271 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:40:02 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[f318a2ca-fc74-4019-899a-cfb37973b727]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:40:02 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4513be8-ac39-45ca-a2a3-0cc889a53198 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:40:02 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:40:02 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:40:02 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:40:02 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[35c1df12-ef5f-428d-8b65-a712c07e9f3e]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bebf46c7-444f-475a-9c3f-615d66556271 (non-flash)\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:40:02 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4513be8-ac39-45ca-a2a3-0cc889a53198 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bebf46c7-444f-475a-9c3f-615d66556271 (non-flash)
Apr 13 16:40:02 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 16:40:02 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4513be8-ac39-45ca-a2a3-0cc889a53198 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bebf46c7-444f-475a-9c3f-615d66556271 (non-flash)
Apr 13 16:40:02 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 16:40:02 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-e4513be8-ac39-45ca-a2a3-0cc889a53198 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bebf46c7-444f-475a-9c3f-615d66556271" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.245s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 16:40:02 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4513be8-ac39-45ca-a2a3-0cc889a53198 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Connected to 172.16.0.220:3260 {{(pid=71731) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 16:40:02 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-e4513be8-ac39-45ca-a2a3-0cc889a53198 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] HCTL ('33', '-', '-', 0) found on session 44 with lun 0 {{(pid=71731) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 16:40:02 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-e4513be8-ac39-45ca-a2a3-0cc889a53198 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71731) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 16:40:02 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:40:02 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:40:02 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[642a66fa-92c3-4486-bbb4-bf4c7381bf6b]: (4, ('- - 0', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:40:02 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-e4513be8-ac39-45ca-a2a3-0cc889a53198 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Searching for a device in session 44 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71731) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 16:40:02 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4513be8-ac39-45ca-a2a3-0cc889a53198 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:bebf46c7-444f-475a-9c3f-615d66556271', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ErRsaBJd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71731) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 16:40:02 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:40:03 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-e4513be8-ac39-45ca-a2a3-0cc889a53198 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.277s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 16:40:03 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4513be8-ac39-45ca-a2a3-0cc889a53198 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] <== connect_volume: return (1278ms) {'type': 'block', 'scsi_wwn': '26533336631393931', 'path': '/dev/sdb'} {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 16:40:03 user nova-compute[71731]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e4513be8-ac39-45ca-a2a3-0cc889a53198 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: 7ae7d3d9-54f7-4c64-8bf6-08fa5c526687] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26533336631393931', 'path': '/dev/sdb'} {{(pid=71731) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 16:40:03 user nova-compute[71731]: DEBUG nova.virt.libvirt.vif [None req-e4513be8-ac39-45ca-a2a3-0cc889a53198 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T16:39:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-182216296',display_name='tempest-ServerActionsTestJSON-server-182216296',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-182216296',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPaDda4gTmMbkxKfok8i4i1XcNLza5lOVYjCPDEGVTF1JRQKderq80DnIN4GAkaZiBV5U44gvdu3wadL/M5wOH7VDSuEghHchow1mC9TB1xgdo8GoXeM279SVAyu08uhIQ==',key_name='tempest-keypair-1700037342',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='980559734a504574a83224deb7423c77',ramdisk_id='',reservation_id='r-r4a3hst0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestJSON-713402718',owner_user_name='tempest-ServerActionsTestJSON-713402718-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T16:39:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1b3df1c5c5d441819bcef89ed6966815',uuid=7ae7d3d9-54f7-4c64-8bf6-08fa5c526687,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f7ec2f7f-f505-44ed-b40d-7b91b2248cea", "address": "fa:16:3e:e2:cd:35", "network": {"id": "cf1fef97-9ef1-449f-a302-b38110024547", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1138167711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "980559734a504574a83224deb7423c77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7ec2f7f-f5", "ovs_interfaceid": "f7ec2f7f-f505-44ed-b40d-7b91b2248cea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71731) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 16:40:03 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-e4513be8-ac39-45ca-a2a3-0cc889a53198 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Converting VIF {"id": "f7ec2f7f-f505-44ed-b40d-7b91b2248cea", "address": "fa:16:3e:e2:cd:35", "network": {"id": "cf1fef97-9ef1-449f-a302-b38110024547", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1138167711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "980559734a504574a83224deb7423c77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7ec2f7f-f5", "ovs_interfaceid": "f7ec2f7f-f505-44ed-b40d-7b91b2248cea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 16:40:03 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-e4513be8-ac39-45ca-a2a3-0cc889a53198 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:cd:35,bridge_name='br-int',has_traffic_filtering=True,id=f7ec2f7f-f505-44ed-b40d-7b91b2248cea,network=Network(cf1fef97-9ef1-449f-a302-b38110024547),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf7ec2f7f-f5') {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 16:40:03 user nova-compute[71731]: DEBUG nova.objects.instance [None req-e4513be8-ac39-45ca-a2a3-0cc889a53198 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lazy-loading 'pci_devices' on Instance uuid 7ae7d3d9-54f7-4c64-8bf6-08fa5c526687 {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:40:03 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-e4513be8-ac39-45ca-a2a3-0cc889a53198 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: 7ae7d3d9-54f7-4c64-8bf6-08fa5c526687] End _get_guest_xml xml=<domain type="kvm">
Apr 13 16:40:03 user nova-compute[71731]:   <uuid>7ae7d3d9-54f7-4c64-8bf6-08fa5c526687</uuid>
Apr 13 16:40:03 user nova-compute[71731]:   <name>instance-00000023</name>
Apr 13 16:40:03 user nova-compute[71731]:   <memory>131072</memory>
Apr 13 16:40:03 user nova-compute[71731]:   <vcpu>1</vcpu>
Apr 13 16:40:03 user nova-compute[71731]:   <metadata>
Apr 13 16:40:03 user nova-compute[71731]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 16:40:03 user nova-compute[71731]:       <nova:package version="0.0.0"/>
Apr 13 16:40:03 user nova-compute[71731]:       <nova:name>tempest-ServerActionsTestJSON-server-182216296</nova:name>
Apr 13 16:40:03 user nova-compute[71731]:       <nova:creationTime>2023-04-13 16:40:01</nova:creationTime>
Apr 13 16:40:03 user nova-compute[71731]:       <nova:flavor name="m1.nano">
Apr 13 16:40:03 user nova-compute[71731]:         <nova:memory>128</nova:memory>
Apr 13 16:40:03 user nova-compute[71731]:         <nova:disk>1</nova:disk>
Apr 13 16:40:03 user nova-compute[71731]:         <nova:swap>0</nova:swap>
Apr 13 16:40:03 user nova-compute[71731]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 16:40:03 user nova-compute[71731]:         <nova:vcpus>1</nova:vcpus>
Apr 13 16:40:03 user nova-compute[71731]:       </nova:flavor>
Apr 13 16:40:03 user nova-compute[71731]:       <nova:owner>
Apr 13 16:40:03 user nova-compute[71731]:         <nova:user uuid="1b3df1c5c5d441819bcef89ed6966815">tempest-ServerActionsTestJSON-713402718-project-member</nova:user>
Apr 13 16:40:03 user nova-compute[71731]:         <nova:project uuid="980559734a504574a83224deb7423c77">tempest-ServerActionsTestJSON-713402718</nova:project>
Apr 13 16:40:03 user nova-compute[71731]:       </nova:owner>
Apr 13 16:40:03 user nova-compute[71731]:       <nova:ports>
Apr 13 16:40:03 user nova-compute[71731]:         <nova:port uuid="f7ec2f7f-f505-44ed-b40d-7b91b2248cea">
Apr 13 16:40:03 user nova-compute[71731]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Apr 13 16:40:03 user nova-compute[71731]:         </nova:port>
Apr 13 16:40:03 user nova-compute[71731]:       </nova:ports>
Apr 13 16:40:03 user nova-compute[71731]:     </nova:instance>
Apr 13 16:40:03 user nova-compute[71731]:   </metadata>
Apr 13 16:40:03 user nova-compute[71731]:   <sysinfo type="smbios">
Apr 13 16:40:03 user nova-compute[71731]:     <system>
Apr 13 16:40:03 user nova-compute[71731]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 16:40:03 user nova-compute[71731]:       <entry name="product">OpenStack Nova</entry>
Apr 13 16:40:03 user nova-compute[71731]:       <entry name="version">0.0.0</entry>
Apr 13 16:40:03 user nova-compute[71731]:       <entry name="serial">7ae7d3d9-54f7-4c64-8bf6-08fa5c526687</entry>
Apr 13 16:40:03 user nova-compute[71731]:       <entry name="uuid">7ae7d3d9-54f7-4c64-8bf6-08fa5c526687</entry>
Apr 13 16:40:03 user nova-compute[71731]:       <entry name="family">Virtual Machine</entry>
Apr 13 16:40:03 user nova-compute[71731]:     </system>
Apr 13 16:40:03 user nova-compute[71731]:   </sysinfo>
Apr 13 16:40:03 user nova-compute[71731]:   <os>
Apr 13 16:40:03 user nova-compute[71731]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 16:40:03 user nova-compute[71731]:     <boot dev="hd"/>
Apr 13 16:40:03 user nova-compute[71731]:     <smbios mode="sysinfo"/>
Apr 13 16:40:03 user nova-compute[71731]:   </os>
Apr 13 16:40:03 user nova-compute[71731]:   <features>
Apr 13 16:40:03 user nova-compute[71731]:     <acpi/>
Apr 13 16:40:03 user nova-compute[71731]:     <apic/>
Apr 13 16:40:03 user nova-compute[71731]:     <vmcoreinfo/>
Apr 13 16:40:03 user nova-compute[71731]:   </features>
Apr 13 16:40:03 user nova-compute[71731]:   <clock offset="utc">
Apr 13 16:40:03 user nova-compute[71731]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 16:40:03 user nova-compute[71731]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 16:40:03 user nova-compute[71731]:     <timer name="hpet" present="no"/>
Apr 13 16:40:03 user nova-compute[71731]:   </clock>
Apr 13 16:40:03 user nova-compute[71731]:   <cpu mode="custom" match="exact">
Apr 13 16:40:03 user nova-compute[71731]:     <model>Nehalem</model>
Apr 13 16:40:03 user nova-compute[71731]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 16:40:03 user nova-compute[71731]:   </cpu>
Apr 13 16:40:03 user nova-compute[71731]:   <devices>
Apr 13 16:40:03 user nova-compute[71731]:     <disk type="block" device="disk">
Apr 13 16:40:03 user nova-compute[71731]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 16:40:03 user nova-compute[71731]:       <source dev="/dev/sdb"/>
Apr 13 16:40:03 user nova-compute[71731]:       <target dev="vda" bus="virtio"/>
Apr 13 16:40:03 user nova-compute[71731]:       <serial>bebf46c7-444f-475a-9c3f-615d66556271</serial>
Apr 13 16:40:03 user nova-compute[71731]:     </disk>
Apr 13 16:40:03 user nova-compute[71731]:     <interface type="ethernet">
Apr 13 16:40:03 user nova-compute[71731]:       <mac address="fa:16:3e:e2:cd:35"/>
Apr 13 16:40:03 user nova-compute[71731]:       <model type="virtio"/>
Apr 13 16:40:03 user nova-compute[71731]:       <mtu size="1442"/>
Apr 13 16:40:03 user nova-compute[71731]:       <target dev="tapf7ec2f7f-f5"/>
Apr 13 16:40:03 user nova-compute[71731]:     </interface>
Apr 13 16:40:03 user nova-compute[71731]:     <serial type="pty">
Apr 13 16:40:03 user nova-compute[71731]:       <log file="/opt/stack/data/nova/instances/7ae7d3d9-54f7-4c64-8bf6-08fa5c526687/console.log" append="off"/>
Apr 13 16:40:03 user nova-compute[71731]:     </serial>
Apr 13 16:40:03 user nova-compute[71731]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 16:40:03 user nova-compute[71731]:     <video>
Apr 13 16:40:03 user nova-compute[71731]:       <model type="virtio"/>
Apr 13 16:40:03 user nova-compute[71731]:     </video>
Apr 13 16:40:03 user nova-compute[71731]:     <rng model="virtio">
Apr 13 16:40:03 user nova-compute[71731]:       <backend model="random">/dev/urandom</backend>
Apr 13 16:40:03 user nova-compute[71731]:     </rng>
Apr 13 16:40:03 user nova-compute[71731]:     <controller type="usb" index="0" model="none"/>
Apr 13 16:40:03 user nova-compute[71731]:     <memballoon model="virtio">
Apr 13 16:40:03 user nova-compute[71731]:       <stats period="10"/>
Apr 13 16:40:03 user nova-compute[71731]:     </memballoon>
Apr 13 16:40:03 user nova-compute[71731]:   </devices>
Apr 13 16:40:03 user nova-compute[71731]: </domain>
Apr 13 16:40:03 user nova-compute[71731]:  {{(pid=71731) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 16:40:03 user nova-compute[71731]: DEBUG nova.virt.libvirt.vif [None req-e4513be8-ac39-45ca-a2a3-0cc889a53198 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T16:39:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-182216296',display_name='tempest-ServerActionsTestJSON-server-182216296',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-182216296',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPaDda4gTmMbkxKfok8i4i1XcNLza5lOVYjCPDEGVTF1JRQKderq80DnIN4GAkaZiBV5U44gvdu3wadL/M5wOH7VDSuEghHchow1mC9TB1xgdo8GoXeM279SVAyu08uhIQ==',key_name='tempest-keypair-1700037342',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='980559734a504574a83224deb7423c77',ramdisk_id='',reservation_id='r-r4a3hst0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestJSON-713402718',owner_user_name='tempest-ServerActionsTestJSON-713402718-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T16:39:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1b3df1c5c5d441819bcef89ed6966815',uuid=7ae7d3d9-54f7-4c64-8bf6-08fa5c526687,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f7ec2f7f-f505-44ed-b40d-7b91b2248cea", "address": "fa:16:3e:e2:cd:35", "network": {"id": "cf1fef97-9ef1-449f-a302-b38110024547", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1138167711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "980559734a504574a83224deb7423c77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7ec2f7f-f5", "ovs_interfaceid": "f7ec2f7f-f505-44ed-b40d-7b91b2248cea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 16:40:03 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-e4513be8-ac39-45ca-a2a3-0cc889a53198 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Converting VIF {"id": "f7ec2f7f-f505-44ed-b40d-7b91b2248cea", "address": "fa:16:3e:e2:cd:35", "network": {"id": "cf1fef97-9ef1-449f-a302-b38110024547", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1138167711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "980559734a504574a83224deb7423c77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7ec2f7f-f5", "ovs_interfaceid": "f7ec2f7f-f505-44ed-b40d-7b91b2248cea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 16:40:03 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-e4513be8-ac39-45ca-a2a3-0cc889a53198 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:cd:35,bridge_name='br-int',has_traffic_filtering=True,id=f7ec2f7f-f505-44ed-b40d-7b91b2248cea,network=Network(cf1fef97-9ef1-449f-a302-b38110024547),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf7ec2f7f-f5') {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 16:40:03 user nova-compute[71731]: DEBUG os_vif [None req-e4513be8-ac39-45ca-a2a3-0cc889a53198 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:cd:35,bridge_name='br-int',has_traffic_filtering=True,id=f7ec2f7f-f505-44ed-b40d-7b91b2248cea,network=Network(cf1fef97-9ef1-449f-a302-b38110024547),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf7ec2f7f-f5') {{(pid=71731) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 16:40:03 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:40:03 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:40:03 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 16:40:03 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:40:03 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf7ec2f7f-f5, may_exist=True) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:40:03 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf7ec2f7f-f5, col_values=(('external_ids', {'iface-id': 'f7ec2f7f-f505-44ed-b40d-7b91b2248cea', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e2:cd:35', 'vm-uuid': '7ae7d3d9-54f7-4c64-8bf6-08fa5c526687'}),)) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:40:03 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:40:03 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 16:40:03 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:40:03 user nova-compute[71731]: INFO os_vif [None req-e4513be8-ac39-45ca-a2a3-0cc889a53198 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:cd:35,bridge_name='br-int',has_traffic_filtering=True,id=f7ec2f7f-f505-44ed-b40d-7b91b2248cea,network=Network(cf1fef97-9ef1-449f-a302-b38110024547),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf7ec2f7f-f5')
Apr 13 16:40:03 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-e4513be8-ac39-45ca-a2a3-0cc889a53198 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] No BDM found with device name vda, not building metadata. {{(pid=71731) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 16:40:03 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-e4513be8-ac39-45ca-a2a3-0cc889a53198 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] No VIF found with MAC fa:16:3e:e2:cd:35, not building metadata {{(pid=71731) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 16:40:04 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:40:04 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:40:04 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:40:04 user nova-compute[71731]: DEBUG nova.compute.manager [req-a5a43f2f-8dde-4bc4-80b7-a72558c81429 req-fa4e20dc-ca59-498e-a543-7bf114bc6cdb service nova] [instance: 7ae7d3d9-54f7-4c64-8bf6-08fa5c526687] Received event network-vif-plugged-f7ec2f7f-f505-44ed-b40d-7b91b2248cea {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:40:04 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-a5a43f2f-8dde-4bc4-80b7-a72558c81429 req-fa4e20dc-ca59-498e-a543-7bf114bc6cdb service nova] Acquiring lock "7ae7d3d9-54f7-4c64-8bf6-08fa5c526687-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:40:04 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-a5a43f2f-8dde-4bc4-80b7-a72558c81429 req-fa4e20dc-ca59-498e-a543-7bf114bc6cdb service nova] Lock "7ae7d3d9-54f7-4c64-8bf6-08fa5c526687-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:40:04 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-a5a43f2f-8dde-4bc4-80b7-a72558c81429 req-fa4e20dc-ca59-498e-a543-7bf114bc6cdb service nova] Lock "7ae7d3d9-54f7-4c64-8bf6-08fa5c526687-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:40:04 user nova-compute[71731]: DEBUG nova.compute.manager [req-a5a43f2f-8dde-4bc4-80b7-a72558c81429 req-fa4e20dc-ca59-498e-a543-7bf114bc6cdb service nova] [instance: 7ae7d3d9-54f7-4c64-8bf6-08fa5c526687] No waiting events found dispatching network-vif-plugged-f7ec2f7f-f505-44ed-b40d-7b91b2248cea {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:40:04 user nova-compute[71731]: WARNING nova.compute.manager [req-a5a43f2f-8dde-4bc4-80b7-a72558c81429 req-fa4e20dc-ca59-498e-a543-7bf114bc6cdb service nova] [instance: 7ae7d3d9-54f7-4c64-8bf6-08fa5c526687] Received unexpected event network-vif-plugged-f7ec2f7f-f505-44ed-b40d-7b91b2248cea for instance with vm_state building and task_state spawning.
Apr 13 16:40:04 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:40:04 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:40:06 user nova-compute[71731]: DEBUG nova.virt.driver [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Emitting event <LifecycleEvent: 1681404006.5495682, 7ae7d3d9-54f7-4c64-8bf6-08fa5c526687 => Resumed> {{(pid=71731) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 16:40:06 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 7ae7d3d9-54f7-4c64-8bf6-08fa5c526687] VM Resumed (Lifecycle Event)
Apr 13 16:40:06 user nova-compute[71731]: DEBUG nova.compute.manager [None req-e4513be8-ac39-45ca-a2a3-0cc889a53198 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: 7ae7d3d9-54f7-4c64-8bf6-08fa5c526687] Instance event wait completed in 0 seconds for  {{(pid=71731) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 16:40:06 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-e4513be8-ac39-45ca-a2a3-0cc889a53198 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: 7ae7d3d9-54f7-4c64-8bf6-08fa5c526687] Guest created on hypervisor {{(pid=71731) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 16:40:06 user nova-compute[71731]: INFO nova.virt.libvirt.driver [-] [instance: 7ae7d3d9-54f7-4c64-8bf6-08fa5c526687] Instance spawned successfully.
Apr 13 16:40:06 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-e4513be8-ac39-45ca-a2a3-0cc889a53198 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: 7ae7d3d9-54f7-4c64-8bf6-08fa5c526687] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 16:40:06 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 7ae7d3d9-54f7-4c64-8bf6-08fa5c526687] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:40:06 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 7ae7d3d9-54f7-4c64-8bf6-08fa5c526687] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71731) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 16:40:06 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-e4513be8-ac39-45ca-a2a3-0cc889a53198 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: 7ae7d3d9-54f7-4c64-8bf6-08fa5c526687] Found default for hw_cdrom_bus of ide {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:40:06 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-e4513be8-ac39-45ca-a2a3-0cc889a53198 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: 7ae7d3d9-54f7-4c64-8bf6-08fa5c526687] Found default for hw_disk_bus of virtio {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:40:06 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-e4513be8-ac39-45ca-a2a3-0cc889a53198 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: 7ae7d3d9-54f7-4c64-8bf6-08fa5c526687] Found default for hw_input_bus of None {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:40:06 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-e4513be8-ac39-45ca-a2a3-0cc889a53198 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: 7ae7d3d9-54f7-4c64-8bf6-08fa5c526687] Found default for hw_pointer_model of None {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:40:06 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-e4513be8-ac39-45ca-a2a3-0cc889a53198 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: 7ae7d3d9-54f7-4c64-8bf6-08fa5c526687] Found default for hw_video_model of virtio {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:40:06 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-e4513be8-ac39-45ca-a2a3-0cc889a53198 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: 7ae7d3d9-54f7-4c64-8bf6-08fa5c526687] Found default for hw_vif_model of virtio {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:40:06 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 7ae7d3d9-54f7-4c64-8bf6-08fa5c526687] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 16:40:06 user nova-compute[71731]: DEBUG nova.virt.driver [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Emitting event <LifecycleEvent: 1681404006.55314, 7ae7d3d9-54f7-4c64-8bf6-08fa5c526687 => Started> {{(pid=71731) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 16:40:06 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 7ae7d3d9-54f7-4c64-8bf6-08fa5c526687] VM Started (Lifecycle Event)
Apr 13 16:40:06 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 7ae7d3d9-54f7-4c64-8bf6-08fa5c526687] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:40:06 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 7ae7d3d9-54f7-4c64-8bf6-08fa5c526687] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71731) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 16:40:06 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 7ae7d3d9-54f7-4c64-8bf6-08fa5c526687] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 16:40:06 user nova-compute[71731]: DEBUG nova.compute.manager [req-1f361583-1a52-4cc2-87b4-ab422265fea9 req-3b47f16c-d8cb-4fab-bf2c-c3dec3f03101 service nova] [instance: 7ae7d3d9-54f7-4c64-8bf6-08fa5c526687] Received event network-vif-plugged-f7ec2f7f-f505-44ed-b40d-7b91b2248cea {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:40:06 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-1f361583-1a52-4cc2-87b4-ab422265fea9 req-3b47f16c-d8cb-4fab-bf2c-c3dec3f03101 service nova] Acquiring lock "7ae7d3d9-54f7-4c64-8bf6-08fa5c526687-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:40:06 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-1f361583-1a52-4cc2-87b4-ab422265fea9 req-3b47f16c-d8cb-4fab-bf2c-c3dec3f03101 service nova] Lock "7ae7d3d9-54f7-4c64-8bf6-08fa5c526687-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:40:06 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-1f361583-1a52-4cc2-87b4-ab422265fea9 req-3b47f16c-d8cb-4fab-bf2c-c3dec3f03101 service nova] Lock "7ae7d3d9-54f7-4c64-8bf6-08fa5c526687-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:40:06 user nova-compute[71731]: DEBUG nova.compute.manager [req-1f361583-1a52-4cc2-87b4-ab422265fea9 req-3b47f16c-d8cb-4fab-bf2c-c3dec3f03101 service nova] [instance: 7ae7d3d9-54f7-4c64-8bf6-08fa5c526687] No waiting events found dispatching network-vif-plugged-f7ec2f7f-f505-44ed-b40d-7b91b2248cea {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:40:06 user nova-compute[71731]: WARNING nova.compute.manager [req-1f361583-1a52-4cc2-87b4-ab422265fea9 req-3b47f16c-d8cb-4fab-bf2c-c3dec3f03101 service nova] [instance: 7ae7d3d9-54f7-4c64-8bf6-08fa5c526687] Received unexpected event network-vif-plugged-f7ec2f7f-f505-44ed-b40d-7b91b2248cea for instance with vm_state building and task_state spawning.
Apr 13 16:40:06 user nova-compute[71731]: INFO nova.compute.manager [None req-e4513be8-ac39-45ca-a2a3-0cc889a53198 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: 7ae7d3d9-54f7-4c64-8bf6-08fa5c526687] Took 4.95 seconds to spawn the instance on the hypervisor.
Apr 13 16:40:06 user nova-compute[71731]: DEBUG nova.compute.manager [None req-e4513be8-ac39-45ca-a2a3-0cc889a53198 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: 7ae7d3d9-54f7-4c64-8bf6-08fa5c526687] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:40:06 user nova-compute[71731]: INFO nova.compute.manager [None req-e4513be8-ac39-45ca-a2a3-0cc889a53198 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: 7ae7d3d9-54f7-4c64-8bf6-08fa5c526687] Took 9.87 seconds to build instance.
Apr 13 16:40:06 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-e4513be8-ac39-45ca-a2a3-0cc889a53198 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "7ae7d3d9-54f7-4c64-8bf6-08fa5c526687" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.974s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:40:07 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:40:07 user nova-compute[71731]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681403992.4855733, f66553f5-5e1b-4f1d-8c5a-63bc340f7586 => Stopped> {{(pid=71731) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 16:40:07 user nova-compute[71731]: INFO nova.compute.manager [-] [instance: f66553f5-5e1b-4f1d-8c5a-63bc340f7586] VM Stopped (Lifecycle Event)
Apr 13 16:40:07 user nova-compute[71731]: DEBUG nova.compute.manager [None req-38048db1-0443-4792-b172-de8267483a21 None None] [instance: f66553f5-5e1b-4f1d-8c5a-63bc340f7586] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:40:08 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:40:12 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:40:13 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:40:18 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 16:40:19 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:40:22 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager.update_available_resource {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:40:22 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:40:22 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:40:22 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:40:22 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Auditing locally available compute resources for user (node: user) {{(pid=71731) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 16:40:22 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:40:22 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71731) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 16:40:22 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ed800fe-577d-4624-898c-c7f40da77376/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:40:22 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ed800fe-577d-4624-898c-c7f40da77376/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:40:22 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ed800fe-577d-4624-898c-c7f40da77376/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:40:22 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ed800fe-577d-4624-898c-c7f40da77376/disk --force-share --output=json" returned: 0 in 0.127s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:40:22 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f6a693f-0a99-434f-871d-f535b71229b9/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:40:22 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f6a693f-0a99-434f-871d-f535b71229b9/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:40:22 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f6a693f-0a99-434f-871d-f535b71229b9/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:40:22 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f6a693f-0a99-434f-871d-f535b71229b9/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:40:23 user nova-compute[71731]: WARNING nova.virt.libvirt.driver [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 16:40:23 user nova-compute[71731]: WARNING nova.virt.libvirt.driver [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 16:40:23 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Hypervisor/Node resource view: name=user free_ram=8545MB free_disk=26.189685821533203GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71731) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 16:40:23 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:40:23 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:40:23 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:40:23 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance 5ed800fe-577d-4624-898c-c7f40da77376 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 16:40:23 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance 1f6a693f-0a99-434f-871d-f535b71229b9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 16:40:23 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance 7ae7d3d9-54f7-4c64-8bf6-08fa5c526687 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 16:40:23 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=71731) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 16:40:23 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Final resource view: name=user phys_ram=16023MB used_ram=896MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=71731) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 16:40:23 user nova-compute[71731]: DEBUG nova.compute.provider_tree [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Inventory has not changed in ProviderTree for provider: cb6b1a64-0c24-4e2d-af1e-16576ca9165c {{(pid=71731) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 16:40:23 user nova-compute[71731]: DEBUG nova.scheduler.client.report [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Inventory has not changed for provider cb6b1a64-0c24-4e2d-af1e-16576ca9165c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71731) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 16:40:23 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Compute_service record updated for user:user {{(pid=71731) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 16:40:23 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.275s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:40:24 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:40:24 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:40:24 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71731) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 16:40:26 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:40:26 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Starting heal instance info cache {{(pid=71731) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 16:40:26 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Rebuilding the list of instances to heal {{(pid=71731) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 13 16:40:26 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Acquiring lock "refresh_cache-5ed800fe-577d-4624-898c-c7f40da77376" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 16:40:26 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Acquired lock "refresh_cache-5ed800fe-577d-4624-898c-c7f40da77376" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 16:40:26 user nova-compute[71731]: DEBUG nova.network.neutron [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] [instance: 5ed800fe-577d-4624-898c-c7f40da77376] Forcefully refreshing network info cache for instance {{(pid=71731) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 16:40:26 user nova-compute[71731]: DEBUG nova.objects.instance [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lazy-loading 'info_cache' on Instance uuid 5ed800fe-577d-4624-898c-c7f40da77376 {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:40:26 user nova-compute[71731]: DEBUG nova.network.neutron [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] [instance: 5ed800fe-577d-4624-898c-c7f40da77376] Updating instance_info_cache with network_info: [{"id": "09531419-c0ff-4d13-89bd-06caa28e019d", "address": "fa:16:3e:13:b1:31", "network": {"id": "cf1fef97-9ef1-449f-a302-b38110024547", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1138167711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "980559734a504574a83224deb7423c77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09531419-c0", "ovs_interfaceid": "09531419-c0ff-4d13-89bd-06caa28e019d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:40:26 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Releasing lock "refresh_cache-5ed800fe-577d-4624-898c-c7f40da77376" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 16:40:26 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] [instance: 5ed800fe-577d-4624-898c-c7f40da77376] Updated the network info_cache for instance {{(pid=71731) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 16:40:27 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:40:27 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:40:28 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:40:28 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:40:30 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:40:32 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:40:32 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:40:33 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:40:35 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:40:37 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:40:38 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:40:42 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:40:43 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:40:44 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:40:48 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:40:49 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:40:52 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:40:52 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:40:53 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:40:53 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-dce8a6c6-24db-46e7-821c-beefda666677 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Acquiring lock "b2d55cdd-c89c-4c59-afe1-49a33225af22" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:40:53 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-dce8a6c6-24db-46e7-821c-beefda666677 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lock "b2d55cdd-c89c-4c59-afe1-49a33225af22" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:40:53 user nova-compute[71731]: DEBUG nova.compute.manager [None req-dce8a6c6-24db-46e7-821c-beefda666677 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] [instance: b2d55cdd-c89c-4c59-afe1-49a33225af22] Starting instance... {{(pid=71731) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 16:40:53 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-dce8a6c6-24db-46e7-821c-beefda666677 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:40:53 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-dce8a6c6-24db-46e7-821c-beefda666677 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:40:53 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-dce8a6c6-24db-46e7-821c-beefda666677 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71731) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 16:40:53 user nova-compute[71731]: INFO nova.compute.claims [None req-dce8a6c6-24db-46e7-821c-beefda666677 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] [instance: b2d55cdd-c89c-4c59-afe1-49a33225af22] Claim successful on node user
Apr 13 16:40:54 user nova-compute[71731]: DEBUG nova.compute.provider_tree [None req-dce8a6c6-24db-46e7-821c-beefda666677 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Inventory has not changed in ProviderTree for provider: cb6b1a64-0c24-4e2d-af1e-16576ca9165c {{(pid=71731) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 16:40:54 user nova-compute[71731]: DEBUG nova.scheduler.client.report [None req-dce8a6c6-24db-46e7-821c-beefda666677 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Inventory has not changed for provider cb6b1a64-0c24-4e2d-af1e-16576ca9165c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71731) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 16:40:54 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-dce8a6c6-24db-46e7-821c-beefda666677 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.271s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:40:54 user nova-compute[71731]: DEBUG nova.compute.manager [None req-dce8a6c6-24db-46e7-821c-beefda666677 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] [instance: b2d55cdd-c89c-4c59-afe1-49a33225af22] Start building networks asynchronously for instance. {{(pid=71731) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 16:40:54 user nova-compute[71731]: DEBUG nova.compute.manager [None req-dce8a6c6-24db-46e7-821c-beefda666677 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] [instance: b2d55cdd-c89c-4c59-afe1-49a33225af22] Allocating IP information in the background. {{(pid=71731) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 16:40:54 user nova-compute[71731]: DEBUG nova.network.neutron [None req-dce8a6c6-24db-46e7-821c-beefda666677 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] [instance: b2d55cdd-c89c-4c59-afe1-49a33225af22] allocate_for_instance() {{(pid=71731) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 16:40:54 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-dce8a6c6-24db-46e7-821c-beefda666677 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] [instance: b2d55cdd-c89c-4c59-afe1-49a33225af22] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 16:40:54 user nova-compute[71731]: DEBUG nova.compute.manager [None req-dce8a6c6-24db-46e7-821c-beefda666677 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] [instance: b2d55cdd-c89c-4c59-afe1-49a33225af22] Start building block device mappings for instance. {{(pid=71731) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 16:40:54 user nova-compute[71731]: DEBUG nova.compute.manager [None req-dce8a6c6-24db-46e7-821c-beefda666677 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] [instance: b2d55cdd-c89c-4c59-afe1-49a33225af22] Start spawning the instance on the hypervisor. {{(pid=71731) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 16:40:54 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-dce8a6c6-24db-46e7-821c-beefda666677 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] [instance: b2d55cdd-c89c-4c59-afe1-49a33225af22] Creating instance directory {{(pid=71731) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 16:40:54 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-dce8a6c6-24db-46e7-821c-beefda666677 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] [instance: b2d55cdd-c89c-4c59-afe1-49a33225af22] Creating image(s)
Apr 13 16:40:54 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-dce8a6c6-24db-46e7-821c-beefda666677 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Acquiring lock "/opt/stack/data/nova/instances/b2d55cdd-c89c-4c59-afe1-49a33225af22/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:40:54 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-dce8a6c6-24db-46e7-821c-beefda666677 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lock "/opt/stack/data/nova/instances/b2d55cdd-c89c-4c59-afe1-49a33225af22/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:40:54 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-dce8a6c6-24db-46e7-821c-beefda666677 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lock "/opt/stack/data/nova/instances/b2d55cdd-c89c-4c59-afe1-49a33225af22/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:40:54 user nova-compute[71731]: DEBUG nova.policy [None req-dce8a6c6-24db-46e7-821c-beefda666677 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0c7f54723c494e05ada117353c0790cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '846732ecb7e047128b4684972d3cd8c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71731) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 16:40:54 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-dce8a6c6-24db-46e7-821c-beefda666677 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279 --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:40:54 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-dce8a6c6-24db-46e7-821c-beefda666677 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279 --force-share --output=json" returned: 0 in 0.140s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:40:54 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-dce8a6c6-24db-46e7-821c-beefda666677 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Acquiring lock "9524227dd898575c3099d3976f096cd935414279" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:40:54 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-dce8a6c6-24db-46e7-821c-beefda666677 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lock "9524227dd898575c3099d3976f096cd935414279" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:40:54 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-dce8a6c6-24db-46e7-821c-beefda666677 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279 --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:40:54 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-dce8a6c6-24db-46e7-821c-beefda666677 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279 --force-share --output=json" returned: 0 in 0.146s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:40:54 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-dce8a6c6-24db-46e7-821c-beefda666677 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279,backing_fmt=raw /opt/stack/data/nova/instances/b2d55cdd-c89c-4c59-afe1-49a33225af22/disk 1073741824 {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:40:54 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-dce8a6c6-24db-46e7-821c-beefda666677 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279,backing_fmt=raw /opt/stack/data/nova/instances/b2d55cdd-c89c-4c59-afe1-49a33225af22/disk 1073741824" returned: 0 in 0.057s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:40:54 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-dce8a6c6-24db-46e7-821c-beefda666677 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lock "9524227dd898575c3099d3976f096cd935414279" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.210s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:40:54 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-dce8a6c6-24db-46e7-821c-beefda666677 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279 --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:40:54 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-c592eb69-ccd6-4157-809c-6f29fe079b00 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Acquiring lock "3af23ff8-4e10-4fbf-a86e-bda842f084ff" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:40:54 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-c592eb69-ccd6-4157-809c-6f29fe079b00 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lock "3af23ff8-4e10-4fbf-a86e-bda842f084ff" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:40:54 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-dce8a6c6-24db-46e7-821c-beefda666677 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279 --force-share --output=json" returned: 0 in 0.152s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:40:54 user nova-compute[71731]: DEBUG nova.virt.disk.api [None req-dce8a6c6-24db-46e7-821c-beefda666677 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b2d55cdd-c89c-4c59-afe1-49a33225af22/disk. size=1073741824 {{(pid=71731) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 16:40:54 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-dce8a6c6-24db-46e7-821c-beefda666677 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2d55cdd-c89c-4c59-afe1-49a33225af22/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:40:54 user nova-compute[71731]: DEBUG nova.compute.manager [None req-c592eb69-ccd6-4157-809c-6f29fe079b00 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] [instance: 3af23ff8-4e10-4fbf-a86e-bda842f084ff] Starting instance... {{(pid=71731) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 16:40:54 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-c592eb69-ccd6-4157-809c-6f29fe079b00 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:40:54 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-c592eb69-ccd6-4157-809c-6f29fe079b00 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:40:54 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-c592eb69-ccd6-4157-809c-6f29fe079b00 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71731) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 16:40:54 user nova-compute[71731]: INFO nova.compute.claims [None req-c592eb69-ccd6-4157-809c-6f29fe079b00 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] [instance: 3af23ff8-4e10-4fbf-a86e-bda842f084ff] Claim successful on node user
Apr 13 16:40:54 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-dce8a6c6-24db-46e7-821c-beefda666677 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2d55cdd-c89c-4c59-afe1-49a33225af22/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:40:54 user nova-compute[71731]: DEBUG nova.virt.disk.api [None req-dce8a6c6-24db-46e7-821c-beefda666677 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Cannot resize image /opt/stack/data/nova/instances/b2d55cdd-c89c-4c59-afe1-49a33225af22/disk to a smaller size. {{(pid=71731) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 16:40:54 user nova-compute[71731]: DEBUG nova.objects.instance [None req-dce8a6c6-24db-46e7-821c-beefda666677 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lazy-loading 'migration_context' on Instance uuid b2d55cdd-c89c-4c59-afe1-49a33225af22 {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:40:54 user nova-compute[71731]: DEBUG nova.network.neutron [None req-dce8a6c6-24db-46e7-821c-beefda666677 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] [instance: b2d55cdd-c89c-4c59-afe1-49a33225af22] Successfully created port: 31e1957f-9bd1-42ae-a2ac-954b49ca15f1 {{(pid=71731) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 16:40:54 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-dce8a6c6-24db-46e7-821c-beefda666677 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] [instance: b2d55cdd-c89c-4c59-afe1-49a33225af22] Created local disks {{(pid=71731) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 16:40:54 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-dce8a6c6-24db-46e7-821c-beefda666677 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] [instance: b2d55cdd-c89c-4c59-afe1-49a33225af22] Ensure instance console log exists: /opt/stack/data/nova/instances/b2d55cdd-c89c-4c59-afe1-49a33225af22/console.log {{(pid=71731) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 16:40:54 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-dce8a6c6-24db-46e7-821c-beefda666677 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:40:55 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-dce8a6c6-24db-46e7-821c-beefda666677 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:40:55 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-dce8a6c6-24db-46e7-821c-beefda666677 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:40:55 user nova-compute[71731]: DEBUG nova.compute.provider_tree [None req-c592eb69-ccd6-4157-809c-6f29fe079b00 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Inventory has not changed in ProviderTree for provider: cb6b1a64-0c24-4e2d-af1e-16576ca9165c {{(pid=71731) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 16:40:55 user nova-compute[71731]: DEBUG nova.scheduler.client.report [None req-c592eb69-ccd6-4157-809c-6f29fe079b00 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Inventory has not changed for provider cb6b1a64-0c24-4e2d-af1e-16576ca9165c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71731) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 16:40:55 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-c592eb69-ccd6-4157-809c-6f29fe079b00 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.308s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:40:55 user nova-compute[71731]: DEBUG nova.compute.manager [None req-c592eb69-ccd6-4157-809c-6f29fe079b00 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] [instance: 3af23ff8-4e10-4fbf-a86e-bda842f084ff] Start building networks asynchronously for instance. {{(pid=71731) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 16:40:55 user nova-compute[71731]: DEBUG nova.compute.manager [None req-c592eb69-ccd6-4157-809c-6f29fe079b00 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] [instance: 3af23ff8-4e10-4fbf-a86e-bda842f084ff] Allocating IP information in the background. {{(pid=71731) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 16:40:55 user nova-compute[71731]: DEBUG nova.network.neutron [None req-c592eb69-ccd6-4157-809c-6f29fe079b00 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] [instance: 3af23ff8-4e10-4fbf-a86e-bda842f084ff] allocate_for_instance() {{(pid=71731) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 16:40:55 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-c592eb69-ccd6-4157-809c-6f29fe079b00 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] [instance: 3af23ff8-4e10-4fbf-a86e-bda842f084ff] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 16:40:55 user nova-compute[71731]: DEBUG nova.compute.manager [None req-c592eb69-ccd6-4157-809c-6f29fe079b00 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] [instance: 3af23ff8-4e10-4fbf-a86e-bda842f084ff] Start building block device mappings for instance. {{(pid=71731) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 16:40:55 user nova-compute[71731]: DEBUG nova.compute.manager [None req-c592eb69-ccd6-4157-809c-6f29fe079b00 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] [instance: 3af23ff8-4e10-4fbf-a86e-bda842f084ff] Start spawning the instance on the hypervisor. {{(pid=71731) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 16:40:55 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-c592eb69-ccd6-4157-809c-6f29fe079b00 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] [instance: 3af23ff8-4e10-4fbf-a86e-bda842f084ff] Creating instance directory {{(pid=71731) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 16:40:55 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-c592eb69-ccd6-4157-809c-6f29fe079b00 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] [instance: 3af23ff8-4e10-4fbf-a86e-bda842f084ff] Creating image(s)
Apr 13 16:40:55 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-c592eb69-ccd6-4157-809c-6f29fe079b00 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Acquiring lock "/opt/stack/data/nova/instances/3af23ff8-4e10-4fbf-a86e-bda842f084ff/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:40:55 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-c592eb69-ccd6-4157-809c-6f29fe079b00 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lock "/opt/stack/data/nova/instances/3af23ff8-4e10-4fbf-a86e-bda842f084ff/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:40:55 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-c592eb69-ccd6-4157-809c-6f29fe079b00 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lock "/opt/stack/data/nova/instances/3af23ff8-4e10-4fbf-a86e-bda842f084ff/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:40:55 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-c592eb69-ccd6-4157-809c-6f29fe079b00 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279 --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:40:55 user nova-compute[71731]: DEBUG nova.policy [None req-c592eb69-ccd6-4157-809c-6f29fe079b00 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0c7f54723c494e05ada117353c0790cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '846732ecb7e047128b4684972d3cd8c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71731) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 16:40:55 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-c592eb69-ccd6-4157-809c-6f29fe079b00 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279 --force-share --output=json" returned: 0 in 0.136s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:40:55 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-c592eb69-ccd6-4157-809c-6f29fe079b00 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Acquiring lock "9524227dd898575c3099d3976f096cd935414279" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:40:55 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-c592eb69-ccd6-4157-809c-6f29fe079b00 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lock "9524227dd898575c3099d3976f096cd935414279" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:40:55 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-c592eb69-ccd6-4157-809c-6f29fe079b00 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279 --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:40:55 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-c592eb69-ccd6-4157-809c-6f29fe079b00 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279 --force-share --output=json" returned: 0 in 0.138s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:40:55 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-c592eb69-ccd6-4157-809c-6f29fe079b00 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279,backing_fmt=raw /opt/stack/data/nova/instances/3af23ff8-4e10-4fbf-a86e-bda842f084ff/disk 1073741824 {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:40:55 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-c592eb69-ccd6-4157-809c-6f29fe079b00 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279,backing_fmt=raw /opt/stack/data/nova/instances/3af23ff8-4e10-4fbf-a86e-bda842f084ff/disk 1073741824" returned: 0 in 0.046s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:40:55 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-c592eb69-ccd6-4157-809c-6f29fe079b00 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lock "9524227dd898575c3099d3976f096cd935414279" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.190s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:40:55 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-c592eb69-ccd6-4157-809c-6f29fe079b00 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279 --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:40:55 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-c592eb69-ccd6-4157-809c-6f29fe079b00 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279 --force-share --output=json" returned: 0 in 0.139s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:40:55 user nova-compute[71731]: DEBUG nova.virt.disk.api [None req-c592eb69-ccd6-4157-809c-6f29fe079b00 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3af23ff8-4e10-4fbf-a86e-bda842f084ff/disk. size=1073741824 {{(pid=71731) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 16:40:55 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-c592eb69-ccd6-4157-809c-6f29fe079b00 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3af23ff8-4e10-4fbf-a86e-bda842f084ff/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:40:56 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-c592eb69-ccd6-4157-809c-6f29fe079b00 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3af23ff8-4e10-4fbf-a86e-bda842f084ff/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:40:56 user nova-compute[71731]: DEBUG nova.virt.disk.api [None req-c592eb69-ccd6-4157-809c-6f29fe079b00 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Cannot resize image /opt/stack/data/nova/instances/3af23ff8-4e10-4fbf-a86e-bda842f084ff/disk to a smaller size. {{(pid=71731) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 16:40:56 user nova-compute[71731]: DEBUG nova.objects.instance [None req-c592eb69-ccd6-4157-809c-6f29fe079b00 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lazy-loading 'migration_context' on Instance uuid 3af23ff8-4e10-4fbf-a86e-bda842f084ff {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:40:56 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-c592eb69-ccd6-4157-809c-6f29fe079b00 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] [instance: 3af23ff8-4e10-4fbf-a86e-bda842f084ff] Created local disks {{(pid=71731) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 16:40:56 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-c592eb69-ccd6-4157-809c-6f29fe079b00 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] [instance: 3af23ff8-4e10-4fbf-a86e-bda842f084ff] Ensure instance console log exists: /opt/stack/data/nova/instances/3af23ff8-4e10-4fbf-a86e-bda842f084ff/console.log {{(pid=71731) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 16:40:56 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-c592eb69-ccd6-4157-809c-6f29fe079b00 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:40:56 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-c592eb69-ccd6-4157-809c-6f29fe079b00 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:40:56 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-c592eb69-ccd6-4157-809c-6f29fe079b00 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:40:56 user nova-compute[71731]: DEBUG nova.network.neutron [None req-dce8a6c6-24db-46e7-821c-beefda666677 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] [instance: b2d55cdd-c89c-4c59-afe1-49a33225af22] Successfully updated port: 31e1957f-9bd1-42ae-a2ac-954b49ca15f1 {{(pid=71731) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 16:40:56 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-dce8a6c6-24db-46e7-821c-beefda666677 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Acquiring lock "refresh_cache-b2d55cdd-c89c-4c59-afe1-49a33225af22" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 16:40:56 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-dce8a6c6-24db-46e7-821c-beefda666677 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Acquired lock "refresh_cache-b2d55cdd-c89c-4c59-afe1-49a33225af22" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 16:40:56 user nova-compute[71731]: DEBUG nova.network.neutron [None req-dce8a6c6-24db-46e7-821c-beefda666677 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] [instance: b2d55cdd-c89c-4c59-afe1-49a33225af22] Building network info cache for instance {{(pid=71731) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 16:40:56 user nova-compute[71731]: DEBUG nova.compute.manager [req-6fdeec37-0487-4d50-a7a2-b1c07ea138f9 req-2e01e843-1f31-4ebb-b2aa-6e0aeedd1205 service nova] [instance: b2d55cdd-c89c-4c59-afe1-49a33225af22] Received event network-changed-31e1957f-9bd1-42ae-a2ac-954b49ca15f1 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:40:56 user nova-compute[71731]: DEBUG nova.compute.manager [req-6fdeec37-0487-4d50-a7a2-b1c07ea138f9 req-2e01e843-1f31-4ebb-b2aa-6e0aeedd1205 service nova] [instance: b2d55cdd-c89c-4c59-afe1-49a33225af22] Refreshing instance network info cache due to event network-changed-31e1957f-9bd1-42ae-a2ac-954b49ca15f1. {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 16:40:56 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-6fdeec37-0487-4d50-a7a2-b1c07ea138f9 req-2e01e843-1f31-4ebb-b2aa-6e0aeedd1205 service nova] Acquiring lock "refresh_cache-b2d55cdd-c89c-4c59-afe1-49a33225af22" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 16:40:56 user nova-compute[71731]: DEBUG nova.network.neutron [None req-dce8a6c6-24db-46e7-821c-beefda666677 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] [instance: b2d55cdd-c89c-4c59-afe1-49a33225af22] Instance cache missing network info. {{(pid=71731) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 16:40:56 user nova-compute[71731]: DEBUG nova.network.neutron [None req-c592eb69-ccd6-4157-809c-6f29fe079b00 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] [instance: 3af23ff8-4e10-4fbf-a86e-bda842f084ff] Successfully created port: b22086e3-8769-494c-af86-228dba7b3638 {{(pid=71731) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 16:40:56 user nova-compute[71731]: DEBUG nova.network.neutron [None req-dce8a6c6-24db-46e7-821c-beefda666677 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] [instance: b2d55cdd-c89c-4c59-afe1-49a33225af22] Updating instance_info_cache with network_info: [{"id": "31e1957f-9bd1-42ae-a2ac-954b49ca15f1", "address": "fa:16:3e:81:e2:10", "network": {"id": "2a5b69f1-fc5b-4c33-a9eb-12a4d9293500", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2137344591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "846732ecb7e047128b4684972d3cd8c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31e1957f-9b", "ovs_interfaceid": "31e1957f-9bd1-42ae-a2ac-954b49ca15f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:40:57 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-dce8a6c6-24db-46e7-821c-beefda666677 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Releasing lock "refresh_cache-b2d55cdd-c89c-4c59-afe1-49a33225af22" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 16:40:57 user nova-compute[71731]: DEBUG nova.compute.manager [None req-dce8a6c6-24db-46e7-821c-beefda666677 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] [instance: b2d55cdd-c89c-4c59-afe1-49a33225af22] Instance network_info: |[{"id": "31e1957f-9bd1-42ae-a2ac-954b49ca15f1", "address": "fa:16:3e:81:e2:10", "network": {"id": "2a5b69f1-fc5b-4c33-a9eb-12a4d9293500", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2137344591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "846732ecb7e047128b4684972d3cd8c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31e1957f-9b", "ovs_interfaceid": "31e1957f-9bd1-42ae-a2ac-954b49ca15f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71731) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 16:40:57 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-6fdeec37-0487-4d50-a7a2-b1c07ea138f9 req-2e01e843-1f31-4ebb-b2aa-6e0aeedd1205 service nova] Acquired lock "refresh_cache-b2d55cdd-c89c-4c59-afe1-49a33225af22" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 16:40:57 user nova-compute[71731]: DEBUG nova.network.neutron [req-6fdeec37-0487-4d50-a7a2-b1c07ea138f9 req-2e01e843-1f31-4ebb-b2aa-6e0aeedd1205 service nova] [instance: b2d55cdd-c89c-4c59-afe1-49a33225af22] Refreshing network info cache for port 31e1957f-9bd1-42ae-a2ac-954b49ca15f1 {{(pid=71731) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 16:40:57 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-dce8a6c6-24db-46e7-821c-beefda666677 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] [instance: b2d55cdd-c89c-4c59-afe1-49a33225af22] Start _get_guest_xml network_info=[{"id": "31e1957f-9bd1-42ae-a2ac-954b49ca15f1", "address": "fa:16:3e:81:e2:10", "network": {"id": "2a5b69f1-fc5b-4c33-a9eb-12a4d9293500", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2137344591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "846732ecb7e047128b4684972d3cd8c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31e1957f-9b", "ovs_interfaceid": "31e1957f-9bd1-42ae-a2ac-954b49ca15f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T16:16:31Z,direct_url=<?>,disk_format='qcow2',id=708622a9-7465-4492-ade8-b827198f7e30,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='0b29a975c552465aba0ac7d6288434bd',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T16:16:33Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'device_type': 'disk', 'encrypted': False, 'disk_bus': 'virtio', 'guest_format': None, 'encryption_options': None, 'image_id': '708622a9-7465-4492-ade8-b827198f7e30'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71731) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 16:40:57 user nova-compute[71731]: WARNING nova.virt.libvirt.driver [None req-dce8a6c6-24db-46e7-821c-beefda666677 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 16:40:57 user nova-compute[71731]: WARNING nova.virt.libvirt.driver [None req-dce8a6c6-24db-46e7-821c-beefda666677 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 16:40:57 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-dce8a6c6-24db-46e7-821c-beefda666677 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71731) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 16:40:57 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-dce8a6c6-24db-46e7-821c-beefda666677 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T16:17:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T16:16:31Z,direct_url=<?>,disk_format='qcow2',id=708622a9-7465-4492-ade8-b827198f7e30,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='0b29a975c552465aba0ac7d6288434bd',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T16:16:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 16:40:57 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-dce8a6c6-24db-46e7-821c-beefda666677 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Flavor limits 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 16:40:57 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-dce8a6c6-24db-46e7-821c-beefda666677 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Image limits 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 16:40:57 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-dce8a6c6-24db-46e7-821c-beefda666677 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Flavor pref 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 16:40:57 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-dce8a6c6-24db-46e7-821c-beefda666677 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Image pref 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 16:40:57 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-dce8a6c6-24db-46e7-821c-beefda666677 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 16:40:57 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-dce8a6c6-24db-46e7-821c-beefda666677 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 16:40:57 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-dce8a6c6-24db-46e7-821c-beefda666677 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71731) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 16:40:57 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-dce8a6c6-24db-46e7-821c-beefda666677 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Got 1 possible topologies {{(pid=71731) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 16:40:57 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-dce8a6c6-24db-46e7-821c-beefda666677 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 16:40:57 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-dce8a6c6-24db-46e7-821c-beefda666677 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 16:40:57 user nova-compute[71731]: DEBUG nova.virt.libvirt.vif [None req-dce8a6c6-24db-46e7-821c-beefda666677 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T16:40:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-862659387',display_name='tempest-ServerRescueNegativeTestJSON-server-862659387',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-862659387',id=36,image_ref='708622a9-7465-4492-ade8-b827198f7e30',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='846732ecb7e047128b4684972d3cd8c6',ramdisk_id='',reservation_id='r-6w8n5dk1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='708622a9-7465-4492-ade8-b827198f7e30',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-84287455',owner_user_name='tempest-ServerRescueNegativeTestJSON-84287455-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T16:40:54Z,user_data=None,user_id='0c7f54723c494e05ada117353c0790cb',uuid=b2d55cdd-c89c-4c59-afe1-49a33225af22,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "31e1957f-9bd1-42ae-a2ac-954b49ca15f1", "address": "fa:16:3e:81:e2:10", "network": {"id": "2a5b69f1-fc5b-4c33-a9eb-12a4d9293500", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2137344591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "846732ecb7e047128b4684972d3cd8c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31e1957f-9b", "ovs_interfaceid": "31e1957f-9bd1-42ae-a2ac-954b49ca15f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71731) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 16:40:57 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-dce8a6c6-24db-46e7-821c-beefda666677 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Converting VIF {"id": "31e1957f-9bd1-42ae-a2ac-954b49ca15f1", "address": "fa:16:3e:81:e2:10", "network": {"id": "2a5b69f1-fc5b-4c33-a9eb-12a4d9293500", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2137344591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "846732ecb7e047128b4684972d3cd8c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31e1957f-9b", "ovs_interfaceid": "31e1957f-9bd1-42ae-a2ac-954b49ca15f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 16:40:57 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-dce8a6c6-24db-46e7-821c-beefda666677 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:81:e2:10,bridge_name='br-int',has_traffic_filtering=True,id=31e1957f-9bd1-42ae-a2ac-954b49ca15f1,network=Network(2a5b69f1-fc5b-4c33-a9eb-12a4d9293500),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31e1957f-9b') {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 16:40:57 user nova-compute[71731]: DEBUG nova.objects.instance [None req-dce8a6c6-24db-46e7-821c-beefda666677 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lazy-loading 'pci_devices' on Instance uuid b2d55cdd-c89c-4c59-afe1-49a33225af22 {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:40:57 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:40:57 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-dce8a6c6-24db-46e7-821c-beefda666677 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] [instance: b2d55cdd-c89c-4c59-afe1-49a33225af22] End _get_guest_xml xml=<domain type="kvm">
Apr 13 16:40:57 user nova-compute[71731]:   <uuid>b2d55cdd-c89c-4c59-afe1-49a33225af22</uuid>
Apr 13 16:40:57 user nova-compute[71731]:   <name>instance-00000024</name>
Apr 13 16:40:57 user nova-compute[71731]:   <memory>131072</memory>
Apr 13 16:40:57 user nova-compute[71731]:   <vcpu>1</vcpu>
Apr 13 16:40:57 user nova-compute[71731]:   <metadata>
Apr 13 16:40:57 user nova-compute[71731]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 16:40:57 user nova-compute[71731]:       <nova:package version="0.0.0"/>
Apr 13 16:40:57 user nova-compute[71731]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-862659387</nova:name>
Apr 13 16:40:57 user nova-compute[71731]:       <nova:creationTime>2023-04-13 16:40:57</nova:creationTime>
Apr 13 16:40:57 user nova-compute[71731]:       <nova:flavor name="m1.nano">
Apr 13 16:40:57 user nova-compute[71731]:         <nova:memory>128</nova:memory>
Apr 13 16:40:57 user nova-compute[71731]:         <nova:disk>1</nova:disk>
Apr 13 16:40:57 user nova-compute[71731]:         <nova:swap>0</nova:swap>
Apr 13 16:40:57 user nova-compute[71731]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 16:40:57 user nova-compute[71731]:         <nova:vcpus>1</nova:vcpus>
Apr 13 16:40:57 user nova-compute[71731]:       </nova:flavor>
Apr 13 16:40:57 user nova-compute[71731]:       <nova:owner>
Apr 13 16:40:57 user nova-compute[71731]:         <nova:user uuid="0c7f54723c494e05ada117353c0790cb">tempest-ServerRescueNegativeTestJSON-84287455-project-member</nova:user>
Apr 13 16:40:57 user nova-compute[71731]:         <nova:project uuid="846732ecb7e047128b4684972d3cd8c6">tempest-ServerRescueNegativeTestJSON-84287455</nova:project>
Apr 13 16:40:57 user nova-compute[71731]:       </nova:owner>
Apr 13 16:40:57 user nova-compute[71731]:       <nova:root type="image" uuid="708622a9-7465-4492-ade8-b827198f7e30"/>
Apr 13 16:40:57 user nova-compute[71731]:       <nova:ports>
Apr 13 16:40:57 user nova-compute[71731]:         <nova:port uuid="31e1957f-9bd1-42ae-a2ac-954b49ca15f1">
Apr 13 16:40:57 user nova-compute[71731]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Apr 13 16:40:57 user nova-compute[71731]:         </nova:port>
Apr 13 16:40:57 user nova-compute[71731]:       </nova:ports>
Apr 13 16:40:57 user nova-compute[71731]:     </nova:instance>
Apr 13 16:40:57 user nova-compute[71731]:   </metadata>
Apr 13 16:40:57 user nova-compute[71731]:   <sysinfo type="smbios">
Apr 13 16:40:57 user nova-compute[71731]:     <system>
Apr 13 16:40:57 user nova-compute[71731]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 16:40:57 user nova-compute[71731]:       <entry name="product">OpenStack Nova</entry>
Apr 13 16:40:57 user nova-compute[71731]:       <entry name="version">0.0.0</entry>
Apr 13 16:40:57 user nova-compute[71731]:       <entry name="serial">b2d55cdd-c89c-4c59-afe1-49a33225af22</entry>
Apr 13 16:40:57 user nova-compute[71731]:       <entry name="uuid">b2d55cdd-c89c-4c59-afe1-49a33225af22</entry>
Apr 13 16:40:57 user nova-compute[71731]:       <entry name="family">Virtual Machine</entry>
Apr 13 16:40:57 user nova-compute[71731]:     </system>
Apr 13 16:40:57 user nova-compute[71731]:   </sysinfo>
Apr 13 16:40:57 user nova-compute[71731]:   <os>
Apr 13 16:40:57 user nova-compute[71731]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 16:40:57 user nova-compute[71731]:     <boot dev="hd"/>
Apr 13 16:40:57 user nova-compute[71731]:     <smbios mode="sysinfo"/>
Apr 13 16:40:57 user nova-compute[71731]:   </os>
Apr 13 16:40:57 user nova-compute[71731]:   <features>
Apr 13 16:40:57 user nova-compute[71731]:     <acpi/>
Apr 13 16:40:57 user nova-compute[71731]:     <apic/>
Apr 13 16:40:57 user nova-compute[71731]:     <vmcoreinfo/>
Apr 13 16:40:57 user nova-compute[71731]:   </features>
Apr 13 16:40:57 user nova-compute[71731]:   <clock offset="utc">
Apr 13 16:40:57 user nova-compute[71731]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 16:40:57 user nova-compute[71731]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 16:40:57 user nova-compute[71731]:     <timer name="hpet" present="no"/>
Apr 13 16:40:57 user nova-compute[71731]:   </clock>
Apr 13 16:40:57 user nova-compute[71731]:   <cpu mode="custom" match="exact">
Apr 13 16:40:57 user nova-compute[71731]:     <model>Nehalem</model>
Apr 13 16:40:57 user nova-compute[71731]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 16:40:57 user nova-compute[71731]:   </cpu>
Apr 13 16:40:57 user nova-compute[71731]:   <devices>
Apr 13 16:40:57 user nova-compute[71731]:     <disk type="file" device="disk">
Apr 13 16:40:57 user nova-compute[71731]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 16:40:57 user nova-compute[71731]:       <source file="/opt/stack/data/nova/instances/b2d55cdd-c89c-4c59-afe1-49a33225af22/disk"/>
Apr 13 16:40:57 user nova-compute[71731]:       <target dev="vda" bus="virtio"/>
Apr 13 16:40:57 user nova-compute[71731]:     </disk>
Apr 13 16:40:57 user nova-compute[71731]:     <interface type="ethernet">
Apr 13 16:40:57 user nova-compute[71731]:       <mac address="fa:16:3e:81:e2:10"/>
Apr 13 16:40:57 user nova-compute[71731]:       <model type="virtio"/>
Apr 13 16:40:57 user nova-compute[71731]:       <mtu size="1442"/>
Apr 13 16:40:57 user nova-compute[71731]:       <target dev="tap31e1957f-9b"/>
Apr 13 16:40:57 user nova-compute[71731]:     </interface>
Apr 13 16:40:57 user nova-compute[71731]:     <serial type="pty">
Apr 13 16:40:57 user nova-compute[71731]:       <log file="/opt/stack/data/nova/instances/b2d55cdd-c89c-4c59-afe1-49a33225af22/console.log" append="off"/>
Apr 13 16:40:57 user nova-compute[71731]:     </serial>
Apr 13 16:40:57 user nova-compute[71731]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 16:40:57 user nova-compute[71731]:     <video>
Apr 13 16:40:57 user nova-compute[71731]:       <model type="virtio"/>
Apr 13 16:40:57 user nova-compute[71731]:     </video>
Apr 13 16:40:57 user nova-compute[71731]:     <rng model="virtio">
Apr 13 16:40:57 user nova-compute[71731]:       <backend model="random">/dev/urandom</backend>
Apr 13 16:40:57 user nova-compute[71731]:     </rng>
Apr 13 16:40:57 user nova-compute[71731]:     <controller type="usb" index="0" model="none"/>
Apr 13 16:40:57 user nova-compute[71731]:     <memballoon model="virtio">
Apr 13 16:40:57 user nova-compute[71731]:       <stats period="10"/>
Apr 13 16:40:57 user nova-compute[71731]:     </memballoon>
Apr 13 16:40:57 user nova-compute[71731]:   </devices>
Apr 13 16:40:57 user nova-compute[71731]: </domain>
Apr 13 16:40:57 user nova-compute[71731]:  {{(pid=71731) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 16:40:57 user nova-compute[71731]: DEBUG nova.virt.libvirt.vif [None req-dce8a6c6-24db-46e7-821c-beefda666677 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T16:40:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-862659387',display_name='tempest-ServerRescueNegativeTestJSON-server-862659387',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-862659387',id=36,image_ref='708622a9-7465-4492-ade8-b827198f7e30',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='846732ecb7e047128b4684972d3cd8c6',ramdisk_id='',reservation_id='r-6w8n5dk1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='708622a9-7465-4492-ade8-b827198f7e30',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-84287455',owner_user_name='tempest-ServerRescueNegativeTestJSON-84287455-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T16:40:54Z,user_data=None,user_id='0c7f54723c494e05ada117353c0790cb',uuid=b2d55cdd-c89c-4c59-afe1-49a33225af22,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "31e1957f-9bd1-42ae-a2ac-954b49ca15f1", "address": "fa:16:3e:81:e2:10", "network": {"id": "2a5b69f1-fc5b-4c33-a9eb-12a4d9293500", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2137344591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "846732ecb7e047128b4684972d3cd8c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31e1957f-9b", "ovs_interfaceid": "31e1957f-9bd1-42ae-a2ac-954b49ca15f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 16:40:57 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-dce8a6c6-24db-46e7-821c-beefda666677 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Converting VIF {"id": "31e1957f-9bd1-42ae-a2ac-954b49ca15f1", "address": "fa:16:3e:81:e2:10", "network": {"id": "2a5b69f1-fc5b-4c33-a9eb-12a4d9293500", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2137344591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "846732ecb7e047128b4684972d3cd8c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31e1957f-9b", "ovs_interfaceid": "31e1957f-9bd1-42ae-a2ac-954b49ca15f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 16:40:57 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-dce8a6c6-24db-46e7-821c-beefda666677 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:81:e2:10,bridge_name='br-int',has_traffic_filtering=True,id=31e1957f-9bd1-42ae-a2ac-954b49ca15f1,network=Network(2a5b69f1-fc5b-4c33-a9eb-12a4d9293500),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31e1957f-9b') {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 16:40:57 user nova-compute[71731]: DEBUG os_vif [None req-dce8a6c6-24db-46e7-821c-beefda666677 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:e2:10,bridge_name='br-int',has_traffic_filtering=True,id=31e1957f-9bd1-42ae-a2ac-954b49ca15f1,network=Network(2a5b69f1-fc5b-4c33-a9eb-12a4d9293500),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31e1957f-9b') {{(pid=71731) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 16:40:57 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:40:57 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:40:57 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 16:40:57 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:40:57 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap31e1957f-9b, may_exist=True) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:40:57 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap31e1957f-9b, col_values=(('external_ids', {'iface-id': '31e1957f-9bd1-42ae-a2ac-954b49ca15f1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:81:e2:10', 'vm-uuid': 'b2d55cdd-c89c-4c59-afe1-49a33225af22'}),)) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:40:57 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:40:57 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 16:40:57 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:40:57 user nova-compute[71731]: INFO os_vif [None req-dce8a6c6-24db-46e7-821c-beefda666677 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:e2:10,bridge_name='br-int',has_traffic_filtering=True,id=31e1957f-9bd1-42ae-a2ac-954b49ca15f1,network=Network(2a5b69f1-fc5b-4c33-a9eb-12a4d9293500),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31e1957f-9b')
Apr 13 16:40:57 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-dce8a6c6-24db-46e7-821c-beefda666677 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] No BDM found with device name vda, not building metadata. {{(pid=71731) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 16:40:57 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-dce8a6c6-24db-46e7-821c-beefda666677 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] No VIF found with MAC fa:16:3e:81:e2:10, not building metadata {{(pid=71731) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 16:40:57 user nova-compute[71731]: DEBUG nova.network.neutron [req-6fdeec37-0487-4d50-a7a2-b1c07ea138f9 req-2e01e843-1f31-4ebb-b2aa-6e0aeedd1205 service nova] [instance: b2d55cdd-c89c-4c59-afe1-49a33225af22] Updated VIF entry in instance network info cache for port 31e1957f-9bd1-42ae-a2ac-954b49ca15f1. {{(pid=71731) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 16:40:57 user nova-compute[71731]: DEBUG nova.network.neutron [req-6fdeec37-0487-4d50-a7a2-b1c07ea138f9 req-2e01e843-1f31-4ebb-b2aa-6e0aeedd1205 service nova] [instance: b2d55cdd-c89c-4c59-afe1-49a33225af22] Updating instance_info_cache with network_info: [{"id": "31e1957f-9bd1-42ae-a2ac-954b49ca15f1", "address": "fa:16:3e:81:e2:10", "network": {"id": "2a5b69f1-fc5b-4c33-a9eb-12a4d9293500", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2137344591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "846732ecb7e047128b4684972d3cd8c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31e1957f-9b", "ovs_interfaceid": "31e1957f-9bd1-42ae-a2ac-954b49ca15f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:40:57 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-6fdeec37-0487-4d50-a7a2-b1c07ea138f9 req-2e01e843-1f31-4ebb-b2aa-6e0aeedd1205 service nova] Releasing lock "refresh_cache-b2d55cdd-c89c-4c59-afe1-49a33225af22" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 16:40:57 user nova-compute[71731]: DEBUG nova.network.neutron [None req-c592eb69-ccd6-4157-809c-6f29fe079b00 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] [instance: 3af23ff8-4e10-4fbf-a86e-bda842f084ff] Successfully updated port: b22086e3-8769-494c-af86-228dba7b3638 {{(pid=71731) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 16:40:57 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-c592eb69-ccd6-4157-809c-6f29fe079b00 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Acquiring lock "refresh_cache-3af23ff8-4e10-4fbf-a86e-bda842f084ff" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 16:40:57 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-c592eb69-ccd6-4157-809c-6f29fe079b00 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Acquired lock "refresh_cache-3af23ff8-4e10-4fbf-a86e-bda842f084ff" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 16:40:57 user nova-compute[71731]: DEBUG nova.network.neutron [None req-c592eb69-ccd6-4157-809c-6f29fe079b00 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] [instance: 3af23ff8-4e10-4fbf-a86e-bda842f084ff] Building network info cache for instance {{(pid=71731) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 16:40:57 user nova-compute[71731]: DEBUG nova.network.neutron [None req-c592eb69-ccd6-4157-809c-6f29fe079b00 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] [instance: 3af23ff8-4e10-4fbf-a86e-bda842f084ff] Instance cache missing network info. {{(pid=71731) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 16:40:58 user nova-compute[71731]: DEBUG nova.network.neutron [None req-c592eb69-ccd6-4157-809c-6f29fe079b00 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] [instance: 3af23ff8-4e10-4fbf-a86e-bda842f084ff] Updating instance_info_cache with network_info: [{"id": "b22086e3-8769-494c-af86-228dba7b3638", "address": "fa:16:3e:84:ee:e5", "network": {"id": "2a5b69f1-fc5b-4c33-a9eb-12a4d9293500", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2137344591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "846732ecb7e047128b4684972d3cd8c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb22086e3-87", "ovs_interfaceid": "b22086e3-8769-494c-af86-228dba7b3638", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:40:58 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-c592eb69-ccd6-4157-809c-6f29fe079b00 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Releasing lock "refresh_cache-3af23ff8-4e10-4fbf-a86e-bda842f084ff" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 16:40:58 user nova-compute[71731]: DEBUG nova.compute.manager [None req-c592eb69-ccd6-4157-809c-6f29fe079b00 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] [instance: 3af23ff8-4e10-4fbf-a86e-bda842f084ff] Instance network_info: |[{"id": "b22086e3-8769-494c-af86-228dba7b3638", "address": "fa:16:3e:84:ee:e5", "network": {"id": "2a5b69f1-fc5b-4c33-a9eb-12a4d9293500", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2137344591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "846732ecb7e047128b4684972d3cd8c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb22086e3-87", "ovs_interfaceid": "b22086e3-8769-494c-af86-228dba7b3638", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71731) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 16:40:58 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-c592eb69-ccd6-4157-809c-6f29fe079b00 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] [instance: 3af23ff8-4e10-4fbf-a86e-bda842f084ff] Start _get_guest_xml network_info=[{"id": "b22086e3-8769-494c-af86-228dba7b3638", "address": "fa:16:3e:84:ee:e5", "network": {"id": "2a5b69f1-fc5b-4c33-a9eb-12a4d9293500", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2137344591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "846732ecb7e047128b4684972d3cd8c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb22086e3-87", "ovs_interfaceid": "b22086e3-8769-494c-af86-228dba7b3638", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T16:16:31Z,direct_url=<?>,disk_format='qcow2',id=708622a9-7465-4492-ade8-b827198f7e30,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='0b29a975c552465aba0ac7d6288434bd',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T16:16:33Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'device_type': 'disk', 'encrypted': False, 'disk_bus': 'virtio', 'guest_format': None, 'encryption_options': None, 'image_id': '708622a9-7465-4492-ade8-b827198f7e30'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71731) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 16:40:58 user nova-compute[71731]: WARNING nova.virt.libvirt.driver [None req-c592eb69-ccd6-4157-809c-6f29fe079b00 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 16:40:58 user nova-compute[71731]: WARNING nova.virt.libvirt.driver [None req-c592eb69-ccd6-4157-809c-6f29fe079b00 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 16:40:58 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-c592eb69-ccd6-4157-809c-6f29fe079b00 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71731) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 16:40:58 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-c592eb69-ccd6-4157-809c-6f29fe079b00 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T16:17:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T16:16:31Z,direct_url=<?>,disk_format='qcow2',id=708622a9-7465-4492-ade8-b827198f7e30,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='0b29a975c552465aba0ac7d6288434bd',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T16:16:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 16:40:58 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-c592eb69-ccd6-4157-809c-6f29fe079b00 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Flavor limits 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 16:40:58 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-c592eb69-ccd6-4157-809c-6f29fe079b00 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Image limits 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 16:40:58 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-c592eb69-ccd6-4157-809c-6f29fe079b00 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Flavor pref 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 16:40:58 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-c592eb69-ccd6-4157-809c-6f29fe079b00 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Image pref 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 16:40:58 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-c592eb69-ccd6-4157-809c-6f29fe079b00 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 16:40:58 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-c592eb69-ccd6-4157-809c-6f29fe079b00 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 16:40:58 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-c592eb69-ccd6-4157-809c-6f29fe079b00 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71731) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 16:40:58 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-c592eb69-ccd6-4157-809c-6f29fe079b00 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Got 1 possible topologies {{(pid=71731) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 16:40:58 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-c592eb69-ccd6-4157-809c-6f29fe079b00 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 16:40:58 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-c592eb69-ccd6-4157-809c-6f29fe079b00 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 16:40:58 user nova-compute[71731]: DEBUG nova.virt.libvirt.vif [None req-c592eb69-ccd6-4157-809c-6f29fe079b00 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T16:40:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-297516343',display_name='tempest-ServerRescueNegativeTestJSON-server-297516343',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-297516343',id=37,image_ref='708622a9-7465-4492-ade8-b827198f7e30',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='846732ecb7e047128b4684972d3cd8c6',ramdisk_id='',reservation_id='r-unv20yee',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='708622a9-7465-4492-ade8-b827198f7e30',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-84287455',owner_user_name='tempest-ServerRescueNegativeTestJSON-84287455-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T16:40:55Z,user_data=None,user_id='0c7f54723c494e05ada117353c0790cb',uuid=3af23ff8-4e10-4fbf-a86e-bda842f084ff,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b22086e3-8769-494c-af86-228dba7b3638", "address": "fa:16:3e:84:ee:e5", "network": {"id": "2a5b69f1-fc5b-4c33-a9eb-12a4d9293500", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2137344591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "846732ecb7e047128b4684972d3cd8c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb22086e3-87", "ovs_interfaceid": "b22086e3-8769-494c-af86-228dba7b3638", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71731) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 16:40:58 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-c592eb69-ccd6-4157-809c-6f29fe079b00 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Converting VIF {"id": "b22086e3-8769-494c-af86-228dba7b3638", "address": "fa:16:3e:84:ee:e5", "network": {"id": "2a5b69f1-fc5b-4c33-a9eb-12a4d9293500", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2137344591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "846732ecb7e047128b4684972d3cd8c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb22086e3-87", "ovs_interfaceid": "b22086e3-8769-494c-af86-228dba7b3638", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 16:40:58 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-c592eb69-ccd6-4157-809c-6f29fe079b00 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:84:ee:e5,bridge_name='br-int',has_traffic_filtering=True,id=b22086e3-8769-494c-af86-228dba7b3638,network=Network(2a5b69f1-fc5b-4c33-a9eb-12a4d9293500),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb22086e3-87') {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 16:40:58 user nova-compute[71731]: DEBUG nova.objects.instance [None req-c592eb69-ccd6-4157-809c-6f29fe079b00 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lazy-loading 'pci_devices' on Instance uuid 3af23ff8-4e10-4fbf-a86e-bda842f084ff {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:40:58 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-c592eb69-ccd6-4157-809c-6f29fe079b00 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] [instance: 3af23ff8-4e10-4fbf-a86e-bda842f084ff] End _get_guest_xml xml=<domain type="kvm">
Apr 13 16:40:58 user nova-compute[71731]:   <uuid>3af23ff8-4e10-4fbf-a86e-bda842f084ff</uuid>
Apr 13 16:40:58 user nova-compute[71731]:   <name>instance-00000025</name>
Apr 13 16:40:58 user nova-compute[71731]:   <memory>131072</memory>
Apr 13 16:40:58 user nova-compute[71731]:   <vcpu>1</vcpu>
Apr 13 16:40:58 user nova-compute[71731]:   <metadata>
Apr 13 16:40:58 user nova-compute[71731]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 16:40:58 user nova-compute[71731]:       <nova:package version="0.0.0"/>
Apr 13 16:40:58 user nova-compute[71731]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-297516343</nova:name>
Apr 13 16:40:58 user nova-compute[71731]:       <nova:creationTime>2023-04-13 16:40:58</nova:creationTime>
Apr 13 16:40:58 user nova-compute[71731]:       <nova:flavor name="m1.nano">
Apr 13 16:40:58 user nova-compute[71731]:         <nova:memory>128</nova:memory>
Apr 13 16:40:58 user nova-compute[71731]:         <nova:disk>1</nova:disk>
Apr 13 16:40:58 user nova-compute[71731]:         <nova:swap>0</nova:swap>
Apr 13 16:40:58 user nova-compute[71731]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 16:40:58 user nova-compute[71731]:         <nova:vcpus>1</nova:vcpus>
Apr 13 16:40:58 user nova-compute[71731]:       </nova:flavor>
Apr 13 16:40:58 user nova-compute[71731]:       <nova:owner>
Apr 13 16:40:58 user nova-compute[71731]:         <nova:user uuid="0c7f54723c494e05ada117353c0790cb">tempest-ServerRescueNegativeTestJSON-84287455-project-member</nova:user>
Apr 13 16:40:58 user nova-compute[71731]:         <nova:project uuid="846732ecb7e047128b4684972d3cd8c6">tempest-ServerRescueNegativeTestJSON-84287455</nova:project>
Apr 13 16:40:58 user nova-compute[71731]:       </nova:owner>
Apr 13 16:40:58 user nova-compute[71731]:       <nova:root type="image" uuid="708622a9-7465-4492-ade8-b827198f7e30"/>
Apr 13 16:40:58 user nova-compute[71731]:       <nova:ports>
Apr 13 16:40:58 user nova-compute[71731]:         <nova:port uuid="b22086e3-8769-494c-af86-228dba7b3638">
Apr 13 16:40:58 user nova-compute[71731]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Apr 13 16:40:58 user nova-compute[71731]:         </nova:port>
Apr 13 16:40:58 user nova-compute[71731]:       </nova:ports>
Apr 13 16:40:58 user nova-compute[71731]:     </nova:instance>
Apr 13 16:40:58 user nova-compute[71731]:   </metadata>
Apr 13 16:40:58 user nova-compute[71731]:   <sysinfo type="smbios">
Apr 13 16:40:58 user nova-compute[71731]:     <system>
Apr 13 16:40:58 user nova-compute[71731]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 16:40:58 user nova-compute[71731]:       <entry name="product">OpenStack Nova</entry>
Apr 13 16:40:58 user nova-compute[71731]:       <entry name="version">0.0.0</entry>
Apr 13 16:40:58 user nova-compute[71731]:       <entry name="serial">3af23ff8-4e10-4fbf-a86e-bda842f084ff</entry>
Apr 13 16:40:58 user nova-compute[71731]:       <entry name="uuid">3af23ff8-4e10-4fbf-a86e-bda842f084ff</entry>
Apr 13 16:40:58 user nova-compute[71731]:       <entry name="family">Virtual Machine</entry>
Apr 13 16:40:58 user nova-compute[71731]:     </system>
Apr 13 16:40:58 user nova-compute[71731]:   </sysinfo>
Apr 13 16:40:58 user nova-compute[71731]:   <os>
Apr 13 16:40:58 user nova-compute[71731]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 16:40:58 user nova-compute[71731]:     <boot dev="hd"/>
Apr 13 16:40:58 user nova-compute[71731]:     <smbios mode="sysinfo"/>
Apr 13 16:40:58 user nova-compute[71731]:   </os>
Apr 13 16:40:58 user nova-compute[71731]:   <features>
Apr 13 16:40:58 user nova-compute[71731]:     <acpi/>
Apr 13 16:40:58 user nova-compute[71731]:     <apic/>
Apr 13 16:40:58 user nova-compute[71731]:     <vmcoreinfo/>
Apr 13 16:40:58 user nova-compute[71731]:   </features>
Apr 13 16:40:58 user nova-compute[71731]:   <clock offset="utc">
Apr 13 16:40:58 user nova-compute[71731]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 16:40:58 user nova-compute[71731]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 16:40:58 user nova-compute[71731]:     <timer name="hpet" present="no"/>
Apr 13 16:40:58 user nova-compute[71731]:   </clock>
Apr 13 16:40:58 user nova-compute[71731]:   <cpu mode="custom" match="exact">
Apr 13 16:40:58 user nova-compute[71731]:     <model>Nehalem</model>
Apr 13 16:40:58 user nova-compute[71731]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 16:40:58 user nova-compute[71731]:   </cpu>
Apr 13 16:40:58 user nova-compute[71731]:   <devices>
Apr 13 16:40:58 user nova-compute[71731]:     <disk type="file" device="disk">
Apr 13 16:40:58 user nova-compute[71731]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 16:40:58 user nova-compute[71731]:       <source file="/opt/stack/data/nova/instances/3af23ff8-4e10-4fbf-a86e-bda842f084ff/disk"/>
Apr 13 16:40:58 user nova-compute[71731]:       <target dev="vda" bus="virtio"/>
Apr 13 16:40:58 user nova-compute[71731]:     </disk>
Apr 13 16:40:58 user nova-compute[71731]:     <interface type="ethernet">
Apr 13 16:40:58 user nova-compute[71731]:       <mac address="fa:16:3e:84:ee:e5"/>
Apr 13 16:40:58 user nova-compute[71731]:       <model type="virtio"/>
Apr 13 16:40:58 user nova-compute[71731]:       <mtu size="1442"/>
Apr 13 16:40:58 user nova-compute[71731]:       <target dev="tapb22086e3-87"/>
Apr 13 16:40:58 user nova-compute[71731]:     </interface>
Apr 13 16:40:58 user nova-compute[71731]:     <serial type="pty">
Apr 13 16:40:58 user nova-compute[71731]:       <log file="/opt/stack/data/nova/instances/3af23ff8-4e10-4fbf-a86e-bda842f084ff/console.log" append="off"/>
Apr 13 16:40:58 user nova-compute[71731]:     </serial>
Apr 13 16:40:58 user nova-compute[71731]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 16:40:58 user nova-compute[71731]:     <video>
Apr 13 16:40:58 user nova-compute[71731]:       <model type="virtio"/>
Apr 13 16:40:58 user nova-compute[71731]:     </video>
Apr 13 16:40:58 user nova-compute[71731]:     <rng model="virtio">
Apr 13 16:40:58 user nova-compute[71731]:       <backend model="random">/dev/urandom</backend>
Apr 13 16:40:58 user nova-compute[71731]:     </rng>
Apr 13 16:40:58 user nova-compute[71731]:     <controller type="usb" index="0" model="none"/>
Apr 13 16:40:58 user nova-compute[71731]:     <memballoon model="virtio">
Apr 13 16:40:58 user nova-compute[71731]:       <stats period="10"/>
Apr 13 16:40:58 user nova-compute[71731]:     </memballoon>
Apr 13 16:40:58 user nova-compute[71731]:   </devices>
Apr 13 16:40:58 user nova-compute[71731]: </domain>
Apr 13 16:40:58 user nova-compute[71731]:  {{(pid=71731) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 16:40:58 user nova-compute[71731]: DEBUG nova.virt.libvirt.vif [None req-c592eb69-ccd6-4157-809c-6f29fe079b00 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T16:40:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-297516343',display_name='tempest-ServerRescueNegativeTestJSON-server-297516343',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-297516343',id=37,image_ref='708622a9-7465-4492-ade8-b827198f7e30',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='846732ecb7e047128b4684972d3cd8c6',ramdisk_id='',reservation_id='r-unv20yee',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='708622a9-7465-4492-ade8-b827198f7e30',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-84287455',owner_user_name='tempest-ServerRescueNegativeTestJSON-84287455-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T16:40:55Z,user_data=None,user_id='0c7f54723c494e05ada117353c0790cb',uuid=3af23ff8-4e10-4fbf-a86e-bda842f084ff,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b22086e3-8769-494c-af86-228dba7b3638", "address": "fa:16:3e:84:ee:e5", "network": {"id": "2a5b69f1-fc5b-4c33-a9eb-12a4d9293500", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2137344591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "846732ecb7e047128b4684972d3cd8c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb22086e3-87", "ovs_interfaceid": "b22086e3-8769-494c-af86-228dba7b3638", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 16:40:58 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-c592eb69-ccd6-4157-809c-6f29fe079b00 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Converting VIF {"id": "b22086e3-8769-494c-af86-228dba7b3638", "address": "fa:16:3e:84:ee:e5", "network": {"id": "2a5b69f1-fc5b-4c33-a9eb-12a4d9293500", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2137344591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "846732ecb7e047128b4684972d3cd8c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb22086e3-87", "ovs_interfaceid": "b22086e3-8769-494c-af86-228dba7b3638", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 16:40:58 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-c592eb69-ccd6-4157-809c-6f29fe079b00 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:84:ee:e5,bridge_name='br-int',has_traffic_filtering=True,id=b22086e3-8769-494c-af86-228dba7b3638,network=Network(2a5b69f1-fc5b-4c33-a9eb-12a4d9293500),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb22086e3-87') {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 16:40:58 user nova-compute[71731]: DEBUG os_vif [None req-c592eb69-ccd6-4157-809c-6f29fe079b00 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:84:ee:e5,bridge_name='br-int',has_traffic_filtering=True,id=b22086e3-8769-494c-af86-228dba7b3638,network=Network(2a5b69f1-fc5b-4c33-a9eb-12a4d9293500),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb22086e3-87') {{(pid=71731) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 16:40:58 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:40:58 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:40:58 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 16:40:58 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:40:58 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb22086e3-87, may_exist=True) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:40:58 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb22086e3-87, col_values=(('external_ids', {'iface-id': 'b22086e3-8769-494c-af86-228dba7b3638', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:84:ee:e5', 'vm-uuid': '3af23ff8-4e10-4fbf-a86e-bda842f084ff'}),)) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:40:58 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:40:58 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 16:40:58 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:40:58 user nova-compute[71731]: INFO os_vif [None req-c592eb69-ccd6-4157-809c-6f29fe079b00 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:84:ee:e5,bridge_name='br-int',has_traffic_filtering=True,id=b22086e3-8769-494c-af86-228dba7b3638,network=Network(2a5b69f1-fc5b-4c33-a9eb-12a4d9293500),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb22086e3-87')
Apr 13 16:40:58 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-c592eb69-ccd6-4157-809c-6f29fe079b00 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] No BDM found with device name vda, not building metadata. {{(pid=71731) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 16:40:58 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-c592eb69-ccd6-4157-809c-6f29fe079b00 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] No VIF found with MAC fa:16:3e:84:ee:e5, not building metadata {{(pid=71731) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 16:40:58 user nova-compute[71731]: DEBUG nova.compute.manager [req-19556248-8b76-4f7a-8724-f8eecdb047b9 req-e31b38c8-f152-40dd-b7a1-24160fa0ab52 service nova] [instance: 3af23ff8-4e10-4fbf-a86e-bda842f084ff] Received event network-changed-b22086e3-8769-494c-af86-228dba7b3638 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:40:58 user nova-compute[71731]: DEBUG nova.compute.manager [req-19556248-8b76-4f7a-8724-f8eecdb047b9 req-e31b38c8-f152-40dd-b7a1-24160fa0ab52 service nova] [instance: 3af23ff8-4e10-4fbf-a86e-bda842f084ff] Refreshing instance network info cache due to event network-changed-b22086e3-8769-494c-af86-228dba7b3638. {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 16:40:58 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-19556248-8b76-4f7a-8724-f8eecdb047b9 req-e31b38c8-f152-40dd-b7a1-24160fa0ab52 service nova] Acquiring lock "refresh_cache-3af23ff8-4e10-4fbf-a86e-bda842f084ff" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 16:40:58 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-19556248-8b76-4f7a-8724-f8eecdb047b9 req-e31b38c8-f152-40dd-b7a1-24160fa0ab52 service nova] Acquired lock "refresh_cache-3af23ff8-4e10-4fbf-a86e-bda842f084ff" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 16:40:58 user nova-compute[71731]: DEBUG nova.network.neutron [req-19556248-8b76-4f7a-8724-f8eecdb047b9 req-e31b38c8-f152-40dd-b7a1-24160fa0ab52 service nova] [instance: 3af23ff8-4e10-4fbf-a86e-bda842f084ff] Refreshing network info cache for port b22086e3-8769-494c-af86-228dba7b3638 {{(pid=71731) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 16:40:58 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:40:58 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:40:58 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:40:58 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:40:59 user nova-compute[71731]: DEBUG nova.compute.manager [req-b2a94289-90b1-4ec1-86e5-0e1f26d96f2e req-c82fd167-f3cb-4c3e-850d-c20d25bd80ae service nova] [instance: b2d55cdd-c89c-4c59-afe1-49a33225af22] Received event network-vif-plugged-31e1957f-9bd1-42ae-a2ac-954b49ca15f1 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:40:59 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-b2a94289-90b1-4ec1-86e5-0e1f26d96f2e req-c82fd167-f3cb-4c3e-850d-c20d25bd80ae service nova] Acquiring lock "b2d55cdd-c89c-4c59-afe1-49a33225af22-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:40:59 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-b2a94289-90b1-4ec1-86e5-0e1f26d96f2e req-c82fd167-f3cb-4c3e-850d-c20d25bd80ae service nova] Lock "b2d55cdd-c89c-4c59-afe1-49a33225af22-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:40:59 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-b2a94289-90b1-4ec1-86e5-0e1f26d96f2e req-c82fd167-f3cb-4c3e-850d-c20d25bd80ae service nova] Lock "b2d55cdd-c89c-4c59-afe1-49a33225af22-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:40:59 user nova-compute[71731]: DEBUG nova.compute.manager [req-b2a94289-90b1-4ec1-86e5-0e1f26d96f2e req-c82fd167-f3cb-4c3e-850d-c20d25bd80ae service nova] [instance: b2d55cdd-c89c-4c59-afe1-49a33225af22] No waiting events found dispatching network-vif-plugged-31e1957f-9bd1-42ae-a2ac-954b49ca15f1 {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:40:59 user nova-compute[71731]: WARNING nova.compute.manager [req-b2a94289-90b1-4ec1-86e5-0e1f26d96f2e req-c82fd167-f3cb-4c3e-850d-c20d25bd80ae service nova] [instance: b2d55cdd-c89c-4c59-afe1-49a33225af22] Received unexpected event network-vif-plugged-31e1957f-9bd1-42ae-a2ac-954b49ca15f1 for instance with vm_state building and task_state spawning.
Apr 13 16:40:59 user nova-compute[71731]: DEBUG nova.network.neutron [req-19556248-8b76-4f7a-8724-f8eecdb047b9 req-e31b38c8-f152-40dd-b7a1-24160fa0ab52 service nova] [instance: 3af23ff8-4e10-4fbf-a86e-bda842f084ff] Updated VIF entry in instance network info cache for port b22086e3-8769-494c-af86-228dba7b3638. {{(pid=71731) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 16:40:59 user nova-compute[71731]: DEBUG nova.network.neutron [req-19556248-8b76-4f7a-8724-f8eecdb047b9 req-e31b38c8-f152-40dd-b7a1-24160fa0ab52 service nova] [instance: 3af23ff8-4e10-4fbf-a86e-bda842f084ff] Updating instance_info_cache with network_info: [{"id": "b22086e3-8769-494c-af86-228dba7b3638", "address": "fa:16:3e:84:ee:e5", "network": {"id": "2a5b69f1-fc5b-4c33-a9eb-12a4d9293500", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2137344591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "846732ecb7e047128b4684972d3cd8c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb22086e3-87", "ovs_interfaceid": "b22086e3-8769-494c-af86-228dba7b3638", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:40:59 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-19556248-8b76-4f7a-8724-f8eecdb047b9 req-e31b38c8-f152-40dd-b7a1-24160fa0ab52 service nova] Releasing lock "refresh_cache-3af23ff8-4e10-4fbf-a86e-bda842f084ff" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 16:40:59 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:40:59 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:40:59 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:40:59 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:40:59 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:40:59 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:41:00 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:41:00 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:41:00 user nova-compute[71731]: DEBUG nova.compute.manager [req-f1200931-62d4-4465-b698-b5a3d563561c req-ea7cde2e-29d1-4ae3-ab0c-1396730edbc4 service nova] [instance: 3af23ff8-4e10-4fbf-a86e-bda842f084ff] Received event network-vif-plugged-b22086e3-8769-494c-af86-228dba7b3638 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:41:00 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-f1200931-62d4-4465-b698-b5a3d563561c req-ea7cde2e-29d1-4ae3-ab0c-1396730edbc4 service nova] Acquiring lock "3af23ff8-4e10-4fbf-a86e-bda842f084ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:41:00 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-f1200931-62d4-4465-b698-b5a3d563561c req-ea7cde2e-29d1-4ae3-ab0c-1396730edbc4 service nova] Lock "3af23ff8-4e10-4fbf-a86e-bda842f084ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:41:00 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-f1200931-62d4-4465-b698-b5a3d563561c req-ea7cde2e-29d1-4ae3-ab0c-1396730edbc4 service nova] Lock "3af23ff8-4e10-4fbf-a86e-bda842f084ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:41:00 user nova-compute[71731]: DEBUG nova.compute.manager [req-f1200931-62d4-4465-b698-b5a3d563561c req-ea7cde2e-29d1-4ae3-ab0c-1396730edbc4 service nova] [instance: 3af23ff8-4e10-4fbf-a86e-bda842f084ff] No waiting events found dispatching network-vif-plugged-b22086e3-8769-494c-af86-228dba7b3638 {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:41:00 user nova-compute[71731]: WARNING nova.compute.manager [req-f1200931-62d4-4465-b698-b5a3d563561c req-ea7cde2e-29d1-4ae3-ab0c-1396730edbc4 service nova] [instance: 3af23ff8-4e10-4fbf-a86e-bda842f084ff] Received unexpected event network-vif-plugged-b22086e3-8769-494c-af86-228dba7b3638 for instance with vm_state building and task_state spawning.
Apr 13 16:41:00 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:41:00 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:41:01 user nova-compute[71731]: DEBUG nova.compute.manager [req-9ada2fcb-9532-4036-b16d-f45d4941118b req-c800ab84-65c1-4e7d-afba-a74e8272e132 service nova] [instance: b2d55cdd-c89c-4c59-afe1-49a33225af22] Received event network-vif-plugged-31e1957f-9bd1-42ae-a2ac-954b49ca15f1 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:41:01 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-9ada2fcb-9532-4036-b16d-f45d4941118b req-c800ab84-65c1-4e7d-afba-a74e8272e132 service nova] Acquiring lock "b2d55cdd-c89c-4c59-afe1-49a33225af22-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:41:01 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-9ada2fcb-9532-4036-b16d-f45d4941118b req-c800ab84-65c1-4e7d-afba-a74e8272e132 service nova] Lock "b2d55cdd-c89c-4c59-afe1-49a33225af22-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:41:01 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-9ada2fcb-9532-4036-b16d-f45d4941118b req-c800ab84-65c1-4e7d-afba-a74e8272e132 service nova] Lock "b2d55cdd-c89c-4c59-afe1-49a33225af22-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:41:01 user nova-compute[71731]: DEBUG nova.compute.manager [req-9ada2fcb-9532-4036-b16d-f45d4941118b req-c800ab84-65c1-4e7d-afba-a74e8272e132 service nova] [instance: b2d55cdd-c89c-4c59-afe1-49a33225af22] No waiting events found dispatching network-vif-plugged-31e1957f-9bd1-42ae-a2ac-954b49ca15f1 {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:41:01 user nova-compute[71731]: WARNING nova.compute.manager [req-9ada2fcb-9532-4036-b16d-f45d4941118b req-c800ab84-65c1-4e7d-afba-a74e8272e132 service nova] [instance: b2d55cdd-c89c-4c59-afe1-49a33225af22] Received unexpected event network-vif-plugged-31e1957f-9bd1-42ae-a2ac-954b49ca15f1 for instance with vm_state building and task_state spawning.
Apr 13 16:41:02 user nova-compute[71731]: DEBUG nova.virt.driver [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Emitting event <LifecycleEvent: 1681404062.0289247, b2d55cdd-c89c-4c59-afe1-49a33225af22 => Resumed> {{(pid=71731) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 16:41:02 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: b2d55cdd-c89c-4c59-afe1-49a33225af22] VM Resumed (Lifecycle Event)
Apr 13 16:41:02 user nova-compute[71731]: DEBUG nova.compute.manager [None req-dce8a6c6-24db-46e7-821c-beefda666677 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] [instance: b2d55cdd-c89c-4c59-afe1-49a33225af22] Instance event wait completed in 0 seconds for  {{(pid=71731) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 16:41:02 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-dce8a6c6-24db-46e7-821c-beefda666677 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] [instance: b2d55cdd-c89c-4c59-afe1-49a33225af22] Guest created on hypervisor {{(pid=71731) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 16:41:02 user nova-compute[71731]: INFO nova.virt.libvirt.driver [-] [instance: b2d55cdd-c89c-4c59-afe1-49a33225af22] Instance spawned successfully.
Apr 13 16:41:02 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-dce8a6c6-24db-46e7-821c-beefda666677 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] [instance: b2d55cdd-c89c-4c59-afe1-49a33225af22] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 16:41:02 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: b2d55cdd-c89c-4c59-afe1-49a33225af22] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:41:02 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: b2d55cdd-c89c-4c59-afe1-49a33225af22] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71731) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 16:41:02 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-dce8a6c6-24db-46e7-821c-beefda666677 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] [instance: b2d55cdd-c89c-4c59-afe1-49a33225af22] Found default for hw_cdrom_bus of ide {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:41:02 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-dce8a6c6-24db-46e7-821c-beefda666677 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] [instance: b2d55cdd-c89c-4c59-afe1-49a33225af22] Found default for hw_disk_bus of virtio {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:41:02 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-dce8a6c6-24db-46e7-821c-beefda666677 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] [instance: b2d55cdd-c89c-4c59-afe1-49a33225af22] Found default for hw_input_bus of None {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:41:02 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-dce8a6c6-24db-46e7-821c-beefda666677 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] [instance: b2d55cdd-c89c-4c59-afe1-49a33225af22] Found default for hw_pointer_model of None {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:41:02 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-dce8a6c6-24db-46e7-821c-beefda666677 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] [instance: b2d55cdd-c89c-4c59-afe1-49a33225af22] Found default for hw_video_model of virtio {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:41:02 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-dce8a6c6-24db-46e7-821c-beefda666677 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] [instance: b2d55cdd-c89c-4c59-afe1-49a33225af22] Found default for hw_vif_model of virtio {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:41:02 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: b2d55cdd-c89c-4c59-afe1-49a33225af22] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 16:41:02 user nova-compute[71731]: DEBUG nova.virt.driver [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Emitting event <LifecycleEvent: 1681404062.0340948, b2d55cdd-c89c-4c59-afe1-49a33225af22 => Started> {{(pid=71731) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 16:41:02 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: b2d55cdd-c89c-4c59-afe1-49a33225af22] VM Started (Lifecycle Event)
Apr 13 16:41:02 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:41:02 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: b2d55cdd-c89c-4c59-afe1-49a33225af22] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:41:02 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: b2d55cdd-c89c-4c59-afe1-49a33225af22] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71731) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 16:41:02 user nova-compute[71731]: DEBUG nova.compute.manager [None req-c592eb69-ccd6-4157-809c-6f29fe079b00 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] [instance: 3af23ff8-4e10-4fbf-a86e-bda842f084ff] Instance event wait completed in 0 seconds for  {{(pid=71731) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 16:41:02 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-c592eb69-ccd6-4157-809c-6f29fe079b00 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] [instance: 3af23ff8-4e10-4fbf-a86e-bda842f084ff] Guest created on hypervisor {{(pid=71731) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 16:41:02 user nova-compute[71731]: INFO nova.virt.libvirt.driver [-] [instance: 3af23ff8-4e10-4fbf-a86e-bda842f084ff] Instance spawned successfully.
Apr 13 16:41:02 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-c592eb69-ccd6-4157-809c-6f29fe079b00 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] [instance: 3af23ff8-4e10-4fbf-a86e-bda842f084ff] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 16:41:02 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: b2d55cdd-c89c-4c59-afe1-49a33225af22] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 16:41:02 user nova-compute[71731]: DEBUG nova.virt.driver [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Emitting event <LifecycleEvent: 1681404062.1097088, 3af23ff8-4e10-4fbf-a86e-bda842f084ff => Resumed> {{(pid=71731) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 16:41:02 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 3af23ff8-4e10-4fbf-a86e-bda842f084ff] VM Resumed (Lifecycle Event)
Apr 13 16:41:02 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-c592eb69-ccd6-4157-809c-6f29fe079b00 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] [instance: 3af23ff8-4e10-4fbf-a86e-bda842f084ff] Found default for hw_cdrom_bus of ide {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:41:02 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-c592eb69-ccd6-4157-809c-6f29fe079b00 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] [instance: 3af23ff8-4e10-4fbf-a86e-bda842f084ff] Found default for hw_disk_bus of virtio {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:41:02 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-c592eb69-ccd6-4157-809c-6f29fe079b00 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] [instance: 3af23ff8-4e10-4fbf-a86e-bda842f084ff] Found default for hw_input_bus of None {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:41:02 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-c592eb69-ccd6-4157-809c-6f29fe079b00 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] [instance: 3af23ff8-4e10-4fbf-a86e-bda842f084ff] Found default for hw_pointer_model of None {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:41:02 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-c592eb69-ccd6-4157-809c-6f29fe079b00 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] [instance: 3af23ff8-4e10-4fbf-a86e-bda842f084ff] Found default for hw_video_model of virtio {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:41:02 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-c592eb69-ccd6-4157-809c-6f29fe079b00 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] [instance: 3af23ff8-4e10-4fbf-a86e-bda842f084ff] Found default for hw_vif_model of virtio {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:41:02 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 3af23ff8-4e10-4fbf-a86e-bda842f084ff] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:41:02 user nova-compute[71731]: INFO nova.compute.manager [None req-dce8a6c6-24db-46e7-821c-beefda666677 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] [instance: b2d55cdd-c89c-4c59-afe1-49a33225af22] Took 7.88 seconds to spawn the instance on the hypervisor.
Apr 13 16:41:02 user nova-compute[71731]: DEBUG nova.compute.manager [None req-dce8a6c6-24db-46e7-821c-beefda666677 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] [instance: b2d55cdd-c89c-4c59-afe1-49a33225af22] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:41:02 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 3af23ff8-4e10-4fbf-a86e-bda842f084ff] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71731) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 16:41:02 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 3af23ff8-4e10-4fbf-a86e-bda842f084ff] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 16:41:02 user nova-compute[71731]: DEBUG nova.virt.driver [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Emitting event <LifecycleEvent: 1681404062.110992, 3af23ff8-4e10-4fbf-a86e-bda842f084ff => Started> {{(pid=71731) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 16:41:02 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 3af23ff8-4e10-4fbf-a86e-bda842f084ff] VM Started (Lifecycle Event)
Apr 13 16:41:02 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 3af23ff8-4e10-4fbf-a86e-bda842f084ff] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:41:02 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 3af23ff8-4e10-4fbf-a86e-bda842f084ff] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71731) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 16:41:02 user nova-compute[71731]: INFO nova.compute.manager [None req-c592eb69-ccd6-4157-809c-6f29fe079b00 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] [instance: 3af23ff8-4e10-4fbf-a86e-bda842f084ff] Took 6.78 seconds to spawn the instance on the hypervisor.
Apr 13 16:41:02 user nova-compute[71731]: DEBUG nova.compute.manager [None req-c592eb69-ccd6-4157-809c-6f29fe079b00 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] [instance: 3af23ff8-4e10-4fbf-a86e-bda842f084ff] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:41:02 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 3af23ff8-4e10-4fbf-a86e-bda842f084ff] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 16:41:02 user nova-compute[71731]: DEBUG nova.compute.manager [req-ba198230-d03b-44c5-beb9-08764fc9e66c req-1d16fe24-4589-4258-9982-5f3e2f23ac73 service nova] [instance: 3af23ff8-4e10-4fbf-a86e-bda842f084ff] Received event network-vif-plugged-b22086e3-8769-494c-af86-228dba7b3638 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:41:02 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-ba198230-d03b-44c5-beb9-08764fc9e66c req-1d16fe24-4589-4258-9982-5f3e2f23ac73 service nova] Acquiring lock "3af23ff8-4e10-4fbf-a86e-bda842f084ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:41:02 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-ba198230-d03b-44c5-beb9-08764fc9e66c req-1d16fe24-4589-4258-9982-5f3e2f23ac73 service nova] Lock "3af23ff8-4e10-4fbf-a86e-bda842f084ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:41:02 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-ba198230-d03b-44c5-beb9-08764fc9e66c req-1d16fe24-4589-4258-9982-5f3e2f23ac73 service nova] Lock "3af23ff8-4e10-4fbf-a86e-bda842f084ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:41:02 user nova-compute[71731]: DEBUG nova.compute.manager [req-ba198230-d03b-44c5-beb9-08764fc9e66c req-1d16fe24-4589-4258-9982-5f3e2f23ac73 service nova] [instance: 3af23ff8-4e10-4fbf-a86e-bda842f084ff] No waiting events found dispatching network-vif-plugged-b22086e3-8769-494c-af86-228dba7b3638 {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:41:02 user nova-compute[71731]: WARNING nova.compute.manager [req-ba198230-d03b-44c5-beb9-08764fc9e66c req-1d16fe24-4589-4258-9982-5f3e2f23ac73 service nova] [instance: 3af23ff8-4e10-4fbf-a86e-bda842f084ff] Received unexpected event network-vif-plugged-b22086e3-8769-494c-af86-228dba7b3638 for instance with vm_state building and task_state spawning.
Apr 13 16:41:02 user nova-compute[71731]: INFO nova.compute.manager [None req-dce8a6c6-24db-46e7-821c-beefda666677 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] [instance: b2d55cdd-c89c-4c59-afe1-49a33225af22] Took 8.50 seconds to build instance.
Apr 13 16:41:02 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-dce8a6c6-24db-46e7-821c-beefda666677 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lock "b2d55cdd-c89c-4c59-afe1-49a33225af22" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.605s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:41:02 user nova-compute[71731]: INFO nova.compute.manager [None req-c592eb69-ccd6-4157-809c-6f29fe079b00 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] [instance: 3af23ff8-4e10-4fbf-a86e-bda842f084ff] Took 7.41 seconds to build instance.
Apr 13 16:41:02 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-c592eb69-ccd6-4157-809c-6f29fe079b00 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lock "3af23ff8-4e10-4fbf-a86e-bda842f084ff" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.542s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:41:03 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:41:07 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:41:08 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:41:08 user nova-compute[71731]: DEBUG nova.compute.manager [req-1e3f758b-e538-49ef-8ae1-6529204885d5 req-e688a226-d9d7-4512-99d6-7dce75c82ada service nova] [instance: 1f6a693f-0a99-434f-871d-f535b71229b9] Received event network-changed-103a0c68-ffc7-4460-836e-0de6c0272d84 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:41:08 user nova-compute[71731]: DEBUG nova.compute.manager [req-1e3f758b-e538-49ef-8ae1-6529204885d5 req-e688a226-d9d7-4512-99d6-7dce75c82ada service nova] [instance: 1f6a693f-0a99-434f-871d-f535b71229b9] Refreshing instance network info cache due to event network-changed-103a0c68-ffc7-4460-836e-0de6c0272d84. {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 16:41:08 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-1e3f758b-e538-49ef-8ae1-6529204885d5 req-e688a226-d9d7-4512-99d6-7dce75c82ada service nova] Acquiring lock "refresh_cache-1f6a693f-0a99-434f-871d-f535b71229b9" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 16:41:08 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-1e3f758b-e538-49ef-8ae1-6529204885d5 req-e688a226-d9d7-4512-99d6-7dce75c82ada service nova] Acquired lock "refresh_cache-1f6a693f-0a99-434f-871d-f535b71229b9" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 16:41:08 user nova-compute[71731]: DEBUG nova.network.neutron [req-1e3f758b-e538-49ef-8ae1-6529204885d5 req-e688a226-d9d7-4512-99d6-7dce75c82ada service nova] [instance: 1f6a693f-0a99-434f-871d-f535b71229b9] Refreshing network info cache for port 103a0c68-ffc7-4460-836e-0de6c0272d84 {{(pid=71731) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 16:41:09 user nova-compute[71731]: DEBUG nova.network.neutron [req-1e3f758b-e538-49ef-8ae1-6529204885d5 req-e688a226-d9d7-4512-99d6-7dce75c82ada service nova] [instance: 1f6a693f-0a99-434f-871d-f535b71229b9] Updated VIF entry in instance network info cache for port 103a0c68-ffc7-4460-836e-0de6c0272d84. {{(pid=71731) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 16:41:09 user nova-compute[71731]: DEBUG nova.network.neutron [req-1e3f758b-e538-49ef-8ae1-6529204885d5 req-e688a226-d9d7-4512-99d6-7dce75c82ada service nova] [instance: 1f6a693f-0a99-434f-871d-f535b71229b9] Updating instance_info_cache with network_info: [{"id": "103a0c68-ffc7-4460-836e-0de6c0272d84", "address": "fa:16:3e:f5:d0:dc", "network": {"id": "5acc9a78-1127-46df-bb60-7544cdd2c1ef", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2143082515-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0653ab16660b46cea9c5af58ea0b1931", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap103a0c68-ff", "ovs_interfaceid": "103a0c68-ffc7-4460-836e-0de6c0272d84", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:41:09 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-1e3f758b-e538-49ef-8ae1-6529204885d5 req-e688a226-d9d7-4512-99d6-7dce75c82ada service nova] Releasing lock "refresh_cache-1f6a693f-0a99-434f-871d-f535b71229b9" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 16:41:11 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-436c60d2-89b1-445a-bfa9-ca49cf0543ed tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Acquiring lock "1f6a693f-0a99-434f-871d-f535b71229b9" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:41:11 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-436c60d2-89b1-445a-bfa9-ca49cf0543ed tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lock "1f6a693f-0a99-434f-871d-f535b71229b9" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:41:11 user nova-compute[71731]: INFO nova.compute.manager [None req-436c60d2-89b1-445a-bfa9-ca49cf0543ed tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] [instance: 1f6a693f-0a99-434f-871d-f535b71229b9] Shelving
Apr 13 16:41:11 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:41:11 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:41:11 user nova-compute[71731]: DEBUG nova.compute.manager [req-ed3f85c0-2768-4535-895f-4c6c01a05e54 req-05801a80-a91c-4cfa-8a43-59d210efff3f service nova] [instance: 1f6a693f-0a99-434f-871d-f535b71229b9] Received event network-vif-unplugged-103a0c68-ffc7-4460-836e-0de6c0272d84 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:41:11 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-ed3f85c0-2768-4535-895f-4c6c01a05e54 req-05801a80-a91c-4cfa-8a43-59d210efff3f service nova] Acquiring lock "1f6a693f-0a99-434f-871d-f535b71229b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:41:11 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-ed3f85c0-2768-4535-895f-4c6c01a05e54 req-05801a80-a91c-4cfa-8a43-59d210efff3f service nova] Lock "1f6a693f-0a99-434f-871d-f535b71229b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:41:11 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-ed3f85c0-2768-4535-895f-4c6c01a05e54 req-05801a80-a91c-4cfa-8a43-59d210efff3f service nova] Lock "1f6a693f-0a99-434f-871d-f535b71229b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:41:11 user nova-compute[71731]: DEBUG nova.compute.manager [req-ed3f85c0-2768-4535-895f-4c6c01a05e54 req-05801a80-a91c-4cfa-8a43-59d210efff3f service nova] [instance: 1f6a693f-0a99-434f-871d-f535b71229b9] No waiting events found dispatching network-vif-unplugged-103a0c68-ffc7-4460-836e-0de6c0272d84 {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:41:11 user nova-compute[71731]: WARNING nova.compute.manager [req-ed3f85c0-2768-4535-895f-4c6c01a05e54 req-05801a80-a91c-4cfa-8a43-59d210efff3f service nova] [instance: 1f6a693f-0a99-434f-871d-f535b71229b9] Received unexpected event network-vif-unplugged-103a0c68-ffc7-4460-836e-0de6c0272d84 for instance with vm_state active and task_state shelving.
Apr 13 16:41:12 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:41:12 user nova-compute[71731]: INFO nova.virt.libvirt.driver [-] [instance: 1f6a693f-0a99-434f-871d-f535b71229b9] Instance destroyed successfully.
Apr 13 16:41:12 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-436c60d2-89b1-445a-bfa9-ca49cf0543ed tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] [instance: 1f6a693f-0a99-434f-871d-f535b71229b9] Beginning cold snapshot process
Apr 13 16:41:12 user nova-compute[71731]: DEBUG nova.privsep.utils [None req-436c60d2-89b1-445a-bfa9-ca49cf0543ed tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71731) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 13 16:41:12 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-436c60d2-89b1-445a-bfa9-ca49cf0543ed tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/1f6a693f-0a99-434f-871d-f535b71229b9/disk /opt/stack/data/nova/instances/snapshots/tmp3pfxauw7/e9eff2f517024dbb91ec0bdf5cf319da {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:41:12 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-436c60d2-89b1-445a-bfa9-ca49cf0543ed tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/1f6a693f-0a99-434f-871d-f535b71229b9/disk /opt/stack/data/nova/instances/snapshots/tmp3pfxauw7/e9eff2f517024dbb91ec0bdf5cf319da" returned: 0 in 0.315s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:41:12 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-436c60d2-89b1-445a-bfa9-ca49cf0543ed tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] [instance: 1f6a693f-0a99-434f-871d-f535b71229b9] Snapshot extracted, beginning image upload
Apr 13 16:41:13 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:41:13 user nova-compute[71731]: DEBUG nova.compute.manager [req-44bc59b5-30e5-4aea-bb16-2bc553b3fef5 req-85a83c3a-02b3-498a-a322-f0fa9e4f30c2 service nova] [instance: 1f6a693f-0a99-434f-871d-f535b71229b9] Received event network-vif-plugged-103a0c68-ffc7-4460-836e-0de6c0272d84 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:41:13 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-44bc59b5-30e5-4aea-bb16-2bc553b3fef5 req-85a83c3a-02b3-498a-a322-f0fa9e4f30c2 service nova] Acquiring lock "1f6a693f-0a99-434f-871d-f535b71229b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:41:13 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-44bc59b5-30e5-4aea-bb16-2bc553b3fef5 req-85a83c3a-02b3-498a-a322-f0fa9e4f30c2 service nova] Lock "1f6a693f-0a99-434f-871d-f535b71229b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:41:13 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-44bc59b5-30e5-4aea-bb16-2bc553b3fef5 req-85a83c3a-02b3-498a-a322-f0fa9e4f30c2 service nova] Lock "1f6a693f-0a99-434f-871d-f535b71229b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:41:13 user nova-compute[71731]: DEBUG nova.compute.manager [req-44bc59b5-30e5-4aea-bb16-2bc553b3fef5 req-85a83c3a-02b3-498a-a322-f0fa9e4f30c2 service nova] [instance: 1f6a693f-0a99-434f-871d-f535b71229b9] No waiting events found dispatching network-vif-plugged-103a0c68-ffc7-4460-836e-0de6c0272d84 {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:41:13 user nova-compute[71731]: WARNING nova.compute.manager [req-44bc59b5-30e5-4aea-bb16-2bc553b3fef5 req-85a83c3a-02b3-498a-a322-f0fa9e4f30c2 service nova] [instance: 1f6a693f-0a99-434f-871d-f535b71229b9] Received unexpected event network-vif-plugged-103a0c68-ffc7-4460-836e-0de6c0272d84 for instance with vm_state active and task_state shelving_image_uploading.
Apr 13 16:41:14 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-436c60d2-89b1-445a-bfa9-ca49cf0543ed tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] [instance: 1f6a693f-0a99-434f-871d-f535b71229b9] Snapshot image upload complete
Apr 13 16:41:14 user nova-compute[71731]: DEBUG nova.compute.manager [None req-436c60d2-89b1-445a-bfa9-ca49cf0543ed tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] [instance: 1f6a693f-0a99-434f-871d-f535b71229b9] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:41:14 user nova-compute[71731]: INFO nova.compute.manager [None req-436c60d2-89b1-445a-bfa9-ca49cf0543ed tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] [instance: 1f6a693f-0a99-434f-871d-f535b71229b9] Shelve offloading
Apr 13 16:41:14 user nova-compute[71731]: INFO nova.virt.libvirt.driver [-] [instance: 1f6a693f-0a99-434f-871d-f535b71229b9] Instance destroyed successfully.
Apr 13 16:41:14 user nova-compute[71731]: DEBUG nova.compute.manager [None req-436c60d2-89b1-445a-bfa9-ca49cf0543ed tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] [instance: 1f6a693f-0a99-434f-871d-f535b71229b9] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:41:14 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-436c60d2-89b1-445a-bfa9-ca49cf0543ed tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Acquiring lock "refresh_cache-1f6a693f-0a99-434f-871d-f535b71229b9" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 16:41:14 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-436c60d2-89b1-445a-bfa9-ca49cf0543ed tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Acquired lock "refresh_cache-1f6a693f-0a99-434f-871d-f535b71229b9" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 16:41:14 user nova-compute[71731]: DEBUG nova.network.neutron [None req-436c60d2-89b1-445a-bfa9-ca49cf0543ed tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] [instance: 1f6a693f-0a99-434f-871d-f535b71229b9] Building network info cache for instance {{(pid=71731) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 16:41:15 user nova-compute[71731]: DEBUG nova.network.neutron [None req-436c60d2-89b1-445a-bfa9-ca49cf0543ed tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] [instance: 1f6a693f-0a99-434f-871d-f535b71229b9] Updating instance_info_cache with network_info: [{"id": "103a0c68-ffc7-4460-836e-0de6c0272d84", "address": "fa:16:3e:f5:d0:dc", "network": {"id": "5acc9a78-1127-46df-bb60-7544cdd2c1ef", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2143082515-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0653ab16660b46cea9c5af58ea0b1931", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap103a0c68-ff", "ovs_interfaceid": "103a0c68-ffc7-4460-836e-0de6c0272d84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:41:15 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-436c60d2-89b1-445a-bfa9-ca49cf0543ed tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Releasing lock "refresh_cache-1f6a693f-0a99-434f-871d-f535b71229b9" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 16:41:16 user nova-compute[71731]: INFO nova.virt.libvirt.driver [-] [instance: 1f6a693f-0a99-434f-871d-f535b71229b9] Instance destroyed successfully.
Apr 13 16:41:16 user nova-compute[71731]: DEBUG nova.objects.instance [None req-436c60d2-89b1-445a-bfa9-ca49cf0543ed tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lazy-loading 'resources' on Instance uuid 1f6a693f-0a99-434f-871d-f535b71229b9 {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:41:16 user nova-compute[71731]: DEBUG nova.virt.libvirt.vif [None req-436c60d2-89b1-445a-bfa9-ca49cf0543ed tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T16:39:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-152363829',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-152363829',id=34,image_ref='708622a9-7465-4492-ade8-b827198f7e30',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEMeM+1/KnPrfHwYC3u+Lcza7snpR0t1GJvUaC1TzWStqRV08H+ksCdHvKc+nMr3bT0XCZGDg/vhmXMFwe7jGl2nfjwDh9ruSgNXBv0ppZMEtKuFitRCX7rOQL8v9bZcKA==',key_name='tempest-keypair-707123723',keypairs=<?>,launch_index=0,launched_at=2023-04-13T16:39:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='0653ab16660b46cea9c5af58ea0b1931',ramdisk_id='',reservation_id='r-nynwey78',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='708622a9-7465-4492-ade8-b827198f7e30',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1310775310',owner_user_name='tempest-AttachVolumeShelveTestJSON-1310775310-project-member',shelved_at='2023-04-13T16:41:14.756423',shelved_host='user',shelved_image_id='f46dd46b-4936-4a51-8ff8-a290b0db8c3c'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T16:41:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='48b4e972cd1049509fa899449961ab59',uuid=1f6a693f-0a99-434f-871d-f535b71229b9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "103a0c68-ffc7-4460-836e-0de6c0272d84", "address": "fa:16:3e:f5:d0:dc", "network": {"id": "5acc9a78-1127-46df-bb60-7544cdd2c1ef", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2143082515-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0653ab16660b46cea9c5af58ea0b1931", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap103a0c68-ff", "ovs_interfaceid": "103a0c68-ffc7-4460-836e-0de6c0272d84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 16:41:16 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-436c60d2-89b1-445a-bfa9-ca49cf0543ed tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Converting VIF {"id": "103a0c68-ffc7-4460-836e-0de6c0272d84", "address": "fa:16:3e:f5:d0:dc", "network": {"id": "5acc9a78-1127-46df-bb60-7544cdd2c1ef", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2143082515-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0653ab16660b46cea9c5af58ea0b1931", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap103a0c68-ff", "ovs_interfaceid": "103a0c68-ffc7-4460-836e-0de6c0272d84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 16:41:16 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-436c60d2-89b1-445a-bfa9-ca49cf0543ed tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:d0:dc,bridge_name='br-int',has_traffic_filtering=True,id=103a0c68-ffc7-4460-836e-0de6c0272d84,network=Network(5acc9a78-1127-46df-bb60-7544cdd2c1ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap103a0c68-ff') {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 16:41:16 user nova-compute[71731]: DEBUG os_vif [None req-436c60d2-89b1-445a-bfa9-ca49cf0543ed tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:d0:dc,bridge_name='br-int',has_traffic_filtering=True,id=103a0c68-ffc7-4460-836e-0de6c0272d84,network=Network(5acc9a78-1127-46df-bb60-7544cdd2c1ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap103a0c68-ff') {{(pid=71731) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 16:41:16 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:41:16 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap103a0c68-ff, bridge=br-int, if_exists=True) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:41:16 user nova-compute[71731]: DEBUG nova.compute.manager [req-5a9d47fd-03e6-41f6-8bdb-d8d9eb39ac6d req-67930121-0741-431c-bf1b-d77c3e35d6e9 service nova] [instance: 1f6a693f-0a99-434f-871d-f535b71229b9] Received event network-changed-103a0c68-ffc7-4460-836e-0de6c0272d84 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:41:16 user nova-compute[71731]: DEBUG nova.compute.manager [req-5a9d47fd-03e6-41f6-8bdb-d8d9eb39ac6d req-67930121-0741-431c-bf1b-d77c3e35d6e9 service nova] [instance: 1f6a693f-0a99-434f-871d-f535b71229b9] Refreshing instance network info cache due to event network-changed-103a0c68-ffc7-4460-836e-0de6c0272d84. {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 16:41:16 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-5a9d47fd-03e6-41f6-8bdb-d8d9eb39ac6d req-67930121-0741-431c-bf1b-d77c3e35d6e9 service nova] Acquiring lock "refresh_cache-1f6a693f-0a99-434f-871d-f535b71229b9" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 16:41:16 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-5a9d47fd-03e6-41f6-8bdb-d8d9eb39ac6d req-67930121-0741-431c-bf1b-d77c3e35d6e9 service nova] Acquired lock "refresh_cache-1f6a693f-0a99-434f-871d-f535b71229b9" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 16:41:16 user nova-compute[71731]: DEBUG nova.network.neutron [req-5a9d47fd-03e6-41f6-8bdb-d8d9eb39ac6d req-67930121-0741-431c-bf1b-d77c3e35d6e9 service nova] [instance: 1f6a693f-0a99-434f-871d-f535b71229b9] Refreshing network info cache for port 103a0c68-ffc7-4460-836e-0de6c0272d84 {{(pid=71731) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 16:41:16 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:41:16 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 16:41:16 user nova-compute[71731]: INFO os_vif [None req-436c60d2-89b1-445a-bfa9-ca49cf0543ed tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:d0:dc,bridge_name='br-int',has_traffic_filtering=True,id=103a0c68-ffc7-4460-836e-0de6c0272d84,network=Network(5acc9a78-1127-46df-bb60-7544cdd2c1ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap103a0c68-ff')
Apr 13 16:41:16 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-436c60d2-89b1-445a-bfa9-ca49cf0543ed tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] [instance: 1f6a693f-0a99-434f-871d-f535b71229b9] Deleting instance files /opt/stack/data/nova/instances/1f6a693f-0a99-434f-871d-f535b71229b9_del
Apr 13 16:41:16 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-436c60d2-89b1-445a-bfa9-ca49cf0543ed tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] [instance: 1f6a693f-0a99-434f-871d-f535b71229b9] Deletion of /opt/stack/data/nova/instances/1f6a693f-0a99-434f-871d-f535b71229b9_del complete
Apr 13 16:41:16 user nova-compute[71731]: INFO nova.scheduler.client.report [None req-436c60d2-89b1-445a-bfa9-ca49cf0543ed tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Deleted allocations for instance 1f6a693f-0a99-434f-871d-f535b71229b9
Apr 13 16:41:16 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-436c60d2-89b1-445a-bfa9-ca49cf0543ed tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:41:16 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-436c60d2-89b1-445a-bfa9-ca49cf0543ed tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:41:16 user nova-compute[71731]: DEBUG nova.objects.instance [None req-436c60d2-89b1-445a-bfa9-ca49cf0543ed tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lazy-loading 'numa_topology' on Instance uuid 1f6a693f-0a99-434f-871d-f535b71229b9 {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:41:16 user nova-compute[71731]: DEBUG nova.compute.provider_tree [None req-436c60d2-89b1-445a-bfa9-ca49cf0543ed tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Inventory has not changed in ProviderTree for provider: cb6b1a64-0c24-4e2d-af1e-16576ca9165c {{(pid=71731) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 16:41:16 user nova-compute[71731]: DEBUG nova.scheduler.client.report [None req-436c60d2-89b1-445a-bfa9-ca49cf0543ed tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Inventory has not changed for provider cb6b1a64-0c24-4e2d-af1e-16576ca9165c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71731) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 16:41:16 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-436c60d2-89b1-445a-bfa9-ca49cf0543ed tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.186s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:41:16 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-436c60d2-89b1-445a-bfa9-ca49cf0543ed tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lock "1f6a693f-0a99-434f-871d-f535b71229b9" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 5.314s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:41:16 user nova-compute[71731]: DEBUG nova.network.neutron [req-5a9d47fd-03e6-41f6-8bdb-d8d9eb39ac6d req-67930121-0741-431c-bf1b-d77c3e35d6e9 service nova] [instance: 1f6a693f-0a99-434f-871d-f535b71229b9] Updated VIF entry in instance network info cache for port 103a0c68-ffc7-4460-836e-0de6c0272d84. {{(pid=71731) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 16:41:16 user nova-compute[71731]: DEBUG nova.network.neutron [req-5a9d47fd-03e6-41f6-8bdb-d8d9eb39ac6d req-67930121-0741-431c-bf1b-d77c3e35d6e9 service nova] [instance: 1f6a693f-0a99-434f-871d-f535b71229b9] Updating instance_info_cache with network_info: [{"id": "103a0c68-ffc7-4460-836e-0de6c0272d84", "address": "fa:16:3e:f5:d0:dc", "network": {"id": "5acc9a78-1127-46df-bb60-7544cdd2c1ef", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-2143082515-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0653ab16660b46cea9c5af58ea0b1931", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap103a0c68-ff", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:41:16 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-5a9d47fd-03e6-41f6-8bdb-d8d9eb39ac6d req-67930121-0741-431c-bf1b-d77c3e35d6e9 service nova] Releasing lock "refresh_cache-1f6a693f-0a99-434f-871d-f535b71229b9" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 16:41:17 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:41:19 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:41:21 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:41:22 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager.update_available_resource {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:41:22 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:41:22 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:41:22 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:41:22 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Auditing locally available compute resources for user (node: user) {{(pid=71731) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 16:41:22 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:41:22 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71731) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 16:41:22 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3af23ff8-4e10-4fbf-a86e-bda842f084ff/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:41:22 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3af23ff8-4e10-4fbf-a86e-bda842f084ff/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:41:22 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3af23ff8-4e10-4fbf-a86e-bda842f084ff/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:41:22 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3af23ff8-4e10-4fbf-a86e-bda842f084ff/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:41:22 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ed800fe-577d-4624-898c-c7f40da77376/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:41:22 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ed800fe-577d-4624-898c-c7f40da77376/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:41:22 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ed800fe-577d-4624-898c-c7f40da77376/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:41:22 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ed800fe-577d-4624-898c-c7f40da77376/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:41:22 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2d55cdd-c89c-4c59-afe1-49a33225af22/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:41:22 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2d55cdd-c89c-4c59-afe1-49a33225af22/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:41:22 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2d55cdd-c89c-4c59-afe1-49a33225af22/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:41:23 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2d55cdd-c89c-4c59-afe1-49a33225af22/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:41:23 user nova-compute[71731]: WARNING nova.virt.libvirt.driver [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 16:41:23 user nova-compute[71731]: WARNING nova.virt.libvirt.driver [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 16:41:23 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Hypervisor/Node resource view: name=user free_ram=8415MB free_disk=26.122661590576172GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71731) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 16:41:23 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:41:23 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:41:23 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance 5ed800fe-577d-4624-898c-c7f40da77376 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 16:41:23 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance 7ae7d3d9-54f7-4c64-8bf6-08fa5c526687 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 16:41:23 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance b2d55cdd-c89c-4c59-afe1-49a33225af22 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 16:41:23 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance 3af23ff8-4e10-4fbf-a86e-bda842f084ff actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 16:41:23 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=71731) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 16:41:23 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Final resource view: name=user phys_ram=16023MB used_ram=1024MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=71731) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 16:41:23 user nova-compute[71731]: DEBUG nova.compute.provider_tree [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Inventory has not changed in ProviderTree for provider: cb6b1a64-0c24-4e2d-af1e-16576ca9165c {{(pid=71731) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 16:41:23 user nova-compute[71731]: DEBUG nova.scheduler.client.report [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Inventory has not changed for provider cb6b1a64-0c24-4e2d-af1e-16576ca9165c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71731) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 16:41:23 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Compute_service record updated for user:user {{(pid=71731) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 16:41:23 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.297s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:41:25 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:41:25 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:41:25 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71731) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 16:41:26 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:41:26 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Starting heal instance info cache {{(pid=71731) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 16:41:26 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] [instance: 1f6a693f-0a99-434f-871d-f535b71229b9] Skipping network cache update for instance because it has been migrated to another host. {{(pid=71731) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9836}}
Apr 13 16:41:26 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Acquiring lock "refresh_cache-7ae7d3d9-54f7-4c64-8bf6-08fa5c526687" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 16:41:26 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Acquired lock "refresh_cache-7ae7d3d9-54f7-4c64-8bf6-08fa5c526687" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 16:41:26 user nova-compute[71731]: DEBUG nova.network.neutron [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] [instance: 7ae7d3d9-54f7-4c64-8bf6-08fa5c526687] Forcefully refreshing network info cache for instance {{(pid=71731) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 16:41:26 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:41:26 user nova-compute[71731]: DEBUG nova.network.neutron [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] [instance: 7ae7d3d9-54f7-4c64-8bf6-08fa5c526687] Updating instance_info_cache with network_info: [{"id": "f7ec2f7f-f505-44ed-b40d-7b91b2248cea", "address": "fa:16:3e:e2:cd:35", "network": {"id": "cf1fef97-9ef1-449f-a302-b38110024547", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1138167711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "980559734a504574a83224deb7423c77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7ec2f7f-f5", "ovs_interfaceid": "f7ec2f7f-f505-44ed-b40d-7b91b2248cea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:41:26 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Releasing lock "refresh_cache-7ae7d3d9-54f7-4c64-8bf6-08fa5c526687" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 16:41:26 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] [instance: 7ae7d3d9-54f7-4c64-8bf6-08fa5c526687] Updated the network info_cache for instance {{(pid=71731) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 16:41:26 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:41:26 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Cleaning up deleted instances {{(pid=71731) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 13 16:41:26 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] There are 0 instances to clean {{(pid=71731) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 13 16:41:27 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:41:27 user nova-compute[71731]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681404072.092556, 1f6a693f-0a99-434f-871d-f535b71229b9 => Stopped> {{(pid=71731) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 16:41:27 user nova-compute[71731]: INFO nova.compute.manager [-] [instance: 1f6a693f-0a99-434f-871d-f535b71229b9] VM Stopped (Lifecycle Event)
Apr 13 16:41:27 user nova-compute[71731]: DEBUG nova.compute.manager [None req-ddd6b68e-6e63-4a00-bdfe-e69404a5038f None None] [instance: 1f6a693f-0a99-434f-871d-f535b71229b9] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:41:29 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:41:29 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:41:31 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:41:31 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:41:32 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:41:32 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:41:36 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:41:39 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:41:41 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 16:41:42 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:41:46 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:41:47 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:41:47 user nova-compute[71731]: DEBUG nova.compute.manager [req-1f52b2b7-e3ca-4d00-9aa3-f1d23464e2a7 req-15ce18ce-7078-4aae-aad6-b0f19f312294 service nova] [instance: 5ed800fe-577d-4624-898c-c7f40da77376] Received event network-changed-09531419-c0ff-4d13-89bd-06caa28e019d {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:41:47 user nova-compute[71731]: DEBUG nova.compute.manager [req-1f52b2b7-e3ca-4d00-9aa3-f1d23464e2a7 req-15ce18ce-7078-4aae-aad6-b0f19f312294 service nova] [instance: 5ed800fe-577d-4624-898c-c7f40da77376] Refreshing instance network info cache due to event network-changed-09531419-c0ff-4d13-89bd-06caa28e019d. {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 16:41:47 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-1f52b2b7-e3ca-4d00-9aa3-f1d23464e2a7 req-15ce18ce-7078-4aae-aad6-b0f19f312294 service nova] Acquiring lock "refresh_cache-5ed800fe-577d-4624-898c-c7f40da77376" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 16:41:47 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-1f52b2b7-e3ca-4d00-9aa3-f1d23464e2a7 req-15ce18ce-7078-4aae-aad6-b0f19f312294 service nova] Acquired lock "refresh_cache-5ed800fe-577d-4624-898c-c7f40da77376" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 16:41:47 user nova-compute[71731]: DEBUG nova.network.neutron [req-1f52b2b7-e3ca-4d00-9aa3-f1d23464e2a7 req-15ce18ce-7078-4aae-aad6-b0f19f312294 service nova] [instance: 5ed800fe-577d-4624-898c-c7f40da77376] Refreshing network info cache for port 09531419-c0ff-4d13-89bd-06caa28e019d {{(pid=71731) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 16:41:48 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:41:48 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Cleaning up deleted instances with incomplete migration  {{(pid=71731) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 13 16:41:48 user nova-compute[71731]: DEBUG nova.network.neutron [req-1f52b2b7-e3ca-4d00-9aa3-f1d23464e2a7 req-15ce18ce-7078-4aae-aad6-b0f19f312294 service nova] [instance: 5ed800fe-577d-4624-898c-c7f40da77376] Updated VIF entry in instance network info cache for port 09531419-c0ff-4d13-89bd-06caa28e019d. {{(pid=71731) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 16:41:48 user nova-compute[71731]: DEBUG nova.network.neutron [req-1f52b2b7-e3ca-4d00-9aa3-f1d23464e2a7 req-15ce18ce-7078-4aae-aad6-b0f19f312294 service nova] [instance: 5ed800fe-577d-4624-898c-c7f40da77376] Updating instance_info_cache with network_info: [{"id": "09531419-c0ff-4d13-89bd-06caa28e019d", "address": "fa:16:3e:13:b1:31", "network": {"id": "cf1fef97-9ef1-449f-a302-b38110024547", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1138167711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "980559734a504574a83224deb7423c77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09531419-c0", "ovs_interfaceid": "09531419-c0ff-4d13-89bd-06caa28e019d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:41:48 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-1f52b2b7-e3ca-4d00-9aa3-f1d23464e2a7 req-15ce18ce-7078-4aae-aad6-b0f19f312294 service nova] Releasing lock "refresh_cache-5ed800fe-577d-4624-898c-c7f40da77376" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 16:41:49 user nova-compute[71731]: DEBUG nova.compute.manager [None req-0fbbb223-40d3-41a9-b616-a001cf975cd9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: 7ae7d3d9-54f7-4c64-8bf6-08fa5c526687] Stashing vm_state: active {{(pid=71731) _prep_resize /opt/stack/nova/nova/compute/manager.py:5499}}
Apr 13 16:41:49 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-0fbbb223-40d3-41a9-b616-a001cf975cd9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:41:49 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-0fbbb223-40d3-41a9-b616-a001cf975cd9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:41:49 user nova-compute[71731]: DEBUG nova.objects.instance [None req-0fbbb223-40d3-41a9-b616-a001cf975cd9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lazy-loading 'pci_requests' on Instance uuid 7ae7d3d9-54f7-4c64-8bf6-08fa5c526687 {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:41:49 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-0fbbb223-40d3-41a9-b616-a001cf975cd9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71731) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 16:41:49 user nova-compute[71731]: INFO nova.compute.claims [None req-0fbbb223-40d3-41a9-b616-a001cf975cd9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: 7ae7d3d9-54f7-4c64-8bf6-08fa5c526687] Claim successful on node user
Apr 13 16:41:49 user nova-compute[71731]: DEBUG nova.objects.instance [None req-0fbbb223-40d3-41a9-b616-a001cf975cd9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lazy-loading 'resources' on Instance uuid 7ae7d3d9-54f7-4c64-8bf6-08fa5c526687 {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:41:49 user nova-compute[71731]: DEBUG nova.objects.instance [None req-0fbbb223-40d3-41a9-b616-a001cf975cd9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lazy-loading 'pci_devices' on Instance uuid 7ae7d3d9-54f7-4c64-8bf6-08fa5c526687 {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:41:49 user nova-compute[71731]: INFO nova.compute.resource_tracker [None req-0fbbb223-40d3-41a9-b616-a001cf975cd9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: 7ae7d3d9-54f7-4c64-8bf6-08fa5c526687] Updating resource usage from migration fc53a14d-8658-42db-a644-15b07e017d46
Apr 13 16:41:49 user nova-compute[71731]: DEBUG nova.compute.provider_tree [None req-0fbbb223-40d3-41a9-b616-a001cf975cd9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Inventory has not changed in ProviderTree for provider: cb6b1a64-0c24-4e2d-af1e-16576ca9165c {{(pid=71731) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 16:41:49 user nova-compute[71731]: DEBUG nova.scheduler.client.report [None req-0fbbb223-40d3-41a9-b616-a001cf975cd9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Inventory has not changed for provider cb6b1a64-0c24-4e2d-af1e-16576ca9165c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71731) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 16:41:49 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-0fbbb223-40d3-41a9-b616-a001cf975cd9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.401s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:41:49 user nova-compute[71731]: INFO nova.compute.manager [None req-0fbbb223-40d3-41a9-b616-a001cf975cd9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: 7ae7d3d9-54f7-4c64-8bf6-08fa5c526687] Migrating
Apr 13 16:41:49 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-0fbbb223-40d3-41a9-b616-a001cf975cd9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Acquiring lock "refresh_cache-7ae7d3d9-54f7-4c64-8bf6-08fa5c526687" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 16:41:49 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-0fbbb223-40d3-41a9-b616-a001cf975cd9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Acquired lock "refresh_cache-7ae7d3d9-54f7-4c64-8bf6-08fa5c526687" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 16:41:49 user nova-compute[71731]: DEBUG nova.network.neutron [None req-0fbbb223-40d3-41a9-b616-a001cf975cd9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: 7ae7d3d9-54f7-4c64-8bf6-08fa5c526687] Building network info cache for instance {{(pid=71731) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 16:41:49 user nova-compute[71731]: DEBUG nova.compute.manager [req-e829f5da-018d-40e2-a9e1-e073388ffc43 req-4cab42f8-f379-4250-bd89-40c48098f545 service nova] [instance: 7ae7d3d9-54f7-4c64-8bf6-08fa5c526687] Received event network-changed-f7ec2f7f-f505-44ed-b40d-7b91b2248cea {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:41:49 user nova-compute[71731]: DEBUG nova.compute.manager [req-e829f5da-018d-40e2-a9e1-e073388ffc43 req-4cab42f8-f379-4250-bd89-40c48098f545 service nova] [instance: 7ae7d3d9-54f7-4c64-8bf6-08fa5c526687] Refreshing instance network info cache due to event network-changed-f7ec2f7f-f505-44ed-b40d-7b91b2248cea. {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 16:41:49 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-e829f5da-018d-40e2-a9e1-e073388ffc43 req-4cab42f8-f379-4250-bd89-40c48098f545 service nova] Acquiring lock "refresh_cache-7ae7d3d9-54f7-4c64-8bf6-08fa5c526687" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 16:41:50 user nova-compute[71731]: DEBUG nova.network.neutron [None req-0fbbb223-40d3-41a9-b616-a001cf975cd9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: 7ae7d3d9-54f7-4c64-8bf6-08fa5c526687] Updating instance_info_cache with network_info: [{"id": "f7ec2f7f-f505-44ed-b40d-7b91b2248cea", "address": "fa:16:3e:e2:cd:35", "network": {"id": "cf1fef97-9ef1-449f-a302-b38110024547", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1138167711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "980559734a504574a83224deb7423c77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7ec2f7f-f5", "ovs_interfaceid": "f7ec2f7f-f505-44ed-b40d-7b91b2248cea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:41:50 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-0fbbb223-40d3-41a9-b616-a001cf975cd9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Releasing lock "refresh_cache-7ae7d3d9-54f7-4c64-8bf6-08fa5c526687" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 16:41:50 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-e829f5da-018d-40e2-a9e1-e073388ffc43 req-4cab42f8-f379-4250-bd89-40c48098f545 service nova] Acquired lock "refresh_cache-7ae7d3d9-54f7-4c64-8bf6-08fa5c526687" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 16:41:50 user nova-compute[71731]: DEBUG nova.network.neutron [req-e829f5da-018d-40e2-a9e1-e073388ffc43 req-4cab42f8-f379-4250-bd89-40c48098f545 service nova] [instance: 7ae7d3d9-54f7-4c64-8bf6-08fa5c526687] Refreshing network info cache for port f7ec2f7f-f505-44ed-b40d-7b91b2248cea {{(pid=71731) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 16:41:50 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-0fbbb223-40d3-41a9-b616-a001cf975cd9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: 7ae7d3d9-54f7-4c64-8bf6-08fa5c526687] Starting migrate_disk_and_power_off {{(pid=71731) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11460}}
Apr 13 16:41:50 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:41:50 user nova-compute[71731]: DEBUG nova.compute.manager [req-0d4e5df9-4d5b-4c3c-a3da-dd57fe6f9f05 req-39760b5f-9a26-4eef-879f-cacd0b76f046 service nova] [instance: 7ae7d3d9-54f7-4c64-8bf6-08fa5c526687] Received event network-vif-unplugged-f7ec2f7f-f505-44ed-b40d-7b91b2248cea {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:41:50 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-0d4e5df9-4d5b-4c3c-a3da-dd57fe6f9f05 req-39760b5f-9a26-4eef-879f-cacd0b76f046 service nova] Acquiring lock "7ae7d3d9-54f7-4c64-8bf6-08fa5c526687-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:41:50 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-0d4e5df9-4d5b-4c3c-a3da-dd57fe6f9f05 req-39760b5f-9a26-4eef-879f-cacd0b76f046 service nova] Lock "7ae7d3d9-54f7-4c64-8bf6-08fa5c526687-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:41:50 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-0d4e5df9-4d5b-4c3c-a3da-dd57fe6f9f05 req-39760b5f-9a26-4eef-879f-cacd0b76f046 service nova] Lock "7ae7d3d9-54f7-4c64-8bf6-08fa5c526687-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:41:50 user nova-compute[71731]: DEBUG nova.compute.manager [req-0d4e5df9-4d5b-4c3c-a3da-dd57fe6f9f05 req-39760b5f-9a26-4eef-879f-cacd0b76f046 service nova] [instance: 7ae7d3d9-54f7-4c64-8bf6-08fa5c526687] No waiting events found dispatching network-vif-unplugged-f7ec2f7f-f505-44ed-b40d-7b91b2248cea {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:41:50 user nova-compute[71731]: WARNING nova.compute.manager [req-0d4e5df9-4d5b-4c3c-a3da-dd57fe6f9f05 req-39760b5f-9a26-4eef-879f-cacd0b76f046 service nova] [instance: 7ae7d3d9-54f7-4c64-8bf6-08fa5c526687] Received unexpected event network-vif-unplugged-f7ec2f7f-f505-44ed-b40d-7b91b2248cea for instance with vm_state active and task_state resize_migrating.
Apr 13 16:41:50 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:41:50 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:41:50 user nova-compute[71731]: DEBUG nova.network.neutron [req-e829f5da-018d-40e2-a9e1-e073388ffc43 req-4cab42f8-f379-4250-bd89-40c48098f545 service nova] [instance: 7ae7d3d9-54f7-4c64-8bf6-08fa5c526687] Updated VIF entry in instance network info cache for port f7ec2f7f-f505-44ed-b40d-7b91b2248cea. {{(pid=71731) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 16:41:50 user nova-compute[71731]: DEBUG nova.network.neutron [req-e829f5da-018d-40e2-a9e1-e073388ffc43 req-4cab42f8-f379-4250-bd89-40c48098f545 service nova] [instance: 7ae7d3d9-54f7-4c64-8bf6-08fa5c526687] Updating instance_info_cache with network_info: [{"id": "f7ec2f7f-f505-44ed-b40d-7b91b2248cea", "address": "fa:16:3e:e2:cd:35", "network": {"id": "cf1fef97-9ef1-449f-a302-b38110024547", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1138167711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "980559734a504574a83224deb7423c77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7ec2f7f-f5", "ovs_interfaceid": "f7ec2f7f-f505-44ed-b40d-7b91b2248cea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:41:50 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-e829f5da-018d-40e2-a9e1-e073388ffc43 req-4cab42f8-f379-4250-bd89-40c48098f545 service nova] Releasing lock "refresh_cache-7ae7d3d9-54f7-4c64-8bf6-08fa5c526687" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 16:41:51 user nova-compute[71731]: INFO nova.virt.libvirt.driver [-] [instance: 7ae7d3d9-54f7-4c64-8bf6-08fa5c526687] Instance destroyed successfully.
Apr 13 16:41:51 user nova-compute[71731]: DEBUG nova.virt.libvirt.vif [None req-0fbbb223-40d3-41a9-b616-a001cf975cd9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T16:39:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-182216296',display_name='tempest-ServerActionsTestJSON-server-182216296',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-182216296',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPaDda4gTmMbkxKfok8i4i1XcNLza5lOVYjCPDEGVTF1JRQKderq80DnIN4GAkaZiBV5U44gvdu3wadL/M5wOH7VDSuEghHchow1mC9TB1xgdo8GoXeM279SVAyu08uhIQ==',key_name='tempest-keypair-1700037342',keypairs=<?>,launch_index=0,launched_at=2023-04-13T16:40:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='980559734a504574a83224deb7423c77',ramdisk_id='',reservation_id='r-r4a3hst0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-713402718',owner_user_name='tempest-ServerActionsTestJSON-713402718-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T16:41:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1b3df1c5c5d441819bcef89ed6966815',uuid=7ae7d3d9-54f7-4c64-8bf6-08fa5c526687,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f7ec2f7f-f505-44ed-b40d-7b91b2248cea", "address": "fa:16:3e:e2:cd:35", "network": {"id": "cf1fef97-9ef1-449f-a302-b38110024547", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1138167711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-1138167711-network", "vif_mac": "fa:16:3e:e2:cd:35"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "980559734a504574a83224deb7423c77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7ec2f7f-f5", "ovs_interfaceid": "f7ec2f7f-f505-44ed-b40d-7b91b2248cea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 16:41:51 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-0fbbb223-40d3-41a9-b616-a001cf975cd9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Converting VIF {"id": "f7ec2f7f-f505-44ed-b40d-7b91b2248cea", "address": "fa:16:3e:e2:cd:35", "network": {"id": "cf1fef97-9ef1-449f-a302-b38110024547", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1138167711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-1138167711-network", "vif_mac": "fa:16:3e:e2:cd:35"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "980559734a504574a83224deb7423c77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7ec2f7f-f5", "ovs_interfaceid": "f7ec2f7f-f505-44ed-b40d-7b91b2248cea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 16:41:51 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-0fbbb223-40d3-41a9-b616-a001cf975cd9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e2:cd:35,bridge_name='br-int',has_traffic_filtering=True,id=f7ec2f7f-f505-44ed-b40d-7b91b2248cea,network=Network(cf1fef97-9ef1-449f-a302-b38110024547),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf7ec2f7f-f5') {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 16:41:51 user nova-compute[71731]: DEBUG os_vif [None req-0fbbb223-40d3-41a9-b616-a001cf975cd9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e2:cd:35,bridge_name='br-int',has_traffic_filtering=True,id=f7ec2f7f-f505-44ed-b40d-7b91b2248cea,network=Network(cf1fef97-9ef1-449f-a302-b38110024547),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf7ec2f7f-f5') {{(pid=71731) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 16:41:51 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:41:51 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:41:51 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf7ec2f7f-f5, bridge=br-int, if_exists=True) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:41:51 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 16:41:51 user nova-compute[71731]: INFO os_vif [None req-0fbbb223-40d3-41a9-b616-a001cf975cd9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e2:cd:35,bridge_name='br-int',has_traffic_filtering=True,id=f7ec2f7f-f505-44ed-b40d-7b91b2248cea,network=Network(cf1fef97-9ef1-449f-a302-b38110024547),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf7ec2f7f-f5')
Apr 13 16:41:51 user nova-compute[71731]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0fbbb223-40d3-41a9-b616-a001cf975cd9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: 7ae7d3d9-54f7-4c64-8bf6-08fa5c526687] calling os-brick to detach iSCSI Volume {{(pid=71731) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 16:41:51 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fbbb223-40d3-41a9-b616-a001cf975cd9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8cf0118790>, {'target_iqn': 'iqn.2010-10.org.openstack:bebf46c7-444f-475a-9c3f-615d66556271', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ErRsaBJd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 16:41:51 user nova-compute[71731]: WARNING os_brick.initiator.connectors.base [None req-0fbbb223-40d3-41a9-b616-a001cf975cd9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 16:41:51 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-0fbbb223-40d3-41a9-b616-a001cf975cd9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 16:41:51 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-0fbbb223-40d3-41a9-b616-a001cf975cd9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 16:41:51 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:41:51 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:41:51 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:41:51 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[af479773-0231-478f-bda8-cdb92e83413d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:bebf46c7-444f-475a-9c3f-615d66556271\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:41:51 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fbbb223-40d3-41a9-b616-a001cf975cd9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 16:41:51 user nova-compute[71731]: No targets found.
Apr 13 16:41:51 user nova-compute[71731]: iSNS:
Apr 13 16:41:51 user nova-compute[71731]: No targets found.
Apr 13 16:41:51 user nova-compute[71731]: STATIC:
Apr 13 16:41:51 user nova-compute[71731]: Target: iqn.2010-10.org.openstack:bebf46c7-444f-475a-9c3f-615d66556271
Apr 13 16:41:51 user nova-compute[71731]:         Portal: 172.16.0.220:3260,-1
Apr 13 16:41:51 user nova-compute[71731]:                 Iface Name: default
Apr 13 16:41:51 user nova-compute[71731]: FIRMWARE:
Apr 13 16:41:51 user nova-compute[71731]: No targets found.
Apr 13 16:41:51 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 16:41:51 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fbbb223-40d3-41a9-b616-a001cf975cd9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 16:41:51 user nova-compute[71731]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 16:41:51 user nova-compute[71731]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71731) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 16:41:51 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fbbb223-40d3-41a9-b616-a001cf975cd9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bebf46c7-444f-475a-9c3f-615d66556271', 0)] {{(pid=71731) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 16:41:51 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:41:51 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:41:51 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b234504-2314-429f-95e9-8bfd09907871]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bebf46c7-444f-475a-9c3f-615d66556271\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:41:51 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:41:51 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:41:51 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[90507d3e-5931-4339-846c-53c53ca8efb6]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bebf46c7-444f-475a-9c3f-615d66556271 (non-flash)\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:41:51 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fbbb223-40d3-41a9-b616-a001cf975cd9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bebf46c7-444f-475a-9c3f-615d66556271 (non-flash)
Apr 13 16:41:51 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 16:41:51 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fbbb223-40d3-41a9-b616-a001cf975cd9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bebf46c7-444f-475a-9c3f-615d66556271 (non-flash)
Apr 13 16:41:51 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 16:41:51 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fbbb223-40d3-41a9-b616-a001cf975cd9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8cff382560>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bebf46c7-444f-475a-9c3f-615d66556271'): ({'sdb'}, set())}) {{(pid=71731) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 16:41:51 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-0fbbb223-40d3-41a9-b616-a001cf975cd9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Removing single pathed devices sdb {{(pid=71731) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 16:41:51 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:41:51 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:41:51 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[235f5ba3-e89c-4c5c-a1b8-fab50319e67d]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:41:51 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:41:51 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:41:51 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb4b863a-84e3-41db-8e12-95720cbd9d55]: (4, ('ok\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:41:51 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-0fbbb223-40d3-41a9-b616-a001cf975cd9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Flushing IO for device /dev/sdb {{(pid=71731) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 16:41:51 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:41:51 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:41:51 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4735b24-2cd4-4829-a099-1c794ea4bf20]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:41:51 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-0fbbb223-40d3-41a9-b616-a001cf975cd9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71731) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 16:41:51 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:41:51 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.048s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:41:51 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[f512849b-5d57-4f60-90ef-ac1d42fa1e03]: (4, ('1', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:41:51 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-0fbbb223-40d3-41a9-b616-a001cf975cd9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71731) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 16:41:51 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-0fbbb223-40d3-41a9-b616-a001cf975cd9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] SCSI volumes sdb have been removed. {{(pid=71731) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 16:41:51 user nova-compute[71731]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_da7a5db2', '/dev/disk/by-id/scsi-26533336631393931', '/dev/disk/by-id/scsi-1SCST_BIOda7a5db2-e33f1991e80a1e18') {{(pid=81776) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Apr 13 16:41:51 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[88590bf0-538a-4610-a6d7-29e13faf692c]: (4, None) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:41:51 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fbbb223-40d3-41a9-b616-a001cf975cd9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bebf46c7-444f-475a-9c3f-615d66556271')] {{(pid=71731) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 16:41:51 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bebf46c7-444f-475a-9c3f-615d66556271 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:41:51 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bebf46c7-444f-475a-9c3f-615d66556271 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:41:51 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[9261391b-f012-4588-9e2b-27279ea8e670]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:41:51 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fbbb223-40d3-41a9-b616-a001cf975cd9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:41:51 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bebf46c7-444f-475a-9c3f-615d66556271 -p 172.16.0.220:3260 --logout {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:41:51 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bebf46c7-444f-475a-9c3f-615d66556271 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:41:51 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[655baf2e-f779-4ef6-9f86-def11102ce9f]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:bebf46c7-444f-475a-9c3f-615d66556271, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:bebf46c7-444f-475a-9c3f-615d66556271, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:41:51 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fbbb223-40d3-41a9-b616-a001cf975cd9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:bebf46c7-444f-475a-9c3f-615d66556271, portal: 172.16.0.220,3260]
Apr 13 16:41:51 user nova-compute[71731]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:bebf46c7-444f-475a-9c3f-615d66556271, portal: 172.16.0.220,3260] successful.
Apr 13 16:41:51 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:41:51 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bebf46c7-444f-475a-9c3f-615d66556271 -p 172.16.0.220:3260 --op delete {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:41:51 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bebf46c7-444f-475a-9c3f-615d66556271 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:41:51 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[72f34e5a-31f1-4576-871c-2e7637ab124a]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:41:51 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fbbb223-40d3-41a9-b616-a001cf975cd9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:41:51 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-0fbbb223-40d3-41a9-b616-a001cf975cd9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.311s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 16:41:51 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fbbb223-40d3-41a9-b616-a001cf975cd9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] <== disconnect_volume: return (313ms) None {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 16:41:51 user nova-compute[71731]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0fbbb223-40d3-41a9-b616-a001cf975cd9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: 7ae7d3d9-54f7-4c64-8bf6-08fa5c526687] Disconnected iSCSI Volume {{(pid=71731) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 16:41:51 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-0fbbb223-40d3-41a9-b616-a001cf975cd9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71731) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 16:41:52 user nova-compute[71731]: DEBUG nova.network.neutron [None req-0fbbb223-40d3-41a9-b616-a001cf975cd9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: 7ae7d3d9-54f7-4c64-8bf6-08fa5c526687] Port f7ec2f7f-f505-44ed-b40d-7b91b2248cea binding to destination host user is already ACTIVE {{(pid=71731) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3161}}
Apr 13 16:41:52 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-0fbbb223-40d3-41a9-b616-a001cf975cd9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Acquiring lock "7ae7d3d9-54f7-4c64-8bf6-08fa5c526687-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:41:52 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-0fbbb223-40d3-41a9-b616-a001cf975cd9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "7ae7d3d9-54f7-4c64-8bf6-08fa5c526687-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:41:52 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-0fbbb223-40d3-41a9-b616-a001cf975cd9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "7ae7d3d9-54f7-4c64-8bf6-08fa5c526687-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:41:52 user nova-compute[71731]: DEBUG nova.compute.manager [req-fab76706-bed1-4e78-b490-c0218e44ff67 req-ce997434-4e71-4f11-aaf1-01816f210cf0 service nova] [instance: 7ae7d3d9-54f7-4c64-8bf6-08fa5c526687] Received event network-vif-plugged-f7ec2f7f-f505-44ed-b40d-7b91b2248cea {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:41:52 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-fab76706-bed1-4e78-b490-c0218e44ff67 req-ce997434-4e71-4f11-aaf1-01816f210cf0 service nova] Acquiring lock "7ae7d3d9-54f7-4c64-8bf6-08fa5c526687-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:41:52 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-fab76706-bed1-4e78-b490-c0218e44ff67 req-ce997434-4e71-4f11-aaf1-01816f210cf0 service nova] Lock "7ae7d3d9-54f7-4c64-8bf6-08fa5c526687-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:41:52 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-fab76706-bed1-4e78-b490-c0218e44ff67 req-ce997434-4e71-4f11-aaf1-01816f210cf0 service nova] Lock "7ae7d3d9-54f7-4c64-8bf6-08fa5c526687-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:41:52 user nova-compute[71731]: DEBUG nova.compute.manager [req-fab76706-bed1-4e78-b490-c0218e44ff67 req-ce997434-4e71-4f11-aaf1-01816f210cf0 service nova] [instance: 7ae7d3d9-54f7-4c64-8bf6-08fa5c526687] No waiting events found dispatching network-vif-plugged-f7ec2f7f-f505-44ed-b40d-7b91b2248cea {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:41:52 user nova-compute[71731]: WARNING nova.compute.manager [req-fab76706-bed1-4e78-b490-c0218e44ff67 req-ce997434-4e71-4f11-aaf1-01816f210cf0 service nova] [instance: 7ae7d3d9-54f7-4c64-8bf6-08fa5c526687] Received unexpected event network-vif-plugged-f7ec2f7f-f505-44ed-b40d-7b91b2248cea for instance with vm_state active and task_state resize_migrated.
Apr 13 16:41:52 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-0fbbb223-40d3-41a9-b616-a001cf975cd9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Acquiring lock "refresh_cache-7ae7d3d9-54f7-4c64-8bf6-08fa5c526687" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 16:41:52 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-0fbbb223-40d3-41a9-b616-a001cf975cd9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Acquired lock "refresh_cache-7ae7d3d9-54f7-4c64-8bf6-08fa5c526687" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 16:41:52 user nova-compute[71731]: DEBUG nova.network.neutron [None req-0fbbb223-40d3-41a9-b616-a001cf975cd9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: 7ae7d3d9-54f7-4c64-8bf6-08fa5c526687] Building network info cache for instance {{(pid=71731) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 16:41:53 user nova-compute[71731]: DEBUG nova.network.neutron [None req-0fbbb223-40d3-41a9-b616-a001cf975cd9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: 7ae7d3d9-54f7-4c64-8bf6-08fa5c526687] Updating instance_info_cache with network_info: [{"id": "f7ec2f7f-f505-44ed-b40d-7b91b2248cea", "address": "fa:16:3e:e2:cd:35", "network": {"id": "cf1fef97-9ef1-449f-a302-b38110024547", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1138167711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "980559734a504574a83224deb7423c77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7ec2f7f-f5", "ovs_interfaceid": "f7ec2f7f-f505-44ed-b40d-7b91b2248cea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:41:53 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-0fbbb223-40d3-41a9-b616-a001cf975cd9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Releasing lock "refresh_cache-7ae7d3d9-54f7-4c64-8bf6-08fa5c526687" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 16:41:53 user nova-compute[71731]: DEBUG os_brick.utils [None req-0fbbb223-40d3-41a9-b616-a001cf975cd9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 16:41:53 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:41:53 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:41:53 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[d59e7b66-e629-4a2f-828e-31b8c1022953]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:81501d91421\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:41:53 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:41:53 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:41:53 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4b31138-0d9d-4ecc-b676-8b265f066a88]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:41:53 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:41:53 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:41:53 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[12e25209-25f4-4600-a09b-2ee0363d574f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:41:53 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5e1911d-a8d7-426e-8151-aec91d36b625]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:41:53 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-0fbbb223-40d3-41a9-b616-a001cf975cd9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Running cmd (subprocess): nvme version {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:41:53 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-0fbbb223-40d3-41a9-b616-a001cf975cd9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] 'nvme version' failed. Not Retrying. {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 16:41:53 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0fbbb223-40d3-41a9-b616-a001cf975cd9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] nvme not present on system {{(pid=71731) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 16:41:53 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:41:53 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 16:41:53 user nova-compute[71731]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 16:41:53 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[9449aefa-11c7-4792-86d4-6f6cbe357d91]: (4, '') {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:41:53 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.lightos [None req-0fbbb223-40d3-41a9-b616-a001cf975cd9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71731) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 16:41:53 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.lightos [None req-0fbbb223-40d3-41a9-b616-a001cf975cd9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71731) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 16:41:53 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.lightos [None req-0fbbb223-40d3-41a9-b616-a001cf975cd9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] LIGHTOS: no hostnqn found. {{(pid=71731) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 16:41:53 user nova-compute[71731]: DEBUG os_brick.utils [None req-0fbbb223-40d3-41a9-b616-a001cf975cd9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:81501d91421', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 16:41:56 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:41:57 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-0fbbb223-40d3-41a9-b616-a001cf975cd9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: 7ae7d3d9-54f7-4c64-8bf6-08fa5c526687] Starting finish_migration {{(pid=71731) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11647}}
Apr 13 16:41:57 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-0fbbb223-40d3-41a9-b616-a001cf975cd9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: 7ae7d3d9-54f7-4c64-8bf6-08fa5c526687] Instance directory exists: not creating {{(pid=71731) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 13 16:41:57 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-0fbbb223-40d3-41a9-b616-a001cf975cd9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: 7ae7d3d9-54f7-4c64-8bf6-08fa5c526687] Creating image(s)
Apr 13 16:41:57 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-0fbbb223-40d3-41a9-b616-a001cf975cd9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: 7ae7d3d9-54f7-4c64-8bf6-08fa5c526687] Did not create local disks {{(pid=71731) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 13 16:41:57 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-0fbbb223-40d3-41a9-b616-a001cf975cd9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: 7ae7d3d9-54f7-4c64-8bf6-08fa5c526687] Ensure instance console log exists: /opt/stack/data/nova/instances/7ae7d3d9-54f7-4c64-8bf6-08fa5c526687/console.log {{(pid=71731) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 16:41:57 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-0fbbb223-40d3-41a9-b616-a001cf975cd9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:41:57 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-0fbbb223-40d3-41a9-b616-a001cf975cd9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:41:57 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-0fbbb223-40d3-41a9-b616-a001cf975cd9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:41:57 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-0fbbb223-40d3-41a9-b616-a001cf975cd9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: 7ae7d3d9-54f7-4c64-8bf6-08fa5c526687] Start _get_guest_xml network_info=[{"id": "f7ec2f7f-f505-44ed-b40d-7b91b2248cea", "address": "fa:16:3e:e2:cd:35", "network": {"id": "cf1fef97-9ef1-449f-a302-b38110024547", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1138167711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-1138167711-network", "vif_mac": "fa:16:3e:e2:cd:35"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "980559734a504574a83224deb7423c77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7ec2f7f-f5", "ovs_interfaceid": "f7ec2f7f-f505-44ed-b40d-7b91b2248cea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'attachment_id': '34ce6d6e-d62e-4252-b0fe-4b7e725af23b', 'mount_device': '/dev/vda', 'delete_on_termination': True, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:bebf46c7-444f-475a-9c3f-615d66556271', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ErRsaBJd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '7ae7d3d9-54f7-4c64-8bf6-08fa5c526687', 'attached_at': '2023-04-13T16:41:58.000000', 'detached_at': '', 'volume_id': 'bebf46c7-444f-475a-9c3f-615d66556271', 'serial': 'bebf46c7-444f-475a-9c3f-615d66556271'}, 'disk_bus': 'virtio', 'guest_format': None, 'volume_type': None} {{(pid=71731) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 16:41:57 user nova-compute[71731]: WARNING nova.virt.libvirt.driver [None req-0fbbb223-40d3-41a9-b616-a001cf975cd9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 16:41:57 user nova-compute[71731]: WARNING nova.virt.libvirt.driver [None req-0fbbb223-40d3-41a9-b616-a001cf975cd9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 16:41:57 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-0fbbb223-40d3-41a9-b616-a001cf975cd9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71731) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 16:41:57 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-0fbbb223-40d3-41a9-b616-a001cf975cd9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T16:17:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='84',id=12,is_public=True,memory_mb=192,name='m1.micro',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 16:41:57 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-0fbbb223-40d3-41a9-b616-a001cf975cd9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Flavor limits 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 16:41:57 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-0fbbb223-40d3-41a9-b616-a001cf975cd9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Image limits 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 16:41:57 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-0fbbb223-40d3-41a9-b616-a001cf975cd9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Flavor pref 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 16:41:57 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-0fbbb223-40d3-41a9-b616-a001cf975cd9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Image pref 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 16:41:57 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-0fbbb223-40d3-41a9-b616-a001cf975cd9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 16:41:57 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-0fbbb223-40d3-41a9-b616-a001cf975cd9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 16:41:57 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-0fbbb223-40d3-41a9-b616-a001cf975cd9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71731) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 16:41:57 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-0fbbb223-40d3-41a9-b616-a001cf975cd9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Got 1 possible topologies {{(pid=71731) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 16:41:57 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-0fbbb223-40d3-41a9-b616-a001cf975cd9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 16:41:57 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-0fbbb223-40d3-41a9-b616-a001cf975cd9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 16:41:57 user nova-compute[71731]: DEBUG nova.objects.instance [None req-0fbbb223-40d3-41a9-b616-a001cf975cd9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lazy-loading 'vcpu_model' on Instance uuid 7ae7d3d9-54f7-4c64-8bf6-08fa5c526687 {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:41:57 user nova-compute[71731]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0fbbb223-40d3-41a9-b616-a001cf975cd9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: 7ae7d3d9-54f7-4c64-8bf6-08fa5c526687] Calling os-brick to attach iSCSI Volume {{(pid=71731) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 16:41:57 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fbbb223-40d3-41a9-b616-a001cf975cd9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8cf0118790>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:bebf46c7-444f-475a-9c3f-615d66556271', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ErRsaBJd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 16:41:57 user nova-compute[71731]: WARNING os_brick.initiator.connectors.base [None req-0fbbb223-40d3-41a9-b616-a001cf975cd9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 16:41:57 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-0fbbb223-40d3-41a9-b616-a001cf975cd9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 16:41:57 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-0fbbb223-40d3-41a9-b616-a001cf975cd9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 16:41:57 user nova-compute[71731]: WARNING os_brick.initiator.connectors.base [None req-0fbbb223-40d3-41a9-b616-a001cf975cd9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 16:41:57 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-0fbbb223-40d3-41a9-b616-a001cf975cd9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bebf46c7-444f-475a-9c3f-615d66556271" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 16:41:57 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-0fbbb223-40d3-41a9-b616-a001cf975cd9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bebf46c7-444f-475a-9c3f-615d66556271" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 16:41:57 user nova-compute[71731]: INFO os_brick.initiator.connectors.iscsi [None req-0fbbb223-40d3-41a9-b616-a001cf975cd9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 16:41:57 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bebf46c7-444f-475a-9c3f-615d66556271 -p 172.16.0.220:3260 {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:41:57 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bebf46c7-444f-475a-9c3f-615d66556271 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:41:57 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c0622cf-387e-470e-8b2a-b83f9a787288]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:41:57 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fbbb223-40d3-41a9-b616-a001cf975cd9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 16:41:57 user nova-compute[71731]:  {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:41:57 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bebf46c7-444f-475a-9c3f-615d66556271 -p 172.16.0.220:3260 --interface default --op new {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:41:57 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bebf46c7-444f-475a-9c3f-615d66556271 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:41:57 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae898fc3-825b-4ab2-93de-fbae82c06d99]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bebf46c7-444f-475a-9c3f-615d66556271] added\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:41:57 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fbbb223-40d3-41a9-b616-a001cf975cd9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bebf46c7-444f-475a-9c3f-615d66556271] added
Apr 13 16:41:57 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:41:57 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bebf46c7-444f-475a-9c3f-615d66556271 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:41:57 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bebf46c7-444f-475a-9c3f-615d66556271 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:41:57 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb8a1a47-4b80-40bc-8d39-5b24186d9052]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:41:57 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fbbb223-40d3-41a9-b616-a001cf975cd9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:41:57 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bebf46c7-444f-475a-9c3f-615d66556271 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:41:58 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bebf46c7-444f-475a-9c3f-615d66556271 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:41:58 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7d0da6d-2fed-4257-9958-0924a03b8e2f]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:41:58 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fbbb223-40d3-41a9-b616-a001cf975cd9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:41:58 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bebf46c7-444f-475a-9c3f-615d66556271 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ErRsaBJd {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:41:58 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bebf46c7-444f-475a-9c3f-615d66556271 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ErRsaBJd" returned: 0 in 0.016s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:41:58 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[e530f7f6-6dc4-49d8-be2e-92e30b8db251]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:41:58 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fbbb223-40d3-41a9-b616-a001cf975cd9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ErRsaBJd'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:41:58 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bebf46c7-444f-475a-9c3f-615d66556271 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:41:58 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bebf46c7-444f-475a-9c3f-615d66556271 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:41:58 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d3e7751-c78f-49b4-ab4b-e29813095856]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:41:58 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fbbb223-40d3-41a9-b616-a001cf975cd9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:41:58 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:41:58 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:41:58 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[c85655cc-4cca-4cf0-aeee-715fe67bad4c]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:41:58 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fbbb223-40d3-41a9-b616-a001cf975cd9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Apr 13 16:41:58 user nova-compute[71731]:  {{(pid=71731) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 16:41:58 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fbbb223-40d3-41a9-b616-a001cf975cd9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Apr 13 16:41:58 user nova-compute[71731]:  {{(pid=71731) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 16:41:58 user nova-compute[71731]: WARNING os_brick.initiator.connectors.iscsi [None req-0fbbb223-40d3-41a9-b616-a001cf975cd9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Apr 13 16:41:58 user nova-compute[71731]: 
Apr 13 16:41:58 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bebf46c7-444f-475a-9c3f-615d66556271 -p 172.16.0.220:3260 --login {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:41:58 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bebf46c7-444f-475a-9c3f-615d66556271 -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:41:58 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[da6d038c-be5f-43c4-bbad-6d1c4d4b7001]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bebf46c7-444f-475a-9c3f-615d66556271, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bebf46c7-444f-475a-9c3f-615d66556271, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:41:58 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fbbb223-40d3-41a9-b616-a001cf975cd9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bebf46c7-444f-475a-9c3f-615d66556271, portal: 172.16.0.220,3260]
Apr 13 16:41:58 user nova-compute[71731]: Login to [iface: default, target: iqn.2010-10.org.openstack:bebf46c7-444f-475a-9c3f-615d66556271, portal: 172.16.0.220,3260] successful.
Apr 13 16:41:58 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:41:58 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bebf46c7-444f-475a-9c3f-615d66556271 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:41:58 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bebf46c7-444f-475a-9c3f-615d66556271 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:41:58 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[05d4bb22-4f6e-4604-b693-13a06aab369d]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:41:58 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fbbb223-40d3-41a9-b616-a001cf975cd9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:41:58 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:41:58 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:41:58 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8b4fc15-f311-4d66-9164-d0ed8445aae7]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bebf46c7-444f-475a-9c3f-615d66556271 (non-flash)\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:41:58 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fbbb223-40d3-41a9-b616-a001cf975cd9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bebf46c7-444f-475a-9c3f-615d66556271 (non-flash)
Apr 13 16:41:58 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 16:41:58 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fbbb223-40d3-41a9-b616-a001cf975cd9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bebf46c7-444f-475a-9c3f-615d66556271 (non-flash)
Apr 13 16:41:58 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 16:41:58 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-0fbbb223-40d3-41a9-b616-a001cf975cd9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bebf46c7-444f-475a-9c3f-615d66556271" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.236s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 16:41:58 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fbbb223-40d3-41a9-b616-a001cf975cd9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Connected to 172.16.0.220:3260 {{(pid=71731) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 16:41:58 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-0fbbb223-40d3-41a9-b616-a001cf975cd9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] HCTL ('33', '-', '-', 0) found on session 45 with lun 0 {{(pid=71731) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 16:41:58 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-0fbbb223-40d3-41a9-b616-a001cf975cd9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71731) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 16:41:58 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:41:58 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:41:58 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fcda737-b4ea-41ed-a589-26d96fe19d96]: (4, ('- - 0', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:41:58 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-0fbbb223-40d3-41a9-b616-a001cf975cd9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Searching for a device in session 45 and hctl ['33', '*', '*', 0] yield: None {{(pid=71731) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 16:41:59 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-0fbbb223-40d3-41a9-b616-a001cf975cd9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Searching for a device in session 45 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71731) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 16:41:59 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fbbb223-40d3-41a9-b616-a001cf975cd9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:bebf46c7-444f-475a-9c3f-615d66556271', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ErRsaBJd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71731) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 16:41:59 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-0fbbb223-40d3-41a9-b616-a001cf975cd9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.266s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 16:41:59 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fbbb223-40d3-41a9-b616-a001cf975cd9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] <== connect_volume: return (1268ms) {'type': 'block', 'scsi_wwn': '26533336631393931', 'path': '/dev/sdb'} {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 16:41:59 user nova-compute[71731]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0fbbb223-40d3-41a9-b616-a001cf975cd9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: 7ae7d3d9-54f7-4c64-8bf6-08fa5c526687] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26533336631393931', 'path': '/dev/sdb'} {{(pid=71731) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 16:41:59 user nova-compute[71731]: DEBUG nova.virt.libvirt.vif [None req-0fbbb223-40d3-41a9-b616-a001cf975cd9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T16:39:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-182216296',display_name='tempest-ServerActionsTestJSON-server-182216296',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-182216296',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPaDda4gTmMbkxKfok8i4i1XcNLza5lOVYjCPDEGVTF1JRQKderq80DnIN4GAkaZiBV5U44gvdu3wadL/M5wOH7VDSuEghHchow1mC9TB1xgdo8GoXeM279SVAyu08uhIQ==',key_name='tempest-keypair-1700037342',keypairs=<?>,launch_index=0,launched_at=2023-04-13T16:40:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='980559734a504574a83224deb7423c77',ramdisk_id='',reservation_id='r-r4a3hst0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-713402718',owner_user_name='tempest-ServerActionsTestJSON-713402718-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T16:41:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1b3df1c5c5d441819bcef89ed6966815',uuid=7ae7d3d9-54f7-4c64-8bf6-08fa5c526687,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f7ec2f7f-f505-44ed-b40d-7b91b2248cea", "address": "fa:16:3e:e2:cd:35", "network": {"id": "cf1fef97-9ef1-449f-a302-b38110024547", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1138167711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-1138167711-network", "vif_mac": "fa:16:3e:e2:cd:35"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "980559734a504574a83224deb7423c77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7ec2f7f-f5", "ovs_interfaceid": "f7ec2f7f-f505-44ed-b40d-7b91b2248cea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71731) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 16:41:59 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-0fbbb223-40d3-41a9-b616-a001cf975cd9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Converting VIF {"id": "f7ec2f7f-f505-44ed-b40d-7b91b2248cea", "address": "fa:16:3e:e2:cd:35", "network": {"id": "cf1fef97-9ef1-449f-a302-b38110024547", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1138167711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-1138167711-network", "vif_mac": "fa:16:3e:e2:cd:35"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "980559734a504574a83224deb7423c77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7ec2f7f-f5", "ovs_interfaceid": "f7ec2f7f-f505-44ed-b40d-7b91b2248cea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 16:41:59 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-0fbbb223-40d3-41a9-b616-a001cf975cd9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:cd:35,bridge_name='br-int',has_traffic_filtering=True,id=f7ec2f7f-f505-44ed-b40d-7b91b2248cea,network=Network(cf1fef97-9ef1-449f-a302-b38110024547),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf7ec2f7f-f5') {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 16:41:59 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-0fbbb223-40d3-41a9-b616-a001cf975cd9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: 7ae7d3d9-54f7-4c64-8bf6-08fa5c526687] End _get_guest_xml xml=<domain type="kvm">
Apr 13 16:41:59 user nova-compute[71731]:   <uuid>7ae7d3d9-54f7-4c64-8bf6-08fa5c526687</uuid>
Apr 13 16:41:59 user nova-compute[71731]:   <name>instance-00000023</name>
Apr 13 16:41:59 user nova-compute[71731]:   <memory>196608</memory>
Apr 13 16:41:59 user nova-compute[71731]:   <vcpu>1</vcpu>
Apr 13 16:41:59 user nova-compute[71731]:   <metadata>
Apr 13 16:41:59 user nova-compute[71731]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 16:41:59 user nova-compute[71731]:       <nova:package version="0.0.0"/>
Apr 13 16:41:59 user nova-compute[71731]:       <nova:name>tempest-ServerActionsTestJSON-server-182216296</nova:name>
Apr 13 16:41:59 user nova-compute[71731]:       <nova:creationTime>2023-04-13 16:41:57</nova:creationTime>
Apr 13 16:41:59 user nova-compute[71731]:       <nova:flavor name="m1.micro">
Apr 13 16:41:59 user nova-compute[71731]:         <nova:memory>192</nova:memory>
Apr 13 16:41:59 user nova-compute[71731]:         <nova:disk>1</nova:disk>
Apr 13 16:41:59 user nova-compute[71731]:         <nova:swap>0</nova:swap>
Apr 13 16:41:59 user nova-compute[71731]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 16:41:59 user nova-compute[71731]:         <nova:vcpus>1</nova:vcpus>
Apr 13 16:41:59 user nova-compute[71731]:       </nova:flavor>
Apr 13 16:41:59 user nova-compute[71731]:       <nova:owner>
Apr 13 16:41:59 user nova-compute[71731]:         <nova:user uuid="1b3df1c5c5d441819bcef89ed6966815">tempest-ServerActionsTestJSON-713402718-project-member</nova:user>
Apr 13 16:41:59 user nova-compute[71731]:         <nova:project uuid="980559734a504574a83224deb7423c77">tempest-ServerActionsTestJSON-713402718</nova:project>
Apr 13 16:41:59 user nova-compute[71731]:       </nova:owner>
Apr 13 16:41:59 user nova-compute[71731]:       <nova:ports>
Apr 13 16:41:59 user nova-compute[71731]:         <nova:port uuid="f7ec2f7f-f505-44ed-b40d-7b91b2248cea">
Apr 13 16:41:59 user nova-compute[71731]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Apr 13 16:41:59 user nova-compute[71731]:         </nova:port>
Apr 13 16:41:59 user nova-compute[71731]:       </nova:ports>
Apr 13 16:41:59 user nova-compute[71731]:     </nova:instance>
Apr 13 16:41:59 user nova-compute[71731]:   </metadata>
Apr 13 16:41:59 user nova-compute[71731]:   <sysinfo type="smbios">
Apr 13 16:41:59 user nova-compute[71731]:     <system>
Apr 13 16:41:59 user nova-compute[71731]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 16:41:59 user nova-compute[71731]:       <entry name="product">OpenStack Nova</entry>
Apr 13 16:41:59 user nova-compute[71731]:       <entry name="version">0.0.0</entry>
Apr 13 16:41:59 user nova-compute[71731]:       <entry name="serial">7ae7d3d9-54f7-4c64-8bf6-08fa5c526687</entry>
Apr 13 16:41:59 user nova-compute[71731]:       <entry name="uuid">7ae7d3d9-54f7-4c64-8bf6-08fa5c526687</entry>
Apr 13 16:41:59 user nova-compute[71731]:       <entry name="family">Virtual Machine</entry>
Apr 13 16:41:59 user nova-compute[71731]:     </system>
Apr 13 16:41:59 user nova-compute[71731]:   </sysinfo>
Apr 13 16:41:59 user nova-compute[71731]:   <os>
Apr 13 16:41:59 user nova-compute[71731]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 16:41:59 user nova-compute[71731]:     <boot dev="hd"/>
Apr 13 16:41:59 user nova-compute[71731]:     <smbios mode="sysinfo"/>
Apr 13 16:41:59 user nova-compute[71731]:   </os>
Apr 13 16:41:59 user nova-compute[71731]:   <features>
Apr 13 16:41:59 user nova-compute[71731]:     <acpi/>
Apr 13 16:41:59 user nova-compute[71731]:     <apic/>
Apr 13 16:41:59 user nova-compute[71731]:     <vmcoreinfo/>
Apr 13 16:41:59 user nova-compute[71731]:   </features>
Apr 13 16:41:59 user nova-compute[71731]:   <clock offset="utc">
Apr 13 16:41:59 user nova-compute[71731]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 16:41:59 user nova-compute[71731]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 16:41:59 user nova-compute[71731]:     <timer name="hpet" present="no"/>
Apr 13 16:41:59 user nova-compute[71731]:   </clock>
Apr 13 16:41:59 user nova-compute[71731]:   <cpu mode="custom" match="exact">
Apr 13 16:41:59 user nova-compute[71731]:     <model>Nehalem</model>
Apr 13 16:41:59 user nova-compute[71731]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 16:41:59 user nova-compute[71731]:   </cpu>
Apr 13 16:41:59 user nova-compute[71731]:   <devices>
Apr 13 16:41:59 user nova-compute[71731]:     <disk type="block" device="disk">
Apr 13 16:41:59 user nova-compute[71731]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 16:41:59 user nova-compute[71731]:       <source dev="/dev/sdb"/>
Apr 13 16:41:59 user nova-compute[71731]:       <target dev="vda" bus="virtio"/>
Apr 13 16:41:59 user nova-compute[71731]:       <serial>bebf46c7-444f-475a-9c3f-615d66556271</serial>
Apr 13 16:41:59 user nova-compute[71731]:     </disk>
Apr 13 16:41:59 user nova-compute[71731]:     <interface type="ethernet">
Apr 13 16:41:59 user nova-compute[71731]:       <mac address="fa:16:3e:e2:cd:35"/>
Apr 13 16:41:59 user nova-compute[71731]:       <model type="virtio"/>
Apr 13 16:41:59 user nova-compute[71731]:       <mtu size="1442"/>
Apr 13 16:41:59 user nova-compute[71731]:       <target dev="tapf7ec2f7f-f5"/>
Apr 13 16:41:59 user nova-compute[71731]:     </interface>
Apr 13 16:41:59 user nova-compute[71731]:     <serial type="pty">
Apr 13 16:41:59 user nova-compute[71731]:       <log file="/opt/stack/data/nova/instances/7ae7d3d9-54f7-4c64-8bf6-08fa5c526687/console.log" append="off"/>
Apr 13 16:41:59 user nova-compute[71731]:     </serial>
Apr 13 16:41:59 user nova-compute[71731]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 16:41:59 user nova-compute[71731]:     <video>
Apr 13 16:41:59 user nova-compute[71731]:       <model type="virtio"/>
Apr 13 16:41:59 user nova-compute[71731]:     </video>
Apr 13 16:41:59 user nova-compute[71731]:     <rng model="virtio">
Apr 13 16:41:59 user nova-compute[71731]:       <backend model="random">/dev/urandom</backend>
Apr 13 16:41:59 user nova-compute[71731]:     </rng>
Apr 13 16:41:59 user nova-compute[71731]:     <controller type="usb" index="0" model="none"/>
Apr 13 16:41:59 user nova-compute[71731]:     <memballoon model="virtio">
Apr 13 16:41:59 user nova-compute[71731]:       <stats period="10"/>
Apr 13 16:41:59 user nova-compute[71731]:     </memballoon>
Apr 13 16:41:59 user nova-compute[71731]:   </devices>
Apr 13 16:41:59 user nova-compute[71731]: </domain>
Apr 13 16:41:59 user nova-compute[71731]:  {{(pid=71731) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 16:41:59 user nova-compute[71731]: DEBUG nova.virt.libvirt.vif [None req-0fbbb223-40d3-41a9-b616-a001cf975cd9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T16:39:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-182216296',display_name='tempest-ServerActionsTestJSON-server-182216296',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-182216296',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPaDda4gTmMbkxKfok8i4i1XcNLza5lOVYjCPDEGVTF1JRQKderq80DnIN4GAkaZiBV5U44gvdu3wadL/M5wOH7VDSuEghHchow1mC9TB1xgdo8GoXeM279SVAyu08uhIQ==',key_name='tempest-keypair-1700037342',keypairs=<?>,launch_index=0,launched_at=2023-04-13T16:40:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='980559734a504574a83224deb7423c77',ramdisk_id='',reservation_id='r-r4a3hst0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-713402718',owner_user_name='tempest-ServerActionsTestJSON-713402718-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T16:41:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1b3df1c5c5d441819bcef89ed6966815',uuid=7ae7d3d9-54f7-4c64-8bf6-08fa5c526687,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f7ec2f7f-f505-44ed-b40d-7b91b2248cea", "address": "fa:16:3e:e2:cd:35", "network": {"id": "cf1fef97-9ef1-449f-a302-b38110024547", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1138167711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-1138167711-network", "vif_mac": "fa:16:3e:e2:cd:35"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "980559734a504574a83224deb7423c77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7ec2f7f-f5", "ovs_interfaceid": "f7ec2f7f-f505-44ed-b40d-7b91b2248cea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 16:41:59 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-0fbbb223-40d3-41a9-b616-a001cf975cd9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Converting VIF {"id": "f7ec2f7f-f505-44ed-b40d-7b91b2248cea", "address": "fa:16:3e:e2:cd:35", "network": {"id": "cf1fef97-9ef1-449f-a302-b38110024547", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1138167711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-1138167711-network", "vif_mac": "fa:16:3e:e2:cd:35"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "980559734a504574a83224deb7423c77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7ec2f7f-f5", "ovs_interfaceid": "f7ec2f7f-f505-44ed-b40d-7b91b2248cea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 16:41:59 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-0fbbb223-40d3-41a9-b616-a001cf975cd9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:cd:35,bridge_name='br-int',has_traffic_filtering=True,id=f7ec2f7f-f505-44ed-b40d-7b91b2248cea,network=Network(cf1fef97-9ef1-449f-a302-b38110024547),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf7ec2f7f-f5') {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 16:41:59 user nova-compute[71731]: DEBUG os_vif [None req-0fbbb223-40d3-41a9-b616-a001cf975cd9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:cd:35,bridge_name='br-int',has_traffic_filtering=True,id=f7ec2f7f-f505-44ed-b40d-7b91b2248cea,network=Network(cf1fef97-9ef1-449f-a302-b38110024547),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf7ec2f7f-f5') {{(pid=71731) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 16:41:59 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:41:59 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:41:59 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 16:41:59 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:41:59 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf7ec2f7f-f5, may_exist=True) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:41:59 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf7ec2f7f-f5, col_values=(('external_ids', {'iface-id': 'f7ec2f7f-f505-44ed-b40d-7b91b2248cea', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e2:cd:35', 'vm-uuid': '7ae7d3d9-54f7-4c64-8bf6-08fa5c526687'}),)) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:41:59 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:41:59 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 16:41:59 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:41:59 user nova-compute[71731]: INFO os_vif [None req-0fbbb223-40d3-41a9-b616-a001cf975cd9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:cd:35,bridge_name='br-int',has_traffic_filtering=True,id=f7ec2f7f-f505-44ed-b40d-7b91b2248cea,network=Network(cf1fef97-9ef1-449f-a302-b38110024547),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf7ec2f7f-f5')
Apr 13 16:41:59 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-0fbbb223-40d3-41a9-b616-a001cf975cd9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] No BDM found with device name vda, not building metadata. {{(pid=71731) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 16:41:59 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-0fbbb223-40d3-41a9-b616-a001cf975cd9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] No VIF found with MAC fa:16:3e:e2:cd:35, not building metadata {{(pid=71731) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 16:42:00 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:42:00 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:42:00 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:42:00 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:42:00 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:42:00 user nova-compute[71731]: DEBUG nova.compute.manager [req-ee7254a5-b8f3-497a-89da-806265541af4 req-81e09609-e13f-47b3-a7a2-4f06f180d4bf service nova] [instance: 7ae7d3d9-54f7-4c64-8bf6-08fa5c526687] Received event network-vif-plugged-f7ec2f7f-f505-44ed-b40d-7b91b2248cea {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:42:00 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-ee7254a5-b8f3-497a-89da-806265541af4 req-81e09609-e13f-47b3-a7a2-4f06f180d4bf service nova] Acquiring lock "7ae7d3d9-54f7-4c64-8bf6-08fa5c526687-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:42:00 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-ee7254a5-b8f3-497a-89da-806265541af4 req-81e09609-e13f-47b3-a7a2-4f06f180d4bf service nova] Lock "7ae7d3d9-54f7-4c64-8bf6-08fa5c526687-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:42:00 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-ee7254a5-b8f3-497a-89da-806265541af4 req-81e09609-e13f-47b3-a7a2-4f06f180d4bf service nova] Lock "7ae7d3d9-54f7-4c64-8bf6-08fa5c526687-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:42:00 user nova-compute[71731]: DEBUG nova.compute.manager [req-ee7254a5-b8f3-497a-89da-806265541af4 req-81e09609-e13f-47b3-a7a2-4f06f180d4bf service nova] [instance: 7ae7d3d9-54f7-4c64-8bf6-08fa5c526687] No waiting events found dispatching network-vif-plugged-f7ec2f7f-f505-44ed-b40d-7b91b2248cea {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:42:00 user nova-compute[71731]: WARNING nova.compute.manager [req-ee7254a5-b8f3-497a-89da-806265541af4 req-81e09609-e13f-47b3-a7a2-4f06f180d4bf service nova] [instance: 7ae7d3d9-54f7-4c64-8bf6-08fa5c526687] Received unexpected event network-vif-plugged-f7ec2f7f-f505-44ed-b40d-7b91b2248cea for instance with vm_state active and task_state resize_finish.
Apr 13 16:42:02 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:42:02 user nova-compute[71731]: DEBUG nova.virt.libvirt.host [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Removed pending event for 7ae7d3d9-54f7-4c64-8bf6-08fa5c526687 due to event {{(pid=71731) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 13 16:42:02 user nova-compute[71731]: DEBUG nova.virt.driver [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Emitting event <LifecycleEvent: 1681404122.6880236, 7ae7d3d9-54f7-4c64-8bf6-08fa5c526687 => Resumed> {{(pid=71731) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 16:42:02 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 7ae7d3d9-54f7-4c64-8bf6-08fa5c526687] VM Resumed (Lifecycle Event)
Apr 13 16:42:02 user nova-compute[71731]: DEBUG nova.compute.manager [None req-0fbbb223-40d3-41a9-b616-a001cf975cd9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: 7ae7d3d9-54f7-4c64-8bf6-08fa5c526687] Instance event wait completed in 0 seconds for  {{(pid=71731) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 16:42:02 user nova-compute[71731]: INFO nova.virt.libvirt.driver [-] [instance: 7ae7d3d9-54f7-4c64-8bf6-08fa5c526687] Instance running successfully.
Apr 13 16:42:02 user nova-compute[71731]: DEBUG nova.virt.libvirt.guest [None req-0fbbb223-40d3-41a9-b616-a001cf975cd9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: 7ae7d3d9-54f7-4c64-8bf6-08fa5c526687] Failed to set time: agent not configured {{(pid=71731) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Apr 13 16:42:02 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-0fbbb223-40d3-41a9-b616-a001cf975cd9 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: 7ae7d3d9-54f7-4c64-8bf6-08fa5c526687] finish_migration finished successfully. {{(pid=71731) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11742}}
Apr 13 16:42:02 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 7ae7d3d9-54f7-4c64-8bf6-08fa5c526687] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:42:02 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 7ae7d3d9-54f7-4c64-8bf6-08fa5c526687] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=71731) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 16:42:02 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 7ae7d3d9-54f7-4c64-8bf6-08fa5c526687] During sync_power_state the instance has a pending task (resize_finish). Skip.
Apr 13 16:42:02 user nova-compute[71731]: DEBUG nova.virt.driver [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Emitting event <LifecycleEvent: 1681404122.6934092, 7ae7d3d9-54f7-4c64-8bf6-08fa5c526687 => Started> {{(pid=71731) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 16:42:02 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 7ae7d3d9-54f7-4c64-8bf6-08fa5c526687] VM Started (Lifecycle Event)
Apr 13 16:42:02 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 7ae7d3d9-54f7-4c64-8bf6-08fa5c526687] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:42:02 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 7ae7d3d9-54f7-4c64-8bf6-08fa5c526687] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=71731) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 16:42:02 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 7ae7d3d9-54f7-4c64-8bf6-08fa5c526687] During sync_power_state the instance has a pending task (resize_finish). Skip.
Apr 13 16:42:02 user nova-compute[71731]: DEBUG nova.compute.manager [req-0b356f5d-410e-4dac-bcdb-2b5895159777 req-9a390334-563f-4752-aef4-3bb30bd93b9b service nova] [instance: 7ae7d3d9-54f7-4c64-8bf6-08fa5c526687] Received event network-vif-plugged-f7ec2f7f-f505-44ed-b40d-7b91b2248cea {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:42:02 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-0b356f5d-410e-4dac-bcdb-2b5895159777 req-9a390334-563f-4752-aef4-3bb30bd93b9b service nova] Acquiring lock "7ae7d3d9-54f7-4c64-8bf6-08fa5c526687-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:42:02 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-0b356f5d-410e-4dac-bcdb-2b5895159777 req-9a390334-563f-4752-aef4-3bb30bd93b9b service nova] Lock "7ae7d3d9-54f7-4c64-8bf6-08fa5c526687-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:42:02 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-0b356f5d-410e-4dac-bcdb-2b5895159777 req-9a390334-563f-4752-aef4-3bb30bd93b9b service nova] Lock "7ae7d3d9-54f7-4c64-8bf6-08fa5c526687-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:42:02 user nova-compute[71731]: DEBUG nova.compute.manager [req-0b356f5d-410e-4dac-bcdb-2b5895159777 req-9a390334-563f-4752-aef4-3bb30bd93b9b service nova] [instance: 7ae7d3d9-54f7-4c64-8bf6-08fa5c526687] No waiting events found dispatching network-vif-plugged-f7ec2f7f-f505-44ed-b40d-7b91b2248cea {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:42:02 user nova-compute[71731]: WARNING nova.compute.manager [req-0b356f5d-410e-4dac-bcdb-2b5895159777 req-9a390334-563f-4752-aef4-3bb30bd93b9b service nova] [instance: 7ae7d3d9-54f7-4c64-8bf6-08fa5c526687] Received unexpected event network-vif-plugged-f7ec2f7f-f505-44ed-b40d-7b91b2248cea for instance with vm_state resized and task_state None.
Apr 13 16:42:04 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:42:09 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 16:42:09 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:42:09 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71731) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 16:42:09 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71731) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 16:42:09 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71731) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 16:42:09 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:42:12 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:42:14 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:42:17 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:42:19 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:42:21 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:42:22 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:42:23 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager.update_available_resource {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:42:23 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:42:23 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:42:23 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:42:23 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Auditing locally available compute resources for user (node: user) {{(pid=71731) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 16:42:23 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71731) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 16:42:23 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3af23ff8-4e10-4fbf-a86e-bda842f084ff/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:42:23 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3af23ff8-4e10-4fbf-a86e-bda842f084ff/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:42:23 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3af23ff8-4e10-4fbf-a86e-bda842f084ff/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:42:23 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3af23ff8-4e10-4fbf-a86e-bda842f084ff/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:42:23 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ed800fe-577d-4624-898c-c7f40da77376/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:42:23 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ed800fe-577d-4624-898c-c7f40da77376/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:42:23 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ed800fe-577d-4624-898c-c7f40da77376/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:42:23 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ed800fe-577d-4624-898c-c7f40da77376/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:42:23 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2d55cdd-c89c-4c59-afe1-49a33225af22/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:42:23 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2d55cdd-c89c-4c59-afe1-49a33225af22/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:42:23 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2d55cdd-c89c-4c59-afe1-49a33225af22/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:42:24 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2d55cdd-c89c-4c59-afe1-49a33225af22/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:42:24 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:42:24 user nova-compute[71731]: WARNING nova.virt.libvirt.driver [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 16:42:24 user nova-compute[71731]: WARNING nova.virt.libvirt.driver [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 16:42:24 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Hypervisor/Node resource view: name=user free_ram=8365MB free_disk=26.120708465576172GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71731) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 16:42:24 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:42:24 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:42:24 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Applying migration context for instance 7ae7d3d9-54f7-4c64-8bf6-08fa5c526687 as it has an incoming, in-progress migration fc53a14d-8658-42db-a644-15b07e017d46. Migration status is finished {{(pid=71731) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:950}}
Apr 13 16:42:24 user nova-compute[71731]: INFO nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] [instance: 7ae7d3d9-54f7-4c64-8bf6-08fa5c526687] Updating resource usage from migration fc53a14d-8658-42db-a644-15b07e017d46
Apr 13 16:42:24 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance 5ed800fe-577d-4624-898c-c7f40da77376 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 16:42:24 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance b2d55cdd-c89c-4c59-afe1-49a33225af22 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 16:42:24 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance 3af23ff8-4e10-4fbf-a86e-bda842f084ff actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 16:42:24 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Migration fc53a14d-8658-42db-a644-15b07e017d46 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 128}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1637}}
Apr 13 16:42:24 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance 7ae7d3d9-54f7-4c64-8bf6-08fa5c526687 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 16:42:24 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=71731) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 16:42:24 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Final resource view: name=user phys_ram=16023MB used_ram=1216MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=71731) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 16:42:24 user nova-compute[71731]: DEBUG nova.scheduler.client.report [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Refreshing inventories for resource provider cb6b1a64-0c24-4e2d-af1e-16576ca9165c {{(pid=71731) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 13 16:42:24 user nova-compute[71731]: DEBUG nova.scheduler.client.report [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Updating ProviderTree inventory for provider cb6b1a64-0c24-4e2d-af1e-16576ca9165c from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71731) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 13 16:42:24 user nova-compute[71731]: DEBUG nova.compute.provider_tree [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Updating inventory in ProviderTree for provider cb6b1a64-0c24-4e2d-af1e-16576ca9165c with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71731) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 13 16:42:24 user nova-compute[71731]: DEBUG nova.scheduler.client.report [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Refreshing aggregate associations for resource provider cb6b1a64-0c24-4e2d-af1e-16576ca9165c, aggregates: None {{(pid=71731) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 13 16:42:24 user nova-compute[71731]: DEBUG nova.scheduler.client.report [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Refreshing trait associations for resource provider cb6b1a64-0c24-4e2d-af1e-16576ca9165c, traits: COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSSE3,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_SATA,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_SSE,COMPUTE_RESCUE_BFV,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE41,HW_CPU_X86_MMX,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_RAW {{(pid=71731) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 13 16:42:24 user nova-compute[71731]: DEBUG nova.compute.provider_tree [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Inventory has not changed in ProviderTree for provider: cb6b1a64-0c24-4e2d-af1e-16576ca9165c {{(pid=71731) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 16:42:24 user nova-compute[71731]: DEBUG nova.scheduler.client.report [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Inventory has not changed for provider cb6b1a64-0c24-4e2d-af1e-16576ca9165c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71731) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 16:42:24 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Compute_service record updated for user:user {{(pid=71731) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 16:42:24 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.498s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:42:25 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:42:26 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:42:26 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71731) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 16:42:26 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:42:26 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Starting heal instance info cache {{(pid=71731) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 16:42:26 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Rebuilding the list of instances to heal {{(pid=71731) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 13 16:42:26 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Acquiring lock "refresh_cache-5ed800fe-577d-4624-898c-c7f40da77376" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 16:42:26 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Acquired lock "refresh_cache-5ed800fe-577d-4624-898c-c7f40da77376" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 16:42:26 user nova-compute[71731]: DEBUG nova.network.neutron [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] [instance: 5ed800fe-577d-4624-898c-c7f40da77376] Forcefully refreshing network info cache for instance {{(pid=71731) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 16:42:26 user nova-compute[71731]: DEBUG nova.objects.instance [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lazy-loading 'info_cache' on Instance uuid 5ed800fe-577d-4624-898c-c7f40da77376 {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:42:26 user nova-compute[71731]: DEBUG nova.network.neutron [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] [instance: 5ed800fe-577d-4624-898c-c7f40da77376] Updating instance_info_cache with network_info: [{"id": "09531419-c0ff-4d13-89bd-06caa28e019d", "address": "fa:16:3e:13:b1:31", "network": {"id": "cf1fef97-9ef1-449f-a302-b38110024547", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1138167711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "980559734a504574a83224deb7423c77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09531419-c0", "ovs_interfaceid": "09531419-c0ff-4d13-89bd-06caa28e019d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:42:26 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Releasing lock "refresh_cache-5ed800fe-577d-4624-898c-c7f40da77376" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 16:42:26 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] [instance: 5ed800fe-577d-4624-898c-c7f40da77376] Updated the network info_cache for instance {{(pid=71731) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 16:42:27 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:42:29 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:42:31 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:42:31 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:42:32 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:42:32 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:42:32 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:42:34 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:42:35 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:42:39 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 16:42:39 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:42:39 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71731) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 16:42:39 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71731) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 16:42:39 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71731) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 16:42:39 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 16:42:44 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 16:42:44 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 16:42:44 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71731) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 16:42:44 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71731) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 16:42:44 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71731) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 16:42:44 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:42:44 user nova-compute[71731]: INFO nova.compute.manager [None req-6c862c76-8963-4133-b42b-433cf3ec8a8e tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] [instance: 3af23ff8-4e10-4fbf-a86e-bda842f084ff] Rescuing
Apr 13 16:42:44 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-6c862c76-8963-4133-b42b-433cf3ec8a8e tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Acquiring lock "refresh_cache-3af23ff8-4e10-4fbf-a86e-bda842f084ff" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 16:42:44 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-6c862c76-8963-4133-b42b-433cf3ec8a8e tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Acquired lock "refresh_cache-3af23ff8-4e10-4fbf-a86e-bda842f084ff" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 16:42:44 user nova-compute[71731]: DEBUG nova.network.neutron [None req-6c862c76-8963-4133-b42b-433cf3ec8a8e tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] [instance: 3af23ff8-4e10-4fbf-a86e-bda842f084ff] Building network info cache for instance {{(pid=71731) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 16:42:45 user nova-compute[71731]: DEBUG nova.network.neutron [None req-6c862c76-8963-4133-b42b-433cf3ec8a8e tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] [instance: 3af23ff8-4e10-4fbf-a86e-bda842f084ff] Updating instance_info_cache with network_info: [{"id": "b22086e3-8769-494c-af86-228dba7b3638", "address": "fa:16:3e:84:ee:e5", "network": {"id": "2a5b69f1-fc5b-4c33-a9eb-12a4d9293500", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2137344591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "846732ecb7e047128b4684972d3cd8c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb22086e3-87", "ovs_interfaceid": "b22086e3-8769-494c-af86-228dba7b3638", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:42:45 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-6c862c76-8963-4133-b42b-433cf3ec8a8e tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Releasing lock "refresh_cache-3af23ff8-4e10-4fbf-a86e-bda842f084ff" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 16:42:45 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:42:45 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:42:45 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:42:45 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:42:45 user nova-compute[71731]: DEBUG nova.compute.manager [req-21df2e4c-876d-4ff0-a654-dc22bd1a4cf2 req-ff65329d-73ae-42ca-8ec7-2bb3de87c532 service nova] [instance: 3af23ff8-4e10-4fbf-a86e-bda842f084ff] Received event network-vif-unplugged-b22086e3-8769-494c-af86-228dba7b3638 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:42:45 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-21df2e4c-876d-4ff0-a654-dc22bd1a4cf2 req-ff65329d-73ae-42ca-8ec7-2bb3de87c532 service nova] Acquiring lock "3af23ff8-4e10-4fbf-a86e-bda842f084ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:42:45 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-21df2e4c-876d-4ff0-a654-dc22bd1a4cf2 req-ff65329d-73ae-42ca-8ec7-2bb3de87c532 service nova] Lock "3af23ff8-4e10-4fbf-a86e-bda842f084ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:42:45 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-21df2e4c-876d-4ff0-a654-dc22bd1a4cf2 req-ff65329d-73ae-42ca-8ec7-2bb3de87c532 service nova] Lock "3af23ff8-4e10-4fbf-a86e-bda842f084ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:42:45 user nova-compute[71731]: DEBUG nova.compute.manager [req-21df2e4c-876d-4ff0-a654-dc22bd1a4cf2 req-ff65329d-73ae-42ca-8ec7-2bb3de87c532 service nova] [instance: 3af23ff8-4e10-4fbf-a86e-bda842f084ff] No waiting events found dispatching network-vif-unplugged-b22086e3-8769-494c-af86-228dba7b3638 {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:42:45 user nova-compute[71731]: WARNING nova.compute.manager [req-21df2e4c-876d-4ff0-a654-dc22bd1a4cf2 req-ff65329d-73ae-42ca-8ec7-2bb3de87c532 service nova] [instance: 3af23ff8-4e10-4fbf-a86e-bda842f084ff] Received unexpected event network-vif-unplugged-b22086e3-8769-494c-af86-228dba7b3638 for instance with vm_state active and task_state rescuing.
Apr 13 16:42:45 user nova-compute[71731]: INFO nova.virt.libvirt.driver [-] [instance: 3af23ff8-4e10-4fbf-a86e-bda842f084ff] Instance destroyed successfully.
Apr 13 16:42:45 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-6c862c76-8963-4133-b42b-433cf3ec8a8e tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] [instance: 3af23ff8-4e10-4fbf-a86e-bda842f084ff] Attempting rescue
Apr 13 16:42:45 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-6c862c76-8963-4133-b42b-433cf3ec8a8e tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=71731) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4289}}
Apr 13 16:42:45 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-6c862c76-8963-4133-b42b-433cf3ec8a8e tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] [instance: 3af23ff8-4e10-4fbf-a86e-bda842f084ff] Instance directory exists: not creating {{(pid=71731) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 13 16:42:45 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-6c862c76-8963-4133-b42b-433cf3ec8a8e tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] [instance: 3af23ff8-4e10-4fbf-a86e-bda842f084ff] Creating image(s)
Apr 13 16:42:45 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-6c862c76-8963-4133-b42b-433cf3ec8a8e tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Acquiring lock "/opt/stack/data/nova/instances/3af23ff8-4e10-4fbf-a86e-bda842f084ff/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:42:45 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-6c862c76-8963-4133-b42b-433cf3ec8a8e tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lock "/opt/stack/data/nova/instances/3af23ff8-4e10-4fbf-a86e-bda842f084ff/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:42:45 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-6c862c76-8963-4133-b42b-433cf3ec8a8e tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lock "/opt/stack/data/nova/instances/3af23ff8-4e10-4fbf-a86e-bda842f084ff/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:42:45 user nova-compute[71731]: DEBUG nova.objects.instance [None req-6c862c76-8963-4133-b42b-433cf3ec8a8e tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lazy-loading 'trusted_certs' on Instance uuid 3af23ff8-4e10-4fbf-a86e-bda842f084ff {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:42:45 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-6c862c76-8963-4133-b42b-433cf3ec8a8e tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Acquiring lock "9524227dd898575c3099d3976f096cd935414279" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:42:45 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-6c862c76-8963-4133-b42b-433cf3ec8a8e tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lock "9524227dd898575c3099d3976f096cd935414279" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:42:45 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-6c862c76-8963-4133-b42b-433cf3ec8a8e tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279 --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:42:46 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-6c862c76-8963-4133-b42b-433cf3ec8a8e tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279 --force-share --output=json" returned: 0 in 0.134s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:42:46 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-6c862c76-8963-4133-b42b-433cf3ec8a8e tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279,backing_fmt=raw /opt/stack/data/nova/instances/3af23ff8-4e10-4fbf-a86e-bda842f084ff/disk.rescue {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:42:46 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-6c862c76-8963-4133-b42b-433cf3ec8a8e tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279,backing_fmt=raw /opt/stack/data/nova/instances/3af23ff8-4e10-4fbf-a86e-bda842f084ff/disk.rescue" returned: 0 in 0.049s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:42:46 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-6c862c76-8963-4133-b42b-433cf3ec8a8e tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lock "9524227dd898575c3099d3976f096cd935414279" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.190s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:42:46 user nova-compute[71731]: DEBUG nova.objects.instance [None req-6c862c76-8963-4133-b42b-433cf3ec8a8e tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lazy-loading 'migration_context' on Instance uuid 3af23ff8-4e10-4fbf-a86e-bda842f084ff {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:42:46 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-6c862c76-8963-4133-b42b-433cf3ec8a8e tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] [instance: 3af23ff8-4e10-4fbf-a86e-bda842f084ff] Created local disks {{(pid=71731) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 16:42:46 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-6c862c76-8963-4133-b42b-433cf3ec8a8e tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] [instance: 3af23ff8-4e10-4fbf-a86e-bda842f084ff] Start _get_guest_xml network_info=[{"id": "b22086e3-8769-494c-af86-228dba7b3638", "address": "fa:16:3e:84:ee:e5", "network": {"id": "2a5b69f1-fc5b-4c33-a9eb-12a4d9293500", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2137344591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-2137344591-network", "vif_mac": "fa:16:3e:84:ee:e5"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "846732ecb7e047128b4684972d3cd8c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb22086e3-87", "ovs_interfaceid": "b22086e3-8769-494c-af86-228dba7b3638", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T16:16:31Z,direct_url=<?>,disk_format='qcow2',id=708622a9-7465-4492-ade8-b827198f7e30,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='0b29a975c552465aba0ac7d6288434bd',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T16:16:33Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '708622a9-7465-4492-ade8-b827198f7e30', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=71731) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 16:42:46 user nova-compute[71731]: DEBUG nova.objects.instance [None req-6c862c76-8963-4133-b42b-433cf3ec8a8e tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lazy-loading 'resources' on Instance uuid 3af23ff8-4e10-4fbf-a86e-bda842f084ff {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:42:46 user nova-compute[71731]: DEBUG nova.objects.instance [None req-6c862c76-8963-4133-b42b-433cf3ec8a8e tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lazy-loading 'numa_topology' on Instance uuid 3af23ff8-4e10-4fbf-a86e-bda842f084ff {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:42:46 user nova-compute[71731]: WARNING nova.virt.libvirt.driver [None req-6c862c76-8963-4133-b42b-433cf3ec8a8e tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 16:42:46 user nova-compute[71731]: WARNING nova.virt.libvirt.driver [None req-6c862c76-8963-4133-b42b-433cf3ec8a8e tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 16:42:46 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-6c862c76-8963-4133-b42b-433cf3ec8a8e tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71731) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 16:42:46 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-6c862c76-8963-4133-b42b-433cf3ec8a8e tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T16:17:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T16:16:31Z,direct_url=<?>,disk_format='qcow2',id=708622a9-7465-4492-ade8-b827198f7e30,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='0b29a975c552465aba0ac7d6288434bd',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T16:16:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 16:42:46 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-6c862c76-8963-4133-b42b-433cf3ec8a8e tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Flavor limits 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 16:42:46 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-6c862c76-8963-4133-b42b-433cf3ec8a8e tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Image limits 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 16:42:46 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-6c862c76-8963-4133-b42b-433cf3ec8a8e tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Flavor pref 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 16:42:46 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-6c862c76-8963-4133-b42b-433cf3ec8a8e tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Image pref 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 16:42:46 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-6c862c76-8963-4133-b42b-433cf3ec8a8e tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 16:42:46 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-6c862c76-8963-4133-b42b-433cf3ec8a8e tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 16:42:46 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-6c862c76-8963-4133-b42b-433cf3ec8a8e tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71731) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 16:42:46 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-6c862c76-8963-4133-b42b-433cf3ec8a8e tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Got 1 possible topologies {{(pid=71731) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 16:42:46 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-6c862c76-8963-4133-b42b-433cf3ec8a8e tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 16:42:46 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-6c862c76-8963-4133-b42b-433cf3ec8a8e tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 16:42:46 user nova-compute[71731]: DEBUG nova.objects.instance [None req-6c862c76-8963-4133-b42b-433cf3ec8a8e tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lazy-loading 'vcpu_model' on Instance uuid 3af23ff8-4e10-4fbf-a86e-bda842f084ff {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:42:46 user nova-compute[71731]: DEBUG nova.virt.libvirt.vif [None req-6c862c76-8963-4133-b42b-433cf3ec8a8e tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T16:40:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-297516343',display_name='tempest-ServerRescueNegativeTestJSON-server-297516343',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-297516343',id=37,image_ref='708622a9-7465-4492-ade8-b827198f7e30',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-13T16:41:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='846732ecb7e047128b4684972d3cd8c6',ramdisk_id='',reservation_id='r-unv20yee',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='708622a9-7465-4492-ade8-b827198f7e30',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-84287455',owner_user_name='tempest-ServerRescueNegativeTestJSON-84287455-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T16:41:02Z,user_data=None,user_id='0c7f54723c494e05ada117353c0790cb',uuid=3af23ff8-4e10-4fbf-a86e-bda842f084ff,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b22086e3-8769-494c-af86-228dba7b3638", "address": "fa:16:3e:84:ee:e5", "network": {"id": "2a5b69f1-fc5b-4c33-a9eb-12a4d9293500", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2137344591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-2137344591-network", "vif_mac": "fa:16:3e:84:ee:e5"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "846732ecb7e047128b4684972d3cd8c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb22086e3-87", "ovs_interfaceid": "b22086e3-8769-494c-af86-228dba7b3638", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71731) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 16:42:46 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-6c862c76-8963-4133-b42b-433cf3ec8a8e tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Converting VIF {"id": "b22086e3-8769-494c-af86-228dba7b3638", "address": "fa:16:3e:84:ee:e5", "network": {"id": "2a5b69f1-fc5b-4c33-a9eb-12a4d9293500", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2137344591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-2137344591-network", "vif_mac": "fa:16:3e:84:ee:e5"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "846732ecb7e047128b4684972d3cd8c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb22086e3-87", "ovs_interfaceid": "b22086e3-8769-494c-af86-228dba7b3638", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 16:42:46 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-6c862c76-8963-4133-b42b-433cf3ec8a8e tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:84:ee:e5,bridge_name='br-int',has_traffic_filtering=True,id=b22086e3-8769-494c-af86-228dba7b3638,network=Network(2a5b69f1-fc5b-4c33-a9eb-12a4d9293500),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb22086e3-87') {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 16:42:46 user nova-compute[71731]: DEBUG nova.objects.instance [None req-6c862c76-8963-4133-b42b-433cf3ec8a8e tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lazy-loading 'pci_devices' on Instance uuid 3af23ff8-4e10-4fbf-a86e-bda842f084ff {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:42:46 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-6c862c76-8963-4133-b42b-433cf3ec8a8e tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] [instance: 3af23ff8-4e10-4fbf-a86e-bda842f084ff] End _get_guest_xml xml=<domain type="kvm">
Apr 13 16:42:46 user nova-compute[71731]:   <uuid>3af23ff8-4e10-4fbf-a86e-bda842f084ff</uuid>
Apr 13 16:42:46 user nova-compute[71731]:   <name>instance-00000025</name>
Apr 13 16:42:46 user nova-compute[71731]:   <memory>131072</memory>
Apr 13 16:42:46 user nova-compute[71731]:   <vcpu>1</vcpu>
Apr 13 16:42:46 user nova-compute[71731]:   <metadata>
Apr 13 16:42:46 user nova-compute[71731]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 16:42:46 user nova-compute[71731]:       <nova:package version="0.0.0"/>
Apr 13 16:42:46 user nova-compute[71731]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-297516343</nova:name>
Apr 13 16:42:46 user nova-compute[71731]:       <nova:creationTime>2023-04-13 16:42:46</nova:creationTime>
Apr 13 16:42:46 user nova-compute[71731]:       <nova:flavor name="m1.nano">
Apr 13 16:42:46 user nova-compute[71731]:         <nova:memory>128</nova:memory>
Apr 13 16:42:46 user nova-compute[71731]:         <nova:disk>1</nova:disk>
Apr 13 16:42:46 user nova-compute[71731]:         <nova:swap>0</nova:swap>
Apr 13 16:42:46 user nova-compute[71731]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 16:42:46 user nova-compute[71731]:         <nova:vcpus>1</nova:vcpus>
Apr 13 16:42:46 user nova-compute[71731]:       </nova:flavor>
Apr 13 16:42:46 user nova-compute[71731]:       <nova:owner>
Apr 13 16:42:46 user nova-compute[71731]:         <nova:user uuid="0c7f54723c494e05ada117353c0790cb">tempest-ServerRescueNegativeTestJSON-84287455-project-member</nova:user>
Apr 13 16:42:46 user nova-compute[71731]:         <nova:project uuid="846732ecb7e047128b4684972d3cd8c6">tempest-ServerRescueNegativeTestJSON-84287455</nova:project>
Apr 13 16:42:46 user nova-compute[71731]:       </nova:owner>
Apr 13 16:42:46 user nova-compute[71731]:       <nova:root type="image" uuid="708622a9-7465-4492-ade8-b827198f7e30"/>
Apr 13 16:42:46 user nova-compute[71731]:       <nova:ports>
Apr 13 16:42:46 user nova-compute[71731]:         <nova:port uuid="b22086e3-8769-494c-af86-228dba7b3638">
Apr 13 16:42:46 user nova-compute[71731]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Apr 13 16:42:46 user nova-compute[71731]:         </nova:port>
Apr 13 16:42:46 user nova-compute[71731]:       </nova:ports>
Apr 13 16:42:46 user nova-compute[71731]:     </nova:instance>
Apr 13 16:42:46 user nova-compute[71731]:   </metadata>
Apr 13 16:42:46 user nova-compute[71731]:   <sysinfo type="smbios">
Apr 13 16:42:46 user nova-compute[71731]:     <system>
Apr 13 16:42:46 user nova-compute[71731]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 16:42:46 user nova-compute[71731]:       <entry name="product">OpenStack Nova</entry>
Apr 13 16:42:46 user nova-compute[71731]:       <entry name="version">0.0.0</entry>
Apr 13 16:42:46 user nova-compute[71731]:       <entry name="serial">3af23ff8-4e10-4fbf-a86e-bda842f084ff</entry>
Apr 13 16:42:46 user nova-compute[71731]:       <entry name="uuid">3af23ff8-4e10-4fbf-a86e-bda842f084ff</entry>
Apr 13 16:42:46 user nova-compute[71731]:       <entry name="family">Virtual Machine</entry>
Apr 13 16:42:46 user nova-compute[71731]:     </system>
Apr 13 16:42:46 user nova-compute[71731]:   </sysinfo>
Apr 13 16:42:46 user nova-compute[71731]:   <os>
Apr 13 16:42:46 user nova-compute[71731]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 16:42:46 user nova-compute[71731]:     <smbios mode="sysinfo"/>
Apr 13 16:42:46 user nova-compute[71731]:   </os>
Apr 13 16:42:46 user nova-compute[71731]:   <features>
Apr 13 16:42:46 user nova-compute[71731]:     <acpi/>
Apr 13 16:42:46 user nova-compute[71731]:     <apic/>
Apr 13 16:42:46 user nova-compute[71731]:     <vmcoreinfo/>
Apr 13 16:42:46 user nova-compute[71731]:   </features>
Apr 13 16:42:46 user nova-compute[71731]:   <clock offset="utc">
Apr 13 16:42:46 user nova-compute[71731]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 16:42:46 user nova-compute[71731]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 16:42:46 user nova-compute[71731]:     <timer name="hpet" present="no"/>
Apr 13 16:42:46 user nova-compute[71731]:   </clock>
Apr 13 16:42:46 user nova-compute[71731]:   <cpu mode="custom" match="exact">
Apr 13 16:42:46 user nova-compute[71731]:     <model>Nehalem</model>
Apr 13 16:42:46 user nova-compute[71731]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 16:42:46 user nova-compute[71731]:   </cpu>
Apr 13 16:42:46 user nova-compute[71731]:   <devices>
Apr 13 16:42:46 user nova-compute[71731]:     <disk type="file" device="disk">
Apr 13 16:42:46 user nova-compute[71731]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 16:42:46 user nova-compute[71731]:       <source file="/opt/stack/data/nova/instances/3af23ff8-4e10-4fbf-a86e-bda842f084ff/disk.rescue"/>
Apr 13 16:42:46 user nova-compute[71731]:       <target dev="vda" bus="virtio"/>
Apr 13 16:42:46 user nova-compute[71731]:     </disk>
Apr 13 16:42:46 user nova-compute[71731]:     <disk type="file" device="disk">
Apr 13 16:42:46 user nova-compute[71731]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 16:42:46 user nova-compute[71731]:       <source file="/opt/stack/data/nova/instances/3af23ff8-4e10-4fbf-a86e-bda842f084ff/disk"/>
Apr 13 16:42:46 user nova-compute[71731]:       <target dev="vdb" bus="virtio"/>
Apr 13 16:42:46 user nova-compute[71731]:     </disk>
Apr 13 16:42:46 user nova-compute[71731]:     <interface type="ethernet">
Apr 13 16:42:46 user nova-compute[71731]:       <mac address="fa:16:3e:84:ee:e5"/>
Apr 13 16:42:46 user nova-compute[71731]:       <model type="virtio"/>
Apr 13 16:42:46 user nova-compute[71731]:       <mtu size="1442"/>
Apr 13 16:42:46 user nova-compute[71731]:       <target dev="tapb22086e3-87"/>
Apr 13 16:42:46 user nova-compute[71731]:     </interface>
Apr 13 16:42:46 user nova-compute[71731]:     <serial type="pty">
Apr 13 16:42:46 user nova-compute[71731]:       <log file="/opt/stack/data/nova/instances/3af23ff8-4e10-4fbf-a86e-bda842f084ff/console.log" append="off"/>
Apr 13 16:42:46 user nova-compute[71731]:     </serial>
Apr 13 16:42:46 user nova-compute[71731]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 16:42:46 user nova-compute[71731]:     <video>
Apr 13 16:42:46 user nova-compute[71731]:       <model type="virtio"/>
Apr 13 16:42:46 user nova-compute[71731]:     </video>
Apr 13 16:42:46 user nova-compute[71731]:     <rng model="virtio">
Apr 13 16:42:46 user nova-compute[71731]:       <backend model="random">/dev/urandom</backend>
Apr 13 16:42:46 user nova-compute[71731]:     </rng>
Apr 13 16:42:46 user nova-compute[71731]:     <controller type="usb" index="0" model="none"/>
Apr 13 16:42:46 user nova-compute[71731]:     <memballoon model="virtio">
Apr 13 16:42:46 user nova-compute[71731]:       <stats period="10"/>
Apr 13 16:42:46 user nova-compute[71731]:     </memballoon>
Apr 13 16:42:46 user nova-compute[71731]:   </devices>
Apr 13 16:42:46 user nova-compute[71731]: </domain>
Apr 13 16:42:46 user nova-compute[71731]:  {{(pid=71731) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 16:42:46 user nova-compute[71731]: INFO nova.virt.libvirt.driver [-] [instance: 3af23ff8-4e10-4fbf-a86e-bda842f084ff] Instance destroyed successfully.
Apr 13 16:42:46 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-6c862c76-8963-4133-b42b-433cf3ec8a8e tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] No BDM found with device name vda, not building metadata. {{(pid=71731) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 16:42:46 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-6c862c76-8963-4133-b42b-433cf3ec8a8e tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71731) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 16:42:46 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-6c862c76-8963-4133-b42b-433cf3ec8a8e tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] No VIF found with MAC fa:16:3e:84:ee:e5, not building metadata {{(pid=71731) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 16:42:47 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:42:47 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:42:47 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:42:47 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:42:47 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:42:47 user nova-compute[71731]: DEBUG nova.compute.manager [req-b8c40b63-f1ca-4f9c-8b96-9428f98c98e0 req-0faed5cd-7689-4f3c-9f25-3c0f0ca2245b service nova] [instance: 3af23ff8-4e10-4fbf-a86e-bda842f084ff] Received event network-vif-plugged-b22086e3-8769-494c-af86-228dba7b3638 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:42:47 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-b8c40b63-f1ca-4f9c-8b96-9428f98c98e0 req-0faed5cd-7689-4f3c-9f25-3c0f0ca2245b service nova] Acquiring lock "3af23ff8-4e10-4fbf-a86e-bda842f084ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:42:47 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-b8c40b63-f1ca-4f9c-8b96-9428f98c98e0 req-0faed5cd-7689-4f3c-9f25-3c0f0ca2245b service nova] Lock "3af23ff8-4e10-4fbf-a86e-bda842f084ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:42:47 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-b8c40b63-f1ca-4f9c-8b96-9428f98c98e0 req-0faed5cd-7689-4f3c-9f25-3c0f0ca2245b service nova] Lock "3af23ff8-4e10-4fbf-a86e-bda842f084ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:42:47 user nova-compute[71731]: DEBUG nova.compute.manager [req-b8c40b63-f1ca-4f9c-8b96-9428f98c98e0 req-0faed5cd-7689-4f3c-9f25-3c0f0ca2245b service nova] [instance: 3af23ff8-4e10-4fbf-a86e-bda842f084ff] No waiting events found dispatching network-vif-plugged-b22086e3-8769-494c-af86-228dba7b3638 {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:42:47 user nova-compute[71731]: WARNING nova.compute.manager [req-b8c40b63-f1ca-4f9c-8b96-9428f98c98e0 req-0faed5cd-7689-4f3c-9f25-3c0f0ca2245b service nova] [instance: 3af23ff8-4e10-4fbf-a86e-bda842f084ff] Received unexpected event network-vif-plugged-b22086e3-8769-494c-af86-228dba7b3638 for instance with vm_state active and task_state rescuing.
Apr 13 16:42:47 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:42:47 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:42:49 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:42:49 user nova-compute[71731]: DEBUG nova.virt.libvirt.host [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Removed pending event for 3af23ff8-4e10-4fbf-a86e-bda842f084ff due to event {{(pid=71731) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 13 16:42:49 user nova-compute[71731]: DEBUG nova.virt.driver [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Emitting event <LifecycleEvent: 1681404169.7773159, 3af23ff8-4e10-4fbf-a86e-bda842f084ff => Resumed> {{(pid=71731) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 16:42:49 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 3af23ff8-4e10-4fbf-a86e-bda842f084ff] VM Resumed (Lifecycle Event)
Apr 13 16:42:49 user nova-compute[71731]: DEBUG nova.compute.manager [None req-6c862c76-8963-4133-b42b-433cf3ec8a8e tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] [instance: 3af23ff8-4e10-4fbf-a86e-bda842f084ff] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:42:49 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 3af23ff8-4e10-4fbf-a86e-bda842f084ff] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:42:49 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 3af23ff8-4e10-4fbf-a86e-bda842f084ff] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71731) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 16:42:49 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 3af23ff8-4e10-4fbf-a86e-bda842f084ff] During sync_power_state the instance has a pending task (rescuing). Skip.
Apr 13 16:42:49 user nova-compute[71731]: DEBUG nova.virt.driver [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Emitting event <LifecycleEvent: 1681404169.7817361, 3af23ff8-4e10-4fbf-a86e-bda842f084ff => Started> {{(pid=71731) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 16:42:49 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 3af23ff8-4e10-4fbf-a86e-bda842f084ff] VM Started (Lifecycle Event)
Apr 13 16:42:49 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 3af23ff8-4e10-4fbf-a86e-bda842f084ff] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:42:49 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 3af23ff8-4e10-4fbf-a86e-bda842f084ff] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71731) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 16:42:49 user nova-compute[71731]: DEBUG nova.compute.manager [req-ed7259f0-cc25-4918-88a9-7b1fdbe71751 req-88a4f5d6-68ba-4f66-83c3-bfc96d11a6f5 service nova] [instance: 3af23ff8-4e10-4fbf-a86e-bda842f084ff] Received event network-vif-plugged-b22086e3-8769-494c-af86-228dba7b3638 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:42:49 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-ed7259f0-cc25-4918-88a9-7b1fdbe71751 req-88a4f5d6-68ba-4f66-83c3-bfc96d11a6f5 service nova] Acquiring lock "3af23ff8-4e10-4fbf-a86e-bda842f084ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:42:49 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-ed7259f0-cc25-4918-88a9-7b1fdbe71751 req-88a4f5d6-68ba-4f66-83c3-bfc96d11a6f5 service nova] Lock "3af23ff8-4e10-4fbf-a86e-bda842f084ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:42:49 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-ed7259f0-cc25-4918-88a9-7b1fdbe71751 req-88a4f5d6-68ba-4f66-83c3-bfc96d11a6f5 service nova] Lock "3af23ff8-4e10-4fbf-a86e-bda842f084ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:42:49 user nova-compute[71731]: DEBUG nova.compute.manager [req-ed7259f0-cc25-4918-88a9-7b1fdbe71751 req-88a4f5d6-68ba-4f66-83c3-bfc96d11a6f5 service nova] [instance: 3af23ff8-4e10-4fbf-a86e-bda842f084ff] No waiting events found dispatching network-vif-plugged-b22086e3-8769-494c-af86-228dba7b3638 {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:42:49 user nova-compute[71731]: WARNING nova.compute.manager [req-ed7259f0-cc25-4918-88a9-7b1fdbe71751 req-88a4f5d6-68ba-4f66-83c3-bfc96d11a6f5 service nova] [instance: 3af23ff8-4e10-4fbf-a86e-bda842f084ff] Received unexpected event network-vif-plugged-b22086e3-8769-494c-af86-228dba7b3638 for instance with vm_state rescued and task_state None.
Apr 13 16:42:49 user nova-compute[71731]: DEBUG nova.compute.manager [req-ed7259f0-cc25-4918-88a9-7b1fdbe71751 req-88a4f5d6-68ba-4f66-83c3-bfc96d11a6f5 service nova] [instance: 3af23ff8-4e10-4fbf-a86e-bda842f084ff] Received event network-vif-plugged-b22086e3-8769-494c-af86-228dba7b3638 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:42:49 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-ed7259f0-cc25-4918-88a9-7b1fdbe71751 req-88a4f5d6-68ba-4f66-83c3-bfc96d11a6f5 service nova] Acquiring lock "3af23ff8-4e10-4fbf-a86e-bda842f084ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:42:49 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-ed7259f0-cc25-4918-88a9-7b1fdbe71751 req-88a4f5d6-68ba-4f66-83c3-bfc96d11a6f5 service nova] Lock "3af23ff8-4e10-4fbf-a86e-bda842f084ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:42:49 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-ed7259f0-cc25-4918-88a9-7b1fdbe71751 req-88a4f5d6-68ba-4f66-83c3-bfc96d11a6f5 service nova] Lock "3af23ff8-4e10-4fbf-a86e-bda842f084ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:42:49 user nova-compute[71731]: DEBUG nova.compute.manager [req-ed7259f0-cc25-4918-88a9-7b1fdbe71751 req-88a4f5d6-68ba-4f66-83c3-bfc96d11a6f5 service nova] [instance: 3af23ff8-4e10-4fbf-a86e-bda842f084ff] No waiting events found dispatching network-vif-plugged-b22086e3-8769-494c-af86-228dba7b3638 {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:42:49 user nova-compute[71731]: WARNING nova.compute.manager [req-ed7259f0-cc25-4918-88a9-7b1fdbe71751 req-88a4f5d6-68ba-4f66-83c3-bfc96d11a6f5 service nova] [instance: 3af23ff8-4e10-4fbf-a86e-bda842f084ff] Received unexpected event network-vif-plugged-b22086e3-8769-494c-af86-228dba7b3638 for instance with vm_state rescued and task_state None.
Apr 13 16:42:52 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:42:54 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:42:59 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 16:43:02 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:43:03 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-6348272b-4031-482d-8d50-de9374f80de9 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Acquiring lock "1f6a693f-0a99-434f-871d-f535b71229b9" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:43:03 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-6348272b-4031-482d-8d50-de9374f80de9 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lock "1f6a693f-0a99-434f-871d-f535b71229b9" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:43:03 user nova-compute[71731]: INFO nova.compute.manager [None req-6348272b-4031-482d-8d50-de9374f80de9 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] [instance: 1f6a693f-0a99-434f-871d-f535b71229b9] Unshelving
Apr 13 16:43:03 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-6348272b-4031-482d-8d50-de9374f80de9 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:43:03 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-6348272b-4031-482d-8d50-de9374f80de9 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:43:03 user nova-compute[71731]: DEBUG nova.objects.instance [None req-6348272b-4031-482d-8d50-de9374f80de9 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lazy-loading 'pci_requests' on Instance uuid 1f6a693f-0a99-434f-871d-f535b71229b9 {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:43:03 user nova-compute[71731]: DEBUG nova.objects.instance [None req-6348272b-4031-482d-8d50-de9374f80de9 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lazy-loading 'numa_topology' on Instance uuid 1f6a693f-0a99-434f-871d-f535b71229b9 {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:43:03 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-6348272b-4031-482d-8d50-de9374f80de9 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71731) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 16:43:03 user nova-compute[71731]: INFO nova.compute.claims [None req-6348272b-4031-482d-8d50-de9374f80de9 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] [instance: 1f6a693f-0a99-434f-871d-f535b71229b9] Claim successful on node user
Apr 13 16:43:04 user nova-compute[71731]: DEBUG nova.compute.provider_tree [None req-6348272b-4031-482d-8d50-de9374f80de9 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Inventory has not changed in ProviderTree for provider: cb6b1a64-0c24-4e2d-af1e-16576ca9165c {{(pid=71731) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 16:43:04 user nova-compute[71731]: DEBUG nova.scheduler.client.report [None req-6348272b-4031-482d-8d50-de9374f80de9 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Inventory has not changed for provider cb6b1a64-0c24-4e2d-af1e-16576ca9165c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71731) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 16:43:04 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-6348272b-4031-482d-8d50-de9374f80de9 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.353s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:43:04 user nova-compute[71731]: INFO nova.network.neutron [None req-6348272b-4031-482d-8d50-de9374f80de9 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] [instance: 1f6a693f-0a99-434f-871d-f535b71229b9] Updating port 103a0c68-ffc7-4460-836e-0de6c0272d84 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Apr 13 16:43:04 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:43:04 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:43:05 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-6348272b-4031-482d-8d50-de9374f80de9 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Acquiring lock "refresh_cache-1f6a693f-0a99-434f-871d-f535b71229b9" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 16:43:05 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-6348272b-4031-482d-8d50-de9374f80de9 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Acquired lock "refresh_cache-1f6a693f-0a99-434f-871d-f535b71229b9" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 16:43:05 user nova-compute[71731]: DEBUG nova.network.neutron [None req-6348272b-4031-482d-8d50-de9374f80de9 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] [instance: 1f6a693f-0a99-434f-871d-f535b71229b9] Building network info cache for instance {{(pid=71731) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 16:43:05 user nova-compute[71731]: DEBUG nova.compute.manager [req-6e8c115f-a33c-4a1a-93ba-035d40af04a9 req-ee5168ac-4f31-4c05-9c79-148b33f4737f service nova] [instance: 1f6a693f-0a99-434f-871d-f535b71229b9] Received event network-changed-103a0c68-ffc7-4460-836e-0de6c0272d84 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:43:05 user nova-compute[71731]: DEBUG nova.compute.manager [req-6e8c115f-a33c-4a1a-93ba-035d40af04a9 req-ee5168ac-4f31-4c05-9c79-148b33f4737f service nova] [instance: 1f6a693f-0a99-434f-871d-f535b71229b9] Refreshing instance network info cache due to event network-changed-103a0c68-ffc7-4460-836e-0de6c0272d84. {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 16:43:05 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-6e8c115f-a33c-4a1a-93ba-035d40af04a9 req-ee5168ac-4f31-4c05-9c79-148b33f4737f service nova] Acquiring lock "refresh_cache-1f6a693f-0a99-434f-871d-f535b71229b9" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 16:43:05 user nova-compute[71731]: DEBUG nova.network.neutron [None req-6348272b-4031-482d-8d50-de9374f80de9 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] [instance: 1f6a693f-0a99-434f-871d-f535b71229b9] Updating instance_info_cache with network_info: [{"id": "103a0c68-ffc7-4460-836e-0de6c0272d84", "address": "fa:16:3e:f5:d0:dc", "network": {"id": "5acc9a78-1127-46df-bb60-7544cdd2c1ef", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2143082515-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0653ab16660b46cea9c5af58ea0b1931", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap103a0c68-ff", "ovs_interfaceid": "103a0c68-ffc7-4460-836e-0de6c0272d84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:43:05 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-6348272b-4031-482d-8d50-de9374f80de9 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Releasing lock "refresh_cache-1f6a693f-0a99-434f-871d-f535b71229b9" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 16:43:05 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-6348272b-4031-482d-8d50-de9374f80de9 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] [instance: 1f6a693f-0a99-434f-871d-f535b71229b9] Creating instance directory {{(pid=71731) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 16:43:05 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-6348272b-4031-482d-8d50-de9374f80de9 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] [instance: 1f6a693f-0a99-434f-871d-f535b71229b9] Creating image(s)
Apr 13 16:43:05 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-6348272b-4031-482d-8d50-de9374f80de9 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Acquiring lock "/opt/stack/data/nova/instances/1f6a693f-0a99-434f-871d-f535b71229b9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:43:05 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-6348272b-4031-482d-8d50-de9374f80de9 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lock "/opt/stack/data/nova/instances/1f6a693f-0a99-434f-871d-f535b71229b9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:43:05 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-6348272b-4031-482d-8d50-de9374f80de9 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lock "/opt/stack/data/nova/instances/1f6a693f-0a99-434f-871d-f535b71229b9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:43:05 user nova-compute[71731]: DEBUG nova.objects.instance [None req-6348272b-4031-482d-8d50-de9374f80de9 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lazy-loading 'trusted_certs' on Instance uuid 1f6a693f-0a99-434f-871d-f535b71229b9 {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:43:05 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-6e8c115f-a33c-4a1a-93ba-035d40af04a9 req-ee5168ac-4f31-4c05-9c79-148b33f4737f service nova] Acquired lock "refresh_cache-1f6a693f-0a99-434f-871d-f535b71229b9" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 16:43:05 user nova-compute[71731]: DEBUG nova.network.neutron [req-6e8c115f-a33c-4a1a-93ba-035d40af04a9 req-ee5168ac-4f31-4c05-9c79-148b33f4737f service nova] [instance: 1f6a693f-0a99-434f-871d-f535b71229b9] Refreshing network info cache for port 103a0c68-ffc7-4460-836e-0de6c0272d84 {{(pid=71731) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 16:43:05 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-6348272b-4031-482d-8d50-de9374f80de9 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Acquiring lock "b58b04c5e7cd85acfb420c71e6db6c496cf2bcea" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:43:05 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-6348272b-4031-482d-8d50-de9374f80de9 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lock "b58b04c5e7cd85acfb420c71e6db6c496cf2bcea" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:43:06 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-6348272b-4031-482d-8d50-de9374f80de9 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58b04c5e7cd85acfb420c71e6db6c496cf2bcea.part --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:43:06 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-6348272b-4031-482d-8d50-de9374f80de9 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58b04c5e7cd85acfb420c71e6db6c496cf2bcea.part --force-share --output=json" returned: 0 in 0.138s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:43:06 user nova-compute[71731]: DEBUG nova.virt.images [None req-6348272b-4031-482d-8d50-de9374f80de9 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] f46dd46b-4936-4a51-8ff8-a290b0db8c3c was qcow2, converting to raw {{(pid=71731) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 13 16:43:06 user nova-compute[71731]: DEBUG nova.privsep.utils [None req-6348272b-4031-482d-8d50-de9374f80de9 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71731) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 13 16:43:06 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-6348272b-4031-482d-8d50-de9374f80de9 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b58b04c5e7cd85acfb420c71e6db6c496cf2bcea.part /opt/stack/data/nova/instances/_base/b58b04c5e7cd85acfb420c71e6db6c496cf2bcea.converted {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:43:06 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-6348272b-4031-482d-8d50-de9374f80de9 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b58b04c5e7cd85acfb420c71e6db6c496cf2bcea.part /opt/stack/data/nova/instances/_base/b58b04c5e7cd85acfb420c71e6db6c496cf2bcea.converted" returned: 0 in 0.164s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:43:06 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-6348272b-4031-482d-8d50-de9374f80de9 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58b04c5e7cd85acfb420c71e6db6c496cf2bcea.converted --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:43:06 user nova-compute[71731]: DEBUG nova.network.neutron [req-6e8c115f-a33c-4a1a-93ba-035d40af04a9 req-ee5168ac-4f31-4c05-9c79-148b33f4737f service nova] [instance: 1f6a693f-0a99-434f-871d-f535b71229b9] Updated VIF entry in instance network info cache for port 103a0c68-ffc7-4460-836e-0de6c0272d84. {{(pid=71731) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 16:43:06 user nova-compute[71731]: DEBUG nova.network.neutron [req-6e8c115f-a33c-4a1a-93ba-035d40af04a9 req-ee5168ac-4f31-4c05-9c79-148b33f4737f service nova] [instance: 1f6a693f-0a99-434f-871d-f535b71229b9] Updating instance_info_cache with network_info: [{"id": "103a0c68-ffc7-4460-836e-0de6c0272d84", "address": "fa:16:3e:f5:d0:dc", "network": {"id": "5acc9a78-1127-46df-bb60-7544cdd2c1ef", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2143082515-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0653ab16660b46cea9c5af58ea0b1931", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap103a0c68-ff", "ovs_interfaceid": "103a0c68-ffc7-4460-836e-0de6c0272d84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:43:06 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-6e8c115f-a33c-4a1a-93ba-035d40af04a9 req-ee5168ac-4f31-4c05-9c79-148b33f4737f service nova] Releasing lock "refresh_cache-1f6a693f-0a99-434f-871d-f535b71229b9" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 16:43:06 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-6348272b-4031-482d-8d50-de9374f80de9 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58b04c5e7cd85acfb420c71e6db6c496cf2bcea.converted --force-share --output=json" returned: 0 in 0.141s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:43:06 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-6348272b-4031-482d-8d50-de9374f80de9 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lock "b58b04c5e7cd85acfb420c71e6db6c496cf2bcea" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.125s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:43:06 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-6348272b-4031-482d-8d50-de9374f80de9 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58b04c5e7cd85acfb420c71e6db6c496cf2bcea --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:43:06 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-6348272b-4031-482d-8d50-de9374f80de9 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58b04c5e7cd85acfb420c71e6db6c496cf2bcea --force-share --output=json" returned: 0 in 0.132s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:43:06 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-6348272b-4031-482d-8d50-de9374f80de9 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Acquiring lock "b58b04c5e7cd85acfb420c71e6db6c496cf2bcea" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:43:06 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-6348272b-4031-482d-8d50-de9374f80de9 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lock "b58b04c5e7cd85acfb420c71e6db6c496cf2bcea" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:43:06 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-6348272b-4031-482d-8d50-de9374f80de9 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58b04c5e7cd85acfb420c71e6db6c496cf2bcea --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:43:07 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-6348272b-4031-482d-8d50-de9374f80de9 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58b04c5e7cd85acfb420c71e6db6c496cf2bcea --force-share --output=json" returned: 0 in 0.136s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:43:07 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-6348272b-4031-482d-8d50-de9374f80de9 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b58b04c5e7cd85acfb420c71e6db6c496cf2bcea,backing_fmt=raw /opt/stack/data/nova/instances/1f6a693f-0a99-434f-871d-f535b71229b9/disk 1073741824 {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:43:07 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:43:07 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-6348272b-4031-482d-8d50-de9374f80de9 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b58b04c5e7cd85acfb420c71e6db6c496cf2bcea,backing_fmt=raw /opt/stack/data/nova/instances/1f6a693f-0a99-434f-871d-f535b71229b9/disk 1073741824" returned: 0 in 0.050s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:43:07 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-6348272b-4031-482d-8d50-de9374f80de9 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lock "b58b04c5e7cd85acfb420c71e6db6c496cf2bcea" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.191s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:43:07 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-6348272b-4031-482d-8d50-de9374f80de9 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58b04c5e7cd85acfb420c71e6db6c496cf2bcea --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:43:07 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-6348272b-4031-482d-8d50-de9374f80de9 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58b04c5e7cd85acfb420c71e6db6c496cf2bcea --force-share --output=json" returned: 0 in 0.152s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:43:07 user nova-compute[71731]: DEBUG nova.objects.instance [None req-6348272b-4031-482d-8d50-de9374f80de9 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lazy-loading 'migration_context' on Instance uuid 1f6a693f-0a99-434f-871d-f535b71229b9 {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:43:07 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-6348272b-4031-482d-8d50-de9374f80de9 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] [instance: 1f6a693f-0a99-434f-871d-f535b71229b9] Rebasing disk image.
Apr 13 16:43:07 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-6348272b-4031-482d-8d50-de9374f80de9 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279 --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:43:07 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-6348272b-4031-482d-8d50-de9374f80de9 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279 --force-share --output=json" returned: 0 in 0.132s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:43:07 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-6348272b-4031-482d-8d50-de9374f80de9 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279 -F raw /opt/stack/data/nova/instances/1f6a693f-0a99-434f-871d-f535b71229b9/disk {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:43:09 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-6348272b-4031-482d-8d50-de9374f80de9 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279 -F raw /opt/stack/data/nova/instances/1f6a693f-0a99-434f-871d-f535b71229b9/disk" returned: 0 in 1.867s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:43:09 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-6348272b-4031-482d-8d50-de9374f80de9 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] [instance: 1f6a693f-0a99-434f-871d-f535b71229b9] Created local disks {{(pid=71731) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 16:43:09 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-6348272b-4031-482d-8d50-de9374f80de9 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] [instance: 1f6a693f-0a99-434f-871d-f535b71229b9] Ensure instance console log exists: /opt/stack/data/nova/instances/1f6a693f-0a99-434f-871d-f535b71229b9/console.log {{(pid=71731) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 16:43:09 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-6348272b-4031-482d-8d50-de9374f80de9 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:43:09 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-6348272b-4031-482d-8d50-de9374f80de9 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:43:09 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-6348272b-4031-482d-8d50-de9374f80de9 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:43:09 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-6348272b-4031-482d-8d50-de9374f80de9 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] [instance: 1f6a693f-0a99-434f-871d-f535b71229b9] Start _get_guest_xml network_info=[{"id": "103a0c68-ffc7-4460-836e-0de6c0272d84", "address": "fa:16:3e:f5:d0:dc", "network": {"id": "5acc9a78-1127-46df-bb60-7544cdd2c1ef", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2143082515-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0653ab16660b46cea9c5af58ea0b1931", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap103a0c68-ff", "ovs_interfaceid": "103a0c68-ffc7-4460-836e-0de6c0272d84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='19639c1bf98b74511fad89dcdaceb02f',container_format='bare',created_at=2023-04-13T16:41:11Z,direct_url=<?>,disk_format='qcow2',id=f46dd46b-4936-4a51-8ff8-a290b0db8c3c,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-152363829-shelved',owner='0653ab16660b46cea9c5af58ea0b1931',properties=ImageMetaProps,protected=<?>,size=38600704,status='active',tags=<?>,updated_at=2023-04-13T16:41:15Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'device_type': 'disk', 'encrypted': False, 'disk_bus': 'virtio', 'guest_format': None, 'encryption_options': None, 'image_id': '708622a9-7465-4492-ade8-b827198f7e30'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71731) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 16:43:09 user nova-compute[71731]: WARNING nova.virt.libvirt.driver [None req-6348272b-4031-482d-8d50-de9374f80de9 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 16:43:09 user nova-compute[71731]: WARNING nova.virt.libvirt.driver [None req-6348272b-4031-482d-8d50-de9374f80de9 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 16:43:09 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-6348272b-4031-482d-8d50-de9374f80de9 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71731) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 16:43:09 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-6348272b-4031-482d-8d50-de9374f80de9 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T16:17:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='19639c1bf98b74511fad89dcdaceb02f',container_format='bare',created_at=2023-04-13T16:41:11Z,direct_url=<?>,disk_format='qcow2',id=f46dd46b-4936-4a51-8ff8-a290b0db8c3c,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-152363829-shelved',owner='0653ab16660b46cea9c5af58ea0b1931',properties=ImageMetaProps,protected=<?>,size=38600704,status='active',tags=<?>,updated_at=2023-04-13T16:41:15Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 16:43:09 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-6348272b-4031-482d-8d50-de9374f80de9 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Flavor limits 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 16:43:09 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-6348272b-4031-482d-8d50-de9374f80de9 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Image limits 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 16:43:09 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-6348272b-4031-482d-8d50-de9374f80de9 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Flavor pref 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 16:43:09 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-6348272b-4031-482d-8d50-de9374f80de9 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Image pref 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 16:43:09 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-6348272b-4031-482d-8d50-de9374f80de9 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 16:43:09 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-6348272b-4031-482d-8d50-de9374f80de9 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 16:43:09 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-6348272b-4031-482d-8d50-de9374f80de9 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71731) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 16:43:09 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-6348272b-4031-482d-8d50-de9374f80de9 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Got 1 possible topologies {{(pid=71731) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 16:43:09 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-6348272b-4031-482d-8d50-de9374f80de9 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 16:43:09 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-6348272b-4031-482d-8d50-de9374f80de9 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 16:43:09 user nova-compute[71731]: DEBUG nova.objects.instance [None req-6348272b-4031-482d-8d50-de9374f80de9 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lazy-loading 'vcpu_model' on Instance uuid 1f6a693f-0a99-434f-871d-f535b71229b9 {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:43:09 user nova-compute[71731]: DEBUG nova.virt.libvirt.vif [None req-6348272b-4031-482d-8d50-de9374f80de9 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-13T16:39:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-152363829',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-152363829',id=34,image_ref='f46dd46b-4936-4a51-8ff8-a290b0db8c3c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-keypair-707123723',keypairs=<?>,launch_index=0,launched_at=2023-04-13T16:39:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='0653ab16660b46cea9c5af58ea0b1931',ramdisk_id='',reservation_id='r-nynwey78',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='708622a9-7465-4492-ade8-b827198f7e30',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1310775310',owner_user_name='tempest-AttachVolumeShelveTestJSON-1310775310-project-member',shelved_at='2023-04-13T16:41:14.756423',shelved_host='user',shelved_image_id='f46dd46b-4936-4a51-8ff8-a290b0db8c3c'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T16:43:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='48b4e972cd1049509fa899449961ab59',uuid=1f6a693f-0a99-434f-871d-f535b71229b9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "103a0c68-ffc7-4460-836e-0de6c0272d84", "address": "fa:16:3e:f5:d0:dc", "network": {"id": "5acc9a78-1127-46df-bb60-7544cdd2c1ef", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2143082515-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0653ab16660b46cea9c5af58ea0b1931", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap103a0c68-ff", "ovs_interfaceid": "103a0c68-ffc7-4460-836e-0de6c0272d84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71731) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 16:43:09 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-6348272b-4031-482d-8d50-de9374f80de9 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Converting VIF {"id": "103a0c68-ffc7-4460-836e-0de6c0272d84", "address": "fa:16:3e:f5:d0:dc", "network": {"id": "5acc9a78-1127-46df-bb60-7544cdd2c1ef", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2143082515-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0653ab16660b46cea9c5af58ea0b1931", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap103a0c68-ff", "ovs_interfaceid": "103a0c68-ffc7-4460-836e-0de6c0272d84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 16:43:09 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-6348272b-4031-482d-8d50-de9374f80de9 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:d0:dc,bridge_name='br-int',has_traffic_filtering=True,id=103a0c68-ffc7-4460-836e-0de6c0272d84,network=Network(5acc9a78-1127-46df-bb60-7544cdd2c1ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap103a0c68-ff') {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 16:43:09 user nova-compute[71731]: DEBUG nova.objects.instance [None req-6348272b-4031-482d-8d50-de9374f80de9 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lazy-loading 'pci_devices' on Instance uuid 1f6a693f-0a99-434f-871d-f535b71229b9 {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:43:09 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-6348272b-4031-482d-8d50-de9374f80de9 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] [instance: 1f6a693f-0a99-434f-871d-f535b71229b9] End _get_guest_xml xml=<domain type="kvm">
Apr 13 16:43:09 user nova-compute[71731]:   <uuid>1f6a693f-0a99-434f-871d-f535b71229b9</uuid>
Apr 13 16:43:09 user nova-compute[71731]:   <name>instance-00000022</name>
Apr 13 16:43:09 user nova-compute[71731]:   <memory>131072</memory>
Apr 13 16:43:09 user nova-compute[71731]:   <vcpu>1</vcpu>
Apr 13 16:43:09 user nova-compute[71731]:   <metadata>
Apr 13 16:43:09 user nova-compute[71731]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 16:43:09 user nova-compute[71731]:       <nova:package version="0.0.0"/>
Apr 13 16:43:09 user nova-compute[71731]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-152363829</nova:name>
Apr 13 16:43:09 user nova-compute[71731]:       <nova:creationTime>2023-04-13 16:43:09</nova:creationTime>
Apr 13 16:43:09 user nova-compute[71731]:       <nova:flavor name="m1.nano">
Apr 13 16:43:09 user nova-compute[71731]:         <nova:memory>128</nova:memory>
Apr 13 16:43:09 user nova-compute[71731]:         <nova:disk>1</nova:disk>
Apr 13 16:43:09 user nova-compute[71731]:         <nova:swap>0</nova:swap>
Apr 13 16:43:09 user nova-compute[71731]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 16:43:09 user nova-compute[71731]:         <nova:vcpus>1</nova:vcpus>
Apr 13 16:43:09 user nova-compute[71731]:       </nova:flavor>
Apr 13 16:43:09 user nova-compute[71731]:       <nova:owner>
Apr 13 16:43:09 user nova-compute[71731]:         <nova:user uuid="48b4e972cd1049509fa899449961ab59">tempest-AttachVolumeShelveTestJSON-1310775310-project-member</nova:user>
Apr 13 16:43:09 user nova-compute[71731]:         <nova:project uuid="0653ab16660b46cea9c5af58ea0b1931">tempest-AttachVolumeShelveTestJSON-1310775310</nova:project>
Apr 13 16:43:09 user nova-compute[71731]:       </nova:owner>
Apr 13 16:43:09 user nova-compute[71731]:       <nova:root type="image" uuid="f46dd46b-4936-4a51-8ff8-a290b0db8c3c"/>
Apr 13 16:43:09 user nova-compute[71731]:       <nova:ports>
Apr 13 16:43:09 user nova-compute[71731]:         <nova:port uuid="103a0c68-ffc7-4460-836e-0de6c0272d84">
Apr 13 16:43:09 user nova-compute[71731]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Apr 13 16:43:09 user nova-compute[71731]:         </nova:port>
Apr 13 16:43:09 user nova-compute[71731]:       </nova:ports>
Apr 13 16:43:09 user nova-compute[71731]:     </nova:instance>
Apr 13 16:43:09 user nova-compute[71731]:   </metadata>
Apr 13 16:43:09 user nova-compute[71731]:   <sysinfo type="smbios">
Apr 13 16:43:09 user nova-compute[71731]:     <system>
Apr 13 16:43:09 user nova-compute[71731]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 16:43:09 user nova-compute[71731]:       <entry name="product">OpenStack Nova</entry>
Apr 13 16:43:09 user nova-compute[71731]:       <entry name="version">0.0.0</entry>
Apr 13 16:43:09 user nova-compute[71731]:       <entry name="serial">1f6a693f-0a99-434f-871d-f535b71229b9</entry>
Apr 13 16:43:09 user nova-compute[71731]:       <entry name="uuid">1f6a693f-0a99-434f-871d-f535b71229b9</entry>
Apr 13 16:43:09 user nova-compute[71731]:       <entry name="family">Virtual Machine</entry>
Apr 13 16:43:09 user nova-compute[71731]:     </system>
Apr 13 16:43:09 user nova-compute[71731]:   </sysinfo>
Apr 13 16:43:09 user nova-compute[71731]:   <os>
Apr 13 16:43:09 user nova-compute[71731]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 16:43:09 user nova-compute[71731]:     <boot dev="hd"/>
Apr 13 16:43:09 user nova-compute[71731]:     <smbios mode="sysinfo"/>
Apr 13 16:43:09 user nova-compute[71731]:   </os>
Apr 13 16:43:09 user nova-compute[71731]:   <features>
Apr 13 16:43:09 user nova-compute[71731]:     <acpi/>
Apr 13 16:43:09 user nova-compute[71731]:     <apic/>
Apr 13 16:43:09 user nova-compute[71731]:     <vmcoreinfo/>
Apr 13 16:43:09 user nova-compute[71731]:   </features>
Apr 13 16:43:09 user nova-compute[71731]:   <clock offset="utc">
Apr 13 16:43:09 user nova-compute[71731]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 16:43:09 user nova-compute[71731]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 16:43:09 user nova-compute[71731]:     <timer name="hpet" present="no"/>
Apr 13 16:43:09 user nova-compute[71731]:   </clock>
Apr 13 16:43:09 user nova-compute[71731]:   <cpu mode="custom" match="exact">
Apr 13 16:43:09 user nova-compute[71731]:     <model>Nehalem</model>
Apr 13 16:43:09 user nova-compute[71731]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 16:43:09 user nova-compute[71731]:   </cpu>
Apr 13 16:43:09 user nova-compute[71731]:   <devices>
Apr 13 16:43:09 user nova-compute[71731]:     <disk type="file" device="disk">
Apr 13 16:43:09 user nova-compute[71731]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 16:43:09 user nova-compute[71731]:       <source file="/opt/stack/data/nova/instances/1f6a693f-0a99-434f-871d-f535b71229b9/disk"/>
Apr 13 16:43:09 user nova-compute[71731]:       <target dev="vda" bus="virtio"/>
Apr 13 16:43:09 user nova-compute[71731]:     </disk>
Apr 13 16:43:09 user nova-compute[71731]:     <interface type="ethernet">
Apr 13 16:43:09 user nova-compute[71731]:       <mac address="fa:16:3e:f5:d0:dc"/>
Apr 13 16:43:09 user nova-compute[71731]:       <model type="virtio"/>
Apr 13 16:43:09 user nova-compute[71731]:       <mtu size="1442"/>
Apr 13 16:43:09 user nova-compute[71731]:       <target dev="tap103a0c68-ff"/>
Apr 13 16:43:09 user nova-compute[71731]:     </interface>
Apr 13 16:43:09 user nova-compute[71731]:     <serial type="pty">
Apr 13 16:43:09 user nova-compute[71731]:       <log file="/opt/stack/data/nova/instances/1f6a693f-0a99-434f-871d-f535b71229b9/console.log" append="off"/>
Apr 13 16:43:09 user nova-compute[71731]:     </serial>
Apr 13 16:43:09 user nova-compute[71731]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 16:43:09 user nova-compute[71731]:     <video>
Apr 13 16:43:09 user nova-compute[71731]:       <model type="virtio"/>
Apr 13 16:43:09 user nova-compute[71731]:     </video>
Apr 13 16:43:09 user nova-compute[71731]:     <rng model="virtio">
Apr 13 16:43:09 user nova-compute[71731]:       <backend model="random">/dev/urandom</backend>
Apr 13 16:43:09 user nova-compute[71731]:     </rng>
Apr 13 16:43:09 user nova-compute[71731]:     <controller type="usb" index="0" model="none"/>
Apr 13 16:43:09 user nova-compute[71731]:     <memballoon model="virtio">
Apr 13 16:43:09 user nova-compute[71731]:       <stats period="10"/>
Apr 13 16:43:09 user nova-compute[71731]:     </memballoon>
Apr 13 16:43:09 user nova-compute[71731]:   </devices>
Apr 13 16:43:09 user nova-compute[71731]: </domain>
Apr 13 16:43:09 user nova-compute[71731]:  {{(pid=71731) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 16:43:09 user nova-compute[71731]: DEBUG nova.virt.libvirt.vif [None req-6348272b-4031-482d-8d50-de9374f80de9 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-13T16:39:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-152363829',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-152363829',id=34,image_ref='f46dd46b-4936-4a51-8ff8-a290b0db8c3c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-keypair-707123723',keypairs=<?>,launch_index=0,launched_at=2023-04-13T16:39:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='0653ab16660b46cea9c5af58ea0b1931',ramdisk_id='',reservation_id='r-nynwey78',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='708622a9-7465-4492-ade8-b827198f7e30',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1310775310',owner_user_name='tempest-AttachVolumeShelveTestJSON-1310775310-project-member',shelved_at='2023-04-13T16:41:14.756423',shelved_host='user',shelved_image_id='f46dd46b-4936-4a51-8ff8-a290b0db8c3c'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T16:43:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='48b4e972cd1049509fa899449961ab59',uuid=1f6a693f-0a99-434f-871d-f535b71229b9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "103a0c68-ffc7-4460-836e-0de6c0272d84", "address": "fa:16:3e:f5:d0:dc", "network": {"id": "5acc9a78-1127-46df-bb60-7544cdd2c1ef", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2143082515-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0653ab16660b46cea9c5af58ea0b1931", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap103a0c68-ff", "ovs_interfaceid": "103a0c68-ffc7-4460-836e-0de6c0272d84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 16:43:09 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-6348272b-4031-482d-8d50-de9374f80de9 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Converting VIF {"id": "103a0c68-ffc7-4460-836e-0de6c0272d84", "address": "fa:16:3e:f5:d0:dc", "network": {"id": "5acc9a78-1127-46df-bb60-7544cdd2c1ef", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2143082515-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0653ab16660b46cea9c5af58ea0b1931", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap103a0c68-ff", "ovs_interfaceid": "103a0c68-ffc7-4460-836e-0de6c0272d84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 16:43:09 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-6348272b-4031-482d-8d50-de9374f80de9 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:d0:dc,bridge_name='br-int',has_traffic_filtering=True,id=103a0c68-ffc7-4460-836e-0de6c0272d84,network=Network(5acc9a78-1127-46df-bb60-7544cdd2c1ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap103a0c68-ff') {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 16:43:09 user nova-compute[71731]: DEBUG os_vif [None req-6348272b-4031-482d-8d50-de9374f80de9 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:d0:dc,bridge_name='br-int',has_traffic_filtering=True,id=103a0c68-ffc7-4460-836e-0de6c0272d84,network=Network(5acc9a78-1127-46df-bb60-7544cdd2c1ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap103a0c68-ff') {{(pid=71731) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 16:43:09 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:43:09 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:43:09 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 16:43:09 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:43:09 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap103a0c68-ff, may_exist=True) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:43:09 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap103a0c68-ff, col_values=(('external_ids', {'iface-id': '103a0c68-ffc7-4460-836e-0de6c0272d84', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f5:d0:dc', 'vm-uuid': '1f6a693f-0a99-434f-871d-f535b71229b9'}),)) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:43:09 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:43:09 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 16:43:09 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:43:09 user nova-compute[71731]: INFO os_vif [None req-6348272b-4031-482d-8d50-de9374f80de9 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:d0:dc,bridge_name='br-int',has_traffic_filtering=True,id=103a0c68-ffc7-4460-836e-0de6c0272d84,network=Network(5acc9a78-1127-46df-bb60-7544cdd2c1ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap103a0c68-ff')
Apr 13 16:43:09 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-6348272b-4031-482d-8d50-de9374f80de9 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] No BDM found with device name vda, not building metadata. {{(pid=71731) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 16:43:09 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-6348272b-4031-482d-8d50-de9374f80de9 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] No VIF found with MAC fa:16:3e:f5:d0:dc, not building metadata {{(pid=71731) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 16:43:10 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:43:10 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:43:10 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:43:11 user nova-compute[71731]: DEBUG nova.compute.manager [req-d414927d-50b5-4060-9a52-de147f4d75e7 req-40292293-bd09-4b33-85ed-11dd6e55ff14 service nova] [instance: 1f6a693f-0a99-434f-871d-f535b71229b9] Received event network-vif-plugged-103a0c68-ffc7-4460-836e-0de6c0272d84 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:43:11 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-d414927d-50b5-4060-9a52-de147f4d75e7 req-40292293-bd09-4b33-85ed-11dd6e55ff14 service nova] Acquiring lock "1f6a693f-0a99-434f-871d-f535b71229b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:43:11 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-d414927d-50b5-4060-9a52-de147f4d75e7 req-40292293-bd09-4b33-85ed-11dd6e55ff14 service nova] Lock "1f6a693f-0a99-434f-871d-f535b71229b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:43:11 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-d414927d-50b5-4060-9a52-de147f4d75e7 req-40292293-bd09-4b33-85ed-11dd6e55ff14 service nova] Lock "1f6a693f-0a99-434f-871d-f535b71229b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:43:11 user nova-compute[71731]: DEBUG nova.compute.manager [req-d414927d-50b5-4060-9a52-de147f4d75e7 req-40292293-bd09-4b33-85ed-11dd6e55ff14 service nova] [instance: 1f6a693f-0a99-434f-871d-f535b71229b9] No waiting events found dispatching network-vif-plugged-103a0c68-ffc7-4460-836e-0de6c0272d84 {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:43:11 user nova-compute[71731]: WARNING nova.compute.manager [req-d414927d-50b5-4060-9a52-de147f4d75e7 req-40292293-bd09-4b33-85ed-11dd6e55ff14 service nova] [instance: 1f6a693f-0a99-434f-871d-f535b71229b9] Received unexpected event network-vif-plugged-103a0c68-ffc7-4460-836e-0de6c0272d84 for instance with vm_state shelved_offloaded and task_state spawning.
Apr 13 16:43:11 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:43:11 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:43:11 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:43:11 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:43:12 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:43:12 user nova-compute[71731]: DEBUG nova.virt.driver [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Emitting event <LifecycleEvent: 1681404192.8768072, 1f6a693f-0a99-434f-871d-f535b71229b9 => Resumed> {{(pid=71731) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 16:43:12 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 1f6a693f-0a99-434f-871d-f535b71229b9] VM Resumed (Lifecycle Event)
Apr 13 16:43:12 user nova-compute[71731]: DEBUG nova.compute.manager [None req-6348272b-4031-482d-8d50-de9374f80de9 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] [instance: 1f6a693f-0a99-434f-871d-f535b71229b9] Instance event wait completed in 0 seconds for  {{(pid=71731) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 16:43:12 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-6348272b-4031-482d-8d50-de9374f80de9 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] [instance: 1f6a693f-0a99-434f-871d-f535b71229b9] Guest created on hypervisor {{(pid=71731) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 16:43:12 user nova-compute[71731]: INFO nova.virt.libvirt.driver [-] [instance: 1f6a693f-0a99-434f-871d-f535b71229b9] Instance spawned successfully.
Apr 13 16:43:12 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 1f6a693f-0a99-434f-871d-f535b71229b9] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:43:12 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 1f6a693f-0a99-434f-871d-f535b71229b9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=71731) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 16:43:12 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 1f6a693f-0a99-434f-871d-f535b71229b9] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 16:43:12 user nova-compute[71731]: DEBUG nova.virt.driver [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Emitting event <LifecycleEvent: 1681404192.8780527, 1f6a693f-0a99-434f-871d-f535b71229b9 => Started> {{(pid=71731) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 16:43:12 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 1f6a693f-0a99-434f-871d-f535b71229b9] VM Started (Lifecycle Event)
Apr 13 16:43:12 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 1f6a693f-0a99-434f-871d-f535b71229b9] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:43:12 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 1f6a693f-0a99-434f-871d-f535b71229b9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=71731) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 16:43:12 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 1f6a693f-0a99-434f-871d-f535b71229b9] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 16:43:13 user nova-compute[71731]: DEBUG nova.compute.manager [req-213790d4-8705-4868-b13a-1e5e5ac1852b req-dca7cda3-a0a0-4f10-a57d-510736d0f06f service nova] [instance: 1f6a693f-0a99-434f-871d-f535b71229b9] Received event network-vif-plugged-103a0c68-ffc7-4460-836e-0de6c0272d84 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:43:13 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-213790d4-8705-4868-b13a-1e5e5ac1852b req-dca7cda3-a0a0-4f10-a57d-510736d0f06f service nova] Acquiring lock "1f6a693f-0a99-434f-871d-f535b71229b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:43:13 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-213790d4-8705-4868-b13a-1e5e5ac1852b req-dca7cda3-a0a0-4f10-a57d-510736d0f06f service nova] Lock "1f6a693f-0a99-434f-871d-f535b71229b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:43:13 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-213790d4-8705-4868-b13a-1e5e5ac1852b req-dca7cda3-a0a0-4f10-a57d-510736d0f06f service nova] Lock "1f6a693f-0a99-434f-871d-f535b71229b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:43:13 user nova-compute[71731]: DEBUG nova.compute.manager [req-213790d4-8705-4868-b13a-1e5e5ac1852b req-dca7cda3-a0a0-4f10-a57d-510736d0f06f service nova] [instance: 1f6a693f-0a99-434f-871d-f535b71229b9] No waiting events found dispatching network-vif-plugged-103a0c68-ffc7-4460-836e-0de6c0272d84 {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:43:13 user nova-compute[71731]: WARNING nova.compute.manager [req-213790d4-8705-4868-b13a-1e5e5ac1852b req-dca7cda3-a0a0-4f10-a57d-510736d0f06f service nova] [instance: 1f6a693f-0a99-434f-871d-f535b71229b9] Received unexpected event network-vif-plugged-103a0c68-ffc7-4460-836e-0de6c0272d84 for instance with vm_state shelved_offloaded and task_state spawning.
Apr 13 16:43:13 user nova-compute[71731]: DEBUG nova.compute.manager [None req-6348272b-4031-482d-8d50-de9374f80de9 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] [instance: 1f6a693f-0a99-434f-871d-f535b71229b9] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:43:13 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-6348272b-4031-482d-8d50-de9374f80de9 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lock "1f6a693f-0a99-434f-871d-f535b71229b9" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 9.557s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:43:14 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:43:17 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:43:19 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:43:21 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:43:22 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:43:23 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager.update_available_resource {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:43:23 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:43:23 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:43:23 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:43:23 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Auditing locally available compute resources for user (node: user) {{(pid=71731) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 16:43:23 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71731) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 16:43:23 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3af23ff8-4e10-4fbf-a86e-bda842f084ff/disk.rescue --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:43:23 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3af23ff8-4e10-4fbf-a86e-bda842f084ff/disk.rescue --force-share --output=json" returned: 0 in 0.135s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:43:23 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3af23ff8-4e10-4fbf-a86e-bda842f084ff/disk.rescue --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:43:23 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3af23ff8-4e10-4fbf-a86e-bda842f084ff/disk.rescue --force-share --output=json" returned: 0 in 0.137s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:43:23 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3af23ff8-4e10-4fbf-a86e-bda842f084ff/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:43:23 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3af23ff8-4e10-4fbf-a86e-bda842f084ff/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:43:23 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3af23ff8-4e10-4fbf-a86e-bda842f084ff/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:43:23 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3af23ff8-4e10-4fbf-a86e-bda842f084ff/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:43:23 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ed800fe-577d-4624-898c-c7f40da77376/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:43:23 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ed800fe-577d-4624-898c-c7f40da77376/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:43:23 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ed800fe-577d-4624-898c-c7f40da77376/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:43:24 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ed800fe-577d-4624-898c-c7f40da77376/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:43:24 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f6a693f-0a99-434f-871d-f535b71229b9/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:43:24 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f6a693f-0a99-434f-871d-f535b71229b9/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:43:24 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f6a693f-0a99-434f-871d-f535b71229b9/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:43:24 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f6a693f-0a99-434f-871d-f535b71229b9/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:43:24 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2d55cdd-c89c-4c59-afe1-49a33225af22/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:43:24 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:43:24 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2d55cdd-c89c-4c59-afe1-49a33225af22/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:43:24 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2d55cdd-c89c-4c59-afe1-49a33225af22/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:43:24 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2d55cdd-c89c-4c59-afe1-49a33225af22/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:43:25 user nova-compute[71731]: WARNING nova.virt.libvirt.driver [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 16:43:25 user nova-compute[71731]: WARNING nova.virt.libvirt.driver [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 16:43:25 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Hypervisor/Node resource view: name=user free_ram=8376MB free_disk=26.08287811279297GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71731) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 16:43:25 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:43:25 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:43:25 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Applying migration context for instance 7ae7d3d9-54f7-4c64-8bf6-08fa5c526687 as it has an incoming, in-progress migration fc53a14d-8658-42db-a644-15b07e017d46. Migration status is finished {{(pid=71731) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:950}}
Apr 13 16:43:25 user nova-compute[71731]: INFO nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] [instance: 7ae7d3d9-54f7-4c64-8bf6-08fa5c526687] Updating resource usage from migration fc53a14d-8658-42db-a644-15b07e017d46
Apr 13 16:43:25 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance 5ed800fe-577d-4624-898c-c7f40da77376 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 16:43:25 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance b2d55cdd-c89c-4c59-afe1-49a33225af22 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 16:43:25 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance 3af23ff8-4e10-4fbf-a86e-bda842f084ff actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 16:43:25 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Migration fc53a14d-8658-42db-a644-15b07e017d46 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 128}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1637}}
Apr 13 16:43:25 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance 7ae7d3d9-54f7-4c64-8bf6-08fa5c526687 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 16:43:25 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance 1f6a693f-0a99-434f-871d-f535b71229b9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 16:43:25 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=71731) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 16:43:25 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Final resource view: name=user phys_ram=16023MB used_ram=1344MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=71731) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 16:43:25 user nova-compute[71731]: DEBUG nova.compute.provider_tree [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Inventory has not changed in ProviderTree for provider: cb6b1a64-0c24-4e2d-af1e-16576ca9165c {{(pid=71731) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 16:43:25 user nova-compute[71731]: DEBUG nova.scheduler.client.report [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Inventory has not changed for provider cb6b1a64-0c24-4e2d-af1e-16576ca9165c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71731) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 16:43:25 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Compute_service record updated for user:user {{(pid=71731) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 16:43:25 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.361s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:43:27 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:43:28 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:43:28 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Starting heal instance info cache {{(pid=71731) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 16:43:28 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Acquiring lock "refresh_cache-7ae7d3d9-54f7-4c64-8bf6-08fa5c526687" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 16:43:28 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Acquired lock "refresh_cache-7ae7d3d9-54f7-4c64-8bf6-08fa5c526687" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 16:43:28 user nova-compute[71731]: DEBUG nova.network.neutron [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] [instance: 7ae7d3d9-54f7-4c64-8bf6-08fa5c526687] Forcefully refreshing network info cache for instance {{(pid=71731) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 16:43:29 user nova-compute[71731]: DEBUG nova.network.neutron [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] [instance: 7ae7d3d9-54f7-4c64-8bf6-08fa5c526687] Updating instance_info_cache with network_info: [{"id": "f7ec2f7f-f505-44ed-b40d-7b91b2248cea", "address": "fa:16:3e:e2:cd:35", "network": {"id": "cf1fef97-9ef1-449f-a302-b38110024547", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1138167711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "980559734a504574a83224deb7423c77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7ec2f7f-f5", "ovs_interfaceid": "f7ec2f7f-f505-44ed-b40d-7b91b2248cea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:43:29 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Releasing lock "refresh_cache-7ae7d3d9-54f7-4c64-8bf6-08fa5c526687" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 16:43:29 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] [instance: 7ae7d3d9-54f7-4c64-8bf6-08fa5c526687] Updated the network info_cache for instance {{(pid=71731) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 16:43:29 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:43:29 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:43:29 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71731) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 16:43:29 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:43:32 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:43:32 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:43:32 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:43:33 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:43:34 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:43:34 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:43:37 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:43:39 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-52acf467-479c-454a-9dac-71c166283c8f tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Acquiring lock "7ae7d3d9-54f7-4c64-8bf6-08fa5c526687" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:43:39 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-52acf467-479c-454a-9dac-71c166283c8f tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "7ae7d3d9-54f7-4c64-8bf6-08fa5c526687" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:43:39 user nova-compute[71731]: DEBUG nova.compute.manager [None req-52acf467-479c-454a-9dac-71c166283c8f tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: 7ae7d3d9-54f7-4c64-8bf6-08fa5c526687] Going to confirm migration 2 {{(pid=71731) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4663}}
Apr 13 16:43:39 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-52acf467-479c-454a-9dac-71c166283c8f tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Acquiring lock "refresh_cache-7ae7d3d9-54f7-4c64-8bf6-08fa5c526687" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 16:43:39 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-52acf467-479c-454a-9dac-71c166283c8f tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Acquired lock "refresh_cache-7ae7d3d9-54f7-4c64-8bf6-08fa5c526687" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 16:43:39 user nova-compute[71731]: DEBUG nova.network.neutron [None req-52acf467-479c-454a-9dac-71c166283c8f tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: 7ae7d3d9-54f7-4c64-8bf6-08fa5c526687] Building network info cache for instance {{(pid=71731) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 16:43:39 user nova-compute[71731]: DEBUG nova.objects.instance [None req-52acf467-479c-454a-9dac-71c166283c8f tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lazy-loading 'info_cache' on Instance uuid 7ae7d3d9-54f7-4c64-8bf6-08fa5c526687 {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:43:39 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:43:39 user nova-compute[71731]: DEBUG nova.network.neutron [None req-52acf467-479c-454a-9dac-71c166283c8f tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: 7ae7d3d9-54f7-4c64-8bf6-08fa5c526687] Updating instance_info_cache with network_info: [{"id": "f7ec2f7f-f505-44ed-b40d-7b91b2248cea", "address": "fa:16:3e:e2:cd:35", "network": {"id": "cf1fef97-9ef1-449f-a302-b38110024547", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1138167711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "980559734a504574a83224deb7423c77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7ec2f7f-f5", "ovs_interfaceid": "f7ec2f7f-f505-44ed-b40d-7b91b2248cea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:43:39 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-52acf467-479c-454a-9dac-71c166283c8f tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Releasing lock "refresh_cache-7ae7d3d9-54f7-4c64-8bf6-08fa5c526687" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 16:43:39 user nova-compute[71731]: DEBUG nova.objects.instance [None req-52acf467-479c-454a-9dac-71c166283c8f tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lazy-loading 'migration_context' on Instance uuid 7ae7d3d9-54f7-4c64-8bf6-08fa5c526687 {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:43:39 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-52acf467-479c-454a-9dac-71c166283c8f tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:43:39 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-52acf467-479c-454a-9dac-71c166283c8f tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:43:39 user nova-compute[71731]: DEBUG nova.compute.provider_tree [None req-52acf467-479c-454a-9dac-71c166283c8f tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Inventory has not changed in ProviderTree for provider: cb6b1a64-0c24-4e2d-af1e-16576ca9165c {{(pid=71731) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 16:43:39 user nova-compute[71731]: DEBUG nova.scheduler.client.report [None req-52acf467-479c-454a-9dac-71c166283c8f tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Inventory has not changed for provider cb6b1a64-0c24-4e2d-af1e-16576ca9165c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71731) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 16:43:39 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-52acf467-479c-454a-9dac-71c166283c8f tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.275s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:43:40 user nova-compute[71731]: INFO nova.scheduler.client.report [None req-52acf467-479c-454a-9dac-71c166283c8f tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Deleted allocation for migration fc53a14d-8658-42db-a644-15b07e017d46
Apr 13 16:43:40 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-52acf467-479c-454a-9dac-71c166283c8f tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "7ae7d3d9-54f7-4c64-8bf6-08fa5c526687" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.175s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:43:42 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:43:44 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:43:49 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 16:43:49 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:43:49 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71731) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 16:43:49 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71731) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 16:43:49 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71731) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 16:43:49 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:43:54 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 16:43:54 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:43:54 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71731) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 16:43:54 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71731) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 16:43:54 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71731) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 16:43:54 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:43:57 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:43:59 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:44:04 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 16:44:04 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:44:04 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71731) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 16:44:04 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71731) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 16:44:04 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71731) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 16:44:04 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:44:09 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 16:44:09 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:44:09 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71731) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 16:44:09 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71731) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 16:44:09 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71731) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 16:44:09 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 16:44:14 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 16:44:14 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 16:44:14 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71731) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 16:44:14 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71731) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 16:44:14 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71731) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 16:44:14 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:44:19 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 16:44:22 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:44:23 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:44:24 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:44:25 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager.update_available_resource {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:44:25 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:44:25 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:44:25 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:44:25 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Auditing locally available compute resources for user (node: user) {{(pid=71731) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 16:44:25 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71731) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 16:44:25 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3af23ff8-4e10-4fbf-a86e-bda842f084ff/disk.rescue --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:44:25 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3af23ff8-4e10-4fbf-a86e-bda842f084ff/disk.rescue --force-share --output=json" returned: 0 in 0.150s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:44:25 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3af23ff8-4e10-4fbf-a86e-bda842f084ff/disk.rescue --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:44:25 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3af23ff8-4e10-4fbf-a86e-bda842f084ff/disk.rescue --force-share --output=json" returned: 0 in 0.138s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:44:25 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3af23ff8-4e10-4fbf-a86e-bda842f084ff/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:44:25 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3af23ff8-4e10-4fbf-a86e-bda842f084ff/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:44:25 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3af23ff8-4e10-4fbf-a86e-bda842f084ff/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:44:25 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3af23ff8-4e10-4fbf-a86e-bda842f084ff/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:44:25 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ed800fe-577d-4624-898c-c7f40da77376/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:44:25 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ed800fe-577d-4624-898c-c7f40da77376/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:44:25 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ed800fe-577d-4624-898c-c7f40da77376/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:44:26 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ed800fe-577d-4624-898c-c7f40da77376/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:44:26 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f6a693f-0a99-434f-871d-f535b71229b9/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:44:26 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f6a693f-0a99-434f-871d-f535b71229b9/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:44:26 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f6a693f-0a99-434f-871d-f535b71229b9/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:44:26 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f6a693f-0a99-434f-871d-f535b71229b9/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:44:26 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2d55cdd-c89c-4c59-afe1-49a33225af22/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:44:26 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2d55cdd-c89c-4c59-afe1-49a33225af22/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:44:26 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2d55cdd-c89c-4c59-afe1-49a33225af22/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:44:26 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2d55cdd-c89c-4c59-afe1-49a33225af22/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:44:27 user nova-compute[71731]: WARNING nova.virt.libvirt.driver [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 16:44:27 user nova-compute[71731]: WARNING nova.virt.libvirt.driver [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 16:44:27 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Hypervisor/Node resource view: name=user free_ram=8390MB free_disk=26.081951141357422GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71731) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 16:44:27 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:44:27 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:44:27 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance 5ed800fe-577d-4624-898c-c7f40da77376 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 16:44:27 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance b2d55cdd-c89c-4c59-afe1-49a33225af22 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 16:44:27 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance 3af23ff8-4e10-4fbf-a86e-bda842f084ff actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 16:44:27 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance 7ae7d3d9-54f7-4c64-8bf6-08fa5c526687 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 16:44:27 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance 1f6a693f-0a99-434f-871d-f535b71229b9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 16:44:27 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=71731) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 16:44:27 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Final resource view: name=user phys_ram=16023MB used_ram=1216MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=71731) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 16:44:27 user nova-compute[71731]: DEBUG nova.compute.provider_tree [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Inventory has not changed in ProviderTree for provider: cb6b1a64-0c24-4e2d-af1e-16576ca9165c {{(pid=71731) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 16:44:27 user nova-compute[71731]: DEBUG nova.scheduler.client.report [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Inventory has not changed for provider cb6b1a64-0c24-4e2d-af1e-16576ca9165c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71731) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 16:44:27 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Compute_service record updated for user:user {{(pid=71731) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 16:44:27 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.317s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:44:28 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:44:28 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:44:28 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71731) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 16:44:29 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:44:29 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Starting heal instance info cache {{(pid=71731) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 16:44:29 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Acquiring lock "refresh_cache-b2d55cdd-c89c-4c59-afe1-49a33225af22" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 16:44:29 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Acquired lock "refresh_cache-b2d55cdd-c89c-4c59-afe1-49a33225af22" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 16:44:29 user nova-compute[71731]: DEBUG nova.network.neutron [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] [instance: b2d55cdd-c89c-4c59-afe1-49a33225af22] Forcefully refreshing network info cache for instance {{(pid=71731) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 16:44:29 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 16:44:29 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 16:44:29 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71731) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 16:44:29 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71731) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 16:44:29 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71731) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 16:44:29 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:44:29 user nova-compute[71731]: DEBUG nova.network.neutron [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] [instance: b2d55cdd-c89c-4c59-afe1-49a33225af22] Updating instance_info_cache with network_info: [{"id": "31e1957f-9bd1-42ae-a2ac-954b49ca15f1", "address": "fa:16:3e:81:e2:10", "network": {"id": "2a5b69f1-fc5b-4c33-a9eb-12a4d9293500", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2137344591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "846732ecb7e047128b4684972d3cd8c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31e1957f-9b", "ovs_interfaceid": "31e1957f-9bd1-42ae-a2ac-954b49ca15f1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:44:29 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Releasing lock "refresh_cache-b2d55cdd-c89c-4c59-afe1-49a33225af22" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 16:44:29 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] [instance: b2d55cdd-c89c-4c59-afe1-49a33225af22] Updated the network info_cache for instance {{(pid=71731) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 16:44:32 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:44:33 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:44:33 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:44:34 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:44:35 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:44:35 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:44:37 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:44:39 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 16:44:39 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 16:44:39 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71731) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 16:44:39 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71731) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 16:44:39 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71731) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 16:44:39 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:44:44 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:44:49 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 16:44:53 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-7dbb1275-cde4-4fa0-b44e-e575fa499d57 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Acquiring lock "1f6a693f-0a99-434f-871d-f535b71229b9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:44:53 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-7dbb1275-cde4-4fa0-b44e-e575fa499d57 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lock "1f6a693f-0a99-434f-871d-f535b71229b9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:44:53 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-7dbb1275-cde4-4fa0-b44e-e575fa499d57 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Acquiring lock "1f6a693f-0a99-434f-871d-f535b71229b9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:44:53 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-7dbb1275-cde4-4fa0-b44e-e575fa499d57 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lock "1f6a693f-0a99-434f-871d-f535b71229b9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:44:53 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-7dbb1275-cde4-4fa0-b44e-e575fa499d57 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lock "1f6a693f-0a99-434f-871d-f535b71229b9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:44:53 user nova-compute[71731]: INFO nova.compute.manager [None req-7dbb1275-cde4-4fa0-b44e-e575fa499d57 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] [instance: 1f6a693f-0a99-434f-871d-f535b71229b9] Terminating instance
Apr 13 16:44:53 user nova-compute[71731]: DEBUG nova.compute.manager [None req-7dbb1275-cde4-4fa0-b44e-e575fa499d57 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] [instance: 1f6a693f-0a99-434f-871d-f535b71229b9] Start destroying the instance on the hypervisor. {{(pid=71731) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 16:44:53 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:44:53 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:44:53 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:44:53 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:44:54 user nova-compute[71731]: DEBUG nova.compute.manager [req-8655fdfc-73ac-4325-9348-fc8903becb31 req-c72c4ebb-e9bb-4697-9002-89cd1633b3d1 service nova] [instance: 1f6a693f-0a99-434f-871d-f535b71229b9] Received event network-vif-unplugged-103a0c68-ffc7-4460-836e-0de6c0272d84 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:44:54 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-8655fdfc-73ac-4325-9348-fc8903becb31 req-c72c4ebb-e9bb-4697-9002-89cd1633b3d1 service nova] Acquiring lock "1f6a693f-0a99-434f-871d-f535b71229b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:44:54 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-8655fdfc-73ac-4325-9348-fc8903becb31 req-c72c4ebb-e9bb-4697-9002-89cd1633b3d1 service nova] Lock "1f6a693f-0a99-434f-871d-f535b71229b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:44:54 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-8655fdfc-73ac-4325-9348-fc8903becb31 req-c72c4ebb-e9bb-4697-9002-89cd1633b3d1 service nova] Lock "1f6a693f-0a99-434f-871d-f535b71229b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:44:54 user nova-compute[71731]: DEBUG nova.compute.manager [req-8655fdfc-73ac-4325-9348-fc8903becb31 req-c72c4ebb-e9bb-4697-9002-89cd1633b3d1 service nova] [instance: 1f6a693f-0a99-434f-871d-f535b71229b9] No waiting events found dispatching network-vif-unplugged-103a0c68-ffc7-4460-836e-0de6c0272d84 {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:44:54 user nova-compute[71731]: DEBUG nova.compute.manager [req-8655fdfc-73ac-4325-9348-fc8903becb31 req-c72c4ebb-e9bb-4697-9002-89cd1633b3d1 service nova] [instance: 1f6a693f-0a99-434f-871d-f535b71229b9] Received event network-vif-unplugged-103a0c68-ffc7-4460-836e-0de6c0272d84 for instance with task_state deleting. {{(pid=71731) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 16:44:54 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:44:54 user nova-compute[71731]: INFO nova.virt.libvirt.driver [-] [instance: 1f6a693f-0a99-434f-871d-f535b71229b9] Instance destroyed successfully.
Apr 13 16:44:54 user nova-compute[71731]: DEBUG nova.objects.instance [None req-7dbb1275-cde4-4fa0-b44e-e575fa499d57 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lazy-loading 'resources' on Instance uuid 1f6a693f-0a99-434f-871d-f535b71229b9 {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:44:54 user nova-compute[71731]: DEBUG nova.virt.libvirt.vif [None req-7dbb1275-cde4-4fa0-b44e-e575fa499d57 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-13T16:39:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-152363829',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-152363829',id=34,image_ref='708622a9-7465-4492-ade8-b827198f7e30',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEMeM+1/KnPrfHwYC3u+Lcza7snpR0t1GJvUaC1TzWStqRV08H+ksCdHvKc+nMr3bT0XCZGDg/vhmXMFwe7jGl2nfjwDh9ruSgNXBv0ppZMEtKuFitRCX7rOQL8v9bZcKA==',key_name='tempest-keypair-707123723',keypairs=<?>,launch_index=0,launched_at=2023-04-13T16:43:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0653ab16660b46cea9c5af58ea0b1931',ramdisk_id='',reservation_id='r-nynwey78',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='708622a9-7465-4492-ade8-b827198f7e30',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1310775310',owner_user_name='tempest-AttachVolumeShelveTestJSON-1310775310-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T16:43:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='48b4e972cd1049509fa899449961ab59',uuid=1f6a693f-0a99-434f-871d-f535b71229b9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "103a0c68-ffc7-4460-836e-0de6c0272d84", "address": "fa:16:3e:f5:d0:dc", "network": {"id": "5acc9a78-1127-46df-bb60-7544cdd2c1ef", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2143082515-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0653ab16660b46cea9c5af58ea0b1931", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap103a0c68-ff", "ovs_interfaceid": "103a0c68-ffc7-4460-836e-0de6c0272d84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 16:44:54 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-7dbb1275-cde4-4fa0-b44e-e575fa499d57 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Converting VIF {"id": "103a0c68-ffc7-4460-836e-0de6c0272d84", "address": "fa:16:3e:f5:d0:dc", "network": {"id": "5acc9a78-1127-46df-bb60-7544cdd2c1ef", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2143082515-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0653ab16660b46cea9c5af58ea0b1931", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap103a0c68-ff", "ovs_interfaceid": "103a0c68-ffc7-4460-836e-0de6c0272d84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 16:44:54 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-7dbb1275-cde4-4fa0-b44e-e575fa499d57 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:d0:dc,bridge_name='br-int',has_traffic_filtering=True,id=103a0c68-ffc7-4460-836e-0de6c0272d84,network=Network(5acc9a78-1127-46df-bb60-7544cdd2c1ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap103a0c68-ff') {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 16:44:54 user nova-compute[71731]: DEBUG os_vif [None req-7dbb1275-cde4-4fa0-b44e-e575fa499d57 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:d0:dc,bridge_name='br-int',has_traffic_filtering=True,id=103a0c68-ffc7-4460-836e-0de6c0272d84,network=Network(5acc9a78-1127-46df-bb60-7544cdd2c1ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap103a0c68-ff') {{(pid=71731) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 16:44:54 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:44:54 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap103a0c68-ff, bridge=br-int, if_exists=True) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:44:54 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:44:54 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 16:44:54 user nova-compute[71731]: INFO os_vif [None req-7dbb1275-cde4-4fa0-b44e-e575fa499d57 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:d0:dc,bridge_name='br-int',has_traffic_filtering=True,id=103a0c68-ffc7-4460-836e-0de6c0272d84,network=Network(5acc9a78-1127-46df-bb60-7544cdd2c1ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap103a0c68-ff')
Apr 13 16:44:54 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-7dbb1275-cde4-4fa0-b44e-e575fa499d57 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] [instance: 1f6a693f-0a99-434f-871d-f535b71229b9] Deleting instance files /opt/stack/data/nova/instances/1f6a693f-0a99-434f-871d-f535b71229b9_del
Apr 13 16:44:54 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-7dbb1275-cde4-4fa0-b44e-e575fa499d57 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] [instance: 1f6a693f-0a99-434f-871d-f535b71229b9] Deletion of /opt/stack/data/nova/instances/1f6a693f-0a99-434f-871d-f535b71229b9_del complete
Apr 13 16:44:54 user nova-compute[71731]: INFO nova.compute.manager [None req-7dbb1275-cde4-4fa0-b44e-e575fa499d57 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] [instance: 1f6a693f-0a99-434f-871d-f535b71229b9] Took 0.66 seconds to destroy the instance on the hypervisor.
Apr 13 16:44:54 user nova-compute[71731]: DEBUG oslo.service.loopingcall [None req-7dbb1275-cde4-4fa0-b44e-e575fa499d57 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71731) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 16:44:54 user nova-compute[71731]: DEBUG nova.compute.manager [-] [instance: 1f6a693f-0a99-434f-871d-f535b71229b9] Deallocating network for instance {{(pid=71731) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 16:44:54 user nova-compute[71731]: DEBUG nova.network.neutron [-] [instance: 1f6a693f-0a99-434f-871d-f535b71229b9] deallocate_for_instance() {{(pid=71731) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 16:44:55 user nova-compute[71731]: DEBUG nova.network.neutron [-] [instance: 1f6a693f-0a99-434f-871d-f535b71229b9] Updating instance_info_cache with network_info: [] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:44:55 user nova-compute[71731]: INFO nova.compute.manager [-] [instance: 1f6a693f-0a99-434f-871d-f535b71229b9] Took 0.69 seconds to deallocate network for instance.
Apr 13 16:44:55 user nova-compute[71731]: DEBUG nova.compute.manager [req-c95f360c-5acd-4353-9fe0-43c5af58b3cc req-98bcf040-237b-4c41-9f56-a180ee7ce36b service nova] [instance: 1f6a693f-0a99-434f-871d-f535b71229b9] Received event network-vif-deleted-103a0c68-ffc7-4460-836e-0de6c0272d84 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:44:55 user nova-compute[71731]: INFO nova.compute.manager [req-c95f360c-5acd-4353-9fe0-43c5af58b3cc req-98bcf040-237b-4c41-9f56-a180ee7ce36b service nova] [instance: 1f6a693f-0a99-434f-871d-f535b71229b9] Neutron deleted interface 103a0c68-ffc7-4460-836e-0de6c0272d84; detaching it from the instance and deleting it from the info cache
Apr 13 16:44:55 user nova-compute[71731]: DEBUG nova.network.neutron [req-c95f360c-5acd-4353-9fe0-43c5af58b3cc req-98bcf040-237b-4c41-9f56-a180ee7ce36b service nova] [instance: 1f6a693f-0a99-434f-871d-f535b71229b9] Updating instance_info_cache with network_info: [] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:44:55 user nova-compute[71731]: DEBUG nova.compute.manager [req-c95f360c-5acd-4353-9fe0-43c5af58b3cc req-98bcf040-237b-4c41-9f56-a180ee7ce36b service nova] [instance: 1f6a693f-0a99-434f-871d-f535b71229b9] Detach interface failed, port_id=103a0c68-ffc7-4460-836e-0de6c0272d84, reason: Instance 1f6a693f-0a99-434f-871d-f535b71229b9 could not be found. {{(pid=71731) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 13 16:44:55 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-7dbb1275-cde4-4fa0-b44e-e575fa499d57 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:44:55 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-7dbb1275-cde4-4fa0-b44e-e575fa499d57 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:44:55 user nova-compute[71731]: DEBUG nova.compute.provider_tree [None req-7dbb1275-cde4-4fa0-b44e-e575fa499d57 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Inventory has not changed in ProviderTree for provider: cb6b1a64-0c24-4e2d-af1e-16576ca9165c {{(pid=71731) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 16:44:55 user nova-compute[71731]: DEBUG nova.scheduler.client.report [None req-7dbb1275-cde4-4fa0-b44e-e575fa499d57 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Inventory has not changed for provider cb6b1a64-0c24-4e2d-af1e-16576ca9165c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71731) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 16:44:55 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-7dbb1275-cde4-4fa0-b44e-e575fa499d57 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.255s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:44:55 user nova-compute[71731]: INFO nova.scheduler.client.report [None req-7dbb1275-cde4-4fa0-b44e-e575fa499d57 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Deleted allocations for instance 1f6a693f-0a99-434f-871d-f535b71229b9
Apr 13 16:44:55 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-7dbb1275-cde4-4fa0-b44e-e575fa499d57 tempest-AttachVolumeShelveTestJSON-1310775310 tempest-AttachVolumeShelveTestJSON-1310775310-project-member] Lock "1f6a693f-0a99-434f-871d-f535b71229b9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.799s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:44:56 user nova-compute[71731]: DEBUG nova.compute.manager [req-f80fe9a7-a385-49d5-8ad7-d3e3932ffe6c req-ef9703f8-dbd2-49e2-8ae5-5bf92ed85f9a service nova] [instance: 1f6a693f-0a99-434f-871d-f535b71229b9] Received event network-vif-plugged-103a0c68-ffc7-4460-836e-0de6c0272d84 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:44:56 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-f80fe9a7-a385-49d5-8ad7-d3e3932ffe6c req-ef9703f8-dbd2-49e2-8ae5-5bf92ed85f9a service nova] Acquiring lock "1f6a693f-0a99-434f-871d-f535b71229b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:44:56 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-f80fe9a7-a385-49d5-8ad7-d3e3932ffe6c req-ef9703f8-dbd2-49e2-8ae5-5bf92ed85f9a service nova] Lock "1f6a693f-0a99-434f-871d-f535b71229b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:44:56 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-f80fe9a7-a385-49d5-8ad7-d3e3932ffe6c req-ef9703f8-dbd2-49e2-8ae5-5bf92ed85f9a service nova] Lock "1f6a693f-0a99-434f-871d-f535b71229b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:44:56 user nova-compute[71731]: DEBUG nova.compute.manager [req-f80fe9a7-a385-49d5-8ad7-d3e3932ffe6c req-ef9703f8-dbd2-49e2-8ae5-5bf92ed85f9a service nova] [instance: 1f6a693f-0a99-434f-871d-f535b71229b9] No waiting events found dispatching network-vif-plugged-103a0c68-ffc7-4460-836e-0de6c0272d84 {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:44:56 user nova-compute[71731]: WARNING nova.compute.manager [req-f80fe9a7-a385-49d5-8ad7-d3e3932ffe6c req-ef9703f8-dbd2-49e2-8ae5-5bf92ed85f9a service nova] [instance: 1f6a693f-0a99-434f-871d-f535b71229b9] Received unexpected event network-vif-plugged-103a0c68-ffc7-4460-836e-0de6c0272d84 for instance with vm_state deleted and task_state None.
Apr 13 16:44:57 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:44:59 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:45:04 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 16:45:09 user nova-compute[71731]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681404294.2894075, 1f6a693f-0a99-434f-871d-f535b71229b9 => Stopped> {{(pid=71731) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 16:45:09 user nova-compute[71731]: INFO nova.compute.manager [-] [instance: 1f6a693f-0a99-434f-871d-f535b71229b9] VM Stopped (Lifecycle Event)
Apr 13 16:45:09 user nova-compute[71731]: DEBUG nova.compute.manager [None req-00317ee2-5f3b-423e-9e2e-4e36a6de47bd None None] [instance: 1f6a693f-0a99-434f-871d-f535b71229b9] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:45:09 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 16:45:14 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:45:19 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 16:45:23 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:45:24 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:45:26 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager.update_available_resource {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:45:26 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:45:26 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:45:26 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:45:26 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Auditing locally available compute resources for user (node: user) {{(pid=71731) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 16:45:26 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71731) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 16:45:26 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3af23ff8-4e10-4fbf-a86e-bda842f084ff/disk.rescue --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:45:26 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3af23ff8-4e10-4fbf-a86e-bda842f084ff/disk.rescue --force-share --output=json" returned: 0 in 0.145s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:45:26 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3af23ff8-4e10-4fbf-a86e-bda842f084ff/disk.rescue --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:45:26 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3af23ff8-4e10-4fbf-a86e-bda842f084ff/disk.rescue --force-share --output=json" returned: 0 in 0.136s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:45:26 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3af23ff8-4e10-4fbf-a86e-bda842f084ff/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:45:26 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3af23ff8-4e10-4fbf-a86e-bda842f084ff/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:45:26 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3af23ff8-4e10-4fbf-a86e-bda842f084ff/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:45:26 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3af23ff8-4e10-4fbf-a86e-bda842f084ff/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:45:26 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ed800fe-577d-4624-898c-c7f40da77376/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:45:26 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ed800fe-577d-4624-898c-c7f40da77376/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:45:26 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ed800fe-577d-4624-898c-c7f40da77376/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:45:27 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ed800fe-577d-4624-898c-c7f40da77376/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:45:27 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2d55cdd-c89c-4c59-afe1-49a33225af22/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:45:27 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2d55cdd-c89c-4c59-afe1-49a33225af22/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:45:27 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2d55cdd-c89c-4c59-afe1-49a33225af22/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:45:27 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2d55cdd-c89c-4c59-afe1-49a33225af22/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:45:27 user nova-compute[71731]: WARNING nova.virt.libvirt.driver [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 16:45:27 user nova-compute[71731]: WARNING nova.virt.libvirt.driver [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 16:45:27 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Hypervisor/Node resource view: name=user free_ram=8487MB free_disk=26.100967407226562GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71731) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 16:45:27 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:45:27 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:45:27 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance 5ed800fe-577d-4624-898c-c7f40da77376 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 16:45:27 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance b2d55cdd-c89c-4c59-afe1-49a33225af22 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 16:45:27 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance 3af23ff8-4e10-4fbf-a86e-bda842f084ff actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 16:45:27 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance 7ae7d3d9-54f7-4c64-8bf6-08fa5c526687 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 16:45:27 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=71731) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 16:45:27 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Final resource view: name=user phys_ram=16023MB used_ram=1088MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=71731) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 16:45:27 user nova-compute[71731]: DEBUG nova.compute.provider_tree [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Inventory has not changed in ProviderTree for provider: cb6b1a64-0c24-4e2d-af1e-16576ca9165c {{(pid=71731) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 16:45:28 user nova-compute[71731]: DEBUG nova.scheduler.client.report [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Inventory has not changed for provider cb6b1a64-0c24-4e2d-af1e-16576ca9165c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71731) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 16:45:28 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Compute_service record updated for user:user {{(pid=71731) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 16:45:28 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.305s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:45:29 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:45:29 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:45:29 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71731) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 16:45:29 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 16:45:29 user nova-compute[71731]: INFO nova.compute.manager [None req-0eb6f62e-7b2c-44bb-becb-778c91e6a51d tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: 7ae7d3d9-54f7-4c64-8bf6-08fa5c526687] Get console output
Apr 13 16:45:30 user nova-compute[71731]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Apr 13 16:45:31 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:45:31 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Starting heal instance info cache {{(pid=71731) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 16:45:31 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Acquiring lock "refresh_cache-3af23ff8-4e10-4fbf-a86e-bda842f084ff" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 16:45:31 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Acquired lock "refresh_cache-3af23ff8-4e10-4fbf-a86e-bda842f084ff" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 16:45:31 user nova-compute[71731]: DEBUG nova.network.neutron [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] [instance: 3af23ff8-4e10-4fbf-a86e-bda842f084ff] Forcefully refreshing network info cache for instance {{(pid=71731) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 16:45:31 user nova-compute[71731]: DEBUG nova.network.neutron [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] [instance: 3af23ff8-4e10-4fbf-a86e-bda842f084ff] Updating instance_info_cache with network_info: [{"id": "b22086e3-8769-494c-af86-228dba7b3638", "address": "fa:16:3e:84:ee:e5", "network": {"id": "2a5b69f1-fc5b-4c33-a9eb-12a4d9293500", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2137344591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "846732ecb7e047128b4684972d3cd8c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb22086e3-87", "ovs_interfaceid": "b22086e3-8769-494c-af86-228dba7b3638", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:45:31 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Releasing lock "refresh_cache-3af23ff8-4e10-4fbf-a86e-bda842f084ff" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 16:45:31 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] [instance: 3af23ff8-4e10-4fbf-a86e-bda842f084ff] Updated the network info_cache for instance {{(pid=71731) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 16:45:32 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:45:33 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:45:33 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:45:34 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:45:35 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:45:35 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:45:37 user nova-compute[71731]: INFO nova.compute.manager [None req-a845e1b9-93fa-4e9e-a2dd-0ef7c1bc9381 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] [instance: b2d55cdd-c89c-4c59-afe1-49a33225af22] Rescuing
Apr 13 16:45:37 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-a845e1b9-93fa-4e9e-a2dd-0ef7c1bc9381 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Acquiring lock "refresh_cache-b2d55cdd-c89c-4c59-afe1-49a33225af22" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 16:45:37 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-a845e1b9-93fa-4e9e-a2dd-0ef7c1bc9381 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Acquired lock "refresh_cache-b2d55cdd-c89c-4c59-afe1-49a33225af22" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 16:45:37 user nova-compute[71731]: DEBUG nova.network.neutron [None req-a845e1b9-93fa-4e9e-a2dd-0ef7c1bc9381 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] [instance: b2d55cdd-c89c-4c59-afe1-49a33225af22] Building network info cache for instance {{(pid=71731) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 16:45:37 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:45:37 user nova-compute[71731]: DEBUG nova.network.neutron [None req-a845e1b9-93fa-4e9e-a2dd-0ef7c1bc9381 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] [instance: b2d55cdd-c89c-4c59-afe1-49a33225af22] Updating instance_info_cache with network_info: [{"id": "31e1957f-9bd1-42ae-a2ac-954b49ca15f1", "address": "fa:16:3e:81:e2:10", "network": {"id": "2a5b69f1-fc5b-4c33-a9eb-12a4d9293500", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2137344591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "846732ecb7e047128b4684972d3cd8c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31e1957f-9b", "ovs_interfaceid": "31e1957f-9bd1-42ae-a2ac-954b49ca15f1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:45:37 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-a845e1b9-93fa-4e9e-a2dd-0ef7c1bc9381 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Releasing lock "refresh_cache-b2d55cdd-c89c-4c59-afe1-49a33225af22" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 16:45:37 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:45:37 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:45:37 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:45:38 user nova-compute[71731]: DEBUG nova.compute.manager [req-fa0fa526-2007-4d1d-9971-b541d28c16dc req-aceeeb52-4080-4474-b937-4508173216c9 service nova] [instance: b2d55cdd-c89c-4c59-afe1-49a33225af22] Received event network-vif-unplugged-31e1957f-9bd1-42ae-a2ac-954b49ca15f1 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:45:38 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-fa0fa526-2007-4d1d-9971-b541d28c16dc req-aceeeb52-4080-4474-b937-4508173216c9 service nova] Acquiring lock "b2d55cdd-c89c-4c59-afe1-49a33225af22-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:45:38 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-fa0fa526-2007-4d1d-9971-b541d28c16dc req-aceeeb52-4080-4474-b937-4508173216c9 service nova] Lock "b2d55cdd-c89c-4c59-afe1-49a33225af22-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:45:38 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-fa0fa526-2007-4d1d-9971-b541d28c16dc req-aceeeb52-4080-4474-b937-4508173216c9 service nova] Lock "b2d55cdd-c89c-4c59-afe1-49a33225af22-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:45:38 user nova-compute[71731]: DEBUG nova.compute.manager [req-fa0fa526-2007-4d1d-9971-b541d28c16dc req-aceeeb52-4080-4474-b937-4508173216c9 service nova] [instance: b2d55cdd-c89c-4c59-afe1-49a33225af22] No waiting events found dispatching network-vif-unplugged-31e1957f-9bd1-42ae-a2ac-954b49ca15f1 {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:45:38 user nova-compute[71731]: WARNING nova.compute.manager [req-fa0fa526-2007-4d1d-9971-b541d28c16dc req-aceeeb52-4080-4474-b937-4508173216c9 service nova] [instance: b2d55cdd-c89c-4c59-afe1-49a33225af22] Received unexpected event network-vif-unplugged-31e1957f-9bd1-42ae-a2ac-954b49ca15f1 for instance with vm_state active and task_state rescuing.
Apr 13 16:45:38 user nova-compute[71731]: INFO nova.virt.libvirt.driver [-] [instance: b2d55cdd-c89c-4c59-afe1-49a33225af22] Instance destroyed successfully.
Apr 13 16:45:38 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-a845e1b9-93fa-4e9e-a2dd-0ef7c1bc9381 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] [instance: b2d55cdd-c89c-4c59-afe1-49a33225af22] Attempting rescue
Apr 13 16:45:38 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-a845e1b9-93fa-4e9e-a2dd-0ef7c1bc9381 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=71731) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4289}}
Apr 13 16:45:38 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-a845e1b9-93fa-4e9e-a2dd-0ef7c1bc9381 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] [instance: b2d55cdd-c89c-4c59-afe1-49a33225af22] Instance directory exists: not creating {{(pid=71731) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 13 16:45:38 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-a845e1b9-93fa-4e9e-a2dd-0ef7c1bc9381 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] [instance: b2d55cdd-c89c-4c59-afe1-49a33225af22] Creating image(s)
Apr 13 16:45:38 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-a845e1b9-93fa-4e9e-a2dd-0ef7c1bc9381 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Acquiring lock "/opt/stack/data/nova/instances/b2d55cdd-c89c-4c59-afe1-49a33225af22/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:45:38 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-a845e1b9-93fa-4e9e-a2dd-0ef7c1bc9381 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lock "/opt/stack/data/nova/instances/b2d55cdd-c89c-4c59-afe1-49a33225af22/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:45:38 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-a845e1b9-93fa-4e9e-a2dd-0ef7c1bc9381 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lock "/opt/stack/data/nova/instances/b2d55cdd-c89c-4c59-afe1-49a33225af22/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:45:38 user nova-compute[71731]: DEBUG nova.objects.instance [None req-a845e1b9-93fa-4e9e-a2dd-0ef7c1bc9381 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lazy-loading 'trusted_certs' on Instance uuid b2d55cdd-c89c-4c59-afe1-49a33225af22 {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:45:38 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-a845e1b9-93fa-4e9e-a2dd-0ef7c1bc9381 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Acquiring lock "9524227dd898575c3099d3976f096cd935414279" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:45:38 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-a845e1b9-93fa-4e9e-a2dd-0ef7c1bc9381 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lock "9524227dd898575c3099d3976f096cd935414279" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:45:38 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-a845e1b9-93fa-4e9e-a2dd-0ef7c1bc9381 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279 --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:45:38 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-a845e1b9-93fa-4e9e-a2dd-0ef7c1bc9381 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279 --force-share --output=json" returned: 0 in 0.134s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:45:38 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-a845e1b9-93fa-4e9e-a2dd-0ef7c1bc9381 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279,backing_fmt=raw /opt/stack/data/nova/instances/b2d55cdd-c89c-4c59-afe1-49a33225af22/disk.rescue {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:45:38 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-a845e1b9-93fa-4e9e-a2dd-0ef7c1bc9381 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279,backing_fmt=raw /opt/stack/data/nova/instances/b2d55cdd-c89c-4c59-afe1-49a33225af22/disk.rescue" returned: 0 in 0.082s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:45:38 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-a845e1b9-93fa-4e9e-a2dd-0ef7c1bc9381 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lock "9524227dd898575c3099d3976f096cd935414279" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.226s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:45:38 user nova-compute[71731]: DEBUG nova.objects.instance [None req-a845e1b9-93fa-4e9e-a2dd-0ef7c1bc9381 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lazy-loading 'migration_context' on Instance uuid b2d55cdd-c89c-4c59-afe1-49a33225af22 {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:45:38 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-a845e1b9-93fa-4e9e-a2dd-0ef7c1bc9381 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] [instance: b2d55cdd-c89c-4c59-afe1-49a33225af22] Created local disks {{(pid=71731) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 16:45:38 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-a845e1b9-93fa-4e9e-a2dd-0ef7c1bc9381 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] [instance: b2d55cdd-c89c-4c59-afe1-49a33225af22] Start _get_guest_xml network_info=[{"id": "31e1957f-9bd1-42ae-a2ac-954b49ca15f1", "address": "fa:16:3e:81:e2:10", "network": {"id": "2a5b69f1-fc5b-4c33-a9eb-12a4d9293500", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2137344591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-2137344591-network", "vif_mac": "fa:16:3e:81:e2:10"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "846732ecb7e047128b4684972d3cd8c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31e1957f-9b", "ovs_interfaceid": "31e1957f-9bd1-42ae-a2ac-954b49ca15f1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T16:16:31Z,direct_url=<?>,disk_format='qcow2',id=708622a9-7465-4492-ade8-b827198f7e30,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='0b29a975c552465aba0ac7d6288434bd',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T16:16:33Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '708622a9-7465-4492-ade8-b827198f7e30', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=71731) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 16:45:38 user nova-compute[71731]: DEBUG nova.objects.instance [None req-a845e1b9-93fa-4e9e-a2dd-0ef7c1bc9381 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lazy-loading 'resources' on Instance uuid b2d55cdd-c89c-4c59-afe1-49a33225af22 {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:45:38 user nova-compute[71731]: DEBUG nova.objects.instance [None req-a845e1b9-93fa-4e9e-a2dd-0ef7c1bc9381 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lazy-loading 'numa_topology' on Instance uuid b2d55cdd-c89c-4c59-afe1-49a33225af22 {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:45:38 user nova-compute[71731]: WARNING nova.virt.libvirt.driver [None req-a845e1b9-93fa-4e9e-a2dd-0ef7c1bc9381 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 16:45:38 user nova-compute[71731]: WARNING nova.virt.libvirt.driver [None req-a845e1b9-93fa-4e9e-a2dd-0ef7c1bc9381 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 16:45:38 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-a845e1b9-93fa-4e9e-a2dd-0ef7c1bc9381 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71731) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 16:45:38 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-a845e1b9-93fa-4e9e-a2dd-0ef7c1bc9381 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T16:17:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T16:16:31Z,direct_url=<?>,disk_format='qcow2',id=708622a9-7465-4492-ade8-b827198f7e30,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='0b29a975c552465aba0ac7d6288434bd',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T16:16:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 16:45:38 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-a845e1b9-93fa-4e9e-a2dd-0ef7c1bc9381 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Flavor limits 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 16:45:38 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-a845e1b9-93fa-4e9e-a2dd-0ef7c1bc9381 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Image limits 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 16:45:38 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-a845e1b9-93fa-4e9e-a2dd-0ef7c1bc9381 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Flavor pref 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 16:45:38 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-a845e1b9-93fa-4e9e-a2dd-0ef7c1bc9381 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Image pref 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 16:45:38 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-a845e1b9-93fa-4e9e-a2dd-0ef7c1bc9381 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 16:45:38 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-a845e1b9-93fa-4e9e-a2dd-0ef7c1bc9381 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 16:45:38 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-a845e1b9-93fa-4e9e-a2dd-0ef7c1bc9381 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71731) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 16:45:38 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-a845e1b9-93fa-4e9e-a2dd-0ef7c1bc9381 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Got 1 possible topologies {{(pid=71731) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 16:45:38 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-a845e1b9-93fa-4e9e-a2dd-0ef7c1bc9381 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 16:45:38 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-a845e1b9-93fa-4e9e-a2dd-0ef7c1bc9381 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 16:45:38 user nova-compute[71731]: DEBUG nova.objects.instance [None req-a845e1b9-93fa-4e9e-a2dd-0ef7c1bc9381 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lazy-loading 'vcpu_model' on Instance uuid b2d55cdd-c89c-4c59-afe1-49a33225af22 {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:45:38 user nova-compute[71731]: DEBUG nova.virt.libvirt.vif [None req-a845e1b9-93fa-4e9e-a2dd-0ef7c1bc9381 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T16:40:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-862659387',display_name='tempest-ServerRescueNegativeTestJSON-server-862659387',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-862659387',id=36,image_ref='708622a9-7465-4492-ade8-b827198f7e30',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-13T16:41:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='846732ecb7e047128b4684972d3cd8c6',ramdisk_id='',reservation_id='r-6w8n5dk1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='708622a9-7465-4492-ade8-b827198f7e30',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-84287455',owner_user_name='tempest-ServerRescueNegativeTestJSON-84287455-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T16:41:02Z,user_data=None,user_id='0c7f54723c494e05ada117353c0790cb',uuid=b2d55cdd-c89c-4c59-afe1-49a33225af22,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "31e1957f-9bd1-42ae-a2ac-954b49ca15f1", "address": "fa:16:3e:81:e2:10", "network": {"id": "2a5b69f1-fc5b-4c33-a9eb-12a4d9293500", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2137344591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-2137344591-network", "vif_mac": "fa:16:3e:81:e2:10"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "846732ecb7e047128b4684972d3cd8c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31e1957f-9b", "ovs_interfaceid": "31e1957f-9bd1-42ae-a2ac-954b49ca15f1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71731) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 16:45:38 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-a845e1b9-93fa-4e9e-a2dd-0ef7c1bc9381 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Converting VIF {"id": "31e1957f-9bd1-42ae-a2ac-954b49ca15f1", "address": "fa:16:3e:81:e2:10", "network": {"id": "2a5b69f1-fc5b-4c33-a9eb-12a4d9293500", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2137344591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-2137344591-network", "vif_mac": "fa:16:3e:81:e2:10"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "846732ecb7e047128b4684972d3cd8c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31e1957f-9b", "ovs_interfaceid": "31e1957f-9bd1-42ae-a2ac-954b49ca15f1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 16:45:38 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-a845e1b9-93fa-4e9e-a2dd-0ef7c1bc9381 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:81:e2:10,bridge_name='br-int',has_traffic_filtering=True,id=31e1957f-9bd1-42ae-a2ac-954b49ca15f1,network=Network(2a5b69f1-fc5b-4c33-a9eb-12a4d9293500),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31e1957f-9b') {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 16:45:38 user nova-compute[71731]: DEBUG nova.objects.instance [None req-a845e1b9-93fa-4e9e-a2dd-0ef7c1bc9381 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lazy-loading 'pci_devices' on Instance uuid b2d55cdd-c89c-4c59-afe1-49a33225af22 {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:45:38 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-a845e1b9-93fa-4e9e-a2dd-0ef7c1bc9381 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] [instance: b2d55cdd-c89c-4c59-afe1-49a33225af22] End _get_guest_xml xml=<domain type="kvm">
Apr 13 16:45:38 user nova-compute[71731]:   <uuid>b2d55cdd-c89c-4c59-afe1-49a33225af22</uuid>
Apr 13 16:45:38 user nova-compute[71731]:   <name>instance-00000024</name>
Apr 13 16:45:38 user nova-compute[71731]:   <memory>131072</memory>
Apr 13 16:45:38 user nova-compute[71731]:   <vcpu>1</vcpu>
Apr 13 16:45:38 user nova-compute[71731]:   <metadata>
Apr 13 16:45:38 user nova-compute[71731]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 16:45:38 user nova-compute[71731]:       <nova:package version="0.0.0"/>
Apr 13 16:45:38 user nova-compute[71731]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-862659387</nova:name>
Apr 13 16:45:38 user nova-compute[71731]:       <nova:creationTime>2023-04-13 16:45:38</nova:creationTime>
Apr 13 16:45:38 user nova-compute[71731]:       <nova:flavor name="m1.nano">
Apr 13 16:45:38 user nova-compute[71731]:         <nova:memory>128</nova:memory>
Apr 13 16:45:38 user nova-compute[71731]:         <nova:disk>1</nova:disk>
Apr 13 16:45:38 user nova-compute[71731]:         <nova:swap>0</nova:swap>
Apr 13 16:45:38 user nova-compute[71731]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 16:45:38 user nova-compute[71731]:         <nova:vcpus>1</nova:vcpus>
Apr 13 16:45:38 user nova-compute[71731]:       </nova:flavor>
Apr 13 16:45:38 user nova-compute[71731]:       <nova:owner>
Apr 13 16:45:38 user nova-compute[71731]:         <nova:user uuid="0c7f54723c494e05ada117353c0790cb">tempest-ServerRescueNegativeTestJSON-84287455-project-member</nova:user>
Apr 13 16:45:38 user nova-compute[71731]:         <nova:project uuid="846732ecb7e047128b4684972d3cd8c6">tempest-ServerRescueNegativeTestJSON-84287455</nova:project>
Apr 13 16:45:38 user nova-compute[71731]:       </nova:owner>
Apr 13 16:45:38 user nova-compute[71731]:       <nova:root type="image" uuid="708622a9-7465-4492-ade8-b827198f7e30"/>
Apr 13 16:45:38 user nova-compute[71731]:       <nova:ports>
Apr 13 16:45:38 user nova-compute[71731]:         <nova:port uuid="31e1957f-9bd1-42ae-a2ac-954b49ca15f1">
Apr 13 16:45:38 user nova-compute[71731]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Apr 13 16:45:38 user nova-compute[71731]:         </nova:port>
Apr 13 16:45:38 user nova-compute[71731]:       </nova:ports>
Apr 13 16:45:38 user nova-compute[71731]:     </nova:instance>
Apr 13 16:45:38 user nova-compute[71731]:   </metadata>
Apr 13 16:45:38 user nova-compute[71731]:   <sysinfo type="smbios">
Apr 13 16:45:38 user nova-compute[71731]:     <system>
Apr 13 16:45:38 user nova-compute[71731]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 16:45:38 user nova-compute[71731]:       <entry name="product">OpenStack Nova</entry>
Apr 13 16:45:38 user nova-compute[71731]:       <entry name="version">0.0.0</entry>
Apr 13 16:45:38 user nova-compute[71731]:       <entry name="serial">b2d55cdd-c89c-4c59-afe1-49a33225af22</entry>
Apr 13 16:45:38 user nova-compute[71731]:       <entry name="uuid">b2d55cdd-c89c-4c59-afe1-49a33225af22</entry>
Apr 13 16:45:38 user nova-compute[71731]:       <entry name="family">Virtual Machine</entry>
Apr 13 16:45:38 user nova-compute[71731]:     </system>
Apr 13 16:45:38 user nova-compute[71731]:   </sysinfo>
Apr 13 16:45:38 user nova-compute[71731]:   <os>
Apr 13 16:45:38 user nova-compute[71731]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 16:45:38 user nova-compute[71731]:     <smbios mode="sysinfo"/>
Apr 13 16:45:38 user nova-compute[71731]:   </os>
Apr 13 16:45:38 user nova-compute[71731]:   <features>
Apr 13 16:45:38 user nova-compute[71731]:     <acpi/>
Apr 13 16:45:38 user nova-compute[71731]:     <apic/>
Apr 13 16:45:38 user nova-compute[71731]:     <vmcoreinfo/>
Apr 13 16:45:38 user nova-compute[71731]:   </features>
Apr 13 16:45:38 user nova-compute[71731]:   <clock offset="utc">
Apr 13 16:45:38 user nova-compute[71731]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 16:45:38 user nova-compute[71731]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 16:45:38 user nova-compute[71731]:     <timer name="hpet" present="no"/>
Apr 13 16:45:38 user nova-compute[71731]:   </clock>
Apr 13 16:45:38 user nova-compute[71731]:   <cpu mode="custom" match="exact">
Apr 13 16:45:38 user nova-compute[71731]:     <model>Nehalem</model>
Apr 13 16:45:38 user nova-compute[71731]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 16:45:38 user nova-compute[71731]:   </cpu>
Apr 13 16:45:38 user nova-compute[71731]:   <devices>
Apr 13 16:45:38 user nova-compute[71731]:     <disk type="file" device="disk">
Apr 13 16:45:38 user nova-compute[71731]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 16:45:38 user nova-compute[71731]:       <source file="/opt/stack/data/nova/instances/b2d55cdd-c89c-4c59-afe1-49a33225af22/disk.rescue"/>
Apr 13 16:45:38 user nova-compute[71731]:       <target dev="vda" bus="virtio"/>
Apr 13 16:45:38 user nova-compute[71731]:     </disk>
Apr 13 16:45:38 user nova-compute[71731]:     <disk type="file" device="disk">
Apr 13 16:45:38 user nova-compute[71731]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 16:45:38 user nova-compute[71731]:       <source file="/opt/stack/data/nova/instances/b2d55cdd-c89c-4c59-afe1-49a33225af22/disk"/>
Apr 13 16:45:38 user nova-compute[71731]:       <target dev="vdb" bus="virtio"/>
Apr 13 16:45:38 user nova-compute[71731]:     </disk>
Apr 13 16:45:38 user nova-compute[71731]:     <interface type="ethernet">
Apr 13 16:45:38 user nova-compute[71731]:       <mac address="fa:16:3e:81:e2:10"/>
Apr 13 16:45:38 user nova-compute[71731]:       <model type="virtio"/>
Apr 13 16:45:38 user nova-compute[71731]:       <mtu size="1442"/>
Apr 13 16:45:38 user nova-compute[71731]:       <target dev="tap31e1957f-9b"/>
Apr 13 16:45:38 user nova-compute[71731]:     </interface>
Apr 13 16:45:38 user nova-compute[71731]:     <serial type="pty">
Apr 13 16:45:38 user nova-compute[71731]:       <log file="/opt/stack/data/nova/instances/b2d55cdd-c89c-4c59-afe1-49a33225af22/console.log" append="off"/>
Apr 13 16:45:38 user nova-compute[71731]:     </serial>
Apr 13 16:45:38 user nova-compute[71731]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 16:45:38 user nova-compute[71731]:     <video>
Apr 13 16:45:38 user nova-compute[71731]:       <model type="virtio"/>
Apr 13 16:45:38 user nova-compute[71731]:     </video>
Apr 13 16:45:38 user nova-compute[71731]:     <rng model="virtio">
Apr 13 16:45:38 user nova-compute[71731]:       <backend model="random">/dev/urandom</backend>
Apr 13 16:45:38 user nova-compute[71731]:     </rng>
Apr 13 16:45:38 user nova-compute[71731]:     <controller type="usb" index="0" model="none"/>
Apr 13 16:45:38 user nova-compute[71731]:     <memballoon model="virtio">
Apr 13 16:45:38 user nova-compute[71731]:       <stats period="10"/>
Apr 13 16:45:38 user nova-compute[71731]:     </memballoon>
Apr 13 16:45:38 user nova-compute[71731]:   </devices>
Apr 13 16:45:38 user nova-compute[71731]: </domain>
Apr 13 16:45:38 user nova-compute[71731]:  {{(pid=71731) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 16:45:38 user nova-compute[71731]: INFO nova.virt.libvirt.driver [-] [instance: b2d55cdd-c89c-4c59-afe1-49a33225af22] Instance destroyed successfully.
Apr 13 16:45:38 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-a845e1b9-93fa-4e9e-a2dd-0ef7c1bc9381 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] No BDM found with device name vda, not building metadata. {{(pid=71731) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 16:45:38 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-a845e1b9-93fa-4e9e-a2dd-0ef7c1bc9381 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71731) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 16:45:38 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-a845e1b9-93fa-4e9e-a2dd-0ef7c1bc9381 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] No VIF found with MAC fa:16:3e:81:e2:10, not building metadata {{(pid=71731) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 16:45:39 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:45:39 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:45:39 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:45:39 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:45:40 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:45:40 user nova-compute[71731]: DEBUG nova.compute.manager [req-762ec402-0720-4cc5-8448-bcec934e3007 req-6e615e31-1f46-49ae-a05d-2d15ca76947d service nova] [instance: b2d55cdd-c89c-4c59-afe1-49a33225af22] Received event network-vif-plugged-31e1957f-9bd1-42ae-a2ac-954b49ca15f1 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:45:40 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-762ec402-0720-4cc5-8448-bcec934e3007 req-6e615e31-1f46-49ae-a05d-2d15ca76947d service nova] Acquiring lock "b2d55cdd-c89c-4c59-afe1-49a33225af22-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:45:40 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-762ec402-0720-4cc5-8448-bcec934e3007 req-6e615e31-1f46-49ae-a05d-2d15ca76947d service nova] Lock "b2d55cdd-c89c-4c59-afe1-49a33225af22-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:45:40 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-762ec402-0720-4cc5-8448-bcec934e3007 req-6e615e31-1f46-49ae-a05d-2d15ca76947d service nova] Lock "b2d55cdd-c89c-4c59-afe1-49a33225af22-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:45:40 user nova-compute[71731]: DEBUG nova.compute.manager [req-762ec402-0720-4cc5-8448-bcec934e3007 req-6e615e31-1f46-49ae-a05d-2d15ca76947d service nova] [instance: b2d55cdd-c89c-4c59-afe1-49a33225af22] No waiting events found dispatching network-vif-plugged-31e1957f-9bd1-42ae-a2ac-954b49ca15f1 {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:45:40 user nova-compute[71731]: WARNING nova.compute.manager [req-762ec402-0720-4cc5-8448-bcec934e3007 req-6e615e31-1f46-49ae-a05d-2d15ca76947d service nova] [instance: b2d55cdd-c89c-4c59-afe1-49a33225af22] Received unexpected event network-vif-plugged-31e1957f-9bd1-42ae-a2ac-954b49ca15f1 for instance with vm_state active and task_state rescuing.
Apr 13 16:45:40 user nova-compute[71731]: DEBUG nova.compute.manager [req-762ec402-0720-4cc5-8448-bcec934e3007 req-6e615e31-1f46-49ae-a05d-2d15ca76947d service nova] [instance: b2d55cdd-c89c-4c59-afe1-49a33225af22] Received event network-vif-plugged-31e1957f-9bd1-42ae-a2ac-954b49ca15f1 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:45:40 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-762ec402-0720-4cc5-8448-bcec934e3007 req-6e615e31-1f46-49ae-a05d-2d15ca76947d service nova] Acquiring lock "b2d55cdd-c89c-4c59-afe1-49a33225af22-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:45:40 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-762ec402-0720-4cc5-8448-bcec934e3007 req-6e615e31-1f46-49ae-a05d-2d15ca76947d service nova] Lock "b2d55cdd-c89c-4c59-afe1-49a33225af22-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:45:40 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-762ec402-0720-4cc5-8448-bcec934e3007 req-6e615e31-1f46-49ae-a05d-2d15ca76947d service nova] Lock "b2d55cdd-c89c-4c59-afe1-49a33225af22-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:45:40 user nova-compute[71731]: DEBUG nova.compute.manager [req-762ec402-0720-4cc5-8448-bcec934e3007 req-6e615e31-1f46-49ae-a05d-2d15ca76947d service nova] [instance: b2d55cdd-c89c-4c59-afe1-49a33225af22] No waiting events found dispatching network-vif-plugged-31e1957f-9bd1-42ae-a2ac-954b49ca15f1 {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:45:40 user nova-compute[71731]: WARNING nova.compute.manager [req-762ec402-0720-4cc5-8448-bcec934e3007 req-6e615e31-1f46-49ae-a05d-2d15ca76947d service nova] [instance: b2d55cdd-c89c-4c59-afe1-49a33225af22] Received unexpected event network-vif-plugged-31e1957f-9bd1-42ae-a2ac-954b49ca15f1 for instance with vm_state active and task_state rescuing.
Apr 13 16:45:42 user nova-compute[71731]: DEBUG nova.virt.libvirt.host [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Removed pending event for b2d55cdd-c89c-4c59-afe1-49a33225af22 due to event {{(pid=71731) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 13 16:45:42 user nova-compute[71731]: DEBUG nova.virt.driver [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Emitting event <LifecycleEvent: 1681404342.0415587, b2d55cdd-c89c-4c59-afe1-49a33225af22 => Resumed> {{(pid=71731) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 16:45:42 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: b2d55cdd-c89c-4c59-afe1-49a33225af22] VM Resumed (Lifecycle Event)
Apr 13 16:45:42 user nova-compute[71731]: DEBUG nova.compute.manager [None req-a845e1b9-93fa-4e9e-a2dd-0ef7c1bc9381 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] [instance: b2d55cdd-c89c-4c59-afe1-49a33225af22] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:45:42 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: b2d55cdd-c89c-4c59-afe1-49a33225af22] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:45:42 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: b2d55cdd-c89c-4c59-afe1-49a33225af22] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71731) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 16:45:42 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: b2d55cdd-c89c-4c59-afe1-49a33225af22] During sync_power_state the instance has a pending task (rescuing). Skip.
Apr 13 16:45:42 user nova-compute[71731]: DEBUG nova.virt.driver [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Emitting event <LifecycleEvent: 1681404342.0428505, b2d55cdd-c89c-4c59-afe1-49a33225af22 => Started> {{(pid=71731) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 16:45:42 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: b2d55cdd-c89c-4c59-afe1-49a33225af22] VM Started (Lifecycle Event)
Apr 13 16:45:42 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: b2d55cdd-c89c-4c59-afe1-49a33225af22] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:45:42 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: b2d55cdd-c89c-4c59-afe1-49a33225af22] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71731) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 16:45:42 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:45:42 user nova-compute[71731]: DEBUG nova.compute.manager [req-8ac6dffe-068c-4405-969d-bbd559d96f21 req-288ee0c1-87a1-48ac-8bdd-e397b00aaa2f service nova] [instance: b2d55cdd-c89c-4c59-afe1-49a33225af22] Received event network-vif-plugged-31e1957f-9bd1-42ae-a2ac-954b49ca15f1 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:45:42 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-8ac6dffe-068c-4405-969d-bbd559d96f21 req-288ee0c1-87a1-48ac-8bdd-e397b00aaa2f service nova] Acquiring lock "b2d55cdd-c89c-4c59-afe1-49a33225af22-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:45:42 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-8ac6dffe-068c-4405-969d-bbd559d96f21 req-288ee0c1-87a1-48ac-8bdd-e397b00aaa2f service nova] Lock "b2d55cdd-c89c-4c59-afe1-49a33225af22-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:45:42 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-8ac6dffe-068c-4405-969d-bbd559d96f21 req-288ee0c1-87a1-48ac-8bdd-e397b00aaa2f service nova] Lock "b2d55cdd-c89c-4c59-afe1-49a33225af22-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:45:42 user nova-compute[71731]: DEBUG nova.compute.manager [req-8ac6dffe-068c-4405-969d-bbd559d96f21 req-288ee0c1-87a1-48ac-8bdd-e397b00aaa2f service nova] [instance: b2d55cdd-c89c-4c59-afe1-49a33225af22] No waiting events found dispatching network-vif-plugged-31e1957f-9bd1-42ae-a2ac-954b49ca15f1 {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:45:42 user nova-compute[71731]: WARNING nova.compute.manager [req-8ac6dffe-068c-4405-969d-bbd559d96f21 req-288ee0c1-87a1-48ac-8bdd-e397b00aaa2f service nova] [instance: b2d55cdd-c89c-4c59-afe1-49a33225af22] Received unexpected event network-vif-plugged-31e1957f-9bd1-42ae-a2ac-954b49ca15f1 for instance with vm_state rescued and task_state None.
Apr 13 16:45:44 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:45:44 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:45:49 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:45:51 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:45:54 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:45:57 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:45:59 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:46:02 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:46:04 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:46:07 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:46:09 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:46:10 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-435c7bd8-4e7b-4a66-b456-66a245bc1703 tempest-VolumesActionsTest-150031261 tempest-VolumesActionsTest-150031261-project-member] Acquiring lock "6e4776e8-d528-4110-90a3-daf4d1df0171" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:46:10 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-435c7bd8-4e7b-4a66-b456-66a245bc1703 tempest-VolumesActionsTest-150031261 tempest-VolumesActionsTest-150031261-project-member] Lock "6e4776e8-d528-4110-90a3-daf4d1df0171" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:46:10 user nova-compute[71731]: DEBUG nova.compute.manager [None req-435c7bd8-4e7b-4a66-b456-66a245bc1703 tempest-VolumesActionsTest-150031261 tempest-VolumesActionsTest-150031261-project-member] [instance: 6e4776e8-d528-4110-90a3-daf4d1df0171] Starting instance... {{(pid=71731) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 16:46:10 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-435c7bd8-4e7b-4a66-b456-66a245bc1703 tempest-VolumesActionsTest-150031261 tempest-VolumesActionsTest-150031261-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:46:10 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-435c7bd8-4e7b-4a66-b456-66a245bc1703 tempest-VolumesActionsTest-150031261 tempest-VolumesActionsTest-150031261-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:46:10 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-435c7bd8-4e7b-4a66-b456-66a245bc1703 tempest-VolumesActionsTest-150031261 tempest-VolumesActionsTest-150031261-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71731) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 16:46:10 user nova-compute[71731]: INFO nova.compute.claims [None req-435c7bd8-4e7b-4a66-b456-66a245bc1703 tempest-VolumesActionsTest-150031261 tempest-VolumesActionsTest-150031261-project-member] [instance: 6e4776e8-d528-4110-90a3-daf4d1df0171] Claim successful on node user
Apr 13 16:46:10 user nova-compute[71731]: DEBUG nova.compute.provider_tree [None req-435c7bd8-4e7b-4a66-b456-66a245bc1703 tempest-VolumesActionsTest-150031261 tempest-VolumesActionsTest-150031261-project-member] Inventory has not changed in ProviderTree for provider: cb6b1a64-0c24-4e2d-af1e-16576ca9165c {{(pid=71731) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 16:46:10 user nova-compute[71731]: DEBUG nova.scheduler.client.report [None req-435c7bd8-4e7b-4a66-b456-66a245bc1703 tempest-VolumesActionsTest-150031261 tempest-VolumesActionsTest-150031261-project-member] Inventory has not changed for provider cb6b1a64-0c24-4e2d-af1e-16576ca9165c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71731) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 16:46:10 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-435c7bd8-4e7b-4a66-b456-66a245bc1703 tempest-VolumesActionsTest-150031261 tempest-VolumesActionsTest-150031261-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.279s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:46:10 user nova-compute[71731]: DEBUG nova.compute.manager [None req-435c7bd8-4e7b-4a66-b456-66a245bc1703 tempest-VolumesActionsTest-150031261 tempest-VolumesActionsTest-150031261-project-member] [instance: 6e4776e8-d528-4110-90a3-daf4d1df0171] Start building networks asynchronously for instance. {{(pid=71731) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 16:46:10 user nova-compute[71731]: DEBUG nova.compute.manager [None req-435c7bd8-4e7b-4a66-b456-66a245bc1703 tempest-VolumesActionsTest-150031261 tempest-VolumesActionsTest-150031261-project-member] [instance: 6e4776e8-d528-4110-90a3-daf4d1df0171] Allocating IP information in the background. {{(pid=71731) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 16:46:10 user nova-compute[71731]: DEBUG nova.network.neutron [None req-435c7bd8-4e7b-4a66-b456-66a245bc1703 tempest-VolumesActionsTest-150031261 tempest-VolumesActionsTest-150031261-project-member] [instance: 6e4776e8-d528-4110-90a3-daf4d1df0171] allocate_for_instance() {{(pid=71731) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 16:46:10 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-435c7bd8-4e7b-4a66-b456-66a245bc1703 tempest-VolumesActionsTest-150031261 tempest-VolumesActionsTest-150031261-project-member] [instance: 6e4776e8-d528-4110-90a3-daf4d1df0171] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 16:46:10 user nova-compute[71731]: DEBUG nova.compute.manager [None req-435c7bd8-4e7b-4a66-b456-66a245bc1703 tempest-VolumesActionsTest-150031261 tempest-VolumesActionsTest-150031261-project-member] [instance: 6e4776e8-d528-4110-90a3-daf4d1df0171] Start building block device mappings for instance. {{(pid=71731) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 16:46:10 user nova-compute[71731]: DEBUG nova.compute.manager [None req-435c7bd8-4e7b-4a66-b456-66a245bc1703 tempest-VolumesActionsTest-150031261 tempest-VolumesActionsTest-150031261-project-member] [instance: 6e4776e8-d528-4110-90a3-daf4d1df0171] Start spawning the instance on the hypervisor. {{(pid=71731) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 16:46:10 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-435c7bd8-4e7b-4a66-b456-66a245bc1703 tempest-VolumesActionsTest-150031261 tempest-VolumesActionsTest-150031261-project-member] [instance: 6e4776e8-d528-4110-90a3-daf4d1df0171] Creating instance directory {{(pid=71731) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 16:46:10 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-435c7bd8-4e7b-4a66-b456-66a245bc1703 tempest-VolumesActionsTest-150031261 tempest-VolumesActionsTest-150031261-project-member] [instance: 6e4776e8-d528-4110-90a3-daf4d1df0171] Creating image(s)
Apr 13 16:46:10 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-435c7bd8-4e7b-4a66-b456-66a245bc1703 tempest-VolumesActionsTest-150031261 tempest-VolumesActionsTest-150031261-project-member] Acquiring lock "/opt/stack/data/nova/instances/6e4776e8-d528-4110-90a3-daf4d1df0171/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:46:10 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-435c7bd8-4e7b-4a66-b456-66a245bc1703 tempest-VolumesActionsTest-150031261 tempest-VolumesActionsTest-150031261-project-member] Lock "/opt/stack/data/nova/instances/6e4776e8-d528-4110-90a3-daf4d1df0171/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:46:10 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-435c7bd8-4e7b-4a66-b456-66a245bc1703 tempest-VolumesActionsTest-150031261 tempest-VolumesActionsTest-150031261-project-member] Lock "/opt/stack/data/nova/instances/6e4776e8-d528-4110-90a3-daf4d1df0171/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:46:10 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-435c7bd8-4e7b-4a66-b456-66a245bc1703 tempest-VolumesActionsTest-150031261 tempest-VolumesActionsTest-150031261-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279 --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:46:11 user nova-compute[71731]: DEBUG nova.policy [None req-435c7bd8-4e7b-4a66-b456-66a245bc1703 tempest-VolumesActionsTest-150031261 tempest-VolumesActionsTest-150031261-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '623668858bee4d308f31f4facd600fb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0bb7653df574769941cf284c6a63154', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71731) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 16:46:11 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-435c7bd8-4e7b-4a66-b456-66a245bc1703 tempest-VolumesActionsTest-150031261 tempest-VolumesActionsTest-150031261-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279 --force-share --output=json" returned: 0 in 0.139s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:46:11 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-435c7bd8-4e7b-4a66-b456-66a245bc1703 tempest-VolumesActionsTest-150031261 tempest-VolumesActionsTest-150031261-project-member] Acquiring lock "9524227dd898575c3099d3976f096cd935414279" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:46:11 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-435c7bd8-4e7b-4a66-b456-66a245bc1703 tempest-VolumesActionsTest-150031261 tempest-VolumesActionsTest-150031261-project-member] Lock "9524227dd898575c3099d3976f096cd935414279" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:46:11 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-435c7bd8-4e7b-4a66-b456-66a245bc1703 tempest-VolumesActionsTest-150031261 tempest-VolumesActionsTest-150031261-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279 --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:46:11 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-435c7bd8-4e7b-4a66-b456-66a245bc1703 tempest-VolumesActionsTest-150031261 tempest-VolumesActionsTest-150031261-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279 --force-share --output=json" returned: 0 in 0.148s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:46:11 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-435c7bd8-4e7b-4a66-b456-66a245bc1703 tempest-VolumesActionsTest-150031261 tempest-VolumesActionsTest-150031261-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279,backing_fmt=raw /opt/stack/data/nova/instances/6e4776e8-d528-4110-90a3-daf4d1df0171/disk 1073741824 {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:46:11 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-435c7bd8-4e7b-4a66-b456-66a245bc1703 tempest-VolumesActionsTest-150031261 tempest-VolumesActionsTest-150031261-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279,backing_fmt=raw /opt/stack/data/nova/instances/6e4776e8-d528-4110-90a3-daf4d1df0171/disk 1073741824" returned: 0 in 0.050s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:46:11 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-435c7bd8-4e7b-4a66-b456-66a245bc1703 tempest-VolumesActionsTest-150031261 tempest-VolumesActionsTest-150031261-project-member] Lock "9524227dd898575c3099d3976f096cd935414279" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.205s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:46:11 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-435c7bd8-4e7b-4a66-b456-66a245bc1703 tempest-VolumesActionsTest-150031261 tempest-VolumesActionsTest-150031261-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279 --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:46:11 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-435c7bd8-4e7b-4a66-b456-66a245bc1703 tempest-VolumesActionsTest-150031261 tempest-VolumesActionsTest-150031261-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279 --force-share --output=json" returned: 0 in 0.136s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:46:11 user nova-compute[71731]: DEBUG nova.virt.disk.api [None req-435c7bd8-4e7b-4a66-b456-66a245bc1703 tempest-VolumesActionsTest-150031261 tempest-VolumesActionsTest-150031261-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6e4776e8-d528-4110-90a3-daf4d1df0171/disk. size=1073741824 {{(pid=71731) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 16:46:11 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-435c7bd8-4e7b-4a66-b456-66a245bc1703 tempest-VolumesActionsTest-150031261 tempest-VolumesActionsTest-150031261-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e4776e8-d528-4110-90a3-daf4d1df0171/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:46:11 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-435c7bd8-4e7b-4a66-b456-66a245bc1703 tempest-VolumesActionsTest-150031261 tempest-VolumesActionsTest-150031261-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e4776e8-d528-4110-90a3-daf4d1df0171/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:46:11 user nova-compute[71731]: DEBUG nova.virt.disk.api [None req-435c7bd8-4e7b-4a66-b456-66a245bc1703 tempest-VolumesActionsTest-150031261 tempest-VolumesActionsTest-150031261-project-member] Cannot resize image /opt/stack/data/nova/instances/6e4776e8-d528-4110-90a3-daf4d1df0171/disk to a smaller size. {{(pid=71731) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 16:46:11 user nova-compute[71731]: DEBUG nova.objects.instance [None req-435c7bd8-4e7b-4a66-b456-66a245bc1703 tempest-VolumesActionsTest-150031261 tempest-VolumesActionsTest-150031261-project-member] Lazy-loading 'migration_context' on Instance uuid 6e4776e8-d528-4110-90a3-daf4d1df0171 {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:46:11 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-435c7bd8-4e7b-4a66-b456-66a245bc1703 tempest-VolumesActionsTest-150031261 tempest-VolumesActionsTest-150031261-project-member] [instance: 6e4776e8-d528-4110-90a3-daf4d1df0171] Created local disks {{(pid=71731) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 16:46:11 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-435c7bd8-4e7b-4a66-b456-66a245bc1703 tempest-VolumesActionsTest-150031261 tempest-VolumesActionsTest-150031261-project-member] [instance: 6e4776e8-d528-4110-90a3-daf4d1df0171] Ensure instance console log exists: /opt/stack/data/nova/instances/6e4776e8-d528-4110-90a3-daf4d1df0171/console.log {{(pid=71731) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 16:46:11 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-435c7bd8-4e7b-4a66-b456-66a245bc1703 tempest-VolumesActionsTest-150031261 tempest-VolumesActionsTest-150031261-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:46:11 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-435c7bd8-4e7b-4a66-b456-66a245bc1703 tempest-VolumesActionsTest-150031261 tempest-VolumesActionsTest-150031261-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:46:11 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-435c7bd8-4e7b-4a66-b456-66a245bc1703 tempest-VolumesActionsTest-150031261 tempest-VolumesActionsTest-150031261-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:46:11 user nova-compute[71731]: DEBUG nova.network.neutron [None req-435c7bd8-4e7b-4a66-b456-66a245bc1703 tempest-VolumesActionsTest-150031261 tempest-VolumesActionsTest-150031261-project-member] [instance: 6e4776e8-d528-4110-90a3-daf4d1df0171] Successfully created port: e4d1a1bf-cfc0-43cb-a0a2-db01fe4fd0e7 {{(pid=71731) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 16:46:12 user nova-compute[71731]: DEBUG nova.network.neutron [None req-435c7bd8-4e7b-4a66-b456-66a245bc1703 tempest-VolumesActionsTest-150031261 tempest-VolumesActionsTest-150031261-project-member] [instance: 6e4776e8-d528-4110-90a3-daf4d1df0171] Successfully updated port: e4d1a1bf-cfc0-43cb-a0a2-db01fe4fd0e7 {{(pid=71731) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 16:46:12 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-435c7bd8-4e7b-4a66-b456-66a245bc1703 tempest-VolumesActionsTest-150031261 tempest-VolumesActionsTest-150031261-project-member] Acquiring lock "refresh_cache-6e4776e8-d528-4110-90a3-daf4d1df0171" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 16:46:12 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-435c7bd8-4e7b-4a66-b456-66a245bc1703 tempest-VolumesActionsTest-150031261 tempest-VolumesActionsTest-150031261-project-member] Acquired lock "refresh_cache-6e4776e8-d528-4110-90a3-daf4d1df0171" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 16:46:12 user nova-compute[71731]: DEBUG nova.network.neutron [None req-435c7bd8-4e7b-4a66-b456-66a245bc1703 tempest-VolumesActionsTest-150031261 tempest-VolumesActionsTest-150031261-project-member] [instance: 6e4776e8-d528-4110-90a3-daf4d1df0171] Building network info cache for instance {{(pid=71731) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 16:46:12 user nova-compute[71731]: DEBUG nova.network.neutron [None req-435c7bd8-4e7b-4a66-b456-66a245bc1703 tempest-VolumesActionsTest-150031261 tempest-VolumesActionsTest-150031261-project-member] [instance: 6e4776e8-d528-4110-90a3-daf4d1df0171] Instance cache missing network info. {{(pid=71731) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 16:46:12 user nova-compute[71731]: DEBUG nova.compute.manager [req-e026e985-1af5-4dc7-b677-a6f225618859 req-4d6114cb-d9d0-4249-8870-e4dc05e1ddf4 service nova] [instance: 6e4776e8-d528-4110-90a3-daf4d1df0171] Received event network-changed-e4d1a1bf-cfc0-43cb-a0a2-db01fe4fd0e7 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:46:12 user nova-compute[71731]: DEBUG nova.compute.manager [req-e026e985-1af5-4dc7-b677-a6f225618859 req-4d6114cb-d9d0-4249-8870-e4dc05e1ddf4 service nova] [instance: 6e4776e8-d528-4110-90a3-daf4d1df0171] Refreshing instance network info cache due to event network-changed-e4d1a1bf-cfc0-43cb-a0a2-db01fe4fd0e7. {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 16:46:12 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-e026e985-1af5-4dc7-b677-a6f225618859 req-4d6114cb-d9d0-4249-8870-e4dc05e1ddf4 service nova] Acquiring lock "refresh_cache-6e4776e8-d528-4110-90a3-daf4d1df0171" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 16:46:12 user nova-compute[71731]: DEBUG nova.network.neutron [None req-435c7bd8-4e7b-4a66-b456-66a245bc1703 tempest-VolumesActionsTest-150031261 tempest-VolumesActionsTest-150031261-project-member] [instance: 6e4776e8-d528-4110-90a3-daf4d1df0171] Updating instance_info_cache with network_info: [{"id": "e4d1a1bf-cfc0-43cb-a0a2-db01fe4fd0e7", "address": "fa:16:3e:7b:c8:f3", "network": {"id": "282f8956-6789-4c49-8b11-a2cc18f673a9", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2013191479-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "c0bb7653df574769941cf284c6a63154", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4d1a1bf-cf", "ovs_interfaceid": "e4d1a1bf-cfc0-43cb-a0a2-db01fe4fd0e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:46:12 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-435c7bd8-4e7b-4a66-b456-66a245bc1703 tempest-VolumesActionsTest-150031261 tempest-VolumesActionsTest-150031261-project-member] Releasing lock "refresh_cache-6e4776e8-d528-4110-90a3-daf4d1df0171" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 16:46:12 user nova-compute[71731]: DEBUG nova.compute.manager [None req-435c7bd8-4e7b-4a66-b456-66a245bc1703 tempest-VolumesActionsTest-150031261 tempest-VolumesActionsTest-150031261-project-member] [instance: 6e4776e8-d528-4110-90a3-daf4d1df0171] Instance network_info: |[{"id": "e4d1a1bf-cfc0-43cb-a0a2-db01fe4fd0e7", "address": "fa:16:3e:7b:c8:f3", "network": {"id": "282f8956-6789-4c49-8b11-a2cc18f673a9", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2013191479-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "c0bb7653df574769941cf284c6a63154", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4d1a1bf-cf", "ovs_interfaceid": "e4d1a1bf-cfc0-43cb-a0a2-db01fe4fd0e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71731) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 16:46:12 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-e026e985-1af5-4dc7-b677-a6f225618859 req-4d6114cb-d9d0-4249-8870-e4dc05e1ddf4 service nova] Acquired lock "refresh_cache-6e4776e8-d528-4110-90a3-daf4d1df0171" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 16:46:12 user nova-compute[71731]: DEBUG nova.network.neutron [req-e026e985-1af5-4dc7-b677-a6f225618859 req-4d6114cb-d9d0-4249-8870-e4dc05e1ddf4 service nova] [instance: 6e4776e8-d528-4110-90a3-daf4d1df0171] Refreshing network info cache for port e4d1a1bf-cfc0-43cb-a0a2-db01fe4fd0e7 {{(pid=71731) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 16:46:12 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-435c7bd8-4e7b-4a66-b456-66a245bc1703 tempest-VolumesActionsTest-150031261 tempest-VolumesActionsTest-150031261-project-member] [instance: 6e4776e8-d528-4110-90a3-daf4d1df0171] Start _get_guest_xml network_info=[{"id": "e4d1a1bf-cfc0-43cb-a0a2-db01fe4fd0e7", "address": "fa:16:3e:7b:c8:f3", "network": {"id": "282f8956-6789-4c49-8b11-a2cc18f673a9", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2013191479-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "c0bb7653df574769941cf284c6a63154", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4d1a1bf-cf", "ovs_interfaceid": "e4d1a1bf-cfc0-43cb-a0a2-db01fe4fd0e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T16:16:31Z,direct_url=<?>,disk_format='qcow2',id=708622a9-7465-4492-ade8-b827198f7e30,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='0b29a975c552465aba0ac7d6288434bd',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T16:16:33Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'device_type': 'disk', 'encrypted': False, 'disk_bus': 'virtio', 'guest_format': None, 'encryption_options': None, 'image_id': '708622a9-7465-4492-ade8-b827198f7e30'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71731) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 16:46:12 user nova-compute[71731]: WARNING nova.virt.libvirt.driver [None req-435c7bd8-4e7b-4a66-b456-66a245bc1703 tempest-VolumesActionsTest-150031261 tempest-VolumesActionsTest-150031261-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 16:46:12 user nova-compute[71731]: WARNING nova.virt.libvirt.driver [None req-435c7bd8-4e7b-4a66-b456-66a245bc1703 tempest-VolumesActionsTest-150031261 tempest-VolumesActionsTest-150031261-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 16:46:12 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-435c7bd8-4e7b-4a66-b456-66a245bc1703 tempest-VolumesActionsTest-150031261 tempest-VolumesActionsTest-150031261-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71731) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 16:46:12 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-435c7bd8-4e7b-4a66-b456-66a245bc1703 tempest-VolumesActionsTest-150031261 tempest-VolumesActionsTest-150031261-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T16:17:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T16:16:31Z,direct_url=<?>,disk_format='qcow2',id=708622a9-7465-4492-ade8-b827198f7e30,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='0b29a975c552465aba0ac7d6288434bd',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T16:16:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 16:46:12 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-435c7bd8-4e7b-4a66-b456-66a245bc1703 tempest-VolumesActionsTest-150031261 tempest-VolumesActionsTest-150031261-project-member] Flavor limits 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 16:46:12 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-435c7bd8-4e7b-4a66-b456-66a245bc1703 tempest-VolumesActionsTest-150031261 tempest-VolumesActionsTest-150031261-project-member] Image limits 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 16:46:12 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-435c7bd8-4e7b-4a66-b456-66a245bc1703 tempest-VolumesActionsTest-150031261 tempest-VolumesActionsTest-150031261-project-member] Flavor pref 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 16:46:12 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-435c7bd8-4e7b-4a66-b456-66a245bc1703 tempest-VolumesActionsTest-150031261 tempest-VolumesActionsTest-150031261-project-member] Image pref 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 16:46:12 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-435c7bd8-4e7b-4a66-b456-66a245bc1703 tempest-VolumesActionsTest-150031261 tempest-VolumesActionsTest-150031261-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 16:46:12 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-435c7bd8-4e7b-4a66-b456-66a245bc1703 tempest-VolumesActionsTest-150031261 tempest-VolumesActionsTest-150031261-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 16:46:12 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-435c7bd8-4e7b-4a66-b456-66a245bc1703 tempest-VolumesActionsTest-150031261 tempest-VolumesActionsTest-150031261-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71731) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 16:46:12 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-435c7bd8-4e7b-4a66-b456-66a245bc1703 tempest-VolumesActionsTest-150031261 tempest-VolumesActionsTest-150031261-project-member] Got 1 possible topologies {{(pid=71731) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 16:46:12 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-435c7bd8-4e7b-4a66-b456-66a245bc1703 tempest-VolumesActionsTest-150031261 tempest-VolumesActionsTest-150031261-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 16:46:12 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-435c7bd8-4e7b-4a66-b456-66a245bc1703 tempest-VolumesActionsTest-150031261 tempest-VolumesActionsTest-150031261-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 16:46:12 user nova-compute[71731]: DEBUG nova.virt.libvirt.vif [None req-435c7bd8-4e7b-4a66-b456-66a245bc1703 tempest-VolumesActionsTest-150031261 tempest-VolumesActionsTest-150031261-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T16:46:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-134291337',display_name='tempest-VolumesActionsTest-instance-134291337',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-134291337',id=38,image_ref='708622a9-7465-4492-ade8-b827198f7e30',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c0bb7653df574769941cf284c6a63154',ramdisk_id='',reservation_id='r-ht0lqdem',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='708622a9-7465-4492-ade8-b827198f7e30',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-150031261',owner_user_name='tempest-VolumesActionsTest-150031261-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T16:46:11Z,user_data=None,user_id='623668858bee4d308f31f4facd600fb1',uuid=6e4776e8-d528-4110-90a3-daf4d1df0171,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e4d1a1bf-cfc0-43cb-a0a2-db01fe4fd0e7", "address": "fa:16:3e:7b:c8:f3", "network": {"id": "282f8956-6789-4c49-8b11-a2cc18f673a9", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2013191479-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "c0bb7653df574769941cf284c6a63154", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4d1a1bf-cf", "ovs_interfaceid": "e4d1a1bf-cfc0-43cb-a0a2-db01fe4fd0e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71731) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 16:46:12 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-435c7bd8-4e7b-4a66-b456-66a245bc1703 tempest-VolumesActionsTest-150031261 tempest-VolumesActionsTest-150031261-project-member] Converting VIF {"id": "e4d1a1bf-cfc0-43cb-a0a2-db01fe4fd0e7", "address": "fa:16:3e:7b:c8:f3", "network": {"id": "282f8956-6789-4c49-8b11-a2cc18f673a9", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2013191479-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "c0bb7653df574769941cf284c6a63154", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4d1a1bf-cf", "ovs_interfaceid": "e4d1a1bf-cfc0-43cb-a0a2-db01fe4fd0e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 16:46:13 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-435c7bd8-4e7b-4a66-b456-66a245bc1703 tempest-VolumesActionsTest-150031261 tempest-VolumesActionsTest-150031261-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7b:c8:f3,bridge_name='br-int',has_traffic_filtering=True,id=e4d1a1bf-cfc0-43cb-a0a2-db01fe4fd0e7,network=Network(282f8956-6789-4c49-8b11-a2cc18f673a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4d1a1bf-cf') {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 16:46:13 user nova-compute[71731]: DEBUG nova.objects.instance [None req-435c7bd8-4e7b-4a66-b456-66a245bc1703 tempest-VolumesActionsTest-150031261 tempest-VolumesActionsTest-150031261-project-member] Lazy-loading 'pci_devices' on Instance uuid 6e4776e8-d528-4110-90a3-daf4d1df0171 {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:46:13 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-435c7bd8-4e7b-4a66-b456-66a245bc1703 tempest-VolumesActionsTest-150031261 tempest-VolumesActionsTest-150031261-project-member] [instance: 6e4776e8-d528-4110-90a3-daf4d1df0171] End _get_guest_xml xml=<domain type="kvm">
Apr 13 16:46:13 user nova-compute[71731]:   <uuid>6e4776e8-d528-4110-90a3-daf4d1df0171</uuid>
Apr 13 16:46:13 user nova-compute[71731]:   <name>instance-00000026</name>
Apr 13 16:46:13 user nova-compute[71731]:   <memory>131072</memory>
Apr 13 16:46:13 user nova-compute[71731]:   <vcpu>1</vcpu>
Apr 13 16:46:13 user nova-compute[71731]:   <metadata>
Apr 13 16:46:13 user nova-compute[71731]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 16:46:13 user nova-compute[71731]:       <nova:package version="0.0.0"/>
Apr 13 16:46:13 user nova-compute[71731]:       <nova:name>tempest-VolumesActionsTest-instance-134291337</nova:name>
Apr 13 16:46:13 user nova-compute[71731]:       <nova:creationTime>2023-04-13 16:46:12</nova:creationTime>
Apr 13 16:46:13 user nova-compute[71731]:       <nova:flavor name="m1.nano">
Apr 13 16:46:13 user nova-compute[71731]:         <nova:memory>128</nova:memory>
Apr 13 16:46:13 user nova-compute[71731]:         <nova:disk>1</nova:disk>
Apr 13 16:46:13 user nova-compute[71731]:         <nova:swap>0</nova:swap>
Apr 13 16:46:13 user nova-compute[71731]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 16:46:13 user nova-compute[71731]:         <nova:vcpus>1</nova:vcpus>
Apr 13 16:46:13 user nova-compute[71731]:       </nova:flavor>
Apr 13 16:46:13 user nova-compute[71731]:       <nova:owner>
Apr 13 16:46:13 user nova-compute[71731]:         <nova:user uuid="623668858bee4d308f31f4facd600fb1">tempest-VolumesActionsTest-150031261-project-member</nova:user>
Apr 13 16:46:13 user nova-compute[71731]:         <nova:project uuid="c0bb7653df574769941cf284c6a63154">tempest-VolumesActionsTest-150031261</nova:project>
Apr 13 16:46:13 user nova-compute[71731]:       </nova:owner>
Apr 13 16:46:13 user nova-compute[71731]:       <nova:root type="image" uuid="708622a9-7465-4492-ade8-b827198f7e30"/>
Apr 13 16:46:13 user nova-compute[71731]:       <nova:ports>
Apr 13 16:46:13 user nova-compute[71731]:         <nova:port uuid="e4d1a1bf-cfc0-43cb-a0a2-db01fe4fd0e7">
Apr 13 16:46:13 user nova-compute[71731]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Apr 13 16:46:13 user nova-compute[71731]:         </nova:port>
Apr 13 16:46:13 user nova-compute[71731]:       </nova:ports>
Apr 13 16:46:13 user nova-compute[71731]:     </nova:instance>
Apr 13 16:46:13 user nova-compute[71731]:   </metadata>
Apr 13 16:46:13 user nova-compute[71731]:   <sysinfo type="smbios">
Apr 13 16:46:13 user nova-compute[71731]:     <system>
Apr 13 16:46:13 user nova-compute[71731]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 16:46:13 user nova-compute[71731]:       <entry name="product">OpenStack Nova</entry>
Apr 13 16:46:13 user nova-compute[71731]:       <entry name="version">0.0.0</entry>
Apr 13 16:46:13 user nova-compute[71731]:       <entry name="serial">6e4776e8-d528-4110-90a3-daf4d1df0171</entry>
Apr 13 16:46:13 user nova-compute[71731]:       <entry name="uuid">6e4776e8-d528-4110-90a3-daf4d1df0171</entry>
Apr 13 16:46:13 user nova-compute[71731]:       <entry name="family">Virtual Machine</entry>
Apr 13 16:46:13 user nova-compute[71731]:     </system>
Apr 13 16:46:13 user nova-compute[71731]:   </sysinfo>
Apr 13 16:46:13 user nova-compute[71731]:   <os>
Apr 13 16:46:13 user nova-compute[71731]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 16:46:13 user nova-compute[71731]:     <boot dev="hd"/>
Apr 13 16:46:13 user nova-compute[71731]:     <smbios mode="sysinfo"/>
Apr 13 16:46:13 user nova-compute[71731]:   </os>
Apr 13 16:46:13 user nova-compute[71731]:   <features>
Apr 13 16:46:13 user nova-compute[71731]:     <acpi/>
Apr 13 16:46:13 user nova-compute[71731]:     <apic/>
Apr 13 16:46:13 user nova-compute[71731]:     <vmcoreinfo/>
Apr 13 16:46:13 user nova-compute[71731]:   </features>
Apr 13 16:46:13 user nova-compute[71731]:   <clock offset="utc">
Apr 13 16:46:13 user nova-compute[71731]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 16:46:13 user nova-compute[71731]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 16:46:13 user nova-compute[71731]:     <timer name="hpet" present="no"/>
Apr 13 16:46:13 user nova-compute[71731]:   </clock>
Apr 13 16:46:13 user nova-compute[71731]:   <cpu mode="custom" match="exact">
Apr 13 16:46:13 user nova-compute[71731]:     <model>Nehalem</model>
Apr 13 16:46:13 user nova-compute[71731]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 16:46:13 user nova-compute[71731]:   </cpu>
Apr 13 16:46:13 user nova-compute[71731]:   <devices>
Apr 13 16:46:13 user nova-compute[71731]:     <disk type="file" device="disk">
Apr 13 16:46:13 user nova-compute[71731]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 16:46:13 user nova-compute[71731]:       <source file="/opt/stack/data/nova/instances/6e4776e8-d528-4110-90a3-daf4d1df0171/disk"/>
Apr 13 16:46:13 user nova-compute[71731]:       <target dev="vda" bus="virtio"/>
Apr 13 16:46:13 user nova-compute[71731]:     </disk>
Apr 13 16:46:13 user nova-compute[71731]:     <interface type="ethernet">
Apr 13 16:46:13 user nova-compute[71731]:       <mac address="fa:16:3e:7b:c8:f3"/>
Apr 13 16:46:13 user nova-compute[71731]:       <model type="virtio"/>
Apr 13 16:46:13 user nova-compute[71731]:       <mtu size="1442"/>
Apr 13 16:46:13 user nova-compute[71731]:       <target dev="tape4d1a1bf-cf"/>
Apr 13 16:46:13 user nova-compute[71731]:     </interface>
Apr 13 16:46:13 user nova-compute[71731]:     <serial type="pty">
Apr 13 16:46:13 user nova-compute[71731]:       <log file="/opt/stack/data/nova/instances/6e4776e8-d528-4110-90a3-daf4d1df0171/console.log" append="off"/>
Apr 13 16:46:13 user nova-compute[71731]:     </serial>
Apr 13 16:46:13 user nova-compute[71731]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 16:46:13 user nova-compute[71731]:     <video>
Apr 13 16:46:13 user nova-compute[71731]:       <model type="virtio"/>
Apr 13 16:46:13 user nova-compute[71731]:     </video>
Apr 13 16:46:13 user nova-compute[71731]:     <rng model="virtio">
Apr 13 16:46:13 user nova-compute[71731]:       <backend model="random">/dev/urandom</backend>
Apr 13 16:46:13 user nova-compute[71731]:     </rng>
Apr 13 16:46:13 user nova-compute[71731]:     <controller type="usb" index="0" model="none"/>
Apr 13 16:46:13 user nova-compute[71731]:     <memballoon model="virtio">
Apr 13 16:46:13 user nova-compute[71731]:       <stats period="10"/>
Apr 13 16:46:13 user nova-compute[71731]:     </memballoon>
Apr 13 16:46:13 user nova-compute[71731]:   </devices>
Apr 13 16:46:13 user nova-compute[71731]: </domain>
Apr 13 16:46:13 user nova-compute[71731]:  {{(pid=71731) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 16:46:13 user nova-compute[71731]: DEBUG nova.virt.libvirt.vif [None req-435c7bd8-4e7b-4a66-b456-66a245bc1703 tempest-VolumesActionsTest-150031261 tempest-VolumesActionsTest-150031261-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T16:46:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-134291337',display_name='tempest-VolumesActionsTest-instance-134291337',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-134291337',id=38,image_ref='708622a9-7465-4492-ade8-b827198f7e30',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c0bb7653df574769941cf284c6a63154',ramdisk_id='',reservation_id='r-ht0lqdem',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='708622a9-7465-4492-ade8-b827198f7e30',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-150031261',owner_user_name='tempest-VolumesActionsTest-150031261-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T16:46:11Z,user_data=None,user_id='623668858bee4d308f31f4facd600fb1',uuid=6e4776e8-d528-4110-90a3-daf4d1df0171,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e4d1a1bf-cfc0-43cb-a0a2-db01fe4fd0e7", "address": "fa:16:3e:7b:c8:f3", "network": {"id": "282f8956-6789-4c49-8b11-a2cc18f673a9", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2013191479-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "c0bb7653df574769941cf284c6a63154", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4d1a1bf-cf", "ovs_interfaceid": "e4d1a1bf-cfc0-43cb-a0a2-db01fe4fd0e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 16:46:13 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-435c7bd8-4e7b-4a66-b456-66a245bc1703 tempest-VolumesActionsTest-150031261 tempest-VolumesActionsTest-150031261-project-member] Converting VIF {"id": "e4d1a1bf-cfc0-43cb-a0a2-db01fe4fd0e7", "address": "fa:16:3e:7b:c8:f3", "network": {"id": "282f8956-6789-4c49-8b11-a2cc18f673a9", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2013191479-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "c0bb7653df574769941cf284c6a63154", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4d1a1bf-cf", "ovs_interfaceid": "e4d1a1bf-cfc0-43cb-a0a2-db01fe4fd0e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 16:46:13 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-435c7bd8-4e7b-4a66-b456-66a245bc1703 tempest-VolumesActionsTest-150031261 tempest-VolumesActionsTest-150031261-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7b:c8:f3,bridge_name='br-int',has_traffic_filtering=True,id=e4d1a1bf-cfc0-43cb-a0a2-db01fe4fd0e7,network=Network(282f8956-6789-4c49-8b11-a2cc18f673a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4d1a1bf-cf') {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 16:46:13 user nova-compute[71731]: DEBUG os_vif [None req-435c7bd8-4e7b-4a66-b456-66a245bc1703 tempest-VolumesActionsTest-150031261 tempest-VolumesActionsTest-150031261-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:c8:f3,bridge_name='br-int',has_traffic_filtering=True,id=e4d1a1bf-cfc0-43cb-a0a2-db01fe4fd0e7,network=Network(282f8956-6789-4c49-8b11-a2cc18f673a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4d1a1bf-cf') {{(pid=71731) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 16:46:13 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:46:13 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:46:13 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 16:46:13 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:46:13 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape4d1a1bf-cf, may_exist=True) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:46:13 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape4d1a1bf-cf, col_values=(('external_ids', {'iface-id': 'e4d1a1bf-cfc0-43cb-a0a2-db01fe4fd0e7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7b:c8:f3', 'vm-uuid': '6e4776e8-d528-4110-90a3-daf4d1df0171'}),)) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:46:13 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:46:13 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 16:46:13 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:46:13 user nova-compute[71731]: INFO os_vif [None req-435c7bd8-4e7b-4a66-b456-66a245bc1703 tempest-VolumesActionsTest-150031261 tempest-VolumesActionsTest-150031261-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:c8:f3,bridge_name='br-int',has_traffic_filtering=True,id=e4d1a1bf-cfc0-43cb-a0a2-db01fe4fd0e7,network=Network(282f8956-6789-4c49-8b11-a2cc18f673a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4d1a1bf-cf')
Apr 13 16:46:13 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-435c7bd8-4e7b-4a66-b456-66a245bc1703 tempest-VolumesActionsTest-150031261 tempest-VolumesActionsTest-150031261-project-member] No BDM found with device name vda, not building metadata. {{(pid=71731) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 16:46:13 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-435c7bd8-4e7b-4a66-b456-66a245bc1703 tempest-VolumesActionsTest-150031261 tempest-VolumesActionsTest-150031261-project-member] No VIF found with MAC fa:16:3e:7b:c8:f3, not building metadata {{(pid=71731) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 16:46:13 user nova-compute[71731]: DEBUG nova.network.neutron [req-e026e985-1af5-4dc7-b677-a6f225618859 req-4d6114cb-d9d0-4249-8870-e4dc05e1ddf4 service nova] [instance: 6e4776e8-d528-4110-90a3-daf4d1df0171] Updated VIF entry in instance network info cache for port e4d1a1bf-cfc0-43cb-a0a2-db01fe4fd0e7. {{(pid=71731) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 16:46:13 user nova-compute[71731]: DEBUG nova.network.neutron [req-e026e985-1af5-4dc7-b677-a6f225618859 req-4d6114cb-d9d0-4249-8870-e4dc05e1ddf4 service nova] [instance: 6e4776e8-d528-4110-90a3-daf4d1df0171] Updating instance_info_cache with network_info: [{"id": "e4d1a1bf-cfc0-43cb-a0a2-db01fe4fd0e7", "address": "fa:16:3e:7b:c8:f3", "network": {"id": "282f8956-6789-4c49-8b11-a2cc18f673a9", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2013191479-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "c0bb7653df574769941cf284c6a63154", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4d1a1bf-cf", "ovs_interfaceid": "e4d1a1bf-cfc0-43cb-a0a2-db01fe4fd0e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:46:13 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-e026e985-1af5-4dc7-b677-a6f225618859 req-4d6114cb-d9d0-4249-8870-e4dc05e1ddf4 service nova] Releasing lock "refresh_cache-6e4776e8-d528-4110-90a3-daf4d1df0171" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 16:46:14 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:46:14 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:46:14 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:46:14 user nova-compute[71731]: DEBUG nova.compute.manager [req-d61a4ae1-8807-4d1f-aa9a-5061a1ce40f1 req-e386759a-43d9-423f-a115-7e6d2e94a055 service nova] [instance: 6e4776e8-d528-4110-90a3-daf4d1df0171] Received event network-vif-plugged-e4d1a1bf-cfc0-43cb-a0a2-db01fe4fd0e7 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:46:14 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-d61a4ae1-8807-4d1f-aa9a-5061a1ce40f1 req-e386759a-43d9-423f-a115-7e6d2e94a055 service nova] Acquiring lock "6e4776e8-d528-4110-90a3-daf4d1df0171-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:46:14 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-d61a4ae1-8807-4d1f-aa9a-5061a1ce40f1 req-e386759a-43d9-423f-a115-7e6d2e94a055 service nova] Lock "6e4776e8-d528-4110-90a3-daf4d1df0171-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:46:14 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-d61a4ae1-8807-4d1f-aa9a-5061a1ce40f1 req-e386759a-43d9-423f-a115-7e6d2e94a055 service nova] Lock "6e4776e8-d528-4110-90a3-daf4d1df0171-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:46:14 user nova-compute[71731]: DEBUG nova.compute.manager [req-d61a4ae1-8807-4d1f-aa9a-5061a1ce40f1 req-e386759a-43d9-423f-a115-7e6d2e94a055 service nova] [instance: 6e4776e8-d528-4110-90a3-daf4d1df0171] No waiting events found dispatching network-vif-plugged-e4d1a1bf-cfc0-43cb-a0a2-db01fe4fd0e7 {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:46:14 user nova-compute[71731]: WARNING nova.compute.manager [req-d61a4ae1-8807-4d1f-aa9a-5061a1ce40f1 req-e386759a-43d9-423f-a115-7e6d2e94a055 service nova] [instance: 6e4776e8-d528-4110-90a3-daf4d1df0171] Received unexpected event network-vif-plugged-e4d1a1bf-cfc0-43cb-a0a2-db01fe4fd0e7 for instance with vm_state building and task_state spawning.
Apr 13 16:46:16 user nova-compute[71731]: DEBUG nova.virt.driver [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Emitting event <LifecycleEvent: 1681404376.4766147, 6e4776e8-d528-4110-90a3-daf4d1df0171 => Resumed> {{(pid=71731) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 16:46:16 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 6e4776e8-d528-4110-90a3-daf4d1df0171] VM Resumed (Lifecycle Event)
Apr 13 16:46:16 user nova-compute[71731]: DEBUG nova.compute.manager [None req-435c7bd8-4e7b-4a66-b456-66a245bc1703 tempest-VolumesActionsTest-150031261 tempest-VolumesActionsTest-150031261-project-member] [instance: 6e4776e8-d528-4110-90a3-daf4d1df0171] Instance event wait completed in 0 seconds for  {{(pid=71731) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 16:46:16 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-435c7bd8-4e7b-4a66-b456-66a245bc1703 tempest-VolumesActionsTest-150031261 tempest-VolumesActionsTest-150031261-project-member] [instance: 6e4776e8-d528-4110-90a3-daf4d1df0171] Guest created on hypervisor {{(pid=71731) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 16:46:16 user nova-compute[71731]: INFO nova.virt.libvirt.driver [-] [instance: 6e4776e8-d528-4110-90a3-daf4d1df0171] Instance spawned successfully.
Apr 13 16:46:16 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-435c7bd8-4e7b-4a66-b456-66a245bc1703 tempest-VolumesActionsTest-150031261 tempest-VolumesActionsTest-150031261-project-member] [instance: 6e4776e8-d528-4110-90a3-daf4d1df0171] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 16:46:16 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 6e4776e8-d528-4110-90a3-daf4d1df0171] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:46:16 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 6e4776e8-d528-4110-90a3-daf4d1df0171] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71731) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 16:46:16 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-435c7bd8-4e7b-4a66-b456-66a245bc1703 tempest-VolumesActionsTest-150031261 tempest-VolumesActionsTest-150031261-project-member] [instance: 6e4776e8-d528-4110-90a3-daf4d1df0171] Found default for hw_cdrom_bus of ide {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:46:16 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-435c7bd8-4e7b-4a66-b456-66a245bc1703 tempest-VolumesActionsTest-150031261 tempest-VolumesActionsTest-150031261-project-member] [instance: 6e4776e8-d528-4110-90a3-daf4d1df0171] Found default for hw_disk_bus of virtio {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:46:16 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-435c7bd8-4e7b-4a66-b456-66a245bc1703 tempest-VolumesActionsTest-150031261 tempest-VolumesActionsTest-150031261-project-member] [instance: 6e4776e8-d528-4110-90a3-daf4d1df0171] Found default for hw_input_bus of None {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:46:16 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-435c7bd8-4e7b-4a66-b456-66a245bc1703 tempest-VolumesActionsTest-150031261 tempest-VolumesActionsTest-150031261-project-member] [instance: 6e4776e8-d528-4110-90a3-daf4d1df0171] Found default for hw_pointer_model of None {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:46:16 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-435c7bd8-4e7b-4a66-b456-66a245bc1703 tempest-VolumesActionsTest-150031261 tempest-VolumesActionsTest-150031261-project-member] [instance: 6e4776e8-d528-4110-90a3-daf4d1df0171] Found default for hw_video_model of virtio {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:46:16 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-435c7bd8-4e7b-4a66-b456-66a245bc1703 tempest-VolumesActionsTest-150031261 tempest-VolumesActionsTest-150031261-project-member] [instance: 6e4776e8-d528-4110-90a3-daf4d1df0171] Found default for hw_vif_model of virtio {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:46:16 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 6e4776e8-d528-4110-90a3-daf4d1df0171] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 16:46:16 user nova-compute[71731]: DEBUG nova.virt.driver [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Emitting event <LifecycleEvent: 1681404376.47873, 6e4776e8-d528-4110-90a3-daf4d1df0171 => Started> {{(pid=71731) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 16:46:16 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 6e4776e8-d528-4110-90a3-daf4d1df0171] VM Started (Lifecycle Event)
Apr 13 16:46:16 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 6e4776e8-d528-4110-90a3-daf4d1df0171] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:46:16 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 6e4776e8-d528-4110-90a3-daf4d1df0171] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71731) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 16:46:16 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 6e4776e8-d528-4110-90a3-daf4d1df0171] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 16:46:16 user nova-compute[71731]: INFO nova.compute.manager [None req-435c7bd8-4e7b-4a66-b456-66a245bc1703 tempest-VolumesActionsTest-150031261 tempest-VolumesActionsTest-150031261-project-member] [instance: 6e4776e8-d528-4110-90a3-daf4d1df0171] Took 5.65 seconds to spawn the instance on the hypervisor.
Apr 13 16:46:16 user nova-compute[71731]: DEBUG nova.compute.manager [None req-435c7bd8-4e7b-4a66-b456-66a245bc1703 tempest-VolumesActionsTest-150031261 tempest-VolumesActionsTest-150031261-project-member] [instance: 6e4776e8-d528-4110-90a3-daf4d1df0171] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:46:16 user nova-compute[71731]: INFO nova.compute.manager [None req-435c7bd8-4e7b-4a66-b456-66a245bc1703 tempest-VolumesActionsTest-150031261 tempest-VolumesActionsTest-150031261-project-member] [instance: 6e4776e8-d528-4110-90a3-daf4d1df0171] Took 6.22 seconds to build instance.
Apr 13 16:46:16 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-435c7bd8-4e7b-4a66-b456-66a245bc1703 tempest-VolumesActionsTest-150031261 tempest-VolumesActionsTest-150031261-project-member] Lock "6e4776e8-d528-4110-90a3-daf4d1df0171" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.340s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:46:16 user nova-compute[71731]: DEBUG nova.compute.manager [req-38677630-82a9-4700-9e75-1d6ffeab84f0 req-da587bf3-49ca-421e-a5c2-50676a0247a0 service nova] [instance: 6e4776e8-d528-4110-90a3-daf4d1df0171] Received event network-vif-plugged-e4d1a1bf-cfc0-43cb-a0a2-db01fe4fd0e7 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:46:16 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-38677630-82a9-4700-9e75-1d6ffeab84f0 req-da587bf3-49ca-421e-a5c2-50676a0247a0 service nova] Acquiring lock "6e4776e8-d528-4110-90a3-daf4d1df0171-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:46:16 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-38677630-82a9-4700-9e75-1d6ffeab84f0 req-da587bf3-49ca-421e-a5c2-50676a0247a0 service nova] Lock "6e4776e8-d528-4110-90a3-daf4d1df0171-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:46:16 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-38677630-82a9-4700-9e75-1d6ffeab84f0 req-da587bf3-49ca-421e-a5c2-50676a0247a0 service nova] Lock "6e4776e8-d528-4110-90a3-daf4d1df0171-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:46:16 user nova-compute[71731]: DEBUG nova.compute.manager [req-38677630-82a9-4700-9e75-1d6ffeab84f0 req-da587bf3-49ca-421e-a5c2-50676a0247a0 service nova] [instance: 6e4776e8-d528-4110-90a3-daf4d1df0171] No waiting events found dispatching network-vif-plugged-e4d1a1bf-cfc0-43cb-a0a2-db01fe4fd0e7 {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:46:16 user nova-compute[71731]: WARNING nova.compute.manager [req-38677630-82a9-4700-9e75-1d6ffeab84f0 req-da587bf3-49ca-421e-a5c2-50676a0247a0 service nova] [instance: 6e4776e8-d528-4110-90a3-daf4d1df0171] Received unexpected event network-vif-plugged-e4d1a1bf-cfc0-43cb-a0a2-db01fe4fd0e7 for instance with vm_state active and task_state None.
Apr 13 16:46:17 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:46:18 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:46:22 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:46:23 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:46:25 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:46:27 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager.update_available_resource {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:46:27 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:46:27 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:46:27 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:46:27 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Auditing locally available compute resources for user (node: user) {{(pid=71731) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 16:46:27 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71731) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 16:46:27 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e4776e8-d528-4110-90a3-daf4d1df0171/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:46:27 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e4776e8-d528-4110-90a3-daf4d1df0171/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:46:27 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e4776e8-d528-4110-90a3-daf4d1df0171/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:46:27 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e4776e8-d528-4110-90a3-daf4d1df0171/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:46:27 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3af23ff8-4e10-4fbf-a86e-bda842f084ff/disk.rescue --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:46:27 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3af23ff8-4e10-4fbf-a86e-bda842f084ff/disk.rescue --force-share --output=json" returned: 0 in 0.145s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:46:27 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3af23ff8-4e10-4fbf-a86e-bda842f084ff/disk.rescue --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:46:27 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3af23ff8-4e10-4fbf-a86e-bda842f084ff/disk.rescue --force-share --output=json" returned: 0 in 0.132s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:46:27 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3af23ff8-4e10-4fbf-a86e-bda842f084ff/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:46:27 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3af23ff8-4e10-4fbf-a86e-bda842f084ff/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:46:27 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3af23ff8-4e10-4fbf-a86e-bda842f084ff/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:46:28 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3af23ff8-4e10-4fbf-a86e-bda842f084ff/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:46:28 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ed800fe-577d-4624-898c-c7f40da77376/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:46:28 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:46:28 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ed800fe-577d-4624-898c-c7f40da77376/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:46:28 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ed800fe-577d-4624-898c-c7f40da77376/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:46:28 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ed800fe-577d-4624-898c-c7f40da77376/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:46:28 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2d55cdd-c89c-4c59-afe1-49a33225af22/disk.rescue --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:46:28 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2d55cdd-c89c-4c59-afe1-49a33225af22/disk.rescue --force-share --output=json" returned: 0 in 0.137s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:46:28 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2d55cdd-c89c-4c59-afe1-49a33225af22/disk.rescue --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:46:28 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2d55cdd-c89c-4c59-afe1-49a33225af22/disk.rescue --force-share --output=json" returned: 0 in 0.138s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:46:28 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2d55cdd-c89c-4c59-afe1-49a33225af22/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:46:28 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2d55cdd-c89c-4c59-afe1-49a33225af22/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:46:28 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2d55cdd-c89c-4c59-afe1-49a33225af22/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:46:28 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2d55cdd-c89c-4c59-afe1-49a33225af22/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:46:29 user nova-compute[71731]: WARNING nova.virt.libvirt.driver [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 16:46:29 user nova-compute[71731]: WARNING nova.virt.libvirt.driver [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 16:46:29 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Hypervisor/Node resource view: name=user free_ram=8404MB free_disk=26.070037841796875GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71731) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 16:46:29 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:46:29 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:46:29 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance 5ed800fe-577d-4624-898c-c7f40da77376 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 16:46:29 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance b2d55cdd-c89c-4c59-afe1-49a33225af22 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 16:46:29 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance 3af23ff8-4e10-4fbf-a86e-bda842f084ff actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 16:46:29 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance 7ae7d3d9-54f7-4c64-8bf6-08fa5c526687 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 16:46:29 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance 6e4776e8-d528-4110-90a3-daf4d1df0171 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 16:46:29 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=71731) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 16:46:29 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Final resource view: name=user phys_ram=16023MB used_ram=1216MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=71731) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 16:46:29 user nova-compute[71731]: DEBUG nova.compute.provider_tree [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Inventory has not changed in ProviderTree for provider: cb6b1a64-0c24-4e2d-af1e-16576ca9165c {{(pid=71731) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 16:46:29 user nova-compute[71731]: DEBUG nova.scheduler.client.report [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Inventory has not changed for provider cb6b1a64-0c24-4e2d-af1e-16576ca9165c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71731) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 16:46:29 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Compute_service record updated for user:user {{(pid=71731) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 16:46:29 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.323s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:46:29 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:46:29 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Cleaning up deleted instances {{(pid=71731) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 13 16:46:29 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] There are 0 instances to clean {{(pid=71731) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 13 16:46:30 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:46:30 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:46:30 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71731) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 16:46:30 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-3eca2445-8b26-45a3-b67e-92a13c22ba96 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Acquiring lock "7ae7d3d9-54f7-4c64-8bf6-08fa5c526687" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:46:30 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-3eca2445-8b26-45a3-b67e-92a13c22ba96 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "7ae7d3d9-54f7-4c64-8bf6-08fa5c526687" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:46:30 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-3eca2445-8b26-45a3-b67e-92a13c22ba96 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Acquiring lock "7ae7d3d9-54f7-4c64-8bf6-08fa5c526687-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:46:30 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-3eca2445-8b26-45a3-b67e-92a13c22ba96 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "7ae7d3d9-54f7-4c64-8bf6-08fa5c526687-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:46:30 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-3eca2445-8b26-45a3-b67e-92a13c22ba96 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "7ae7d3d9-54f7-4c64-8bf6-08fa5c526687-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:46:30 user nova-compute[71731]: INFO nova.compute.manager [None req-3eca2445-8b26-45a3-b67e-92a13c22ba96 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: 7ae7d3d9-54f7-4c64-8bf6-08fa5c526687] Terminating instance
Apr 13 16:46:30 user nova-compute[71731]: DEBUG nova.compute.manager [None req-3eca2445-8b26-45a3-b67e-92a13c22ba96 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: 7ae7d3d9-54f7-4c64-8bf6-08fa5c526687] Start destroying the instance on the hypervisor. {{(pid=71731) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 16:46:31 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:46:31 user nova-compute[71731]: DEBUG nova.compute.manager [req-2c149d45-fc0a-4b7b-9b76-8d9240e6c9be req-47db9538-67d2-4f46-bbc6-d9de34621a11 service nova] [instance: 7ae7d3d9-54f7-4c64-8bf6-08fa5c526687] Received event network-vif-unplugged-f7ec2f7f-f505-44ed-b40d-7b91b2248cea {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:46:31 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-2c149d45-fc0a-4b7b-9b76-8d9240e6c9be req-47db9538-67d2-4f46-bbc6-d9de34621a11 service nova] Acquiring lock "7ae7d3d9-54f7-4c64-8bf6-08fa5c526687-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:46:31 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-2c149d45-fc0a-4b7b-9b76-8d9240e6c9be req-47db9538-67d2-4f46-bbc6-d9de34621a11 service nova] Lock "7ae7d3d9-54f7-4c64-8bf6-08fa5c526687-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:46:31 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-2c149d45-fc0a-4b7b-9b76-8d9240e6c9be req-47db9538-67d2-4f46-bbc6-d9de34621a11 service nova] Lock "7ae7d3d9-54f7-4c64-8bf6-08fa5c526687-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:46:31 user nova-compute[71731]: DEBUG nova.compute.manager [req-2c149d45-fc0a-4b7b-9b76-8d9240e6c9be req-47db9538-67d2-4f46-bbc6-d9de34621a11 service nova] [instance: 7ae7d3d9-54f7-4c64-8bf6-08fa5c526687] No waiting events found dispatching network-vif-unplugged-f7ec2f7f-f505-44ed-b40d-7b91b2248cea {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:46:31 user nova-compute[71731]: DEBUG nova.compute.manager [req-2c149d45-fc0a-4b7b-9b76-8d9240e6c9be req-47db9538-67d2-4f46-bbc6-d9de34621a11 service nova] [instance: 7ae7d3d9-54f7-4c64-8bf6-08fa5c526687] Received event network-vif-unplugged-f7ec2f7f-f505-44ed-b40d-7b91b2248cea for instance with task_state deleting. {{(pid=71731) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 16:46:31 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:46:31 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:46:31 user nova-compute[71731]: INFO nova.virt.libvirt.driver [-] [instance: 7ae7d3d9-54f7-4c64-8bf6-08fa5c526687] Instance destroyed successfully.
Apr 13 16:46:31 user nova-compute[71731]: DEBUG nova.objects.instance [None req-3eca2445-8b26-45a3-b67e-92a13c22ba96 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lazy-loading 'resources' on Instance uuid 7ae7d3d9-54f7-4c64-8bf6-08fa5c526687 {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:46:31 user nova-compute[71731]: DEBUG nova.virt.libvirt.vif [None req-3eca2445-8b26-45a3-b67e-92a13c22ba96 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T16:39:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-182216296',display_name='tempest-ServerActionsTestJSON-server-182216296',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-182216296',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPaDda4gTmMbkxKfok8i4i1XcNLza5lOVYjCPDEGVTF1JRQKderq80DnIN4GAkaZiBV5U44gvdu3wadL/M5wOH7VDSuEghHchow1mC9TB1xgdo8GoXeM279SVAyu08uhIQ==',key_name='tempest-keypair-1700037342',keypairs=<?>,launch_index=0,launched_at=2023-04-13T16:42:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='980559734a504574a83224deb7423c77',ramdisk_id='',reservation_id='r-r4a3hst0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestJSON-713402718',owner_user_name='tempest-ServerActionsTestJSON-713402718-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T16:43:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1b3df1c5c5d441819bcef89ed6966815',uuid=7ae7d3d9-54f7-4c64-8bf6-08fa5c526687,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f7ec2f7f-f505-44ed-b40d-7b91b2248cea", "address": "fa:16:3e:e2:cd:35", "network": {"id": "cf1fef97-9ef1-449f-a302-b38110024547", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1138167711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "980559734a504574a83224deb7423c77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7ec2f7f-f5", "ovs_interfaceid": "f7ec2f7f-f505-44ed-b40d-7b91b2248cea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 16:46:31 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-3eca2445-8b26-45a3-b67e-92a13c22ba96 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Converting VIF {"id": "f7ec2f7f-f505-44ed-b40d-7b91b2248cea", "address": "fa:16:3e:e2:cd:35", "network": {"id": "cf1fef97-9ef1-449f-a302-b38110024547", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1138167711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "980559734a504574a83224deb7423c77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7ec2f7f-f5", "ovs_interfaceid": "f7ec2f7f-f505-44ed-b40d-7b91b2248cea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 16:46:31 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-3eca2445-8b26-45a3-b67e-92a13c22ba96 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e2:cd:35,bridge_name='br-int',has_traffic_filtering=True,id=f7ec2f7f-f505-44ed-b40d-7b91b2248cea,network=Network(cf1fef97-9ef1-449f-a302-b38110024547),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf7ec2f7f-f5') {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 16:46:31 user nova-compute[71731]: DEBUG os_vif [None req-3eca2445-8b26-45a3-b67e-92a13c22ba96 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e2:cd:35,bridge_name='br-int',has_traffic_filtering=True,id=f7ec2f7f-f505-44ed-b40d-7b91b2248cea,network=Network(cf1fef97-9ef1-449f-a302-b38110024547),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf7ec2f7f-f5') {{(pid=71731) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 16:46:31 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:46:31 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf7ec2f7f-f5, bridge=br-int, if_exists=True) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:46:31 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:46:31 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 16:46:31 user nova-compute[71731]: INFO os_vif [None req-3eca2445-8b26-45a3-b67e-92a13c22ba96 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e2:cd:35,bridge_name='br-int',has_traffic_filtering=True,id=f7ec2f7f-f505-44ed-b40d-7b91b2248cea,network=Network(cf1fef97-9ef1-449f-a302-b38110024547),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf7ec2f7f-f5')
Apr 13 16:46:31 user nova-compute[71731]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3eca2445-8b26-45a3-b67e-92a13c22ba96 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: 7ae7d3d9-54f7-4c64-8bf6-08fa5c526687] calling os-brick to detach iSCSI Volume {{(pid=71731) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 16:46:31 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-3eca2445-8b26-45a3-b67e-92a13c22ba96 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8cf0118790>, {'target_iqn': 'iqn.2010-10.org.openstack:bebf46c7-444f-475a-9c3f-615d66556271', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ErRsaBJd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 16:46:31 user nova-compute[71731]: WARNING os_brick.initiator.connectors.base [None req-3eca2445-8b26-45a3-b67e-92a13c22ba96 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 16:46:31 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-3eca2445-8b26-45a3-b67e-92a13c22ba96 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 16:46:31 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-3eca2445-8b26-45a3-b67e-92a13c22ba96 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 16:46:31 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:46:31 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:46:31 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[47a1bd7e-80ae-4889-9727-108d3fc37c04]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:bebf46c7-444f-475a-9c3f-615d66556271\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:46:31 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-3eca2445-8b26-45a3-b67e-92a13c22ba96 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 16:46:31 user nova-compute[71731]: No targets found.
Apr 13 16:46:31 user nova-compute[71731]: iSNS:
Apr 13 16:46:31 user nova-compute[71731]: No targets found.
Apr 13 16:46:31 user nova-compute[71731]: STATIC:
Apr 13 16:46:31 user nova-compute[71731]: Target: iqn.2010-10.org.openstack:bebf46c7-444f-475a-9c3f-615d66556271
Apr 13 16:46:31 user nova-compute[71731]:         Portal: 172.16.0.220:3260,-1
Apr 13 16:46:31 user nova-compute[71731]:                 Iface Name: default
Apr 13 16:46:31 user nova-compute[71731]: FIRMWARE:
Apr 13 16:46:31 user nova-compute[71731]: No targets found.
Apr 13 16:46:31 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 16:46:31 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-3eca2445-8b26-45a3-b67e-92a13c22ba96 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 16:46:31 user nova-compute[71731]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 16:46:31 user nova-compute[71731]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71731) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 16:46:31 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-3eca2445-8b26-45a3-b67e-92a13c22ba96 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bebf46c7-444f-475a-9c3f-615d66556271', 0)] {{(pid=71731) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 16:46:31 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:46:31 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:46:31 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[9641f147-68d6-471c-83f2-77ab6a4fb7b2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bebf46c7-444f-475a-9c3f-615d66556271\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:46:31 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:46:31 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:46:31 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[185c7ed5-66ff-4680-8928-fb22a85031a8]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bebf46c7-444f-475a-9c3f-615d66556271 (non-flash)\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:46:31 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-3eca2445-8b26-45a3-b67e-92a13c22ba96 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bebf46c7-444f-475a-9c3f-615d66556271 (non-flash)
Apr 13 16:46:31 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 16:46:31 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-3eca2445-8b26-45a3-b67e-92a13c22ba96 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bebf46c7-444f-475a-9c3f-615d66556271 (non-flash)
Apr 13 16:46:31 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 16:46:31 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-3eca2445-8b26-45a3-b67e-92a13c22ba96 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8cf01e2c20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bebf46c7-444f-475a-9c3f-615d66556271'): ({'sdb'}, set())}) {{(pid=71731) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 16:46:31 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-3eca2445-8b26-45a3-b67e-92a13c22ba96 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Removing single pathed devices sdb {{(pid=71731) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 16:46:31 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:46:31 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:46:31 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f11c9ba-c56c-4d53-bccf-42c2f7f72e86]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:46:31 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:46:32 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:46:32 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[315a84ee-cbce-4b6b-8e51-ef202e79c888]: (4, ('ok\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:46:32 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-3eca2445-8b26-45a3-b67e-92a13c22ba96 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Flushing IO for device /dev/sdb {{(pid=71731) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 16:46:32 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:46:32 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:46:32 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Starting heal instance info cache {{(pid=71731) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 16:46:32 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Rebuilding the list of instances to heal {{(pid=71731) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 13 16:46:32 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:46:32 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[59bb207a-5242-4332-a17d-df7877bfd7d7]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:46:32 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-3eca2445-8b26-45a3-b67e-92a13c22ba96 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71731) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 16:46:32 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:46:32 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] [instance: 7ae7d3d9-54f7-4c64-8bf6-08fa5c526687] Skipping network cache update for instance because it is being deleted. {{(pid=71731) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9809}}
Apr 13 16:46:32 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.046s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:46:32 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e7791cd-62ce-468d-9441-7f2a1eb79850]: (4, ('1', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:46:32 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-3eca2445-8b26-45a3-b67e-92a13c22ba96 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71731) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 16:46:32 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-3eca2445-8b26-45a3-b67e-92a13c22ba96 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] SCSI volumes sdb have been removed. {{(pid=71731) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 16:46:32 user nova-compute[71731]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_da7a5db2', '/dev/disk/by-id/scsi-26533336631393931', '/dev/disk/by-id/scsi-1SCST_BIOda7a5db2-e33f1991e80a1e18') {{(pid=81776) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Apr 13 16:46:32 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a249e05-e234-42fc-b4e4-93957a11715a]: (4, None) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:46:32 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-3eca2445-8b26-45a3-b67e-92a13c22ba96 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bebf46c7-444f-475a-9c3f-615d66556271')] {{(pid=71731) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 16:46:32 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bebf46c7-444f-475a-9c3f-615d66556271 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:46:32 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bebf46c7-444f-475a-9c3f-615d66556271 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:46:32 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[7afea3b2-b249-45c2-b226-4b32b0294371]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:46:32 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-3eca2445-8b26-45a3-b67e-92a13c22ba96 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:46:32 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bebf46c7-444f-475a-9c3f-615d66556271 -p 172.16.0.220:3260 --logout {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:46:32 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Acquiring lock "refresh_cache-5ed800fe-577d-4624-898c-c7f40da77376" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 16:46:32 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Acquired lock "refresh_cache-5ed800fe-577d-4624-898c-c7f40da77376" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 16:46:32 user nova-compute[71731]: DEBUG nova.network.neutron [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] [instance: 5ed800fe-577d-4624-898c-c7f40da77376] Forcefully refreshing network info cache for instance {{(pid=71731) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 16:46:32 user nova-compute[71731]: DEBUG nova.objects.instance [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lazy-loading 'info_cache' on Instance uuid 5ed800fe-577d-4624-898c-c7f40da77376 {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:46:32 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bebf46c7-444f-475a-9c3f-615d66556271 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:46:32 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d65fe3a-f9bd-4310-a6cf-23312f21f5d4]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:bebf46c7-444f-475a-9c3f-615d66556271, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:bebf46c7-444f-475a-9c3f-615d66556271, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:46:32 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-3eca2445-8b26-45a3-b67e-92a13c22ba96 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:bebf46c7-444f-475a-9c3f-615d66556271, portal: 172.16.0.220,3260]
Apr 13 16:46:32 user nova-compute[71731]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:bebf46c7-444f-475a-9c3f-615d66556271, portal: 172.16.0.220,3260] successful.
Apr 13 16:46:32 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:46:32 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bebf46c7-444f-475a-9c3f-615d66556271 -p 172.16.0.220:3260 --op delete {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:46:32 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:46:32 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bebf46c7-444f-475a-9c3f-615d66556271 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:46:32 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[261823ab-275c-4614-ae35-0ce0d8fd223e]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:46:32 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-3eca2445-8b26-45a3-b67e-92a13c22ba96 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:46:32 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-3eca2445-8b26-45a3-b67e-92a13c22ba96 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.332s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 16:46:32 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-3eca2445-8b26-45a3-b67e-92a13c22ba96 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] <== disconnect_volume: return (335ms) None {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 16:46:32 user nova-compute[71731]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3eca2445-8b26-45a3-b67e-92a13c22ba96 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: 7ae7d3d9-54f7-4c64-8bf6-08fa5c526687] Disconnected iSCSI Volume {{(pid=71731) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 16:46:32 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-3eca2445-8b26-45a3-b67e-92a13c22ba96 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: 7ae7d3d9-54f7-4c64-8bf6-08fa5c526687] Deleting instance files /opt/stack/data/nova/instances/7ae7d3d9-54f7-4c64-8bf6-08fa5c526687_del
Apr 13 16:46:32 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-3eca2445-8b26-45a3-b67e-92a13c22ba96 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: 7ae7d3d9-54f7-4c64-8bf6-08fa5c526687] Deletion of /opt/stack/data/nova/instances/7ae7d3d9-54f7-4c64-8bf6-08fa5c526687_del complete
Apr 13 16:46:32 user nova-compute[71731]: INFO nova.compute.manager [None req-3eca2445-8b26-45a3-b67e-92a13c22ba96 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: 7ae7d3d9-54f7-4c64-8bf6-08fa5c526687] Took 1.33 seconds to destroy the instance on the hypervisor.
Apr 13 16:46:32 user nova-compute[71731]: DEBUG oslo.service.loopingcall [None req-3eca2445-8b26-45a3-b67e-92a13c22ba96 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71731) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 16:46:32 user nova-compute[71731]: DEBUG nova.compute.manager [-] [instance: 7ae7d3d9-54f7-4c64-8bf6-08fa5c526687] Deallocating network for instance {{(pid=71731) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 16:46:32 user nova-compute[71731]: DEBUG nova.network.neutron [-] [instance: 7ae7d3d9-54f7-4c64-8bf6-08fa5c526687] deallocate_for_instance() {{(pid=71731) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 16:46:32 user nova-compute[71731]: DEBUG nova.network.neutron [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] [instance: 5ed800fe-577d-4624-898c-c7f40da77376] Updating instance_info_cache with network_info: [{"id": "09531419-c0ff-4d13-89bd-06caa28e019d", "address": "fa:16:3e:13:b1:31", "network": {"id": "cf1fef97-9ef1-449f-a302-b38110024547", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1138167711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "980559734a504574a83224deb7423c77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09531419-c0", "ovs_interfaceid": "09531419-c0ff-4d13-89bd-06caa28e019d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:46:32 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Releasing lock "refresh_cache-5ed800fe-577d-4624-898c-c7f40da77376" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 16:46:32 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] [instance: 5ed800fe-577d-4624-898c-c7f40da77376] Updated the network info_cache for instance {{(pid=71731) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 16:46:33 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:46:33 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:46:33 user nova-compute[71731]: DEBUG nova.network.neutron [-] [instance: 7ae7d3d9-54f7-4c64-8bf6-08fa5c526687] Updating instance_info_cache with network_info: [] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:46:33 user nova-compute[71731]: INFO nova.compute.manager [-] [instance: 7ae7d3d9-54f7-4c64-8bf6-08fa5c526687] Took 0.99 seconds to deallocate network for instance.
Apr 13 16:46:33 user nova-compute[71731]: DEBUG nova.compute.manager [req-aa833fd4-3a72-4b06-bf73-87f658f8498f req-592e2ee6-a23b-4148-a409-4d5bb4f6e8dd service nova] [instance: 7ae7d3d9-54f7-4c64-8bf6-08fa5c526687] Received event network-vif-deleted-f7ec2f7f-f505-44ed-b40d-7b91b2248cea {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:46:33 user nova-compute[71731]: DEBUG nova.compute.manager [req-00019b7f-5176-44f9-9810-3df5265c2d83 req-0d8e2dae-06b0-484e-950d-4e0b996b60ec service nova] [instance: 7ae7d3d9-54f7-4c64-8bf6-08fa5c526687] Received event network-vif-plugged-f7ec2f7f-f505-44ed-b40d-7b91b2248cea {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:46:33 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-00019b7f-5176-44f9-9810-3df5265c2d83 req-0d8e2dae-06b0-484e-950d-4e0b996b60ec service nova] Acquiring lock "7ae7d3d9-54f7-4c64-8bf6-08fa5c526687-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:46:33 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-00019b7f-5176-44f9-9810-3df5265c2d83 req-0d8e2dae-06b0-484e-950d-4e0b996b60ec service nova] Lock "7ae7d3d9-54f7-4c64-8bf6-08fa5c526687-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:46:33 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-00019b7f-5176-44f9-9810-3df5265c2d83 req-0d8e2dae-06b0-484e-950d-4e0b996b60ec service nova] Lock "7ae7d3d9-54f7-4c64-8bf6-08fa5c526687-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:46:33 user nova-compute[71731]: DEBUG nova.compute.manager [req-00019b7f-5176-44f9-9810-3df5265c2d83 req-0d8e2dae-06b0-484e-950d-4e0b996b60ec service nova] [instance: 7ae7d3d9-54f7-4c64-8bf6-08fa5c526687] No waiting events found dispatching network-vif-plugged-f7ec2f7f-f505-44ed-b40d-7b91b2248cea {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:46:33 user nova-compute[71731]: WARNING nova.compute.manager [req-00019b7f-5176-44f9-9810-3df5265c2d83 req-0d8e2dae-06b0-484e-950d-4e0b996b60ec service nova] [instance: 7ae7d3d9-54f7-4c64-8bf6-08fa5c526687] Received unexpected event network-vif-plugged-f7ec2f7f-f505-44ed-b40d-7b91b2248cea for instance with vm_state active and task_state deleting.
Apr 13 16:46:34 user nova-compute[71731]: INFO nova.compute.manager [None req-3eca2445-8b26-45a3-b67e-92a13c22ba96 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: 7ae7d3d9-54f7-4c64-8bf6-08fa5c526687] Took 0.77 seconds to detach 1 volumes for instance.
Apr 13 16:46:34 user nova-compute[71731]: DEBUG nova.compute.manager [None req-3eca2445-8b26-45a3-b67e-92a13c22ba96 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: 7ae7d3d9-54f7-4c64-8bf6-08fa5c526687] Deleting volume: bebf46c7-444f-475a-9c3f-615d66556271 {{(pid=71731) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3202}}
Apr 13 16:46:34 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-3eca2445-8b26-45a3-b67e-92a13c22ba96 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:46:34 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-3eca2445-8b26-45a3-b67e-92a13c22ba96 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:46:34 user nova-compute[71731]: DEBUG nova.compute.provider_tree [None req-3eca2445-8b26-45a3-b67e-92a13c22ba96 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Inventory has not changed in ProviderTree for provider: cb6b1a64-0c24-4e2d-af1e-16576ca9165c {{(pid=71731) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 16:46:34 user nova-compute[71731]: DEBUG nova.scheduler.client.report [None req-3eca2445-8b26-45a3-b67e-92a13c22ba96 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Inventory has not changed for provider cb6b1a64-0c24-4e2d-af1e-16576ca9165c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71731) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 16:46:34 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-3eca2445-8b26-45a3-b67e-92a13c22ba96 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.217s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:46:34 user nova-compute[71731]: INFO nova.scheduler.client.report [None req-3eca2445-8b26-45a3-b67e-92a13c22ba96 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Deleted allocations for instance 7ae7d3d9-54f7-4c64-8bf6-08fa5c526687
Apr 13 16:46:34 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-3eca2445-8b26-45a3-b67e-92a13c22ba96 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "7ae7d3d9-54f7-4c64-8bf6-08fa5c526687" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.543s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:46:35 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:46:36 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:46:37 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:46:37 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:46:40 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:46:41 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:46:42 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:46:46 user nova-compute[71731]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681404391.8068404, 7ae7d3d9-54f7-4c64-8bf6-08fa5c526687 => Stopped> {{(pid=71731) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 16:46:46 user nova-compute[71731]: INFO nova.compute.manager [-] [instance: 7ae7d3d9-54f7-4c64-8bf6-08fa5c526687] VM Stopped (Lifecycle Event)
Apr 13 16:46:46 user nova-compute[71731]: DEBUG nova.compute.manager [None req-0840e1ba-f0b2-4fd8-ba48-4ed8013e3011 None None] [instance: 7ae7d3d9-54f7-4c64-8bf6-08fa5c526687] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:46:46 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 16:46:46 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:46:46 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71731) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 16:46:46 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71731) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 16:46:46 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71731) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 16:46:46 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 16:46:47 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:46:48 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:46:48 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Cleaning up deleted instances with incomplete migration  {{(pid=71731) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 13 16:46:51 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:46:52 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:46:56 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:46:57 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:47:01 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 16:47:02 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:47:06 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:47:11 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 16:47:16 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 16:47:21 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-f59981bc-ad59-406c-b688-e1790f57e724 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Acquiring lock "5ed800fe-577d-4624-898c-c7f40da77376" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:47:21 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-f59981bc-ad59-406c-b688-e1790f57e724 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "5ed800fe-577d-4624-898c-c7f40da77376" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:47:21 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-f59981bc-ad59-406c-b688-e1790f57e724 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Acquiring lock "5ed800fe-577d-4624-898c-c7f40da77376-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:47:21 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-f59981bc-ad59-406c-b688-e1790f57e724 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "5ed800fe-577d-4624-898c-c7f40da77376-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:47:21 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-f59981bc-ad59-406c-b688-e1790f57e724 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "5ed800fe-577d-4624-898c-c7f40da77376-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:47:21 user nova-compute[71731]: INFO nova.compute.manager [None req-f59981bc-ad59-406c-b688-e1790f57e724 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: 5ed800fe-577d-4624-898c-c7f40da77376] Terminating instance
Apr 13 16:47:21 user nova-compute[71731]: DEBUG nova.compute.manager [None req-f59981bc-ad59-406c-b688-e1790f57e724 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: 5ed800fe-577d-4624-898c-c7f40da77376] Start destroying the instance on the hypervisor. {{(pid=71731) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 16:47:21 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:47:21 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:47:21 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:47:21 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:47:21 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:47:21 user nova-compute[71731]: DEBUG nova.compute.manager [req-15009e63-06e7-45f5-bdca-e461306cf866 req-eb74cd4a-fa7b-469c-b388-8a510ef73239 service nova] [instance: 5ed800fe-577d-4624-898c-c7f40da77376] Received event network-vif-unplugged-09531419-c0ff-4d13-89bd-06caa28e019d {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:47:21 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-15009e63-06e7-45f5-bdca-e461306cf866 req-eb74cd4a-fa7b-469c-b388-8a510ef73239 service nova] Acquiring lock "5ed800fe-577d-4624-898c-c7f40da77376-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:47:21 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-15009e63-06e7-45f5-bdca-e461306cf866 req-eb74cd4a-fa7b-469c-b388-8a510ef73239 service nova] Lock "5ed800fe-577d-4624-898c-c7f40da77376-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:47:21 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-15009e63-06e7-45f5-bdca-e461306cf866 req-eb74cd4a-fa7b-469c-b388-8a510ef73239 service nova] Lock "5ed800fe-577d-4624-898c-c7f40da77376-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:47:21 user nova-compute[71731]: DEBUG nova.compute.manager [req-15009e63-06e7-45f5-bdca-e461306cf866 req-eb74cd4a-fa7b-469c-b388-8a510ef73239 service nova] [instance: 5ed800fe-577d-4624-898c-c7f40da77376] No waiting events found dispatching network-vif-unplugged-09531419-c0ff-4d13-89bd-06caa28e019d {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:47:21 user nova-compute[71731]: DEBUG nova.compute.manager [req-15009e63-06e7-45f5-bdca-e461306cf866 req-eb74cd4a-fa7b-469c-b388-8a510ef73239 service nova] [instance: 5ed800fe-577d-4624-898c-c7f40da77376] Received event network-vif-unplugged-09531419-c0ff-4d13-89bd-06caa28e019d for instance with task_state deleting. {{(pid=71731) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 16:47:22 user nova-compute[71731]: INFO nova.virt.libvirt.driver [-] [instance: 5ed800fe-577d-4624-898c-c7f40da77376] Instance destroyed successfully.
Apr 13 16:47:22 user nova-compute[71731]: DEBUG nova.objects.instance [None req-f59981bc-ad59-406c-b688-e1790f57e724 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lazy-loading 'resources' on Instance uuid 5ed800fe-577d-4624-898c-c7f40da77376 {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:47:22 user nova-compute[71731]: DEBUG nova.virt.libvirt.vif [None req-f59981bc-ad59-406c-b688-e1790f57e724 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T16:38:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-845961470',display_name='tempest-ServerActionsTestJSON-server-845961470',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-845961470',id=33,image_ref='708622a9-7465-4492-ade8-b827198f7e30',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPaDda4gTmMbkxKfok8i4i1XcNLza5lOVYjCPDEGVTF1JRQKderq80DnIN4GAkaZiBV5U44gvdu3wadL/M5wOH7VDSuEghHchow1mC9TB1xgdo8GoXeM279SVAyu08uhIQ==',key_name='tempest-keypair-1700037342',keypairs=<?>,launch_index=0,launched_at=2023-04-13T16:38:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='980559734a504574a83224deb7423c77',ramdisk_id='',reservation_id='r-1g3u1088',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='708622a9-7465-4492-ade8-b827198f7e30',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestJSON-713402718',owner_user_name='tempest-ServerActionsTestJSON-713402718-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T16:38:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1b3df1c5c5d441819bcef89ed6966815',uuid=5ed800fe-577d-4624-898c-c7f40da77376,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "09531419-c0ff-4d13-89bd-06caa28e019d", "address": "fa:16:3e:13:b1:31", "network": {"id": "cf1fef97-9ef1-449f-a302-b38110024547", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1138167711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "980559734a504574a83224deb7423c77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09531419-c0", "ovs_interfaceid": "09531419-c0ff-4d13-89bd-06caa28e019d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 16:47:22 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-f59981bc-ad59-406c-b688-e1790f57e724 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Converting VIF {"id": "09531419-c0ff-4d13-89bd-06caa28e019d", "address": "fa:16:3e:13:b1:31", "network": {"id": "cf1fef97-9ef1-449f-a302-b38110024547", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1138167711-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "980559734a504574a83224deb7423c77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09531419-c0", "ovs_interfaceid": "09531419-c0ff-4d13-89bd-06caa28e019d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 16:47:22 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-f59981bc-ad59-406c-b688-e1790f57e724 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:13:b1:31,bridge_name='br-int',has_traffic_filtering=True,id=09531419-c0ff-4d13-89bd-06caa28e019d,network=Network(cf1fef97-9ef1-449f-a302-b38110024547),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09531419-c0') {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 16:47:22 user nova-compute[71731]: DEBUG os_vif [None req-f59981bc-ad59-406c-b688-e1790f57e724 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:13:b1:31,bridge_name='br-int',has_traffic_filtering=True,id=09531419-c0ff-4d13-89bd-06caa28e019d,network=Network(cf1fef97-9ef1-449f-a302-b38110024547),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09531419-c0') {{(pid=71731) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 16:47:22 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:47:22 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap09531419-c0, bridge=br-int, if_exists=True) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:47:22 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:47:22 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 16:47:22 user nova-compute[71731]: INFO os_vif [None req-f59981bc-ad59-406c-b688-e1790f57e724 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:13:b1:31,bridge_name='br-int',has_traffic_filtering=True,id=09531419-c0ff-4d13-89bd-06caa28e019d,network=Network(cf1fef97-9ef1-449f-a302-b38110024547),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09531419-c0')
Apr 13 16:47:22 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-f59981bc-ad59-406c-b688-e1790f57e724 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: 5ed800fe-577d-4624-898c-c7f40da77376] Deleting instance files /opt/stack/data/nova/instances/5ed800fe-577d-4624-898c-c7f40da77376_del
Apr 13 16:47:22 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-f59981bc-ad59-406c-b688-e1790f57e724 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: 5ed800fe-577d-4624-898c-c7f40da77376] Deletion of /opt/stack/data/nova/instances/5ed800fe-577d-4624-898c-c7f40da77376_del complete
Apr 13 16:47:22 user nova-compute[71731]: INFO nova.compute.manager [None req-f59981bc-ad59-406c-b688-e1790f57e724 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] [instance: 5ed800fe-577d-4624-898c-c7f40da77376] Took 0.84 seconds to destroy the instance on the hypervisor.
Apr 13 16:47:22 user nova-compute[71731]: DEBUG oslo.service.loopingcall [None req-f59981bc-ad59-406c-b688-e1790f57e724 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71731) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 16:47:22 user nova-compute[71731]: DEBUG nova.compute.manager [-] [instance: 5ed800fe-577d-4624-898c-c7f40da77376] Deallocating network for instance {{(pid=71731) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 16:47:22 user nova-compute[71731]: DEBUG nova.network.neutron [-] [instance: 5ed800fe-577d-4624-898c-c7f40da77376] deallocate_for_instance() {{(pid=71731) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 16:47:22 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:47:22 user nova-compute[71731]: DEBUG nova.network.neutron [-] [instance: 5ed800fe-577d-4624-898c-c7f40da77376] Updating instance_info_cache with network_info: [] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:47:22 user nova-compute[71731]: INFO nova.compute.manager [-] [instance: 5ed800fe-577d-4624-898c-c7f40da77376] Took 0.47 seconds to deallocate network for instance.
Apr 13 16:47:22 user nova-compute[71731]: DEBUG nova.compute.manager [req-1e9f2583-6f61-4c7a-b1ed-320ea90dfadb req-25a19d28-56a9-469b-9e19-250a7c9e34e9 service nova] [instance: 5ed800fe-577d-4624-898c-c7f40da77376] Received event network-vif-deleted-09531419-c0ff-4d13-89bd-06caa28e019d {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:47:22 user nova-compute[71731]: INFO nova.compute.manager [req-1e9f2583-6f61-4c7a-b1ed-320ea90dfadb req-25a19d28-56a9-469b-9e19-250a7c9e34e9 service nova] [instance: 5ed800fe-577d-4624-898c-c7f40da77376] Neutron deleted interface 09531419-c0ff-4d13-89bd-06caa28e019d; detaching it from the instance and deleting it from the info cache
Apr 13 16:47:22 user nova-compute[71731]: DEBUG nova.network.neutron [req-1e9f2583-6f61-4c7a-b1ed-320ea90dfadb req-25a19d28-56a9-469b-9e19-250a7c9e34e9 service nova] [instance: 5ed800fe-577d-4624-898c-c7f40da77376] Updating instance_info_cache with network_info: [] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:47:22 user nova-compute[71731]: DEBUG nova.compute.manager [req-1e9f2583-6f61-4c7a-b1ed-320ea90dfadb req-25a19d28-56a9-469b-9e19-250a7c9e34e9 service nova] [instance: 5ed800fe-577d-4624-898c-c7f40da77376] Detach interface failed, port_id=09531419-c0ff-4d13-89bd-06caa28e019d, reason: Instance 5ed800fe-577d-4624-898c-c7f40da77376 could not be found. {{(pid=71731) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 13 16:47:22 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-f59981bc-ad59-406c-b688-e1790f57e724 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:47:22 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-f59981bc-ad59-406c-b688-e1790f57e724 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:47:23 user nova-compute[71731]: DEBUG nova.compute.provider_tree [None req-f59981bc-ad59-406c-b688-e1790f57e724 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Inventory has not changed in ProviderTree for provider: cb6b1a64-0c24-4e2d-af1e-16576ca9165c {{(pid=71731) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 16:47:23 user nova-compute[71731]: DEBUG nova.scheduler.client.report [None req-f59981bc-ad59-406c-b688-e1790f57e724 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Inventory has not changed for provider cb6b1a64-0c24-4e2d-af1e-16576ca9165c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71731) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 16:47:23 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-f59981bc-ad59-406c-b688-e1790f57e724 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.238s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:47:23 user nova-compute[71731]: INFO nova.scheduler.client.report [None req-f59981bc-ad59-406c-b688-e1790f57e724 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Deleted allocations for instance 5ed800fe-577d-4624-898c-c7f40da77376
Apr 13 16:47:23 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-f59981bc-ad59-406c-b688-e1790f57e724 tempest-ServerActionsTestJSON-713402718 tempest-ServerActionsTestJSON-713402718-project-member] Lock "5ed800fe-577d-4624-898c-c7f40da77376" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.738s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:47:23 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._sync_power_states {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:47:23 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Triggering sync for uuid b2d55cdd-c89c-4c59-afe1-49a33225af22 {{(pid=71731) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 13 16:47:23 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Triggering sync for uuid 3af23ff8-4e10-4fbf-a86e-bda842f084ff {{(pid=71731) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 13 16:47:23 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Triggering sync for uuid 6e4776e8-d528-4110-90a3-daf4d1df0171 {{(pid=71731) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 13 16:47:23 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Acquiring lock "b2d55cdd-c89c-4c59-afe1-49a33225af22" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:47:23 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "b2d55cdd-c89c-4c59-afe1-49a33225af22" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:47:23 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Acquiring lock "3af23ff8-4e10-4fbf-a86e-bda842f084ff" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:47:23 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "3af23ff8-4e10-4fbf-a86e-bda842f084ff" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:47:23 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Acquiring lock "6e4776e8-d528-4110-90a3-daf4d1df0171" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:47:23 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "6e4776e8-d528-4110-90a3-daf4d1df0171" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:47:23 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "b2d55cdd-c89c-4c59-afe1-49a33225af22" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.026s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:47:23 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "3af23ff8-4e10-4fbf-a86e-bda842f084ff" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.027s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:47:23 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "6e4776e8-d528-4110-90a3-daf4d1df0171" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.030s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:47:23 user nova-compute[71731]: DEBUG nova.compute.manager [req-533d1b41-32f3-443e-8492-9a76d15a0d20 req-2af81620-a3e5-48f8-a022-0cf319a755b7 service nova] [instance: 5ed800fe-577d-4624-898c-c7f40da77376] Received event network-vif-plugged-09531419-c0ff-4d13-89bd-06caa28e019d {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:47:23 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-533d1b41-32f3-443e-8492-9a76d15a0d20 req-2af81620-a3e5-48f8-a022-0cf319a755b7 service nova] Acquiring lock "5ed800fe-577d-4624-898c-c7f40da77376-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:47:23 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-533d1b41-32f3-443e-8492-9a76d15a0d20 req-2af81620-a3e5-48f8-a022-0cf319a755b7 service nova] Lock "5ed800fe-577d-4624-898c-c7f40da77376-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:47:23 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-533d1b41-32f3-443e-8492-9a76d15a0d20 req-2af81620-a3e5-48f8-a022-0cf319a755b7 service nova] Lock "5ed800fe-577d-4624-898c-c7f40da77376-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:47:23 user nova-compute[71731]: DEBUG nova.compute.manager [req-533d1b41-32f3-443e-8492-9a76d15a0d20 req-2af81620-a3e5-48f8-a022-0cf319a755b7 service nova] [instance: 5ed800fe-577d-4624-898c-c7f40da77376] No waiting events found dispatching network-vif-plugged-09531419-c0ff-4d13-89bd-06caa28e019d {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:47:23 user nova-compute[71731]: WARNING nova.compute.manager [req-533d1b41-32f3-443e-8492-9a76d15a0d20 req-2af81620-a3e5-48f8-a022-0cf319a755b7 service nova] [instance: 5ed800fe-577d-4624-898c-c7f40da77376] Received unexpected event network-vif-plugged-09531419-c0ff-4d13-89bd-06caa28e019d for instance with vm_state deleted and task_state None.
Apr 13 16:47:26 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:47:27 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:47:27 user nova-compute[71731]: INFO nova.compute.manager [None req-35bc6642-5345-4176-88d4-75e63794ed53 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] [instance: b2d55cdd-c89c-4c59-afe1-49a33225af22] Unrescuing
Apr 13 16:47:27 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-35bc6642-5345-4176-88d4-75e63794ed53 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Acquiring lock "refresh_cache-b2d55cdd-c89c-4c59-afe1-49a33225af22" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 16:47:27 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-35bc6642-5345-4176-88d4-75e63794ed53 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Acquired lock "refresh_cache-b2d55cdd-c89c-4c59-afe1-49a33225af22" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 16:47:27 user nova-compute[71731]: DEBUG nova.network.neutron [None req-35bc6642-5345-4176-88d4-75e63794ed53 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] [instance: b2d55cdd-c89c-4c59-afe1-49a33225af22] Building network info cache for instance {{(pid=71731) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 16:47:28 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager.update_available_resource {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:47:28 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:47:28 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:47:28 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:47:28 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Auditing locally available compute resources for user (node: user) {{(pid=71731) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 16:47:28 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e4776e8-d528-4110-90a3-daf4d1df0171/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:47:28 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e4776e8-d528-4110-90a3-daf4d1df0171/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:47:28 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e4776e8-d528-4110-90a3-daf4d1df0171/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:47:28 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e4776e8-d528-4110-90a3-daf4d1df0171/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:47:28 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3af23ff8-4e10-4fbf-a86e-bda842f084ff/disk.rescue --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:47:28 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3af23ff8-4e10-4fbf-a86e-bda842f084ff/disk.rescue --force-share --output=json" returned: 0 in 0.135s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:47:28 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3af23ff8-4e10-4fbf-a86e-bda842f084ff/disk.rescue --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:47:28 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3af23ff8-4e10-4fbf-a86e-bda842f084ff/disk.rescue --force-share --output=json" returned: 0 in 0.133s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:47:28 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3af23ff8-4e10-4fbf-a86e-bda842f084ff/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:47:28 user nova-compute[71731]: DEBUG nova.network.neutron [None req-35bc6642-5345-4176-88d4-75e63794ed53 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] [instance: b2d55cdd-c89c-4c59-afe1-49a33225af22] Updating instance_info_cache with network_info: [{"id": "31e1957f-9bd1-42ae-a2ac-954b49ca15f1", "address": "fa:16:3e:81:e2:10", "network": {"id": "2a5b69f1-fc5b-4c33-a9eb-12a4d9293500", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2137344591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "846732ecb7e047128b4684972d3cd8c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31e1957f-9b", "ovs_interfaceid": "31e1957f-9bd1-42ae-a2ac-954b49ca15f1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:47:28 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-35bc6642-5345-4176-88d4-75e63794ed53 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Releasing lock "refresh_cache-b2d55cdd-c89c-4c59-afe1-49a33225af22" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 16:47:28 user nova-compute[71731]: DEBUG nova.objects.instance [None req-35bc6642-5345-4176-88d4-75e63794ed53 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lazy-loading 'flavor' on Instance uuid b2d55cdd-c89c-4c59-afe1-49a33225af22 {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:47:28 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3af23ff8-4e10-4fbf-a86e-bda842f084ff/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:47:28 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3af23ff8-4e10-4fbf-a86e-bda842f084ff/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:47:28 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:47:28 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3af23ff8-4e10-4fbf-a86e-bda842f084ff/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:47:29 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2d55cdd-c89c-4c59-afe1-49a33225af22/disk.rescue --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:47:29 user nova-compute[71731]: DEBUG nova.compute.manager [req-5e71b076-ca17-4f50-a0fa-682683ab944d req-4809452f-f8e4-44b7-b48e-af82bbf319b8 service nova] [instance: b2d55cdd-c89c-4c59-afe1-49a33225af22] Received event network-vif-unplugged-31e1957f-9bd1-42ae-a2ac-954b49ca15f1 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:47:29 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-5e71b076-ca17-4f50-a0fa-682683ab944d req-4809452f-f8e4-44b7-b48e-af82bbf319b8 service nova] Acquiring lock "b2d55cdd-c89c-4c59-afe1-49a33225af22-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:47:29 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-5e71b076-ca17-4f50-a0fa-682683ab944d req-4809452f-f8e4-44b7-b48e-af82bbf319b8 service nova] Lock "b2d55cdd-c89c-4c59-afe1-49a33225af22-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:47:29 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-5e71b076-ca17-4f50-a0fa-682683ab944d req-4809452f-f8e4-44b7-b48e-af82bbf319b8 service nova] Lock "b2d55cdd-c89c-4c59-afe1-49a33225af22-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:47:29 user nova-compute[71731]: DEBUG nova.compute.manager [req-5e71b076-ca17-4f50-a0fa-682683ab944d req-4809452f-f8e4-44b7-b48e-af82bbf319b8 service nova] [instance: b2d55cdd-c89c-4c59-afe1-49a33225af22] No waiting events found dispatching network-vif-unplugged-31e1957f-9bd1-42ae-a2ac-954b49ca15f1 {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:47:29 user nova-compute[71731]: WARNING nova.compute.manager [req-5e71b076-ca17-4f50-a0fa-682683ab944d req-4809452f-f8e4-44b7-b48e-af82bbf319b8 service nova] [instance: b2d55cdd-c89c-4c59-afe1-49a33225af22] Received unexpected event network-vif-unplugged-31e1957f-9bd1-42ae-a2ac-954b49ca15f1 for instance with vm_state rescued and task_state unrescuing.
Apr 13 16:47:29 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:47:29 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:47:29 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2d55cdd-c89c-4c59-afe1-49a33225af22/disk.rescue --force-share --output=json" returned: 0 in 0.167s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:47:29 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2d55cdd-c89c-4c59-afe1-49a33225af22/disk.rescue --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:47:29 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2d55cdd-c89c-4c59-afe1-49a33225af22/disk.rescue --force-share --output=json" returned: 0 in 0.162s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:47:29 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2d55cdd-c89c-4c59-afe1-49a33225af22/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:47:29 user nova-compute[71731]: INFO nova.virt.libvirt.driver [-] [instance: b2d55cdd-c89c-4c59-afe1-49a33225af22] Instance destroyed successfully.
Apr 13 16:47:29 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2d55cdd-c89c-4c59-afe1-49a33225af22/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:47:29 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2d55cdd-c89c-4c59-afe1-49a33225af22/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:47:29 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2d55cdd-c89c-4c59-afe1-49a33225af22/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:47:33 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:47:33 user nova-compute[71731]: DEBUG nova.virt.libvirt.host [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Removed pending event for b2d55cdd-c89c-4c59-afe1-49a33225af22 due to event {{(pid=71731) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 13 16:47:33 user nova-compute[71731]: DEBUG nova.virt.driver [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Emitting event <LifecycleEvent: 1681404453.2167234, b2d55cdd-c89c-4c59-afe1-49a33225af22 => Resumed> {{(pid=71731) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 16:47:33 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: b2d55cdd-c89c-4c59-afe1-49a33225af22] VM Resumed (Lifecycle Event)
Apr 13 16:47:33 user nova-compute[71731]: DEBUG nova.compute.manager [None req-35bc6642-5345-4176-88d4-75e63794ed53 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] [instance: b2d55cdd-c89c-4c59-afe1-49a33225af22] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:47:33 user nova-compute[71731]: DEBUG nova.compute.manager [req-367abee9-a7a4-46ce-a436-c37cec26413e req-dfa37c31-84e5-4ae3-b8eb-f8cc69ceab5e service nova] [instance: b2d55cdd-c89c-4c59-afe1-49a33225af22] Received event network-vif-plugged-31e1957f-9bd1-42ae-a2ac-954b49ca15f1 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:47:33 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-367abee9-a7a4-46ce-a436-c37cec26413e req-dfa37c31-84e5-4ae3-b8eb-f8cc69ceab5e service nova] Acquiring lock "b2d55cdd-c89c-4c59-afe1-49a33225af22-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:47:33 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-367abee9-a7a4-46ce-a436-c37cec26413e req-dfa37c31-84e5-4ae3-b8eb-f8cc69ceab5e service nova] Lock "b2d55cdd-c89c-4c59-afe1-49a33225af22-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:47:33 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-367abee9-a7a4-46ce-a436-c37cec26413e req-dfa37c31-84e5-4ae3-b8eb-f8cc69ceab5e service nova] Lock "b2d55cdd-c89c-4c59-afe1-49a33225af22-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:47:33 user nova-compute[71731]: DEBUG nova.compute.manager [req-367abee9-a7a4-46ce-a436-c37cec26413e req-dfa37c31-84e5-4ae3-b8eb-f8cc69ceab5e service nova] [instance: b2d55cdd-c89c-4c59-afe1-49a33225af22] No waiting events found dispatching network-vif-plugged-31e1957f-9bd1-42ae-a2ac-954b49ca15f1 {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:47:33 user nova-compute[71731]: WARNING nova.compute.manager [req-367abee9-a7a4-46ce-a436-c37cec26413e req-dfa37c31-84e5-4ae3-b8eb-f8cc69ceab5e service nova] [instance: b2d55cdd-c89c-4c59-afe1-49a33225af22] Received unexpected event network-vif-plugged-31e1957f-9bd1-42ae-a2ac-954b49ca15f1 for instance with vm_state rescued and task_state unrescuing.
Apr 13 16:47:33 user nova-compute[71731]: DEBUG nova.compute.manager [req-367abee9-a7a4-46ce-a436-c37cec26413e req-dfa37c31-84e5-4ae3-b8eb-f8cc69ceab5e service nova] [instance: b2d55cdd-c89c-4c59-afe1-49a33225af22] Received event network-vif-plugged-31e1957f-9bd1-42ae-a2ac-954b49ca15f1 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:47:33 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-367abee9-a7a4-46ce-a436-c37cec26413e req-dfa37c31-84e5-4ae3-b8eb-f8cc69ceab5e service nova] Acquiring lock "b2d55cdd-c89c-4c59-afe1-49a33225af22-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:47:33 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-367abee9-a7a4-46ce-a436-c37cec26413e req-dfa37c31-84e5-4ae3-b8eb-f8cc69ceab5e service nova] Lock "b2d55cdd-c89c-4c59-afe1-49a33225af22-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:47:33 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-367abee9-a7a4-46ce-a436-c37cec26413e req-dfa37c31-84e5-4ae3-b8eb-f8cc69ceab5e service nova] Lock "b2d55cdd-c89c-4c59-afe1-49a33225af22-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:47:33 user nova-compute[71731]: DEBUG nova.compute.manager [req-367abee9-a7a4-46ce-a436-c37cec26413e req-dfa37c31-84e5-4ae3-b8eb-f8cc69ceab5e service nova] [instance: b2d55cdd-c89c-4c59-afe1-49a33225af22] No waiting events found dispatching network-vif-plugged-31e1957f-9bd1-42ae-a2ac-954b49ca15f1 {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:47:33 user nova-compute[71731]: WARNING nova.compute.manager [req-367abee9-a7a4-46ce-a436-c37cec26413e req-dfa37c31-84e5-4ae3-b8eb-f8cc69ceab5e service nova] [instance: b2d55cdd-c89c-4c59-afe1-49a33225af22] Received unexpected event network-vif-plugged-31e1957f-9bd1-42ae-a2ac-954b49ca15f1 for instance with vm_state rescued and task_state unrescuing.
Apr 13 16:47:33 user nova-compute[71731]: DEBUG nova.compute.manager [req-11881430-874c-47d4-9ca3-db452d8fe917 req-847b3d42-e70c-42ae-98da-0f6e713ce31c service nova] [instance: b2d55cdd-c89c-4c59-afe1-49a33225af22] Received event network-vif-plugged-31e1957f-9bd1-42ae-a2ac-954b49ca15f1 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:47:33 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-11881430-874c-47d4-9ca3-db452d8fe917 req-847b3d42-e70c-42ae-98da-0f6e713ce31c service nova] Acquiring lock "b2d55cdd-c89c-4c59-afe1-49a33225af22-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:47:33 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-11881430-874c-47d4-9ca3-db452d8fe917 req-847b3d42-e70c-42ae-98da-0f6e713ce31c service nova] Lock "b2d55cdd-c89c-4c59-afe1-49a33225af22-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:47:33 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-11881430-874c-47d4-9ca3-db452d8fe917 req-847b3d42-e70c-42ae-98da-0f6e713ce31c service nova] Lock "b2d55cdd-c89c-4c59-afe1-49a33225af22-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:47:33 user nova-compute[71731]: DEBUG nova.compute.manager [req-11881430-874c-47d4-9ca3-db452d8fe917 req-847b3d42-e70c-42ae-98da-0f6e713ce31c service nova] [instance: b2d55cdd-c89c-4c59-afe1-49a33225af22] No waiting events found dispatching network-vif-plugged-31e1957f-9bd1-42ae-a2ac-954b49ca15f1 {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:47:33 user nova-compute[71731]: WARNING nova.compute.manager [req-11881430-874c-47d4-9ca3-db452d8fe917 req-847b3d42-e70c-42ae-98da-0f6e713ce31c service nova] [instance: b2d55cdd-c89c-4c59-afe1-49a33225af22] Received unexpected event network-vif-plugged-31e1957f-9bd1-42ae-a2ac-954b49ca15f1 for instance with vm_state rescued and task_state unrescuing.
Apr 13 16:47:33 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: b2d55cdd-c89c-4c59-afe1-49a33225af22] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:47:33 user nova-compute[71731]: WARNING nova.virt.libvirt.driver [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 16:47:33 user nova-compute[71731]: WARNING nova.virt.libvirt.driver [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 16:47:33 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Hypervisor/Node resource view: name=user free_ram=8513MB free_disk=26.0703125GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71731) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 16:47:33 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:47:33 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:47:33 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: b2d55cdd-c89c-4c59-afe1-49a33225af22] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71731) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 16:47:33 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: b2d55cdd-c89c-4c59-afe1-49a33225af22] During sync_power_state the instance has a pending task (unrescuing). Skip.
Apr 13 16:47:33 user nova-compute[71731]: DEBUG nova.virt.driver [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Emitting event <LifecycleEvent: 1681404453.217916, b2d55cdd-c89c-4c59-afe1-49a33225af22 => Started> {{(pid=71731) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 16:47:33 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: b2d55cdd-c89c-4c59-afe1-49a33225af22] VM Started (Lifecycle Event)
Apr 13 16:47:33 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: b2d55cdd-c89c-4c59-afe1-49a33225af22] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:47:33 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: b2d55cdd-c89c-4c59-afe1-49a33225af22] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71731) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 16:47:33 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance b2d55cdd-c89c-4c59-afe1-49a33225af22 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 16:47:33 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance 3af23ff8-4e10-4fbf-a86e-bda842f084ff actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 16:47:33 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance 6e4776e8-d528-4110-90a3-daf4d1df0171 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 16:47:33 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=71731) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 16:47:33 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Final resource view: name=user phys_ram=16023MB used_ram=896MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=71731) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 16:47:33 user nova-compute[71731]: DEBUG nova.scheduler.client.report [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Refreshing inventories for resource provider cb6b1a64-0c24-4e2d-af1e-16576ca9165c {{(pid=71731) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 13 16:47:33 user nova-compute[71731]: DEBUG nova.scheduler.client.report [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Updating ProviderTree inventory for provider cb6b1a64-0c24-4e2d-af1e-16576ca9165c from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71731) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 13 16:47:33 user nova-compute[71731]: DEBUG nova.compute.provider_tree [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Updating inventory in ProviderTree for provider cb6b1a64-0c24-4e2d-af1e-16576ca9165c with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71731) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 13 16:47:33 user nova-compute[71731]: DEBUG nova.scheduler.client.report [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Refreshing aggregate associations for resource provider cb6b1a64-0c24-4e2d-af1e-16576ca9165c, aggregates: None {{(pid=71731) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 13 16:47:33 user nova-compute[71731]: DEBUG nova.scheduler.client.report [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Refreshing trait associations for resource provider cb6b1a64-0c24-4e2d-af1e-16576ca9165c, traits: COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSSE3,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_SATA,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_SSE,COMPUTE_RESCUE_BFV,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE41,HW_CPU_X86_MMX,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_RAW {{(pid=71731) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 13 16:47:33 user nova-compute[71731]: DEBUG nova.compute.provider_tree [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Inventory has not changed in ProviderTree for provider: cb6b1a64-0c24-4e2d-af1e-16576ca9165c {{(pid=71731) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 16:47:33 user nova-compute[71731]: DEBUG nova.scheduler.client.report [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Inventory has not changed for provider cb6b1a64-0c24-4e2d-af1e-16576ca9165c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71731) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 16:47:33 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Compute_service record updated for user:user {{(pid=71731) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 16:47:33 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.384s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:47:34 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:47:34 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Starting heal instance info cache {{(pid=71731) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 16:47:35 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Acquiring lock "refresh_cache-b2d55cdd-c89c-4c59-afe1-49a33225af22" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 16:47:35 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Acquired lock "refresh_cache-b2d55cdd-c89c-4c59-afe1-49a33225af22" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 16:47:35 user nova-compute[71731]: DEBUG nova.network.neutron [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] [instance: b2d55cdd-c89c-4c59-afe1-49a33225af22] Forcefully refreshing network info cache for instance {{(pid=71731) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 16:47:35 user nova-compute[71731]: DEBUG nova.network.neutron [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] [instance: b2d55cdd-c89c-4c59-afe1-49a33225af22] Updating instance_info_cache with network_info: [{"id": "31e1957f-9bd1-42ae-a2ac-954b49ca15f1", "address": "fa:16:3e:81:e2:10", "network": {"id": "2a5b69f1-fc5b-4c33-a9eb-12a4d9293500", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2137344591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "846732ecb7e047128b4684972d3cd8c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31e1957f-9b", "ovs_interfaceid": "31e1957f-9bd1-42ae-a2ac-954b49ca15f1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:47:35 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Releasing lock "refresh_cache-b2d55cdd-c89c-4c59-afe1-49a33225af22" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 16:47:35 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] [instance: b2d55cdd-c89c-4c59-afe1-49a33225af22] Updated the network info_cache for instance {{(pid=71731) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 16:47:35 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:47:35 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:47:35 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:47:35 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:47:35 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71731) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 16:47:35 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:47:37 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:47:37 user nova-compute[71731]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681404442.3354974, 5ed800fe-577d-4624-898c-c7f40da77376 => Stopped> {{(pid=71731) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 16:47:37 user nova-compute[71731]: INFO nova.compute.manager [-] [instance: 5ed800fe-577d-4624-898c-c7f40da77376] VM Stopped (Lifecycle Event)
Apr 13 16:47:37 user nova-compute[71731]: DEBUG nova.compute.manager [None req-edafd9d4-35ab-4c8f-9e63-e6e841822251 None None] [instance: 5ed800fe-577d-4624-898c-c7f40da77376] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:47:38 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:47:38 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:47:43 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:47:47 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:47:48 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:47:52 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:47:53 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:47:57 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:47:58 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:48:02 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:48:03 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:48:05 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-fa803e77-748e-43c9-9eb8-0afc7b55bae7 tempest-VolumesActionsTest-150031261 tempest-VolumesActionsTest-150031261-project-member] Acquiring lock "6e4776e8-d528-4110-90a3-daf4d1df0171" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:48:05 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-fa803e77-748e-43c9-9eb8-0afc7b55bae7 tempest-VolumesActionsTest-150031261 tempest-VolumesActionsTest-150031261-project-member] Lock "6e4776e8-d528-4110-90a3-daf4d1df0171" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:48:05 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-fa803e77-748e-43c9-9eb8-0afc7b55bae7 tempest-VolumesActionsTest-150031261 tempest-VolumesActionsTest-150031261-project-member] Acquiring lock "6e4776e8-d528-4110-90a3-daf4d1df0171-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:48:05 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-fa803e77-748e-43c9-9eb8-0afc7b55bae7 tempest-VolumesActionsTest-150031261 tempest-VolumesActionsTest-150031261-project-member] Lock "6e4776e8-d528-4110-90a3-daf4d1df0171-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:48:05 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-fa803e77-748e-43c9-9eb8-0afc7b55bae7 tempest-VolumesActionsTest-150031261 tempest-VolumesActionsTest-150031261-project-member] Lock "6e4776e8-d528-4110-90a3-daf4d1df0171-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:48:05 user nova-compute[71731]: INFO nova.compute.manager [None req-fa803e77-748e-43c9-9eb8-0afc7b55bae7 tempest-VolumesActionsTest-150031261 tempest-VolumesActionsTest-150031261-project-member] [instance: 6e4776e8-d528-4110-90a3-daf4d1df0171] Terminating instance
Apr 13 16:48:05 user nova-compute[71731]: DEBUG nova.compute.manager [None req-fa803e77-748e-43c9-9eb8-0afc7b55bae7 tempest-VolumesActionsTest-150031261 tempest-VolumesActionsTest-150031261-project-member] [instance: 6e4776e8-d528-4110-90a3-daf4d1df0171] Start destroying the instance on the hypervisor. {{(pid=71731) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 16:48:05 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:48:05 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:48:05 user nova-compute[71731]: DEBUG nova.compute.manager [req-80f71cdd-18ae-44c1-98e3-73b3bfdccd8d req-ebac759f-e33b-4f65-b0c8-0d68da688a94 service nova] [instance: 6e4776e8-d528-4110-90a3-daf4d1df0171] Received event network-vif-unplugged-e4d1a1bf-cfc0-43cb-a0a2-db01fe4fd0e7 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:48:05 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-80f71cdd-18ae-44c1-98e3-73b3bfdccd8d req-ebac759f-e33b-4f65-b0c8-0d68da688a94 service nova] Acquiring lock "6e4776e8-d528-4110-90a3-daf4d1df0171-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:48:05 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-80f71cdd-18ae-44c1-98e3-73b3bfdccd8d req-ebac759f-e33b-4f65-b0c8-0d68da688a94 service nova] Lock "6e4776e8-d528-4110-90a3-daf4d1df0171-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:48:05 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-80f71cdd-18ae-44c1-98e3-73b3bfdccd8d req-ebac759f-e33b-4f65-b0c8-0d68da688a94 service nova] Lock "6e4776e8-d528-4110-90a3-daf4d1df0171-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:48:05 user nova-compute[71731]: DEBUG nova.compute.manager [req-80f71cdd-18ae-44c1-98e3-73b3bfdccd8d req-ebac759f-e33b-4f65-b0c8-0d68da688a94 service nova] [instance: 6e4776e8-d528-4110-90a3-daf4d1df0171] No waiting events found dispatching network-vif-unplugged-e4d1a1bf-cfc0-43cb-a0a2-db01fe4fd0e7 {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:48:05 user nova-compute[71731]: DEBUG nova.compute.manager [req-80f71cdd-18ae-44c1-98e3-73b3bfdccd8d req-ebac759f-e33b-4f65-b0c8-0d68da688a94 service nova] [instance: 6e4776e8-d528-4110-90a3-daf4d1df0171] Received event network-vif-unplugged-e4d1a1bf-cfc0-43cb-a0a2-db01fe4fd0e7 for instance with task_state deleting. {{(pid=71731) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 16:48:06 user nova-compute[71731]: INFO nova.virt.libvirt.driver [-] [instance: 6e4776e8-d528-4110-90a3-daf4d1df0171] Instance destroyed successfully.
Apr 13 16:48:06 user nova-compute[71731]: DEBUG nova.objects.instance [None req-fa803e77-748e-43c9-9eb8-0afc7b55bae7 tempest-VolumesActionsTest-150031261 tempest-VolumesActionsTest-150031261-project-member] Lazy-loading 'resources' on Instance uuid 6e4776e8-d528-4110-90a3-daf4d1df0171 {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:48:06 user nova-compute[71731]: DEBUG nova.virt.libvirt.vif [None req-fa803e77-748e-43c9-9eb8-0afc7b55bae7 tempest-VolumesActionsTest-150031261 tempest-VolumesActionsTest-150031261-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T16:46:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-134291337',display_name='tempest-VolumesActionsTest-instance-134291337',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-134291337',id=38,image_ref='708622a9-7465-4492-ade8-b827198f7e30',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-13T16:46:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c0bb7653df574769941cf284c6a63154',ramdisk_id='',reservation_id='r-ht0lqdem',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='708622a9-7465-4492-ade8-b827198f7e30',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-150031261',owner_user_name='tempest-VolumesActionsTest-150031261-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T16:46:17Z,user_data=None,user_id='623668858bee4d308f31f4facd600fb1',uuid=6e4776e8-d528-4110-90a3-daf4d1df0171,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e4d1a1bf-cfc0-43cb-a0a2-db01fe4fd0e7", "address": "fa:16:3e:7b:c8:f3", "network": {"id": "282f8956-6789-4c49-8b11-a2cc18f673a9", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2013191479-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "c0bb7653df574769941cf284c6a63154", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4d1a1bf-cf", "ovs_interfaceid": "e4d1a1bf-cfc0-43cb-a0a2-db01fe4fd0e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 16:48:06 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-fa803e77-748e-43c9-9eb8-0afc7b55bae7 tempest-VolumesActionsTest-150031261 tempest-VolumesActionsTest-150031261-project-member] Converting VIF {"id": "e4d1a1bf-cfc0-43cb-a0a2-db01fe4fd0e7", "address": "fa:16:3e:7b:c8:f3", "network": {"id": "282f8956-6789-4c49-8b11-a2cc18f673a9", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2013191479-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "c0bb7653df574769941cf284c6a63154", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4d1a1bf-cf", "ovs_interfaceid": "e4d1a1bf-cfc0-43cb-a0a2-db01fe4fd0e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 16:48:06 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-fa803e77-748e-43c9-9eb8-0afc7b55bae7 tempest-VolumesActionsTest-150031261 tempest-VolumesActionsTest-150031261-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7b:c8:f3,bridge_name='br-int',has_traffic_filtering=True,id=e4d1a1bf-cfc0-43cb-a0a2-db01fe4fd0e7,network=Network(282f8956-6789-4c49-8b11-a2cc18f673a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4d1a1bf-cf') {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 16:48:06 user nova-compute[71731]: DEBUG os_vif [None req-fa803e77-748e-43c9-9eb8-0afc7b55bae7 tempest-VolumesActionsTest-150031261 tempest-VolumesActionsTest-150031261-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:c8:f3,bridge_name='br-int',has_traffic_filtering=True,id=e4d1a1bf-cfc0-43cb-a0a2-db01fe4fd0e7,network=Network(282f8956-6789-4c49-8b11-a2cc18f673a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4d1a1bf-cf') {{(pid=71731) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 16:48:06 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:48:06 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape4d1a1bf-cf, bridge=br-int, if_exists=True) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:48:06 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:48:06 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 16:48:06 user nova-compute[71731]: INFO os_vif [None req-fa803e77-748e-43c9-9eb8-0afc7b55bae7 tempest-VolumesActionsTest-150031261 tempest-VolumesActionsTest-150031261-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:c8:f3,bridge_name='br-int',has_traffic_filtering=True,id=e4d1a1bf-cfc0-43cb-a0a2-db01fe4fd0e7,network=Network(282f8956-6789-4c49-8b11-a2cc18f673a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4d1a1bf-cf')
Apr 13 16:48:06 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-fa803e77-748e-43c9-9eb8-0afc7b55bae7 tempest-VolumesActionsTest-150031261 tempest-VolumesActionsTest-150031261-project-member] [instance: 6e4776e8-d528-4110-90a3-daf4d1df0171] Deleting instance files /opt/stack/data/nova/instances/6e4776e8-d528-4110-90a3-daf4d1df0171_del
Apr 13 16:48:06 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-fa803e77-748e-43c9-9eb8-0afc7b55bae7 tempest-VolumesActionsTest-150031261 tempest-VolumesActionsTest-150031261-project-member] [instance: 6e4776e8-d528-4110-90a3-daf4d1df0171] Deletion of /opt/stack/data/nova/instances/6e4776e8-d528-4110-90a3-daf4d1df0171_del complete
Apr 13 16:48:06 user nova-compute[71731]: INFO nova.compute.manager [None req-fa803e77-748e-43c9-9eb8-0afc7b55bae7 tempest-VolumesActionsTest-150031261 tempest-VolumesActionsTest-150031261-project-member] [instance: 6e4776e8-d528-4110-90a3-daf4d1df0171] Took 0.71 seconds to destroy the instance on the hypervisor.
Apr 13 16:48:06 user nova-compute[71731]: DEBUG oslo.service.loopingcall [None req-fa803e77-748e-43c9-9eb8-0afc7b55bae7 tempest-VolumesActionsTest-150031261 tempest-VolumesActionsTest-150031261-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71731) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 16:48:06 user nova-compute[71731]: DEBUG nova.compute.manager [-] [instance: 6e4776e8-d528-4110-90a3-daf4d1df0171] Deallocating network for instance {{(pid=71731) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 16:48:06 user nova-compute[71731]: DEBUG nova.network.neutron [-] [instance: 6e4776e8-d528-4110-90a3-daf4d1df0171] deallocate_for_instance() {{(pid=71731) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 16:48:06 user nova-compute[71731]: DEBUG nova.network.neutron [-] [instance: 6e4776e8-d528-4110-90a3-daf4d1df0171] Updating instance_info_cache with network_info: [] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:48:06 user nova-compute[71731]: DEBUG nova.compute.manager [req-a810f0de-9044-4163-a33b-9640fdbff408 req-b63651e2-988b-405e-851f-75693825ceaf service nova] [instance: 6e4776e8-d528-4110-90a3-daf4d1df0171] Received event network-vif-deleted-e4d1a1bf-cfc0-43cb-a0a2-db01fe4fd0e7 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:48:06 user nova-compute[71731]: INFO nova.compute.manager [req-a810f0de-9044-4163-a33b-9640fdbff408 req-b63651e2-988b-405e-851f-75693825ceaf service nova] [instance: 6e4776e8-d528-4110-90a3-daf4d1df0171] Neutron deleted interface e4d1a1bf-cfc0-43cb-a0a2-db01fe4fd0e7; detaching it from the instance and deleting it from the info cache
Apr 13 16:48:06 user nova-compute[71731]: DEBUG nova.network.neutron [req-a810f0de-9044-4163-a33b-9640fdbff408 req-b63651e2-988b-405e-851f-75693825ceaf service nova] [instance: 6e4776e8-d528-4110-90a3-daf4d1df0171] Updating instance_info_cache with network_info: [] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:48:06 user nova-compute[71731]: INFO nova.compute.manager [-] [instance: 6e4776e8-d528-4110-90a3-daf4d1df0171] Took 0.52 seconds to deallocate network for instance.
Apr 13 16:48:06 user nova-compute[71731]: DEBUG nova.compute.manager [req-a810f0de-9044-4163-a33b-9640fdbff408 req-b63651e2-988b-405e-851f-75693825ceaf service nova] [instance: 6e4776e8-d528-4110-90a3-daf4d1df0171] Detach interface failed, port_id=e4d1a1bf-cfc0-43cb-a0a2-db01fe4fd0e7, reason: Instance 6e4776e8-d528-4110-90a3-daf4d1df0171 could not be found. {{(pid=71731) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 13 16:48:06 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-fa803e77-748e-43c9-9eb8-0afc7b55bae7 tempest-VolumesActionsTest-150031261 tempest-VolumesActionsTest-150031261-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:48:06 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-fa803e77-748e-43c9-9eb8-0afc7b55bae7 tempest-VolumesActionsTest-150031261 tempest-VolumesActionsTest-150031261-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:48:06 user nova-compute[71731]: DEBUG nova.compute.provider_tree [None req-fa803e77-748e-43c9-9eb8-0afc7b55bae7 tempest-VolumesActionsTest-150031261 tempest-VolumesActionsTest-150031261-project-member] Inventory has not changed in ProviderTree for provider: cb6b1a64-0c24-4e2d-af1e-16576ca9165c {{(pid=71731) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 16:48:06 user nova-compute[71731]: DEBUG nova.scheduler.client.report [None req-fa803e77-748e-43c9-9eb8-0afc7b55bae7 tempest-VolumesActionsTest-150031261 tempest-VolumesActionsTest-150031261-project-member] Inventory has not changed for provider cb6b1a64-0c24-4e2d-af1e-16576ca9165c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71731) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 16:48:06 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-fa803e77-748e-43c9-9eb8-0afc7b55bae7 tempest-VolumesActionsTest-150031261 tempest-VolumesActionsTest-150031261-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.153s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:48:07 user nova-compute[71731]: INFO nova.scheduler.client.report [None req-fa803e77-748e-43c9-9eb8-0afc7b55bae7 tempest-VolumesActionsTest-150031261 tempest-VolumesActionsTest-150031261-project-member] Deleted allocations for instance 6e4776e8-d528-4110-90a3-daf4d1df0171
Apr 13 16:48:07 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-fa803e77-748e-43c9-9eb8-0afc7b55bae7 tempest-VolumesActionsTest-150031261 tempest-VolumesActionsTest-150031261-project-member] Lock "6e4776e8-d528-4110-90a3-daf4d1df0171" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.568s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:48:07 user nova-compute[71731]: DEBUG nova.compute.manager [req-28e0d75f-2c63-4599-b554-affb77a9b793 req-5ef74977-42a6-4cda-9239-b35c6856a739 service nova] [instance: 6e4776e8-d528-4110-90a3-daf4d1df0171] Received event network-vif-plugged-e4d1a1bf-cfc0-43cb-a0a2-db01fe4fd0e7 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:48:07 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-28e0d75f-2c63-4599-b554-affb77a9b793 req-5ef74977-42a6-4cda-9239-b35c6856a739 service nova] Acquiring lock "6e4776e8-d528-4110-90a3-daf4d1df0171-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:48:07 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-28e0d75f-2c63-4599-b554-affb77a9b793 req-5ef74977-42a6-4cda-9239-b35c6856a739 service nova] Lock "6e4776e8-d528-4110-90a3-daf4d1df0171-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:48:07 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-28e0d75f-2c63-4599-b554-affb77a9b793 req-5ef74977-42a6-4cda-9239-b35c6856a739 service nova] Lock "6e4776e8-d528-4110-90a3-daf4d1df0171-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:48:07 user nova-compute[71731]: DEBUG nova.compute.manager [req-28e0d75f-2c63-4599-b554-affb77a9b793 req-5ef74977-42a6-4cda-9239-b35c6856a739 service nova] [instance: 6e4776e8-d528-4110-90a3-daf4d1df0171] No waiting events found dispatching network-vif-plugged-e4d1a1bf-cfc0-43cb-a0a2-db01fe4fd0e7 {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:48:07 user nova-compute[71731]: WARNING nova.compute.manager [req-28e0d75f-2c63-4599-b554-affb77a9b793 req-5ef74977-42a6-4cda-9239-b35c6856a739 service nova] [instance: 6e4776e8-d528-4110-90a3-daf4d1df0171] Received unexpected event network-vif-plugged-e4d1a1bf-cfc0-43cb-a0a2-db01fe4fd0e7 for instance with vm_state deleted and task_state None.
Apr 13 16:48:11 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:48:16 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:48:17 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:48:17 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:48:19 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:48:21 user nova-compute[71731]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681404486.1215196, 6e4776e8-d528-4110-90a3-daf4d1df0171 => Stopped> {{(pid=71731) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 16:48:21 user nova-compute[71731]: INFO nova.compute.manager [-] [instance: 6e4776e8-d528-4110-90a3-daf4d1df0171] VM Stopped (Lifecycle Event)
Apr 13 16:48:21 user nova-compute[71731]: DEBUG nova.compute.manager [None req-685707f1-4bde-417a-8476-c224caaaa1c7 None None] [instance: 6e4776e8-d528-4110-90a3-daf4d1df0171] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:48:21 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:48:26 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:48:26 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:48:29 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:48:29 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71731) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 16:48:29 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager.update_available_resource {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:48:29 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:48:29 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:48:29 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:48:29 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Auditing locally available compute resources for user (node: user) {{(pid=71731) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 16:48:29 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3af23ff8-4e10-4fbf-a86e-bda842f084ff/disk.rescue --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:48:29 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3af23ff8-4e10-4fbf-a86e-bda842f084ff/disk.rescue --force-share --output=json" returned: 0 in 0.146s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:48:29 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3af23ff8-4e10-4fbf-a86e-bda842f084ff/disk.rescue --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:48:29 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3af23ff8-4e10-4fbf-a86e-bda842f084ff/disk.rescue --force-share --output=json" returned: 0 in 0.143s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:48:29 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3af23ff8-4e10-4fbf-a86e-bda842f084ff/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:48:29 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3af23ff8-4e10-4fbf-a86e-bda842f084ff/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:48:29 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3af23ff8-4e10-4fbf-a86e-bda842f084ff/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:48:29 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3af23ff8-4e10-4fbf-a86e-bda842f084ff/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:48:29 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2d55cdd-c89c-4c59-afe1-49a33225af22/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:48:29 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2d55cdd-c89c-4c59-afe1-49a33225af22/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:48:29 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2d55cdd-c89c-4c59-afe1-49a33225af22/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:48:30 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2d55cdd-c89c-4c59-afe1-49a33225af22/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:48:30 user nova-compute[71731]: WARNING nova.virt.libvirt.driver [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 16:48:30 user nova-compute[71731]: WARNING nova.virt.libvirt.driver [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 16:48:30 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Hypervisor/Node resource view: name=user free_ram=8606MB free_disk=26.105152130126953GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71731) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 16:48:30 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:48:30 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:48:30 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance b2d55cdd-c89c-4c59-afe1-49a33225af22 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 16:48:30 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance 3af23ff8-4e10-4fbf-a86e-bda842f084ff actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 16:48:30 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=71731) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 16:48:30 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Final resource view: name=user phys_ram=16023MB used_ram=768MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=71731) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 16:48:30 user nova-compute[71731]: DEBUG nova.compute.provider_tree [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Inventory has not changed in ProviderTree for provider: cb6b1a64-0c24-4e2d-af1e-16576ca9165c {{(pid=71731) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 16:48:30 user nova-compute[71731]: DEBUG nova.scheduler.client.report [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Inventory has not changed for provider cb6b1a64-0c24-4e2d-af1e-16576ca9165c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71731) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 16:48:30 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Compute_service record updated for user:user {{(pid=71731) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 16:48:30 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.301s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:48:31 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 16:48:31 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:48:35 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:48:35 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:48:35 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Starting heal instance info cache {{(pid=71731) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 16:48:35 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Acquiring lock "refresh_cache-3af23ff8-4e10-4fbf-a86e-bda842f084ff" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 16:48:35 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Acquired lock "refresh_cache-3af23ff8-4e10-4fbf-a86e-bda842f084ff" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 16:48:35 user nova-compute[71731]: DEBUG nova.network.neutron [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] [instance: 3af23ff8-4e10-4fbf-a86e-bda842f084ff] Forcefully refreshing network info cache for instance {{(pid=71731) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 16:48:35 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-9757a67b-8e17-4d18-8a72-d09742bbf3d7 tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] Acquiring lock "e6953c30-c409-45fe-8b22-d9e66d1138ed" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:48:35 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-9757a67b-8e17-4d18-8a72-d09742bbf3d7 tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] Lock "e6953c30-c409-45fe-8b22-d9e66d1138ed" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:48:35 user nova-compute[71731]: DEBUG nova.compute.manager [None req-9757a67b-8e17-4d18-8a72-d09742bbf3d7 tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] [instance: e6953c30-c409-45fe-8b22-d9e66d1138ed] Starting instance... {{(pid=71731) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 16:48:35 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-9757a67b-8e17-4d18-8a72-d09742bbf3d7 tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:48:35 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-9757a67b-8e17-4d18-8a72-d09742bbf3d7 tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:48:35 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-9757a67b-8e17-4d18-8a72-d09742bbf3d7 tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71731) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 16:48:35 user nova-compute[71731]: INFO nova.compute.claims [None req-9757a67b-8e17-4d18-8a72-d09742bbf3d7 tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] [instance: e6953c30-c409-45fe-8b22-d9e66d1138ed] Claim successful on node user
Apr 13 16:48:35 user nova-compute[71731]: DEBUG nova.compute.provider_tree [None req-9757a67b-8e17-4d18-8a72-d09742bbf3d7 tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] Inventory has not changed in ProviderTree for provider: cb6b1a64-0c24-4e2d-af1e-16576ca9165c {{(pid=71731) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 16:48:35 user nova-compute[71731]: DEBUG nova.scheduler.client.report [None req-9757a67b-8e17-4d18-8a72-d09742bbf3d7 tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] Inventory has not changed for provider cb6b1a64-0c24-4e2d-af1e-16576ca9165c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71731) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 16:48:35 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-9757a67b-8e17-4d18-8a72-d09742bbf3d7 tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.260s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:48:35 user nova-compute[71731]: DEBUG nova.compute.manager [None req-9757a67b-8e17-4d18-8a72-d09742bbf3d7 tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] [instance: e6953c30-c409-45fe-8b22-d9e66d1138ed] Start building networks asynchronously for instance. {{(pid=71731) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 16:48:35 user nova-compute[71731]: DEBUG nova.network.neutron [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] [instance: 3af23ff8-4e10-4fbf-a86e-bda842f084ff] Updating instance_info_cache with network_info: [{"id": "b22086e3-8769-494c-af86-228dba7b3638", "address": "fa:16:3e:84:ee:e5", "network": {"id": "2a5b69f1-fc5b-4c33-a9eb-12a4d9293500", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2137344591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "846732ecb7e047128b4684972d3cd8c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb22086e3-87", "ovs_interfaceid": "b22086e3-8769-494c-af86-228dba7b3638", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:48:35 user nova-compute[71731]: DEBUG nova.compute.manager [None req-9757a67b-8e17-4d18-8a72-d09742bbf3d7 tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] [instance: e6953c30-c409-45fe-8b22-d9e66d1138ed] Allocating IP information in the background. {{(pid=71731) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 16:48:35 user nova-compute[71731]: DEBUG nova.network.neutron [None req-9757a67b-8e17-4d18-8a72-d09742bbf3d7 tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] [instance: e6953c30-c409-45fe-8b22-d9e66d1138ed] allocate_for_instance() {{(pid=71731) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 16:48:35 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Releasing lock "refresh_cache-3af23ff8-4e10-4fbf-a86e-bda842f084ff" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 16:48:35 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] [instance: 3af23ff8-4e10-4fbf-a86e-bda842f084ff] Updated the network info_cache for instance {{(pid=71731) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 16:48:35 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-9757a67b-8e17-4d18-8a72-d09742bbf3d7 tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] [instance: e6953c30-c409-45fe-8b22-d9e66d1138ed] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 16:48:35 user nova-compute[71731]: DEBUG nova.compute.manager [None req-9757a67b-8e17-4d18-8a72-d09742bbf3d7 tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] [instance: e6953c30-c409-45fe-8b22-d9e66d1138ed] Start building block device mappings for instance. {{(pid=71731) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 16:48:35 user nova-compute[71731]: DEBUG nova.policy [None req-9757a67b-8e17-4d18-8a72-d09742bbf3d7 tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5051bef91062494f991ee96a93c9dc6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd099f58565de44fba2df173a2bdb3019', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71731) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 16:48:35 user nova-compute[71731]: DEBUG nova.compute.manager [None req-9757a67b-8e17-4d18-8a72-d09742bbf3d7 tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] [instance: e6953c30-c409-45fe-8b22-d9e66d1138ed] Start spawning the instance on the hypervisor. {{(pid=71731) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 16:48:35 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-9757a67b-8e17-4d18-8a72-d09742bbf3d7 tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] [instance: e6953c30-c409-45fe-8b22-d9e66d1138ed] Creating instance directory {{(pid=71731) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 16:48:35 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-9757a67b-8e17-4d18-8a72-d09742bbf3d7 tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] [instance: e6953c30-c409-45fe-8b22-d9e66d1138ed] Creating image(s)
Apr 13 16:48:35 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-9757a67b-8e17-4d18-8a72-d09742bbf3d7 tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] Acquiring lock "/opt/stack/data/nova/instances/e6953c30-c409-45fe-8b22-d9e66d1138ed/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:48:35 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-9757a67b-8e17-4d18-8a72-d09742bbf3d7 tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] Lock "/opt/stack/data/nova/instances/e6953c30-c409-45fe-8b22-d9e66d1138ed/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:48:35 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-9757a67b-8e17-4d18-8a72-d09742bbf3d7 tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] Lock "/opt/stack/data/nova/instances/e6953c30-c409-45fe-8b22-d9e66d1138ed/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:48:35 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-9757a67b-8e17-4d18-8a72-d09742bbf3d7 tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279 --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:48:35 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-9757a67b-8e17-4d18-8a72-d09742bbf3d7 tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279 --force-share --output=json" returned: 0 in 0.128s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:48:35 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-9757a67b-8e17-4d18-8a72-d09742bbf3d7 tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] Acquiring lock "9524227dd898575c3099d3976f096cd935414279" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:48:35 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-9757a67b-8e17-4d18-8a72-d09742bbf3d7 tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] Lock "9524227dd898575c3099d3976f096cd935414279" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:48:35 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-9757a67b-8e17-4d18-8a72-d09742bbf3d7 tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279 --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:48:35 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-9757a67b-8e17-4d18-8a72-d09742bbf3d7 tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279 --force-share --output=json" returned: 0 in 0.138s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:48:36 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-9757a67b-8e17-4d18-8a72-d09742bbf3d7 tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279,backing_fmt=raw /opt/stack/data/nova/instances/e6953c30-c409-45fe-8b22-d9e66d1138ed/disk 1073741824 {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:48:36 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:48:36 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-9757a67b-8e17-4d18-8a72-d09742bbf3d7 tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279,backing_fmt=raw /opt/stack/data/nova/instances/e6953c30-c409-45fe-8b22-d9e66d1138ed/disk 1073741824" returned: 0 in 0.048s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:48:36 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-9757a67b-8e17-4d18-8a72-d09742bbf3d7 tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] Lock "9524227dd898575c3099d3976f096cd935414279" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.193s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:48:36 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-9757a67b-8e17-4d18-8a72-d09742bbf3d7 tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279 --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:48:36 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 16:48:36 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-9757a67b-8e17-4d18-8a72-d09742bbf3d7 tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279 --force-share --output=json" returned: 0 in 0.130s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:48:36 user nova-compute[71731]: DEBUG nova.virt.disk.api [None req-9757a67b-8e17-4d18-8a72-d09742bbf3d7 tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e6953c30-c409-45fe-8b22-d9e66d1138ed/disk. size=1073741824 {{(pid=71731) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 16:48:36 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-9757a67b-8e17-4d18-8a72-d09742bbf3d7 tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6953c30-c409-45fe-8b22-d9e66d1138ed/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:48:36 user nova-compute[71731]: DEBUG nova.network.neutron [None req-9757a67b-8e17-4d18-8a72-d09742bbf3d7 tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] [instance: e6953c30-c409-45fe-8b22-d9e66d1138ed] Successfully created port: e2f0381a-2e17-4d01-b125-0d9ad8c94788 {{(pid=71731) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 16:48:36 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-9757a67b-8e17-4d18-8a72-d09742bbf3d7 tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6953c30-c409-45fe-8b22-d9e66d1138ed/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:48:36 user nova-compute[71731]: DEBUG nova.virt.disk.api [None req-9757a67b-8e17-4d18-8a72-d09742bbf3d7 tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] Cannot resize image /opt/stack/data/nova/instances/e6953c30-c409-45fe-8b22-d9e66d1138ed/disk to a smaller size. {{(pid=71731) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 16:48:36 user nova-compute[71731]: DEBUG nova.objects.instance [None req-9757a67b-8e17-4d18-8a72-d09742bbf3d7 tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] Lazy-loading 'migration_context' on Instance uuid e6953c30-c409-45fe-8b22-d9e66d1138ed {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:48:36 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-9757a67b-8e17-4d18-8a72-d09742bbf3d7 tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] [instance: e6953c30-c409-45fe-8b22-d9e66d1138ed] Created local disks {{(pid=71731) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 16:48:36 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-9757a67b-8e17-4d18-8a72-d09742bbf3d7 tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] [instance: e6953c30-c409-45fe-8b22-d9e66d1138ed] Ensure instance console log exists: /opt/stack/data/nova/instances/e6953c30-c409-45fe-8b22-d9e66d1138ed/console.log {{(pid=71731) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 16:48:36 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-9757a67b-8e17-4d18-8a72-d09742bbf3d7 tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:48:36 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-9757a67b-8e17-4d18-8a72-d09742bbf3d7 tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:48:36 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-9757a67b-8e17-4d18-8a72-d09742bbf3d7 tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:48:36 user nova-compute[71731]: DEBUG nova.network.neutron [None req-9757a67b-8e17-4d18-8a72-d09742bbf3d7 tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] [instance: e6953c30-c409-45fe-8b22-d9e66d1138ed] Successfully updated port: e2f0381a-2e17-4d01-b125-0d9ad8c94788 {{(pid=71731) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 16:48:36 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-9757a67b-8e17-4d18-8a72-d09742bbf3d7 tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] Acquiring lock "refresh_cache-e6953c30-c409-45fe-8b22-d9e66d1138ed" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 16:48:36 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-9757a67b-8e17-4d18-8a72-d09742bbf3d7 tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] Acquired lock "refresh_cache-e6953c30-c409-45fe-8b22-d9e66d1138ed" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 16:48:36 user nova-compute[71731]: DEBUG nova.network.neutron [None req-9757a67b-8e17-4d18-8a72-d09742bbf3d7 tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] [instance: e6953c30-c409-45fe-8b22-d9e66d1138ed] Building network info cache for instance {{(pid=71731) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 16:48:37 user nova-compute[71731]: DEBUG nova.compute.manager [req-c3d80c04-e9dd-4df7-b785-03f7e93fc4eb req-f823a084-de08-496b-9eea-99fc36463199 service nova] [instance: e6953c30-c409-45fe-8b22-d9e66d1138ed] Received event network-changed-e2f0381a-2e17-4d01-b125-0d9ad8c94788 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:48:37 user nova-compute[71731]: DEBUG nova.compute.manager [req-c3d80c04-e9dd-4df7-b785-03f7e93fc4eb req-f823a084-de08-496b-9eea-99fc36463199 service nova] [instance: e6953c30-c409-45fe-8b22-d9e66d1138ed] Refreshing instance network info cache due to event network-changed-e2f0381a-2e17-4d01-b125-0d9ad8c94788. {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 16:48:37 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-c3d80c04-e9dd-4df7-b785-03f7e93fc4eb req-f823a084-de08-496b-9eea-99fc36463199 service nova] Acquiring lock "refresh_cache-e6953c30-c409-45fe-8b22-d9e66d1138ed" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 16:48:37 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:48:37 user nova-compute[71731]: DEBUG nova.network.neutron [None req-9757a67b-8e17-4d18-8a72-d09742bbf3d7 tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] [instance: e6953c30-c409-45fe-8b22-d9e66d1138ed] Instance cache missing network info. {{(pid=71731) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 16:48:37 user nova-compute[71731]: DEBUG nova.network.neutron [None req-9757a67b-8e17-4d18-8a72-d09742bbf3d7 tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] [instance: e6953c30-c409-45fe-8b22-d9e66d1138ed] Updating instance_info_cache with network_info: [{"id": "e2f0381a-2e17-4d01-b125-0d9ad8c94788", "address": "fa:16:3e:03:46:65", "network": {"id": "b742fa77-3781-46be-8a60-11bf61969238", "bridge": "br-int", "label": "tempest-VolumesActionsTest-204183032-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "d099f58565de44fba2df173a2bdb3019", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2f0381a-2e", "ovs_interfaceid": "e2f0381a-2e17-4d01-b125-0d9ad8c94788", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:48:37 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-9757a67b-8e17-4d18-8a72-d09742bbf3d7 tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] Releasing lock "refresh_cache-e6953c30-c409-45fe-8b22-d9e66d1138ed" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 16:48:37 user nova-compute[71731]: DEBUG nova.compute.manager [None req-9757a67b-8e17-4d18-8a72-d09742bbf3d7 tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] [instance: e6953c30-c409-45fe-8b22-d9e66d1138ed] Instance network_info: |[{"id": "e2f0381a-2e17-4d01-b125-0d9ad8c94788", "address": "fa:16:3e:03:46:65", "network": {"id": "b742fa77-3781-46be-8a60-11bf61969238", "bridge": "br-int", "label": "tempest-VolumesActionsTest-204183032-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "d099f58565de44fba2df173a2bdb3019", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2f0381a-2e", "ovs_interfaceid": "e2f0381a-2e17-4d01-b125-0d9ad8c94788", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71731) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 16:48:37 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-c3d80c04-e9dd-4df7-b785-03f7e93fc4eb req-f823a084-de08-496b-9eea-99fc36463199 service nova] Acquired lock "refresh_cache-e6953c30-c409-45fe-8b22-d9e66d1138ed" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 16:48:37 user nova-compute[71731]: DEBUG nova.network.neutron [req-c3d80c04-e9dd-4df7-b785-03f7e93fc4eb req-f823a084-de08-496b-9eea-99fc36463199 service nova] [instance: e6953c30-c409-45fe-8b22-d9e66d1138ed] Refreshing network info cache for port e2f0381a-2e17-4d01-b125-0d9ad8c94788 {{(pid=71731) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 16:48:37 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-9757a67b-8e17-4d18-8a72-d09742bbf3d7 tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] [instance: e6953c30-c409-45fe-8b22-d9e66d1138ed] Start _get_guest_xml network_info=[{"id": "e2f0381a-2e17-4d01-b125-0d9ad8c94788", "address": "fa:16:3e:03:46:65", "network": {"id": "b742fa77-3781-46be-8a60-11bf61969238", "bridge": "br-int", "label": "tempest-VolumesActionsTest-204183032-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "d099f58565de44fba2df173a2bdb3019", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2f0381a-2e", "ovs_interfaceid": "e2f0381a-2e17-4d01-b125-0d9ad8c94788", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T16:16:31Z,direct_url=<?>,disk_format='qcow2',id=708622a9-7465-4492-ade8-b827198f7e30,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='0b29a975c552465aba0ac7d6288434bd',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T16:16:33Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'device_type': 'disk', 'encrypted': False, 'disk_bus': 'virtio', 'guest_format': None, 'encryption_options': None, 'image_id': '708622a9-7465-4492-ade8-b827198f7e30'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71731) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 16:48:37 user nova-compute[71731]: WARNING nova.virt.libvirt.driver [None req-9757a67b-8e17-4d18-8a72-d09742bbf3d7 tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 16:48:37 user nova-compute[71731]: WARNING nova.virt.libvirt.driver [None req-9757a67b-8e17-4d18-8a72-d09742bbf3d7 tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 16:48:37 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-9757a67b-8e17-4d18-8a72-d09742bbf3d7 tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71731) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 16:48:37 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-9757a67b-8e17-4d18-8a72-d09742bbf3d7 tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T16:17:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T16:16:31Z,direct_url=<?>,disk_format='qcow2',id=708622a9-7465-4492-ade8-b827198f7e30,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='0b29a975c552465aba0ac7d6288434bd',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T16:16:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 16:48:37 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-9757a67b-8e17-4d18-8a72-d09742bbf3d7 tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] Flavor limits 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 16:48:37 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-9757a67b-8e17-4d18-8a72-d09742bbf3d7 tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] Image limits 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 16:48:37 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-9757a67b-8e17-4d18-8a72-d09742bbf3d7 tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] Flavor pref 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 16:48:37 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-9757a67b-8e17-4d18-8a72-d09742bbf3d7 tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] Image pref 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 16:48:37 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-9757a67b-8e17-4d18-8a72-d09742bbf3d7 tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 16:48:37 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-9757a67b-8e17-4d18-8a72-d09742bbf3d7 tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 16:48:37 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-9757a67b-8e17-4d18-8a72-d09742bbf3d7 tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71731) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 16:48:37 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-9757a67b-8e17-4d18-8a72-d09742bbf3d7 tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] Got 1 possible topologies {{(pid=71731) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 16:48:37 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-9757a67b-8e17-4d18-8a72-d09742bbf3d7 tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 16:48:37 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-9757a67b-8e17-4d18-8a72-d09742bbf3d7 tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 16:48:37 user nova-compute[71731]: DEBUG nova.virt.libvirt.vif [None req-9757a67b-8e17-4d18-8a72-d09742bbf3d7 tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T16:48:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1742782258',display_name='tempest-VolumesActionsTest-instance-1742782258',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1742782258',id=39,image_ref='708622a9-7465-4492-ade8-b827198f7e30',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d099f58565de44fba2df173a2bdb3019',ramdisk_id='',reservation_id='r-3t3i035g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='708622a9-7465-4492-ade8-b827198f7e30',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-450740344',owner_user_name='tempest-VolumesActionsTest-450740344-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T16:48:36Z,user_data=None,user_id='5051bef91062494f991ee96a93c9dc6a',uuid=e6953c30-c409-45fe-8b22-d9e66d1138ed,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e2f0381a-2e17-4d01-b125-0d9ad8c94788", "address": "fa:16:3e:03:46:65", "network": {"id": "b742fa77-3781-46be-8a60-11bf61969238", "bridge": "br-int", "label": "tempest-VolumesActionsTest-204183032-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "d099f58565de44fba2df173a2bdb3019", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2f0381a-2e", "ovs_interfaceid": "e2f0381a-2e17-4d01-b125-0d9ad8c94788", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71731) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 16:48:37 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-9757a67b-8e17-4d18-8a72-d09742bbf3d7 tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] Converting VIF {"id": "e2f0381a-2e17-4d01-b125-0d9ad8c94788", "address": "fa:16:3e:03:46:65", "network": {"id": "b742fa77-3781-46be-8a60-11bf61969238", "bridge": "br-int", "label": "tempest-VolumesActionsTest-204183032-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "d099f58565de44fba2df173a2bdb3019", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2f0381a-2e", "ovs_interfaceid": "e2f0381a-2e17-4d01-b125-0d9ad8c94788", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 16:48:37 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-9757a67b-8e17-4d18-8a72-d09742bbf3d7 tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:03:46:65,bridge_name='br-int',has_traffic_filtering=True,id=e2f0381a-2e17-4d01-b125-0d9ad8c94788,network=Network(b742fa77-3781-46be-8a60-11bf61969238),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2f0381a-2e') {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 16:48:37 user nova-compute[71731]: DEBUG nova.objects.instance [None req-9757a67b-8e17-4d18-8a72-d09742bbf3d7 tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] Lazy-loading 'pci_devices' on Instance uuid e6953c30-c409-45fe-8b22-d9e66d1138ed {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:48:37 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-9757a67b-8e17-4d18-8a72-d09742bbf3d7 tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] [instance: e6953c30-c409-45fe-8b22-d9e66d1138ed] End _get_guest_xml xml=<domain type="kvm">
Apr 13 16:48:37 user nova-compute[71731]:   <uuid>e6953c30-c409-45fe-8b22-d9e66d1138ed</uuid>
Apr 13 16:48:37 user nova-compute[71731]:   <name>instance-00000027</name>
Apr 13 16:48:37 user nova-compute[71731]:   <memory>131072</memory>
Apr 13 16:48:37 user nova-compute[71731]:   <vcpu>1</vcpu>
Apr 13 16:48:37 user nova-compute[71731]:   <metadata>
Apr 13 16:48:37 user nova-compute[71731]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 16:48:37 user nova-compute[71731]:       <nova:package version="0.0.0"/>
Apr 13 16:48:37 user nova-compute[71731]:       <nova:name>tempest-VolumesActionsTest-instance-1742782258</nova:name>
Apr 13 16:48:37 user nova-compute[71731]:       <nova:creationTime>2023-04-13 16:48:37</nova:creationTime>
Apr 13 16:48:37 user nova-compute[71731]:       <nova:flavor name="m1.nano">
Apr 13 16:48:37 user nova-compute[71731]:         <nova:memory>128</nova:memory>
Apr 13 16:48:37 user nova-compute[71731]:         <nova:disk>1</nova:disk>
Apr 13 16:48:37 user nova-compute[71731]:         <nova:swap>0</nova:swap>
Apr 13 16:48:37 user nova-compute[71731]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 16:48:37 user nova-compute[71731]:         <nova:vcpus>1</nova:vcpus>
Apr 13 16:48:37 user nova-compute[71731]:       </nova:flavor>
Apr 13 16:48:37 user nova-compute[71731]:       <nova:owner>
Apr 13 16:48:37 user nova-compute[71731]:         <nova:user uuid="5051bef91062494f991ee96a93c9dc6a">tempest-VolumesActionsTest-450740344-project-member</nova:user>
Apr 13 16:48:37 user nova-compute[71731]:         <nova:project uuid="d099f58565de44fba2df173a2bdb3019">tempest-VolumesActionsTest-450740344</nova:project>
Apr 13 16:48:37 user nova-compute[71731]:       </nova:owner>
Apr 13 16:48:37 user nova-compute[71731]:       <nova:root type="image" uuid="708622a9-7465-4492-ade8-b827198f7e30"/>
Apr 13 16:48:37 user nova-compute[71731]:       <nova:ports>
Apr 13 16:48:37 user nova-compute[71731]:         <nova:port uuid="e2f0381a-2e17-4d01-b125-0d9ad8c94788">
Apr 13 16:48:37 user nova-compute[71731]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Apr 13 16:48:37 user nova-compute[71731]:         </nova:port>
Apr 13 16:48:37 user nova-compute[71731]:       </nova:ports>
Apr 13 16:48:37 user nova-compute[71731]:     </nova:instance>
Apr 13 16:48:37 user nova-compute[71731]:   </metadata>
Apr 13 16:48:37 user nova-compute[71731]:   <sysinfo type="smbios">
Apr 13 16:48:37 user nova-compute[71731]:     <system>
Apr 13 16:48:37 user nova-compute[71731]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 16:48:37 user nova-compute[71731]:       <entry name="product">OpenStack Nova</entry>
Apr 13 16:48:37 user nova-compute[71731]:       <entry name="version">0.0.0</entry>
Apr 13 16:48:37 user nova-compute[71731]:       <entry name="serial">e6953c30-c409-45fe-8b22-d9e66d1138ed</entry>
Apr 13 16:48:37 user nova-compute[71731]:       <entry name="uuid">e6953c30-c409-45fe-8b22-d9e66d1138ed</entry>
Apr 13 16:48:37 user nova-compute[71731]:       <entry name="family">Virtual Machine</entry>
Apr 13 16:48:37 user nova-compute[71731]:     </system>
Apr 13 16:48:37 user nova-compute[71731]:   </sysinfo>
Apr 13 16:48:37 user nova-compute[71731]:   <os>
Apr 13 16:48:37 user nova-compute[71731]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 16:48:37 user nova-compute[71731]:     <boot dev="hd"/>
Apr 13 16:48:37 user nova-compute[71731]:     <smbios mode="sysinfo"/>
Apr 13 16:48:37 user nova-compute[71731]:   </os>
Apr 13 16:48:37 user nova-compute[71731]:   <features>
Apr 13 16:48:37 user nova-compute[71731]:     <acpi/>
Apr 13 16:48:37 user nova-compute[71731]:     <apic/>
Apr 13 16:48:37 user nova-compute[71731]:     <vmcoreinfo/>
Apr 13 16:48:37 user nova-compute[71731]:   </features>
Apr 13 16:48:37 user nova-compute[71731]:   <clock offset="utc">
Apr 13 16:48:37 user nova-compute[71731]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 16:48:37 user nova-compute[71731]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 16:48:37 user nova-compute[71731]:     <timer name="hpet" present="no"/>
Apr 13 16:48:37 user nova-compute[71731]:   </clock>
Apr 13 16:48:37 user nova-compute[71731]:   <cpu mode="custom" match="exact">
Apr 13 16:48:37 user nova-compute[71731]:     <model>Nehalem</model>
Apr 13 16:48:37 user nova-compute[71731]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 16:48:37 user nova-compute[71731]:   </cpu>
Apr 13 16:48:37 user nova-compute[71731]:   <devices>
Apr 13 16:48:37 user nova-compute[71731]:     <disk type="file" device="disk">
Apr 13 16:48:37 user nova-compute[71731]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 16:48:37 user nova-compute[71731]:       <source file="/opt/stack/data/nova/instances/e6953c30-c409-45fe-8b22-d9e66d1138ed/disk"/>
Apr 13 16:48:37 user nova-compute[71731]:       <target dev="vda" bus="virtio"/>
Apr 13 16:48:37 user nova-compute[71731]:     </disk>
Apr 13 16:48:37 user nova-compute[71731]:     <interface type="ethernet">
Apr 13 16:48:37 user nova-compute[71731]:       <mac address="fa:16:3e:03:46:65"/>
Apr 13 16:48:37 user nova-compute[71731]:       <model type="virtio"/>
Apr 13 16:48:37 user nova-compute[71731]:       <mtu size="1442"/>
Apr 13 16:48:37 user nova-compute[71731]:       <target dev="tape2f0381a-2e"/>
Apr 13 16:48:37 user nova-compute[71731]:     </interface>
Apr 13 16:48:37 user nova-compute[71731]:     <serial type="pty">
Apr 13 16:48:37 user nova-compute[71731]:       <log file="/opt/stack/data/nova/instances/e6953c30-c409-45fe-8b22-d9e66d1138ed/console.log" append="off"/>
Apr 13 16:48:37 user nova-compute[71731]:     </serial>
Apr 13 16:48:37 user nova-compute[71731]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 16:48:37 user nova-compute[71731]:     <video>
Apr 13 16:48:37 user nova-compute[71731]:       <model type="virtio"/>
Apr 13 16:48:37 user nova-compute[71731]:     </video>
Apr 13 16:48:37 user nova-compute[71731]:     <rng model="virtio">
Apr 13 16:48:37 user nova-compute[71731]:       <backend model="random">/dev/urandom</backend>
Apr 13 16:48:37 user nova-compute[71731]:     </rng>
Apr 13 16:48:37 user nova-compute[71731]:     <controller type="usb" index="0" model="none"/>
Apr 13 16:48:37 user nova-compute[71731]:     <memballoon model="virtio">
Apr 13 16:48:37 user nova-compute[71731]:       <stats period="10"/>
Apr 13 16:48:37 user nova-compute[71731]:     </memballoon>
Apr 13 16:48:37 user nova-compute[71731]:   </devices>
Apr 13 16:48:37 user nova-compute[71731]: </domain>
Apr 13 16:48:37 user nova-compute[71731]:  {{(pid=71731) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 16:48:37 user nova-compute[71731]: DEBUG nova.virt.libvirt.vif [None req-9757a67b-8e17-4d18-8a72-d09742bbf3d7 tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T16:48:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1742782258',display_name='tempest-VolumesActionsTest-instance-1742782258',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1742782258',id=39,image_ref='708622a9-7465-4492-ade8-b827198f7e30',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d099f58565de44fba2df173a2bdb3019',ramdisk_id='',reservation_id='r-3t3i035g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='708622a9-7465-4492-ade8-b827198f7e30',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-450740344',owner_user_name='tempest-VolumesActionsTest-450740344-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T16:48:36Z,user_data=None,user_id='5051bef91062494f991ee96a93c9dc6a',uuid=e6953c30-c409-45fe-8b22-d9e66d1138ed,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e2f0381a-2e17-4d01-b125-0d9ad8c94788", "address": "fa:16:3e:03:46:65", "network": {"id": "b742fa77-3781-46be-8a60-11bf61969238", "bridge": "br-int", "label": "tempest-VolumesActionsTest-204183032-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "d099f58565de44fba2df173a2bdb3019", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2f0381a-2e", "ovs_interfaceid": "e2f0381a-2e17-4d01-b125-0d9ad8c94788", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 16:48:37 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-9757a67b-8e17-4d18-8a72-d09742bbf3d7 tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] Converting VIF {"id": "e2f0381a-2e17-4d01-b125-0d9ad8c94788", "address": "fa:16:3e:03:46:65", "network": {"id": "b742fa77-3781-46be-8a60-11bf61969238", "bridge": "br-int", "label": "tempest-VolumesActionsTest-204183032-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "d099f58565de44fba2df173a2bdb3019", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2f0381a-2e", "ovs_interfaceid": "e2f0381a-2e17-4d01-b125-0d9ad8c94788", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 16:48:37 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-9757a67b-8e17-4d18-8a72-d09742bbf3d7 tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:03:46:65,bridge_name='br-int',has_traffic_filtering=True,id=e2f0381a-2e17-4d01-b125-0d9ad8c94788,network=Network(b742fa77-3781-46be-8a60-11bf61969238),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2f0381a-2e') {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 16:48:37 user nova-compute[71731]: DEBUG os_vif [None req-9757a67b-8e17-4d18-8a72-d09742bbf3d7 tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:46:65,bridge_name='br-int',has_traffic_filtering=True,id=e2f0381a-2e17-4d01-b125-0d9ad8c94788,network=Network(b742fa77-3781-46be-8a60-11bf61969238),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2f0381a-2e') {{(pid=71731) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 16:48:37 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:48:37 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:48:37 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 16:48:37 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:48:37 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape2f0381a-2e, may_exist=True) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:48:37 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape2f0381a-2e, col_values=(('external_ids', {'iface-id': 'e2f0381a-2e17-4d01-b125-0d9ad8c94788', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:03:46:65', 'vm-uuid': 'e6953c30-c409-45fe-8b22-d9e66d1138ed'}),)) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:48:37 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 16:48:37 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:48:37 user nova-compute[71731]: INFO os_vif [None req-9757a67b-8e17-4d18-8a72-d09742bbf3d7 tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:46:65,bridge_name='br-int',has_traffic_filtering=True,id=e2f0381a-2e17-4d01-b125-0d9ad8c94788,network=Network(b742fa77-3781-46be-8a60-11bf61969238),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2f0381a-2e')
Apr 13 16:48:37 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-9757a67b-8e17-4d18-8a72-d09742bbf3d7 tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] No BDM found with device name vda, not building metadata. {{(pid=71731) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 16:48:37 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-9757a67b-8e17-4d18-8a72-d09742bbf3d7 tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] No VIF found with MAC fa:16:3e:03:46:65, not building metadata {{(pid=71731) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 16:48:38 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:48:38 user nova-compute[71731]: DEBUG nova.network.neutron [req-c3d80c04-e9dd-4df7-b785-03f7e93fc4eb req-f823a084-de08-496b-9eea-99fc36463199 service nova] [instance: e6953c30-c409-45fe-8b22-d9e66d1138ed] Updated VIF entry in instance network info cache for port e2f0381a-2e17-4d01-b125-0d9ad8c94788. {{(pid=71731) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 16:48:38 user nova-compute[71731]: DEBUG nova.network.neutron [req-c3d80c04-e9dd-4df7-b785-03f7e93fc4eb req-f823a084-de08-496b-9eea-99fc36463199 service nova] [instance: e6953c30-c409-45fe-8b22-d9e66d1138ed] Updating instance_info_cache with network_info: [{"id": "e2f0381a-2e17-4d01-b125-0d9ad8c94788", "address": "fa:16:3e:03:46:65", "network": {"id": "b742fa77-3781-46be-8a60-11bf61969238", "bridge": "br-int", "label": "tempest-VolumesActionsTest-204183032-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "d099f58565de44fba2df173a2bdb3019", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2f0381a-2e", "ovs_interfaceid": "e2f0381a-2e17-4d01-b125-0d9ad8c94788", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:48:38 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-c3d80c04-e9dd-4df7-b785-03f7e93fc4eb req-f823a084-de08-496b-9eea-99fc36463199 service nova] Releasing lock "refresh_cache-e6953c30-c409-45fe-8b22-d9e66d1138ed" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 16:48:38 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:48:38 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:48:38 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:48:39 user nova-compute[71731]: DEBUG nova.compute.manager [req-369d9ab5-1eab-4210-a5ca-4fcddb2a597c req-209fd33f-fad0-4b58-9ac3-c804be3740d3 service nova] [instance: e6953c30-c409-45fe-8b22-d9e66d1138ed] Received event network-vif-plugged-e2f0381a-2e17-4d01-b125-0d9ad8c94788 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:48:39 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-369d9ab5-1eab-4210-a5ca-4fcddb2a597c req-209fd33f-fad0-4b58-9ac3-c804be3740d3 service nova] Acquiring lock "e6953c30-c409-45fe-8b22-d9e66d1138ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:48:39 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-369d9ab5-1eab-4210-a5ca-4fcddb2a597c req-209fd33f-fad0-4b58-9ac3-c804be3740d3 service nova] Lock "e6953c30-c409-45fe-8b22-d9e66d1138ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:48:39 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-369d9ab5-1eab-4210-a5ca-4fcddb2a597c req-209fd33f-fad0-4b58-9ac3-c804be3740d3 service nova] Lock "e6953c30-c409-45fe-8b22-d9e66d1138ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:48:39 user nova-compute[71731]: DEBUG nova.compute.manager [req-369d9ab5-1eab-4210-a5ca-4fcddb2a597c req-209fd33f-fad0-4b58-9ac3-c804be3740d3 service nova] [instance: e6953c30-c409-45fe-8b22-d9e66d1138ed] No waiting events found dispatching network-vif-plugged-e2f0381a-2e17-4d01-b125-0d9ad8c94788 {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:48:39 user nova-compute[71731]: WARNING nova.compute.manager [req-369d9ab5-1eab-4210-a5ca-4fcddb2a597c req-209fd33f-fad0-4b58-9ac3-c804be3740d3 service nova] [instance: e6953c30-c409-45fe-8b22-d9e66d1138ed] Received unexpected event network-vif-plugged-e2f0381a-2e17-4d01-b125-0d9ad8c94788 for instance with vm_state building and task_state spawning.
Apr 13 16:48:40 user nova-compute[71731]: DEBUG nova.virt.driver [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Emitting event <LifecycleEvent: 1681404520.9050567, e6953c30-c409-45fe-8b22-d9e66d1138ed => Resumed> {{(pid=71731) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 16:48:40 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: e6953c30-c409-45fe-8b22-d9e66d1138ed] VM Resumed (Lifecycle Event)
Apr 13 16:48:40 user nova-compute[71731]: DEBUG nova.compute.manager [None req-9757a67b-8e17-4d18-8a72-d09742bbf3d7 tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] [instance: e6953c30-c409-45fe-8b22-d9e66d1138ed] Instance event wait completed in 0 seconds for  {{(pid=71731) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 16:48:40 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-9757a67b-8e17-4d18-8a72-d09742bbf3d7 tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] [instance: e6953c30-c409-45fe-8b22-d9e66d1138ed] Guest created on hypervisor {{(pid=71731) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 16:48:40 user nova-compute[71731]: INFO nova.virt.libvirt.driver [-] [instance: e6953c30-c409-45fe-8b22-d9e66d1138ed] Instance spawned successfully.
Apr 13 16:48:40 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-9757a67b-8e17-4d18-8a72-d09742bbf3d7 tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] [instance: e6953c30-c409-45fe-8b22-d9e66d1138ed] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 16:48:40 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: e6953c30-c409-45fe-8b22-d9e66d1138ed] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:48:40 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: e6953c30-c409-45fe-8b22-d9e66d1138ed] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71731) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 16:48:40 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-9757a67b-8e17-4d18-8a72-d09742bbf3d7 tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] [instance: e6953c30-c409-45fe-8b22-d9e66d1138ed] Found default for hw_cdrom_bus of ide {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:48:40 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-9757a67b-8e17-4d18-8a72-d09742bbf3d7 tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] [instance: e6953c30-c409-45fe-8b22-d9e66d1138ed] Found default for hw_disk_bus of virtio {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:48:40 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-9757a67b-8e17-4d18-8a72-d09742bbf3d7 tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] [instance: e6953c30-c409-45fe-8b22-d9e66d1138ed] Found default for hw_input_bus of None {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:48:40 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-9757a67b-8e17-4d18-8a72-d09742bbf3d7 tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] [instance: e6953c30-c409-45fe-8b22-d9e66d1138ed] Found default for hw_pointer_model of None {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:48:40 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-9757a67b-8e17-4d18-8a72-d09742bbf3d7 tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] [instance: e6953c30-c409-45fe-8b22-d9e66d1138ed] Found default for hw_video_model of virtio {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:48:40 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-9757a67b-8e17-4d18-8a72-d09742bbf3d7 tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] [instance: e6953c30-c409-45fe-8b22-d9e66d1138ed] Found default for hw_vif_model of virtio {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:48:40 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: e6953c30-c409-45fe-8b22-d9e66d1138ed] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 16:48:40 user nova-compute[71731]: DEBUG nova.virt.driver [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Emitting event <LifecycleEvent: 1681404520.9066362, e6953c30-c409-45fe-8b22-d9e66d1138ed => Started> {{(pid=71731) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 16:48:40 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: e6953c30-c409-45fe-8b22-d9e66d1138ed] VM Started (Lifecycle Event)
Apr 13 16:48:40 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: e6953c30-c409-45fe-8b22-d9e66d1138ed] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:48:40 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: e6953c30-c409-45fe-8b22-d9e66d1138ed] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71731) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 16:48:41 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: e6953c30-c409-45fe-8b22-d9e66d1138ed] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 16:48:41 user nova-compute[71731]: INFO nova.compute.manager [None req-9757a67b-8e17-4d18-8a72-d09742bbf3d7 tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] [instance: e6953c30-c409-45fe-8b22-d9e66d1138ed] Took 5.31 seconds to spawn the instance on the hypervisor.
Apr 13 16:48:41 user nova-compute[71731]: DEBUG nova.compute.manager [None req-9757a67b-8e17-4d18-8a72-d09742bbf3d7 tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] [instance: e6953c30-c409-45fe-8b22-d9e66d1138ed] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:48:41 user nova-compute[71731]: DEBUG nova.compute.manager [req-8763cf36-78fb-40a1-81db-8a8ada80ff63 req-dd1621f6-95f8-4215-b10f-f66e35086536 service nova] [instance: e6953c30-c409-45fe-8b22-d9e66d1138ed] Received event network-vif-plugged-e2f0381a-2e17-4d01-b125-0d9ad8c94788 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:48:41 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-8763cf36-78fb-40a1-81db-8a8ada80ff63 req-dd1621f6-95f8-4215-b10f-f66e35086536 service nova] Acquiring lock "e6953c30-c409-45fe-8b22-d9e66d1138ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:48:41 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-8763cf36-78fb-40a1-81db-8a8ada80ff63 req-dd1621f6-95f8-4215-b10f-f66e35086536 service nova] Lock "e6953c30-c409-45fe-8b22-d9e66d1138ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:48:41 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-8763cf36-78fb-40a1-81db-8a8ada80ff63 req-dd1621f6-95f8-4215-b10f-f66e35086536 service nova] Lock "e6953c30-c409-45fe-8b22-d9e66d1138ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:48:41 user nova-compute[71731]: DEBUG nova.compute.manager [req-8763cf36-78fb-40a1-81db-8a8ada80ff63 req-dd1621f6-95f8-4215-b10f-f66e35086536 service nova] [instance: e6953c30-c409-45fe-8b22-d9e66d1138ed] No waiting events found dispatching network-vif-plugged-e2f0381a-2e17-4d01-b125-0d9ad8c94788 {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:48:41 user nova-compute[71731]: WARNING nova.compute.manager [req-8763cf36-78fb-40a1-81db-8a8ada80ff63 req-dd1621f6-95f8-4215-b10f-f66e35086536 service nova] [instance: e6953c30-c409-45fe-8b22-d9e66d1138ed] Received unexpected event network-vif-plugged-e2f0381a-2e17-4d01-b125-0d9ad8c94788 for instance with vm_state building and task_state spawning.
Apr 13 16:48:41 user nova-compute[71731]: INFO nova.compute.manager [None req-9757a67b-8e17-4d18-8a72-d09742bbf3d7 tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] [instance: e6953c30-c409-45fe-8b22-d9e66d1138ed] Took 5.87 seconds to build instance.
Apr 13 16:48:41 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-9757a67b-8e17-4d18-8a72-d09742bbf3d7 tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] Lock "e6953c30-c409-45fe-8b22-d9e66d1138ed" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.971s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:48:42 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:48:42 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:48:44 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:48:47 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:48:47 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:48:52 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:48:52 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:48:57 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:48:57 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:49:02 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:49:02 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:49:07 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:49:12 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:49:12 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:49:17 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 16:49:17 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:49:17 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71731) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 16:49:17 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71731) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 16:49:17 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71731) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 16:49:17 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:49:17 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:49:22 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-5d5320bb-c759-41f7-a5c0-eb74140bcb89 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Acquiring lock "37a39f40-d239-4716-91bc-3f562906bd1e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:49:22 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-5d5320bb-c759-41f7-a5c0-eb74140bcb89 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lock "37a39f40-d239-4716-91bc-3f562906bd1e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:49:22 user nova-compute[71731]: DEBUG nova.compute.manager [None req-5d5320bb-c759-41f7-a5c0-eb74140bcb89 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] [instance: 37a39f40-d239-4716-91bc-3f562906bd1e] Starting instance... {{(pid=71731) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 16:49:22 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-5d5320bb-c759-41f7-a5c0-eb74140bcb89 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:49:22 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-5d5320bb-c759-41f7-a5c0-eb74140bcb89 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:49:22 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-5d5320bb-c759-41f7-a5c0-eb74140bcb89 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71731) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 16:49:22 user nova-compute[71731]: INFO nova.compute.claims [None req-5d5320bb-c759-41f7-a5c0-eb74140bcb89 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] [instance: 37a39f40-d239-4716-91bc-3f562906bd1e] Claim successful on node user
Apr 13 16:49:22 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:49:22 user nova-compute[71731]: DEBUG nova.compute.provider_tree [None req-5d5320bb-c759-41f7-a5c0-eb74140bcb89 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Inventory has not changed in ProviderTree for provider: cb6b1a64-0c24-4e2d-af1e-16576ca9165c {{(pid=71731) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 16:49:22 user nova-compute[71731]: DEBUG nova.scheduler.client.report [None req-5d5320bb-c759-41f7-a5c0-eb74140bcb89 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Inventory has not changed for provider cb6b1a64-0c24-4e2d-af1e-16576ca9165c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71731) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 16:49:22 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-5d5320bb-c759-41f7-a5c0-eb74140bcb89 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.299s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:49:22 user nova-compute[71731]: DEBUG nova.compute.manager [None req-5d5320bb-c759-41f7-a5c0-eb74140bcb89 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] [instance: 37a39f40-d239-4716-91bc-3f562906bd1e] Start building networks asynchronously for instance. {{(pid=71731) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 16:49:22 user nova-compute[71731]: DEBUG nova.compute.manager [None req-5d5320bb-c759-41f7-a5c0-eb74140bcb89 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] [instance: 37a39f40-d239-4716-91bc-3f562906bd1e] Allocating IP information in the background. {{(pid=71731) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 16:49:22 user nova-compute[71731]: DEBUG nova.network.neutron [None req-5d5320bb-c759-41f7-a5c0-eb74140bcb89 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] [instance: 37a39f40-d239-4716-91bc-3f562906bd1e] allocate_for_instance() {{(pid=71731) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 16:49:23 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-5d5320bb-c759-41f7-a5c0-eb74140bcb89 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] [instance: 37a39f40-d239-4716-91bc-3f562906bd1e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 16:49:23 user nova-compute[71731]: DEBUG nova.compute.manager [None req-5d5320bb-c759-41f7-a5c0-eb74140bcb89 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] [instance: 37a39f40-d239-4716-91bc-3f562906bd1e] Start building block device mappings for instance. {{(pid=71731) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 16:49:23 user nova-compute[71731]: DEBUG nova.policy [None req-5d5320bb-c759-41f7-a5c0-eb74140bcb89 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0c7f54723c494e05ada117353c0790cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '846732ecb7e047128b4684972d3cd8c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71731) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 16:49:23 user nova-compute[71731]: DEBUG nova.compute.manager [None req-5d5320bb-c759-41f7-a5c0-eb74140bcb89 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] [instance: 37a39f40-d239-4716-91bc-3f562906bd1e] Start spawning the instance on the hypervisor. {{(pid=71731) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 16:49:23 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-5d5320bb-c759-41f7-a5c0-eb74140bcb89 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] [instance: 37a39f40-d239-4716-91bc-3f562906bd1e] Creating instance directory {{(pid=71731) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 16:49:23 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-5d5320bb-c759-41f7-a5c0-eb74140bcb89 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] [instance: 37a39f40-d239-4716-91bc-3f562906bd1e] Creating image(s)
Apr 13 16:49:23 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-5d5320bb-c759-41f7-a5c0-eb74140bcb89 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Acquiring lock "/opt/stack/data/nova/instances/37a39f40-d239-4716-91bc-3f562906bd1e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:49:23 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-5d5320bb-c759-41f7-a5c0-eb74140bcb89 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lock "/opt/stack/data/nova/instances/37a39f40-d239-4716-91bc-3f562906bd1e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:49:23 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-5d5320bb-c759-41f7-a5c0-eb74140bcb89 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lock "/opt/stack/data/nova/instances/37a39f40-d239-4716-91bc-3f562906bd1e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:49:23 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-5d5320bb-c759-41f7-a5c0-eb74140bcb89 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279 --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:49:23 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-5d5320bb-c759-41f7-a5c0-eb74140bcb89 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279 --force-share --output=json" returned: 0 in 0.133s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:49:23 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-5d5320bb-c759-41f7-a5c0-eb74140bcb89 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Acquiring lock "9524227dd898575c3099d3976f096cd935414279" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:49:23 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-5d5320bb-c759-41f7-a5c0-eb74140bcb89 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lock "9524227dd898575c3099d3976f096cd935414279" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:49:23 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-5d5320bb-c759-41f7-a5c0-eb74140bcb89 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279 --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:49:23 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-5d5320bb-c759-41f7-a5c0-eb74140bcb89 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279 --force-share --output=json" returned: 0 in 0.131s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:49:23 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-5d5320bb-c759-41f7-a5c0-eb74140bcb89 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279,backing_fmt=raw /opt/stack/data/nova/instances/37a39f40-d239-4716-91bc-3f562906bd1e/disk 1073741824 {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:49:23 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-5d5320bb-c759-41f7-a5c0-eb74140bcb89 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279,backing_fmt=raw /opt/stack/data/nova/instances/37a39f40-d239-4716-91bc-3f562906bd1e/disk 1073741824" returned: 0 in 0.091s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:49:23 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-5d5320bb-c759-41f7-a5c0-eb74140bcb89 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lock "9524227dd898575c3099d3976f096cd935414279" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.228s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:49:23 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-5d5320bb-c759-41f7-a5c0-eb74140bcb89 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279 --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:49:23 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-5d5320bb-c759-41f7-a5c0-eb74140bcb89 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279 --force-share --output=json" returned: 0 in 0.131s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:49:23 user nova-compute[71731]: DEBUG nova.virt.disk.api [None req-5d5320bb-c759-41f7-a5c0-eb74140bcb89 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Checking if we can resize image /opt/stack/data/nova/instances/37a39f40-d239-4716-91bc-3f562906bd1e/disk. size=1073741824 {{(pid=71731) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 16:49:23 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-5d5320bb-c759-41f7-a5c0-eb74140bcb89 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37a39f40-d239-4716-91bc-3f562906bd1e/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:49:23 user nova-compute[71731]: DEBUG nova.network.neutron [None req-5d5320bb-c759-41f7-a5c0-eb74140bcb89 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] [instance: 37a39f40-d239-4716-91bc-3f562906bd1e] Successfully created port: 86b0ae4e-a317-4c75-9033-49325a4399d2 {{(pid=71731) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 16:49:23 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-5d5320bb-c759-41f7-a5c0-eb74140bcb89 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37a39f40-d239-4716-91bc-3f562906bd1e/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:49:23 user nova-compute[71731]: DEBUG nova.virt.disk.api [None req-5d5320bb-c759-41f7-a5c0-eb74140bcb89 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Cannot resize image /opt/stack/data/nova/instances/37a39f40-d239-4716-91bc-3f562906bd1e/disk to a smaller size. {{(pid=71731) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 16:49:23 user nova-compute[71731]: DEBUG nova.objects.instance [None req-5d5320bb-c759-41f7-a5c0-eb74140bcb89 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lazy-loading 'migration_context' on Instance uuid 37a39f40-d239-4716-91bc-3f562906bd1e {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:49:23 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-5d5320bb-c759-41f7-a5c0-eb74140bcb89 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] [instance: 37a39f40-d239-4716-91bc-3f562906bd1e] Created local disks {{(pid=71731) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 16:49:23 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-5d5320bb-c759-41f7-a5c0-eb74140bcb89 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] [instance: 37a39f40-d239-4716-91bc-3f562906bd1e] Ensure instance console log exists: /opt/stack/data/nova/instances/37a39f40-d239-4716-91bc-3f562906bd1e/console.log {{(pid=71731) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 16:49:23 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-5d5320bb-c759-41f7-a5c0-eb74140bcb89 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:49:23 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-5d5320bb-c759-41f7-a5c0-eb74140bcb89 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:49:23 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-5d5320bb-c759-41f7-a5c0-eb74140bcb89 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:49:24 user nova-compute[71731]: DEBUG nova.network.neutron [None req-5d5320bb-c759-41f7-a5c0-eb74140bcb89 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] [instance: 37a39f40-d239-4716-91bc-3f562906bd1e] Successfully updated port: 86b0ae4e-a317-4c75-9033-49325a4399d2 {{(pid=71731) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 16:49:24 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-5d5320bb-c759-41f7-a5c0-eb74140bcb89 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Acquiring lock "refresh_cache-37a39f40-d239-4716-91bc-3f562906bd1e" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 16:49:24 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-5d5320bb-c759-41f7-a5c0-eb74140bcb89 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Acquired lock "refresh_cache-37a39f40-d239-4716-91bc-3f562906bd1e" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 16:49:24 user nova-compute[71731]: DEBUG nova.network.neutron [None req-5d5320bb-c759-41f7-a5c0-eb74140bcb89 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] [instance: 37a39f40-d239-4716-91bc-3f562906bd1e] Building network info cache for instance {{(pid=71731) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 16:49:24 user nova-compute[71731]: DEBUG nova.compute.manager [req-6aa50eb6-2751-43e5-ba17-7276f11dcbc6 req-e90a0871-49fd-4944-8f78-5e7e34f3bb30 service nova] [instance: 37a39f40-d239-4716-91bc-3f562906bd1e] Received event network-changed-86b0ae4e-a317-4c75-9033-49325a4399d2 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:49:24 user nova-compute[71731]: DEBUG nova.compute.manager [req-6aa50eb6-2751-43e5-ba17-7276f11dcbc6 req-e90a0871-49fd-4944-8f78-5e7e34f3bb30 service nova] [instance: 37a39f40-d239-4716-91bc-3f562906bd1e] Refreshing instance network info cache due to event network-changed-86b0ae4e-a317-4c75-9033-49325a4399d2. {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 16:49:24 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-6aa50eb6-2751-43e5-ba17-7276f11dcbc6 req-e90a0871-49fd-4944-8f78-5e7e34f3bb30 service nova] Acquiring lock "refresh_cache-37a39f40-d239-4716-91bc-3f562906bd1e" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 16:49:24 user nova-compute[71731]: DEBUG nova.network.neutron [None req-5d5320bb-c759-41f7-a5c0-eb74140bcb89 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] [instance: 37a39f40-d239-4716-91bc-3f562906bd1e] Instance cache missing network info. {{(pid=71731) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 16:49:24 user nova-compute[71731]: DEBUG nova.network.neutron [None req-5d5320bb-c759-41f7-a5c0-eb74140bcb89 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] [instance: 37a39f40-d239-4716-91bc-3f562906bd1e] Updating instance_info_cache with network_info: [{"id": "86b0ae4e-a317-4c75-9033-49325a4399d2", "address": "fa:16:3e:14:4c:bc", "network": {"id": "2a5b69f1-fc5b-4c33-a9eb-12a4d9293500", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2137344591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "846732ecb7e047128b4684972d3cd8c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86b0ae4e-a3", "ovs_interfaceid": "86b0ae4e-a317-4c75-9033-49325a4399d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:49:24 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-5d5320bb-c759-41f7-a5c0-eb74140bcb89 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Releasing lock "refresh_cache-37a39f40-d239-4716-91bc-3f562906bd1e" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 16:49:24 user nova-compute[71731]: DEBUG nova.compute.manager [None req-5d5320bb-c759-41f7-a5c0-eb74140bcb89 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] [instance: 37a39f40-d239-4716-91bc-3f562906bd1e] Instance network_info: |[{"id": "86b0ae4e-a317-4c75-9033-49325a4399d2", "address": "fa:16:3e:14:4c:bc", "network": {"id": "2a5b69f1-fc5b-4c33-a9eb-12a4d9293500", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2137344591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "846732ecb7e047128b4684972d3cd8c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86b0ae4e-a3", "ovs_interfaceid": "86b0ae4e-a317-4c75-9033-49325a4399d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71731) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 16:49:24 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-6aa50eb6-2751-43e5-ba17-7276f11dcbc6 req-e90a0871-49fd-4944-8f78-5e7e34f3bb30 service nova] Acquired lock "refresh_cache-37a39f40-d239-4716-91bc-3f562906bd1e" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 16:49:24 user nova-compute[71731]: DEBUG nova.network.neutron [req-6aa50eb6-2751-43e5-ba17-7276f11dcbc6 req-e90a0871-49fd-4944-8f78-5e7e34f3bb30 service nova] [instance: 37a39f40-d239-4716-91bc-3f562906bd1e] Refreshing network info cache for port 86b0ae4e-a317-4c75-9033-49325a4399d2 {{(pid=71731) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 16:49:24 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-5d5320bb-c759-41f7-a5c0-eb74140bcb89 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] [instance: 37a39f40-d239-4716-91bc-3f562906bd1e] Start _get_guest_xml network_info=[{"id": "86b0ae4e-a317-4c75-9033-49325a4399d2", "address": "fa:16:3e:14:4c:bc", "network": {"id": "2a5b69f1-fc5b-4c33-a9eb-12a4d9293500", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2137344591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "846732ecb7e047128b4684972d3cd8c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86b0ae4e-a3", "ovs_interfaceid": "86b0ae4e-a317-4c75-9033-49325a4399d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T16:16:31Z,direct_url=<?>,disk_format='qcow2',id=708622a9-7465-4492-ade8-b827198f7e30,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='0b29a975c552465aba0ac7d6288434bd',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T16:16:33Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'device_type': 'disk', 'encrypted': False, 'disk_bus': 'virtio', 'guest_format': None, 'encryption_options': None, 'image_id': '708622a9-7465-4492-ade8-b827198f7e30'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71731) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 16:49:24 user nova-compute[71731]: WARNING nova.virt.libvirt.driver [None req-5d5320bb-c759-41f7-a5c0-eb74140bcb89 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 16:49:24 user nova-compute[71731]: WARNING nova.virt.libvirt.driver [None req-5d5320bb-c759-41f7-a5c0-eb74140bcb89 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 16:49:24 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-5d5320bb-c759-41f7-a5c0-eb74140bcb89 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71731) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 16:49:24 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-5d5320bb-c759-41f7-a5c0-eb74140bcb89 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T16:17:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T16:16:31Z,direct_url=<?>,disk_format='qcow2',id=708622a9-7465-4492-ade8-b827198f7e30,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='0b29a975c552465aba0ac7d6288434bd',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T16:16:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 16:49:24 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-5d5320bb-c759-41f7-a5c0-eb74140bcb89 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Flavor limits 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 16:49:24 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-5d5320bb-c759-41f7-a5c0-eb74140bcb89 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Image limits 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 16:49:24 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-5d5320bb-c759-41f7-a5c0-eb74140bcb89 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Flavor pref 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 16:49:24 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-5d5320bb-c759-41f7-a5c0-eb74140bcb89 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Image pref 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 16:49:24 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-5d5320bb-c759-41f7-a5c0-eb74140bcb89 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 16:49:24 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-5d5320bb-c759-41f7-a5c0-eb74140bcb89 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 16:49:24 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-5d5320bb-c759-41f7-a5c0-eb74140bcb89 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71731) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 16:49:24 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-5d5320bb-c759-41f7-a5c0-eb74140bcb89 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Got 1 possible topologies {{(pid=71731) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 16:49:24 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-5d5320bb-c759-41f7-a5c0-eb74140bcb89 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 16:49:24 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-5d5320bb-c759-41f7-a5c0-eb74140bcb89 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 16:49:25 user nova-compute[71731]: DEBUG nova.virt.libvirt.vif [None req-5d5320bb-c759-41f7-a5c0-eb74140bcb89 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T16:49:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2129119099',display_name='tempest-ServerRescueNegativeTestJSON-server-2129119099',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2129119099',id=40,image_ref='708622a9-7465-4492-ade8-b827198f7e30',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBInYPh0gx086UszGyyqEY0fWXC6yPnnRldjV6vUByd8iGqw/BPMxIKhGYsYjdNeYHSNNfn33Tapk/jQbqiYzfJYw4chd2naEdDS8MeKSMHscX8fHOp+k3fZ6id92uef9aA==',key_name='tempest-keypair-1684148765',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='846732ecb7e047128b4684972d3cd8c6',ramdisk_id='',reservation_id='r-8atp79dt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='708622a9-7465-4492-ade8-b827198f7e30',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-84287455',owner_user_name='tempest-ServerRescueNegativeTestJSON-84287455-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T16:49:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0c7f54723c494e05ada117353c0790cb',uuid=37a39f40-d239-4716-91bc-3f562906bd1e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "86b0ae4e-a317-4c75-9033-49325a4399d2", "address": "fa:16:3e:14:4c:bc", "network": {"id": "2a5b69f1-fc5b-4c33-a9eb-12a4d9293500", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2137344591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "846732ecb7e047128b4684972d3cd8c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86b0ae4e-a3", "ovs_interfaceid": "86b0ae4e-a317-4c75-9033-49325a4399d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71731) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 16:49:25 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-5d5320bb-c759-41f7-a5c0-eb74140bcb89 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Converting VIF {"id": "86b0ae4e-a317-4c75-9033-49325a4399d2", "address": "fa:16:3e:14:4c:bc", "network": {"id": "2a5b69f1-fc5b-4c33-a9eb-12a4d9293500", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2137344591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "846732ecb7e047128b4684972d3cd8c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86b0ae4e-a3", "ovs_interfaceid": "86b0ae4e-a317-4c75-9033-49325a4399d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 16:49:25 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-5d5320bb-c759-41f7-a5c0-eb74140bcb89 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:14:4c:bc,bridge_name='br-int',has_traffic_filtering=True,id=86b0ae4e-a317-4c75-9033-49325a4399d2,network=Network(2a5b69f1-fc5b-4c33-a9eb-12a4d9293500),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86b0ae4e-a3') {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 16:49:25 user nova-compute[71731]: DEBUG nova.objects.instance [None req-5d5320bb-c759-41f7-a5c0-eb74140bcb89 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lazy-loading 'pci_devices' on Instance uuid 37a39f40-d239-4716-91bc-3f562906bd1e {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:49:25 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-5d5320bb-c759-41f7-a5c0-eb74140bcb89 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] [instance: 37a39f40-d239-4716-91bc-3f562906bd1e] End _get_guest_xml xml=<domain type="kvm">
Apr 13 16:49:25 user nova-compute[71731]:   <uuid>37a39f40-d239-4716-91bc-3f562906bd1e</uuid>
Apr 13 16:49:25 user nova-compute[71731]:   <name>instance-00000028</name>
Apr 13 16:49:25 user nova-compute[71731]:   <memory>131072</memory>
Apr 13 16:49:25 user nova-compute[71731]:   <vcpu>1</vcpu>
Apr 13 16:49:25 user nova-compute[71731]:   <metadata>
Apr 13 16:49:25 user nova-compute[71731]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 16:49:25 user nova-compute[71731]:       <nova:package version="0.0.0"/>
Apr 13 16:49:25 user nova-compute[71731]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-2129119099</nova:name>
Apr 13 16:49:25 user nova-compute[71731]:       <nova:creationTime>2023-04-13 16:49:24</nova:creationTime>
Apr 13 16:49:25 user nova-compute[71731]:       <nova:flavor name="m1.nano">
Apr 13 16:49:25 user nova-compute[71731]:         <nova:memory>128</nova:memory>
Apr 13 16:49:25 user nova-compute[71731]:         <nova:disk>1</nova:disk>
Apr 13 16:49:25 user nova-compute[71731]:         <nova:swap>0</nova:swap>
Apr 13 16:49:25 user nova-compute[71731]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 16:49:25 user nova-compute[71731]:         <nova:vcpus>1</nova:vcpus>
Apr 13 16:49:25 user nova-compute[71731]:       </nova:flavor>
Apr 13 16:49:25 user nova-compute[71731]:       <nova:owner>
Apr 13 16:49:25 user nova-compute[71731]:         <nova:user uuid="0c7f54723c494e05ada117353c0790cb">tempest-ServerRescueNegativeTestJSON-84287455-project-member</nova:user>
Apr 13 16:49:25 user nova-compute[71731]:         <nova:project uuid="846732ecb7e047128b4684972d3cd8c6">tempest-ServerRescueNegativeTestJSON-84287455</nova:project>
Apr 13 16:49:25 user nova-compute[71731]:       </nova:owner>
Apr 13 16:49:25 user nova-compute[71731]:       <nova:root type="image" uuid="708622a9-7465-4492-ade8-b827198f7e30"/>
Apr 13 16:49:25 user nova-compute[71731]:       <nova:ports>
Apr 13 16:49:25 user nova-compute[71731]:         <nova:port uuid="86b0ae4e-a317-4c75-9033-49325a4399d2">
Apr 13 16:49:25 user nova-compute[71731]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Apr 13 16:49:25 user nova-compute[71731]:         </nova:port>
Apr 13 16:49:25 user nova-compute[71731]:       </nova:ports>
Apr 13 16:49:25 user nova-compute[71731]:     </nova:instance>
Apr 13 16:49:25 user nova-compute[71731]:   </metadata>
Apr 13 16:49:25 user nova-compute[71731]:   <sysinfo type="smbios">
Apr 13 16:49:25 user nova-compute[71731]:     <system>
Apr 13 16:49:25 user nova-compute[71731]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 16:49:25 user nova-compute[71731]:       <entry name="product">OpenStack Nova</entry>
Apr 13 16:49:25 user nova-compute[71731]:       <entry name="version">0.0.0</entry>
Apr 13 16:49:25 user nova-compute[71731]:       <entry name="serial">37a39f40-d239-4716-91bc-3f562906bd1e</entry>
Apr 13 16:49:25 user nova-compute[71731]:       <entry name="uuid">37a39f40-d239-4716-91bc-3f562906bd1e</entry>
Apr 13 16:49:25 user nova-compute[71731]:       <entry name="family">Virtual Machine</entry>
Apr 13 16:49:25 user nova-compute[71731]:     </system>
Apr 13 16:49:25 user nova-compute[71731]:   </sysinfo>
Apr 13 16:49:25 user nova-compute[71731]:   <os>
Apr 13 16:49:25 user nova-compute[71731]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 16:49:25 user nova-compute[71731]:     <boot dev="hd"/>
Apr 13 16:49:25 user nova-compute[71731]:     <smbios mode="sysinfo"/>
Apr 13 16:49:25 user nova-compute[71731]:   </os>
Apr 13 16:49:25 user nova-compute[71731]:   <features>
Apr 13 16:49:25 user nova-compute[71731]:     <acpi/>
Apr 13 16:49:25 user nova-compute[71731]:     <apic/>
Apr 13 16:49:25 user nova-compute[71731]:     <vmcoreinfo/>
Apr 13 16:49:25 user nova-compute[71731]:   </features>
Apr 13 16:49:25 user nova-compute[71731]:   <clock offset="utc">
Apr 13 16:49:25 user nova-compute[71731]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 16:49:25 user nova-compute[71731]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 16:49:25 user nova-compute[71731]:     <timer name="hpet" present="no"/>
Apr 13 16:49:25 user nova-compute[71731]:   </clock>
Apr 13 16:49:25 user nova-compute[71731]:   <cpu mode="custom" match="exact">
Apr 13 16:49:25 user nova-compute[71731]:     <model>Nehalem</model>
Apr 13 16:49:25 user nova-compute[71731]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 16:49:25 user nova-compute[71731]:   </cpu>
Apr 13 16:49:25 user nova-compute[71731]:   <devices>
Apr 13 16:49:25 user nova-compute[71731]:     <disk type="file" device="disk">
Apr 13 16:49:25 user nova-compute[71731]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 16:49:25 user nova-compute[71731]:       <source file="/opt/stack/data/nova/instances/37a39f40-d239-4716-91bc-3f562906bd1e/disk"/>
Apr 13 16:49:25 user nova-compute[71731]:       <target dev="vda" bus="virtio"/>
Apr 13 16:49:25 user nova-compute[71731]:     </disk>
Apr 13 16:49:25 user nova-compute[71731]:     <interface type="ethernet">
Apr 13 16:49:25 user nova-compute[71731]:       <mac address="fa:16:3e:14:4c:bc"/>
Apr 13 16:49:25 user nova-compute[71731]:       <model type="virtio"/>
Apr 13 16:49:25 user nova-compute[71731]:       <mtu size="1442"/>
Apr 13 16:49:25 user nova-compute[71731]:       <target dev="tap86b0ae4e-a3"/>
Apr 13 16:49:25 user nova-compute[71731]:     </interface>
Apr 13 16:49:25 user nova-compute[71731]:     <serial type="pty">
Apr 13 16:49:25 user nova-compute[71731]:       <log file="/opt/stack/data/nova/instances/37a39f40-d239-4716-91bc-3f562906bd1e/console.log" append="off"/>
Apr 13 16:49:25 user nova-compute[71731]:     </serial>
Apr 13 16:49:25 user nova-compute[71731]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 16:49:25 user nova-compute[71731]:     <video>
Apr 13 16:49:25 user nova-compute[71731]:       <model type="virtio"/>
Apr 13 16:49:25 user nova-compute[71731]:     </video>
Apr 13 16:49:25 user nova-compute[71731]:     <rng model="virtio">
Apr 13 16:49:25 user nova-compute[71731]:       <backend model="random">/dev/urandom</backend>
Apr 13 16:49:25 user nova-compute[71731]:     </rng>
Apr 13 16:49:25 user nova-compute[71731]:     <controller type="usb" index="0" model="none"/>
Apr 13 16:49:25 user nova-compute[71731]:     <memballoon model="virtio">
Apr 13 16:49:25 user nova-compute[71731]:       <stats period="10"/>
Apr 13 16:49:25 user nova-compute[71731]:     </memballoon>
Apr 13 16:49:25 user nova-compute[71731]:   </devices>
Apr 13 16:49:25 user nova-compute[71731]: </domain>
Apr 13 16:49:25 user nova-compute[71731]:  {{(pid=71731) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 16:49:25 user nova-compute[71731]: DEBUG nova.virt.libvirt.vif [None req-5d5320bb-c759-41f7-a5c0-eb74140bcb89 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T16:49:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2129119099',display_name='tempest-ServerRescueNegativeTestJSON-server-2129119099',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2129119099',id=40,image_ref='708622a9-7465-4492-ade8-b827198f7e30',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBInYPh0gx086UszGyyqEY0fWXC6yPnnRldjV6vUByd8iGqw/BPMxIKhGYsYjdNeYHSNNfn33Tapk/jQbqiYzfJYw4chd2naEdDS8MeKSMHscX8fHOp+k3fZ6id92uef9aA==',key_name='tempest-keypair-1684148765',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='846732ecb7e047128b4684972d3cd8c6',ramdisk_id='',reservation_id='r-8atp79dt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='708622a9-7465-4492-ade8-b827198f7e30',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-84287455',owner_user_name='tempest-ServerRescueNegativeTestJSON-84287455-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T16:49:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0c7f54723c494e05ada117353c0790cb',uuid=37a39f40-d239-4716-91bc-3f562906bd1e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "86b0ae4e-a317-4c75-9033-49325a4399d2", "address": "fa:16:3e:14:4c:bc", "network": {"id": "2a5b69f1-fc5b-4c33-a9eb-12a4d9293500", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2137344591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "846732ecb7e047128b4684972d3cd8c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86b0ae4e-a3", "ovs_interfaceid": "86b0ae4e-a317-4c75-9033-49325a4399d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 16:49:25 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-5d5320bb-c759-41f7-a5c0-eb74140bcb89 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Converting VIF {"id": "86b0ae4e-a317-4c75-9033-49325a4399d2", "address": "fa:16:3e:14:4c:bc", "network": {"id": "2a5b69f1-fc5b-4c33-a9eb-12a4d9293500", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2137344591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "846732ecb7e047128b4684972d3cd8c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86b0ae4e-a3", "ovs_interfaceid": "86b0ae4e-a317-4c75-9033-49325a4399d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 16:49:25 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-5d5320bb-c759-41f7-a5c0-eb74140bcb89 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:14:4c:bc,bridge_name='br-int',has_traffic_filtering=True,id=86b0ae4e-a317-4c75-9033-49325a4399d2,network=Network(2a5b69f1-fc5b-4c33-a9eb-12a4d9293500),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86b0ae4e-a3') {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 16:49:25 user nova-compute[71731]: DEBUG os_vif [None req-5d5320bb-c759-41f7-a5c0-eb74140bcb89 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:4c:bc,bridge_name='br-int',has_traffic_filtering=True,id=86b0ae4e-a317-4c75-9033-49325a4399d2,network=Network(2a5b69f1-fc5b-4c33-a9eb-12a4d9293500),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86b0ae4e-a3') {{(pid=71731) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 16:49:25 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:49:25 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:49:25 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 16:49:25 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:49:25 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap86b0ae4e-a3, may_exist=True) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:49:25 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap86b0ae4e-a3, col_values=(('external_ids', {'iface-id': '86b0ae4e-a317-4c75-9033-49325a4399d2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:14:4c:bc', 'vm-uuid': '37a39f40-d239-4716-91bc-3f562906bd1e'}),)) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:49:25 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:49:25 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 16:49:25 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:49:25 user nova-compute[71731]: INFO os_vif [None req-5d5320bb-c759-41f7-a5c0-eb74140bcb89 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:4c:bc,bridge_name='br-int',has_traffic_filtering=True,id=86b0ae4e-a317-4c75-9033-49325a4399d2,network=Network(2a5b69f1-fc5b-4c33-a9eb-12a4d9293500),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86b0ae4e-a3')
Apr 13 16:49:25 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-5d5320bb-c759-41f7-a5c0-eb74140bcb89 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] No BDM found with device name vda, not building metadata. {{(pid=71731) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 16:49:25 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-5d5320bb-c759-41f7-a5c0-eb74140bcb89 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] No VIF found with MAC fa:16:3e:14:4c:bc, not building metadata {{(pid=71731) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 16:49:25 user nova-compute[71731]: DEBUG nova.network.neutron [req-6aa50eb6-2751-43e5-ba17-7276f11dcbc6 req-e90a0871-49fd-4944-8f78-5e7e34f3bb30 service nova] [instance: 37a39f40-d239-4716-91bc-3f562906bd1e] Updated VIF entry in instance network info cache for port 86b0ae4e-a317-4c75-9033-49325a4399d2. {{(pid=71731) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 16:49:25 user nova-compute[71731]: DEBUG nova.network.neutron [req-6aa50eb6-2751-43e5-ba17-7276f11dcbc6 req-e90a0871-49fd-4944-8f78-5e7e34f3bb30 service nova] [instance: 37a39f40-d239-4716-91bc-3f562906bd1e] Updating instance_info_cache with network_info: [{"id": "86b0ae4e-a317-4c75-9033-49325a4399d2", "address": "fa:16:3e:14:4c:bc", "network": {"id": "2a5b69f1-fc5b-4c33-a9eb-12a4d9293500", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2137344591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "846732ecb7e047128b4684972d3cd8c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86b0ae4e-a3", "ovs_interfaceid": "86b0ae4e-a317-4c75-9033-49325a4399d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:49:25 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-6aa50eb6-2751-43e5-ba17-7276f11dcbc6 req-e90a0871-49fd-4944-8f78-5e7e34f3bb30 service nova] Releasing lock "refresh_cache-37a39f40-d239-4716-91bc-3f562906bd1e" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 16:49:26 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:49:26 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:49:26 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:49:26 user nova-compute[71731]: DEBUG nova.compute.manager [req-4967fb7e-4ea6-4cb5-9771-d11d7db10ba5 req-2ef0925e-1c3b-46da-ab74-62d54a138d60 service nova] [instance: 37a39f40-d239-4716-91bc-3f562906bd1e] Received event network-vif-plugged-86b0ae4e-a317-4c75-9033-49325a4399d2 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:49:26 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-4967fb7e-4ea6-4cb5-9771-d11d7db10ba5 req-2ef0925e-1c3b-46da-ab74-62d54a138d60 service nova] Acquiring lock "37a39f40-d239-4716-91bc-3f562906bd1e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:49:26 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-4967fb7e-4ea6-4cb5-9771-d11d7db10ba5 req-2ef0925e-1c3b-46da-ab74-62d54a138d60 service nova] Lock "37a39f40-d239-4716-91bc-3f562906bd1e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:49:26 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-4967fb7e-4ea6-4cb5-9771-d11d7db10ba5 req-2ef0925e-1c3b-46da-ab74-62d54a138d60 service nova] Lock "37a39f40-d239-4716-91bc-3f562906bd1e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:49:26 user nova-compute[71731]: DEBUG nova.compute.manager [req-4967fb7e-4ea6-4cb5-9771-d11d7db10ba5 req-2ef0925e-1c3b-46da-ab74-62d54a138d60 service nova] [instance: 37a39f40-d239-4716-91bc-3f562906bd1e] No waiting events found dispatching network-vif-plugged-86b0ae4e-a317-4c75-9033-49325a4399d2 {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:49:26 user nova-compute[71731]: WARNING nova.compute.manager [req-4967fb7e-4ea6-4cb5-9771-d11d7db10ba5 req-2ef0925e-1c3b-46da-ab74-62d54a138d60 service nova] [instance: 37a39f40-d239-4716-91bc-3f562906bd1e] Received unexpected event network-vif-plugged-86b0ae4e-a317-4c75-9033-49325a4399d2 for instance with vm_state building and task_state spawning.
Apr 13 16:49:26 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:49:26 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:49:27 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:49:28 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:49:28 user nova-compute[71731]: DEBUG nova.virt.driver [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Emitting event <LifecycleEvent: 1681404568.6329336, 37a39f40-d239-4716-91bc-3f562906bd1e => Resumed> {{(pid=71731) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 16:49:28 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 37a39f40-d239-4716-91bc-3f562906bd1e] VM Resumed (Lifecycle Event)
Apr 13 16:49:28 user nova-compute[71731]: DEBUG nova.compute.manager [None req-5d5320bb-c759-41f7-a5c0-eb74140bcb89 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] [instance: 37a39f40-d239-4716-91bc-3f562906bd1e] Instance event wait completed in 0 seconds for  {{(pid=71731) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 16:49:28 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-5d5320bb-c759-41f7-a5c0-eb74140bcb89 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] [instance: 37a39f40-d239-4716-91bc-3f562906bd1e] Guest created on hypervisor {{(pid=71731) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 16:49:28 user nova-compute[71731]: INFO nova.virt.libvirt.driver [-] [instance: 37a39f40-d239-4716-91bc-3f562906bd1e] Instance spawned successfully.
Apr 13 16:49:28 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-5d5320bb-c759-41f7-a5c0-eb74140bcb89 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] [instance: 37a39f40-d239-4716-91bc-3f562906bd1e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 16:49:28 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 37a39f40-d239-4716-91bc-3f562906bd1e] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:49:28 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 37a39f40-d239-4716-91bc-3f562906bd1e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71731) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 16:49:28 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-5d5320bb-c759-41f7-a5c0-eb74140bcb89 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] [instance: 37a39f40-d239-4716-91bc-3f562906bd1e] Found default for hw_cdrom_bus of ide {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:49:28 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-5d5320bb-c759-41f7-a5c0-eb74140bcb89 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] [instance: 37a39f40-d239-4716-91bc-3f562906bd1e] Found default for hw_disk_bus of virtio {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:49:28 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-5d5320bb-c759-41f7-a5c0-eb74140bcb89 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] [instance: 37a39f40-d239-4716-91bc-3f562906bd1e] Found default for hw_input_bus of None {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:49:28 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-5d5320bb-c759-41f7-a5c0-eb74140bcb89 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] [instance: 37a39f40-d239-4716-91bc-3f562906bd1e] Found default for hw_pointer_model of None {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:49:28 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-5d5320bb-c759-41f7-a5c0-eb74140bcb89 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] [instance: 37a39f40-d239-4716-91bc-3f562906bd1e] Found default for hw_video_model of virtio {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:49:28 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-5d5320bb-c759-41f7-a5c0-eb74140bcb89 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] [instance: 37a39f40-d239-4716-91bc-3f562906bd1e] Found default for hw_vif_model of virtio {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:49:28 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 37a39f40-d239-4716-91bc-3f562906bd1e] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 16:49:28 user nova-compute[71731]: DEBUG nova.virt.driver [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Emitting event <LifecycleEvent: 1681404568.634661, 37a39f40-d239-4716-91bc-3f562906bd1e => Started> {{(pid=71731) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 16:49:28 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 37a39f40-d239-4716-91bc-3f562906bd1e] VM Started (Lifecycle Event)
Apr 13 16:49:28 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 37a39f40-d239-4716-91bc-3f562906bd1e] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:49:28 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 37a39f40-d239-4716-91bc-3f562906bd1e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71731) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 16:49:28 user nova-compute[71731]: DEBUG nova.compute.manager [req-4c3b3ac4-512c-4fc6-a8b5-242c66653bfe req-dad72944-f5b8-490b-8f44-c538aacb9422 service nova] [instance: 37a39f40-d239-4716-91bc-3f562906bd1e] Received event network-vif-plugged-86b0ae4e-a317-4c75-9033-49325a4399d2 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:49:28 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-4c3b3ac4-512c-4fc6-a8b5-242c66653bfe req-dad72944-f5b8-490b-8f44-c538aacb9422 service nova] Acquiring lock "37a39f40-d239-4716-91bc-3f562906bd1e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:49:28 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-4c3b3ac4-512c-4fc6-a8b5-242c66653bfe req-dad72944-f5b8-490b-8f44-c538aacb9422 service nova] Lock "37a39f40-d239-4716-91bc-3f562906bd1e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:49:28 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-4c3b3ac4-512c-4fc6-a8b5-242c66653bfe req-dad72944-f5b8-490b-8f44-c538aacb9422 service nova] Lock "37a39f40-d239-4716-91bc-3f562906bd1e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:49:28 user nova-compute[71731]: DEBUG nova.compute.manager [req-4c3b3ac4-512c-4fc6-a8b5-242c66653bfe req-dad72944-f5b8-490b-8f44-c538aacb9422 service nova] [instance: 37a39f40-d239-4716-91bc-3f562906bd1e] No waiting events found dispatching network-vif-plugged-86b0ae4e-a317-4c75-9033-49325a4399d2 {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:49:28 user nova-compute[71731]: WARNING nova.compute.manager [req-4c3b3ac4-512c-4fc6-a8b5-242c66653bfe req-dad72944-f5b8-490b-8f44-c538aacb9422 service nova] [instance: 37a39f40-d239-4716-91bc-3f562906bd1e] Received unexpected event network-vif-plugged-86b0ae4e-a317-4c75-9033-49325a4399d2 for instance with vm_state building and task_state spawning.
Apr 13 16:49:28 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 37a39f40-d239-4716-91bc-3f562906bd1e] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 16:49:28 user nova-compute[71731]: INFO nova.compute.manager [None req-5d5320bb-c759-41f7-a5c0-eb74140bcb89 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] [instance: 37a39f40-d239-4716-91bc-3f562906bd1e] Took 5.61 seconds to spawn the instance on the hypervisor.
Apr 13 16:49:28 user nova-compute[71731]: DEBUG nova.compute.manager [None req-5d5320bb-c759-41f7-a5c0-eb74140bcb89 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] [instance: 37a39f40-d239-4716-91bc-3f562906bd1e] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:49:28 user nova-compute[71731]: INFO nova.compute.manager [None req-5d5320bb-c759-41f7-a5c0-eb74140bcb89 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] [instance: 37a39f40-d239-4716-91bc-3f562906bd1e] Took 6.50 seconds to build instance.
Apr 13 16:49:28 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-5d5320bb-c759-41f7-a5c0-eb74140bcb89 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lock "37a39f40-d239-4716-91bc-3f562906bd1e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.602s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:49:29 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:49:29 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71731) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 16:49:30 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:49:30 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:49:31 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager.update_available_resource {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:49:31 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:49:31 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:49:31 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:49:31 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Auditing locally available compute resources for user (node: user) {{(pid=71731) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 16:49:31 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3af23ff8-4e10-4fbf-a86e-bda842f084ff/disk.rescue --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:49:31 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3af23ff8-4e10-4fbf-a86e-bda842f084ff/disk.rescue --force-share --output=json" returned: 0 in 0.229s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:49:31 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3af23ff8-4e10-4fbf-a86e-bda842f084ff/disk.rescue --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:49:31 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3af23ff8-4e10-4fbf-a86e-bda842f084ff/disk.rescue --force-share --output=json" returned: 0 in 0.162s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:49:31 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3af23ff8-4e10-4fbf-a86e-bda842f084ff/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:49:31 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3af23ff8-4e10-4fbf-a86e-bda842f084ff/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:49:31 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3af23ff8-4e10-4fbf-a86e-bda842f084ff/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:49:31 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3af23ff8-4e10-4fbf-a86e-bda842f084ff/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:49:32 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37a39f40-d239-4716-91bc-3f562906bd1e/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:49:32 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37a39f40-d239-4716-91bc-3f562906bd1e/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:49:32 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37a39f40-d239-4716-91bc-3f562906bd1e/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:49:32 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37a39f40-d239-4716-91bc-3f562906bd1e/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:49:32 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6953c30-c409-45fe-8b22-d9e66d1138ed/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:49:32 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6953c30-c409-45fe-8b22-d9e66d1138ed/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:49:32 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6953c30-c409-45fe-8b22-d9e66d1138ed/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:49:32 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6953c30-c409-45fe-8b22-d9e66d1138ed/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:49:32 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2d55cdd-c89c-4c59-afe1-49a33225af22/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:49:32 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2d55cdd-c89c-4c59-afe1-49a33225af22/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:49:32 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2d55cdd-c89c-4c59-afe1-49a33225af22/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:49:32 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2d55cdd-c89c-4c59-afe1-49a33225af22/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:49:33 user nova-compute[71731]: WARNING nova.virt.libvirt.driver [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 16:49:33 user nova-compute[71731]: WARNING nova.virt.libvirt.driver [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 16:49:33 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Hypervisor/Node resource view: name=user free_ram=8471MB free_disk=26.074180603027344GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71731) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 16:49:33 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:49:33 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:49:33 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance b2d55cdd-c89c-4c59-afe1-49a33225af22 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 16:49:33 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance 3af23ff8-4e10-4fbf-a86e-bda842f084ff actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 16:49:33 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance e6953c30-c409-45fe-8b22-d9e66d1138ed actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 16:49:33 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance 37a39f40-d239-4716-91bc-3f562906bd1e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 16:49:33 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=71731) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 16:49:33 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Final resource view: name=user phys_ram=16023MB used_ram=1024MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=71731) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 16:49:33 user nova-compute[71731]: DEBUG nova.compute.provider_tree [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Inventory has not changed in ProviderTree for provider: cb6b1a64-0c24-4e2d-af1e-16576ca9165c {{(pid=71731) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 16:49:33 user nova-compute[71731]: DEBUG nova.scheduler.client.report [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Inventory has not changed for provider cb6b1a64-0c24-4e2d-af1e-16576ca9165c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71731) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 16:49:33 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Compute_service record updated for user:user {{(pid=71731) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 16:49:33 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.269s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:49:35 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 16:49:35 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:49:35 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71731) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 16:49:35 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71731) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 16:49:35 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71731) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 16:49:35 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:49:38 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:49:38 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:49:38 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Starting heal instance info cache {{(pid=71731) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 16:49:38 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Didn't find any instances for network info cache update. {{(pid=71731) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 13 16:49:38 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:49:39 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:49:39 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:49:40 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 16:49:40 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 16:49:40 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71731) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 16:49:40 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71731) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 16:49:40 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:49:40 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71731) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 16:49:42 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:49:45 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:49:47 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:49:50 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:49:52 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:49:55 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:49:57 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:50:00 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:50:02 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:50:05 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:50:10 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 16:50:10 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:50:10 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71731) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 16:50:10 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71731) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 16:50:10 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71731) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 16:50:10 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:50:12 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:50:15 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:50:20 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 16:50:20 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:50:20 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71731) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 16:50:20 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71731) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 16:50:20 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71731) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 16:50:20 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:50:25 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 16:50:25 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:50:25 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71731) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 16:50:25 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71731) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 16:50:25 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71731) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 16:50:25 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:50:25 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-27f5dad0-6008-4642-8adf-5d7b827912ba tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] Acquiring lock "e6953c30-c409-45fe-8b22-d9e66d1138ed" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:50:25 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-27f5dad0-6008-4642-8adf-5d7b827912ba tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] Lock "e6953c30-c409-45fe-8b22-d9e66d1138ed" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:50:25 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-27f5dad0-6008-4642-8adf-5d7b827912ba tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] Acquiring lock "e6953c30-c409-45fe-8b22-d9e66d1138ed-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:50:25 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-27f5dad0-6008-4642-8adf-5d7b827912ba tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] Lock "e6953c30-c409-45fe-8b22-d9e66d1138ed-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:50:25 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-27f5dad0-6008-4642-8adf-5d7b827912ba tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] Lock "e6953c30-c409-45fe-8b22-d9e66d1138ed-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:50:25 user nova-compute[71731]: INFO nova.compute.manager [None req-27f5dad0-6008-4642-8adf-5d7b827912ba tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] [instance: e6953c30-c409-45fe-8b22-d9e66d1138ed] Terminating instance
Apr 13 16:50:25 user nova-compute[71731]: DEBUG nova.compute.manager [None req-27f5dad0-6008-4642-8adf-5d7b827912ba tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] [instance: e6953c30-c409-45fe-8b22-d9e66d1138ed] Start destroying the instance on the hypervisor. {{(pid=71731) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 16:50:25 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:50:26 user nova-compute[71731]: DEBUG nova.compute.manager [req-c1a0d5b4-4e06-4b6a-8090-31f785cc398b req-813380b8-a44a-434e-a8e5-68cf5cc752fd service nova] [instance: e6953c30-c409-45fe-8b22-d9e66d1138ed] Received event network-vif-unplugged-e2f0381a-2e17-4d01-b125-0d9ad8c94788 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:50:26 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-c1a0d5b4-4e06-4b6a-8090-31f785cc398b req-813380b8-a44a-434e-a8e5-68cf5cc752fd service nova] Acquiring lock "e6953c30-c409-45fe-8b22-d9e66d1138ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:50:26 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-c1a0d5b4-4e06-4b6a-8090-31f785cc398b req-813380b8-a44a-434e-a8e5-68cf5cc752fd service nova] Lock "e6953c30-c409-45fe-8b22-d9e66d1138ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:50:26 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-c1a0d5b4-4e06-4b6a-8090-31f785cc398b req-813380b8-a44a-434e-a8e5-68cf5cc752fd service nova] Lock "e6953c30-c409-45fe-8b22-d9e66d1138ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:50:26 user nova-compute[71731]: DEBUG nova.compute.manager [req-c1a0d5b4-4e06-4b6a-8090-31f785cc398b req-813380b8-a44a-434e-a8e5-68cf5cc752fd service nova] [instance: e6953c30-c409-45fe-8b22-d9e66d1138ed] No waiting events found dispatching network-vif-unplugged-e2f0381a-2e17-4d01-b125-0d9ad8c94788 {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:50:26 user nova-compute[71731]: DEBUG nova.compute.manager [req-c1a0d5b4-4e06-4b6a-8090-31f785cc398b req-813380b8-a44a-434e-a8e5-68cf5cc752fd service nova] [instance: e6953c30-c409-45fe-8b22-d9e66d1138ed] Received event network-vif-unplugged-e2f0381a-2e17-4d01-b125-0d9ad8c94788 for instance with task_state deleting. {{(pid=71731) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 16:50:26 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:50:26 user nova-compute[71731]: INFO nova.virt.libvirt.driver [-] [instance: e6953c30-c409-45fe-8b22-d9e66d1138ed] Instance destroyed successfully.
Apr 13 16:50:26 user nova-compute[71731]: DEBUG nova.objects.instance [None req-27f5dad0-6008-4642-8adf-5d7b827912ba tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] Lazy-loading 'resources' on Instance uuid e6953c30-c409-45fe-8b22-d9e66d1138ed {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:50:26 user nova-compute[71731]: DEBUG nova.virt.libvirt.vif [None req-27f5dad0-6008-4642-8adf-5d7b827912ba tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T16:48:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1742782258',display_name='tempest-VolumesActionsTest-instance-1742782258',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1742782258',id=39,image_ref='708622a9-7465-4492-ade8-b827198f7e30',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-13T16:48:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d099f58565de44fba2df173a2bdb3019',ramdisk_id='',reservation_id='r-3t3i035g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='708622a9-7465-4492-ade8-b827198f7e30',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-450740344',owner_user_name='tempest-VolumesActionsTest-450740344-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T16:48:41Z,user_data=None,user_id='5051bef91062494f991ee96a93c9dc6a',uuid=e6953c30-c409-45fe-8b22-d9e66d1138ed,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e2f0381a-2e17-4d01-b125-0d9ad8c94788", "address": "fa:16:3e:03:46:65", "network": {"id": "b742fa77-3781-46be-8a60-11bf61969238", "bridge": "br-int", "label": "tempest-VolumesActionsTest-204183032-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "d099f58565de44fba2df173a2bdb3019", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2f0381a-2e", "ovs_interfaceid": "e2f0381a-2e17-4d01-b125-0d9ad8c94788", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 16:50:26 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-27f5dad0-6008-4642-8adf-5d7b827912ba tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] Converting VIF {"id": "e2f0381a-2e17-4d01-b125-0d9ad8c94788", "address": "fa:16:3e:03:46:65", "network": {"id": "b742fa77-3781-46be-8a60-11bf61969238", "bridge": "br-int", "label": "tempest-VolumesActionsTest-204183032-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "d099f58565de44fba2df173a2bdb3019", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2f0381a-2e", "ovs_interfaceid": "e2f0381a-2e17-4d01-b125-0d9ad8c94788", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 16:50:26 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-27f5dad0-6008-4642-8adf-5d7b827912ba tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:03:46:65,bridge_name='br-int',has_traffic_filtering=True,id=e2f0381a-2e17-4d01-b125-0d9ad8c94788,network=Network(b742fa77-3781-46be-8a60-11bf61969238),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2f0381a-2e') {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 16:50:26 user nova-compute[71731]: DEBUG os_vif [None req-27f5dad0-6008-4642-8adf-5d7b827912ba tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:46:65,bridge_name='br-int',has_traffic_filtering=True,id=e2f0381a-2e17-4d01-b125-0d9ad8c94788,network=Network(b742fa77-3781-46be-8a60-11bf61969238),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2f0381a-2e') {{(pid=71731) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 16:50:26 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:50:26 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape2f0381a-2e, bridge=br-int, if_exists=True) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:50:26 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:50:26 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 16:50:26 user nova-compute[71731]: INFO os_vif [None req-27f5dad0-6008-4642-8adf-5d7b827912ba tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:46:65,bridge_name='br-int',has_traffic_filtering=True,id=e2f0381a-2e17-4d01-b125-0d9ad8c94788,network=Network(b742fa77-3781-46be-8a60-11bf61969238),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2f0381a-2e')
Apr 13 16:50:26 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-27f5dad0-6008-4642-8adf-5d7b827912ba tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] [instance: e6953c30-c409-45fe-8b22-d9e66d1138ed] Deleting instance files /opt/stack/data/nova/instances/e6953c30-c409-45fe-8b22-d9e66d1138ed_del
Apr 13 16:50:26 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-27f5dad0-6008-4642-8adf-5d7b827912ba tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] [instance: e6953c30-c409-45fe-8b22-d9e66d1138ed] Deletion of /opt/stack/data/nova/instances/e6953c30-c409-45fe-8b22-d9e66d1138ed_del complete
Apr 13 16:50:26 user nova-compute[71731]: INFO nova.compute.manager [None req-27f5dad0-6008-4642-8adf-5d7b827912ba tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] [instance: e6953c30-c409-45fe-8b22-d9e66d1138ed] Took 0.65 seconds to destroy the instance on the hypervisor.
Apr 13 16:50:26 user nova-compute[71731]: DEBUG oslo.service.loopingcall [None req-27f5dad0-6008-4642-8adf-5d7b827912ba tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71731) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 16:50:26 user nova-compute[71731]: DEBUG nova.compute.manager [-] [instance: e6953c30-c409-45fe-8b22-d9e66d1138ed] Deallocating network for instance {{(pid=71731) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 16:50:26 user nova-compute[71731]: DEBUG nova.network.neutron [-] [instance: e6953c30-c409-45fe-8b22-d9e66d1138ed] deallocate_for_instance() {{(pid=71731) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 16:50:26 user nova-compute[71731]: DEBUG nova.network.neutron [-] [instance: e6953c30-c409-45fe-8b22-d9e66d1138ed] Updating instance_info_cache with network_info: [] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:50:26 user nova-compute[71731]: INFO nova.compute.manager [-] [instance: e6953c30-c409-45fe-8b22-d9e66d1138ed] Took 0.46 seconds to deallocate network for instance.
Apr 13 16:50:26 user nova-compute[71731]: DEBUG nova.compute.manager [req-48e1ae66-f3ea-4068-adb3-0919a946ae2a req-33155e01-3dc6-4cd4-85bd-615e08ca4b06 service nova] [instance: e6953c30-c409-45fe-8b22-d9e66d1138ed] Received event network-vif-deleted-e2f0381a-2e17-4d01-b125-0d9ad8c94788 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:50:26 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-27f5dad0-6008-4642-8adf-5d7b827912ba tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:50:26 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-27f5dad0-6008-4642-8adf-5d7b827912ba tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:50:27 user nova-compute[71731]: DEBUG nova.compute.provider_tree [None req-27f5dad0-6008-4642-8adf-5d7b827912ba tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] Inventory has not changed in ProviderTree for provider: cb6b1a64-0c24-4e2d-af1e-16576ca9165c {{(pid=71731) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 16:50:27 user nova-compute[71731]: DEBUG nova.scheduler.client.report [None req-27f5dad0-6008-4642-8adf-5d7b827912ba tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] Inventory has not changed for provider cb6b1a64-0c24-4e2d-af1e-16576ca9165c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71731) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 16:50:27 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-27f5dad0-6008-4642-8adf-5d7b827912ba tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.184s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:50:27 user nova-compute[71731]: INFO nova.scheduler.client.report [None req-27f5dad0-6008-4642-8adf-5d7b827912ba tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] Deleted allocations for instance e6953c30-c409-45fe-8b22-d9e66d1138ed
Apr 13 16:50:27 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-27f5dad0-6008-4642-8adf-5d7b827912ba tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] Lock "e6953c30-c409-45fe-8b22-d9e66d1138ed" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.468s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:50:28 user nova-compute[71731]: DEBUG nova.compute.manager [req-1d12911d-9288-4a35-be21-b36c56b74e7a req-c0ce2af1-4ddf-4693-b9cd-7eb7cb8274d5 service nova] [instance: e6953c30-c409-45fe-8b22-d9e66d1138ed] Received event network-vif-plugged-e2f0381a-2e17-4d01-b125-0d9ad8c94788 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:50:28 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-1d12911d-9288-4a35-be21-b36c56b74e7a req-c0ce2af1-4ddf-4693-b9cd-7eb7cb8274d5 service nova] Acquiring lock "e6953c30-c409-45fe-8b22-d9e66d1138ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:50:28 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-1d12911d-9288-4a35-be21-b36c56b74e7a req-c0ce2af1-4ddf-4693-b9cd-7eb7cb8274d5 service nova] Lock "e6953c30-c409-45fe-8b22-d9e66d1138ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:50:28 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-1d12911d-9288-4a35-be21-b36c56b74e7a req-c0ce2af1-4ddf-4693-b9cd-7eb7cb8274d5 service nova] Lock "e6953c30-c409-45fe-8b22-d9e66d1138ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:50:28 user nova-compute[71731]: DEBUG nova.compute.manager [req-1d12911d-9288-4a35-be21-b36c56b74e7a req-c0ce2af1-4ddf-4693-b9cd-7eb7cb8274d5 service nova] [instance: e6953c30-c409-45fe-8b22-d9e66d1138ed] No waiting events found dispatching network-vif-plugged-e2f0381a-2e17-4d01-b125-0d9ad8c94788 {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:50:28 user nova-compute[71731]: WARNING nova.compute.manager [req-1d12911d-9288-4a35-be21-b36c56b74e7a req-c0ce2af1-4ddf-4693-b9cd-7eb7cb8274d5 service nova] [instance: e6953c30-c409-45fe-8b22-d9e66d1138ed] Received unexpected event network-vif-plugged-e2f0381a-2e17-4d01-b125-0d9ad8c94788 for instance with vm_state deleted and task_state None.
Apr 13 16:50:29 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:50:29 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71731) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 16:50:30 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:50:31 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:50:31 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:50:33 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager.update_available_resource {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:50:33 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:50:33 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:50:33 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:50:33 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Auditing locally available compute resources for user (node: user) {{(pid=71731) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 16:50:33 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3af23ff8-4e10-4fbf-a86e-bda842f084ff/disk.rescue --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:50:33 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3af23ff8-4e10-4fbf-a86e-bda842f084ff/disk.rescue --force-share --output=json" returned: 0 in 0.138s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:50:33 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3af23ff8-4e10-4fbf-a86e-bda842f084ff/disk.rescue --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:50:33 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3af23ff8-4e10-4fbf-a86e-bda842f084ff/disk.rescue --force-share --output=json" returned: 0 in 0.139s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:50:33 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3af23ff8-4e10-4fbf-a86e-bda842f084ff/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:50:33 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3af23ff8-4e10-4fbf-a86e-bda842f084ff/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:50:33 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3af23ff8-4e10-4fbf-a86e-bda842f084ff/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:50:33 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3af23ff8-4e10-4fbf-a86e-bda842f084ff/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:50:33 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37a39f40-d239-4716-91bc-3f562906bd1e/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:50:33 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37a39f40-d239-4716-91bc-3f562906bd1e/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:50:33 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37a39f40-d239-4716-91bc-3f562906bd1e/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:50:34 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37a39f40-d239-4716-91bc-3f562906bd1e/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:50:34 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2d55cdd-c89c-4c59-afe1-49a33225af22/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:50:34 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2d55cdd-c89c-4c59-afe1-49a33225af22/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:50:34 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2d55cdd-c89c-4c59-afe1-49a33225af22/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:50:34 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2d55cdd-c89c-4c59-afe1-49a33225af22/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:50:34 user nova-compute[71731]: WARNING nova.virt.libvirt.driver [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 16:50:34 user nova-compute[71731]: WARNING nova.virt.libvirt.driver [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 16:50:34 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Hypervisor/Node resource view: name=user free_ram=8548MB free_disk=26.072223663330078GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71731) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 16:50:34 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:50:34 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:50:34 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance b2d55cdd-c89c-4c59-afe1-49a33225af22 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 16:50:34 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance 3af23ff8-4e10-4fbf-a86e-bda842f084ff actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 16:50:34 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance 37a39f40-d239-4716-91bc-3f562906bd1e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 16:50:34 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=71731) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 16:50:34 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Final resource view: name=user phys_ram=16023MB used_ram=896MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=71731) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 16:50:34 user nova-compute[71731]: DEBUG nova.compute.provider_tree [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Inventory has not changed in ProviderTree for provider: cb6b1a64-0c24-4e2d-af1e-16576ca9165c {{(pid=71731) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 16:50:34 user nova-compute[71731]: DEBUG nova.scheduler.client.report [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Inventory has not changed for provider cb6b1a64-0c24-4e2d-af1e-16576ca9165c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71731) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 16:50:35 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Compute_service record updated for user:user {{(pid=71731) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 16:50:35 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.280s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:50:36 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 16:50:38 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:50:38 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:50:38 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Starting heal instance info cache {{(pid=71731) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 16:50:38 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Rebuilding the list of instances to heal {{(pid=71731) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 13 16:50:38 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Acquiring lock "refresh_cache-b2d55cdd-c89c-4c59-afe1-49a33225af22" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 16:50:38 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Acquired lock "refresh_cache-b2d55cdd-c89c-4c59-afe1-49a33225af22" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 16:50:38 user nova-compute[71731]: DEBUG nova.network.neutron [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] [instance: b2d55cdd-c89c-4c59-afe1-49a33225af22] Forcefully refreshing network info cache for instance {{(pid=71731) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 16:50:38 user nova-compute[71731]: DEBUG nova.objects.instance [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lazy-loading 'info_cache' on Instance uuid b2d55cdd-c89c-4c59-afe1-49a33225af22 {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:50:38 user nova-compute[71731]: DEBUG nova.network.neutron [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] [instance: b2d55cdd-c89c-4c59-afe1-49a33225af22] Updating instance_info_cache with network_info: [{"id": "31e1957f-9bd1-42ae-a2ac-954b49ca15f1", "address": "fa:16:3e:81:e2:10", "network": {"id": "2a5b69f1-fc5b-4c33-a9eb-12a4d9293500", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2137344591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "846732ecb7e047128b4684972d3cd8c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31e1957f-9b", "ovs_interfaceid": "31e1957f-9bd1-42ae-a2ac-954b49ca15f1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:50:38 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Releasing lock "refresh_cache-b2d55cdd-c89c-4c59-afe1-49a33225af22" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 16:50:38 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] [instance: b2d55cdd-c89c-4c59-afe1-49a33225af22] Updated the network info_cache for instance {{(pid=71731) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 16:50:38 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:50:39 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:50:40 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:50:41 user nova-compute[71731]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681404626.3081105, e6953c30-c409-45fe-8b22-d9e66d1138ed => Stopped> {{(pid=71731) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 16:50:41 user nova-compute[71731]: INFO nova.compute.manager [-] [instance: e6953c30-c409-45fe-8b22-d9e66d1138ed] VM Stopped (Lifecycle Event)
Apr 13 16:50:41 user nova-compute[71731]: DEBUG nova.compute.manager [None req-baf65e9c-d0e3-4b54-8bdb-041673aa1175 None None] [instance: e6953c30-c409-45fe-8b22-d9e66d1138ed] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:50:41 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 16:50:46 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 16:50:47 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:50:48 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:50:51 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:50:56 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 16:50:56 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:50:56 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71731) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 16:50:56 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71731) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 16:50:56 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71731) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 16:50:56 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:51:01 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 16:51:06 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 16:51:06 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:51:06 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71731) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 16:51:06 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71731) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 16:51:06 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71731) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 16:51:06 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:51:11 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 16:51:13 user nova-compute[71731]: DEBUG nova.compute.manager [req-8607508b-1f20-456f-a829-5dcd41cc702b req-7822911d-6040-40ed-9594-0535747e490e service nova] [instance: 37a39f40-d239-4716-91bc-3f562906bd1e] Received event network-changed-86b0ae4e-a317-4c75-9033-49325a4399d2 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:51:13 user nova-compute[71731]: DEBUG nova.compute.manager [req-8607508b-1f20-456f-a829-5dcd41cc702b req-7822911d-6040-40ed-9594-0535747e490e service nova] [instance: 37a39f40-d239-4716-91bc-3f562906bd1e] Refreshing instance network info cache due to event network-changed-86b0ae4e-a317-4c75-9033-49325a4399d2. {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 16:51:13 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-8607508b-1f20-456f-a829-5dcd41cc702b req-7822911d-6040-40ed-9594-0535747e490e service nova] Acquiring lock "refresh_cache-37a39f40-d239-4716-91bc-3f562906bd1e" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 16:51:13 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-8607508b-1f20-456f-a829-5dcd41cc702b req-7822911d-6040-40ed-9594-0535747e490e service nova] Acquired lock "refresh_cache-37a39f40-d239-4716-91bc-3f562906bd1e" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 16:51:13 user nova-compute[71731]: DEBUG nova.network.neutron [req-8607508b-1f20-456f-a829-5dcd41cc702b req-7822911d-6040-40ed-9594-0535747e490e service nova] [instance: 37a39f40-d239-4716-91bc-3f562906bd1e] Refreshing network info cache for port 86b0ae4e-a317-4c75-9033-49325a4399d2 {{(pid=71731) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 16:51:13 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-00252ad1-5058-4934-bf99-a252af075394 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Acquiring lock "37a39f40-d239-4716-91bc-3f562906bd1e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:51:13 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-00252ad1-5058-4934-bf99-a252af075394 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lock "37a39f40-d239-4716-91bc-3f562906bd1e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:51:13 user nova-compute[71731]: DEBUG nova.objects.instance [None req-00252ad1-5058-4934-bf99-a252af075394 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lazy-loading 'flavor' on Instance uuid 37a39f40-d239-4716-91bc-3f562906bd1e {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:51:13 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-00252ad1-5058-4934-bf99-a252af075394 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lock "37a39f40-d239-4716-91bc-3f562906bd1e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.065s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:51:14 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-00252ad1-5058-4934-bf99-a252af075394 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Acquiring lock "37a39f40-d239-4716-91bc-3f562906bd1e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:51:14 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-00252ad1-5058-4934-bf99-a252af075394 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lock "37a39f40-d239-4716-91bc-3f562906bd1e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:51:14 user nova-compute[71731]: INFO nova.compute.manager [None req-00252ad1-5058-4934-bf99-a252af075394 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] [instance: 37a39f40-d239-4716-91bc-3f562906bd1e] Attaching volume 80224b51-c622-4586-9f20-796024d9cba0 to /dev/vdb
Apr 13 16:51:14 user nova-compute[71731]: DEBUG os_brick.utils [None req-00252ad1-5058-4934-bf99-a252af075394 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 16:51:14 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:51:14 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:51:14 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[40f25f22-ab33-407f-9538-fdeb4b540648]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:81501d91421\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:51:14 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:51:14 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:51:14 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f343a6c-dde0-44f5-a983-8fac746ec951]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:51:14 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:51:14 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:51:14 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[afc495f8-49f2-4e8b-986b-66bfb2dc06fb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:51:14 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b9bd2d1-f1b2-41a1-824a-7d03ee2e6bfd]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:51:14 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-00252ad1-5058-4934-bf99-a252af075394 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Running cmd (subprocess): nvme version {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:51:14 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-00252ad1-5058-4934-bf99-a252af075394 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] 'nvme version' failed. Not Retrying. {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 16:51:14 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.nvmeof [None req-00252ad1-5058-4934-bf99-a252af075394 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] nvme not present on system {{(pid=71731) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 16:51:14 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:51:14 user nova-compute[71731]: DEBUG nova.network.neutron [req-8607508b-1f20-456f-a829-5dcd41cc702b req-7822911d-6040-40ed-9594-0535747e490e service nova] [instance: 37a39f40-d239-4716-91bc-3f562906bd1e] Updated VIF entry in instance network info cache for port 86b0ae4e-a317-4c75-9033-49325a4399d2. {{(pid=71731) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 16:51:14 user nova-compute[71731]: DEBUG nova.network.neutron [req-8607508b-1f20-456f-a829-5dcd41cc702b req-7822911d-6040-40ed-9594-0535747e490e service nova] [instance: 37a39f40-d239-4716-91bc-3f562906bd1e] Updating instance_info_cache with network_info: [{"id": "86b0ae4e-a317-4c75-9033-49325a4399d2", "address": "fa:16:3e:14:4c:bc", "network": {"id": "2a5b69f1-fc5b-4c33-a9eb-12a4d9293500", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2137344591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "846732ecb7e047128b4684972d3cd8c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86b0ae4e-a3", "ovs_interfaceid": "86b0ae4e-a317-4c75-9033-49325a4399d2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:51:14 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 16:51:14 user nova-compute[71731]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 16:51:14 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dd1d346-2894-412b-8bb5-e01acd7715f8]: (4, '') {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:51:14 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.lightos [None req-00252ad1-5058-4934-bf99-a252af075394 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71731) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 16:51:14 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.lightos [None req-00252ad1-5058-4934-bf99-a252af075394 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71731) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 16:51:14 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.lightos [None req-00252ad1-5058-4934-bf99-a252af075394 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] LIGHTOS: no hostnqn found. {{(pid=71731) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 16:51:14 user nova-compute[71731]: DEBUG os_brick.utils [None req-00252ad1-5058-4934-bf99-a252af075394 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:81501d91421', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 16:51:14 user nova-compute[71731]: DEBUG nova.virt.block_device [None req-00252ad1-5058-4934-bf99-a252af075394 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] [instance: 37a39f40-d239-4716-91bc-3f562906bd1e] Updating existing volume attachment record: 696c9ecf-4dc7-4a84-a7fc-3f6dbefcc192 {{(pid=71731) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 16:51:14 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-8607508b-1f20-456f-a829-5dcd41cc702b req-7822911d-6040-40ed-9594-0535747e490e service nova] Releasing lock "refresh_cache-37a39f40-d239-4716-91bc-3f562906bd1e" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 16:51:16 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 16:51:17 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:51:17 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-8c4816d7-3cce-452f-a2ac-47a3a4f04d7e tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] Acquiring lock "61c8082e-a4c5-47de-a239-05c10bb4c5ac" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:51:17 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-8c4816d7-3cce-452f-a2ac-47a3a4f04d7e tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] Lock "61c8082e-a4c5-47de-a239-05c10bb4c5ac" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:51:17 user nova-compute[71731]: DEBUG nova.compute.manager [None req-8c4816d7-3cce-452f-a2ac-47a3a4f04d7e tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] [instance: 61c8082e-a4c5-47de-a239-05c10bb4c5ac] Starting instance... {{(pid=71731) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 16:51:17 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-8c4816d7-3cce-452f-a2ac-47a3a4f04d7e tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:51:17 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-8c4816d7-3cce-452f-a2ac-47a3a4f04d7e tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:51:17 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-8c4816d7-3cce-452f-a2ac-47a3a4f04d7e tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71731) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 16:51:17 user nova-compute[71731]: INFO nova.compute.claims [None req-8c4816d7-3cce-452f-a2ac-47a3a4f04d7e tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] [instance: 61c8082e-a4c5-47de-a239-05c10bb4c5ac] Claim successful on node user
Apr 13 16:51:17 user nova-compute[71731]: DEBUG nova.compute.provider_tree [None req-8c4816d7-3cce-452f-a2ac-47a3a4f04d7e tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] Inventory has not changed in ProviderTree for provider: cb6b1a64-0c24-4e2d-af1e-16576ca9165c {{(pid=71731) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 16:51:17 user nova-compute[71731]: DEBUG nova.scheduler.client.report [None req-8c4816d7-3cce-452f-a2ac-47a3a4f04d7e tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] Inventory has not changed for provider cb6b1a64-0c24-4e2d-af1e-16576ca9165c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71731) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 16:51:17 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-8c4816d7-3cce-452f-a2ac-47a3a4f04d7e tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.300s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:51:17 user nova-compute[71731]: DEBUG nova.compute.manager [None req-8c4816d7-3cce-452f-a2ac-47a3a4f04d7e tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] [instance: 61c8082e-a4c5-47de-a239-05c10bb4c5ac] Start building networks asynchronously for instance. {{(pid=71731) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 16:51:17 user nova-compute[71731]: DEBUG nova.compute.manager [None req-8c4816d7-3cce-452f-a2ac-47a3a4f04d7e tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] [instance: 61c8082e-a4c5-47de-a239-05c10bb4c5ac] Allocating IP information in the background. {{(pid=71731) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 16:51:17 user nova-compute[71731]: DEBUG nova.network.neutron [None req-8c4816d7-3cce-452f-a2ac-47a3a4f04d7e tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] [instance: 61c8082e-a4c5-47de-a239-05c10bb4c5ac] allocate_for_instance() {{(pid=71731) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 16:51:17 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-8c4816d7-3cce-452f-a2ac-47a3a4f04d7e tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] [instance: 61c8082e-a4c5-47de-a239-05c10bb4c5ac] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 16:51:17 user nova-compute[71731]: DEBUG nova.compute.manager [None req-8c4816d7-3cce-452f-a2ac-47a3a4f04d7e tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] [instance: 61c8082e-a4c5-47de-a239-05c10bb4c5ac] Start building block device mappings for instance. {{(pid=71731) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 16:51:17 user nova-compute[71731]: DEBUG nova.compute.manager [None req-8c4816d7-3cce-452f-a2ac-47a3a4f04d7e tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] [instance: 61c8082e-a4c5-47de-a239-05c10bb4c5ac] Start spawning the instance on the hypervisor. {{(pid=71731) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 16:51:17 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-8c4816d7-3cce-452f-a2ac-47a3a4f04d7e tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] [instance: 61c8082e-a4c5-47de-a239-05c10bb4c5ac] Creating instance directory {{(pid=71731) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 16:51:17 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-8c4816d7-3cce-452f-a2ac-47a3a4f04d7e tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] [instance: 61c8082e-a4c5-47de-a239-05c10bb4c5ac] Creating image(s)
Apr 13 16:51:17 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-8c4816d7-3cce-452f-a2ac-47a3a4f04d7e tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] Acquiring lock "/opt/stack/data/nova/instances/61c8082e-a4c5-47de-a239-05c10bb4c5ac/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:51:17 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-8c4816d7-3cce-452f-a2ac-47a3a4f04d7e tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] Lock "/opt/stack/data/nova/instances/61c8082e-a4c5-47de-a239-05c10bb4c5ac/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:51:18 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-8c4816d7-3cce-452f-a2ac-47a3a4f04d7e tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] Lock "/opt/stack/data/nova/instances/61c8082e-a4c5-47de-a239-05c10bb4c5ac/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:51:18 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-8c4816d7-3cce-452f-a2ac-47a3a4f04d7e tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279 --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:51:18 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-8c4816d7-3cce-452f-a2ac-47a3a4f04d7e tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279 --force-share --output=json" returned: 0 in 0.133s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:51:18 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-8c4816d7-3cce-452f-a2ac-47a3a4f04d7e tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] Acquiring lock "9524227dd898575c3099d3976f096cd935414279" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:51:18 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-8c4816d7-3cce-452f-a2ac-47a3a4f04d7e tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] Lock "9524227dd898575c3099d3976f096cd935414279" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:51:18 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-8c4816d7-3cce-452f-a2ac-47a3a4f04d7e tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279 --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:51:18 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-8c4816d7-3cce-452f-a2ac-47a3a4f04d7e tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279 --force-share --output=json" returned: 0 in 0.131s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:51:18 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-8c4816d7-3cce-452f-a2ac-47a3a4f04d7e tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279,backing_fmt=raw /opt/stack/data/nova/instances/61c8082e-a4c5-47de-a239-05c10bb4c5ac/disk 1073741824 {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:51:18 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-8c4816d7-3cce-452f-a2ac-47a3a4f04d7e tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279,backing_fmt=raw /opt/stack/data/nova/instances/61c8082e-a4c5-47de-a239-05c10bb4c5ac/disk 1073741824" returned: 0 in 0.058s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:51:18 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-8c4816d7-3cce-452f-a2ac-47a3a4f04d7e tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] Lock "9524227dd898575c3099d3976f096cd935414279" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.196s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:51:18 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-8c4816d7-3cce-452f-a2ac-47a3a4f04d7e tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279 --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:51:18 user nova-compute[71731]: DEBUG nova.policy [None req-8c4816d7-3cce-452f-a2ac-47a3a4f04d7e tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5051bef91062494f991ee96a93c9dc6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd099f58565de44fba2df173a2bdb3019', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71731) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 16:51:18 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-8c4816d7-3cce-452f-a2ac-47a3a4f04d7e tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279 --force-share --output=json" returned: 0 in 0.141s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:51:18 user nova-compute[71731]: DEBUG nova.virt.disk.api [None req-8c4816d7-3cce-452f-a2ac-47a3a4f04d7e tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] Checking if we can resize image /opt/stack/data/nova/instances/61c8082e-a4c5-47de-a239-05c10bb4c5ac/disk. size=1073741824 {{(pid=71731) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 16:51:18 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-8c4816d7-3cce-452f-a2ac-47a3a4f04d7e tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61c8082e-a4c5-47de-a239-05c10bb4c5ac/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:51:18 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-8c4816d7-3cce-452f-a2ac-47a3a4f04d7e tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61c8082e-a4c5-47de-a239-05c10bb4c5ac/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:51:18 user nova-compute[71731]: DEBUG nova.virt.disk.api [None req-8c4816d7-3cce-452f-a2ac-47a3a4f04d7e tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] Cannot resize image /opt/stack/data/nova/instances/61c8082e-a4c5-47de-a239-05c10bb4c5ac/disk to a smaller size. {{(pid=71731) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 16:51:18 user nova-compute[71731]: DEBUG nova.objects.instance [None req-8c4816d7-3cce-452f-a2ac-47a3a4f04d7e tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] Lazy-loading 'migration_context' on Instance uuid 61c8082e-a4c5-47de-a239-05c10bb4c5ac {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:51:18 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-8c4816d7-3cce-452f-a2ac-47a3a4f04d7e tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] [instance: 61c8082e-a4c5-47de-a239-05c10bb4c5ac] Created local disks {{(pid=71731) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 16:51:18 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-8c4816d7-3cce-452f-a2ac-47a3a4f04d7e tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] [instance: 61c8082e-a4c5-47de-a239-05c10bb4c5ac] Ensure instance console log exists: /opt/stack/data/nova/instances/61c8082e-a4c5-47de-a239-05c10bb4c5ac/console.log {{(pid=71731) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 16:51:18 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-8c4816d7-3cce-452f-a2ac-47a3a4f04d7e tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:51:18 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-8c4816d7-3cce-452f-a2ac-47a3a4f04d7e tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:51:18 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-8c4816d7-3cce-452f-a2ac-47a3a4f04d7e tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:51:19 user nova-compute[71731]: DEBUG nova.network.neutron [None req-8c4816d7-3cce-452f-a2ac-47a3a4f04d7e tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] [instance: 61c8082e-a4c5-47de-a239-05c10bb4c5ac] Successfully created port: 2366235b-52e8-49ab-8a64-f961015f5bec {{(pid=71731) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 16:51:19 user nova-compute[71731]: DEBUG nova.network.neutron [None req-8c4816d7-3cce-452f-a2ac-47a3a4f04d7e tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] [instance: 61c8082e-a4c5-47de-a239-05c10bb4c5ac] Successfully updated port: 2366235b-52e8-49ab-8a64-f961015f5bec {{(pid=71731) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 16:51:19 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-8c4816d7-3cce-452f-a2ac-47a3a4f04d7e tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] Acquiring lock "refresh_cache-61c8082e-a4c5-47de-a239-05c10bb4c5ac" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 16:51:19 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-8c4816d7-3cce-452f-a2ac-47a3a4f04d7e tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] Acquired lock "refresh_cache-61c8082e-a4c5-47de-a239-05c10bb4c5ac" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 16:51:19 user nova-compute[71731]: DEBUG nova.network.neutron [None req-8c4816d7-3cce-452f-a2ac-47a3a4f04d7e tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] [instance: 61c8082e-a4c5-47de-a239-05c10bb4c5ac] Building network info cache for instance {{(pid=71731) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 16:51:19 user nova-compute[71731]: DEBUG nova.compute.manager [req-4fb09c35-1f3f-42ca-9145-13014bb9d8d5 req-d0a4e77d-d4c3-4ff5-ab5c-5962ab91e16f service nova] [instance: 61c8082e-a4c5-47de-a239-05c10bb4c5ac] Received event network-changed-2366235b-52e8-49ab-8a64-f961015f5bec {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:51:19 user nova-compute[71731]: DEBUG nova.compute.manager [req-4fb09c35-1f3f-42ca-9145-13014bb9d8d5 req-d0a4e77d-d4c3-4ff5-ab5c-5962ab91e16f service nova] [instance: 61c8082e-a4c5-47de-a239-05c10bb4c5ac] Refreshing instance network info cache due to event network-changed-2366235b-52e8-49ab-8a64-f961015f5bec. {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 16:51:19 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-4fb09c35-1f3f-42ca-9145-13014bb9d8d5 req-d0a4e77d-d4c3-4ff5-ab5c-5962ab91e16f service nova] Acquiring lock "refresh_cache-61c8082e-a4c5-47de-a239-05c10bb4c5ac" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 16:51:19 user nova-compute[71731]: DEBUG nova.network.neutron [None req-8c4816d7-3cce-452f-a2ac-47a3a4f04d7e tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] [instance: 61c8082e-a4c5-47de-a239-05c10bb4c5ac] Instance cache missing network info. {{(pid=71731) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 16:51:20 user nova-compute[71731]: DEBUG nova.network.neutron [None req-8c4816d7-3cce-452f-a2ac-47a3a4f04d7e tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] [instance: 61c8082e-a4c5-47de-a239-05c10bb4c5ac] Updating instance_info_cache with network_info: [{"id": "2366235b-52e8-49ab-8a64-f961015f5bec", "address": "fa:16:3e:f0:11:62", "network": {"id": "b742fa77-3781-46be-8a60-11bf61969238", "bridge": "br-int", "label": "tempest-VolumesActionsTest-204183032-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "d099f58565de44fba2df173a2bdb3019", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2366235b-52", "ovs_interfaceid": "2366235b-52e8-49ab-8a64-f961015f5bec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:51:20 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-8c4816d7-3cce-452f-a2ac-47a3a4f04d7e tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] Releasing lock "refresh_cache-61c8082e-a4c5-47de-a239-05c10bb4c5ac" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 16:51:20 user nova-compute[71731]: DEBUG nova.compute.manager [None req-8c4816d7-3cce-452f-a2ac-47a3a4f04d7e tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] [instance: 61c8082e-a4c5-47de-a239-05c10bb4c5ac] Instance network_info: |[{"id": "2366235b-52e8-49ab-8a64-f961015f5bec", "address": "fa:16:3e:f0:11:62", "network": {"id": "b742fa77-3781-46be-8a60-11bf61969238", "bridge": "br-int", "label": "tempest-VolumesActionsTest-204183032-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "d099f58565de44fba2df173a2bdb3019", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2366235b-52", "ovs_interfaceid": "2366235b-52e8-49ab-8a64-f961015f5bec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71731) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 16:51:20 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-4fb09c35-1f3f-42ca-9145-13014bb9d8d5 req-d0a4e77d-d4c3-4ff5-ab5c-5962ab91e16f service nova] Acquired lock "refresh_cache-61c8082e-a4c5-47de-a239-05c10bb4c5ac" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 16:51:20 user nova-compute[71731]: DEBUG nova.network.neutron [req-4fb09c35-1f3f-42ca-9145-13014bb9d8d5 req-d0a4e77d-d4c3-4ff5-ab5c-5962ab91e16f service nova] [instance: 61c8082e-a4c5-47de-a239-05c10bb4c5ac] Refreshing network info cache for port 2366235b-52e8-49ab-8a64-f961015f5bec {{(pid=71731) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 16:51:20 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-8c4816d7-3cce-452f-a2ac-47a3a4f04d7e tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] [instance: 61c8082e-a4c5-47de-a239-05c10bb4c5ac] Start _get_guest_xml network_info=[{"id": "2366235b-52e8-49ab-8a64-f961015f5bec", "address": "fa:16:3e:f0:11:62", "network": {"id": "b742fa77-3781-46be-8a60-11bf61969238", "bridge": "br-int", "label": "tempest-VolumesActionsTest-204183032-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "d099f58565de44fba2df173a2bdb3019", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2366235b-52", "ovs_interfaceid": "2366235b-52e8-49ab-8a64-f961015f5bec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T16:16:31Z,direct_url=<?>,disk_format='qcow2',id=708622a9-7465-4492-ade8-b827198f7e30,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='0b29a975c552465aba0ac7d6288434bd',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T16:16:33Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'device_type': 'disk', 'encrypted': False, 'disk_bus': 'virtio', 'guest_format': None, 'encryption_options': None, 'image_id': '708622a9-7465-4492-ade8-b827198f7e30'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71731) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 16:51:20 user nova-compute[71731]: WARNING nova.virt.libvirt.driver [None req-8c4816d7-3cce-452f-a2ac-47a3a4f04d7e tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 16:51:20 user nova-compute[71731]: WARNING nova.virt.libvirt.driver [None req-8c4816d7-3cce-452f-a2ac-47a3a4f04d7e tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 16:51:20 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-8c4816d7-3cce-452f-a2ac-47a3a4f04d7e tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71731) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 16:51:20 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-8c4816d7-3cce-452f-a2ac-47a3a4f04d7e tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T16:17:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T16:16:31Z,direct_url=<?>,disk_format='qcow2',id=708622a9-7465-4492-ade8-b827198f7e30,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='0b29a975c552465aba0ac7d6288434bd',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T16:16:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 16:51:20 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-8c4816d7-3cce-452f-a2ac-47a3a4f04d7e tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] Flavor limits 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 16:51:20 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-8c4816d7-3cce-452f-a2ac-47a3a4f04d7e tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] Image limits 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 16:51:20 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-8c4816d7-3cce-452f-a2ac-47a3a4f04d7e tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] Flavor pref 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 16:51:20 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-8c4816d7-3cce-452f-a2ac-47a3a4f04d7e tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] Image pref 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 16:51:20 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-8c4816d7-3cce-452f-a2ac-47a3a4f04d7e tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 16:51:20 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-8c4816d7-3cce-452f-a2ac-47a3a4f04d7e tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 16:51:20 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-8c4816d7-3cce-452f-a2ac-47a3a4f04d7e tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71731) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 16:51:20 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-8c4816d7-3cce-452f-a2ac-47a3a4f04d7e tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] Got 1 possible topologies {{(pid=71731) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 16:51:20 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-8c4816d7-3cce-452f-a2ac-47a3a4f04d7e tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 16:51:20 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-8c4816d7-3cce-452f-a2ac-47a3a4f04d7e tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 16:51:20 user nova-compute[71731]: DEBUG nova.virt.libvirt.vif [None req-8c4816d7-3cce-452f-a2ac-47a3a4f04d7e tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T16:51:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1617630502',display_name='tempest-VolumesActionsTest-instance-1617630502',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1617630502',id=41,image_ref='708622a9-7465-4492-ade8-b827198f7e30',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d099f58565de44fba2df173a2bdb3019',ramdisk_id='',reservation_id='r-e2dsggzx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='708622a9-7465-4492-ade8-b827198f7e30',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-450740344',owner_user_name='tempest-VolumesActionsTest-450740344-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T16:51:18Z,user_data=None,user_id='5051bef91062494f991ee96a93c9dc6a',uuid=61c8082e-a4c5-47de-a239-05c10bb4c5ac,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2366235b-52e8-49ab-8a64-f961015f5bec", "address": "fa:16:3e:f0:11:62", "network": {"id": "b742fa77-3781-46be-8a60-11bf61969238", "bridge": "br-int", "label": "tempest-VolumesActionsTest-204183032-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "d099f58565de44fba2df173a2bdb3019", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2366235b-52", "ovs_interfaceid": "2366235b-52e8-49ab-8a64-f961015f5bec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71731) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 16:51:20 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-8c4816d7-3cce-452f-a2ac-47a3a4f04d7e tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] Converting VIF {"id": "2366235b-52e8-49ab-8a64-f961015f5bec", "address": "fa:16:3e:f0:11:62", "network": {"id": "b742fa77-3781-46be-8a60-11bf61969238", "bridge": "br-int", "label": "tempest-VolumesActionsTest-204183032-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "d099f58565de44fba2df173a2bdb3019", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2366235b-52", "ovs_interfaceid": "2366235b-52e8-49ab-8a64-f961015f5bec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 16:51:20 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-8c4816d7-3cce-452f-a2ac-47a3a4f04d7e tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f0:11:62,bridge_name='br-int',has_traffic_filtering=True,id=2366235b-52e8-49ab-8a64-f961015f5bec,network=Network(b742fa77-3781-46be-8a60-11bf61969238),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2366235b-52') {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 16:51:20 user nova-compute[71731]: DEBUG nova.objects.instance [None req-8c4816d7-3cce-452f-a2ac-47a3a4f04d7e tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] Lazy-loading 'pci_devices' on Instance uuid 61c8082e-a4c5-47de-a239-05c10bb4c5ac {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:51:20 user nova-compute[71731]: DEBUG nova.virt.libvirt.volume.iscsi [None req-00252ad1-5058-4934-bf99-a252af075394 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] [instance: 37a39f40-d239-4716-91bc-3f562906bd1e] Calling os-brick to attach iSCSI Volume {{(pid=71731) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 16:51:20 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-00252ad1-5058-4934-bf99-a252af075394 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8cf0118790>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:80224b51-c622-4586-9f20-796024d9cba0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lXFCdmeV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 16:51:20 user nova-compute[71731]: WARNING os_brick.initiator.connectors.base [None req-00252ad1-5058-4934-bf99-a252af075394 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 16:51:20 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-00252ad1-5058-4934-bf99-a252af075394 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 16:51:20 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-00252ad1-5058-4934-bf99-a252af075394 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 16:51:20 user nova-compute[71731]: WARNING os_brick.initiator.connectors.base [None req-00252ad1-5058-4934-bf99-a252af075394 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 16:51:20 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-00252ad1-5058-4934-bf99-a252af075394 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:80224b51-c622-4586-9f20-796024d9cba0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 16:51:20 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-00252ad1-5058-4934-bf99-a252af075394 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:80224b51-c622-4586-9f20-796024d9cba0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 16:51:20 user nova-compute[71731]: INFO os_brick.initiator.connectors.iscsi [None req-00252ad1-5058-4934-bf99-a252af075394 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 16:51:20 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-8c4816d7-3cce-452f-a2ac-47a3a4f04d7e tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] [instance: 61c8082e-a4c5-47de-a239-05c10bb4c5ac] End _get_guest_xml xml=<domain type="kvm">
Apr 13 16:51:20 user nova-compute[71731]:   <uuid>61c8082e-a4c5-47de-a239-05c10bb4c5ac</uuid>
Apr 13 16:51:20 user nova-compute[71731]:   <name>instance-00000029</name>
Apr 13 16:51:20 user nova-compute[71731]:   <memory>131072</memory>
Apr 13 16:51:20 user nova-compute[71731]:   <vcpu>1</vcpu>
Apr 13 16:51:20 user nova-compute[71731]:   <metadata>
Apr 13 16:51:20 user nova-compute[71731]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 16:51:20 user nova-compute[71731]:       <nova:package version="0.0.0"/>
Apr 13 16:51:20 user nova-compute[71731]:       <nova:name>tempest-VolumesActionsTest-instance-1617630502</nova:name>
Apr 13 16:51:20 user nova-compute[71731]:       <nova:creationTime>2023-04-13 16:51:20</nova:creationTime>
Apr 13 16:51:20 user nova-compute[71731]:       <nova:flavor name="m1.nano">
Apr 13 16:51:20 user nova-compute[71731]:         <nova:memory>128</nova:memory>
Apr 13 16:51:20 user nova-compute[71731]:         <nova:disk>1</nova:disk>
Apr 13 16:51:20 user nova-compute[71731]:         <nova:swap>0</nova:swap>
Apr 13 16:51:20 user nova-compute[71731]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 16:51:20 user nova-compute[71731]:         <nova:vcpus>1</nova:vcpus>
Apr 13 16:51:20 user nova-compute[71731]:       </nova:flavor>
Apr 13 16:51:20 user nova-compute[71731]:       <nova:owner>
Apr 13 16:51:20 user nova-compute[71731]:         <nova:user uuid="5051bef91062494f991ee96a93c9dc6a">tempest-VolumesActionsTest-450740344-project-member</nova:user>
Apr 13 16:51:20 user nova-compute[71731]:         <nova:project uuid="d099f58565de44fba2df173a2bdb3019">tempest-VolumesActionsTest-450740344</nova:project>
Apr 13 16:51:20 user nova-compute[71731]:       </nova:owner>
Apr 13 16:51:20 user nova-compute[71731]:       <nova:root type="image" uuid="708622a9-7465-4492-ade8-b827198f7e30"/>
Apr 13 16:51:20 user nova-compute[71731]:       <nova:ports>
Apr 13 16:51:20 user nova-compute[71731]:         <nova:port uuid="2366235b-52e8-49ab-8a64-f961015f5bec">
Apr 13 16:51:20 user nova-compute[71731]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Apr 13 16:51:20 user nova-compute[71731]:         </nova:port>
Apr 13 16:51:20 user nova-compute[71731]:       </nova:ports>
Apr 13 16:51:20 user nova-compute[71731]:     </nova:instance>
Apr 13 16:51:20 user nova-compute[71731]:   </metadata>
Apr 13 16:51:20 user nova-compute[71731]:   <sysinfo type="smbios">
Apr 13 16:51:20 user nova-compute[71731]:     <system>
Apr 13 16:51:20 user nova-compute[71731]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 16:51:20 user nova-compute[71731]:       <entry name="product">OpenStack Nova</entry>
Apr 13 16:51:20 user nova-compute[71731]:       <entry name="version">0.0.0</entry>
Apr 13 16:51:20 user nova-compute[71731]:       <entry name="serial">61c8082e-a4c5-47de-a239-05c10bb4c5ac</entry>
Apr 13 16:51:20 user nova-compute[71731]:       <entry name="uuid">61c8082e-a4c5-47de-a239-05c10bb4c5ac</entry>
Apr 13 16:51:20 user nova-compute[71731]:       <entry name="family">Virtual Machine</entry>
Apr 13 16:51:20 user nova-compute[71731]:     </system>
Apr 13 16:51:20 user nova-compute[71731]:   </sysinfo>
Apr 13 16:51:20 user nova-compute[71731]:   <os>
Apr 13 16:51:20 user nova-compute[71731]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 16:51:20 user nova-compute[71731]:     <boot dev="hd"/>
Apr 13 16:51:20 user nova-compute[71731]:     <smbios mode="sysinfo"/>
Apr 13 16:51:20 user nova-compute[71731]:   </os>
Apr 13 16:51:20 user nova-compute[71731]:   <features>
Apr 13 16:51:20 user nova-compute[71731]:     <acpi/>
Apr 13 16:51:20 user nova-compute[71731]:     <apic/>
Apr 13 16:51:20 user nova-compute[71731]:     <vmcoreinfo/>
Apr 13 16:51:20 user nova-compute[71731]:   </features>
Apr 13 16:51:20 user nova-compute[71731]:   <clock offset="utc">
Apr 13 16:51:20 user nova-compute[71731]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 16:51:20 user nova-compute[71731]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 16:51:20 user nova-compute[71731]:     <timer name="hpet" present="no"/>
Apr 13 16:51:20 user nova-compute[71731]:   </clock>
Apr 13 16:51:20 user nova-compute[71731]:   <cpu mode="custom" match="exact">
Apr 13 16:51:20 user nova-compute[71731]:     <model>Nehalem</model>
Apr 13 16:51:20 user nova-compute[71731]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 16:51:20 user nova-compute[71731]:   </cpu>
Apr 13 16:51:20 user nova-compute[71731]:   <devices>
Apr 13 16:51:20 user nova-compute[71731]:     <disk type="file" device="disk">
Apr 13 16:51:20 user nova-compute[71731]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 16:51:20 user nova-compute[71731]:       <source file="/opt/stack/data/nova/instances/61c8082e-a4c5-47de-a239-05c10bb4c5ac/disk"/>
Apr 13 16:51:20 user nova-compute[71731]:       <target dev="vda" bus="virtio"/>
Apr 13 16:51:20 user nova-compute[71731]:     </disk>
Apr 13 16:51:20 user nova-compute[71731]:     <interface type="ethernet">
Apr 13 16:51:20 user nova-compute[71731]:       <mac address="fa:16:3e:f0:11:62"/>
Apr 13 16:51:20 user nova-compute[71731]:       <model type="virtio"/>
Apr 13 16:51:20 user nova-compute[71731]:       <mtu size="1442"/>
Apr 13 16:51:20 user nova-compute[71731]:       <target dev="tap2366235b-52"/>
Apr 13 16:51:20 user nova-compute[71731]:     </interface>
Apr 13 16:51:20 user nova-compute[71731]:     <serial type="pty">
Apr 13 16:51:20 user nova-compute[71731]:       <log file="/opt/stack/data/nova/instances/61c8082e-a4c5-47de-a239-05c10bb4c5ac/console.log" append="off"/>
Apr 13 16:51:20 user nova-compute[71731]:     </serial>
Apr 13 16:51:20 user nova-compute[71731]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 16:51:20 user nova-compute[71731]:     <video>
Apr 13 16:51:20 user nova-compute[71731]:       <model type="virtio"/>
Apr 13 16:51:20 user nova-compute[71731]:     </video>
Apr 13 16:51:20 user nova-compute[71731]:     <rng model="virtio">
Apr 13 16:51:20 user nova-compute[71731]:       <backend model="random">/dev/urandom</backend>
Apr 13 16:51:20 user nova-compute[71731]:     </rng>
Apr 13 16:51:20 user nova-compute[71731]:     <controller type="usb" index="0" model="none"/>
Apr 13 16:51:20 user nova-compute[71731]:     <memballoon model="virtio">
Apr 13 16:51:20 user nova-compute[71731]:       <stats period="10"/>
Apr 13 16:51:20 user nova-compute[71731]:     </memballoon>
Apr 13 16:51:20 user nova-compute[71731]:   </devices>
Apr 13 16:51:20 user nova-compute[71731]: </domain>
Apr 13 16:51:20 user nova-compute[71731]:  {{(pid=71731) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 16:51:20 user nova-compute[71731]: DEBUG nova.virt.libvirt.vif [None req-8c4816d7-3cce-452f-a2ac-47a3a4f04d7e tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T16:51:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1617630502',display_name='tempest-VolumesActionsTest-instance-1617630502',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1617630502',id=41,image_ref='708622a9-7465-4492-ade8-b827198f7e30',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d099f58565de44fba2df173a2bdb3019',ramdisk_id='',reservation_id='r-e2dsggzx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='708622a9-7465-4492-ade8-b827198f7e30',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-450740344',owner_user_name='tempest-VolumesActionsTest-450740344-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T16:51:18Z,user_data=None,user_id='5051bef91062494f991ee96a93c9dc6a',uuid=61c8082e-a4c5-47de-a239-05c10bb4c5ac,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2366235b-52e8-49ab-8a64-f961015f5bec", "address": "fa:16:3e:f0:11:62", "network": {"id": "b742fa77-3781-46be-8a60-11bf61969238", "bridge": "br-int", "label": "tempest-VolumesActionsTest-204183032-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "d099f58565de44fba2df173a2bdb3019", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2366235b-52", "ovs_interfaceid": "2366235b-52e8-49ab-8a64-f961015f5bec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 16:51:20 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-8c4816d7-3cce-452f-a2ac-47a3a4f04d7e tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] Converting VIF {"id": "2366235b-52e8-49ab-8a64-f961015f5bec", "address": "fa:16:3e:f0:11:62", "network": {"id": "b742fa77-3781-46be-8a60-11bf61969238", "bridge": "br-int", "label": "tempest-VolumesActionsTest-204183032-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "d099f58565de44fba2df173a2bdb3019", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2366235b-52", "ovs_interfaceid": "2366235b-52e8-49ab-8a64-f961015f5bec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 16:51:20 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-8c4816d7-3cce-452f-a2ac-47a3a4f04d7e tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f0:11:62,bridge_name='br-int',has_traffic_filtering=True,id=2366235b-52e8-49ab-8a64-f961015f5bec,network=Network(b742fa77-3781-46be-8a60-11bf61969238),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2366235b-52') {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 16:51:20 user nova-compute[71731]: DEBUG os_vif [None req-8c4816d7-3cce-452f-a2ac-47a3a4f04d7e tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:11:62,bridge_name='br-int',has_traffic_filtering=True,id=2366235b-52e8-49ab-8a64-f961015f5bec,network=Network(b742fa77-3781-46be-8a60-11bf61969238),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2366235b-52') {{(pid=71731) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 16:51:20 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:51:20 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:51:20 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 16:51:20 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80224b51-c622-4586-9f20-796024d9cba0 -p 172.16.0.220:3260 {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:51:20 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:51:20 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2366235b-52, may_exist=True) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:51:20 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2366235b-52, col_values=(('external_ids', {'iface-id': '2366235b-52e8-49ab-8a64-f961015f5bec', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f0:11:62', 'vm-uuid': '61c8082e-a4c5-47de-a239-05c10bb4c5ac'}),)) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:51:20 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:51:20 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 16:51:20 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80224b51-c622-4586-9f20-796024d9cba0 -p 172.16.0.220:3260" returned: 21 in 0.026s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:51:20 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d2230de-0b37-4b2f-953e-c764adea0040]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:51:20 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-00252ad1-5058-4934-bf99-a252af075394 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 16:51:20 user nova-compute[71731]:  {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:51:20 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:51:20 user nova-compute[71731]: INFO os_vif [None req-8c4816d7-3cce-452f-a2ac-47a3a4f04d7e tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:11:62,bridge_name='br-int',has_traffic_filtering=True,id=2366235b-52e8-49ab-8a64-f961015f5bec,network=Network(b742fa77-3781-46be-8a60-11bf61969238),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2366235b-52')
Apr 13 16:51:20 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80224b51-c622-4586-9f20-796024d9cba0 -p 172.16.0.220:3260 --interface default --op new {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:51:20 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80224b51-c622-4586-9f20-796024d9cba0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:51:20 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ded6ef5-4d4a-40f1-9310-5f3cac16ae61]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:80224b51-c622-4586-9f20-796024d9cba0] added\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:51:20 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-00252ad1-5058-4934-bf99-a252af075394 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:80224b51-c622-4586-9f20-796024d9cba0] added
Apr 13 16:51:20 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:51:20 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80224b51-c622-4586-9f20-796024d9cba0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:51:20 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80224b51-c622-4586-9f20-796024d9cba0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:51:20 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d6d3105-7b13-4b5e-a395-cd83f9e78394]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:51:20 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-00252ad1-5058-4934-bf99-a252af075394 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:51:20 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80224b51-c622-4586-9f20-796024d9cba0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:51:20 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-8c4816d7-3cce-452f-a2ac-47a3a4f04d7e tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] No BDM found with device name vda, not building metadata. {{(pid=71731) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 16:51:20 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-8c4816d7-3cce-452f-a2ac-47a3a4f04d7e tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] No VIF found with MAC fa:16:3e:f0:11:62, not building metadata {{(pid=71731) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 16:51:20 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80224b51-c622-4586-9f20-796024d9cba0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:51:20 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[05b53d83-9428-441a-9ba8-163150079a56]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:51:20 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-00252ad1-5058-4934-bf99-a252af075394 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:51:20 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80224b51-c622-4586-9f20-796024d9cba0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lXFCdmeV {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:51:20 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80224b51-c622-4586-9f20-796024d9cba0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lXFCdmeV" returned: 0 in 0.022s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:51:20 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[a56a3e71-4b01-4041-8186-e26242043c26]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:51:20 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-00252ad1-5058-4934-bf99-a252af075394 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lXFCdmeV'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:51:20 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80224b51-c622-4586-9f20-796024d9cba0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:51:20 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80224b51-c622-4586-9f20-796024d9cba0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:51:20 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[636f69a1-88ae-450c-8ebb-f73fd04867ab]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:51:20 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-00252ad1-5058-4934-bf99-a252af075394 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:51:20 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:51:20 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:51:20 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[143fd33d-33a2-46d4-9916-305e28345bb5]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:51:20 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-00252ad1-5058-4934-bf99-a252af075394 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Apr 13 16:51:20 user nova-compute[71731]:  {{(pid=71731) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 16:51:20 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-00252ad1-5058-4934-bf99-a252af075394 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Apr 13 16:51:20 user nova-compute[71731]:  {{(pid=71731) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 16:51:20 user nova-compute[71731]: WARNING os_brick.initiator.connectors.iscsi [None req-00252ad1-5058-4934-bf99-a252af075394 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Apr 13 16:51:20 user nova-compute[71731]: 
Apr 13 16:51:20 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80224b51-c622-4586-9f20-796024d9cba0 -p 172.16.0.220:3260 --login {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:51:20 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80224b51-c622-4586-9f20-796024d9cba0 -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:51:20 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a3afa1d-2012-4abb-8fe9-9a25af09a6f7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:80224b51-c622-4586-9f20-796024d9cba0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:80224b51-c622-4586-9f20-796024d9cba0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:51:20 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-00252ad1-5058-4934-bf99-a252af075394 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:80224b51-c622-4586-9f20-796024d9cba0, portal: 172.16.0.220,3260]
Apr 13 16:51:20 user nova-compute[71731]: Login to [iface: default, target: iqn.2010-10.org.openstack:80224b51-c622-4586-9f20-796024d9cba0, portal: 172.16.0.220,3260] successful.
Apr 13 16:51:20 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:51:20 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80224b51-c622-4586-9f20-796024d9cba0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:51:20 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80224b51-c622-4586-9f20-796024d9cba0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:51:20 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[c09ea728-9a27-464a-8fda-67a0793a25d5]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:51:20 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-00252ad1-5058-4934-bf99-a252af075394 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:51:20 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:51:20 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:51:20 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[2216d132-be05-4d09-9db0-3aae880ab49e]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80224b51-c622-4586-9f20-796024d9cba0 (non-flash)\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:51:20 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-00252ad1-5058-4934-bf99-a252af075394 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80224b51-c622-4586-9f20-796024d9cba0 (non-flash)
Apr 13 16:51:20 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 16:51:20 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-00252ad1-5058-4934-bf99-a252af075394 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80224b51-c622-4586-9f20-796024d9cba0 (non-flash)
Apr 13 16:51:20 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 16:51:20 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-00252ad1-5058-4934-bf99-a252af075394 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:80224b51-c622-4586-9f20-796024d9cba0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.294s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 16:51:20 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-00252ad1-5058-4934-bf99-a252af075394 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Connected to 172.16.0.220:3260 {{(pid=71731) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 16:51:20 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-00252ad1-5058-4934-bf99-a252af075394 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] HCTL ('33', '-', '-', 0) found on session 46 with lun 0 {{(pid=71731) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 16:51:20 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-00252ad1-5058-4934-bf99-a252af075394 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71731) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 16:51:20 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:51:20 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:51:20 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[18606977-ac45-4bf7-8caf-7655909cfec5]: (4, ('- - 0', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:51:20 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-00252ad1-5058-4934-bf99-a252af075394 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Searching for a device in session 46 and hctl ['33', '*', '*', 0] yield: None {{(pid=71731) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 16:51:20 user nova-compute[71731]: DEBUG nova.network.neutron [req-4fb09c35-1f3f-42ca-9145-13014bb9d8d5 req-d0a4e77d-d4c3-4ff5-ab5c-5962ab91e16f service nova] [instance: 61c8082e-a4c5-47de-a239-05c10bb4c5ac] Updated VIF entry in instance network info cache for port 2366235b-52e8-49ab-8a64-f961015f5bec. {{(pid=71731) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 16:51:20 user nova-compute[71731]: DEBUG nova.network.neutron [req-4fb09c35-1f3f-42ca-9145-13014bb9d8d5 req-d0a4e77d-d4c3-4ff5-ab5c-5962ab91e16f service nova] [instance: 61c8082e-a4c5-47de-a239-05c10bb4c5ac] Updating instance_info_cache with network_info: [{"id": "2366235b-52e8-49ab-8a64-f961015f5bec", "address": "fa:16:3e:f0:11:62", "network": {"id": "b742fa77-3781-46be-8a60-11bf61969238", "bridge": "br-int", "label": "tempest-VolumesActionsTest-204183032-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "d099f58565de44fba2df173a2bdb3019", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2366235b-52", "ovs_interfaceid": "2366235b-52e8-49ab-8a64-f961015f5bec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:51:20 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-4fb09c35-1f3f-42ca-9145-13014bb9d8d5 req-d0a4e77d-d4c3-4ff5-ab5c-5962ab91e16f service nova] Releasing lock "refresh_cache-61c8082e-a4c5-47de-a239-05c10bb4c5ac" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 16:51:21 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-00252ad1-5058-4934-bf99-a252af075394 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Searching for a device in session 46 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71731) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 16:51:21 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-00252ad1-5058-4934-bf99-a252af075394 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:80224b51-c622-4586-9f20-796024d9cba0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lXFCdmeV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71731) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 16:51:21 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-00252ad1-5058-4934-bf99-a252af075394 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.325s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 16:51:21 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-00252ad1-5058-4934-bf99-a252af075394 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] <== connect_volume: return (1326ms) {'type': 'block', 'scsi_wwn': '23132393134353736', 'path': '/dev/sdb'} {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 16:51:21 user nova-compute[71731]: DEBUG nova.virt.libvirt.volume.iscsi [None req-00252ad1-5058-4934-bf99-a252af075394 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] [instance: 37a39f40-d239-4716-91bc-3f562906bd1e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23132393134353736', 'path': '/dev/sdb'} {{(pid=71731) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 16:51:21 user nova-compute[71731]: DEBUG nova.objects.instance [None req-00252ad1-5058-4934-bf99-a252af075394 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lazy-loading 'flavor' on Instance uuid 37a39f40-d239-4716-91bc-3f562906bd1e {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:51:21 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:51:21 user nova-compute[71731]: DEBUG nova.virt.libvirt.guest [None req-00252ad1-5058-4934-bf99-a252af075394 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] attach device xml: <disk type="block" device="disk">
Apr 13 16:51:21 user nova-compute[71731]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 16:51:21 user nova-compute[71731]:   <source dev="/dev/sdb"/>
Apr 13 16:51:21 user nova-compute[71731]:   <target dev="vdb" bus="virtio"/>
Apr 13 16:51:21 user nova-compute[71731]:   <serial>80224b51-c622-4586-9f20-796024d9cba0</serial>
Apr 13 16:51:21 user nova-compute[71731]: </disk>
Apr 13 16:51:21 user nova-compute[71731]:  {{(pid=71731) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 13 16:51:21 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:51:21 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:51:22 user nova-compute[71731]: DEBUG nova.compute.manager [req-e02886f6-a69b-4313-b1a2-235373cf73db req-2e304ed4-e0dc-4d0a-b1d2-91f5a0a75460 service nova] [instance: 61c8082e-a4c5-47de-a239-05c10bb4c5ac] Received event network-vif-plugged-2366235b-52e8-49ab-8a64-f961015f5bec {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:51:22 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-e02886f6-a69b-4313-b1a2-235373cf73db req-2e304ed4-e0dc-4d0a-b1d2-91f5a0a75460 service nova] Acquiring lock "61c8082e-a4c5-47de-a239-05c10bb4c5ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:51:22 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-e02886f6-a69b-4313-b1a2-235373cf73db req-2e304ed4-e0dc-4d0a-b1d2-91f5a0a75460 service nova] Lock "61c8082e-a4c5-47de-a239-05c10bb4c5ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:51:22 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-e02886f6-a69b-4313-b1a2-235373cf73db req-2e304ed4-e0dc-4d0a-b1d2-91f5a0a75460 service nova] Lock "61c8082e-a4c5-47de-a239-05c10bb4c5ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:51:22 user nova-compute[71731]: DEBUG nova.compute.manager [req-e02886f6-a69b-4313-b1a2-235373cf73db req-2e304ed4-e0dc-4d0a-b1d2-91f5a0a75460 service nova] [instance: 61c8082e-a4c5-47de-a239-05c10bb4c5ac] No waiting events found dispatching network-vif-plugged-2366235b-52e8-49ab-8a64-f961015f5bec {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:51:22 user nova-compute[71731]: WARNING nova.compute.manager [req-e02886f6-a69b-4313-b1a2-235373cf73db req-2e304ed4-e0dc-4d0a-b1d2-91f5a0a75460 service nova] [instance: 61c8082e-a4c5-47de-a239-05c10bb4c5ac] Received unexpected event network-vif-plugged-2366235b-52e8-49ab-8a64-f961015f5bec for instance with vm_state building and task_state spawning.
Apr 13 16:51:22 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:51:22 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-00252ad1-5058-4934-bf99-a252af075394 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] No BDM found with device name vda, not building metadata. {{(pid=71731) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 16:51:22 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-00252ad1-5058-4934-bf99-a252af075394 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71731) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 16:51:22 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-00252ad1-5058-4934-bf99-a252af075394 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] No VIF found with MAC fa:16:3e:14:4c:bc, not building metadata {{(pid=71731) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 16:51:22 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-00252ad1-5058-4934-bf99-a252af075394 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lock "37a39f40-d239-4716-91bc-3f562906bd1e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.357s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:51:22 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:51:22 user nova-compute[71731]: INFO nova.compute.manager [None req-795dab24-b9d0-4b47-992f-7e1e5c3ad0d6 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] [instance: 37a39f40-d239-4716-91bc-3f562906bd1e] Rescuing
Apr 13 16:51:22 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-795dab24-b9d0-4b47-992f-7e1e5c3ad0d6 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Acquiring lock "refresh_cache-37a39f40-d239-4716-91bc-3f562906bd1e" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 16:51:22 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-795dab24-b9d0-4b47-992f-7e1e5c3ad0d6 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Acquired lock "refresh_cache-37a39f40-d239-4716-91bc-3f562906bd1e" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 16:51:22 user nova-compute[71731]: DEBUG nova.network.neutron [None req-795dab24-b9d0-4b47-992f-7e1e5c3ad0d6 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] [instance: 37a39f40-d239-4716-91bc-3f562906bd1e] Building network info cache for instance {{(pid=71731) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 16:51:23 user nova-compute[71731]: DEBUG nova.network.neutron [None req-795dab24-b9d0-4b47-992f-7e1e5c3ad0d6 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] [instance: 37a39f40-d239-4716-91bc-3f562906bd1e] Updating instance_info_cache with network_info: [{"id": "86b0ae4e-a317-4c75-9033-49325a4399d2", "address": "fa:16:3e:14:4c:bc", "network": {"id": "2a5b69f1-fc5b-4c33-a9eb-12a4d9293500", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2137344591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "846732ecb7e047128b4684972d3cd8c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86b0ae4e-a3", "ovs_interfaceid": "86b0ae4e-a317-4c75-9033-49325a4399d2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:51:23 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-795dab24-b9d0-4b47-992f-7e1e5c3ad0d6 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Releasing lock "refresh_cache-37a39f40-d239-4716-91bc-3f562906bd1e" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 16:51:23 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:51:23 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:51:23 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:51:23 user nova-compute[71731]: DEBUG nova.compute.manager [req-90d3c2b1-d291-455c-872d-1af87b18a323 req-236e74d7-91b8-46c2-94ba-668de3eee733 service nova] [instance: 37a39f40-d239-4716-91bc-3f562906bd1e] Received event network-vif-unplugged-86b0ae4e-a317-4c75-9033-49325a4399d2 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:51:23 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-90d3c2b1-d291-455c-872d-1af87b18a323 req-236e74d7-91b8-46c2-94ba-668de3eee733 service nova] Acquiring lock "37a39f40-d239-4716-91bc-3f562906bd1e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:51:23 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-90d3c2b1-d291-455c-872d-1af87b18a323 req-236e74d7-91b8-46c2-94ba-668de3eee733 service nova] Lock "37a39f40-d239-4716-91bc-3f562906bd1e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:51:23 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-90d3c2b1-d291-455c-872d-1af87b18a323 req-236e74d7-91b8-46c2-94ba-668de3eee733 service nova] Lock "37a39f40-d239-4716-91bc-3f562906bd1e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:51:23 user nova-compute[71731]: DEBUG nova.compute.manager [req-90d3c2b1-d291-455c-872d-1af87b18a323 req-236e74d7-91b8-46c2-94ba-668de3eee733 service nova] [instance: 37a39f40-d239-4716-91bc-3f562906bd1e] No waiting events found dispatching network-vif-unplugged-86b0ae4e-a317-4c75-9033-49325a4399d2 {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:51:23 user nova-compute[71731]: WARNING nova.compute.manager [req-90d3c2b1-d291-455c-872d-1af87b18a323 req-236e74d7-91b8-46c2-94ba-668de3eee733 service nova] [instance: 37a39f40-d239-4716-91bc-3f562906bd1e] Received unexpected event network-vif-unplugged-86b0ae4e-a317-4c75-9033-49325a4399d2 for instance with vm_state active and task_state rescuing.
Apr 13 16:51:24 user nova-compute[71731]: DEBUG nova.virt.driver [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Emitting event <LifecycleEvent: 1681404684.1279037, 61c8082e-a4c5-47de-a239-05c10bb4c5ac => Resumed> {{(pid=71731) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 16:51:24 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 61c8082e-a4c5-47de-a239-05c10bb4c5ac] VM Resumed (Lifecycle Event)
Apr 13 16:51:24 user nova-compute[71731]: DEBUG nova.compute.manager [None req-8c4816d7-3cce-452f-a2ac-47a3a4f04d7e tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] [instance: 61c8082e-a4c5-47de-a239-05c10bb4c5ac] Instance event wait completed in 0 seconds for  {{(pid=71731) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 16:51:24 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-8c4816d7-3cce-452f-a2ac-47a3a4f04d7e tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] [instance: 61c8082e-a4c5-47de-a239-05c10bb4c5ac] Guest created on hypervisor {{(pid=71731) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 16:51:24 user nova-compute[71731]: INFO nova.virt.libvirt.driver [-] [instance: 61c8082e-a4c5-47de-a239-05c10bb4c5ac] Instance spawned successfully.
Apr 13 16:51:24 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-8c4816d7-3cce-452f-a2ac-47a3a4f04d7e tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] [instance: 61c8082e-a4c5-47de-a239-05c10bb4c5ac] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 16:51:24 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 61c8082e-a4c5-47de-a239-05c10bb4c5ac] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:51:24 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 61c8082e-a4c5-47de-a239-05c10bb4c5ac] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71731) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 16:51:24 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-8c4816d7-3cce-452f-a2ac-47a3a4f04d7e tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] [instance: 61c8082e-a4c5-47de-a239-05c10bb4c5ac] Found default for hw_cdrom_bus of ide {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:51:24 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-8c4816d7-3cce-452f-a2ac-47a3a4f04d7e tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] [instance: 61c8082e-a4c5-47de-a239-05c10bb4c5ac] Found default for hw_disk_bus of virtio {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:51:24 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-8c4816d7-3cce-452f-a2ac-47a3a4f04d7e tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] [instance: 61c8082e-a4c5-47de-a239-05c10bb4c5ac] Found default for hw_input_bus of None {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:51:24 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-8c4816d7-3cce-452f-a2ac-47a3a4f04d7e tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] [instance: 61c8082e-a4c5-47de-a239-05c10bb4c5ac] Found default for hw_pointer_model of None {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:51:24 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-8c4816d7-3cce-452f-a2ac-47a3a4f04d7e tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] [instance: 61c8082e-a4c5-47de-a239-05c10bb4c5ac] Found default for hw_video_model of virtio {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:51:24 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-8c4816d7-3cce-452f-a2ac-47a3a4f04d7e tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] [instance: 61c8082e-a4c5-47de-a239-05c10bb4c5ac] Found default for hw_vif_model of virtio {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:51:24 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 61c8082e-a4c5-47de-a239-05c10bb4c5ac] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 16:51:24 user nova-compute[71731]: DEBUG nova.virt.driver [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Emitting event <LifecycleEvent: 1681404684.1297507, 61c8082e-a4c5-47de-a239-05c10bb4c5ac => Started> {{(pid=71731) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 16:51:24 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 61c8082e-a4c5-47de-a239-05c10bb4c5ac] VM Started (Lifecycle Event)
Apr 13 16:51:24 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 61c8082e-a4c5-47de-a239-05c10bb4c5ac] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:51:24 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 61c8082e-a4c5-47de-a239-05c10bb4c5ac] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71731) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 16:51:24 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 61c8082e-a4c5-47de-a239-05c10bb4c5ac] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 16:51:24 user nova-compute[71731]: INFO nova.compute.manager [None req-8c4816d7-3cce-452f-a2ac-47a3a4f04d7e tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] [instance: 61c8082e-a4c5-47de-a239-05c10bb4c5ac] Took 6.25 seconds to spawn the instance on the hypervisor.
Apr 13 16:51:24 user nova-compute[71731]: DEBUG nova.compute.manager [None req-8c4816d7-3cce-452f-a2ac-47a3a4f04d7e tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] [instance: 61c8082e-a4c5-47de-a239-05c10bb4c5ac] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:51:24 user nova-compute[71731]: INFO nova.compute.manager [None req-8c4816d7-3cce-452f-a2ac-47a3a4f04d7e tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] [instance: 61c8082e-a4c5-47de-a239-05c10bb4c5ac] Took 6.91 seconds to build instance.
Apr 13 16:51:24 user nova-compute[71731]: DEBUG nova.compute.manager [req-cb70d00b-7d41-40a6-9719-519dbde8638f req-09e578f3-5cc6-439e-9075-ae858e0037f6 service nova] [instance: 61c8082e-a4c5-47de-a239-05c10bb4c5ac] Received event network-vif-plugged-2366235b-52e8-49ab-8a64-f961015f5bec {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:51:24 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-cb70d00b-7d41-40a6-9719-519dbde8638f req-09e578f3-5cc6-439e-9075-ae858e0037f6 service nova] Acquiring lock "61c8082e-a4c5-47de-a239-05c10bb4c5ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:51:24 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-cb70d00b-7d41-40a6-9719-519dbde8638f req-09e578f3-5cc6-439e-9075-ae858e0037f6 service nova] Lock "61c8082e-a4c5-47de-a239-05c10bb4c5ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:51:24 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-cb70d00b-7d41-40a6-9719-519dbde8638f req-09e578f3-5cc6-439e-9075-ae858e0037f6 service nova] Lock "61c8082e-a4c5-47de-a239-05c10bb4c5ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:51:24 user nova-compute[71731]: DEBUG nova.compute.manager [req-cb70d00b-7d41-40a6-9719-519dbde8638f req-09e578f3-5cc6-439e-9075-ae858e0037f6 service nova] [instance: 61c8082e-a4c5-47de-a239-05c10bb4c5ac] No waiting events found dispatching network-vif-plugged-2366235b-52e8-49ab-8a64-f961015f5bec {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:51:24 user nova-compute[71731]: WARNING nova.compute.manager [req-cb70d00b-7d41-40a6-9719-519dbde8638f req-09e578f3-5cc6-439e-9075-ae858e0037f6 service nova] [instance: 61c8082e-a4c5-47de-a239-05c10bb4c5ac] Received unexpected event network-vif-plugged-2366235b-52e8-49ab-8a64-f961015f5bec for instance with vm_state active and task_state None.
Apr 13 16:51:24 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-8c4816d7-3cce-452f-a2ac-47a3a4f04d7e tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] Lock "61c8082e-a4c5-47de-a239-05c10bb4c5ac" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.032s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:51:24 user nova-compute[71731]: INFO nova.virt.libvirt.driver [-] [instance: 37a39f40-d239-4716-91bc-3f562906bd1e] Instance destroyed successfully.
Apr 13 16:51:24 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-795dab24-b9d0-4b47-992f-7e1e5c3ad0d6 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] [instance: 37a39f40-d239-4716-91bc-3f562906bd1e] Attempting rescue
Apr 13 16:51:24 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-795dab24-b9d0-4b47-992f-7e1e5c3ad0d6 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=71731) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4289}}
Apr 13 16:51:24 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-795dab24-b9d0-4b47-992f-7e1e5c3ad0d6 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] [instance: 37a39f40-d239-4716-91bc-3f562906bd1e] Instance directory exists: not creating {{(pid=71731) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 13 16:51:24 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-795dab24-b9d0-4b47-992f-7e1e5c3ad0d6 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] [instance: 37a39f40-d239-4716-91bc-3f562906bd1e] Creating image(s)
Apr 13 16:51:24 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-795dab24-b9d0-4b47-992f-7e1e5c3ad0d6 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Acquiring lock "/opt/stack/data/nova/instances/37a39f40-d239-4716-91bc-3f562906bd1e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:51:24 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-795dab24-b9d0-4b47-992f-7e1e5c3ad0d6 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lock "/opt/stack/data/nova/instances/37a39f40-d239-4716-91bc-3f562906bd1e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:51:24 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-795dab24-b9d0-4b47-992f-7e1e5c3ad0d6 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lock "/opt/stack/data/nova/instances/37a39f40-d239-4716-91bc-3f562906bd1e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:51:24 user nova-compute[71731]: DEBUG nova.objects.instance [None req-795dab24-b9d0-4b47-992f-7e1e5c3ad0d6 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lazy-loading 'trusted_certs' on Instance uuid 37a39f40-d239-4716-91bc-3f562906bd1e {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:51:24 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-795dab24-b9d0-4b47-992f-7e1e5c3ad0d6 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Acquiring lock "9524227dd898575c3099d3976f096cd935414279" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:51:24 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-795dab24-b9d0-4b47-992f-7e1e5c3ad0d6 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lock "9524227dd898575c3099d3976f096cd935414279" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:51:24 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-795dab24-b9d0-4b47-992f-7e1e5c3ad0d6 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279 --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:51:24 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-795dab24-b9d0-4b47-992f-7e1e5c3ad0d6 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279 --force-share --output=json" returned: 0 in 0.135s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:51:24 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-795dab24-b9d0-4b47-992f-7e1e5c3ad0d6 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279,backing_fmt=raw /opt/stack/data/nova/instances/37a39f40-d239-4716-91bc-3f562906bd1e/disk.rescue {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:51:24 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-795dab24-b9d0-4b47-992f-7e1e5c3ad0d6 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279,backing_fmt=raw /opt/stack/data/nova/instances/37a39f40-d239-4716-91bc-3f562906bd1e/disk.rescue" returned: 0 in 0.050s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:51:24 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-795dab24-b9d0-4b47-992f-7e1e5c3ad0d6 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lock "9524227dd898575c3099d3976f096cd935414279" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.192s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:51:24 user nova-compute[71731]: DEBUG nova.objects.instance [None req-795dab24-b9d0-4b47-992f-7e1e5c3ad0d6 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lazy-loading 'migration_context' on Instance uuid 37a39f40-d239-4716-91bc-3f562906bd1e {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:51:24 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-795dab24-b9d0-4b47-992f-7e1e5c3ad0d6 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] [instance: 37a39f40-d239-4716-91bc-3f562906bd1e] Created local disks {{(pid=71731) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 16:51:24 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-795dab24-b9d0-4b47-992f-7e1e5c3ad0d6 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] [instance: 37a39f40-d239-4716-91bc-3f562906bd1e] Start _get_guest_xml network_info=[{"id": "86b0ae4e-a317-4c75-9033-49325a4399d2", "address": "fa:16:3e:14:4c:bc", "network": {"id": "2a5b69f1-fc5b-4c33-a9eb-12a4d9293500", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2137344591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-2137344591-network", "vif_mac": "fa:16:3e:14:4c:bc"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "846732ecb7e047128b4684972d3cd8c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86b0ae4e-a3", "ovs_interfaceid": "86b0ae4e-a317-4c75-9033-49325a4399d2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T16:16:31Z,direct_url=<?>,disk_format='qcow2',id=708622a9-7465-4492-ade8-b827198f7e30,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='0b29a975c552465aba0ac7d6288434bd',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T16:16:33Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '708622a9-7465-4492-ade8-b827198f7e30', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=71731) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 16:51:24 user nova-compute[71731]: DEBUG nova.objects.instance [None req-795dab24-b9d0-4b47-992f-7e1e5c3ad0d6 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lazy-loading 'resources' on Instance uuid 37a39f40-d239-4716-91bc-3f562906bd1e {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:51:24 user nova-compute[71731]: DEBUG nova.objects.instance [None req-795dab24-b9d0-4b47-992f-7e1e5c3ad0d6 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lazy-loading 'numa_topology' on Instance uuid 37a39f40-d239-4716-91bc-3f562906bd1e {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:51:24 user nova-compute[71731]: WARNING nova.virt.libvirt.driver [None req-795dab24-b9d0-4b47-992f-7e1e5c3ad0d6 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 16:51:24 user nova-compute[71731]: WARNING nova.virt.libvirt.driver [None req-795dab24-b9d0-4b47-992f-7e1e5c3ad0d6 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 16:51:24 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-795dab24-b9d0-4b47-992f-7e1e5c3ad0d6 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71731) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 16:51:24 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-795dab24-b9d0-4b47-992f-7e1e5c3ad0d6 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T16:17:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T16:16:31Z,direct_url=<?>,disk_format='qcow2',id=708622a9-7465-4492-ade8-b827198f7e30,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='0b29a975c552465aba0ac7d6288434bd',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T16:16:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 16:51:24 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-795dab24-b9d0-4b47-992f-7e1e5c3ad0d6 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Flavor limits 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 16:51:24 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-795dab24-b9d0-4b47-992f-7e1e5c3ad0d6 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Image limits 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 16:51:24 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-795dab24-b9d0-4b47-992f-7e1e5c3ad0d6 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Flavor pref 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 16:51:24 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-795dab24-b9d0-4b47-992f-7e1e5c3ad0d6 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Image pref 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 16:51:24 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-795dab24-b9d0-4b47-992f-7e1e5c3ad0d6 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 16:51:24 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-795dab24-b9d0-4b47-992f-7e1e5c3ad0d6 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 16:51:24 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-795dab24-b9d0-4b47-992f-7e1e5c3ad0d6 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71731) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 16:51:24 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-795dab24-b9d0-4b47-992f-7e1e5c3ad0d6 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Got 1 possible topologies {{(pid=71731) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 16:51:24 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-795dab24-b9d0-4b47-992f-7e1e5c3ad0d6 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 16:51:24 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-795dab24-b9d0-4b47-992f-7e1e5c3ad0d6 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 16:51:24 user nova-compute[71731]: DEBUG nova.objects.instance [None req-795dab24-b9d0-4b47-992f-7e1e5c3ad0d6 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lazy-loading 'vcpu_model' on Instance uuid 37a39f40-d239-4716-91bc-3f562906bd1e {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:51:24 user nova-compute[71731]: DEBUG nova.virt.libvirt.vif [None req-795dab24-b9d0-4b47-992f-7e1e5c3ad0d6 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T16:49:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2129119099',display_name='tempest-ServerRescueNegativeTestJSON-server-2129119099',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2129119099',id=40,image_ref='708622a9-7465-4492-ade8-b827198f7e30',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBInYPh0gx086UszGyyqEY0fWXC6yPnnRldjV6vUByd8iGqw/BPMxIKhGYsYjdNeYHSNNfn33Tapk/jQbqiYzfJYw4chd2naEdDS8MeKSMHscX8fHOp+k3fZ6id92uef9aA==',key_name='tempest-keypair-1684148765',keypairs=<?>,launch_index=0,launched_at=2023-04-13T16:49:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='846732ecb7e047128b4684972d3cd8c6',ramdisk_id='',reservation_id='r-8atp79dt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='708622a9-7465-4492-ade8-b827198f7e30',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-84287455',owner_user_name='tempest-ServerRescueNegativeTestJSON-84287455-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T16:49:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0c7f54723c494e05ada117353c0790cb',uuid=37a39f40-d239-4716-91bc-3f562906bd1e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "86b0ae4e-a317-4c75-9033-49325a4399d2", "address": "fa:16:3e:14:4c:bc", "network": {"id": "2a5b69f1-fc5b-4c33-a9eb-12a4d9293500", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2137344591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-2137344591-network", "vif_mac": "fa:16:3e:14:4c:bc"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "846732ecb7e047128b4684972d3cd8c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86b0ae4e-a3", "ovs_interfaceid": "86b0ae4e-a317-4c75-9033-49325a4399d2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71731) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 16:51:24 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-795dab24-b9d0-4b47-992f-7e1e5c3ad0d6 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Converting VIF {"id": "86b0ae4e-a317-4c75-9033-49325a4399d2", "address": "fa:16:3e:14:4c:bc", "network": {"id": "2a5b69f1-fc5b-4c33-a9eb-12a4d9293500", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2137344591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-2137344591-network", "vif_mac": "fa:16:3e:14:4c:bc"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "846732ecb7e047128b4684972d3cd8c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86b0ae4e-a3", "ovs_interfaceid": "86b0ae4e-a317-4c75-9033-49325a4399d2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 16:51:24 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-795dab24-b9d0-4b47-992f-7e1e5c3ad0d6 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:14:4c:bc,bridge_name='br-int',has_traffic_filtering=True,id=86b0ae4e-a317-4c75-9033-49325a4399d2,network=Network(2a5b69f1-fc5b-4c33-a9eb-12a4d9293500),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86b0ae4e-a3') {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 16:51:24 user nova-compute[71731]: DEBUG nova.objects.instance [None req-795dab24-b9d0-4b47-992f-7e1e5c3ad0d6 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lazy-loading 'pci_devices' on Instance uuid 37a39f40-d239-4716-91bc-3f562906bd1e {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:51:24 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-795dab24-b9d0-4b47-992f-7e1e5c3ad0d6 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] [instance: 37a39f40-d239-4716-91bc-3f562906bd1e] End _get_guest_xml xml=<domain type="kvm">
Apr 13 16:51:24 user nova-compute[71731]:   <uuid>37a39f40-d239-4716-91bc-3f562906bd1e</uuid>
Apr 13 16:51:24 user nova-compute[71731]:   <name>instance-00000028</name>
Apr 13 16:51:24 user nova-compute[71731]:   <memory>131072</memory>
Apr 13 16:51:24 user nova-compute[71731]:   <vcpu>1</vcpu>
Apr 13 16:51:24 user nova-compute[71731]:   <metadata>
Apr 13 16:51:24 user nova-compute[71731]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 16:51:24 user nova-compute[71731]:       <nova:package version="0.0.0"/>
Apr 13 16:51:24 user nova-compute[71731]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-2129119099</nova:name>
Apr 13 16:51:24 user nova-compute[71731]:       <nova:creationTime>2023-04-13 16:51:24</nova:creationTime>
Apr 13 16:51:24 user nova-compute[71731]:       <nova:flavor name="m1.nano">
Apr 13 16:51:24 user nova-compute[71731]:         <nova:memory>128</nova:memory>
Apr 13 16:51:24 user nova-compute[71731]:         <nova:disk>1</nova:disk>
Apr 13 16:51:24 user nova-compute[71731]:         <nova:swap>0</nova:swap>
Apr 13 16:51:24 user nova-compute[71731]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 16:51:24 user nova-compute[71731]:         <nova:vcpus>1</nova:vcpus>
Apr 13 16:51:24 user nova-compute[71731]:       </nova:flavor>
Apr 13 16:51:24 user nova-compute[71731]:       <nova:owner>
Apr 13 16:51:24 user nova-compute[71731]:         <nova:user uuid="0c7f54723c494e05ada117353c0790cb">tempest-ServerRescueNegativeTestJSON-84287455-project-member</nova:user>
Apr 13 16:51:24 user nova-compute[71731]:         <nova:project uuid="846732ecb7e047128b4684972d3cd8c6">tempest-ServerRescueNegativeTestJSON-84287455</nova:project>
Apr 13 16:51:24 user nova-compute[71731]:       </nova:owner>
Apr 13 16:51:24 user nova-compute[71731]:       <nova:root type="image" uuid="708622a9-7465-4492-ade8-b827198f7e30"/>
Apr 13 16:51:24 user nova-compute[71731]:       <nova:ports>
Apr 13 16:51:24 user nova-compute[71731]:         <nova:port uuid="86b0ae4e-a317-4c75-9033-49325a4399d2">
Apr 13 16:51:24 user nova-compute[71731]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Apr 13 16:51:24 user nova-compute[71731]:         </nova:port>
Apr 13 16:51:24 user nova-compute[71731]:       </nova:ports>
Apr 13 16:51:24 user nova-compute[71731]:     </nova:instance>
Apr 13 16:51:24 user nova-compute[71731]:   </metadata>
Apr 13 16:51:24 user nova-compute[71731]:   <sysinfo type="smbios">
Apr 13 16:51:24 user nova-compute[71731]:     <system>
Apr 13 16:51:24 user nova-compute[71731]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 16:51:24 user nova-compute[71731]:       <entry name="product">OpenStack Nova</entry>
Apr 13 16:51:24 user nova-compute[71731]:       <entry name="version">0.0.0</entry>
Apr 13 16:51:24 user nova-compute[71731]:       <entry name="serial">37a39f40-d239-4716-91bc-3f562906bd1e</entry>
Apr 13 16:51:24 user nova-compute[71731]:       <entry name="uuid">37a39f40-d239-4716-91bc-3f562906bd1e</entry>
Apr 13 16:51:24 user nova-compute[71731]:       <entry name="family">Virtual Machine</entry>
Apr 13 16:51:24 user nova-compute[71731]:     </system>
Apr 13 16:51:24 user nova-compute[71731]:   </sysinfo>
Apr 13 16:51:24 user nova-compute[71731]:   <os>
Apr 13 16:51:24 user nova-compute[71731]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 16:51:24 user nova-compute[71731]:     <smbios mode="sysinfo"/>
Apr 13 16:51:24 user nova-compute[71731]:   </os>
Apr 13 16:51:24 user nova-compute[71731]:   <features>
Apr 13 16:51:24 user nova-compute[71731]:     <acpi/>
Apr 13 16:51:24 user nova-compute[71731]:     <apic/>
Apr 13 16:51:24 user nova-compute[71731]:     <vmcoreinfo/>
Apr 13 16:51:24 user nova-compute[71731]:   </features>
Apr 13 16:51:24 user nova-compute[71731]:   <clock offset="utc">
Apr 13 16:51:24 user nova-compute[71731]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 16:51:24 user nova-compute[71731]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 16:51:24 user nova-compute[71731]:     <timer name="hpet" present="no"/>
Apr 13 16:51:24 user nova-compute[71731]:   </clock>
Apr 13 16:51:24 user nova-compute[71731]:   <cpu mode="custom" match="exact">
Apr 13 16:51:24 user nova-compute[71731]:     <model>Nehalem</model>
Apr 13 16:51:24 user nova-compute[71731]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 16:51:24 user nova-compute[71731]:   </cpu>
Apr 13 16:51:24 user nova-compute[71731]:   <devices>
Apr 13 16:51:24 user nova-compute[71731]:     <disk type="file" device="disk">
Apr 13 16:51:24 user nova-compute[71731]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 16:51:24 user nova-compute[71731]:       <source file="/opt/stack/data/nova/instances/37a39f40-d239-4716-91bc-3f562906bd1e/disk.rescue"/>
Apr 13 16:51:24 user nova-compute[71731]:       <target dev="vda" bus="virtio"/>
Apr 13 16:51:24 user nova-compute[71731]:     </disk>
Apr 13 16:51:24 user nova-compute[71731]:     <disk type="file" device="disk">
Apr 13 16:51:24 user nova-compute[71731]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 16:51:24 user nova-compute[71731]:       <source file="/opt/stack/data/nova/instances/37a39f40-d239-4716-91bc-3f562906bd1e/disk"/>
Apr 13 16:51:24 user nova-compute[71731]:       <target dev="vdb" bus="virtio"/>
Apr 13 16:51:24 user nova-compute[71731]:     </disk>
Apr 13 16:51:24 user nova-compute[71731]:     <interface type="ethernet">
Apr 13 16:51:24 user nova-compute[71731]:       <mac address="fa:16:3e:14:4c:bc"/>
Apr 13 16:51:24 user nova-compute[71731]:       <model type="virtio"/>
Apr 13 16:51:24 user nova-compute[71731]:       <mtu size="1442"/>
Apr 13 16:51:24 user nova-compute[71731]:       <target dev="tap86b0ae4e-a3"/>
Apr 13 16:51:24 user nova-compute[71731]:     </interface>
Apr 13 16:51:24 user nova-compute[71731]:     <serial type="pty">
Apr 13 16:51:24 user nova-compute[71731]:       <log file="/opt/stack/data/nova/instances/37a39f40-d239-4716-91bc-3f562906bd1e/console.log" append="off"/>
Apr 13 16:51:24 user nova-compute[71731]:     </serial>
Apr 13 16:51:24 user nova-compute[71731]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 16:51:24 user nova-compute[71731]:     <video>
Apr 13 16:51:24 user nova-compute[71731]:       <model type="virtio"/>
Apr 13 16:51:24 user nova-compute[71731]:     </video>
Apr 13 16:51:24 user nova-compute[71731]:     <rng model="virtio">
Apr 13 16:51:24 user nova-compute[71731]:       <backend model="random">/dev/urandom</backend>
Apr 13 16:51:24 user nova-compute[71731]:     </rng>
Apr 13 16:51:24 user nova-compute[71731]:     <controller type="usb" index="0" model="none"/>
Apr 13 16:51:24 user nova-compute[71731]:     <memballoon model="virtio">
Apr 13 16:51:24 user nova-compute[71731]:       <stats period="10"/>
Apr 13 16:51:24 user nova-compute[71731]:     </memballoon>
Apr 13 16:51:24 user nova-compute[71731]:   </devices>
Apr 13 16:51:24 user nova-compute[71731]: </domain>
Apr 13 16:51:24 user nova-compute[71731]:  {{(pid=71731) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 16:51:24 user nova-compute[71731]: INFO nova.virt.libvirt.driver [-] [instance: 37a39f40-d239-4716-91bc-3f562906bd1e] Instance destroyed successfully.
Apr 13 16:51:24 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-795dab24-b9d0-4b47-992f-7e1e5c3ad0d6 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] No BDM found with device name vda, not building metadata. {{(pid=71731) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 16:51:24 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-795dab24-b9d0-4b47-992f-7e1e5c3ad0d6 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71731) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 16:51:24 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-795dab24-b9d0-4b47-992f-7e1e5c3ad0d6 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] No VIF found with MAC fa:16:3e:14:4c:bc, not building metadata {{(pid=71731) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 16:51:25 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:51:25 user nova-compute[71731]: DEBUG nova.compute.manager [req-ad3247e1-83e3-4aa5-91d0-6bbed95859ab req-3cc65031-a2c8-4243-9df0-ec61d8ec3472 service nova] [instance: 37a39f40-d239-4716-91bc-3f562906bd1e] Received event network-vif-plugged-86b0ae4e-a317-4c75-9033-49325a4399d2 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:51:25 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-ad3247e1-83e3-4aa5-91d0-6bbed95859ab req-3cc65031-a2c8-4243-9df0-ec61d8ec3472 service nova] Acquiring lock "37a39f40-d239-4716-91bc-3f562906bd1e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:51:25 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-ad3247e1-83e3-4aa5-91d0-6bbed95859ab req-3cc65031-a2c8-4243-9df0-ec61d8ec3472 service nova] Lock "37a39f40-d239-4716-91bc-3f562906bd1e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:51:25 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-ad3247e1-83e3-4aa5-91d0-6bbed95859ab req-3cc65031-a2c8-4243-9df0-ec61d8ec3472 service nova] Lock "37a39f40-d239-4716-91bc-3f562906bd1e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:51:25 user nova-compute[71731]: DEBUG nova.compute.manager [req-ad3247e1-83e3-4aa5-91d0-6bbed95859ab req-3cc65031-a2c8-4243-9df0-ec61d8ec3472 service nova] [instance: 37a39f40-d239-4716-91bc-3f562906bd1e] No waiting events found dispatching network-vif-plugged-86b0ae4e-a317-4c75-9033-49325a4399d2 {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:51:25 user nova-compute[71731]: WARNING nova.compute.manager [req-ad3247e1-83e3-4aa5-91d0-6bbed95859ab req-3cc65031-a2c8-4243-9df0-ec61d8ec3472 service nova] [instance: 37a39f40-d239-4716-91bc-3f562906bd1e] Received unexpected event network-vif-plugged-86b0ae4e-a317-4c75-9033-49325a4399d2 for instance with vm_state active and task_state rescuing.
Apr 13 16:51:26 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:51:26 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:51:26 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:51:26 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:51:26 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:51:27 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:51:27 user nova-compute[71731]: DEBUG nova.compute.manager [req-40722a49-4ef2-489e-80a4-9462e97574e5 req-0ed5e5bc-4116-43dd-b288-9af6ef01e625 service nova] [instance: 37a39f40-d239-4716-91bc-3f562906bd1e] Received event network-vif-plugged-86b0ae4e-a317-4c75-9033-49325a4399d2 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:51:27 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-40722a49-4ef2-489e-80a4-9462e97574e5 req-0ed5e5bc-4116-43dd-b288-9af6ef01e625 service nova] Acquiring lock "37a39f40-d239-4716-91bc-3f562906bd1e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:51:27 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-40722a49-4ef2-489e-80a4-9462e97574e5 req-0ed5e5bc-4116-43dd-b288-9af6ef01e625 service nova] Lock "37a39f40-d239-4716-91bc-3f562906bd1e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:51:27 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-40722a49-4ef2-489e-80a4-9462e97574e5 req-0ed5e5bc-4116-43dd-b288-9af6ef01e625 service nova] Lock "37a39f40-d239-4716-91bc-3f562906bd1e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:51:27 user nova-compute[71731]: DEBUG nova.compute.manager [req-40722a49-4ef2-489e-80a4-9462e97574e5 req-0ed5e5bc-4116-43dd-b288-9af6ef01e625 service nova] [instance: 37a39f40-d239-4716-91bc-3f562906bd1e] No waiting events found dispatching network-vif-plugged-86b0ae4e-a317-4c75-9033-49325a4399d2 {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:51:27 user nova-compute[71731]: WARNING nova.compute.manager [req-40722a49-4ef2-489e-80a4-9462e97574e5 req-0ed5e5bc-4116-43dd-b288-9af6ef01e625 service nova] [instance: 37a39f40-d239-4716-91bc-3f562906bd1e] Received unexpected event network-vif-plugged-86b0ae4e-a317-4c75-9033-49325a4399d2 for instance with vm_state active and task_state rescuing.
Apr 13 16:51:27 user nova-compute[71731]: DEBUG nova.compute.manager [req-40722a49-4ef2-489e-80a4-9462e97574e5 req-0ed5e5bc-4116-43dd-b288-9af6ef01e625 service nova] [instance: 37a39f40-d239-4716-91bc-3f562906bd1e] Received event network-vif-plugged-86b0ae4e-a317-4c75-9033-49325a4399d2 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:51:27 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-40722a49-4ef2-489e-80a4-9462e97574e5 req-0ed5e5bc-4116-43dd-b288-9af6ef01e625 service nova] Acquiring lock "37a39f40-d239-4716-91bc-3f562906bd1e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:51:27 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-40722a49-4ef2-489e-80a4-9462e97574e5 req-0ed5e5bc-4116-43dd-b288-9af6ef01e625 service nova] Lock "37a39f40-d239-4716-91bc-3f562906bd1e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:51:27 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-40722a49-4ef2-489e-80a4-9462e97574e5 req-0ed5e5bc-4116-43dd-b288-9af6ef01e625 service nova] Lock "37a39f40-d239-4716-91bc-3f562906bd1e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:51:27 user nova-compute[71731]: DEBUG nova.compute.manager [req-40722a49-4ef2-489e-80a4-9462e97574e5 req-0ed5e5bc-4116-43dd-b288-9af6ef01e625 service nova] [instance: 37a39f40-d239-4716-91bc-3f562906bd1e] No waiting events found dispatching network-vif-plugged-86b0ae4e-a317-4c75-9033-49325a4399d2 {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:51:27 user nova-compute[71731]: WARNING nova.compute.manager [req-40722a49-4ef2-489e-80a4-9462e97574e5 req-0ed5e5bc-4116-43dd-b288-9af6ef01e625 service nova] [instance: 37a39f40-d239-4716-91bc-3f562906bd1e] Received unexpected event network-vif-plugged-86b0ae4e-a317-4c75-9033-49325a4399d2 for instance with vm_state active and task_state rescuing.
Apr 13 16:51:28 user nova-compute[71731]: DEBUG nova.virt.libvirt.host [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Removed pending event for 37a39f40-d239-4716-91bc-3f562906bd1e due to event {{(pid=71731) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 13 16:51:28 user nova-compute[71731]: DEBUG nova.virt.driver [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Emitting event <LifecycleEvent: 1681404688.4035127, 37a39f40-d239-4716-91bc-3f562906bd1e => Resumed> {{(pid=71731) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 16:51:28 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 37a39f40-d239-4716-91bc-3f562906bd1e] VM Resumed (Lifecycle Event)
Apr 13 16:51:28 user nova-compute[71731]: DEBUG nova.compute.manager [None req-795dab24-b9d0-4b47-992f-7e1e5c3ad0d6 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] [instance: 37a39f40-d239-4716-91bc-3f562906bd1e] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:51:28 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 37a39f40-d239-4716-91bc-3f562906bd1e] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:51:28 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 37a39f40-d239-4716-91bc-3f562906bd1e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71731) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 16:51:28 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 37a39f40-d239-4716-91bc-3f562906bd1e] During sync_power_state the instance has a pending task (rescuing). Skip.
Apr 13 16:51:28 user nova-compute[71731]: DEBUG nova.virt.driver [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Emitting event <LifecycleEvent: 1681404688.4079976, 37a39f40-d239-4716-91bc-3f562906bd1e => Started> {{(pid=71731) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 16:51:28 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 37a39f40-d239-4716-91bc-3f562906bd1e] VM Started (Lifecycle Event)
Apr 13 16:51:28 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 37a39f40-d239-4716-91bc-3f562906bd1e] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:51:28 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 37a39f40-d239-4716-91bc-3f562906bd1e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71731) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 16:51:30 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:51:30 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71731) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 16:51:30 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:51:31 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:51:32 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:51:32 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:51:33 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager.update_available_resource {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:51:33 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:51:33 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:51:33 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:51:33 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Auditing locally available compute resources for user (node: user) {{(pid=71731) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 16:51:33 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3af23ff8-4e10-4fbf-a86e-bda842f084ff/disk.rescue --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:51:33 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3af23ff8-4e10-4fbf-a86e-bda842f084ff/disk.rescue --force-share --output=json" returned: 0 in 0.149s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:51:33 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3af23ff8-4e10-4fbf-a86e-bda842f084ff/disk.rescue --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:51:33 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3af23ff8-4e10-4fbf-a86e-bda842f084ff/disk.rescue --force-share --output=json" returned: 0 in 0.139s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:51:33 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3af23ff8-4e10-4fbf-a86e-bda842f084ff/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:51:33 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3af23ff8-4e10-4fbf-a86e-bda842f084ff/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:51:33 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3af23ff8-4e10-4fbf-a86e-bda842f084ff/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:51:33 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3af23ff8-4e10-4fbf-a86e-bda842f084ff/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:51:33 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37a39f40-d239-4716-91bc-3f562906bd1e/disk.rescue --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:51:33 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37a39f40-d239-4716-91bc-3f562906bd1e/disk.rescue --force-share --output=json" returned: 0 in 0.148s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:51:33 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37a39f40-d239-4716-91bc-3f562906bd1e/disk.rescue --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:51:34 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37a39f40-d239-4716-91bc-3f562906bd1e/disk.rescue --force-share --output=json" returned: 0 in 0.133s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:51:34 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] skipping disk /opt/stack/data/nova/instances/37a39f40-d239-4716-91bc-3f562906bd1e/disk (vdb) as it is a volume {{(pid=71731) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 16:51:34 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61c8082e-a4c5-47de-a239-05c10bb4c5ac/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:51:34 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61c8082e-a4c5-47de-a239-05c10bb4c5ac/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:51:34 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61c8082e-a4c5-47de-a239-05c10bb4c5ac/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:51:34 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61c8082e-a4c5-47de-a239-05c10bb4c5ac/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:51:34 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2d55cdd-c89c-4c59-afe1-49a33225af22/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:51:34 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2d55cdd-c89c-4c59-afe1-49a33225af22/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:51:34 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2d55cdd-c89c-4c59-afe1-49a33225af22/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:51:34 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2d55cdd-c89c-4c59-afe1-49a33225af22/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:51:35 user nova-compute[71731]: WARNING nova.virt.libvirt.driver [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 16:51:35 user nova-compute[71731]: WARNING nova.virt.libvirt.driver [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 16:51:35 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Hypervisor/Node resource view: name=user free_ram=8477MB free_disk=26.06924819946289GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71731) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 16:51:35 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:51:35 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:51:35 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance b2d55cdd-c89c-4c59-afe1-49a33225af22 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 16:51:35 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance 3af23ff8-4e10-4fbf-a86e-bda842f084ff actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 16:51:35 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance 37a39f40-d239-4716-91bc-3f562906bd1e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 16:51:35 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance 61c8082e-a4c5-47de-a239-05c10bb4c5ac actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 16:51:35 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=71731) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 16:51:35 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Final resource view: name=user phys_ram=16023MB used_ram=1024MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=71731) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 16:51:35 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:51:35 user nova-compute[71731]: DEBUG nova.compute.provider_tree [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Inventory has not changed in ProviderTree for provider: cb6b1a64-0c24-4e2d-af1e-16576ca9165c {{(pid=71731) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 16:51:35 user nova-compute[71731]: DEBUG nova.scheduler.client.report [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Inventory has not changed for provider cb6b1a64-0c24-4e2d-af1e-16576ca9165c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71731) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 16:51:35 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Compute_service record updated for user:user {{(pid=71731) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 16:51:35 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.316s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:51:37 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:51:38 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:51:38 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:51:38 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Starting heal instance info cache {{(pid=71731) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 16:51:38 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Acquiring lock "refresh_cache-3af23ff8-4e10-4fbf-a86e-bda842f084ff" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 16:51:38 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Acquired lock "refresh_cache-3af23ff8-4e10-4fbf-a86e-bda842f084ff" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 16:51:38 user nova-compute[71731]: DEBUG nova.network.neutron [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] [instance: 3af23ff8-4e10-4fbf-a86e-bda842f084ff] Forcefully refreshing network info cache for instance {{(pid=71731) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 16:51:38 user nova-compute[71731]: DEBUG nova.network.neutron [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] [instance: 3af23ff8-4e10-4fbf-a86e-bda842f084ff] Updating instance_info_cache with network_info: [{"id": "b22086e3-8769-494c-af86-228dba7b3638", "address": "fa:16:3e:84:ee:e5", "network": {"id": "2a5b69f1-fc5b-4c33-a9eb-12a4d9293500", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2137344591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "846732ecb7e047128b4684972d3cd8c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb22086e3-87", "ovs_interfaceid": "b22086e3-8769-494c-af86-228dba7b3638", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:51:38 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Releasing lock "refresh_cache-3af23ff8-4e10-4fbf-a86e-bda842f084ff" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 16:51:38 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] [instance: 3af23ff8-4e10-4fbf-a86e-bda842f084ff] Updated the network info_cache for instance {{(pid=71731) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 16:51:38 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:51:40 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:51:40 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:51:41 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:51:42 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:51:42 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Cleaning up deleted instances {{(pid=71731) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 13 16:51:42 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] There are 0 instances to clean {{(pid=71731) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 13 16:51:42 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:51:45 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:51:47 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:51:47 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:51:50 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:51:52 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:51:55 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:51:57 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:52:00 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:52:00 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Cleaning up deleted instances with incomplete migration  {{(pid=71731) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 13 16:52:00 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:52:05 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 16:52:05 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:52:05 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71731) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 16:52:05 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71731) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 16:52:05 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71731) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 16:52:05 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:52:07 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:52:10 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:52:12 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:52:15 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:52:20 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 16:52:20 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 16:52:20 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71731) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 16:52:20 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71731) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 16:52:20 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:52:20 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71731) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 16:52:25 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 16:52:25 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:52:25 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71731) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 16:52:25 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71731) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 16:52:25 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71731) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 16:52:25 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:52:30 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 16:52:30 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 16:52:30 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71731) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 16:52:30 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71731) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 16:52:30 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71731) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 16:52:30 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:52:32 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:52:32 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:52:32 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71731) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 16:52:33 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:52:35 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager.update_available_resource {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:52:35 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:52:35 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:52:35 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:52:35 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Auditing locally available compute resources for user (node: user) {{(pid=71731) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 16:52:35 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3af23ff8-4e10-4fbf-a86e-bda842f084ff/disk.rescue --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:52:35 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3af23ff8-4e10-4fbf-a86e-bda842f084ff/disk.rescue --force-share --output=json" returned: 0 in 0.132s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:52:35 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3af23ff8-4e10-4fbf-a86e-bda842f084ff/disk.rescue --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:52:35 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:52:35 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3af23ff8-4e10-4fbf-a86e-bda842f084ff/disk.rescue --force-share --output=json" returned: 0 in 0.135s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:52:35 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3af23ff8-4e10-4fbf-a86e-bda842f084ff/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:52:35 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3af23ff8-4e10-4fbf-a86e-bda842f084ff/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:52:35 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3af23ff8-4e10-4fbf-a86e-bda842f084ff/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:52:35 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3af23ff8-4e10-4fbf-a86e-bda842f084ff/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:52:35 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37a39f40-d239-4716-91bc-3f562906bd1e/disk.rescue --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:52:35 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37a39f40-d239-4716-91bc-3f562906bd1e/disk.rescue --force-share --output=json" returned: 0 in 0.135s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:52:35 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37a39f40-d239-4716-91bc-3f562906bd1e/disk.rescue --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:52:36 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37a39f40-d239-4716-91bc-3f562906bd1e/disk.rescue --force-share --output=json" returned: 0 in 0.135s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:52:36 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] skipping disk /opt/stack/data/nova/instances/37a39f40-d239-4716-91bc-3f562906bd1e/disk (vdb) as it is a volume {{(pid=71731) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 16:52:36 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61c8082e-a4c5-47de-a239-05c10bb4c5ac/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:52:36 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61c8082e-a4c5-47de-a239-05c10bb4c5ac/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:52:36 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61c8082e-a4c5-47de-a239-05c10bb4c5ac/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:52:36 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61c8082e-a4c5-47de-a239-05c10bb4c5ac/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:52:36 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2d55cdd-c89c-4c59-afe1-49a33225af22/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:52:36 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2d55cdd-c89c-4c59-afe1-49a33225af22/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:52:36 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2d55cdd-c89c-4c59-afe1-49a33225af22/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:52:36 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2d55cdd-c89c-4c59-afe1-49a33225af22/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:52:37 user nova-compute[71731]: WARNING nova.virt.libvirt.driver [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 16:52:37 user nova-compute[71731]: WARNING nova.virt.libvirt.driver [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 16:52:37 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Hypervisor/Node resource view: name=user free_ram=8512MB free_disk=26.031517028808594GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71731) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 16:52:37 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:52:37 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:52:37 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance b2d55cdd-c89c-4c59-afe1-49a33225af22 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 16:52:37 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance 3af23ff8-4e10-4fbf-a86e-bda842f084ff actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 16:52:37 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance 37a39f40-d239-4716-91bc-3f562906bd1e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 16:52:37 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance 61c8082e-a4c5-47de-a239-05c10bb4c5ac actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 16:52:37 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=71731) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 16:52:37 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Final resource view: name=user phys_ram=16023MB used_ram=1024MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=71731) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 16:52:37 user nova-compute[71731]: DEBUG nova.scheduler.client.report [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Refreshing inventories for resource provider cb6b1a64-0c24-4e2d-af1e-16576ca9165c {{(pid=71731) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 13 16:52:37 user nova-compute[71731]: DEBUG nova.scheduler.client.report [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Updating ProviderTree inventory for provider cb6b1a64-0c24-4e2d-af1e-16576ca9165c from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71731) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 13 16:52:37 user nova-compute[71731]: DEBUG nova.compute.provider_tree [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Updating inventory in ProviderTree for provider cb6b1a64-0c24-4e2d-af1e-16576ca9165c with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71731) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 13 16:52:37 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:52:37 user nova-compute[71731]: DEBUG nova.scheduler.client.report [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Refreshing aggregate associations for resource provider cb6b1a64-0c24-4e2d-af1e-16576ca9165c, aggregates: None {{(pid=71731) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 13 16:52:37 user nova-compute[71731]: DEBUG nova.scheduler.client.report [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Refreshing trait associations for resource provider cb6b1a64-0c24-4e2d-af1e-16576ca9165c, traits: COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSSE3,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_SATA,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_SSE,COMPUTE_RESCUE_BFV,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE41,HW_CPU_X86_MMX,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_RAW {{(pid=71731) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 13 16:52:37 user nova-compute[71731]: DEBUG nova.compute.provider_tree [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Inventory has not changed in ProviderTree for provider: cb6b1a64-0c24-4e2d-af1e-16576ca9165c {{(pid=71731) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 16:52:37 user nova-compute[71731]: DEBUG nova.scheduler.client.report [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Inventory has not changed for provider cb6b1a64-0c24-4e2d-af1e-16576ca9165c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71731) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 16:52:37 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Compute_service record updated for user:user {{(pid=71731) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 16:52:37 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.478s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:52:40 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:52:40 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:52:40 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:52:40 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Starting heal instance info cache {{(pid=71731) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 16:52:40 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Acquiring lock "refresh_cache-37a39f40-d239-4716-91bc-3f562906bd1e" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 16:52:40 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Acquired lock "refresh_cache-37a39f40-d239-4716-91bc-3f562906bd1e" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 16:52:40 user nova-compute[71731]: DEBUG nova.network.neutron [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] [instance: 37a39f40-d239-4716-91bc-3f562906bd1e] Forcefully refreshing network info cache for instance {{(pid=71731) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 16:52:41 user nova-compute[71731]: DEBUG nova.network.neutron [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] [instance: 37a39f40-d239-4716-91bc-3f562906bd1e] Updating instance_info_cache with network_info: [{"id": "86b0ae4e-a317-4c75-9033-49325a4399d2", "address": "fa:16:3e:14:4c:bc", "network": {"id": "2a5b69f1-fc5b-4c33-a9eb-12a4d9293500", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2137344591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "846732ecb7e047128b4684972d3cd8c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86b0ae4e-a3", "ovs_interfaceid": "86b0ae4e-a317-4c75-9033-49325a4399d2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:52:41 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Releasing lock "refresh_cache-37a39f40-d239-4716-91bc-3f562906bd1e" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 16:52:41 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] [instance: 37a39f40-d239-4716-91bc-3f562906bd1e] Updated the network info_cache for instance {{(pid=71731) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 16:52:41 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:52:41 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:52:42 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:52:42 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:52:45 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:52:50 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 16:52:50 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:52:50 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71731) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 16:52:50 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71731) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 16:52:50 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71731) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 16:52:50 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:52:52 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:52:55 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 16:52:55 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:52:55 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71731) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 16:52:55 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71731) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 16:52:55 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71731) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 16:52:55 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:53:00 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 16:53:00 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:53:00 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71731) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 16:53:00 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71731) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 16:53:00 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71731) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 16:53:00 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:53:05 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 16:53:05 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:53:05 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71731) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 16:53:05 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71731) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 16:53:05 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71731) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 16:53:05 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:53:07 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-1f598c04-91d1-4862-a498-d2bd25bb734f tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] Acquiring lock "61c8082e-a4c5-47de-a239-05c10bb4c5ac" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:53:07 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-1f598c04-91d1-4862-a498-d2bd25bb734f tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] Lock "61c8082e-a4c5-47de-a239-05c10bb4c5ac" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:53:07 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-1f598c04-91d1-4862-a498-d2bd25bb734f tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] Acquiring lock "61c8082e-a4c5-47de-a239-05c10bb4c5ac-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:53:07 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-1f598c04-91d1-4862-a498-d2bd25bb734f tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] Lock "61c8082e-a4c5-47de-a239-05c10bb4c5ac-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:53:07 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-1f598c04-91d1-4862-a498-d2bd25bb734f tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] Lock "61c8082e-a4c5-47de-a239-05c10bb4c5ac-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:53:07 user nova-compute[71731]: INFO nova.compute.manager [None req-1f598c04-91d1-4862-a498-d2bd25bb734f tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] [instance: 61c8082e-a4c5-47de-a239-05c10bb4c5ac] Terminating instance
Apr 13 16:53:07 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1f598c04-91d1-4862-a498-d2bd25bb734f tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] [instance: 61c8082e-a4c5-47de-a239-05c10bb4c5ac] Start destroying the instance on the hypervisor. {{(pid=71731) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 16:53:07 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:53:08 user nova-compute[71731]: DEBUG nova.compute.manager [req-21aa598f-a466-43fa-a774-4e4208b63dc4 req-9733910a-6fec-4cf6-a942-d992571a72a2 service nova] [instance: 61c8082e-a4c5-47de-a239-05c10bb4c5ac] Received event network-vif-unplugged-2366235b-52e8-49ab-8a64-f961015f5bec {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:53:08 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-21aa598f-a466-43fa-a774-4e4208b63dc4 req-9733910a-6fec-4cf6-a942-d992571a72a2 service nova] Acquiring lock "61c8082e-a4c5-47de-a239-05c10bb4c5ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:53:08 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-21aa598f-a466-43fa-a774-4e4208b63dc4 req-9733910a-6fec-4cf6-a942-d992571a72a2 service nova] Lock "61c8082e-a4c5-47de-a239-05c10bb4c5ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:53:08 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-21aa598f-a466-43fa-a774-4e4208b63dc4 req-9733910a-6fec-4cf6-a942-d992571a72a2 service nova] Lock "61c8082e-a4c5-47de-a239-05c10bb4c5ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:53:08 user nova-compute[71731]: DEBUG nova.compute.manager [req-21aa598f-a466-43fa-a774-4e4208b63dc4 req-9733910a-6fec-4cf6-a942-d992571a72a2 service nova] [instance: 61c8082e-a4c5-47de-a239-05c10bb4c5ac] No waiting events found dispatching network-vif-unplugged-2366235b-52e8-49ab-8a64-f961015f5bec {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:53:08 user nova-compute[71731]: DEBUG nova.compute.manager [req-21aa598f-a466-43fa-a774-4e4208b63dc4 req-9733910a-6fec-4cf6-a942-d992571a72a2 service nova] [instance: 61c8082e-a4c5-47de-a239-05c10bb4c5ac] Received event network-vif-unplugged-2366235b-52e8-49ab-8a64-f961015f5bec for instance with task_state deleting. {{(pid=71731) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 16:53:08 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:53:08 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:53:08 user nova-compute[71731]: INFO nova.virt.libvirt.driver [-] [instance: 61c8082e-a4c5-47de-a239-05c10bb4c5ac] Instance destroyed successfully.
Apr 13 16:53:08 user nova-compute[71731]: DEBUG nova.objects.instance [None req-1f598c04-91d1-4862-a498-d2bd25bb734f tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] Lazy-loading 'resources' on Instance uuid 61c8082e-a4c5-47de-a239-05c10bb4c5ac {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:53:08 user nova-compute[71731]: DEBUG nova.virt.libvirt.vif [None req-1f598c04-91d1-4862-a498-d2bd25bb734f tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T16:51:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1617630502',display_name='tempest-VolumesActionsTest-instance-1617630502',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1617630502',id=41,image_ref='708622a9-7465-4492-ade8-b827198f7e30',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-13T16:51:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d099f58565de44fba2df173a2bdb3019',ramdisk_id='',reservation_id='r-e2dsggzx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='708622a9-7465-4492-ade8-b827198f7e30',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-450740344',owner_user_name='tempest-VolumesActionsTest-450740344-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T16:51:24Z,user_data=None,user_id='5051bef91062494f991ee96a93c9dc6a',uuid=61c8082e-a4c5-47de-a239-05c10bb4c5ac,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2366235b-52e8-49ab-8a64-f961015f5bec", "address": "fa:16:3e:f0:11:62", "network": {"id": "b742fa77-3781-46be-8a60-11bf61969238", "bridge": "br-int", "label": "tempest-VolumesActionsTest-204183032-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "d099f58565de44fba2df173a2bdb3019", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2366235b-52", "ovs_interfaceid": "2366235b-52e8-49ab-8a64-f961015f5bec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 16:53:08 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-1f598c04-91d1-4862-a498-d2bd25bb734f tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] Converting VIF {"id": "2366235b-52e8-49ab-8a64-f961015f5bec", "address": "fa:16:3e:f0:11:62", "network": {"id": "b742fa77-3781-46be-8a60-11bf61969238", "bridge": "br-int", "label": "tempest-VolumesActionsTest-204183032-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "d099f58565de44fba2df173a2bdb3019", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2366235b-52", "ovs_interfaceid": "2366235b-52e8-49ab-8a64-f961015f5bec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 16:53:08 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-1f598c04-91d1-4862-a498-d2bd25bb734f tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f0:11:62,bridge_name='br-int',has_traffic_filtering=True,id=2366235b-52e8-49ab-8a64-f961015f5bec,network=Network(b742fa77-3781-46be-8a60-11bf61969238),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2366235b-52') {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 16:53:08 user nova-compute[71731]: DEBUG os_vif [None req-1f598c04-91d1-4862-a498-d2bd25bb734f tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:11:62,bridge_name='br-int',has_traffic_filtering=True,id=2366235b-52e8-49ab-8a64-f961015f5bec,network=Network(b742fa77-3781-46be-8a60-11bf61969238),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2366235b-52') {{(pid=71731) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 16:53:08 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:53:08 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2366235b-52, bridge=br-int, if_exists=True) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:53:08 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:53:08 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 16:53:08 user nova-compute[71731]: INFO os_vif [None req-1f598c04-91d1-4862-a498-d2bd25bb734f tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:11:62,bridge_name='br-int',has_traffic_filtering=True,id=2366235b-52e8-49ab-8a64-f961015f5bec,network=Network(b742fa77-3781-46be-8a60-11bf61969238),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2366235b-52')
Apr 13 16:53:08 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-1f598c04-91d1-4862-a498-d2bd25bb734f tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] [instance: 61c8082e-a4c5-47de-a239-05c10bb4c5ac] Deleting instance files /opt/stack/data/nova/instances/61c8082e-a4c5-47de-a239-05c10bb4c5ac_del
Apr 13 16:53:08 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-1f598c04-91d1-4862-a498-d2bd25bb734f tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] [instance: 61c8082e-a4c5-47de-a239-05c10bb4c5ac] Deletion of /opt/stack/data/nova/instances/61c8082e-a4c5-47de-a239-05c10bb4c5ac_del complete
Apr 13 16:53:08 user nova-compute[71731]: INFO nova.compute.manager [None req-1f598c04-91d1-4862-a498-d2bd25bb734f tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] [instance: 61c8082e-a4c5-47de-a239-05c10bb4c5ac] Took 0.69 seconds to destroy the instance on the hypervisor.
Apr 13 16:53:08 user nova-compute[71731]: DEBUG oslo.service.loopingcall [None req-1f598c04-91d1-4862-a498-d2bd25bb734f tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71731) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 16:53:08 user nova-compute[71731]: DEBUG nova.compute.manager [-] [instance: 61c8082e-a4c5-47de-a239-05c10bb4c5ac] Deallocating network for instance {{(pid=71731) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 16:53:08 user nova-compute[71731]: DEBUG nova.network.neutron [-] [instance: 61c8082e-a4c5-47de-a239-05c10bb4c5ac] deallocate_for_instance() {{(pid=71731) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 16:53:09 user nova-compute[71731]: DEBUG nova.network.neutron [-] [instance: 61c8082e-a4c5-47de-a239-05c10bb4c5ac] Updating instance_info_cache with network_info: [] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:53:09 user nova-compute[71731]: INFO nova.compute.manager [-] [instance: 61c8082e-a4c5-47de-a239-05c10bb4c5ac] Took 0.48 seconds to deallocate network for instance.
Apr 13 16:53:09 user nova-compute[71731]: DEBUG nova.compute.manager [req-69243293-0af1-486d-bf36-89caf8c4371d req-cc66958b-6dc3-468b-9495-df37d788ebf3 service nova] [instance: 61c8082e-a4c5-47de-a239-05c10bb4c5ac] Received event network-vif-deleted-2366235b-52e8-49ab-8a64-f961015f5bec {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:53:09 user nova-compute[71731]: INFO nova.compute.manager [req-69243293-0af1-486d-bf36-89caf8c4371d req-cc66958b-6dc3-468b-9495-df37d788ebf3 service nova] [instance: 61c8082e-a4c5-47de-a239-05c10bb4c5ac] Neutron deleted interface 2366235b-52e8-49ab-8a64-f961015f5bec; detaching it from the instance and deleting it from the info cache
Apr 13 16:53:09 user nova-compute[71731]: DEBUG nova.network.neutron [req-69243293-0af1-486d-bf36-89caf8c4371d req-cc66958b-6dc3-468b-9495-df37d788ebf3 service nova] [instance: 61c8082e-a4c5-47de-a239-05c10bb4c5ac] Updating instance_info_cache with network_info: [] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:53:09 user nova-compute[71731]: DEBUG nova.compute.manager [req-69243293-0af1-486d-bf36-89caf8c4371d req-cc66958b-6dc3-468b-9495-df37d788ebf3 service nova] [instance: 61c8082e-a4c5-47de-a239-05c10bb4c5ac] Detach interface failed, port_id=2366235b-52e8-49ab-8a64-f961015f5bec, reason: Instance 61c8082e-a4c5-47de-a239-05c10bb4c5ac could not be found. {{(pid=71731) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 13 16:53:09 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-1f598c04-91d1-4862-a498-d2bd25bb734f tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:53:09 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-1f598c04-91d1-4862-a498-d2bd25bb734f tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:53:09 user nova-compute[71731]: DEBUG nova.compute.provider_tree [None req-1f598c04-91d1-4862-a498-d2bd25bb734f tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] Inventory has not changed in ProviderTree for provider: cb6b1a64-0c24-4e2d-af1e-16576ca9165c {{(pid=71731) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 16:53:09 user nova-compute[71731]: DEBUG nova.scheduler.client.report [None req-1f598c04-91d1-4862-a498-d2bd25bb734f tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] Inventory has not changed for provider cb6b1a64-0c24-4e2d-af1e-16576ca9165c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71731) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 16:53:09 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-1f598c04-91d1-4862-a498-d2bd25bb734f tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.191s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:53:09 user nova-compute[71731]: INFO nova.scheduler.client.report [None req-1f598c04-91d1-4862-a498-d2bd25bb734f tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] Deleted allocations for instance 61c8082e-a4c5-47de-a239-05c10bb4c5ac
Apr 13 16:53:09 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-1f598c04-91d1-4862-a498-d2bd25bb734f tempest-VolumesActionsTest-450740344 tempest-VolumesActionsTest-450740344-project-member] Lock "61c8082e-a4c5-47de-a239-05c10bb4c5ac" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.844s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:53:10 user nova-compute[71731]: DEBUG nova.compute.manager [req-39defff9-ed2f-4d42-8b07-1c4fb51ab9ac req-913f0fde-33d2-4dd2-afcf-2f031b4f4f20 service nova] [instance: 61c8082e-a4c5-47de-a239-05c10bb4c5ac] Received event network-vif-plugged-2366235b-52e8-49ab-8a64-f961015f5bec {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:53:10 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-39defff9-ed2f-4d42-8b07-1c4fb51ab9ac req-913f0fde-33d2-4dd2-afcf-2f031b4f4f20 service nova] Acquiring lock "61c8082e-a4c5-47de-a239-05c10bb4c5ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:53:10 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-39defff9-ed2f-4d42-8b07-1c4fb51ab9ac req-913f0fde-33d2-4dd2-afcf-2f031b4f4f20 service nova] Lock "61c8082e-a4c5-47de-a239-05c10bb4c5ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:53:10 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-39defff9-ed2f-4d42-8b07-1c4fb51ab9ac req-913f0fde-33d2-4dd2-afcf-2f031b4f4f20 service nova] Lock "61c8082e-a4c5-47de-a239-05c10bb4c5ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:53:10 user nova-compute[71731]: DEBUG nova.compute.manager [req-39defff9-ed2f-4d42-8b07-1c4fb51ab9ac req-913f0fde-33d2-4dd2-afcf-2f031b4f4f20 service nova] [instance: 61c8082e-a4c5-47de-a239-05c10bb4c5ac] No waiting events found dispatching network-vif-plugged-2366235b-52e8-49ab-8a64-f961015f5bec {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:53:10 user nova-compute[71731]: WARNING nova.compute.manager [req-39defff9-ed2f-4d42-8b07-1c4fb51ab9ac req-913f0fde-33d2-4dd2-afcf-2f031b4f4f20 service nova] [instance: 61c8082e-a4c5-47de-a239-05c10bb4c5ac] Received unexpected event network-vif-plugged-2366235b-52e8-49ab-8a64-f961015f5bec for instance with vm_state deleted and task_state None.
Apr 13 16:53:13 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:53:13 user nova-compute[71731]: INFO nova.compute.manager [None req-e441d8ae-eaec-4bee-a538-3506eaf69806 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] [instance: 37a39f40-d239-4716-91bc-3f562906bd1e] Unrescuing
Apr 13 16:53:13 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-e441d8ae-eaec-4bee-a538-3506eaf69806 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Acquiring lock "refresh_cache-37a39f40-d239-4716-91bc-3f562906bd1e" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 16:53:13 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-e441d8ae-eaec-4bee-a538-3506eaf69806 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Acquired lock "refresh_cache-37a39f40-d239-4716-91bc-3f562906bd1e" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 16:53:13 user nova-compute[71731]: DEBUG nova.network.neutron [None req-e441d8ae-eaec-4bee-a538-3506eaf69806 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] [instance: 37a39f40-d239-4716-91bc-3f562906bd1e] Building network info cache for instance {{(pid=71731) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 16:53:14 user nova-compute[71731]: DEBUG nova.network.neutron [None req-e441d8ae-eaec-4bee-a538-3506eaf69806 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] [instance: 37a39f40-d239-4716-91bc-3f562906bd1e] Updating instance_info_cache with network_info: [{"id": "86b0ae4e-a317-4c75-9033-49325a4399d2", "address": "fa:16:3e:14:4c:bc", "network": {"id": "2a5b69f1-fc5b-4c33-a9eb-12a4d9293500", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2137344591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "846732ecb7e047128b4684972d3cd8c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86b0ae4e-a3", "ovs_interfaceid": "86b0ae4e-a317-4c75-9033-49325a4399d2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:53:14 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-e441d8ae-eaec-4bee-a538-3506eaf69806 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Releasing lock "refresh_cache-37a39f40-d239-4716-91bc-3f562906bd1e" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 16:53:14 user nova-compute[71731]: DEBUG nova.objects.instance [None req-e441d8ae-eaec-4bee-a538-3506eaf69806 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lazy-loading 'flavor' on Instance uuid 37a39f40-d239-4716-91bc-3f562906bd1e {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:53:14 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:53:14 user nova-compute[71731]: DEBUG nova.compute.manager [req-ba287e0c-033e-4311-8783-4fe2551b5be6 req-2375e220-d321-4cdf-9a26-0ce8e6441b20 service nova] [instance: 37a39f40-d239-4716-91bc-3f562906bd1e] Received event network-vif-unplugged-86b0ae4e-a317-4c75-9033-49325a4399d2 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:53:14 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-ba287e0c-033e-4311-8783-4fe2551b5be6 req-2375e220-d321-4cdf-9a26-0ce8e6441b20 service nova] Acquiring lock "37a39f40-d239-4716-91bc-3f562906bd1e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:53:14 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-ba287e0c-033e-4311-8783-4fe2551b5be6 req-2375e220-d321-4cdf-9a26-0ce8e6441b20 service nova] Lock "37a39f40-d239-4716-91bc-3f562906bd1e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:53:14 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-ba287e0c-033e-4311-8783-4fe2551b5be6 req-2375e220-d321-4cdf-9a26-0ce8e6441b20 service nova] Lock "37a39f40-d239-4716-91bc-3f562906bd1e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:53:14 user nova-compute[71731]: DEBUG nova.compute.manager [req-ba287e0c-033e-4311-8783-4fe2551b5be6 req-2375e220-d321-4cdf-9a26-0ce8e6441b20 service nova] [instance: 37a39f40-d239-4716-91bc-3f562906bd1e] No waiting events found dispatching network-vif-unplugged-86b0ae4e-a317-4c75-9033-49325a4399d2 {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:53:14 user nova-compute[71731]: WARNING nova.compute.manager [req-ba287e0c-033e-4311-8783-4fe2551b5be6 req-2375e220-d321-4cdf-9a26-0ce8e6441b20 service nova] [instance: 37a39f40-d239-4716-91bc-3f562906bd1e] Received unexpected event network-vif-unplugged-86b0ae4e-a317-4c75-9033-49325a4399d2 for instance with vm_state rescued and task_state unrescuing.
Apr 13 16:53:14 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:53:14 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:53:14 user nova-compute[71731]: INFO nova.virt.libvirt.driver [-] [instance: 37a39f40-d239-4716-91bc-3f562906bd1e] Instance destroyed successfully.
Apr 13 16:53:16 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:53:16 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:53:16 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:53:16 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:53:16 user nova-compute[71731]: DEBUG nova.compute.manager [req-802b3323-cb9c-48d1-a6d3-2497e0daa037 req-2cb53de1-499a-4a57-8b35-f85425890ef0 service nova] [instance: 37a39f40-d239-4716-91bc-3f562906bd1e] Received event network-vif-plugged-86b0ae4e-a317-4c75-9033-49325a4399d2 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:53:16 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-802b3323-cb9c-48d1-a6d3-2497e0daa037 req-2cb53de1-499a-4a57-8b35-f85425890ef0 service nova] Acquiring lock "37a39f40-d239-4716-91bc-3f562906bd1e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:53:16 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-802b3323-cb9c-48d1-a6d3-2497e0daa037 req-2cb53de1-499a-4a57-8b35-f85425890ef0 service nova] Lock "37a39f40-d239-4716-91bc-3f562906bd1e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:53:16 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-802b3323-cb9c-48d1-a6d3-2497e0daa037 req-2cb53de1-499a-4a57-8b35-f85425890ef0 service nova] Lock "37a39f40-d239-4716-91bc-3f562906bd1e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:53:16 user nova-compute[71731]: DEBUG nova.compute.manager [req-802b3323-cb9c-48d1-a6d3-2497e0daa037 req-2cb53de1-499a-4a57-8b35-f85425890ef0 service nova] [instance: 37a39f40-d239-4716-91bc-3f562906bd1e] No waiting events found dispatching network-vif-plugged-86b0ae4e-a317-4c75-9033-49325a4399d2 {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:53:16 user nova-compute[71731]: WARNING nova.compute.manager [req-802b3323-cb9c-48d1-a6d3-2497e0daa037 req-2cb53de1-499a-4a57-8b35-f85425890ef0 service nova] [instance: 37a39f40-d239-4716-91bc-3f562906bd1e] Received unexpected event network-vif-plugged-86b0ae4e-a317-4c75-9033-49325a4399d2 for instance with vm_state rescued and task_state unrescuing.
Apr 13 16:53:17 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:53:18 user nova-compute[71731]: DEBUG nova.virt.libvirt.host [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Removed pending event for 37a39f40-d239-4716-91bc-3f562906bd1e due to event {{(pid=71731) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 13 16:53:18 user nova-compute[71731]: DEBUG nova.virt.driver [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Emitting event <LifecycleEvent: 1681404798.4568722, 37a39f40-d239-4716-91bc-3f562906bd1e => Resumed> {{(pid=71731) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 16:53:18 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 37a39f40-d239-4716-91bc-3f562906bd1e] VM Resumed (Lifecycle Event)
Apr 13 16:53:18 user nova-compute[71731]: DEBUG nova.compute.manager [None req-e441d8ae-eaec-4bee-a538-3506eaf69806 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] [instance: 37a39f40-d239-4716-91bc-3f562906bd1e] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:53:18 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 37a39f40-d239-4716-91bc-3f562906bd1e] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:53:18 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 37a39f40-d239-4716-91bc-3f562906bd1e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71731) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 16:53:18 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 37a39f40-d239-4716-91bc-3f562906bd1e] During sync_power_state the instance has a pending task (unrescuing). Skip.
Apr 13 16:53:18 user nova-compute[71731]: DEBUG nova.virt.driver [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Emitting event <LifecycleEvent: 1681404798.4599729, 37a39f40-d239-4716-91bc-3f562906bd1e => Started> {{(pid=71731) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 16:53:18 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 37a39f40-d239-4716-91bc-3f562906bd1e] VM Started (Lifecycle Event)
Apr 13 16:53:18 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:53:18 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 37a39f40-d239-4716-91bc-3f562906bd1e] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:53:18 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 37a39f40-d239-4716-91bc-3f562906bd1e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71731) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 16:53:18 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 37a39f40-d239-4716-91bc-3f562906bd1e] During sync_power_state the instance has a pending task (unrescuing). Skip.
Apr 13 16:53:18 user nova-compute[71731]: DEBUG nova.compute.manager [req-c43e6d06-af4a-4b48-af92-aacd551a8202 req-383a4921-0e39-44cd-996b-8fa8a8783574 service nova] [instance: 37a39f40-d239-4716-91bc-3f562906bd1e] Received event network-vif-plugged-86b0ae4e-a317-4c75-9033-49325a4399d2 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:53:18 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-c43e6d06-af4a-4b48-af92-aacd551a8202 req-383a4921-0e39-44cd-996b-8fa8a8783574 service nova] Acquiring lock "37a39f40-d239-4716-91bc-3f562906bd1e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:53:18 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-c43e6d06-af4a-4b48-af92-aacd551a8202 req-383a4921-0e39-44cd-996b-8fa8a8783574 service nova] Lock "37a39f40-d239-4716-91bc-3f562906bd1e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:53:18 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-c43e6d06-af4a-4b48-af92-aacd551a8202 req-383a4921-0e39-44cd-996b-8fa8a8783574 service nova] Lock "37a39f40-d239-4716-91bc-3f562906bd1e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:53:18 user nova-compute[71731]: DEBUG nova.compute.manager [req-c43e6d06-af4a-4b48-af92-aacd551a8202 req-383a4921-0e39-44cd-996b-8fa8a8783574 service nova] [instance: 37a39f40-d239-4716-91bc-3f562906bd1e] No waiting events found dispatching network-vif-plugged-86b0ae4e-a317-4c75-9033-49325a4399d2 {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:53:18 user nova-compute[71731]: WARNING nova.compute.manager [req-c43e6d06-af4a-4b48-af92-aacd551a8202 req-383a4921-0e39-44cd-996b-8fa8a8783574 service nova] [instance: 37a39f40-d239-4716-91bc-3f562906bd1e] Received unexpected event network-vif-plugged-86b0ae4e-a317-4c75-9033-49325a4399d2 for instance with vm_state active and task_state None.
Apr 13 16:53:18 user nova-compute[71731]: DEBUG nova.compute.manager [req-c43e6d06-af4a-4b48-af92-aacd551a8202 req-383a4921-0e39-44cd-996b-8fa8a8783574 service nova] [instance: 37a39f40-d239-4716-91bc-3f562906bd1e] Received event network-vif-plugged-86b0ae4e-a317-4c75-9033-49325a4399d2 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:53:18 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-c43e6d06-af4a-4b48-af92-aacd551a8202 req-383a4921-0e39-44cd-996b-8fa8a8783574 service nova] Acquiring lock "37a39f40-d239-4716-91bc-3f562906bd1e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:53:18 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-c43e6d06-af4a-4b48-af92-aacd551a8202 req-383a4921-0e39-44cd-996b-8fa8a8783574 service nova] Lock "37a39f40-d239-4716-91bc-3f562906bd1e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:53:18 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-c43e6d06-af4a-4b48-af92-aacd551a8202 req-383a4921-0e39-44cd-996b-8fa8a8783574 service nova] Lock "37a39f40-d239-4716-91bc-3f562906bd1e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:53:18 user nova-compute[71731]: DEBUG nova.compute.manager [req-c43e6d06-af4a-4b48-af92-aacd551a8202 req-383a4921-0e39-44cd-996b-8fa8a8783574 service nova] [instance: 37a39f40-d239-4716-91bc-3f562906bd1e] No waiting events found dispatching network-vif-plugged-86b0ae4e-a317-4c75-9033-49325a4399d2 {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:53:18 user nova-compute[71731]: WARNING nova.compute.manager [req-c43e6d06-af4a-4b48-af92-aacd551a8202 req-383a4921-0e39-44cd-996b-8fa8a8783574 service nova] [instance: 37a39f40-d239-4716-91bc-3f562906bd1e] Received unexpected event network-vif-plugged-86b0ae4e-a317-4c75-9033-49325a4399d2 for instance with vm_state active and task_state None.
Apr 13 16:53:23 user nova-compute[71731]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681404788.472081, 61c8082e-a4c5-47de-a239-05c10bb4c5ac => Stopped> {{(pid=71731) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 16:53:23 user nova-compute[71731]: INFO nova.compute.manager [-] [instance: 61c8082e-a4c5-47de-a239-05c10bb4c5ac] VM Stopped (Lifecycle Event)
Apr 13 16:53:23 user nova-compute[71731]: DEBUG nova.compute.manager [None req-cbdfe73c-b626-4832-b14b-c4571ac3893c None None] [instance: 61c8082e-a4c5-47de-a239-05c10bb4c5ac] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:53:23 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 16:53:23 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:53:23 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71731) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 16:53:23 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71731) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 16:53:23 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71731) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 16:53:23 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:53:28 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:53:32 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:53:32 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:53:33 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:53:34 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:53:34 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71731) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 16:53:35 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:53:37 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager.update_available_resource {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:53:37 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:53:37 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:53:37 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:53:37 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Auditing locally available compute resources for user (node: user) {{(pid=71731) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 16:53:37 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3af23ff8-4e10-4fbf-a86e-bda842f084ff/disk.rescue --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:53:37 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3af23ff8-4e10-4fbf-a86e-bda842f084ff/disk.rescue --force-share --output=json" returned: 0 in 0.138s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:53:37 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3af23ff8-4e10-4fbf-a86e-bda842f084ff/disk.rescue --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:53:37 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:53:37 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3af23ff8-4e10-4fbf-a86e-bda842f084ff/disk.rescue --force-share --output=json" returned: 0 in 0.136s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:53:37 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3af23ff8-4e10-4fbf-a86e-bda842f084ff/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:53:37 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3af23ff8-4e10-4fbf-a86e-bda842f084ff/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:53:37 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3af23ff8-4e10-4fbf-a86e-bda842f084ff/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:53:37 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3af23ff8-4e10-4fbf-a86e-bda842f084ff/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:53:37 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37a39f40-d239-4716-91bc-3f562906bd1e/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:53:37 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37a39f40-d239-4716-91bc-3f562906bd1e/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:53:37 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37a39f40-d239-4716-91bc-3f562906bd1e/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:53:38 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37a39f40-d239-4716-91bc-3f562906bd1e/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:53:38 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=71731) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 16:53:38 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2d55cdd-c89c-4c59-afe1-49a33225af22/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:53:38 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2d55cdd-c89c-4c59-afe1-49a33225af22/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:53:38 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2d55cdd-c89c-4c59-afe1-49a33225af22/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:53:38 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2d55cdd-c89c-4c59-afe1-49a33225af22/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:53:38 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:53:38 user nova-compute[71731]: WARNING nova.virt.libvirt.driver [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 16:53:38 user nova-compute[71731]: WARNING nova.virt.libvirt.driver [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 16:53:38 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Hypervisor/Node resource view: name=user free_ram=8516MB free_disk=26.067279815673828GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71731) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 16:53:38 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:53:38 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:53:38 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance b2d55cdd-c89c-4c59-afe1-49a33225af22 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 16:53:38 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance 3af23ff8-4e10-4fbf-a86e-bda842f084ff actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 16:53:38 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance 37a39f40-d239-4716-91bc-3f562906bd1e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 16:53:38 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=71731) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 16:53:38 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Final resource view: name=user phys_ram=16023MB used_ram=896MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=71731) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 16:53:39 user nova-compute[71731]: DEBUG nova.compute.provider_tree [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Inventory has not changed in ProviderTree for provider: cb6b1a64-0c24-4e2d-af1e-16576ca9165c {{(pid=71731) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 16:53:39 user nova-compute[71731]: DEBUG nova.scheduler.client.report [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Inventory has not changed for provider cb6b1a64-0c24-4e2d-af1e-16576ca9165c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71731) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 16:53:39 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Compute_service record updated for user:user {{(pid=71731) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 16:53:39 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.373s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:53:42 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:53:42 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:53:42 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Starting heal instance info cache {{(pid=71731) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 16:53:42 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Rebuilding the list of instances to heal {{(pid=71731) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 13 16:53:42 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Acquiring lock "refresh_cache-b2d55cdd-c89c-4c59-afe1-49a33225af22" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 16:53:42 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Acquired lock "refresh_cache-b2d55cdd-c89c-4c59-afe1-49a33225af22" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 16:53:42 user nova-compute[71731]: DEBUG nova.network.neutron [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] [instance: b2d55cdd-c89c-4c59-afe1-49a33225af22] Forcefully refreshing network info cache for instance {{(pid=71731) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 16:53:42 user nova-compute[71731]: DEBUG nova.objects.instance [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lazy-loading 'info_cache' on Instance uuid b2d55cdd-c89c-4c59-afe1-49a33225af22 {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:53:42 user nova-compute[71731]: DEBUG nova.network.neutron [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] [instance: b2d55cdd-c89c-4c59-afe1-49a33225af22] Updating instance_info_cache with network_info: [{"id": "31e1957f-9bd1-42ae-a2ac-954b49ca15f1", "address": "fa:16:3e:81:e2:10", "network": {"id": "2a5b69f1-fc5b-4c33-a9eb-12a4d9293500", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2137344591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "846732ecb7e047128b4684972d3cd8c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31e1957f-9b", "ovs_interfaceid": "31e1957f-9bd1-42ae-a2ac-954b49ca15f1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:53:42 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Releasing lock "refresh_cache-b2d55cdd-c89c-4c59-afe1-49a33225af22" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 16:53:42 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] [instance: b2d55cdd-c89c-4c59-afe1-49a33225af22] Updated the network info_cache for instance {{(pid=71731) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 16:53:42 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:53:42 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:53:43 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:53:43 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 16:53:43 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:53:43 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71731) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 16:53:43 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71731) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 16:53:43 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71731) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 16:53:43 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:53:47 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:53:48 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:53:53 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 16:53:58 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 16:53:58 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:53:58 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71731) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 16:53:58 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71731) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 16:53:58 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71731) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 16:53:58 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 16:54:02 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:54:03 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:54:08 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 16:54:08 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:54:08 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71731) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 16:54:08 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71731) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 16:54:08 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71731) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 16:54:08 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:54:13 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:54:18 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:54:23 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:54:26 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:54:27 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:54:28 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:54:32 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:54:33 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:54:34 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:54:35 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:54:35 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71731) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 16:54:36 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:54:38 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 16:54:38 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:54:38 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71731) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 16:54:38 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71731) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 16:54:38 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71731) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 16:54:38 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:54:39 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager.update_available_resource {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:54:39 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:54:39 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:54:39 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:54:39 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Auditing locally available compute resources for user (node: user) {{(pid=71731) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 16:54:39 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3af23ff8-4e10-4fbf-a86e-bda842f084ff/disk.rescue --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:54:39 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3af23ff8-4e10-4fbf-a86e-bda842f084ff/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:54:39 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3af23ff8-4e10-4fbf-a86e-bda842f084ff/disk.rescue --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:54:39 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3af23ff8-4e10-4fbf-a86e-bda842f084ff/disk.rescue --force-share --output=json" returned: 0 in 0.141s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:54:39 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3af23ff8-4e10-4fbf-a86e-bda842f084ff/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:54:39 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3af23ff8-4e10-4fbf-a86e-bda842f084ff/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:54:39 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3af23ff8-4e10-4fbf-a86e-bda842f084ff/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:54:39 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3af23ff8-4e10-4fbf-a86e-bda842f084ff/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:54:39 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37a39f40-d239-4716-91bc-3f562906bd1e/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:54:39 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37a39f40-d239-4716-91bc-3f562906bd1e/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:54:39 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37a39f40-d239-4716-91bc-3f562906bd1e/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:54:40 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37a39f40-d239-4716-91bc-3f562906bd1e/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:54:40 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=71731) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 16:54:40 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2d55cdd-c89c-4c59-afe1-49a33225af22/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:54:40 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2d55cdd-c89c-4c59-afe1-49a33225af22/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:54:40 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2d55cdd-c89c-4c59-afe1-49a33225af22/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:54:40 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2d55cdd-c89c-4c59-afe1-49a33225af22/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:54:41 user nova-compute[71731]: WARNING nova.virt.libvirt.driver [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 16:54:41 user nova-compute[71731]: WARNING nova.virt.libvirt.driver [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 16:54:41 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Hypervisor/Node resource view: name=user free_ram=8578MB free_disk=26.06554412841797GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71731) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 16:54:41 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:54:41 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:54:41 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance b2d55cdd-c89c-4c59-afe1-49a33225af22 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 16:54:41 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance 3af23ff8-4e10-4fbf-a86e-bda842f084ff actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 16:54:41 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance 37a39f40-d239-4716-91bc-3f562906bd1e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 16:54:41 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=71731) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 16:54:41 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Final resource view: name=user phys_ram=16023MB used_ram=896MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=71731) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 16:54:41 user nova-compute[71731]: DEBUG nova.compute.provider_tree [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Inventory has not changed in ProviderTree for provider: cb6b1a64-0c24-4e2d-af1e-16576ca9165c {{(pid=71731) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 16:54:41 user nova-compute[71731]: DEBUG nova.scheduler.client.report [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Inventory has not changed for provider cb6b1a64-0c24-4e2d-af1e-16576ca9165c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71731) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 16:54:41 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Compute_service record updated for user:user {{(pid=71731) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 16:54:41 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.238s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:54:42 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:54:42 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:54:42 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Starting heal instance info cache {{(pid=71731) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 16:54:42 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Acquiring lock "refresh_cache-3af23ff8-4e10-4fbf-a86e-bda842f084ff" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 16:54:42 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Acquired lock "refresh_cache-3af23ff8-4e10-4fbf-a86e-bda842f084ff" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 16:54:42 user nova-compute[71731]: DEBUG nova.network.neutron [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] [instance: 3af23ff8-4e10-4fbf-a86e-bda842f084ff] Forcefully refreshing network info cache for instance {{(pid=71731) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 16:54:43 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:54:43 user nova-compute[71731]: DEBUG nova.network.neutron [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] [instance: 3af23ff8-4e10-4fbf-a86e-bda842f084ff] Updating instance_info_cache with network_info: [{"id": "b22086e3-8769-494c-af86-228dba7b3638", "address": "fa:16:3e:84:ee:e5", "network": {"id": "2a5b69f1-fc5b-4c33-a9eb-12a4d9293500", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2137344591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "846732ecb7e047128b4684972d3cd8c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb22086e3-87", "ovs_interfaceid": "b22086e3-8769-494c-af86-228dba7b3638", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:54:43 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Releasing lock "refresh_cache-3af23ff8-4e10-4fbf-a86e-bda842f084ff" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 16:54:43 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] [instance: 3af23ff8-4e10-4fbf-a86e-bda842f084ff] Updated the network info_cache for instance {{(pid=71731) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 16:54:43 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:54:43 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:54:43 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:54:44 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:54:45 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:54:47 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:54:48 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:54:49 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:54:51 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:54:52 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:54:53 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:54:55 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:54:55 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-0adfe3be-b106-4c9a-984c-ecd07fb321c9 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Acquiring lock "e048d6f6-f6aa-4491-ae06-9e22a8ff6691" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:54:55 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-0adfe3be-b106-4c9a-984c-ecd07fb321c9 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lock "e048d6f6-f6aa-4491-ae06-9e22a8ff6691" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:54:55 user nova-compute[71731]: DEBUG nova.compute.manager [None req-0adfe3be-b106-4c9a-984c-ecd07fb321c9 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] [instance: e048d6f6-f6aa-4491-ae06-9e22a8ff6691] Starting instance... {{(pid=71731) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 16:54:55 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-0adfe3be-b106-4c9a-984c-ecd07fb321c9 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:54:55 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-0adfe3be-b106-4c9a-984c-ecd07fb321c9 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:54:55 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-0adfe3be-b106-4c9a-984c-ecd07fb321c9 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71731) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 16:54:55 user nova-compute[71731]: INFO nova.compute.claims [None req-0adfe3be-b106-4c9a-984c-ecd07fb321c9 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] [instance: e048d6f6-f6aa-4491-ae06-9e22a8ff6691] Claim successful on node user
Apr 13 16:54:55 user nova-compute[71731]: DEBUG nova.compute.provider_tree [None req-0adfe3be-b106-4c9a-984c-ecd07fb321c9 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Inventory has not changed in ProviderTree for provider: cb6b1a64-0c24-4e2d-af1e-16576ca9165c {{(pid=71731) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 16:54:55 user nova-compute[71731]: DEBUG nova.scheduler.client.report [None req-0adfe3be-b106-4c9a-984c-ecd07fb321c9 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Inventory has not changed for provider cb6b1a64-0c24-4e2d-af1e-16576ca9165c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71731) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 16:54:55 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-0adfe3be-b106-4c9a-984c-ecd07fb321c9 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.250s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:54:55 user nova-compute[71731]: DEBUG nova.compute.manager [None req-0adfe3be-b106-4c9a-984c-ecd07fb321c9 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] [instance: e048d6f6-f6aa-4491-ae06-9e22a8ff6691] Start building networks asynchronously for instance. {{(pid=71731) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 16:54:55 user nova-compute[71731]: DEBUG nova.compute.manager [None req-0adfe3be-b106-4c9a-984c-ecd07fb321c9 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] [instance: e048d6f6-f6aa-4491-ae06-9e22a8ff6691] Allocating IP information in the background. {{(pid=71731) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 16:54:55 user nova-compute[71731]: DEBUG nova.network.neutron [None req-0adfe3be-b106-4c9a-984c-ecd07fb321c9 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] [instance: e048d6f6-f6aa-4491-ae06-9e22a8ff6691] allocate_for_instance() {{(pid=71731) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 16:54:55 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-0adfe3be-b106-4c9a-984c-ecd07fb321c9 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] [instance: e048d6f6-f6aa-4491-ae06-9e22a8ff6691] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 16:54:55 user nova-compute[71731]: DEBUG nova.compute.manager [None req-0adfe3be-b106-4c9a-984c-ecd07fb321c9 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] [instance: e048d6f6-f6aa-4491-ae06-9e22a8ff6691] Start building block device mappings for instance. {{(pid=71731) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 16:54:55 user nova-compute[71731]: DEBUG nova.policy [None req-0adfe3be-b106-4c9a-984c-ecd07fb321c9 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '91a450674d7046ae82f5dd182506c85b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7edf468527d84954a943bb4c1f7ff54d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71731) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 16:54:55 user nova-compute[71731]: DEBUG nova.compute.manager [None req-0adfe3be-b106-4c9a-984c-ecd07fb321c9 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] [instance: e048d6f6-f6aa-4491-ae06-9e22a8ff6691] Start spawning the instance on the hypervisor. {{(pid=71731) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 16:54:55 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-0adfe3be-b106-4c9a-984c-ecd07fb321c9 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] [instance: e048d6f6-f6aa-4491-ae06-9e22a8ff6691] Creating instance directory {{(pid=71731) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 16:54:55 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-0adfe3be-b106-4c9a-984c-ecd07fb321c9 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] [instance: e048d6f6-f6aa-4491-ae06-9e22a8ff6691] Creating image(s)
Apr 13 16:54:55 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-0adfe3be-b106-4c9a-984c-ecd07fb321c9 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Acquiring lock "/opt/stack/data/nova/instances/e048d6f6-f6aa-4491-ae06-9e22a8ff6691/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:54:55 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-0adfe3be-b106-4c9a-984c-ecd07fb321c9 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lock "/opt/stack/data/nova/instances/e048d6f6-f6aa-4491-ae06-9e22a8ff6691/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:54:55 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-0adfe3be-b106-4c9a-984c-ecd07fb321c9 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lock "/opt/stack/data/nova/instances/e048d6f6-f6aa-4491-ae06-9e22a8ff6691/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:54:55 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-0adfe3be-b106-4c9a-984c-ecd07fb321c9 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Acquiring lock "fa7c6a0f960510af81481294f43b184e85fb013f" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:54:55 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-0adfe3be-b106-4c9a-984c-ecd07fb321c9 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lock "fa7c6a0f960510af81481294f43b184e85fb013f" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:54:56 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-0adfe3be-b106-4c9a-984c-ecd07fb321c9 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa7c6a0f960510af81481294f43b184e85fb013f.part --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:54:56 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-0adfe3be-b106-4c9a-984c-ecd07fb321c9 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa7c6a0f960510af81481294f43b184e85fb013f.part --force-share --output=json" returned: 0 in 0.147s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:54:56 user nova-compute[71731]: DEBUG nova.virt.images [None req-0adfe3be-b106-4c9a-984c-ecd07fb321c9 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] e81308c1-1e9d-43bf-bd21-d6a7d7856ff1 was qcow2, converting to raw {{(pid=71731) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 13 16:54:56 user nova-compute[71731]: DEBUG nova.privsep.utils [None req-0adfe3be-b106-4c9a-984c-ecd07fb321c9 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71731) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 13 16:54:56 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-0adfe3be-b106-4c9a-984c-ecd07fb321c9 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/fa7c6a0f960510af81481294f43b184e85fb013f.part /opt/stack/data/nova/instances/_base/fa7c6a0f960510af81481294f43b184e85fb013f.converted {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:54:56 user nova-compute[71731]: DEBUG nova.network.neutron [None req-0adfe3be-b106-4c9a-984c-ecd07fb321c9 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] [instance: e048d6f6-f6aa-4491-ae06-9e22a8ff6691] Successfully created port: 4fb36f71-2601-4c01-9eba-514f5f2af95f {{(pid=71731) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 16:54:56 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-0adfe3be-b106-4c9a-984c-ecd07fb321c9 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/fa7c6a0f960510af81481294f43b184e85fb013f.part /opt/stack/data/nova/instances/_base/fa7c6a0f960510af81481294f43b184e85fb013f.converted" returned: 0 in 0.400s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:54:56 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-0adfe3be-b106-4c9a-984c-ecd07fb321c9 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa7c6a0f960510af81481294f43b184e85fb013f.converted --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:54:56 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-0adfe3be-b106-4c9a-984c-ecd07fb321c9 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa7c6a0f960510af81481294f43b184e85fb013f.converted --force-share --output=json" returned: 0 in 0.143s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:54:56 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-0adfe3be-b106-4c9a-984c-ecd07fb321c9 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lock "fa7c6a0f960510af81481294f43b184e85fb013f" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.243s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:54:56 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-0adfe3be-b106-4c9a-984c-ecd07fb321c9 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa7c6a0f960510af81481294f43b184e85fb013f --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:54:57 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-0adfe3be-b106-4c9a-984c-ecd07fb321c9 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa7c6a0f960510af81481294f43b184e85fb013f --force-share --output=json" returned: 0 in 0.127s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:54:57 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-0adfe3be-b106-4c9a-984c-ecd07fb321c9 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Acquiring lock "fa7c6a0f960510af81481294f43b184e85fb013f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:54:57 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-0adfe3be-b106-4c9a-984c-ecd07fb321c9 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lock "fa7c6a0f960510af81481294f43b184e85fb013f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:54:57 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-0adfe3be-b106-4c9a-984c-ecd07fb321c9 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa7c6a0f960510af81481294f43b184e85fb013f --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:54:57 user nova-compute[71731]: DEBUG nova.network.neutron [None req-0adfe3be-b106-4c9a-984c-ecd07fb321c9 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] [instance: e048d6f6-f6aa-4491-ae06-9e22a8ff6691] Successfully updated port: 4fb36f71-2601-4c01-9eba-514f5f2af95f {{(pid=71731) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 16:54:57 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-0adfe3be-b106-4c9a-984c-ecd07fb321c9 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa7c6a0f960510af81481294f43b184e85fb013f --force-share --output=json" returned: 0 in 0.128s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:54:57 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-0adfe3be-b106-4c9a-984c-ecd07fb321c9 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fa7c6a0f960510af81481294f43b184e85fb013f,backing_fmt=raw /opt/stack/data/nova/instances/e048d6f6-f6aa-4491-ae06-9e22a8ff6691/disk 1073741824 {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:54:57 user nova-compute[71731]: DEBUG nova.compute.manager [req-509db3ba-04c9-43be-8fcc-d2ded13dd827 req-16c24618-d49f-4ede-a7b0-63893476e642 service nova] [instance: e048d6f6-f6aa-4491-ae06-9e22a8ff6691] Received event network-changed-4fb36f71-2601-4c01-9eba-514f5f2af95f {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:54:57 user nova-compute[71731]: DEBUG nova.compute.manager [req-509db3ba-04c9-43be-8fcc-d2ded13dd827 req-16c24618-d49f-4ede-a7b0-63893476e642 service nova] [instance: e048d6f6-f6aa-4491-ae06-9e22a8ff6691] Refreshing instance network info cache due to event network-changed-4fb36f71-2601-4c01-9eba-514f5f2af95f. {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 16:54:57 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-509db3ba-04c9-43be-8fcc-d2ded13dd827 req-16c24618-d49f-4ede-a7b0-63893476e642 service nova] Acquiring lock "refresh_cache-e048d6f6-f6aa-4491-ae06-9e22a8ff6691" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 16:54:57 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-509db3ba-04c9-43be-8fcc-d2ded13dd827 req-16c24618-d49f-4ede-a7b0-63893476e642 service nova] Acquired lock "refresh_cache-e048d6f6-f6aa-4491-ae06-9e22a8ff6691" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 16:54:57 user nova-compute[71731]: DEBUG nova.network.neutron [req-509db3ba-04c9-43be-8fcc-d2ded13dd827 req-16c24618-d49f-4ede-a7b0-63893476e642 service nova] [instance: e048d6f6-f6aa-4491-ae06-9e22a8ff6691] Refreshing network info cache for port 4fb36f71-2601-4c01-9eba-514f5f2af95f {{(pid=71731) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 16:54:57 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-0adfe3be-b106-4c9a-984c-ecd07fb321c9 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Acquiring lock "refresh_cache-e048d6f6-f6aa-4491-ae06-9e22a8ff6691" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 16:54:57 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-0adfe3be-b106-4c9a-984c-ecd07fb321c9 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fa7c6a0f960510af81481294f43b184e85fb013f,backing_fmt=raw /opt/stack/data/nova/instances/e048d6f6-f6aa-4491-ae06-9e22a8ff6691/disk 1073741824" returned: 0 in 0.056s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:54:57 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-0adfe3be-b106-4c9a-984c-ecd07fb321c9 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lock "fa7c6a0f960510af81481294f43b184e85fb013f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.187s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:54:57 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-0adfe3be-b106-4c9a-984c-ecd07fb321c9 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa7c6a0f960510af81481294f43b184e85fb013f --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:54:57 user nova-compute[71731]: DEBUG nova.network.neutron [req-509db3ba-04c9-43be-8fcc-d2ded13dd827 req-16c24618-d49f-4ede-a7b0-63893476e642 service nova] [instance: e048d6f6-f6aa-4491-ae06-9e22a8ff6691] Instance cache missing network info. {{(pid=71731) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 16:54:57 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:54:57 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-0adfe3be-b106-4c9a-984c-ecd07fb321c9 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa7c6a0f960510af81481294f43b184e85fb013f --force-share --output=json" returned: 0 in 0.155s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:54:57 user nova-compute[71731]: DEBUG nova.virt.disk.api [None req-0adfe3be-b106-4c9a-984c-ecd07fb321c9 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e048d6f6-f6aa-4491-ae06-9e22a8ff6691/disk. size=1073741824 {{(pid=71731) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 16:54:57 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-0adfe3be-b106-4c9a-984c-ecd07fb321c9 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e048d6f6-f6aa-4491-ae06-9e22a8ff6691/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:54:57 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-0adfe3be-b106-4c9a-984c-ecd07fb321c9 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e048d6f6-f6aa-4491-ae06-9e22a8ff6691/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:54:57 user nova-compute[71731]: DEBUG nova.virt.disk.api [None req-0adfe3be-b106-4c9a-984c-ecd07fb321c9 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Cannot resize image /opt/stack/data/nova/instances/e048d6f6-f6aa-4491-ae06-9e22a8ff6691/disk to a smaller size. {{(pid=71731) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 16:54:57 user nova-compute[71731]: DEBUG nova.objects.instance [None req-0adfe3be-b106-4c9a-984c-ecd07fb321c9 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lazy-loading 'migration_context' on Instance uuid e048d6f6-f6aa-4491-ae06-9e22a8ff6691 {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:54:57 user nova-compute[71731]: DEBUG nova.network.neutron [req-509db3ba-04c9-43be-8fcc-d2ded13dd827 req-16c24618-d49f-4ede-a7b0-63893476e642 service nova] [instance: e048d6f6-f6aa-4491-ae06-9e22a8ff6691] Updating instance_info_cache with network_info: [] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:54:57 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-0adfe3be-b106-4c9a-984c-ecd07fb321c9 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] [instance: e048d6f6-f6aa-4491-ae06-9e22a8ff6691] Created local disks {{(pid=71731) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 16:54:57 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-0adfe3be-b106-4c9a-984c-ecd07fb321c9 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] [instance: e048d6f6-f6aa-4491-ae06-9e22a8ff6691] Ensure instance console log exists: /opt/stack/data/nova/instances/e048d6f6-f6aa-4491-ae06-9e22a8ff6691/console.log {{(pid=71731) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 16:54:57 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-0adfe3be-b106-4c9a-984c-ecd07fb321c9 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:54:57 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-0adfe3be-b106-4c9a-984c-ecd07fb321c9 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:54:57 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-0adfe3be-b106-4c9a-984c-ecd07fb321c9 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:54:57 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-509db3ba-04c9-43be-8fcc-d2ded13dd827 req-16c24618-d49f-4ede-a7b0-63893476e642 service nova] Releasing lock "refresh_cache-e048d6f6-f6aa-4491-ae06-9e22a8ff6691" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 16:54:57 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-0adfe3be-b106-4c9a-984c-ecd07fb321c9 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Acquired lock "refresh_cache-e048d6f6-f6aa-4491-ae06-9e22a8ff6691" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 16:54:57 user nova-compute[71731]: DEBUG nova.network.neutron [None req-0adfe3be-b106-4c9a-984c-ecd07fb321c9 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] [instance: e048d6f6-f6aa-4491-ae06-9e22a8ff6691] Building network info cache for instance {{(pid=71731) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 16:54:57 user nova-compute[71731]: DEBUG nova.network.neutron [None req-0adfe3be-b106-4c9a-984c-ecd07fb321c9 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] [instance: e048d6f6-f6aa-4491-ae06-9e22a8ff6691] Instance cache missing network info. {{(pid=71731) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 16:54:57 user nova-compute[71731]: DEBUG nova.network.neutron [None req-0adfe3be-b106-4c9a-984c-ecd07fb321c9 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] [instance: e048d6f6-f6aa-4491-ae06-9e22a8ff6691] Updating instance_info_cache with network_info: [{"id": "4fb36f71-2601-4c01-9eba-514f5f2af95f", "address": "fa:16:3e:11:9f:98", "network": {"id": "0c6a5f46-e53b-4b4c-806e-b2617ba3ef35", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1984894004-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7edf468527d84954a943bb4c1f7ff54d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fb36f71-26", "ovs_interfaceid": "4fb36f71-2601-4c01-9eba-514f5f2af95f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:54:57 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-0adfe3be-b106-4c9a-984c-ecd07fb321c9 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Releasing lock "refresh_cache-e048d6f6-f6aa-4491-ae06-9e22a8ff6691" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 16:54:57 user nova-compute[71731]: DEBUG nova.compute.manager [None req-0adfe3be-b106-4c9a-984c-ecd07fb321c9 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] [instance: e048d6f6-f6aa-4491-ae06-9e22a8ff6691] Instance network_info: |[{"id": "4fb36f71-2601-4c01-9eba-514f5f2af95f", "address": "fa:16:3e:11:9f:98", "network": {"id": "0c6a5f46-e53b-4b4c-806e-b2617ba3ef35", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1984894004-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7edf468527d84954a943bb4c1f7ff54d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fb36f71-26", "ovs_interfaceid": "4fb36f71-2601-4c01-9eba-514f5f2af95f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71731) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 16:54:57 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-0adfe3be-b106-4c9a-984c-ecd07fb321c9 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] [instance: e048d6f6-f6aa-4491-ae06-9e22a8ff6691] Start _get_guest_xml network_info=[{"id": "4fb36f71-2601-4c01-9eba-514f5f2af95f", "address": "fa:16:3e:11:9f:98", "network": {"id": "0c6a5f46-e53b-4b4c-806e-b2617ba3ef35", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1984894004-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7edf468527d84954a943bb4c1f7ff54d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fb36f71-26", "ovs_interfaceid": "4fb36f71-2601-4c01-9eba-514f5f2af95f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T16:54:53Z,direct_url=<?>,disk_format='qcow2',id=e81308c1-1e9d-43bf-bd21-d6a7d7856ff1,min_disk=0,min_ram=0,name='tempest-scenario-img--1648156102',owner='7edf468527d84954a943bb4c1f7ff54d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T16:54:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'device_type': 'disk', 'encrypted': False, 'disk_bus': 'virtio', 'guest_format': None, 'encryption_options': None, 'image_id': 'e81308c1-1e9d-43bf-bd21-d6a7d7856ff1'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71731) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 16:54:57 user nova-compute[71731]: WARNING nova.virt.libvirt.driver [None req-0adfe3be-b106-4c9a-984c-ecd07fb321c9 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 16:54:57 user nova-compute[71731]: WARNING nova.virt.libvirt.driver [None req-0adfe3be-b106-4c9a-984c-ecd07fb321c9 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 16:54:57 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-0adfe3be-b106-4c9a-984c-ecd07fb321c9 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71731) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 16:54:57 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-0adfe3be-b106-4c9a-984c-ecd07fb321c9 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T16:17:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T16:54:53Z,direct_url=<?>,disk_format='qcow2',id=e81308c1-1e9d-43bf-bd21-d6a7d7856ff1,min_disk=0,min_ram=0,name='tempest-scenario-img--1648156102',owner='7edf468527d84954a943bb4c1f7ff54d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T16:54:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 16:54:57 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-0adfe3be-b106-4c9a-984c-ecd07fb321c9 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Flavor limits 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 16:54:57 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-0adfe3be-b106-4c9a-984c-ecd07fb321c9 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Image limits 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 16:54:57 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-0adfe3be-b106-4c9a-984c-ecd07fb321c9 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Flavor pref 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 16:54:57 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-0adfe3be-b106-4c9a-984c-ecd07fb321c9 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Image pref 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 16:54:57 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-0adfe3be-b106-4c9a-984c-ecd07fb321c9 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 16:54:57 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-0adfe3be-b106-4c9a-984c-ecd07fb321c9 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 16:54:57 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-0adfe3be-b106-4c9a-984c-ecd07fb321c9 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71731) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 16:54:57 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-0adfe3be-b106-4c9a-984c-ecd07fb321c9 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Got 1 possible topologies {{(pid=71731) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 16:54:57 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-0adfe3be-b106-4c9a-984c-ecd07fb321c9 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 16:54:57 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-0adfe3be-b106-4c9a-984c-ecd07fb321c9 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 16:54:57 user nova-compute[71731]: DEBUG nova.virt.libvirt.vif [None req-0adfe3be-b106-4c9a-984c-ecd07fb321c9 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T16:54:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-2141029123',display_name='tempest-TestMinimumBasicScenario-server-2141029123',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-2141029123',id=42,image_ref='e81308c1-1e9d-43bf-bd21-d6a7d7856ff1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCJeR98CrX5Pyefe/rcz7c7swHCPLDeP62HQPhZNTY1lR3svV0j4RlALHIf9UrR6zTy6O2Onfsic7sNVnaIU+KNr9U5sJ8q1nmWzQ0dRWeAumpZeD0Chk2QSpA1BLE1qxA==',key_name='tempest-TestMinimumBasicScenario-810545990',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7edf468527d84954a943bb4c1f7ff54d',ramdisk_id='',reservation_id='r-8091fn2v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e81308c1-1e9d-43bf-bd21-d6a7d7856ff1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-419032150',owner_user_name='tempest-TestMinimumBasicScenario-419032150-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T16:54:56Z,user_data=None,user_id='91a450674d7046ae82f5dd182506c85b',uuid=e048d6f6-f6aa-4491-ae06-9e22a8ff6691,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4fb36f71-2601-4c01-9eba-514f5f2af95f", "address": "fa:16:3e:11:9f:98", "network": {"id": "0c6a5f46-e53b-4b4c-806e-b2617ba3ef35", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1984894004-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7edf468527d84954a943bb4c1f7ff54d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fb36f71-26", "ovs_interfaceid": "4fb36f71-2601-4c01-9eba-514f5f2af95f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71731) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 16:54:57 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-0adfe3be-b106-4c9a-984c-ecd07fb321c9 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Converting VIF {"id": "4fb36f71-2601-4c01-9eba-514f5f2af95f", "address": "fa:16:3e:11:9f:98", "network": {"id": "0c6a5f46-e53b-4b4c-806e-b2617ba3ef35", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1984894004-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7edf468527d84954a943bb4c1f7ff54d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fb36f71-26", "ovs_interfaceid": "4fb36f71-2601-4c01-9eba-514f5f2af95f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 16:54:57 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-0adfe3be-b106-4c9a-984c-ecd07fb321c9 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:11:9f:98,bridge_name='br-int',has_traffic_filtering=True,id=4fb36f71-2601-4c01-9eba-514f5f2af95f,network=Network(0c6a5f46-e53b-4b4c-806e-b2617ba3ef35),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4fb36f71-26') {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 16:54:57 user nova-compute[71731]: DEBUG nova.objects.instance [None req-0adfe3be-b106-4c9a-984c-ecd07fb321c9 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lazy-loading 'pci_devices' on Instance uuid e048d6f6-f6aa-4491-ae06-9e22a8ff6691 {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:54:57 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-0adfe3be-b106-4c9a-984c-ecd07fb321c9 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] [instance: e048d6f6-f6aa-4491-ae06-9e22a8ff6691] End _get_guest_xml xml=<domain type="kvm">
Apr 13 16:54:57 user nova-compute[71731]:   <uuid>e048d6f6-f6aa-4491-ae06-9e22a8ff6691</uuid>
Apr 13 16:54:57 user nova-compute[71731]:   <name>instance-0000002a</name>
Apr 13 16:54:57 user nova-compute[71731]:   <memory>131072</memory>
Apr 13 16:54:57 user nova-compute[71731]:   <vcpu>1</vcpu>
Apr 13 16:54:57 user nova-compute[71731]:   <metadata>
Apr 13 16:54:57 user nova-compute[71731]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 16:54:57 user nova-compute[71731]:       <nova:package version="0.0.0"/>
Apr 13 16:54:57 user nova-compute[71731]:       <nova:name>tempest-TestMinimumBasicScenario-server-2141029123</nova:name>
Apr 13 16:54:57 user nova-compute[71731]:       <nova:creationTime>2023-04-13 16:54:57</nova:creationTime>
Apr 13 16:54:57 user nova-compute[71731]:       <nova:flavor name="m1.nano">
Apr 13 16:54:57 user nova-compute[71731]:         <nova:memory>128</nova:memory>
Apr 13 16:54:57 user nova-compute[71731]:         <nova:disk>1</nova:disk>
Apr 13 16:54:57 user nova-compute[71731]:         <nova:swap>0</nova:swap>
Apr 13 16:54:57 user nova-compute[71731]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 16:54:57 user nova-compute[71731]:         <nova:vcpus>1</nova:vcpus>
Apr 13 16:54:57 user nova-compute[71731]:       </nova:flavor>
Apr 13 16:54:57 user nova-compute[71731]:       <nova:owner>
Apr 13 16:54:57 user nova-compute[71731]:         <nova:user uuid="91a450674d7046ae82f5dd182506c85b">tempest-TestMinimumBasicScenario-419032150-project-member</nova:user>
Apr 13 16:54:57 user nova-compute[71731]:         <nova:project uuid="7edf468527d84954a943bb4c1f7ff54d">tempest-TestMinimumBasicScenario-419032150</nova:project>
Apr 13 16:54:57 user nova-compute[71731]:       </nova:owner>
Apr 13 16:54:57 user nova-compute[71731]:       <nova:root type="image" uuid="e81308c1-1e9d-43bf-bd21-d6a7d7856ff1"/>
Apr 13 16:54:57 user nova-compute[71731]:       <nova:ports>
Apr 13 16:54:57 user nova-compute[71731]:         <nova:port uuid="4fb36f71-2601-4c01-9eba-514f5f2af95f">
Apr 13 16:54:57 user nova-compute[71731]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Apr 13 16:54:57 user nova-compute[71731]:         </nova:port>
Apr 13 16:54:57 user nova-compute[71731]:       </nova:ports>
Apr 13 16:54:57 user nova-compute[71731]:     </nova:instance>
Apr 13 16:54:57 user nova-compute[71731]:   </metadata>
Apr 13 16:54:57 user nova-compute[71731]:   <sysinfo type="smbios">
Apr 13 16:54:57 user nova-compute[71731]:     <system>
Apr 13 16:54:57 user nova-compute[71731]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 16:54:57 user nova-compute[71731]:       <entry name="product">OpenStack Nova</entry>
Apr 13 16:54:57 user nova-compute[71731]:       <entry name="version">0.0.0</entry>
Apr 13 16:54:57 user nova-compute[71731]:       <entry name="serial">e048d6f6-f6aa-4491-ae06-9e22a8ff6691</entry>
Apr 13 16:54:57 user nova-compute[71731]:       <entry name="uuid">e048d6f6-f6aa-4491-ae06-9e22a8ff6691</entry>
Apr 13 16:54:57 user nova-compute[71731]:       <entry name="family">Virtual Machine</entry>
Apr 13 16:54:57 user nova-compute[71731]:     </system>
Apr 13 16:54:57 user nova-compute[71731]:   </sysinfo>
Apr 13 16:54:57 user nova-compute[71731]:   <os>
Apr 13 16:54:57 user nova-compute[71731]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 16:54:57 user nova-compute[71731]:     <boot dev="hd"/>
Apr 13 16:54:57 user nova-compute[71731]:     <smbios mode="sysinfo"/>
Apr 13 16:54:57 user nova-compute[71731]:   </os>
Apr 13 16:54:57 user nova-compute[71731]:   <features>
Apr 13 16:54:57 user nova-compute[71731]:     <acpi/>
Apr 13 16:54:57 user nova-compute[71731]:     <apic/>
Apr 13 16:54:57 user nova-compute[71731]:     <vmcoreinfo/>
Apr 13 16:54:57 user nova-compute[71731]:   </features>
Apr 13 16:54:57 user nova-compute[71731]:   <clock offset="utc">
Apr 13 16:54:57 user nova-compute[71731]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 16:54:57 user nova-compute[71731]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 16:54:57 user nova-compute[71731]:     <timer name="hpet" present="no"/>
Apr 13 16:54:57 user nova-compute[71731]:   </clock>
Apr 13 16:54:57 user nova-compute[71731]:   <cpu mode="custom" match="exact">
Apr 13 16:54:57 user nova-compute[71731]:     <model>Nehalem</model>
Apr 13 16:54:57 user nova-compute[71731]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 16:54:57 user nova-compute[71731]:   </cpu>
Apr 13 16:54:57 user nova-compute[71731]:   <devices>
Apr 13 16:54:57 user nova-compute[71731]:     <disk type="file" device="disk">
Apr 13 16:54:57 user nova-compute[71731]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 16:54:57 user nova-compute[71731]:       <source file="/opt/stack/data/nova/instances/e048d6f6-f6aa-4491-ae06-9e22a8ff6691/disk"/>
Apr 13 16:54:57 user nova-compute[71731]:       <target dev="vda" bus="virtio"/>
Apr 13 16:54:57 user nova-compute[71731]:     </disk>
Apr 13 16:54:57 user nova-compute[71731]:     <interface type="ethernet">
Apr 13 16:54:57 user nova-compute[71731]:       <mac address="fa:16:3e:11:9f:98"/>
Apr 13 16:54:57 user nova-compute[71731]:       <model type="virtio"/>
Apr 13 16:54:57 user nova-compute[71731]:       <mtu size="1442"/>
Apr 13 16:54:57 user nova-compute[71731]:       <target dev="tap4fb36f71-26"/>
Apr 13 16:54:57 user nova-compute[71731]:     </interface>
Apr 13 16:54:57 user nova-compute[71731]:     <serial type="pty">
Apr 13 16:54:57 user nova-compute[71731]:       <log file="/opt/stack/data/nova/instances/e048d6f6-f6aa-4491-ae06-9e22a8ff6691/console.log" append="off"/>
Apr 13 16:54:57 user nova-compute[71731]:     </serial>
Apr 13 16:54:57 user nova-compute[71731]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 16:54:57 user nova-compute[71731]:     <video>
Apr 13 16:54:57 user nova-compute[71731]:       <model type="virtio"/>
Apr 13 16:54:57 user nova-compute[71731]:     </video>
Apr 13 16:54:57 user nova-compute[71731]:     <rng model="virtio">
Apr 13 16:54:57 user nova-compute[71731]:       <backend model="random">/dev/urandom</backend>
Apr 13 16:54:57 user nova-compute[71731]:     </rng>
Apr 13 16:54:57 user nova-compute[71731]:     <controller type="usb" index="0" model="none"/>
Apr 13 16:54:57 user nova-compute[71731]:     <memballoon model="virtio">
Apr 13 16:54:57 user nova-compute[71731]:       <stats period="10"/>
Apr 13 16:54:57 user nova-compute[71731]:     </memballoon>
Apr 13 16:54:57 user nova-compute[71731]:   </devices>
Apr 13 16:54:57 user nova-compute[71731]: </domain>
Apr 13 16:54:57 user nova-compute[71731]:  {{(pid=71731) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 16:54:57 user nova-compute[71731]: DEBUG nova.virt.libvirt.vif [None req-0adfe3be-b106-4c9a-984c-ecd07fb321c9 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T16:54:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-2141029123',display_name='tempest-TestMinimumBasicScenario-server-2141029123',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-2141029123',id=42,image_ref='e81308c1-1e9d-43bf-bd21-d6a7d7856ff1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCJeR98CrX5Pyefe/rcz7c7swHCPLDeP62HQPhZNTY1lR3svV0j4RlALHIf9UrR6zTy6O2Onfsic7sNVnaIU+KNr9U5sJ8q1nmWzQ0dRWeAumpZeD0Chk2QSpA1BLE1qxA==',key_name='tempest-TestMinimumBasicScenario-810545990',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7edf468527d84954a943bb4c1f7ff54d',ramdisk_id='',reservation_id='r-8091fn2v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e81308c1-1e9d-43bf-bd21-d6a7d7856ff1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-419032150',owner_user_name='tempest-TestMinimumBasicScenario-419032150-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T16:54:56Z,user_data=None,user_id='91a450674d7046ae82f5dd182506c85b',uuid=e048d6f6-f6aa-4491-ae06-9e22a8ff6691,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4fb36f71-2601-4c01-9eba-514f5f2af95f", "address": "fa:16:3e:11:9f:98", "network": {"id": "0c6a5f46-e53b-4b4c-806e-b2617ba3ef35", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1984894004-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7edf468527d84954a943bb4c1f7ff54d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fb36f71-26", "ovs_interfaceid": "4fb36f71-2601-4c01-9eba-514f5f2af95f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 16:54:57 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-0adfe3be-b106-4c9a-984c-ecd07fb321c9 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Converting VIF {"id": "4fb36f71-2601-4c01-9eba-514f5f2af95f", "address": "fa:16:3e:11:9f:98", "network": {"id": "0c6a5f46-e53b-4b4c-806e-b2617ba3ef35", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1984894004-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7edf468527d84954a943bb4c1f7ff54d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fb36f71-26", "ovs_interfaceid": "4fb36f71-2601-4c01-9eba-514f5f2af95f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 16:54:57 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-0adfe3be-b106-4c9a-984c-ecd07fb321c9 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:11:9f:98,bridge_name='br-int',has_traffic_filtering=True,id=4fb36f71-2601-4c01-9eba-514f5f2af95f,network=Network(0c6a5f46-e53b-4b4c-806e-b2617ba3ef35),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4fb36f71-26') {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 16:54:57 user nova-compute[71731]: DEBUG os_vif [None req-0adfe3be-b106-4c9a-984c-ecd07fb321c9 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:9f:98,bridge_name='br-int',has_traffic_filtering=True,id=4fb36f71-2601-4c01-9eba-514f5f2af95f,network=Network(0c6a5f46-e53b-4b4c-806e-b2617ba3ef35),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4fb36f71-26') {{(pid=71731) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 16:54:57 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:54:57 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:54:57 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 16:54:57 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:54:57 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4fb36f71-26, may_exist=True) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:54:57 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4fb36f71-26, col_values=(('external_ids', {'iface-id': '4fb36f71-2601-4c01-9eba-514f5f2af95f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:11:9f:98', 'vm-uuid': 'e048d6f6-f6aa-4491-ae06-9e22a8ff6691'}),)) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:54:57 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:54:57 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 16:54:57 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:54:57 user nova-compute[71731]: INFO os_vif [None req-0adfe3be-b106-4c9a-984c-ecd07fb321c9 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:9f:98,bridge_name='br-int',has_traffic_filtering=True,id=4fb36f71-2601-4c01-9eba-514f5f2af95f,network=Network(0c6a5f46-e53b-4b4c-806e-b2617ba3ef35),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4fb36f71-26')
Apr 13 16:54:58 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-0adfe3be-b106-4c9a-984c-ecd07fb321c9 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] No BDM found with device name vda, not building metadata. {{(pid=71731) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 16:54:58 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-0adfe3be-b106-4c9a-984c-ecd07fb321c9 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] No VIF found with MAC fa:16:3e:11:9f:98, not building metadata {{(pid=71731) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 16:54:59 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:54:59 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:54:59 user nova-compute[71731]: DEBUG nova.compute.manager [req-8623803b-b1d5-436e-93c3-76d5640fec66 req-06dd62ab-4977-4c05-b92f-55e8ef53064a service nova] [instance: e048d6f6-f6aa-4491-ae06-9e22a8ff6691] Received event network-vif-plugged-4fb36f71-2601-4c01-9eba-514f5f2af95f {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:54:59 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-8623803b-b1d5-436e-93c3-76d5640fec66 req-06dd62ab-4977-4c05-b92f-55e8ef53064a service nova] Acquiring lock "e048d6f6-f6aa-4491-ae06-9e22a8ff6691-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:54:59 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-8623803b-b1d5-436e-93c3-76d5640fec66 req-06dd62ab-4977-4c05-b92f-55e8ef53064a service nova] Lock "e048d6f6-f6aa-4491-ae06-9e22a8ff6691-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:54:59 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-8623803b-b1d5-436e-93c3-76d5640fec66 req-06dd62ab-4977-4c05-b92f-55e8ef53064a service nova] Lock "e048d6f6-f6aa-4491-ae06-9e22a8ff6691-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:54:59 user nova-compute[71731]: DEBUG nova.compute.manager [req-8623803b-b1d5-436e-93c3-76d5640fec66 req-06dd62ab-4977-4c05-b92f-55e8ef53064a service nova] [instance: e048d6f6-f6aa-4491-ae06-9e22a8ff6691] No waiting events found dispatching network-vif-plugged-4fb36f71-2601-4c01-9eba-514f5f2af95f {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:54:59 user nova-compute[71731]: WARNING nova.compute.manager [req-8623803b-b1d5-436e-93c3-76d5640fec66 req-06dd62ab-4977-4c05-b92f-55e8ef53064a service nova] [instance: e048d6f6-f6aa-4491-ae06-9e22a8ff6691] Received unexpected event network-vif-plugged-4fb36f71-2601-4c01-9eba-514f5f2af95f for instance with vm_state building and task_state spawning.
Apr 13 16:54:59 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:54:59 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:54:59 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:55:01 user nova-compute[71731]: DEBUG nova.virt.driver [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Emitting event <LifecycleEvent: 1681404901.4741743, e048d6f6-f6aa-4491-ae06-9e22a8ff6691 => Resumed> {{(pid=71731) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 16:55:01 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: e048d6f6-f6aa-4491-ae06-9e22a8ff6691] VM Resumed (Lifecycle Event)
Apr 13 16:55:01 user nova-compute[71731]: DEBUG nova.compute.manager [None req-0adfe3be-b106-4c9a-984c-ecd07fb321c9 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] [instance: e048d6f6-f6aa-4491-ae06-9e22a8ff6691] Instance event wait completed in 0 seconds for  {{(pid=71731) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 16:55:01 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-0adfe3be-b106-4c9a-984c-ecd07fb321c9 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] [instance: e048d6f6-f6aa-4491-ae06-9e22a8ff6691] Guest created on hypervisor {{(pid=71731) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 16:55:01 user nova-compute[71731]: INFO nova.virt.libvirt.driver [-] [instance: e048d6f6-f6aa-4491-ae06-9e22a8ff6691] Instance spawned successfully.
Apr 13 16:55:01 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-0adfe3be-b106-4c9a-984c-ecd07fb321c9 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] [instance: e048d6f6-f6aa-4491-ae06-9e22a8ff6691] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 16:55:01 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: e048d6f6-f6aa-4491-ae06-9e22a8ff6691] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:55:01 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: e048d6f6-f6aa-4491-ae06-9e22a8ff6691] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71731) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 16:55:01 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-0adfe3be-b106-4c9a-984c-ecd07fb321c9 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] [instance: e048d6f6-f6aa-4491-ae06-9e22a8ff6691] Found default for hw_cdrom_bus of ide {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:55:01 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-0adfe3be-b106-4c9a-984c-ecd07fb321c9 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] [instance: e048d6f6-f6aa-4491-ae06-9e22a8ff6691] Found default for hw_disk_bus of virtio {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:55:01 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-0adfe3be-b106-4c9a-984c-ecd07fb321c9 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] [instance: e048d6f6-f6aa-4491-ae06-9e22a8ff6691] Found default for hw_input_bus of None {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:55:01 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-0adfe3be-b106-4c9a-984c-ecd07fb321c9 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] [instance: e048d6f6-f6aa-4491-ae06-9e22a8ff6691] Found default for hw_pointer_model of None {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:55:01 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-0adfe3be-b106-4c9a-984c-ecd07fb321c9 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] [instance: e048d6f6-f6aa-4491-ae06-9e22a8ff6691] Found default for hw_video_model of virtio {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:55:01 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-0adfe3be-b106-4c9a-984c-ecd07fb321c9 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] [instance: e048d6f6-f6aa-4491-ae06-9e22a8ff6691] Found default for hw_vif_model of virtio {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:55:01 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: e048d6f6-f6aa-4491-ae06-9e22a8ff6691] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 16:55:01 user nova-compute[71731]: DEBUG nova.virt.driver [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Emitting event <LifecycleEvent: 1681404901.476498, e048d6f6-f6aa-4491-ae06-9e22a8ff6691 => Started> {{(pid=71731) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 16:55:01 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: e048d6f6-f6aa-4491-ae06-9e22a8ff6691] VM Started (Lifecycle Event)
Apr 13 16:55:01 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: e048d6f6-f6aa-4491-ae06-9e22a8ff6691] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:55:01 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: e048d6f6-f6aa-4491-ae06-9e22a8ff6691] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71731) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 16:55:01 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: e048d6f6-f6aa-4491-ae06-9e22a8ff6691] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 16:55:01 user nova-compute[71731]: INFO nova.compute.manager [None req-0adfe3be-b106-4c9a-984c-ecd07fb321c9 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] [instance: e048d6f6-f6aa-4491-ae06-9e22a8ff6691] Took 5.93 seconds to spawn the instance on the hypervisor.
Apr 13 16:55:01 user nova-compute[71731]: DEBUG nova.compute.manager [None req-0adfe3be-b106-4c9a-984c-ecd07fb321c9 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] [instance: e048d6f6-f6aa-4491-ae06-9e22a8ff6691] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:55:01 user nova-compute[71731]: INFO nova.compute.manager [None req-0adfe3be-b106-4c9a-984c-ecd07fb321c9 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] [instance: e048d6f6-f6aa-4491-ae06-9e22a8ff6691] Took 6.74 seconds to build instance.
Apr 13 16:55:02 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-0adfe3be-b106-4c9a-984c-ecd07fb321c9 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lock "e048d6f6-f6aa-4491-ae06-9e22a8ff6691" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.916s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:55:02 user nova-compute[71731]: DEBUG nova.compute.manager [req-9c8c93e3-a81a-49a3-9ffc-a768b49622dc req-f1e6695d-336a-427c-b643-4ea8f6b951e3 service nova] [instance: e048d6f6-f6aa-4491-ae06-9e22a8ff6691] Received event network-vif-plugged-4fb36f71-2601-4c01-9eba-514f5f2af95f {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:55:02 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-9c8c93e3-a81a-49a3-9ffc-a768b49622dc req-f1e6695d-336a-427c-b643-4ea8f6b951e3 service nova] Acquiring lock "e048d6f6-f6aa-4491-ae06-9e22a8ff6691-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:55:02 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-9c8c93e3-a81a-49a3-9ffc-a768b49622dc req-f1e6695d-336a-427c-b643-4ea8f6b951e3 service nova] Lock "e048d6f6-f6aa-4491-ae06-9e22a8ff6691-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:55:02 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-9c8c93e3-a81a-49a3-9ffc-a768b49622dc req-f1e6695d-336a-427c-b643-4ea8f6b951e3 service nova] Lock "e048d6f6-f6aa-4491-ae06-9e22a8ff6691-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:55:02 user nova-compute[71731]: DEBUG nova.compute.manager [req-9c8c93e3-a81a-49a3-9ffc-a768b49622dc req-f1e6695d-336a-427c-b643-4ea8f6b951e3 service nova] [instance: e048d6f6-f6aa-4491-ae06-9e22a8ff6691] No waiting events found dispatching network-vif-plugged-4fb36f71-2601-4c01-9eba-514f5f2af95f {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:55:02 user nova-compute[71731]: WARNING nova.compute.manager [req-9c8c93e3-a81a-49a3-9ffc-a768b49622dc req-f1e6695d-336a-427c-b643-4ea8f6b951e3 service nova] [instance: e048d6f6-f6aa-4491-ae06-9e22a8ff6691] Received unexpected event network-vif-plugged-4fb36f71-2601-4c01-9eba-514f5f2af95f for instance with vm_state active and task_state None.
Apr 13 16:55:02 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:55:02 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:55:05 user nova-compute[71731]: DEBUG nova.compute.manager [req-a7139ecd-f573-4614-acd8-ebac4dd3b37a req-bfdf55c7-15f9-4175-b058-f4502d5840e6 service nova] [instance: 37a39f40-d239-4716-91bc-3f562906bd1e] Received event network-changed-86b0ae4e-a317-4c75-9033-49325a4399d2 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:55:05 user nova-compute[71731]: DEBUG nova.compute.manager [req-a7139ecd-f573-4614-acd8-ebac4dd3b37a req-bfdf55c7-15f9-4175-b058-f4502d5840e6 service nova] [instance: 37a39f40-d239-4716-91bc-3f562906bd1e] Refreshing instance network info cache due to event network-changed-86b0ae4e-a317-4c75-9033-49325a4399d2. {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 16:55:05 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-a7139ecd-f573-4614-acd8-ebac4dd3b37a req-bfdf55c7-15f9-4175-b058-f4502d5840e6 service nova] Acquiring lock "refresh_cache-37a39f40-d239-4716-91bc-3f562906bd1e" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 16:55:05 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-a7139ecd-f573-4614-acd8-ebac4dd3b37a req-bfdf55c7-15f9-4175-b058-f4502d5840e6 service nova] Acquired lock "refresh_cache-37a39f40-d239-4716-91bc-3f562906bd1e" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 16:55:05 user nova-compute[71731]: DEBUG nova.network.neutron [req-a7139ecd-f573-4614-acd8-ebac4dd3b37a req-bfdf55c7-15f9-4175-b058-f4502d5840e6 service nova] [instance: 37a39f40-d239-4716-91bc-3f562906bd1e] Refreshing network info cache for port 86b0ae4e-a317-4c75-9033-49325a4399d2 {{(pid=71731) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 16:55:05 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-e3d8c3af-9798-4be9-9714-370a7e799878 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Acquiring lock "37a39f40-d239-4716-91bc-3f562906bd1e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:55:05 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-e3d8c3af-9798-4be9-9714-370a7e799878 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lock "37a39f40-d239-4716-91bc-3f562906bd1e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:55:05 user nova-compute[71731]: INFO nova.compute.manager [None req-e3d8c3af-9798-4be9-9714-370a7e799878 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] [instance: 37a39f40-d239-4716-91bc-3f562906bd1e] Detaching volume 80224b51-c622-4586-9f20-796024d9cba0
Apr 13 16:55:05 user nova-compute[71731]: INFO nova.virt.block_device [None req-e3d8c3af-9798-4be9-9714-370a7e799878 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] [instance: 37a39f40-d239-4716-91bc-3f562906bd1e] Attempting to driver detach volume 80224b51-c622-4586-9f20-796024d9cba0 from mountpoint /dev/vdb
Apr 13 16:55:05 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-e3d8c3af-9798-4be9-9714-370a7e799878 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Attempting to detach device vdb from instance 37a39f40-d239-4716-91bc-3f562906bd1e from the persistent domain config. {{(pid=71731) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 13 16:55:05 user nova-compute[71731]: DEBUG nova.virt.libvirt.guest [None req-e3d8c3af-9798-4be9-9714-370a7e799878 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 16:55:05 user nova-compute[71731]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 16:55:05 user nova-compute[71731]:   <source dev="/dev/sdb"/>
Apr 13 16:55:05 user nova-compute[71731]:   <target dev="vdb" bus="virtio"/>
Apr 13 16:55:05 user nova-compute[71731]:   <serial>80224b51-c622-4586-9f20-796024d9cba0</serial>
Apr 13 16:55:05 user nova-compute[71731]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 13 16:55:05 user nova-compute[71731]: </disk>
Apr 13 16:55:05 user nova-compute[71731]:  {{(pid=71731) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 16:55:05 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-e3d8c3af-9798-4be9-9714-370a7e799878 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Successfully detached device vdb from instance 37a39f40-d239-4716-91bc-3f562906bd1e from the persistent domain config.
Apr 13 16:55:05 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-e3d8c3af-9798-4be9-9714-370a7e799878 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 37a39f40-d239-4716-91bc-3f562906bd1e from the live domain config. {{(pid=71731) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 13 16:55:05 user nova-compute[71731]: DEBUG nova.virt.libvirt.guest [None req-e3d8c3af-9798-4be9-9714-370a7e799878 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 16:55:05 user nova-compute[71731]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 16:55:05 user nova-compute[71731]:   <source dev="/dev/sdb"/>
Apr 13 16:55:05 user nova-compute[71731]:   <target dev="vdb" bus="virtio"/>
Apr 13 16:55:05 user nova-compute[71731]:   <serial>80224b51-c622-4586-9f20-796024d9cba0</serial>
Apr 13 16:55:05 user nova-compute[71731]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 13 16:55:05 user nova-compute[71731]: </disk>
Apr 13 16:55:05 user nova-compute[71731]:  {{(pid=71731) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 16:55:06 user nova-compute[71731]: DEBUG nova.network.neutron [req-a7139ecd-f573-4614-acd8-ebac4dd3b37a req-bfdf55c7-15f9-4175-b058-f4502d5840e6 service nova] [instance: 37a39f40-d239-4716-91bc-3f562906bd1e] Updated VIF entry in instance network info cache for port 86b0ae4e-a317-4c75-9033-49325a4399d2. {{(pid=71731) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 16:55:06 user nova-compute[71731]: DEBUG nova.network.neutron [req-a7139ecd-f573-4614-acd8-ebac4dd3b37a req-bfdf55c7-15f9-4175-b058-f4502d5840e6 service nova] [instance: 37a39f40-d239-4716-91bc-3f562906bd1e] Updating instance_info_cache with network_info: [{"id": "86b0ae4e-a317-4c75-9033-49325a4399d2", "address": "fa:16:3e:14:4c:bc", "network": {"id": "2a5b69f1-fc5b-4c33-a9eb-12a4d9293500", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2137344591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "846732ecb7e047128b4684972d3cd8c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86b0ae4e-a3", "ovs_interfaceid": "86b0ae4e-a317-4c75-9033-49325a4399d2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:55:06 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-a7139ecd-f573-4614-acd8-ebac4dd3b37a req-bfdf55c7-15f9-4175-b058-f4502d5840e6 service nova] Releasing lock "refresh_cache-37a39f40-d239-4716-91bc-3f562906bd1e" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 16:55:06 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Received event <DeviceRemovedEvent: 1681404906.378118, 37a39f40-d239-4716-91bc-3f562906bd1e => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71731) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 13 16:55:06 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-e3d8c3af-9798-4be9-9714-370a7e799878 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 37a39f40-d239-4716-91bc-3f562906bd1e {{(pid=71731) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 13 16:55:06 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-e3d8c3af-9798-4be9-9714-370a7e799878 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Successfully detached device vdb from instance 37a39f40-d239-4716-91bc-3f562906bd1e from the live domain config.
Apr 13 16:55:06 user nova-compute[71731]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e3d8c3af-9798-4be9-9714-370a7e799878 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] [instance: 37a39f40-d239-4716-91bc-3f562906bd1e] calling os-brick to detach iSCSI Volume {{(pid=71731) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 16:55:06 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3d8c3af-9798-4be9-9714-370a7e799878 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8cf0118790>, {'target_iqn': 'iqn.2010-10.org.openstack:80224b51-c622-4586-9f20-796024d9cba0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lXFCdmeV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 16:55:06 user nova-compute[71731]: WARNING os_brick.initiator.connectors.base [None req-e3d8c3af-9798-4be9-9714-370a7e799878 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 16:55:06 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-e3d8c3af-9798-4be9-9714-370a7e799878 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 16:55:06 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-e3d8c3af-9798-4be9-9714-370a7e799878 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 16:55:06 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:55:06 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:55:06 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[caeb5700-1059-451b-85f6-b9f8fb54ddce]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:80224b51-c622-4586-9f20-796024d9cba0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:55:06 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3d8c3af-9798-4be9-9714-370a7e799878 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 16:55:06 user nova-compute[71731]: No targets found.
Apr 13 16:55:06 user nova-compute[71731]: iSNS:
Apr 13 16:55:06 user nova-compute[71731]: No targets found.
Apr 13 16:55:06 user nova-compute[71731]: STATIC:
Apr 13 16:55:06 user nova-compute[71731]: Target: iqn.2010-10.org.openstack:80224b51-c622-4586-9f20-796024d9cba0
Apr 13 16:55:06 user nova-compute[71731]:         Portal: 172.16.0.220:3260,-1
Apr 13 16:55:06 user nova-compute[71731]:                 Iface Name: default
Apr 13 16:55:06 user nova-compute[71731]: FIRMWARE:
Apr 13 16:55:06 user nova-compute[71731]: No targets found.
Apr 13 16:55:06 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 16:55:06 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3d8c3af-9798-4be9-9714-370a7e799878 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 16:55:06 user nova-compute[71731]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 16:55:06 user nova-compute[71731]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71731) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 16:55:06 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3d8c3af-9798-4be9-9714-370a7e799878 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:80224b51-c622-4586-9f20-796024d9cba0', 0)] {{(pid=71731) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 16:55:06 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:55:06 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:55:06 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bc71823-e099-4668-b4b3-1a87dc7b2785]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:80224b51-c622-4586-9f20-796024d9cba0\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:55:06 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:55:06 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:55:06 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[02b29193-0ff0-4239-9813-2a28bbb9ed12]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80224b51-c622-4586-9f20-796024d9cba0 (non-flash)\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:55:06 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3d8c3af-9798-4be9-9714-370a7e799878 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80224b51-c622-4586-9f20-796024d9cba0 (non-flash)
Apr 13 16:55:06 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 16:55:06 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3d8c3af-9798-4be9-9714-370a7e799878 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80224b51-c622-4586-9f20-796024d9cba0 (non-flash)
Apr 13 16:55:06 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 16:55:06 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3d8c3af-9798-4be9-9714-370a7e799878 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8cf067ee60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:80224b51-c622-4586-9f20-796024d9cba0'): ({'sdb'}, set())}) {{(pid=71731) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 16:55:06 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-e3d8c3af-9798-4be9-9714-370a7e799878 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Removing single pathed devices sdb {{(pid=71731) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 16:55:06 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:55:06 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:55:06 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[bff514d1-a519-424a-89fd-15bdccfbb22c]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:55:06 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:55:06 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:55:06 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[0458672f-01a5-42a7-bcd9-a22ac91c876f]: (4, ('ok\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:55:06 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-e3d8c3af-9798-4be9-9714-370a7e799878 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Flushing IO for device /dev/sdb {{(pid=71731) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 16:55:06 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:55:06 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:55:06 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[69c1be1b-3061-4055-835f-1b17fb0a1322]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:55:06 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-e3d8c3af-9798-4be9-9714-370a7e799878 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71731) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 16:55:06 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:55:06 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.031s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:55:06 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[3db543e1-a61a-431b-9374-1e9ebefa03eb]: (4, ('1', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:55:06 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-e3d8c3af-9798-4be9-9714-370a7e799878 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71731) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 16:55:06 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-e3d8c3af-9798-4be9-9714-370a7e799878 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] SCSI volumes sdb have been removed. {{(pid=71731) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 16:55:06 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3d8c3af-9798-4be9-9714-370a7e799878 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:80224b51-c622-4586-9f20-796024d9cba0')] {{(pid=71731) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 16:55:06 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80224b51-c622-4586-9f20-796024d9cba0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:55:06 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80224b51-c622-4586-9f20-796024d9cba0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:55:06 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca6bf9ab-5942-40bb-9eb8-fd986d6d6184]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:55:06 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3d8c3af-9798-4be9-9714-370a7e799878 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:55:06 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80224b51-c622-4586-9f20-796024d9cba0 -p 172.16.0.220:3260 --logout {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:55:06 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80224b51-c622-4586-9f20-796024d9cba0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:55:06 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ed1a4a1-3c8a-44a3-8ac7-c470ae1e5309]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:80224b51-c622-4586-9f20-796024d9cba0, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:80224b51-c622-4586-9f20-796024d9cba0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:55:06 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3d8c3af-9798-4be9-9714-370a7e799878 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:80224b51-c622-4586-9f20-796024d9cba0, portal: 172.16.0.220,3260]
Apr 13 16:55:06 user nova-compute[71731]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:80224b51-c622-4586-9f20-796024d9cba0, portal: 172.16.0.220,3260] successful.
Apr 13 16:55:06 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:55:06 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80224b51-c622-4586-9f20-796024d9cba0 -p 172.16.0.220:3260 --op delete {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:55:06 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80224b51-c622-4586-9f20-796024d9cba0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:55:06 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[55a577c7-366e-4108-98ca-9c7b037760cb]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:55:06 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3d8c3af-9798-4be9-9714-370a7e799878 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:55:06 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-e3d8c3af-9798-4be9-9714-370a7e799878 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.269s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 16:55:06 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3d8c3af-9798-4be9-9714-370a7e799878 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] <== disconnect_volume: return (270ms) None {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 16:55:06 user nova-compute[71731]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e3d8c3af-9798-4be9-9714-370a7e799878 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] [instance: 37a39f40-d239-4716-91bc-3f562906bd1e] Disconnected iSCSI Volume {{(pid=71731) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 16:55:07 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:55:07 user nova-compute[71731]: DEBUG nova.compute.manager [req-3a997063-0a15-49ef-a54e-38ce83374236 req-08d01888-b6fb-4d83-82fd-8922fa8b41bb service nova] [instance: 37a39f40-d239-4716-91bc-3f562906bd1e] Received event network-changed-86b0ae4e-a317-4c75-9033-49325a4399d2 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:55:07 user nova-compute[71731]: DEBUG nova.compute.manager [req-3a997063-0a15-49ef-a54e-38ce83374236 req-08d01888-b6fb-4d83-82fd-8922fa8b41bb service nova] [instance: 37a39f40-d239-4716-91bc-3f562906bd1e] Refreshing instance network info cache due to event network-changed-86b0ae4e-a317-4c75-9033-49325a4399d2. {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 16:55:07 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-3a997063-0a15-49ef-a54e-38ce83374236 req-08d01888-b6fb-4d83-82fd-8922fa8b41bb service nova] Acquiring lock "refresh_cache-37a39f40-d239-4716-91bc-3f562906bd1e" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 16:55:07 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-3a997063-0a15-49ef-a54e-38ce83374236 req-08d01888-b6fb-4d83-82fd-8922fa8b41bb service nova] Acquired lock "refresh_cache-37a39f40-d239-4716-91bc-3f562906bd1e" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 16:55:07 user nova-compute[71731]: DEBUG nova.network.neutron [req-3a997063-0a15-49ef-a54e-38ce83374236 req-08d01888-b6fb-4d83-82fd-8922fa8b41bb service nova] [instance: 37a39f40-d239-4716-91bc-3f562906bd1e] Refreshing network info cache for port 86b0ae4e-a317-4c75-9033-49325a4399d2 {{(pid=71731) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 16:55:07 user nova-compute[71731]: DEBUG nova.objects.instance [None req-e3d8c3af-9798-4be9-9714-370a7e799878 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lazy-loading 'flavor' on Instance uuid 37a39f40-d239-4716-91bc-3f562906bd1e {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:55:07 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-e3d8c3af-9798-4be9-9714-370a7e799878 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lock "37a39f40-d239-4716-91bc-3f562906bd1e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.790s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:55:07 user nova-compute[71731]: DEBUG nova.network.neutron [req-3a997063-0a15-49ef-a54e-38ce83374236 req-08d01888-b6fb-4d83-82fd-8922fa8b41bb service nova] [instance: 37a39f40-d239-4716-91bc-3f562906bd1e] Updated VIF entry in instance network info cache for port 86b0ae4e-a317-4c75-9033-49325a4399d2. {{(pid=71731) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 16:55:07 user nova-compute[71731]: DEBUG nova.network.neutron [req-3a997063-0a15-49ef-a54e-38ce83374236 req-08d01888-b6fb-4d83-82fd-8922fa8b41bb service nova] [instance: 37a39f40-d239-4716-91bc-3f562906bd1e] Updating instance_info_cache with network_info: [{"id": "86b0ae4e-a317-4c75-9033-49325a4399d2", "address": "fa:16:3e:14:4c:bc", "network": {"id": "2a5b69f1-fc5b-4c33-a9eb-12a4d9293500", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2137344591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "846732ecb7e047128b4684972d3cd8c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86b0ae4e-a3", "ovs_interfaceid": "86b0ae4e-a317-4c75-9033-49325a4399d2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:55:07 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-3a997063-0a15-49ef-a54e-38ce83374236 req-08d01888-b6fb-4d83-82fd-8922fa8b41bb service nova] Releasing lock "refresh_cache-37a39f40-d239-4716-91bc-3f562906bd1e" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 16:55:07 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:55:12 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:55:12 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:55:17 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:55:17 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:55:22 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:55:22 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:55:27 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:55:27 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:55:32 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:55:32 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:55:35 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:55:36 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:55:36 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71731) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 16:55:37 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:55:37 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 16:55:37 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 16:55:37 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71731) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 16:55:37 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71731) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 16:55:38 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71731) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 16:55:38 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:55:40 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager.update_available_resource {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:55:40 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:55:40 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:55:40 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:55:40 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Auditing locally available compute resources for user (node: user) {{(pid=71731) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 16:55:40 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e048d6f6-f6aa-4491-ae06-9e22a8ff6691/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:55:40 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e048d6f6-f6aa-4491-ae06-9e22a8ff6691/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:55:40 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e048d6f6-f6aa-4491-ae06-9e22a8ff6691/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:55:40 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e048d6f6-f6aa-4491-ae06-9e22a8ff6691/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:55:40 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37a39f40-d239-4716-91bc-3f562906bd1e/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:55:40 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37a39f40-d239-4716-91bc-3f562906bd1e/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:55:40 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37a39f40-d239-4716-91bc-3f562906bd1e/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:55:40 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37a39f40-d239-4716-91bc-3f562906bd1e/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:55:40 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3af23ff8-4e10-4fbf-a86e-bda842f084ff/disk.rescue --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:55:40 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3af23ff8-4e10-4fbf-a86e-bda842f084ff/disk.rescue --force-share --output=json" returned: 0 in 0.132s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:55:40 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3af23ff8-4e10-4fbf-a86e-bda842f084ff/disk.rescue --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:55:41 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3af23ff8-4e10-4fbf-a86e-bda842f084ff/disk.rescue --force-share --output=json" returned: 0 in 0.137s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:55:41 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3af23ff8-4e10-4fbf-a86e-bda842f084ff/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:55:41 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3af23ff8-4e10-4fbf-a86e-bda842f084ff/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:55:41 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3af23ff8-4e10-4fbf-a86e-bda842f084ff/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:55:41 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3af23ff8-4e10-4fbf-a86e-bda842f084ff/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:55:41 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2d55cdd-c89c-4c59-afe1-49a33225af22/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:55:41 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2d55cdd-c89c-4c59-afe1-49a33225af22/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:55:41 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2d55cdd-c89c-4c59-afe1-49a33225af22/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:55:41 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2d55cdd-c89c-4c59-afe1-49a33225af22/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:55:42 user nova-compute[71731]: WARNING nova.virt.libvirt.driver [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 16:55:42 user nova-compute[71731]: WARNING nova.virt.libvirt.driver [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 16:55:42 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Hypervisor/Node resource view: name=user free_ram=8468MB free_disk=25.981216430664062GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71731) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 16:55:42 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:55:42 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:55:42 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance b2d55cdd-c89c-4c59-afe1-49a33225af22 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 16:55:42 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance 3af23ff8-4e10-4fbf-a86e-bda842f084ff actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 16:55:42 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance 37a39f40-d239-4716-91bc-3f562906bd1e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 16:55:42 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance e048d6f6-f6aa-4491-ae06-9e22a8ff6691 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 16:55:42 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=71731) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 16:55:42 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Final resource view: name=user phys_ram=16023MB used_ram=1024MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=71731) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 16:55:42 user nova-compute[71731]: DEBUG nova.compute.provider_tree [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Inventory has not changed in ProviderTree for provider: cb6b1a64-0c24-4e2d-af1e-16576ca9165c {{(pid=71731) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 16:55:42 user nova-compute[71731]: DEBUG nova.scheduler.client.report [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Inventory has not changed for provider cb6b1a64-0c24-4e2d-af1e-16576ca9165c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71731) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 16:55:42 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Compute_service record updated for user:user {{(pid=71731) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 16:55:42 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.282s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:55:43 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 16:55:43 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:55:43 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71731) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 16:55:43 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71731) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 16:55:43 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71731) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 16:55:43 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:55:43 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:55:43 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:55:43 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Starting heal instance info cache {{(pid=71731) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 16:55:43 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Acquiring lock "refresh_cache-37a39f40-d239-4716-91bc-3f562906bd1e" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 16:55:43 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Acquired lock "refresh_cache-37a39f40-d239-4716-91bc-3f562906bd1e" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 16:55:43 user nova-compute[71731]: DEBUG nova.network.neutron [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] [instance: 37a39f40-d239-4716-91bc-3f562906bd1e] Forcefully refreshing network info cache for instance {{(pid=71731) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 16:55:43 user nova-compute[71731]: DEBUG nova.network.neutron [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] [instance: 37a39f40-d239-4716-91bc-3f562906bd1e] Updating instance_info_cache with network_info: [{"id": "86b0ae4e-a317-4c75-9033-49325a4399d2", "address": "fa:16:3e:14:4c:bc", "network": {"id": "2a5b69f1-fc5b-4c33-a9eb-12a4d9293500", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2137344591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "846732ecb7e047128b4684972d3cd8c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86b0ae4e-a3", "ovs_interfaceid": "86b0ae4e-a317-4c75-9033-49325a4399d2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:55:43 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Releasing lock "refresh_cache-37a39f40-d239-4716-91bc-3f562906bd1e" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 16:55:43 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] [instance: 37a39f40-d239-4716-91bc-3f562906bd1e] Updated the network info_cache for instance {{(pid=71731) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 16:55:43 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:55:43 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:55:44 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:55:47 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:55:48 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:55:53 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 16:55:53 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 16:55:53 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71731) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 16:55:53 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71731) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 16:55:53 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71731) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 16:55:53 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:55:56 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-78e3608d-9dca-4a6a-b508-8c1a3ac110f0 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Acquiring lock "37a39f40-d239-4716-91bc-3f562906bd1e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:55:56 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-78e3608d-9dca-4a6a-b508-8c1a3ac110f0 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lock "37a39f40-d239-4716-91bc-3f562906bd1e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:55:56 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-78e3608d-9dca-4a6a-b508-8c1a3ac110f0 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Acquiring lock "37a39f40-d239-4716-91bc-3f562906bd1e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:55:56 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-78e3608d-9dca-4a6a-b508-8c1a3ac110f0 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lock "37a39f40-d239-4716-91bc-3f562906bd1e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:55:56 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-78e3608d-9dca-4a6a-b508-8c1a3ac110f0 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lock "37a39f40-d239-4716-91bc-3f562906bd1e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:55:56 user nova-compute[71731]: INFO nova.compute.manager [None req-78e3608d-9dca-4a6a-b508-8c1a3ac110f0 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] [instance: 37a39f40-d239-4716-91bc-3f562906bd1e] Terminating instance
Apr 13 16:55:56 user nova-compute[71731]: DEBUG nova.compute.manager [None req-78e3608d-9dca-4a6a-b508-8c1a3ac110f0 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] [instance: 37a39f40-d239-4716-91bc-3f562906bd1e] Start destroying the instance on the hypervisor. {{(pid=71731) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 16:55:56 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:55:56 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:55:56 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:55:56 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:55:56 user nova-compute[71731]: DEBUG nova.compute.manager [req-7f605fe5-5fc2-4f72-b6c5-2c7d460ec3d1 req-354b7a80-8d0e-4e94-975b-2bdfccb71842 service nova] [instance: 37a39f40-d239-4716-91bc-3f562906bd1e] Received event network-vif-unplugged-86b0ae4e-a317-4c75-9033-49325a4399d2 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:55:56 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-7f605fe5-5fc2-4f72-b6c5-2c7d460ec3d1 req-354b7a80-8d0e-4e94-975b-2bdfccb71842 service nova] Acquiring lock "37a39f40-d239-4716-91bc-3f562906bd1e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:55:56 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-7f605fe5-5fc2-4f72-b6c5-2c7d460ec3d1 req-354b7a80-8d0e-4e94-975b-2bdfccb71842 service nova] Lock "37a39f40-d239-4716-91bc-3f562906bd1e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:55:56 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-7f605fe5-5fc2-4f72-b6c5-2c7d460ec3d1 req-354b7a80-8d0e-4e94-975b-2bdfccb71842 service nova] Lock "37a39f40-d239-4716-91bc-3f562906bd1e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:55:56 user nova-compute[71731]: DEBUG nova.compute.manager [req-7f605fe5-5fc2-4f72-b6c5-2c7d460ec3d1 req-354b7a80-8d0e-4e94-975b-2bdfccb71842 service nova] [instance: 37a39f40-d239-4716-91bc-3f562906bd1e] No waiting events found dispatching network-vif-unplugged-86b0ae4e-a317-4c75-9033-49325a4399d2 {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:55:56 user nova-compute[71731]: DEBUG nova.compute.manager [req-7f605fe5-5fc2-4f72-b6c5-2c7d460ec3d1 req-354b7a80-8d0e-4e94-975b-2bdfccb71842 service nova] [instance: 37a39f40-d239-4716-91bc-3f562906bd1e] Received event network-vif-unplugged-86b0ae4e-a317-4c75-9033-49325a4399d2 for instance with task_state deleting. {{(pid=71731) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 16:55:56 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:55:56 user nova-compute[71731]: INFO nova.virt.libvirt.driver [-] [instance: 37a39f40-d239-4716-91bc-3f562906bd1e] Instance destroyed successfully.
Apr 13 16:55:56 user nova-compute[71731]: DEBUG nova.objects.instance [None req-78e3608d-9dca-4a6a-b508-8c1a3ac110f0 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lazy-loading 'resources' on Instance uuid 37a39f40-d239-4716-91bc-3f562906bd1e {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:55:56 user nova-compute[71731]: DEBUG nova.virt.libvirt.vif [None req-78e3608d-9dca-4a6a-b508-8c1a3ac110f0 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T16:49:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2129119099',display_name='tempest-ServerRescueNegativeTestJSON-server-2129119099',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2129119099',id=40,image_ref='708622a9-7465-4492-ade8-b827198f7e30',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBInYPh0gx086UszGyyqEY0fWXC6yPnnRldjV6vUByd8iGqw/BPMxIKhGYsYjdNeYHSNNfn33Tapk/jQbqiYzfJYw4chd2naEdDS8MeKSMHscX8fHOp+k3fZ6id92uef9aA==',key_name='tempest-keypair-1684148765',keypairs=<?>,launch_index=0,launched_at=2023-04-13T16:51:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='846732ecb7e047128b4684972d3cd8c6',ramdisk_id='',reservation_id='r-8atp79dt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='708622a9-7465-4492-ade8-b827198f7e30',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-84287455',owner_user_name='tempest-ServerRescueNegativeTestJSON-84287455-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T16:53:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0c7f54723c494e05ada117353c0790cb',uuid=37a39f40-d239-4716-91bc-3f562906bd1e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "86b0ae4e-a317-4c75-9033-49325a4399d2", "address": "fa:16:3e:14:4c:bc", "network": {"id": "2a5b69f1-fc5b-4c33-a9eb-12a4d9293500", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2137344591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "846732ecb7e047128b4684972d3cd8c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86b0ae4e-a3", "ovs_interfaceid": "86b0ae4e-a317-4c75-9033-49325a4399d2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 16:55:56 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-78e3608d-9dca-4a6a-b508-8c1a3ac110f0 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Converting VIF {"id": "86b0ae4e-a317-4c75-9033-49325a4399d2", "address": "fa:16:3e:14:4c:bc", "network": {"id": "2a5b69f1-fc5b-4c33-a9eb-12a4d9293500", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2137344591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "846732ecb7e047128b4684972d3cd8c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86b0ae4e-a3", "ovs_interfaceid": "86b0ae4e-a317-4c75-9033-49325a4399d2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 16:55:56 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-78e3608d-9dca-4a6a-b508-8c1a3ac110f0 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:14:4c:bc,bridge_name='br-int',has_traffic_filtering=True,id=86b0ae4e-a317-4c75-9033-49325a4399d2,network=Network(2a5b69f1-fc5b-4c33-a9eb-12a4d9293500),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86b0ae4e-a3') {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 16:55:56 user nova-compute[71731]: DEBUG os_vif [None req-78e3608d-9dca-4a6a-b508-8c1a3ac110f0 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:14:4c:bc,bridge_name='br-int',has_traffic_filtering=True,id=86b0ae4e-a317-4c75-9033-49325a4399d2,network=Network(2a5b69f1-fc5b-4c33-a9eb-12a4d9293500),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86b0ae4e-a3') {{(pid=71731) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 16:55:56 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:55:56 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap86b0ae4e-a3, bridge=br-int, if_exists=True) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:55:56 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:55:56 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 16:55:56 user nova-compute[71731]: INFO os_vif [None req-78e3608d-9dca-4a6a-b508-8c1a3ac110f0 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:14:4c:bc,bridge_name='br-int',has_traffic_filtering=True,id=86b0ae4e-a317-4c75-9033-49325a4399d2,network=Network(2a5b69f1-fc5b-4c33-a9eb-12a4d9293500),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86b0ae4e-a3')
Apr 13 16:55:56 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-78e3608d-9dca-4a6a-b508-8c1a3ac110f0 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] [instance: 37a39f40-d239-4716-91bc-3f562906bd1e] Deleting instance files /opt/stack/data/nova/instances/37a39f40-d239-4716-91bc-3f562906bd1e_del
Apr 13 16:55:56 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-78e3608d-9dca-4a6a-b508-8c1a3ac110f0 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] [instance: 37a39f40-d239-4716-91bc-3f562906bd1e] Deletion of /opt/stack/data/nova/instances/37a39f40-d239-4716-91bc-3f562906bd1e_del complete
Apr 13 16:55:57 user nova-compute[71731]: INFO nova.compute.manager [None req-78e3608d-9dca-4a6a-b508-8c1a3ac110f0 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] [instance: 37a39f40-d239-4716-91bc-3f562906bd1e] Took 0.85 seconds to destroy the instance on the hypervisor.
Apr 13 16:55:57 user nova-compute[71731]: DEBUG oslo.service.loopingcall [None req-78e3608d-9dca-4a6a-b508-8c1a3ac110f0 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71731) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 16:55:57 user nova-compute[71731]: DEBUG nova.compute.manager [-] [instance: 37a39f40-d239-4716-91bc-3f562906bd1e] Deallocating network for instance {{(pid=71731) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 16:55:57 user nova-compute[71731]: DEBUG nova.network.neutron [-] [instance: 37a39f40-d239-4716-91bc-3f562906bd1e] deallocate_for_instance() {{(pid=71731) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 16:55:57 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:55:57 user nova-compute[71731]: DEBUG nova.network.neutron [-] [instance: 37a39f40-d239-4716-91bc-3f562906bd1e] Updating instance_info_cache with network_info: [] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:55:57 user nova-compute[71731]: INFO nova.compute.manager [-] [instance: 37a39f40-d239-4716-91bc-3f562906bd1e] Took 0.71 seconds to deallocate network for instance.
Apr 13 16:55:57 user nova-compute[71731]: DEBUG nova.compute.manager [req-9645009c-e9d6-4b42-90fc-9ff785f2e68f req-0f681085-c671-4371-9d9b-151e97ed5f2e service nova] [instance: 37a39f40-d239-4716-91bc-3f562906bd1e] Received event network-vif-deleted-86b0ae4e-a317-4c75-9033-49325a4399d2 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:55:57 user nova-compute[71731]: INFO nova.compute.manager [req-9645009c-e9d6-4b42-90fc-9ff785f2e68f req-0f681085-c671-4371-9d9b-151e97ed5f2e service nova] [instance: 37a39f40-d239-4716-91bc-3f562906bd1e] Neutron deleted interface 86b0ae4e-a317-4c75-9033-49325a4399d2; detaching it from the instance and deleting it from the info cache
Apr 13 16:55:57 user nova-compute[71731]: DEBUG nova.network.neutron [req-9645009c-e9d6-4b42-90fc-9ff785f2e68f req-0f681085-c671-4371-9d9b-151e97ed5f2e service nova] [instance: 37a39f40-d239-4716-91bc-3f562906bd1e] Updating instance_info_cache with network_info: [] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:55:57 user nova-compute[71731]: DEBUG nova.compute.manager [req-9645009c-e9d6-4b42-90fc-9ff785f2e68f req-0f681085-c671-4371-9d9b-151e97ed5f2e service nova] [instance: 37a39f40-d239-4716-91bc-3f562906bd1e] Detach interface failed, port_id=86b0ae4e-a317-4c75-9033-49325a4399d2, reason: Instance 37a39f40-d239-4716-91bc-3f562906bd1e could not be found. {{(pid=71731) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 13 16:55:57 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-78e3608d-9dca-4a6a-b508-8c1a3ac110f0 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:55:57 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-78e3608d-9dca-4a6a-b508-8c1a3ac110f0 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:55:57 user nova-compute[71731]: DEBUG nova.compute.provider_tree [None req-78e3608d-9dca-4a6a-b508-8c1a3ac110f0 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Inventory has not changed in ProviderTree for provider: cb6b1a64-0c24-4e2d-af1e-16576ca9165c {{(pid=71731) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 16:55:57 user nova-compute[71731]: DEBUG nova.scheduler.client.report [None req-78e3608d-9dca-4a6a-b508-8c1a3ac110f0 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Inventory has not changed for provider cb6b1a64-0c24-4e2d-af1e-16576ca9165c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71731) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 16:55:57 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-78e3608d-9dca-4a6a-b508-8c1a3ac110f0 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.188s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:55:57 user nova-compute[71731]: INFO nova.scheduler.client.report [None req-78e3608d-9dca-4a6a-b508-8c1a3ac110f0 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Deleted allocations for instance 37a39f40-d239-4716-91bc-3f562906bd1e
Apr 13 16:55:58 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-78e3608d-9dca-4a6a-b508-8c1a3ac110f0 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lock "37a39f40-d239-4716-91bc-3f562906bd1e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.926s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:55:58 user nova-compute[71731]: DEBUG nova.compute.manager [req-34fed33d-33aa-4bf6-aaf8-f23fff2df60e req-50760a1b-949d-4967-9414-386524e9643f service nova] [instance: 37a39f40-d239-4716-91bc-3f562906bd1e] Received event network-vif-plugged-86b0ae4e-a317-4c75-9033-49325a4399d2 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:55:58 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-34fed33d-33aa-4bf6-aaf8-f23fff2df60e req-50760a1b-949d-4967-9414-386524e9643f service nova] Acquiring lock "37a39f40-d239-4716-91bc-3f562906bd1e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:55:58 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-34fed33d-33aa-4bf6-aaf8-f23fff2df60e req-50760a1b-949d-4967-9414-386524e9643f service nova] Lock "37a39f40-d239-4716-91bc-3f562906bd1e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:55:58 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-34fed33d-33aa-4bf6-aaf8-f23fff2df60e req-50760a1b-949d-4967-9414-386524e9643f service nova] Lock "37a39f40-d239-4716-91bc-3f562906bd1e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:55:58 user nova-compute[71731]: DEBUG nova.compute.manager [req-34fed33d-33aa-4bf6-aaf8-f23fff2df60e req-50760a1b-949d-4967-9414-386524e9643f service nova] [instance: 37a39f40-d239-4716-91bc-3f562906bd1e] No waiting events found dispatching network-vif-plugged-86b0ae4e-a317-4c75-9033-49325a4399d2 {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:55:58 user nova-compute[71731]: WARNING nova.compute.manager [req-34fed33d-33aa-4bf6-aaf8-f23fff2df60e req-50760a1b-949d-4967-9414-386524e9643f service nova] [instance: 37a39f40-d239-4716-91bc-3f562906bd1e] Received unexpected event network-vif-plugged-86b0ae4e-a317-4c75-9033-49325a4399d2 for instance with vm_state deleted and task_state None.
Apr 13 16:56:01 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:56:03 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:56:03 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:56:03 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.002s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:56:03 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:56:03 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:56:03 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:56:03 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:56:03 user nova-compute[71731]: DEBUG nova.virt.libvirt.imagecache [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Verify base images {{(pid=71731) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Apr 13 16:56:03 user nova-compute[71731]: DEBUG nova.virt.libvirt.imagecache [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Image id e81308c1-1e9d-43bf-bd21-d6a7d7856ff1 yields fingerprint fa7c6a0f960510af81481294f43b184e85fb013f {{(pid=71731) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Apr 13 16:56:03 user nova-compute[71731]: INFO nova.virt.libvirt.imagecache [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] image e81308c1-1e9d-43bf-bd21-d6a7d7856ff1 at (/opt/stack/data/nova/instances/_base/fa7c6a0f960510af81481294f43b184e85fb013f): checking
Apr 13 16:56:03 user nova-compute[71731]: DEBUG nova.virt.libvirt.imagecache [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] image e81308c1-1e9d-43bf-bd21-d6a7d7856ff1 at (/opt/stack/data/nova/instances/_base/fa7c6a0f960510af81481294f43b184e85fb013f): image is in use {{(pid=71731) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Apr 13 16:56:03 user nova-compute[71731]: DEBUG nova.virt.libvirt.imagecache [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=71731) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Apr 13 16:56:03 user nova-compute[71731]: DEBUG nova.virt.libvirt.imagecache [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Image id 708622a9-7465-4492-ade8-b827198f7e30 yields fingerprint 9524227dd898575c3099d3976f096cd935414279 {{(pid=71731) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Apr 13 16:56:03 user nova-compute[71731]: INFO nova.virt.libvirt.imagecache [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] image 708622a9-7465-4492-ade8-b827198f7e30 at (/opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279): checking
Apr 13 16:56:03 user nova-compute[71731]: DEBUG nova.virt.libvirt.imagecache [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] image 708622a9-7465-4492-ade8-b827198f7e30 at (/opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279): image is in use {{(pid=71731) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Apr 13 16:56:03 user nova-compute[71731]: DEBUG nova.virt.libvirt.imagecache [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] 3af23ff8-4e10-4fbf-a86e-bda842f084ff is a valid instance name {{(pid=71731) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Apr 13 16:56:03 user nova-compute[71731]: DEBUG nova.virt.libvirt.imagecache [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] 3af23ff8-4e10-4fbf-a86e-bda842f084ff has a disk file {{(pid=71731) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Apr 13 16:56:03 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3af23ff8-4e10-4fbf-a86e-bda842f084ff/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:56:03 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3af23ff8-4e10-4fbf-a86e-bda842f084ff/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:56:03 user nova-compute[71731]: DEBUG nova.virt.libvirt.imagecache [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance 3af23ff8-4e10-4fbf-a86e-bda842f084ff is backed by 9524227dd898575c3099d3976f096cd935414279 {{(pid=71731) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Apr 13 16:56:03 user nova-compute[71731]: DEBUG nova.virt.libvirt.imagecache [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] b2d55cdd-c89c-4c59-afe1-49a33225af22 is a valid instance name {{(pid=71731) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Apr 13 16:56:03 user nova-compute[71731]: DEBUG nova.virt.libvirt.imagecache [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] b2d55cdd-c89c-4c59-afe1-49a33225af22 has a disk file {{(pid=71731) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Apr 13 16:56:03 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2d55cdd-c89c-4c59-afe1-49a33225af22/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:56:03 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2d55cdd-c89c-4c59-afe1-49a33225af22/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:56:03 user nova-compute[71731]: DEBUG nova.virt.libvirt.imagecache [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance b2d55cdd-c89c-4c59-afe1-49a33225af22 is backed by 9524227dd898575c3099d3976f096cd935414279 {{(pid=71731) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Apr 13 16:56:03 user nova-compute[71731]: DEBUG nova.virt.libvirt.imagecache [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] e048d6f6-f6aa-4491-ae06-9e22a8ff6691 is a valid instance name {{(pid=71731) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Apr 13 16:56:03 user nova-compute[71731]: DEBUG nova.virt.libvirt.imagecache [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] e048d6f6-f6aa-4491-ae06-9e22a8ff6691 has a disk file {{(pid=71731) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Apr 13 16:56:03 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e048d6f6-f6aa-4491-ae06-9e22a8ff6691/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:56:03 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e048d6f6-f6aa-4491-ae06-9e22a8ff6691/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:56:03 user nova-compute[71731]: DEBUG nova.virt.libvirt.imagecache [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance e048d6f6-f6aa-4491-ae06-9e22a8ff6691 is backed by fa7c6a0f960510af81481294f43b184e85fb013f {{(pid=71731) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Apr 13 16:56:03 user nova-compute[71731]: WARNING nova.virt.libvirt.imagecache [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Unknown base file: /opt/stack/data/nova/instances/_base/e8d789a49cc1d9cec552fc5ab9d54dbf5c5f2c83
Apr 13 16:56:03 user nova-compute[71731]: WARNING nova.virt.libvirt.imagecache [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Unknown base file: /opt/stack/data/nova/instances/_base/57f83a61f4e1bf2db199b6b8e2d06ee1017f7214
Apr 13 16:56:03 user nova-compute[71731]: WARNING nova.virt.libvirt.imagecache [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Unknown base file: /opt/stack/data/nova/instances/_base/832132f66b5e60a24bd4fcc9f0ffbb286fc9ce5e
Apr 13 16:56:03 user nova-compute[71731]: WARNING nova.virt.libvirt.imagecache [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Unknown base file: /opt/stack/data/nova/instances/_base/8a473598334c2a118e9cfdc58efc2d7cf3d2962e
Apr 13 16:56:03 user nova-compute[71731]: WARNING nova.virt.libvirt.imagecache [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Unknown base file: /opt/stack/data/nova/instances/_base/007d2cff596f02e935e64ffbdcdeed367c4897db
Apr 13 16:56:03 user nova-compute[71731]: WARNING nova.virt.libvirt.imagecache [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Unknown base file: /opt/stack/data/nova/instances/_base/b58b04c5e7cd85acfb420c71e6db6c496cf2bcea
Apr 13 16:56:03 user nova-compute[71731]: WARNING nova.virt.libvirt.imagecache [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Unknown base file: /opt/stack/data/nova/instances/_base/08557ca53db1a83b3e13823c8beddc4d0d9419cb
Apr 13 16:56:03 user nova-compute[71731]: INFO nova.virt.libvirt.imagecache [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Active base files: /opt/stack/data/nova/instances/_base/fa7c6a0f960510af81481294f43b184e85fb013f /opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279
Apr 13 16:56:03 user nova-compute[71731]: INFO nova.virt.libvirt.imagecache [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Removable base files: /opt/stack/data/nova/instances/_base/e8d789a49cc1d9cec552fc5ab9d54dbf5c5f2c83 /opt/stack/data/nova/instances/_base/57f83a61f4e1bf2db199b6b8e2d06ee1017f7214 /opt/stack/data/nova/instances/_base/832132f66b5e60a24bd4fcc9f0ffbb286fc9ce5e /opt/stack/data/nova/instances/_base/8a473598334c2a118e9cfdc58efc2d7cf3d2962e /opt/stack/data/nova/instances/_base/007d2cff596f02e935e64ffbdcdeed367c4897db /opt/stack/data/nova/instances/_base/b58b04c5e7cd85acfb420c71e6db6c496cf2bcea /opt/stack/data/nova/instances/_base/08557ca53db1a83b3e13823c8beddc4d0d9419cb
Apr 13 16:56:03 user nova-compute[71731]: INFO nova.virt.libvirt.imagecache [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/e8d789a49cc1d9cec552fc5ab9d54dbf5c5f2c83
Apr 13 16:56:03 user nova-compute[71731]: INFO nova.virt.libvirt.imagecache [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/57f83a61f4e1bf2db199b6b8e2d06ee1017f7214
Apr 13 16:56:03 user nova-compute[71731]: INFO nova.virt.libvirt.imagecache [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/832132f66b5e60a24bd4fcc9f0ffbb286fc9ce5e
Apr 13 16:56:03 user nova-compute[71731]: INFO nova.virt.libvirt.imagecache [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/8a473598334c2a118e9cfdc58efc2d7cf3d2962e
Apr 13 16:56:03 user nova-compute[71731]: INFO nova.virt.libvirt.imagecache [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/007d2cff596f02e935e64ffbdcdeed367c4897db
Apr 13 16:56:03 user nova-compute[71731]: INFO nova.virt.libvirt.imagecache [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/b58b04c5e7cd85acfb420c71e6db6c496cf2bcea
Apr 13 16:56:03 user nova-compute[71731]: INFO nova.virt.libvirt.imagecache [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/08557ca53db1a83b3e13823c8beddc4d0d9419cb
Apr 13 16:56:03 user nova-compute[71731]: DEBUG nova.virt.libvirt.imagecache [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Verification complete {{(pid=71731) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Apr 13 16:56:03 user nova-compute[71731]: DEBUG nova.virt.libvirt.imagecache [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Verify swap images {{(pid=71731) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Apr 13 16:56:03 user nova-compute[71731]: DEBUG nova.virt.libvirt.imagecache [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Verify ephemeral images {{(pid=71731) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Apr 13 16:56:06 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:56:11 user nova-compute[71731]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681404956.896203, 37a39f40-d239-4716-91bc-3f562906bd1e => Stopped> {{(pid=71731) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 16:56:11 user nova-compute[71731]: INFO nova.compute.manager [-] [instance: 37a39f40-d239-4716-91bc-3f562906bd1e] VM Stopped (Lifecycle Event)
Apr 13 16:56:11 user nova-compute[71731]: DEBUG nova.compute.manager [None req-2235b419-3525-492e-9f4c-494dc0232756 None None] [instance: 37a39f40-d239-4716-91bc-3f562906bd1e] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:56:11 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 16:56:16 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 16:56:21 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 16:56:22 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:56:26 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:56:31 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:56:36 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:56:36 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:56:36 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71731) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 16:56:36 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 16:56:37 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:56:41 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager.update_available_resource {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:56:41 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:56:41 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:56:41 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:56:41 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Auditing locally available compute resources for user (node: user) {{(pid=71731) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 16:56:41 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e048d6f6-f6aa-4491-ae06-9e22a8ff6691/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:56:41 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e048d6f6-f6aa-4491-ae06-9e22a8ff6691/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:56:41 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e048d6f6-f6aa-4491-ae06-9e22a8ff6691/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:56:41 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e048d6f6-f6aa-4491-ae06-9e22a8ff6691/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:56:41 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3af23ff8-4e10-4fbf-a86e-bda842f084ff/disk.rescue --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:56:41 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3af23ff8-4e10-4fbf-a86e-bda842f084ff/disk.rescue --force-share --output=json" returned: 0 in 0.141s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:56:41 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3af23ff8-4e10-4fbf-a86e-bda842f084ff/disk.rescue --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:56:41 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3af23ff8-4e10-4fbf-a86e-bda842f084ff/disk.rescue --force-share --output=json" returned: 0 in 0.136s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:56:41 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3af23ff8-4e10-4fbf-a86e-bda842f084ff/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:56:41 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3af23ff8-4e10-4fbf-a86e-bda842f084ff/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:56:41 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3af23ff8-4e10-4fbf-a86e-bda842f084ff/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:56:41 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 16:56:42 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3af23ff8-4e10-4fbf-a86e-bda842f084ff/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:56:42 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2d55cdd-c89c-4c59-afe1-49a33225af22/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:56:42 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2d55cdd-c89c-4c59-afe1-49a33225af22/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:56:42 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2d55cdd-c89c-4c59-afe1-49a33225af22/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:56:42 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2d55cdd-c89c-4c59-afe1-49a33225af22/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:56:42 user nova-compute[71731]: WARNING nova.virt.libvirt.driver [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 16:56:42 user nova-compute[71731]: WARNING nova.virt.libvirt.driver [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 16:56:42 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Hypervisor/Node resource view: name=user free_ram=8577MB free_disk=26.000091552734375GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71731) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 16:56:42 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:56:42 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:56:42 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance b2d55cdd-c89c-4c59-afe1-49a33225af22 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 16:56:42 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance 3af23ff8-4e10-4fbf-a86e-bda842f084ff actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 16:56:42 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance e048d6f6-f6aa-4491-ae06-9e22a8ff6691 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 16:56:42 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=71731) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 16:56:42 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Final resource view: name=user phys_ram=16023MB used_ram=896MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=71731) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 16:56:42 user nova-compute[71731]: DEBUG nova.compute.provider_tree [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Inventory has not changed in ProviderTree for provider: cb6b1a64-0c24-4e2d-af1e-16576ca9165c {{(pid=71731) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 16:56:42 user nova-compute[71731]: DEBUG nova.scheduler.client.report [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Inventory has not changed for provider cb6b1a64-0c24-4e2d-af1e-16576ca9165c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71731) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 16:56:43 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Compute_service record updated for user:user {{(pid=71731) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 16:56:43 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.258s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:56:45 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:56:45 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:56:45 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Starting heal instance info cache {{(pid=71731) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 16:56:45 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Rebuilding the list of instances to heal {{(pid=71731) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 13 16:56:45 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Acquiring lock "refresh_cache-b2d55cdd-c89c-4c59-afe1-49a33225af22" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 16:56:45 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Acquired lock "refresh_cache-b2d55cdd-c89c-4c59-afe1-49a33225af22" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 16:56:45 user nova-compute[71731]: DEBUG nova.network.neutron [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] [instance: b2d55cdd-c89c-4c59-afe1-49a33225af22] Forcefully refreshing network info cache for instance {{(pid=71731) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 16:56:45 user nova-compute[71731]: DEBUG nova.objects.instance [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lazy-loading 'info_cache' on Instance uuid b2d55cdd-c89c-4c59-afe1-49a33225af22 {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:56:45 user nova-compute[71731]: DEBUG nova.network.neutron [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] [instance: b2d55cdd-c89c-4c59-afe1-49a33225af22] Updating instance_info_cache with network_info: [{"id": "31e1957f-9bd1-42ae-a2ac-954b49ca15f1", "address": "fa:16:3e:81:e2:10", "network": {"id": "2a5b69f1-fc5b-4c33-a9eb-12a4d9293500", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2137344591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "846732ecb7e047128b4684972d3cd8c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31e1957f-9b", "ovs_interfaceid": "31e1957f-9bd1-42ae-a2ac-954b49ca15f1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:56:45 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Releasing lock "refresh_cache-b2d55cdd-c89c-4c59-afe1-49a33225af22" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 16:56:45 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] [instance: b2d55cdd-c89c-4c59-afe1-49a33225af22] Updated the network info_cache for instance {{(pid=71731) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 16:56:45 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:56:45 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:56:45 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:56:45 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:56:45 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Cleaning up deleted instances {{(pid=71731) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 13 16:56:45 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] There are 0 instances to clean {{(pid=71731) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 13 16:56:46 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 16:56:48 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-049a4716-fb58-4d23-8331-9f7c36649f42 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Acquiring lock "e048d6f6-f6aa-4491-ae06-9e22a8ff6691" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:56:48 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-049a4716-fb58-4d23-8331-9f7c36649f42 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lock "e048d6f6-f6aa-4491-ae06-9e22a8ff6691" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:56:48 user nova-compute[71731]: DEBUG nova.objects.instance [None req-049a4716-fb58-4d23-8331-9f7c36649f42 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lazy-loading 'flavor' on Instance uuid e048d6f6-f6aa-4491-ae06-9e22a8ff6691 {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:56:48 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-049a4716-fb58-4d23-8331-9f7c36649f42 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lock "e048d6f6-f6aa-4491-ae06-9e22a8ff6691" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:56:48 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-049a4716-fb58-4d23-8331-9f7c36649f42 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Acquiring lock "e048d6f6-f6aa-4491-ae06-9e22a8ff6691" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:56:48 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-049a4716-fb58-4d23-8331-9f7c36649f42 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lock "e048d6f6-f6aa-4491-ae06-9e22a8ff6691" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:56:48 user nova-compute[71731]: INFO nova.compute.manager [None req-049a4716-fb58-4d23-8331-9f7c36649f42 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] [instance: e048d6f6-f6aa-4491-ae06-9e22a8ff6691] Attaching volume 52d252b7-6e23-4733-bf50-80e9ff903f75 to /dev/vdb
Apr 13 16:56:49 user nova-compute[71731]: DEBUG os_brick.utils [None req-049a4716-fb58-4d23-8331-9f7c36649f42 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 16:56:49 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:56:49 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:56:49 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[acfa92d1-d4c6-44c0-b6d7-604f0b9830e3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:81501d91421\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:56:49 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:56:49 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:56:49 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[00381a37-8020-46d8-8eef-e283a0ec82a2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:56:49 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:56:49 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:56:49 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4dc0464-157e-4e7c-bd2e-8b78f715bdf1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:56:49 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[e534f867-632b-4874-b876-461d45fd4d2d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:56:49 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-049a4716-fb58-4d23-8331-9f7c36649f42 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Running cmd (subprocess): nvme version {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:56:49 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-049a4716-fb58-4d23-8331-9f7c36649f42 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] 'nvme version' failed. Not Retrying. {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 16:56:49 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.nvmeof [None req-049a4716-fb58-4d23-8331-9f7c36649f42 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] nvme not present on system {{(pid=71731) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 16:56:49 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:56:49 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 16:56:49 user nova-compute[71731]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 16:56:49 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[2151bbc2-e090-4b9a-b14b-6f8206e5ffd2]: (4, '') {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:56:49 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.lightos [None req-049a4716-fb58-4d23-8331-9f7c36649f42 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71731) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 16:56:49 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.lightos [None req-049a4716-fb58-4d23-8331-9f7c36649f42 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71731) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 16:56:49 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.lightos [None req-049a4716-fb58-4d23-8331-9f7c36649f42 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] LIGHTOS: no hostnqn found. {{(pid=71731) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 16:56:49 user nova-compute[71731]: DEBUG os_brick.utils [None req-049a4716-fb58-4d23-8331-9f7c36649f42 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:81501d91421', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 16:56:49 user nova-compute[71731]: DEBUG nova.virt.block_device [None req-049a4716-fb58-4d23-8331-9f7c36649f42 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] [instance: e048d6f6-f6aa-4491-ae06-9e22a8ff6691] Updating existing volume attachment record: 94bca0bb-782d-43c9-a368-df54c5e99e1d {{(pid=71731) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 16:56:51 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:56:51 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-524f1483-ad93-4989-a202-4e2db84ef9f0 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Acquiring lock "3af23ff8-4e10-4fbf-a86e-bda842f084ff" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:56:51 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-524f1483-ad93-4989-a202-4e2db84ef9f0 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lock "3af23ff8-4e10-4fbf-a86e-bda842f084ff" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:56:51 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-524f1483-ad93-4989-a202-4e2db84ef9f0 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Acquiring lock "3af23ff8-4e10-4fbf-a86e-bda842f084ff-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:56:51 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-524f1483-ad93-4989-a202-4e2db84ef9f0 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lock "3af23ff8-4e10-4fbf-a86e-bda842f084ff-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:56:51 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-524f1483-ad93-4989-a202-4e2db84ef9f0 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lock "3af23ff8-4e10-4fbf-a86e-bda842f084ff-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:56:51 user nova-compute[71731]: INFO nova.compute.manager [None req-524f1483-ad93-4989-a202-4e2db84ef9f0 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] [instance: 3af23ff8-4e10-4fbf-a86e-bda842f084ff] Terminating instance
Apr 13 16:56:51 user nova-compute[71731]: DEBUG nova.compute.manager [None req-524f1483-ad93-4989-a202-4e2db84ef9f0 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] [instance: 3af23ff8-4e10-4fbf-a86e-bda842f084ff] Start destroying the instance on the hypervisor. {{(pid=71731) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 16:56:51 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:56:52 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:56:52 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:56:52 user nova-compute[71731]: DEBUG nova.compute.manager [req-72ac5136-aa97-4524-b4f0-022a111cbf41 req-663b4ee0-fe3f-4f3f-99fd-bf390cfed868 service nova] [instance: 3af23ff8-4e10-4fbf-a86e-bda842f084ff] Received event network-vif-unplugged-b22086e3-8769-494c-af86-228dba7b3638 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:56:52 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-72ac5136-aa97-4524-b4f0-022a111cbf41 req-663b4ee0-fe3f-4f3f-99fd-bf390cfed868 service nova] Acquiring lock "3af23ff8-4e10-4fbf-a86e-bda842f084ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:56:52 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-72ac5136-aa97-4524-b4f0-022a111cbf41 req-663b4ee0-fe3f-4f3f-99fd-bf390cfed868 service nova] Lock "3af23ff8-4e10-4fbf-a86e-bda842f084ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:56:52 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-72ac5136-aa97-4524-b4f0-022a111cbf41 req-663b4ee0-fe3f-4f3f-99fd-bf390cfed868 service nova] Lock "3af23ff8-4e10-4fbf-a86e-bda842f084ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:56:52 user nova-compute[71731]: DEBUG nova.compute.manager [req-72ac5136-aa97-4524-b4f0-022a111cbf41 req-663b4ee0-fe3f-4f3f-99fd-bf390cfed868 service nova] [instance: 3af23ff8-4e10-4fbf-a86e-bda842f084ff] No waiting events found dispatching network-vif-unplugged-b22086e3-8769-494c-af86-228dba7b3638 {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:56:52 user nova-compute[71731]: DEBUG nova.compute.manager [req-72ac5136-aa97-4524-b4f0-022a111cbf41 req-663b4ee0-fe3f-4f3f-99fd-bf390cfed868 service nova] [instance: 3af23ff8-4e10-4fbf-a86e-bda842f084ff] Received event network-vif-unplugged-b22086e3-8769-494c-af86-228dba7b3638 for instance with task_state deleting. {{(pid=71731) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 16:56:52 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:56:52 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:56:52 user nova-compute[71731]: INFO nova.virt.libvirt.driver [-] [instance: 3af23ff8-4e10-4fbf-a86e-bda842f084ff] Instance destroyed successfully.
Apr 13 16:56:52 user nova-compute[71731]: DEBUG nova.objects.instance [None req-524f1483-ad93-4989-a202-4e2db84ef9f0 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lazy-loading 'resources' on Instance uuid 3af23ff8-4e10-4fbf-a86e-bda842f084ff {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:56:52 user nova-compute[71731]: DEBUG nova.virt.libvirt.vif [None req-524f1483-ad93-4989-a202-4e2db84ef9f0 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T16:40:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-297516343',display_name='tempest-ServerRescueNegativeTestJSON-server-297516343',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-297516343',id=37,image_ref='708622a9-7465-4492-ade8-b827198f7e30',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-13T16:42:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='846732ecb7e047128b4684972d3cd8c6',ramdisk_id='',reservation_id='r-unv20yee',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='708622a9-7465-4492-ade8-b827198f7e30',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-84287455',owner_user_name='tempest-ServerRescueNegativeTestJSON-84287455-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T16:42:50Z,user_data=None,user_id='0c7f54723c494e05ada117353c0790cb',uuid=3af23ff8-4e10-4fbf-a86e-bda842f084ff,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "b22086e3-8769-494c-af86-228dba7b3638", "address": "fa:16:3e:84:ee:e5", "network": {"id": "2a5b69f1-fc5b-4c33-a9eb-12a4d9293500", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2137344591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "846732ecb7e047128b4684972d3cd8c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb22086e3-87", "ovs_interfaceid": "b22086e3-8769-494c-af86-228dba7b3638", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 16:56:52 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-524f1483-ad93-4989-a202-4e2db84ef9f0 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Converting VIF {"id": "b22086e3-8769-494c-af86-228dba7b3638", "address": "fa:16:3e:84:ee:e5", "network": {"id": "2a5b69f1-fc5b-4c33-a9eb-12a4d9293500", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2137344591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "846732ecb7e047128b4684972d3cd8c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb22086e3-87", "ovs_interfaceid": "b22086e3-8769-494c-af86-228dba7b3638", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 16:56:52 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-524f1483-ad93-4989-a202-4e2db84ef9f0 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:84:ee:e5,bridge_name='br-int',has_traffic_filtering=True,id=b22086e3-8769-494c-af86-228dba7b3638,network=Network(2a5b69f1-fc5b-4c33-a9eb-12a4d9293500),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb22086e3-87') {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 16:56:52 user nova-compute[71731]: DEBUG os_vif [None req-524f1483-ad93-4989-a202-4e2db84ef9f0 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:84:ee:e5,bridge_name='br-int',has_traffic_filtering=True,id=b22086e3-8769-494c-af86-228dba7b3638,network=Network(2a5b69f1-fc5b-4c33-a9eb-12a4d9293500),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb22086e3-87') {{(pid=71731) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 16:56:52 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:56:52 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb22086e3-87, bridge=br-int, if_exists=True) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:56:52 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:56:52 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 16:56:52 user nova-compute[71731]: INFO os_vif [None req-524f1483-ad93-4989-a202-4e2db84ef9f0 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:84:ee:e5,bridge_name='br-int',has_traffic_filtering=True,id=b22086e3-8769-494c-af86-228dba7b3638,network=Network(2a5b69f1-fc5b-4c33-a9eb-12a4d9293500),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb22086e3-87')
Apr 13 16:56:52 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-524f1483-ad93-4989-a202-4e2db84ef9f0 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] [instance: 3af23ff8-4e10-4fbf-a86e-bda842f084ff] Deleting instance files /opt/stack/data/nova/instances/3af23ff8-4e10-4fbf-a86e-bda842f084ff_del
Apr 13 16:56:52 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-524f1483-ad93-4989-a202-4e2db84ef9f0 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] [instance: 3af23ff8-4e10-4fbf-a86e-bda842f084ff] Deletion of /opt/stack/data/nova/instances/3af23ff8-4e10-4fbf-a86e-bda842f084ff_del complete
Apr 13 16:56:52 user nova-compute[71731]: INFO nova.compute.manager [None req-524f1483-ad93-4989-a202-4e2db84ef9f0 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] [instance: 3af23ff8-4e10-4fbf-a86e-bda842f084ff] Took 0.90 seconds to destroy the instance on the hypervisor.
Apr 13 16:56:52 user nova-compute[71731]: DEBUG oslo.service.loopingcall [None req-524f1483-ad93-4989-a202-4e2db84ef9f0 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71731) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 16:56:52 user nova-compute[71731]: DEBUG nova.compute.manager [-] [instance: 3af23ff8-4e10-4fbf-a86e-bda842f084ff] Deallocating network for instance {{(pid=71731) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 16:56:52 user nova-compute[71731]: DEBUG nova.network.neutron [-] [instance: 3af23ff8-4e10-4fbf-a86e-bda842f084ff] deallocate_for_instance() {{(pid=71731) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 16:56:53 user nova-compute[71731]: DEBUG nova.network.neutron [-] [instance: 3af23ff8-4e10-4fbf-a86e-bda842f084ff] Updating instance_info_cache with network_info: [] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:56:53 user nova-compute[71731]: INFO nova.compute.manager [-] [instance: 3af23ff8-4e10-4fbf-a86e-bda842f084ff] Took 0.45 seconds to deallocate network for instance.
Apr 13 16:56:53 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-524f1483-ad93-4989-a202-4e2db84ef9f0 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:56:53 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-524f1483-ad93-4989-a202-4e2db84ef9f0 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:56:53 user nova-compute[71731]: DEBUG nova.compute.manager [req-2c4e6ace-da4b-4e4a-b014-1f23cbf1a83b req-57b1bfbc-9dcf-4750-ba53-e4728fd7caec service nova] [instance: 3af23ff8-4e10-4fbf-a86e-bda842f084ff] Received event network-vif-deleted-b22086e3-8769-494c-af86-228dba7b3638 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:56:53 user nova-compute[71731]: DEBUG nova.virt.libvirt.volume.iscsi [None req-049a4716-fb58-4d23-8331-9f7c36649f42 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] [instance: e048d6f6-f6aa-4491-ae06-9e22a8ff6691] Calling os-brick to attach iSCSI Volume {{(pid=71731) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 16:56:53 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-049a4716-fb58-4d23-8331-9f7c36649f42 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8cf0118790>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:52d252b7-6e23-4733-bf50-80e9ff903f75', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KCpXvRDk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 16:56:53 user nova-compute[71731]: WARNING os_brick.initiator.connectors.base [None req-049a4716-fb58-4d23-8331-9f7c36649f42 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 16:56:53 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-049a4716-fb58-4d23-8331-9f7c36649f42 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 16:56:53 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-049a4716-fb58-4d23-8331-9f7c36649f42 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 16:56:53 user nova-compute[71731]: WARNING os_brick.initiator.connectors.base [None req-049a4716-fb58-4d23-8331-9f7c36649f42 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 16:56:53 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-049a4716-fb58-4d23-8331-9f7c36649f42 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:52d252b7-6e23-4733-bf50-80e9ff903f75" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 16:56:53 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-049a4716-fb58-4d23-8331-9f7c36649f42 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:52d252b7-6e23-4733-bf50-80e9ff903f75" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 16:56:53 user nova-compute[71731]: INFO os_brick.initiator.connectors.iscsi [None req-049a4716-fb58-4d23-8331-9f7c36649f42 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 16:56:53 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52d252b7-6e23-4733-bf50-80e9ff903f75 -p 172.16.0.220:3260 {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:56:53 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52d252b7-6e23-4733-bf50-80e9ff903f75 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:56:53 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cb3124b-d64b-4397-b7ea-57dac157e246]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:56:53 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-049a4716-fb58-4d23-8331-9f7c36649f42 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 16:56:53 user nova-compute[71731]:  {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:56:53 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52d252b7-6e23-4733-bf50-80e9ff903f75 -p 172.16.0.220:3260 --interface default --op new {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:56:53 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52d252b7-6e23-4733-bf50-80e9ff903f75 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:56:53 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[74823127-b4c0-4d4e-81ca-1c3c78c53867]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:52d252b7-6e23-4733-bf50-80e9ff903f75] added\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:56:53 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-049a4716-fb58-4d23-8331-9f7c36649f42 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:52d252b7-6e23-4733-bf50-80e9ff903f75] added
Apr 13 16:56:53 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:56:53 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52d252b7-6e23-4733-bf50-80e9ff903f75 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:56:53 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52d252b7-6e23-4733-bf50-80e9ff903f75 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:56:53 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[43d23f95-28fb-428a-ad67-0c2ba227b9c5]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:56:53 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-049a4716-fb58-4d23-8331-9f7c36649f42 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:56:53 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52d252b7-6e23-4733-bf50-80e9ff903f75 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:56:53 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52d252b7-6e23-4733-bf50-80e9ff903f75 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:56:53 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[3852b73c-5fa1-4ad7-859a-14c5a7d68ab7]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:56:53 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-049a4716-fb58-4d23-8331-9f7c36649f42 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:56:53 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52d252b7-6e23-4733-bf50-80e9ff903f75 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KCpXvRDk {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:56:53 user nova-compute[71731]: DEBUG nova.compute.provider_tree [None req-524f1483-ad93-4989-a202-4e2db84ef9f0 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Inventory has not changed in ProviderTree for provider: cb6b1a64-0c24-4e2d-af1e-16576ca9165c {{(pid=71731) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 16:56:53 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52d252b7-6e23-4733-bf50-80e9ff903f75 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KCpXvRDk" returned: 0 in 0.017s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:56:53 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[08b08ff2-f7a1-4117-bcc5-c15c5e4ce12b]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:56:53 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-049a4716-fb58-4d23-8331-9f7c36649f42 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KCpXvRDk'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:56:53 user nova-compute[71731]: DEBUG nova.scheduler.client.report [None req-524f1483-ad93-4989-a202-4e2db84ef9f0 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Inventory has not changed for provider cb6b1a64-0c24-4e2d-af1e-16576ca9165c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71731) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 16:56:53 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52d252b7-6e23-4733-bf50-80e9ff903f75 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:56:53 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52d252b7-6e23-4733-bf50-80e9ff903f75 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:56:53 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[201b5faa-d0ea-4d35-b120-f879e452613a]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:56:53 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-049a4716-fb58-4d23-8331-9f7c36649f42 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:56:53 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:56:53 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-524f1483-ad93-4989-a202-4e2db84ef9f0 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.198s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:56:53 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:56:53 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[93e6f283-0737-468e-b6a6-3e16e192a0ea]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:56:53 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-049a4716-fb58-4d23-8331-9f7c36649f42 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Apr 13 16:56:53 user nova-compute[71731]:  {{(pid=71731) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 16:56:53 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-049a4716-fb58-4d23-8331-9f7c36649f42 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Apr 13 16:56:53 user nova-compute[71731]:  {{(pid=71731) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 16:56:53 user nova-compute[71731]: WARNING os_brick.initiator.connectors.iscsi [None req-049a4716-fb58-4d23-8331-9f7c36649f42 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Apr 13 16:56:53 user nova-compute[71731]: 
Apr 13 16:56:53 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52d252b7-6e23-4733-bf50-80e9ff903f75 -p 172.16.0.220:3260 --login {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:56:53 user nova-compute[71731]: INFO nova.scheduler.client.report [None req-524f1483-ad93-4989-a202-4e2db84ef9f0 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Deleted allocations for instance 3af23ff8-4e10-4fbf-a86e-bda842f084ff
Apr 13 16:56:53 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52d252b7-6e23-4733-bf50-80e9ff903f75 -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:56:53 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f3857af-3d19-43ca-a625-1e95c7da8a5d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:52d252b7-6e23-4733-bf50-80e9ff903f75, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:52d252b7-6e23-4733-bf50-80e9ff903f75, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:56:53 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-049a4716-fb58-4d23-8331-9f7c36649f42 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:52d252b7-6e23-4733-bf50-80e9ff903f75, portal: 172.16.0.220,3260]
Apr 13 16:56:53 user nova-compute[71731]: Login to [iface: default, target: iqn.2010-10.org.openstack:52d252b7-6e23-4733-bf50-80e9ff903f75, portal: 172.16.0.220,3260] successful.
Apr 13 16:56:53 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:56:53 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52d252b7-6e23-4733-bf50-80e9ff903f75 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:56:53 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52d252b7-6e23-4733-bf50-80e9ff903f75 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:56:53 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c3cd079-56fa-45b0-9c5a-4b2132dab870]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:56:53 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-049a4716-fb58-4d23-8331-9f7c36649f42 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:56:53 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:56:53 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-524f1483-ad93-4989-a202-4e2db84ef9f0 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lock "3af23ff8-4e10-4fbf-a86e-bda842f084ff" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.728s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:56:53 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:56:53 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[330a5ce6-454e-48c5-b5b3-67b8f140e1cd]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52d252b7-6e23-4733-bf50-80e9ff903f75 (non-flash)\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:56:53 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-049a4716-fb58-4d23-8331-9f7c36649f42 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52d252b7-6e23-4733-bf50-80e9ff903f75 (non-flash)
Apr 13 16:56:53 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 16:56:53 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-049a4716-fb58-4d23-8331-9f7c36649f42 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52d252b7-6e23-4733-bf50-80e9ff903f75 (non-flash)
Apr 13 16:56:53 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 16:56:53 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-049a4716-fb58-4d23-8331-9f7c36649f42 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:52d252b7-6e23-4733-bf50-80e9ff903f75" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.283s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 16:56:53 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-049a4716-fb58-4d23-8331-9f7c36649f42 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Connected to 172.16.0.220:3260 {{(pid=71731) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 16:56:53 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-049a4716-fb58-4d23-8331-9f7c36649f42 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] HCTL ('33', '-', '-', 0) found on session 48 with lun 0 {{(pid=71731) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 16:56:53 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-049a4716-fb58-4d23-8331-9f7c36649f42 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71731) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 16:56:53 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:56:53 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:56:53 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b852a5c-dfd6-4ede-b925-ba1ca27992c7]: (4, ('- - 0', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:56:53 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-049a4716-fb58-4d23-8331-9f7c36649f42 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Searching for a device in session 48 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71731) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 16:56:53 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-049a4716-fb58-4d23-8331-9f7c36649f42 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:52d252b7-6e23-4733-bf50-80e9ff903f75', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KCpXvRDk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71731) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 16:56:54 user nova-compute[71731]: DEBUG nova.compute.manager [req-919a691f-3969-4750-ab25-656897ec229d req-5be7ec1b-f324-4b91-ada9-d1f89b0ae59a service nova] [instance: 3af23ff8-4e10-4fbf-a86e-bda842f084ff] Received event network-vif-plugged-b22086e3-8769-494c-af86-228dba7b3638 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:56:54 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-919a691f-3969-4750-ab25-656897ec229d req-5be7ec1b-f324-4b91-ada9-d1f89b0ae59a service nova] Acquiring lock "3af23ff8-4e10-4fbf-a86e-bda842f084ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:56:54 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-919a691f-3969-4750-ab25-656897ec229d req-5be7ec1b-f324-4b91-ada9-d1f89b0ae59a service nova] Lock "3af23ff8-4e10-4fbf-a86e-bda842f084ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:56:54 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-919a691f-3969-4750-ab25-656897ec229d req-5be7ec1b-f324-4b91-ada9-d1f89b0ae59a service nova] Lock "3af23ff8-4e10-4fbf-a86e-bda842f084ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:56:54 user nova-compute[71731]: DEBUG nova.compute.manager [req-919a691f-3969-4750-ab25-656897ec229d req-5be7ec1b-f324-4b91-ada9-d1f89b0ae59a service nova] [instance: 3af23ff8-4e10-4fbf-a86e-bda842f084ff] No waiting events found dispatching network-vif-plugged-b22086e3-8769-494c-af86-228dba7b3638 {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:56:54 user nova-compute[71731]: WARNING nova.compute.manager [req-919a691f-3969-4750-ab25-656897ec229d req-5be7ec1b-f324-4b91-ada9-d1f89b0ae59a service nova] [instance: 3af23ff8-4e10-4fbf-a86e-bda842f084ff] Received unexpected event network-vif-plugged-b22086e3-8769-494c-af86-228dba7b3638 for instance with vm_state deleted and task_state None.
Apr 13 16:56:54 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-049a4716-fb58-4d23-8331-9f7c36649f42 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.315s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 16:56:54 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-049a4716-fb58-4d23-8331-9f7c36649f42 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] <== connect_volume: return (1317ms) {'type': 'block', 'scsi_wwn': '26636653031326634', 'path': '/dev/sdb'} {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 16:56:54 user nova-compute[71731]: DEBUG nova.virt.libvirt.volume.iscsi [None req-049a4716-fb58-4d23-8331-9f7c36649f42 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] [instance: e048d6f6-f6aa-4491-ae06-9e22a8ff6691] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26636653031326634', 'path': '/dev/sdb'} {{(pid=71731) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 16:56:54 user nova-compute[71731]: DEBUG nova.objects.instance [None req-049a4716-fb58-4d23-8331-9f7c36649f42 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lazy-loading 'flavor' on Instance uuid e048d6f6-f6aa-4491-ae06-9e22a8ff6691 {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:56:54 user nova-compute[71731]: DEBUG nova.virt.libvirt.guest [None req-049a4716-fb58-4d23-8331-9f7c36649f42 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] attach device xml: <disk type="block" device="disk">
Apr 13 16:56:54 user nova-compute[71731]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 16:56:54 user nova-compute[71731]:   <source dev="/dev/sdb"/>
Apr 13 16:56:54 user nova-compute[71731]:   <target dev="vdb" bus="virtio"/>
Apr 13 16:56:54 user nova-compute[71731]:   <serial>52d252b7-6e23-4733-bf50-80e9ff903f75</serial>
Apr 13 16:56:54 user nova-compute[71731]: </disk>
Apr 13 16:56:54 user nova-compute[71731]:  {{(pid=71731) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 13 16:56:55 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-049a4716-fb58-4d23-8331-9f7c36649f42 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] No BDM found with device name vda, not building metadata. {{(pid=71731) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 16:56:55 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-049a4716-fb58-4d23-8331-9f7c36649f42 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71731) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 16:56:55 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-049a4716-fb58-4d23-8331-9f7c36649f42 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] No VIF found with MAC fa:16:3e:11:9f:98, not building metadata {{(pid=71731) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 16:56:55 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-049a4716-fb58-4d23-8331-9f7c36649f42 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lock "e048d6f6-f6aa-4491-ae06-9e22a8ff6691" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.442s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:56:57 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:56:58 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:56:59 user nova-compute[71731]: DEBUG nova.compute.manager [req-82cf2eff-323a-4082-8ef0-25b9a865a437 req-0e232cc2-c451-4e10-99ed-7e3130ae6b95 service nova] [instance: e048d6f6-f6aa-4491-ae06-9e22a8ff6691] Received event network-changed-4fb36f71-2601-4c01-9eba-514f5f2af95f {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:56:59 user nova-compute[71731]: DEBUG nova.compute.manager [req-82cf2eff-323a-4082-8ef0-25b9a865a437 req-0e232cc2-c451-4e10-99ed-7e3130ae6b95 service nova] [instance: e048d6f6-f6aa-4491-ae06-9e22a8ff6691] Refreshing instance network info cache due to event network-changed-4fb36f71-2601-4c01-9eba-514f5f2af95f. {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 16:56:59 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-82cf2eff-323a-4082-8ef0-25b9a865a437 req-0e232cc2-c451-4e10-99ed-7e3130ae6b95 service nova] Acquiring lock "refresh_cache-e048d6f6-f6aa-4491-ae06-9e22a8ff6691" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 16:56:59 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-82cf2eff-323a-4082-8ef0-25b9a865a437 req-0e232cc2-c451-4e10-99ed-7e3130ae6b95 service nova] Acquired lock "refresh_cache-e048d6f6-f6aa-4491-ae06-9e22a8ff6691" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 16:56:59 user nova-compute[71731]: DEBUG nova.network.neutron [req-82cf2eff-323a-4082-8ef0-25b9a865a437 req-0e232cc2-c451-4e10-99ed-7e3130ae6b95 service nova] [instance: e048d6f6-f6aa-4491-ae06-9e22a8ff6691] Refreshing network info cache for port 4fb36f71-2601-4c01-9eba-514f5f2af95f {{(pid=71731) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 16:57:00 user nova-compute[71731]: DEBUG nova.network.neutron [req-82cf2eff-323a-4082-8ef0-25b9a865a437 req-0e232cc2-c451-4e10-99ed-7e3130ae6b95 service nova] [instance: e048d6f6-f6aa-4491-ae06-9e22a8ff6691] Updated VIF entry in instance network info cache for port 4fb36f71-2601-4c01-9eba-514f5f2af95f. {{(pid=71731) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 16:57:00 user nova-compute[71731]: DEBUG nova.network.neutron [req-82cf2eff-323a-4082-8ef0-25b9a865a437 req-0e232cc2-c451-4e10-99ed-7e3130ae6b95 service nova] [instance: e048d6f6-f6aa-4491-ae06-9e22a8ff6691] Updating instance_info_cache with network_info: [{"id": "4fb36f71-2601-4c01-9eba-514f5f2af95f", "address": "fa:16:3e:11:9f:98", "network": {"id": "0c6a5f46-e53b-4b4c-806e-b2617ba3ef35", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1984894004-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.143", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7edf468527d84954a943bb4c1f7ff54d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fb36f71-26", "ovs_interfaceid": "4fb36f71-2601-4c01-9eba-514f5f2af95f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:57:00 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-82cf2eff-323a-4082-8ef0-25b9a865a437 req-0e232cc2-c451-4e10-99ed-7e3130ae6b95 service nova] Releasing lock "refresh_cache-e048d6f6-f6aa-4491-ae06-9e22a8ff6691" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 16:57:01 user nova-compute[71731]: DEBUG nova.compute.manager [req-6f2a76c8-6056-4432-a185-18a6100e2b5d req-830c9991-9941-4c4a-9e6d-c3e2151cfe31 service nova] [instance: e048d6f6-f6aa-4491-ae06-9e22a8ff6691] Received event network-changed-4fb36f71-2601-4c01-9eba-514f5f2af95f {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:57:01 user nova-compute[71731]: DEBUG nova.compute.manager [req-6f2a76c8-6056-4432-a185-18a6100e2b5d req-830c9991-9941-4c4a-9e6d-c3e2151cfe31 service nova] [instance: e048d6f6-f6aa-4491-ae06-9e22a8ff6691] Refreshing instance network info cache due to event network-changed-4fb36f71-2601-4c01-9eba-514f5f2af95f. {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 16:57:01 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-6f2a76c8-6056-4432-a185-18a6100e2b5d req-830c9991-9941-4c4a-9e6d-c3e2151cfe31 service nova] Acquiring lock "refresh_cache-e048d6f6-f6aa-4491-ae06-9e22a8ff6691" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 16:57:01 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-6f2a76c8-6056-4432-a185-18a6100e2b5d req-830c9991-9941-4c4a-9e6d-c3e2151cfe31 service nova] Acquired lock "refresh_cache-e048d6f6-f6aa-4491-ae06-9e22a8ff6691" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 16:57:01 user nova-compute[71731]: DEBUG nova.network.neutron [req-6f2a76c8-6056-4432-a185-18a6100e2b5d req-830c9991-9941-4c4a-9e6d-c3e2151cfe31 service nova] [instance: e048d6f6-f6aa-4491-ae06-9e22a8ff6691] Refreshing network info cache for port 4fb36f71-2601-4c01-9eba-514f5f2af95f {{(pid=71731) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 16:57:01 user nova-compute[71731]: DEBUG nova.network.neutron [req-6f2a76c8-6056-4432-a185-18a6100e2b5d req-830c9991-9941-4c4a-9e6d-c3e2151cfe31 service nova] [instance: e048d6f6-f6aa-4491-ae06-9e22a8ff6691] Updated VIF entry in instance network info cache for port 4fb36f71-2601-4c01-9eba-514f5f2af95f. {{(pid=71731) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 16:57:01 user nova-compute[71731]: DEBUG nova.network.neutron [req-6f2a76c8-6056-4432-a185-18a6100e2b5d req-830c9991-9941-4c4a-9e6d-c3e2151cfe31 service nova] [instance: e048d6f6-f6aa-4491-ae06-9e22a8ff6691] Updating instance_info_cache with network_info: [{"id": "4fb36f71-2601-4c01-9eba-514f5f2af95f", "address": "fa:16:3e:11:9f:98", "network": {"id": "0c6a5f46-e53b-4b4c-806e-b2617ba3ef35", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1984894004-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.143", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7edf468527d84954a943bb4c1f7ff54d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fb36f71-26", "ovs_interfaceid": "4fb36f71-2601-4c01-9eba-514f5f2af95f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:57:02 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-6f2a76c8-6056-4432-a185-18a6100e2b5d req-830c9991-9941-4c4a-9e6d-c3e2151cfe31 service nova] Releasing lock "refresh_cache-e048d6f6-f6aa-4491-ae06-9e22a8ff6691" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 16:57:02 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:57:02 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:57:04 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-c7285f7e-a7ed-4856-95ba-e4a5cc5f917e tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Acquiring lock "e048d6f6-f6aa-4491-ae06-9e22a8ff6691" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:57:04 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-c7285f7e-a7ed-4856-95ba-e4a5cc5f917e tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lock "e048d6f6-f6aa-4491-ae06-9e22a8ff6691" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:57:04 user nova-compute[71731]: INFO nova.compute.manager [None req-c7285f7e-a7ed-4856-95ba-e4a5cc5f917e tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] [instance: e048d6f6-f6aa-4491-ae06-9e22a8ff6691] Rebooting instance
Apr 13 16:57:04 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-c7285f7e-a7ed-4856-95ba-e4a5cc5f917e tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Acquiring lock "refresh_cache-e048d6f6-f6aa-4491-ae06-9e22a8ff6691" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 16:57:04 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-c7285f7e-a7ed-4856-95ba-e4a5cc5f917e tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Acquired lock "refresh_cache-e048d6f6-f6aa-4491-ae06-9e22a8ff6691" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 16:57:04 user nova-compute[71731]: DEBUG nova.network.neutron [None req-c7285f7e-a7ed-4856-95ba-e4a5cc5f917e tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] [instance: e048d6f6-f6aa-4491-ae06-9e22a8ff6691] Building network info cache for instance {{(pid=71731) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 16:57:04 user nova-compute[71731]: DEBUG nova.network.neutron [None req-c7285f7e-a7ed-4856-95ba-e4a5cc5f917e tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] [instance: e048d6f6-f6aa-4491-ae06-9e22a8ff6691] Updating instance_info_cache with network_info: [{"id": "4fb36f71-2601-4c01-9eba-514f5f2af95f", "address": "fa:16:3e:11:9f:98", "network": {"id": "0c6a5f46-e53b-4b4c-806e-b2617ba3ef35", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1984894004-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.143", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7edf468527d84954a943bb4c1f7ff54d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fb36f71-26", "ovs_interfaceid": "4fb36f71-2601-4c01-9eba-514f5f2af95f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:57:04 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-c7285f7e-a7ed-4856-95ba-e4a5cc5f917e tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Releasing lock "refresh_cache-e048d6f6-f6aa-4491-ae06-9e22a8ff6691" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 16:57:04 user nova-compute[71731]: DEBUG nova.compute.manager [None req-c7285f7e-a7ed-4856-95ba-e4a5cc5f917e tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] [instance: e048d6f6-f6aa-4491-ae06-9e22a8ff6691] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:57:04 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:57:04 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:57:04 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:57:04 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:57:05 user nova-compute[71731]: DEBUG nova.compute.manager [req-789d1c4f-46fb-43c6-99ca-ba743dc2f27f req-baef706f-fb0d-41ce-aa87-eef68d718b56 service nova] [instance: e048d6f6-f6aa-4491-ae06-9e22a8ff6691] Received event network-vif-unplugged-4fb36f71-2601-4c01-9eba-514f5f2af95f {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:57:05 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-789d1c4f-46fb-43c6-99ca-ba743dc2f27f req-baef706f-fb0d-41ce-aa87-eef68d718b56 service nova] Acquiring lock "e048d6f6-f6aa-4491-ae06-9e22a8ff6691-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:57:05 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-789d1c4f-46fb-43c6-99ca-ba743dc2f27f req-baef706f-fb0d-41ce-aa87-eef68d718b56 service nova] Lock "e048d6f6-f6aa-4491-ae06-9e22a8ff6691-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:57:05 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-789d1c4f-46fb-43c6-99ca-ba743dc2f27f req-baef706f-fb0d-41ce-aa87-eef68d718b56 service nova] Lock "e048d6f6-f6aa-4491-ae06-9e22a8ff6691-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:57:05 user nova-compute[71731]: DEBUG nova.compute.manager [req-789d1c4f-46fb-43c6-99ca-ba743dc2f27f req-baef706f-fb0d-41ce-aa87-eef68d718b56 service nova] [instance: e048d6f6-f6aa-4491-ae06-9e22a8ff6691] No waiting events found dispatching network-vif-unplugged-4fb36f71-2601-4c01-9eba-514f5f2af95f {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:57:05 user nova-compute[71731]: WARNING nova.compute.manager [req-789d1c4f-46fb-43c6-99ca-ba743dc2f27f req-baef706f-fb0d-41ce-aa87-eef68d718b56 service nova] [instance: e048d6f6-f6aa-4491-ae06-9e22a8ff6691] Received unexpected event network-vif-unplugged-4fb36f71-2601-4c01-9eba-514f5f2af95f for instance with vm_state active and task_state reboot_started_hard.
Apr 13 16:57:05 user nova-compute[71731]: INFO nova.virt.libvirt.driver [-] [instance: e048d6f6-f6aa-4491-ae06-9e22a8ff6691] Instance destroyed successfully.
Apr 13 16:57:05 user nova-compute[71731]: DEBUG nova.objects.instance [None req-c7285f7e-a7ed-4856-95ba-e4a5cc5f917e tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lazy-loading 'resources' on Instance uuid e048d6f6-f6aa-4491-ae06-9e22a8ff6691 {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:57:05 user nova-compute[71731]: DEBUG nova.virt.libvirt.vif [None req-c7285f7e-a7ed-4856-95ba-e4a5cc5f917e tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T16:54:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-2141029123',display_name='tempest-TestMinimumBasicScenario-server-2141029123',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-2141029123',id=42,image_ref='e81308c1-1e9d-43bf-bd21-d6a7d7856ff1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCJeR98CrX5Pyefe/rcz7c7swHCPLDeP62HQPhZNTY1lR3svV0j4RlALHIf9UrR6zTy6O2Onfsic7sNVnaIU+KNr9U5sJ8q1nmWzQ0dRWeAumpZeD0Chk2QSpA1BLE1qxA==',key_name='tempest-TestMinimumBasicScenario-810545990',keypairs=<?>,launch_index=0,launched_at=2023-04-13T16:55:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7edf468527d84954a943bb4c1f7ff54d',ramdisk_id='',reservation_id='r-8091fn2v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e81308c1-1e9d-43bf-bd21-d6a7d7856ff1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-419032150',owner_user_name='tempest-TestMinimumBasicScenario-419032150-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T16:57:05Z,user_data=None,user_id='91a450674d7046ae82f5dd182506c85b',uuid=e048d6f6-f6aa-4491-ae06-9e22a8ff6691,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4fb36f71-2601-4c01-9eba-514f5f2af95f", "address": "fa:16:3e:11:9f:98", "network": {"id": "0c6a5f46-e53b-4b4c-806e-b2617ba3ef35", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1984894004-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.143", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7edf468527d84954a943bb4c1f7ff54d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fb36f71-26", "ovs_interfaceid": "4fb36f71-2601-4c01-9eba-514f5f2af95f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 16:57:05 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-c7285f7e-a7ed-4856-95ba-e4a5cc5f917e tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Converting VIF {"id": "4fb36f71-2601-4c01-9eba-514f5f2af95f", "address": "fa:16:3e:11:9f:98", "network": {"id": "0c6a5f46-e53b-4b4c-806e-b2617ba3ef35", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1984894004-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.143", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7edf468527d84954a943bb4c1f7ff54d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fb36f71-26", "ovs_interfaceid": "4fb36f71-2601-4c01-9eba-514f5f2af95f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 16:57:05 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-c7285f7e-a7ed-4856-95ba-e4a5cc5f917e tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:11:9f:98,bridge_name='br-int',has_traffic_filtering=True,id=4fb36f71-2601-4c01-9eba-514f5f2af95f,network=Network(0c6a5f46-e53b-4b4c-806e-b2617ba3ef35),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4fb36f71-26') {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 16:57:05 user nova-compute[71731]: DEBUG os_vif [None req-c7285f7e-a7ed-4856-95ba-e4a5cc5f917e tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:11:9f:98,bridge_name='br-int',has_traffic_filtering=True,id=4fb36f71-2601-4c01-9eba-514f5f2af95f,network=Network(0c6a5f46-e53b-4b4c-806e-b2617ba3ef35),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4fb36f71-26') {{(pid=71731) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 16:57:05 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:57:05 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4fb36f71-26, bridge=br-int, if_exists=True) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:57:05 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:57:05 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 16:57:05 user nova-compute[71731]: INFO os_vif [None req-c7285f7e-a7ed-4856-95ba-e4a5cc5f917e tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:11:9f:98,bridge_name='br-int',has_traffic_filtering=True,id=4fb36f71-2601-4c01-9eba-514f5f2af95f,network=Network(0c6a5f46-e53b-4b4c-806e-b2617ba3ef35),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4fb36f71-26')
Apr 13 16:57:05 user nova-compute[71731]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c7285f7e-a7ed-4856-95ba-e4a5cc5f917e tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] [instance: e048d6f6-f6aa-4491-ae06-9e22a8ff6691] calling os-brick to detach iSCSI Volume {{(pid=71731) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 16:57:05 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7285f7e-a7ed-4856-95ba-e4a5cc5f917e tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8cf0118790>, {'target_iqn': 'iqn.2010-10.org.openstack:52d252b7-6e23-4733-bf50-80e9ff903f75', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KCpXvRDk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 16:57:05 user nova-compute[71731]: WARNING os_brick.initiator.connectors.base [None req-c7285f7e-a7ed-4856-95ba-e4a5cc5f917e tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 16:57:05 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-c7285f7e-a7ed-4856-95ba-e4a5cc5f917e tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 16:57:05 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-c7285f7e-a7ed-4856-95ba-e4a5cc5f917e tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 16:57:05 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:57:05 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:57:05 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[36daf905-1f71-4e59-bd8d-4a255d68982e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:52d252b7-6e23-4733-bf50-80e9ff903f75\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:57:05 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7285f7e-a7ed-4856-95ba-e4a5cc5f917e tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 16:57:05 user nova-compute[71731]: No targets found.
Apr 13 16:57:05 user nova-compute[71731]: iSNS:
Apr 13 16:57:05 user nova-compute[71731]: No targets found.
Apr 13 16:57:05 user nova-compute[71731]: STATIC:
Apr 13 16:57:05 user nova-compute[71731]: Target: iqn.2010-10.org.openstack:52d252b7-6e23-4733-bf50-80e9ff903f75
Apr 13 16:57:05 user nova-compute[71731]:         Portal: 172.16.0.220:3260,-1
Apr 13 16:57:05 user nova-compute[71731]:                 Iface Name: default
Apr 13 16:57:05 user nova-compute[71731]: FIRMWARE:
Apr 13 16:57:05 user nova-compute[71731]: No targets found.
Apr 13 16:57:05 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 16:57:05 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7285f7e-a7ed-4856-95ba-e4a5cc5f917e tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 16:57:05 user nova-compute[71731]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 16:57:05 user nova-compute[71731]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71731) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 16:57:05 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7285f7e-a7ed-4856-95ba-e4a5cc5f917e tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:52d252b7-6e23-4733-bf50-80e9ff903f75', 0)] {{(pid=71731) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 16:57:05 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:57:05 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:57:05 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f1a0232-825e-40c4-9dee-771f595520bf]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:52d252b7-6e23-4733-bf50-80e9ff903f75\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:57:05 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:57:05 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:57:05 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dedeef3-8f69-4b69-ad82-ed181c06b7d8]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52d252b7-6e23-4733-bf50-80e9ff903f75 (non-flash)\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:57:05 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7285f7e-a7ed-4856-95ba-e4a5cc5f917e tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52d252b7-6e23-4733-bf50-80e9ff903f75 (non-flash)
Apr 13 16:57:05 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 16:57:05 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7285f7e-a7ed-4856-95ba-e4a5cc5f917e tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52d252b7-6e23-4733-bf50-80e9ff903f75 (non-flash)
Apr 13 16:57:05 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 16:57:05 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7285f7e-a7ed-4856-95ba-e4a5cc5f917e tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8cf02040d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:52d252b7-6e23-4733-bf50-80e9ff903f75'): ({'sdb'}, set())}) {{(pid=71731) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 16:57:05 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-c7285f7e-a7ed-4856-95ba-e4a5cc5f917e tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Removing single pathed devices sdb {{(pid=71731) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 16:57:05 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:57:05 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:57:05 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[67418d43-1411-4e10-8909-63d226f4e9f4]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:57:05 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:57:05 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:57:05 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[4af81dbe-ce5d-4859-a165-90b65559e4eb]: (4, ('ok\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:57:05 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-c7285f7e-a7ed-4856-95ba-e4a5cc5f917e tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Flushing IO for device /dev/sdb {{(pid=71731) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 16:57:05 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:57:05 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:57:05 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[20ad16e9-06ac-4505-8397-ca73e30565e1]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:57:05 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-c7285f7e-a7ed-4856-95ba-e4a5cc5f917e tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71731) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 16:57:05 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:57:05 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.051s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:57:05 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c4a5481-f05a-4ddb-90e5-498a96020f8b]: (4, ('1', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:57:05 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-c7285f7e-a7ed-4856-95ba-e4a5cc5f917e tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71731) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 16:57:05 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-c7285f7e-a7ed-4856-95ba-e4a5cc5f917e tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] SCSI volumes sdb have been removed. {{(pid=71731) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 16:57:05 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7285f7e-a7ed-4856-95ba-e4a5cc5f917e tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:52d252b7-6e23-4733-bf50-80e9ff903f75')] {{(pid=71731) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 16:57:05 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52d252b7-6e23-4733-bf50-80e9ff903f75 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:57:05 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52d252b7-6e23-4733-bf50-80e9ff903f75 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:57:05 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cadd917-8464-4d5f-9447-97db0cd4d6a0]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:57:05 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7285f7e-a7ed-4856-95ba-e4a5cc5f917e tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:57:05 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52d252b7-6e23-4733-bf50-80e9ff903f75 -p 172.16.0.220:3260 --logout {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:57:05 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52d252b7-6e23-4733-bf50-80e9ff903f75 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:57:05 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[f874e9c4-9b7d-4369-9785-ac038ebf535c]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:52d252b7-6e23-4733-bf50-80e9ff903f75, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:52d252b7-6e23-4733-bf50-80e9ff903f75, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:57:05 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7285f7e-a7ed-4856-95ba-e4a5cc5f917e tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:52d252b7-6e23-4733-bf50-80e9ff903f75, portal: 172.16.0.220,3260]
Apr 13 16:57:05 user nova-compute[71731]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:52d252b7-6e23-4733-bf50-80e9ff903f75, portal: 172.16.0.220,3260] successful.
Apr 13 16:57:05 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:57:05 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52d252b7-6e23-4733-bf50-80e9ff903f75 -p 172.16.0.220:3260 --op delete {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:57:05 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52d252b7-6e23-4733-bf50-80e9ff903f75 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:57:05 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d011708-5e09-49c0-8e43-9f6734e5b1de]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:57:05 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7285f7e-a7ed-4856-95ba-e4a5cc5f917e tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:57:05 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-c7285f7e-a7ed-4856-95ba-e4a5cc5f917e tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.297s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 16:57:05 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7285f7e-a7ed-4856-95ba-e4a5cc5f917e tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] <== disconnect_volume: return (298ms) None {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 16:57:05 user nova-compute[71731]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c7285f7e-a7ed-4856-95ba-e4a5cc5f917e tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] [instance: e048d6f6-f6aa-4491-ae06-9e22a8ff6691] Disconnected iSCSI Volume {{(pid=71731) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 16:57:05 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-c7285f7e-a7ed-4856-95ba-e4a5cc5f917e tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] [instance: e048d6f6-f6aa-4491-ae06-9e22a8ff6691] Start _get_guest_xml network_info=[{"id": "4fb36f71-2601-4c01-9eba-514f5f2af95f", "address": "fa:16:3e:11:9f:98", "network": {"id": "0c6a5f46-e53b-4b4c-806e-b2617ba3ef35", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1984894004-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.143", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7edf468527d84954a943bb4c1f7ff54d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fb36f71-26", "ovs_interfaceid": "4fb36f71-2601-4c01-9eba-514f5f2af95f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=e81308c1-1e9d-43bf-bd21-d6a7d7856ff1,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'device_type': 'disk', 'encrypted': False, 'disk_bus': 'virtio', 'guest_format': None, 'encryption_options': None, 'image_id': 'e81308c1-1e9d-43bf-bd21-d6a7d7856ff1'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'attachment_id': '94bca0bb-782d-43c9-a368-df54c5e99e1d', 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:52d252b7-6e23-4733-bf50-80e9ff903f75', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KCpXvRDk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': 'e048d6f6-f6aa-4491-ae06-9e22a8ff6691', 'attached_at': '', 'detached_at': '', 'volume_id': '52d252b7-6e23-4733-bf50-80e9ff903f75', 'serial': '52d252b7-6e23-4733-bf50-80e9ff903f75'}, 'disk_bus': 'virtio', 'guest_format': None, 'volume_type': None} {{(pid=71731) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 16:57:05 user nova-compute[71731]: WARNING nova.virt.libvirt.driver [None req-c7285f7e-a7ed-4856-95ba-e4a5cc5f917e tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 16:57:05 user nova-compute[71731]: WARNING nova.virt.libvirt.driver [None req-c7285f7e-a7ed-4856-95ba-e4a5cc5f917e tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 16:57:05 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-c7285f7e-a7ed-4856-95ba-e4a5cc5f917e tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71731) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 16:57:05 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-c7285f7e-a7ed-4856-95ba-e4a5cc5f917e tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T16:17:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=e81308c1-1e9d-43bf-bd21-d6a7d7856ff1,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 16:57:05 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-c7285f7e-a7ed-4856-95ba-e4a5cc5f917e tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Flavor limits 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 16:57:05 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-c7285f7e-a7ed-4856-95ba-e4a5cc5f917e tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Image limits 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 16:57:05 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-c7285f7e-a7ed-4856-95ba-e4a5cc5f917e tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Flavor pref 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 16:57:05 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-c7285f7e-a7ed-4856-95ba-e4a5cc5f917e tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Image pref 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 16:57:05 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-c7285f7e-a7ed-4856-95ba-e4a5cc5f917e tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 16:57:05 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-c7285f7e-a7ed-4856-95ba-e4a5cc5f917e tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 16:57:05 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-c7285f7e-a7ed-4856-95ba-e4a5cc5f917e tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71731) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 16:57:05 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-c7285f7e-a7ed-4856-95ba-e4a5cc5f917e tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Got 1 possible topologies {{(pid=71731) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 16:57:05 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-c7285f7e-a7ed-4856-95ba-e4a5cc5f917e tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 16:57:05 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-c7285f7e-a7ed-4856-95ba-e4a5cc5f917e tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 16:57:05 user nova-compute[71731]: DEBUG nova.objects.instance [None req-c7285f7e-a7ed-4856-95ba-e4a5cc5f917e tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lazy-loading 'vcpu_model' on Instance uuid e048d6f6-f6aa-4491-ae06-9e22a8ff6691 {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:57:05 user nova-compute[71731]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c7285f7e-a7ed-4856-95ba-e4a5cc5f917e tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] [instance: e048d6f6-f6aa-4491-ae06-9e22a8ff6691] Calling os-brick to attach iSCSI Volume {{(pid=71731) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 16:57:05 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7285f7e-a7ed-4856-95ba-e4a5cc5f917e tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8cf0118790>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:52d252b7-6e23-4733-bf50-80e9ff903f75', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KCpXvRDk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 16:57:05 user nova-compute[71731]: WARNING os_brick.initiator.connectors.base [None req-c7285f7e-a7ed-4856-95ba-e4a5cc5f917e tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 16:57:05 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-c7285f7e-a7ed-4856-95ba-e4a5cc5f917e tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 16:57:05 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-c7285f7e-a7ed-4856-95ba-e4a5cc5f917e tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 16:57:05 user nova-compute[71731]: WARNING os_brick.initiator.connectors.base [None req-c7285f7e-a7ed-4856-95ba-e4a5cc5f917e tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 16:57:05 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-c7285f7e-a7ed-4856-95ba-e4a5cc5f917e tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:52d252b7-6e23-4733-bf50-80e9ff903f75" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 16:57:05 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-c7285f7e-a7ed-4856-95ba-e4a5cc5f917e tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:52d252b7-6e23-4733-bf50-80e9ff903f75" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 16:57:05 user nova-compute[71731]: INFO os_brick.initiator.connectors.iscsi [None req-c7285f7e-a7ed-4856-95ba-e4a5cc5f917e tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 16:57:05 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52d252b7-6e23-4733-bf50-80e9ff903f75 -p 172.16.0.220:3260 {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:57:05 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52d252b7-6e23-4733-bf50-80e9ff903f75 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:57:05 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[f852b1b8-daaf-410c-89a9-7ac718042719]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:57:05 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7285f7e-a7ed-4856-95ba-e4a5cc5f917e tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 16:57:05 user nova-compute[71731]:  {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:57:05 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52d252b7-6e23-4733-bf50-80e9ff903f75 -p 172.16.0.220:3260 --interface default --op new {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:57:05 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52d252b7-6e23-4733-bf50-80e9ff903f75 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:57:05 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[4194b5e4-24d5-43cc-a9b0-3dd61d169781]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:52d252b7-6e23-4733-bf50-80e9ff903f75] added\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:57:05 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7285f7e-a7ed-4856-95ba-e4a5cc5f917e tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:52d252b7-6e23-4733-bf50-80e9ff903f75] added
Apr 13 16:57:05 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:57:05 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52d252b7-6e23-4733-bf50-80e9ff903f75 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:57:06 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52d252b7-6e23-4733-bf50-80e9ff903f75 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:57:06 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eb43e12-6b28-4b92-afaa-0d9682a65674]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:57:06 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7285f7e-a7ed-4856-95ba-e4a5cc5f917e tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:57:06 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52d252b7-6e23-4733-bf50-80e9ff903f75 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:57:06 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52d252b7-6e23-4733-bf50-80e9ff903f75 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:57:06 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[c541f6e7-10ed-460e-9717-681e137ee62a]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:57:06 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7285f7e-a7ed-4856-95ba-e4a5cc5f917e tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:57:06 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52d252b7-6e23-4733-bf50-80e9ff903f75 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KCpXvRDk {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:57:06 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52d252b7-6e23-4733-bf50-80e9ff903f75 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KCpXvRDk" returned: 0 in 0.017s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:57:06 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbf8df9d-ebc6-49cf-bd35-c4cfcafe7f07]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:57:06 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7285f7e-a7ed-4856-95ba-e4a5cc5f917e tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KCpXvRDk'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:57:06 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52d252b7-6e23-4733-bf50-80e9ff903f75 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:57:06 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52d252b7-6e23-4733-bf50-80e9ff903f75 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:57:06 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e3677f1-df44-4abf-bee2-666c24535704]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:57:06 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7285f7e-a7ed-4856-95ba-e4a5cc5f917e tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:57:06 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:57:06 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:57:06 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b616ca7-cbbc-4474-9d5f-18a3437e0c5b]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:57:06 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7285f7e-a7ed-4856-95ba-e4a5cc5f917e tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Apr 13 16:57:06 user nova-compute[71731]:  {{(pid=71731) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 16:57:06 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7285f7e-a7ed-4856-95ba-e4a5cc5f917e tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Apr 13 16:57:06 user nova-compute[71731]:  {{(pid=71731) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 16:57:06 user nova-compute[71731]: WARNING os_brick.initiator.connectors.iscsi [None req-c7285f7e-a7ed-4856-95ba-e4a5cc5f917e tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Apr 13 16:57:06 user nova-compute[71731]: 
Apr 13 16:57:06 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52d252b7-6e23-4733-bf50-80e9ff903f75 -p 172.16.0.220:3260 --login {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:57:06 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52d252b7-6e23-4733-bf50-80e9ff903f75 -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:57:06 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5dea2c5-62ac-4e09-843f-6a3ca0df9c4d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:52d252b7-6e23-4733-bf50-80e9ff903f75, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:52d252b7-6e23-4733-bf50-80e9ff903f75, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:57:06 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7285f7e-a7ed-4856-95ba-e4a5cc5f917e tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:52d252b7-6e23-4733-bf50-80e9ff903f75, portal: 172.16.0.220,3260]
Apr 13 16:57:06 user nova-compute[71731]: Login to [iface: default, target: iqn.2010-10.org.openstack:52d252b7-6e23-4733-bf50-80e9ff903f75, portal: 172.16.0.220,3260] successful.
Apr 13 16:57:06 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:57:06 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52d252b7-6e23-4733-bf50-80e9ff903f75 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:57:06 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52d252b7-6e23-4733-bf50-80e9ff903f75 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:57:06 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[228ef43c-f389-4e70-99a2-770a064ae4b7]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:57:06 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7285f7e-a7ed-4856-95ba-e4a5cc5f917e tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:57:06 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:57:06 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:57:06 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[53248b37-057a-45d9-a826-ab46efab7846]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52d252b7-6e23-4733-bf50-80e9ff903f75 (non-flash)\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:57:06 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7285f7e-a7ed-4856-95ba-e4a5cc5f917e tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52d252b7-6e23-4733-bf50-80e9ff903f75 (non-flash)
Apr 13 16:57:06 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 16:57:06 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7285f7e-a7ed-4856-95ba-e4a5cc5f917e tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52d252b7-6e23-4733-bf50-80e9ff903f75 (non-flash)
Apr 13 16:57:06 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 16:57:06 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-c7285f7e-a7ed-4856-95ba-e4a5cc5f917e tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:52d252b7-6e23-4733-bf50-80e9ff903f75" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.245s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 16:57:06 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7285f7e-a7ed-4856-95ba-e4a5cc5f917e tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Connected to 172.16.0.220:3260 {{(pid=71731) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 16:57:06 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-c7285f7e-a7ed-4856-95ba-e4a5cc5f917e tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] HCTL ('33', '-', '-', 0) found on session 49 with lun 0 {{(pid=71731) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 16:57:06 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-c7285f7e-a7ed-4856-95ba-e4a5cc5f917e tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71731) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 16:57:06 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:57:06 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:57:06 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd01358d-19ef-4013-8295-0678631be0c1]: (4, ('- - 0', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:57:06 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-c7285f7e-a7ed-4856-95ba-e4a5cc5f917e tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Searching for a device in session 49 and hctl ['33', '*', '*', 0] yield: None {{(pid=71731) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 16:57:07 user nova-compute[71731]: DEBUG nova.compute.manager [req-17358a4c-6f14-4696-9d41-ecd7fe0a941c req-d9c11365-cf14-40f5-8593-007acd671785 service nova] [instance: e048d6f6-f6aa-4491-ae06-9e22a8ff6691] Received event network-vif-plugged-4fb36f71-2601-4c01-9eba-514f5f2af95f {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:57:07 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-17358a4c-6f14-4696-9d41-ecd7fe0a941c req-d9c11365-cf14-40f5-8593-007acd671785 service nova] Acquiring lock "e048d6f6-f6aa-4491-ae06-9e22a8ff6691-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:57:07 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-17358a4c-6f14-4696-9d41-ecd7fe0a941c req-d9c11365-cf14-40f5-8593-007acd671785 service nova] Lock "e048d6f6-f6aa-4491-ae06-9e22a8ff6691-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:57:07 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-17358a4c-6f14-4696-9d41-ecd7fe0a941c req-d9c11365-cf14-40f5-8593-007acd671785 service nova] Lock "e048d6f6-f6aa-4491-ae06-9e22a8ff6691-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:57:07 user nova-compute[71731]: DEBUG nova.compute.manager [req-17358a4c-6f14-4696-9d41-ecd7fe0a941c req-d9c11365-cf14-40f5-8593-007acd671785 service nova] [instance: e048d6f6-f6aa-4491-ae06-9e22a8ff6691] No waiting events found dispatching network-vif-plugged-4fb36f71-2601-4c01-9eba-514f5f2af95f {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:57:07 user nova-compute[71731]: WARNING nova.compute.manager [req-17358a4c-6f14-4696-9d41-ecd7fe0a941c req-d9c11365-cf14-40f5-8593-007acd671785 service nova] [instance: e048d6f6-f6aa-4491-ae06-9e22a8ff6691] Received unexpected event network-vif-plugged-4fb36f71-2601-4c01-9eba-514f5f2af95f for instance with vm_state active and task_state reboot_started_hard.
Apr 13 16:57:07 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-c7285f7e-a7ed-4856-95ba-e4a5cc5f917e tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Searching for a device in session 49 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71731) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 16:57:07 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7285f7e-a7ed-4856-95ba-e4a5cc5f917e tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:52d252b7-6e23-4733-bf50-80e9ff903f75', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KCpXvRDk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=71731) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 16:57:07 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-c7285f7e-a7ed-4856-95ba-e4a5cc5f917e tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.274s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 16:57:07 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7285f7e-a7ed-4856-95ba-e4a5cc5f917e tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] <== connect_volume: return (1275ms) {'type': 'block', 'scsi_wwn': '26636653031326634', 'path': '/dev/sdb'} {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 16:57:07 user nova-compute[71731]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c7285f7e-a7ed-4856-95ba-e4a5cc5f917e tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] [instance: e048d6f6-f6aa-4491-ae06-9e22a8ff6691] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26636653031326634', 'path': '/dev/sdb'} {{(pid=71731) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 16:57:07 user nova-compute[71731]: DEBUG nova.virt.libvirt.vif [None req-c7285f7e-a7ed-4856-95ba-e4a5cc5f917e tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T16:54:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-2141029123',display_name='tempest-TestMinimumBasicScenario-server-2141029123',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-2141029123',id=42,image_ref='e81308c1-1e9d-43bf-bd21-d6a7d7856ff1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCJeR98CrX5Pyefe/rcz7c7swHCPLDeP62HQPhZNTY1lR3svV0j4RlALHIf9UrR6zTy6O2Onfsic7sNVnaIU+KNr9U5sJ8q1nmWzQ0dRWeAumpZeD0Chk2QSpA1BLE1qxA==',key_name='tempest-TestMinimumBasicScenario-810545990',keypairs=<?>,launch_index=0,launched_at=2023-04-13T16:55:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7edf468527d84954a943bb4c1f7ff54d',ramdisk_id='',reservation_id='r-8091fn2v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e81308c1-1e9d-43bf-bd21-d6a7d7856ff1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-419032150',owner_user_name='tempest-TestMinimumBasicScenario-419032150-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T16:57:05Z,user_data=None,user_id='91a450674d7046ae82f5dd182506c85b',uuid=e048d6f6-f6aa-4491-ae06-9e22a8ff6691,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4fb36f71-2601-4c01-9eba-514f5f2af95f", "address": "fa:16:3e:11:9f:98", "network": {"id": "0c6a5f46-e53b-4b4c-806e-b2617ba3ef35", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1984894004-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.143", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7edf468527d84954a943bb4c1f7ff54d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fb36f71-26", "ovs_interfaceid": "4fb36f71-2601-4c01-9eba-514f5f2af95f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71731) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 16:57:07 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-c7285f7e-a7ed-4856-95ba-e4a5cc5f917e tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Converting VIF {"id": "4fb36f71-2601-4c01-9eba-514f5f2af95f", "address": "fa:16:3e:11:9f:98", "network": {"id": "0c6a5f46-e53b-4b4c-806e-b2617ba3ef35", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1984894004-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.143", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7edf468527d84954a943bb4c1f7ff54d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fb36f71-26", "ovs_interfaceid": "4fb36f71-2601-4c01-9eba-514f5f2af95f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 16:57:07 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-c7285f7e-a7ed-4856-95ba-e4a5cc5f917e tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:11:9f:98,bridge_name='br-int',has_traffic_filtering=True,id=4fb36f71-2601-4c01-9eba-514f5f2af95f,network=Network(0c6a5f46-e53b-4b4c-806e-b2617ba3ef35),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4fb36f71-26') {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 16:57:07 user nova-compute[71731]: DEBUG nova.objects.instance [None req-c7285f7e-a7ed-4856-95ba-e4a5cc5f917e tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lazy-loading 'pci_devices' on Instance uuid e048d6f6-f6aa-4491-ae06-9e22a8ff6691 {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:57:07 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-c7285f7e-a7ed-4856-95ba-e4a5cc5f917e tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] [instance: e048d6f6-f6aa-4491-ae06-9e22a8ff6691] End _get_guest_xml xml=<domain type="kvm">
Apr 13 16:57:07 user nova-compute[71731]:   <uuid>e048d6f6-f6aa-4491-ae06-9e22a8ff6691</uuid>
Apr 13 16:57:07 user nova-compute[71731]:   <name>instance-0000002a</name>
Apr 13 16:57:07 user nova-compute[71731]:   <memory>131072</memory>
Apr 13 16:57:07 user nova-compute[71731]:   <vcpu>1</vcpu>
Apr 13 16:57:07 user nova-compute[71731]:   <metadata>
Apr 13 16:57:07 user nova-compute[71731]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 16:57:07 user nova-compute[71731]:       <nova:package version="0.0.0"/>
Apr 13 16:57:07 user nova-compute[71731]:       <nova:name>tempest-TestMinimumBasicScenario-server-2141029123</nova:name>
Apr 13 16:57:07 user nova-compute[71731]:       <nova:creationTime>2023-04-13 16:57:05</nova:creationTime>
Apr 13 16:57:07 user nova-compute[71731]:       <nova:flavor name="m1.nano">
Apr 13 16:57:07 user nova-compute[71731]:         <nova:memory>128</nova:memory>
Apr 13 16:57:07 user nova-compute[71731]:         <nova:disk>1</nova:disk>
Apr 13 16:57:07 user nova-compute[71731]:         <nova:swap>0</nova:swap>
Apr 13 16:57:07 user nova-compute[71731]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 16:57:07 user nova-compute[71731]:         <nova:vcpus>1</nova:vcpus>
Apr 13 16:57:07 user nova-compute[71731]:       </nova:flavor>
Apr 13 16:57:07 user nova-compute[71731]:       <nova:owner>
Apr 13 16:57:07 user nova-compute[71731]:         <nova:user uuid="91a450674d7046ae82f5dd182506c85b">tempest-TestMinimumBasicScenario-419032150-project-member</nova:user>
Apr 13 16:57:07 user nova-compute[71731]:         <nova:project uuid="7edf468527d84954a943bb4c1f7ff54d">tempest-TestMinimumBasicScenario-419032150</nova:project>
Apr 13 16:57:07 user nova-compute[71731]:       </nova:owner>
Apr 13 16:57:07 user nova-compute[71731]:       <nova:root type="image" uuid="e81308c1-1e9d-43bf-bd21-d6a7d7856ff1"/>
Apr 13 16:57:07 user nova-compute[71731]:       <nova:ports>
Apr 13 16:57:07 user nova-compute[71731]:         <nova:port uuid="4fb36f71-2601-4c01-9eba-514f5f2af95f">
Apr 13 16:57:07 user nova-compute[71731]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Apr 13 16:57:07 user nova-compute[71731]:         </nova:port>
Apr 13 16:57:07 user nova-compute[71731]:       </nova:ports>
Apr 13 16:57:07 user nova-compute[71731]:     </nova:instance>
Apr 13 16:57:07 user nova-compute[71731]:   </metadata>
Apr 13 16:57:07 user nova-compute[71731]:   <sysinfo type="smbios">
Apr 13 16:57:07 user nova-compute[71731]:     <system>
Apr 13 16:57:07 user nova-compute[71731]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 16:57:07 user nova-compute[71731]:       <entry name="product">OpenStack Nova</entry>
Apr 13 16:57:07 user nova-compute[71731]:       <entry name="version">0.0.0</entry>
Apr 13 16:57:07 user nova-compute[71731]:       <entry name="serial">e048d6f6-f6aa-4491-ae06-9e22a8ff6691</entry>
Apr 13 16:57:07 user nova-compute[71731]:       <entry name="uuid">e048d6f6-f6aa-4491-ae06-9e22a8ff6691</entry>
Apr 13 16:57:07 user nova-compute[71731]:       <entry name="family">Virtual Machine</entry>
Apr 13 16:57:07 user nova-compute[71731]:     </system>
Apr 13 16:57:07 user nova-compute[71731]:   </sysinfo>
Apr 13 16:57:07 user nova-compute[71731]:   <os>
Apr 13 16:57:07 user nova-compute[71731]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 16:57:07 user nova-compute[71731]:     <boot dev="hd"/>
Apr 13 16:57:07 user nova-compute[71731]:     <smbios mode="sysinfo"/>
Apr 13 16:57:07 user nova-compute[71731]:   </os>
Apr 13 16:57:07 user nova-compute[71731]:   <features>
Apr 13 16:57:07 user nova-compute[71731]:     <acpi/>
Apr 13 16:57:07 user nova-compute[71731]:     <apic/>
Apr 13 16:57:07 user nova-compute[71731]:     <vmcoreinfo/>
Apr 13 16:57:07 user nova-compute[71731]:   </features>
Apr 13 16:57:07 user nova-compute[71731]:   <clock offset="utc">
Apr 13 16:57:07 user nova-compute[71731]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 16:57:07 user nova-compute[71731]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 16:57:07 user nova-compute[71731]:     <timer name="hpet" present="no"/>
Apr 13 16:57:07 user nova-compute[71731]:   </clock>
Apr 13 16:57:07 user nova-compute[71731]:   <cpu mode="custom" match="exact">
Apr 13 16:57:07 user nova-compute[71731]:     <model>Nehalem</model>
Apr 13 16:57:07 user nova-compute[71731]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 16:57:07 user nova-compute[71731]:   </cpu>
Apr 13 16:57:07 user nova-compute[71731]:   <devices>
Apr 13 16:57:07 user nova-compute[71731]:     <disk type="file" device="disk">
Apr 13 16:57:07 user nova-compute[71731]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 16:57:07 user nova-compute[71731]:       <source file="/opt/stack/data/nova/instances/e048d6f6-f6aa-4491-ae06-9e22a8ff6691/disk"/>
Apr 13 16:57:07 user nova-compute[71731]:       <target dev="vda" bus="virtio"/>
Apr 13 16:57:07 user nova-compute[71731]:     </disk>
Apr 13 16:57:07 user nova-compute[71731]:     <disk type="block" device="disk">
Apr 13 16:57:07 user nova-compute[71731]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 16:57:07 user nova-compute[71731]:       <source dev="/dev/sdb"/>
Apr 13 16:57:07 user nova-compute[71731]:       <target dev="vdb" bus="virtio"/>
Apr 13 16:57:07 user nova-compute[71731]:       <serial>52d252b7-6e23-4733-bf50-80e9ff903f75</serial>
Apr 13 16:57:07 user nova-compute[71731]:     </disk>
Apr 13 16:57:07 user nova-compute[71731]:     <interface type="ethernet">
Apr 13 16:57:07 user nova-compute[71731]:       <mac address="fa:16:3e:11:9f:98"/>
Apr 13 16:57:07 user nova-compute[71731]:       <model type="virtio"/>
Apr 13 16:57:07 user nova-compute[71731]:       <mtu size="1442"/>
Apr 13 16:57:07 user nova-compute[71731]:       <target dev="tap4fb36f71-26"/>
Apr 13 16:57:07 user nova-compute[71731]:     </interface>
Apr 13 16:57:07 user nova-compute[71731]:     <serial type="pty">
Apr 13 16:57:07 user nova-compute[71731]:       <log file="/opt/stack/data/nova/instances/e048d6f6-f6aa-4491-ae06-9e22a8ff6691/console.log" append="off"/>
Apr 13 16:57:07 user nova-compute[71731]:     </serial>
Apr 13 16:57:07 user nova-compute[71731]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 16:57:07 user nova-compute[71731]:     <video>
Apr 13 16:57:07 user nova-compute[71731]:       <model type="virtio"/>
Apr 13 16:57:07 user nova-compute[71731]:     </video>
Apr 13 16:57:07 user nova-compute[71731]:     <rng model="virtio">
Apr 13 16:57:07 user nova-compute[71731]:       <backend model="random">/dev/urandom</backend>
Apr 13 16:57:07 user nova-compute[71731]:     </rng>
Apr 13 16:57:07 user nova-compute[71731]:     <controller type="usb" index="0" model="none"/>
Apr 13 16:57:07 user nova-compute[71731]:     <memballoon model="virtio">
Apr 13 16:57:07 user nova-compute[71731]:       <stats period="10"/>
Apr 13 16:57:07 user nova-compute[71731]:     </memballoon>
Apr 13 16:57:07 user nova-compute[71731]:   </devices>
Apr 13 16:57:07 user nova-compute[71731]: </domain>
Apr 13 16:57:07 user nova-compute[71731]:  {{(pid=71731) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 16:57:07 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-c7285f7e-a7ed-4856-95ba-e4a5cc5f917e tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e048d6f6-f6aa-4491-ae06-9e22a8ff6691/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:57:07 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-c7285f7e-a7ed-4856-95ba-e4a5cc5f917e tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e048d6f6-f6aa-4491-ae06-9e22a8ff6691/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:57:07 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-c7285f7e-a7ed-4856-95ba-e4a5cc5f917e tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e048d6f6-f6aa-4491-ae06-9e22a8ff6691/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:57:07 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:57:07 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-c7285f7e-a7ed-4856-95ba-e4a5cc5f917e tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e048d6f6-f6aa-4491-ae06-9e22a8ff6691/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:57:07 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-c7285f7e-a7ed-4856-95ba-e4a5cc5f917e tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=71731) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 16:57:07 user nova-compute[71731]: DEBUG nova.objects.instance [None req-c7285f7e-a7ed-4856-95ba-e4a5cc5f917e tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lazy-loading 'trusted_certs' on Instance uuid e048d6f6-f6aa-4491-ae06-9e22a8ff6691 {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:57:07 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-c7285f7e-a7ed-4856-95ba-e4a5cc5f917e tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa7c6a0f960510af81481294f43b184e85fb013f --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:57:07 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-c7285f7e-a7ed-4856-95ba-e4a5cc5f917e tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fa7c6a0f960510af81481294f43b184e85fb013f --force-share --output=json" returned: 0 in 0.141s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:57:07 user nova-compute[71731]: DEBUG nova.virt.disk.api [None req-c7285f7e-a7ed-4856-95ba-e4a5cc5f917e tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e048d6f6-f6aa-4491-ae06-9e22a8ff6691/disk. size=1073741824 {{(pid=71731) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 16:57:07 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-c7285f7e-a7ed-4856-95ba-e4a5cc5f917e tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e048d6f6-f6aa-4491-ae06-9e22a8ff6691/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:57:07 user nova-compute[71731]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681405012.757036, 3af23ff8-4e10-4fbf-a86e-bda842f084ff => Stopped> {{(pid=71731) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 16:57:07 user nova-compute[71731]: INFO nova.compute.manager [-] [instance: 3af23ff8-4e10-4fbf-a86e-bda842f084ff] VM Stopped (Lifecycle Event)
Apr 13 16:57:07 user nova-compute[71731]: DEBUG nova.compute.manager [None req-9ab51897-099f-418c-b880-562bd25f14f5 None None] [instance: 3af23ff8-4e10-4fbf-a86e-bda842f084ff] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:57:07 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-c7285f7e-a7ed-4856-95ba-e4a5cc5f917e tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e048d6f6-f6aa-4491-ae06-9e22a8ff6691/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:57:07 user nova-compute[71731]: DEBUG nova.virt.disk.api [None req-c7285f7e-a7ed-4856-95ba-e4a5cc5f917e tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Cannot resize image /opt/stack/data/nova/instances/e048d6f6-f6aa-4491-ae06-9e22a8ff6691/disk to a smaller size. {{(pid=71731) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 16:57:07 user nova-compute[71731]: DEBUG nova.objects.instance [None req-c7285f7e-a7ed-4856-95ba-e4a5cc5f917e tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lazy-loading 'migration_context' on Instance uuid e048d6f6-f6aa-4491-ae06-9e22a8ff6691 {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:57:07 user nova-compute[71731]: DEBUG nova.virt.libvirt.vif [None req-c7285f7e-a7ed-4856-95ba-e4a5cc5f917e tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T16:54:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-2141029123',display_name='tempest-TestMinimumBasicScenario-server-2141029123',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-2141029123',id=42,image_ref='e81308c1-1e9d-43bf-bd21-d6a7d7856ff1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCJeR98CrX5Pyefe/rcz7c7swHCPLDeP62HQPhZNTY1lR3svV0j4RlALHIf9UrR6zTy6O2Onfsic7sNVnaIU+KNr9U5sJ8q1nmWzQ0dRWeAumpZeD0Chk2QSpA1BLE1qxA==',key_name='tempest-TestMinimumBasicScenario-810545990',keypairs=<?>,launch_index=0,launched_at=2023-04-13T16:55:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='7edf468527d84954a943bb4c1f7ff54d',ramdisk_id='',reservation_id='r-8091fn2v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e81308c1-1e9d-43bf-bd21-d6a7d7856ff1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-419032150',owner_user_name='tempest-TestMinimumBasicScenario-419032150-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T16:57:05Z,user_data=None,user_id='91a450674d7046ae82f5dd182506c85b',uuid=e048d6f6-f6aa-4491-ae06-9e22a8ff6691,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4fb36f71-2601-4c01-9eba-514f5f2af95f", "address": "fa:16:3e:11:9f:98", "network": {"id": "0c6a5f46-e53b-4b4c-806e-b2617ba3ef35", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1984894004-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.143", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7edf468527d84954a943bb4c1f7ff54d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fb36f71-26", "ovs_interfaceid": "4fb36f71-2601-4c01-9eba-514f5f2af95f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 16:57:07 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-c7285f7e-a7ed-4856-95ba-e4a5cc5f917e tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Converting VIF {"id": "4fb36f71-2601-4c01-9eba-514f5f2af95f", "address": "fa:16:3e:11:9f:98", "network": {"id": "0c6a5f46-e53b-4b4c-806e-b2617ba3ef35", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1984894004-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.143", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7edf468527d84954a943bb4c1f7ff54d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fb36f71-26", "ovs_interfaceid": "4fb36f71-2601-4c01-9eba-514f5f2af95f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 16:57:07 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-c7285f7e-a7ed-4856-95ba-e4a5cc5f917e tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:11:9f:98,bridge_name='br-int',has_traffic_filtering=True,id=4fb36f71-2601-4c01-9eba-514f5f2af95f,network=Network(0c6a5f46-e53b-4b4c-806e-b2617ba3ef35),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4fb36f71-26') {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 16:57:07 user nova-compute[71731]: DEBUG os_vif [None req-c7285f7e-a7ed-4856-95ba-e4a5cc5f917e tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:11:9f:98,bridge_name='br-int',has_traffic_filtering=True,id=4fb36f71-2601-4c01-9eba-514f5f2af95f,network=Network(0c6a5f46-e53b-4b4c-806e-b2617ba3ef35),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4fb36f71-26') {{(pid=71731) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 16:57:07 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:57:07 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:57:07 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 16:57:07 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:57:07 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4fb36f71-26, may_exist=True) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:57:07 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4fb36f71-26, col_values=(('external_ids', {'iface-id': '4fb36f71-2601-4c01-9eba-514f5f2af95f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:11:9f:98', 'vm-uuid': 'e048d6f6-f6aa-4491-ae06-9e22a8ff6691'}),)) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:57:07 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:57:07 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 16:57:07 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:57:07 user nova-compute[71731]: INFO os_vif [None req-c7285f7e-a7ed-4856-95ba-e4a5cc5f917e tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:11:9f:98,bridge_name='br-int',has_traffic_filtering=True,id=4fb36f71-2601-4c01-9eba-514f5f2af95f,network=Network(0c6a5f46-e53b-4b4c-806e-b2617ba3ef35),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4fb36f71-26')
Apr 13 16:57:08 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:57:08 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Cleaning up deleted instances with incomplete migration  {{(pid=71731) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 13 16:57:09 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:57:09 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:57:09 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:57:09 user nova-compute[71731]: DEBUG nova.compute.manager [req-b4cf6389-abd9-42dd-b809-991e1713cd27 req-3827ac1a-b6b1-491d-8cbd-f51e3d0ab946 service nova] [instance: e048d6f6-f6aa-4491-ae06-9e22a8ff6691] Received event network-vif-plugged-4fb36f71-2601-4c01-9eba-514f5f2af95f {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:57:09 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-b4cf6389-abd9-42dd-b809-991e1713cd27 req-3827ac1a-b6b1-491d-8cbd-f51e3d0ab946 service nova] Acquiring lock "e048d6f6-f6aa-4491-ae06-9e22a8ff6691-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:57:09 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-b4cf6389-abd9-42dd-b809-991e1713cd27 req-3827ac1a-b6b1-491d-8cbd-f51e3d0ab946 service nova] Lock "e048d6f6-f6aa-4491-ae06-9e22a8ff6691-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:57:09 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-b4cf6389-abd9-42dd-b809-991e1713cd27 req-3827ac1a-b6b1-491d-8cbd-f51e3d0ab946 service nova] Lock "e048d6f6-f6aa-4491-ae06-9e22a8ff6691-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:57:09 user nova-compute[71731]: DEBUG nova.compute.manager [req-b4cf6389-abd9-42dd-b809-991e1713cd27 req-3827ac1a-b6b1-491d-8cbd-f51e3d0ab946 service nova] [instance: e048d6f6-f6aa-4491-ae06-9e22a8ff6691] No waiting events found dispatching network-vif-plugged-4fb36f71-2601-4c01-9eba-514f5f2af95f {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:57:09 user nova-compute[71731]: WARNING nova.compute.manager [req-b4cf6389-abd9-42dd-b809-991e1713cd27 req-3827ac1a-b6b1-491d-8cbd-f51e3d0ab946 service nova] [instance: e048d6f6-f6aa-4491-ae06-9e22a8ff6691] Received unexpected event network-vif-plugged-4fb36f71-2601-4c01-9eba-514f5f2af95f for instance with vm_state active and task_state reboot_started_hard.
Apr 13 16:57:09 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:57:09 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:57:11 user nova-compute[71731]: DEBUG nova.virt.libvirt.host [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Removed pending event for e048d6f6-f6aa-4491-ae06-9e22a8ff6691 due to event {{(pid=71731) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 13 16:57:11 user nova-compute[71731]: DEBUG nova.virt.driver [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Emitting event <LifecycleEvent: 1681405031.342841, e048d6f6-f6aa-4491-ae06-9e22a8ff6691 => Resumed> {{(pid=71731) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 16:57:11 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: e048d6f6-f6aa-4491-ae06-9e22a8ff6691] VM Resumed (Lifecycle Event)
Apr 13 16:57:11 user nova-compute[71731]: DEBUG nova.compute.manager [None req-c7285f7e-a7ed-4856-95ba-e4a5cc5f917e tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] [instance: e048d6f6-f6aa-4491-ae06-9e22a8ff6691] Instance event wait completed in 0 seconds for  {{(pid=71731) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 16:57:11 user nova-compute[71731]: INFO nova.virt.libvirt.driver [-] [instance: e048d6f6-f6aa-4491-ae06-9e22a8ff6691] Instance rebooted successfully.
Apr 13 16:57:11 user nova-compute[71731]: DEBUG nova.compute.manager [None req-c7285f7e-a7ed-4856-95ba-e4a5cc5f917e tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] [instance: e048d6f6-f6aa-4491-ae06-9e22a8ff6691] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:57:11 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: e048d6f6-f6aa-4491-ae06-9e22a8ff6691] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:57:11 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: e048d6f6-f6aa-4491-ae06-9e22a8ff6691] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=71731) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 16:57:11 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: e048d6f6-f6aa-4491-ae06-9e22a8ff6691] During sync_power_state the instance has a pending task (reboot_started_hard). Skip.
Apr 13 16:57:11 user nova-compute[71731]: DEBUG nova.virt.driver [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Emitting event <LifecycleEvent: 1681405031.3442192, e048d6f6-f6aa-4491-ae06-9e22a8ff6691 => Started> {{(pid=71731) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 16:57:11 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: e048d6f6-f6aa-4491-ae06-9e22a8ff6691] VM Started (Lifecycle Event)
Apr 13 16:57:11 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: e048d6f6-f6aa-4491-ae06-9e22a8ff6691] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:57:11 user nova-compute[71731]: DEBUG nova.compute.manager [req-1a06d75f-0f3a-4968-86c2-661c155492c6 req-abd1ef8f-9bbf-4b17-aa39-fd4f8a9d20a5 service nova] [instance: e048d6f6-f6aa-4491-ae06-9e22a8ff6691] Received event network-vif-plugged-4fb36f71-2601-4c01-9eba-514f5f2af95f {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:57:11 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-1a06d75f-0f3a-4968-86c2-661c155492c6 req-abd1ef8f-9bbf-4b17-aa39-fd4f8a9d20a5 service nova] Acquiring lock "e048d6f6-f6aa-4491-ae06-9e22a8ff6691-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:57:11 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-1a06d75f-0f3a-4968-86c2-661c155492c6 req-abd1ef8f-9bbf-4b17-aa39-fd4f8a9d20a5 service nova] Lock "e048d6f6-f6aa-4491-ae06-9e22a8ff6691-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:57:11 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-1a06d75f-0f3a-4968-86c2-661c155492c6 req-abd1ef8f-9bbf-4b17-aa39-fd4f8a9d20a5 service nova] Lock "e048d6f6-f6aa-4491-ae06-9e22a8ff6691-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:57:11 user nova-compute[71731]: DEBUG nova.compute.manager [req-1a06d75f-0f3a-4968-86c2-661c155492c6 req-abd1ef8f-9bbf-4b17-aa39-fd4f8a9d20a5 service nova] [instance: e048d6f6-f6aa-4491-ae06-9e22a8ff6691] No waiting events found dispatching network-vif-plugged-4fb36f71-2601-4c01-9eba-514f5f2af95f {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:57:11 user nova-compute[71731]: WARNING nova.compute.manager [req-1a06d75f-0f3a-4968-86c2-661c155492c6 req-abd1ef8f-9bbf-4b17-aa39-fd4f8a9d20a5 service nova] [instance: e048d6f6-f6aa-4491-ae06-9e22a8ff6691] Received unexpected event network-vif-plugged-4fb36f71-2601-4c01-9eba-514f5f2af95f for instance with vm_state active and task_state reboot_started_hard.
Apr 13 16:57:11 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: e048d6f6-f6aa-4491-ae06-9e22a8ff6691] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=71731) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 16:57:11 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-c7285f7e-a7ed-4856-95ba-e4a5cc5f917e tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lock "e048d6f6-f6aa-4491-ae06-9e22a8ff6691" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.298s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:57:12 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:57:12 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:57:17 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:57:17 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:57:22 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 16:57:22 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:57:22 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71731) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 16:57:22 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71731) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 16:57:22 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71731) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 16:57:22 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:57:27 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:57:27 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:57:30 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._sync_power_states {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:57:30 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Triggering sync for uuid b2d55cdd-c89c-4c59-afe1-49a33225af22 {{(pid=71731) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 13 16:57:30 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Triggering sync for uuid e048d6f6-f6aa-4491-ae06-9e22a8ff6691 {{(pid=71731) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 13 16:57:30 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Acquiring lock "b2d55cdd-c89c-4c59-afe1-49a33225af22" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:57:30 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "b2d55cdd-c89c-4c59-afe1-49a33225af22" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.002s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:57:30 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Acquiring lock "e048d6f6-f6aa-4491-ae06-9e22a8ff6691" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:57:30 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "e048d6f6-f6aa-4491-ae06-9e22a8ff6691" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:57:30 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "b2d55cdd-c89c-4c59-afe1-49a33225af22" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.041s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:57:30 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "e048d6f6-f6aa-4491-ae06-9e22a8ff6691" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.050s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:57:32 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:57:32 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:57:36 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:57:36 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71731) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 16:57:37 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:57:37 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:57:37 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 16:57:37 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:57:37 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71731) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 16:57:37 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71731) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 16:57:37 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71731) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 16:57:37 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:57:42 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager.update_available_resource {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:57:42 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:57:42 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:57:42 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:57:42 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Auditing locally available compute resources for user (node: user) {{(pid=71731) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 16:57:42 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e048d6f6-f6aa-4491-ae06-9e22a8ff6691/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:57:42 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e048d6f6-f6aa-4491-ae06-9e22a8ff6691/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:57:42 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e048d6f6-f6aa-4491-ae06-9e22a8ff6691/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:57:42 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:57:42 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e048d6f6-f6aa-4491-ae06-9e22a8ff6691/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:57:42 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=71731) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 16:57:42 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2d55cdd-c89c-4c59-afe1-49a33225af22/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:57:42 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-a91e8543-1c94-4e83-af31-69ae10a983f6 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Acquiring lock "b2d55cdd-c89c-4c59-afe1-49a33225af22" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:57:42 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-a91e8543-1c94-4e83-af31-69ae10a983f6 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lock "b2d55cdd-c89c-4c59-afe1-49a33225af22" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:57:42 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-a91e8543-1c94-4e83-af31-69ae10a983f6 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Acquiring lock "b2d55cdd-c89c-4c59-afe1-49a33225af22-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:57:42 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-a91e8543-1c94-4e83-af31-69ae10a983f6 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lock "b2d55cdd-c89c-4c59-afe1-49a33225af22-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:57:42 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-a91e8543-1c94-4e83-af31-69ae10a983f6 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lock "b2d55cdd-c89c-4c59-afe1-49a33225af22-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:57:42 user nova-compute[71731]: INFO nova.compute.manager [None req-a91e8543-1c94-4e83-af31-69ae10a983f6 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] [instance: b2d55cdd-c89c-4c59-afe1-49a33225af22] Terminating instance
Apr 13 16:57:42 user nova-compute[71731]: DEBUG nova.compute.manager [None req-a91e8543-1c94-4e83-af31-69ae10a983f6 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] [instance: b2d55cdd-c89c-4c59-afe1-49a33225af22] Start destroying the instance on the hypervisor. {{(pid=71731) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 16:57:42 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2d55cdd-c89c-4c59-afe1-49a33225af22/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:57:42 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2d55cdd-c89c-4c59-afe1-49a33225af22/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:57:42 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:57:42 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:57:42 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2d55cdd-c89c-4c59-afe1-49a33225af22/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:57:43 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:57:43 user nova-compute[71731]: DEBUG nova.compute.manager [req-7c4dfd37-4973-4671-838a-f8d268e56e9c req-9c5556d2-1228-4043-91e6-d7496c8fbcc8 service nova] [instance: b2d55cdd-c89c-4c59-afe1-49a33225af22] Received event network-vif-unplugged-31e1957f-9bd1-42ae-a2ac-954b49ca15f1 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:57:43 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-7c4dfd37-4973-4671-838a-f8d268e56e9c req-9c5556d2-1228-4043-91e6-d7496c8fbcc8 service nova] Acquiring lock "b2d55cdd-c89c-4c59-afe1-49a33225af22-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:57:43 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-7c4dfd37-4973-4671-838a-f8d268e56e9c req-9c5556d2-1228-4043-91e6-d7496c8fbcc8 service nova] Lock "b2d55cdd-c89c-4c59-afe1-49a33225af22-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:57:43 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-7c4dfd37-4973-4671-838a-f8d268e56e9c req-9c5556d2-1228-4043-91e6-d7496c8fbcc8 service nova] Lock "b2d55cdd-c89c-4c59-afe1-49a33225af22-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:57:43 user nova-compute[71731]: DEBUG nova.compute.manager [req-7c4dfd37-4973-4671-838a-f8d268e56e9c req-9c5556d2-1228-4043-91e6-d7496c8fbcc8 service nova] [instance: b2d55cdd-c89c-4c59-afe1-49a33225af22] No waiting events found dispatching network-vif-unplugged-31e1957f-9bd1-42ae-a2ac-954b49ca15f1 {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:57:43 user nova-compute[71731]: DEBUG nova.compute.manager [req-7c4dfd37-4973-4671-838a-f8d268e56e9c req-9c5556d2-1228-4043-91e6-d7496c8fbcc8 service nova] [instance: b2d55cdd-c89c-4c59-afe1-49a33225af22] Received event network-vif-unplugged-31e1957f-9bd1-42ae-a2ac-954b49ca15f1 for instance with task_state deleting. {{(pid=71731) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 16:57:43 user nova-compute[71731]: WARNING nova.virt.libvirt.driver [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 16:57:43 user nova-compute[71731]: WARNING nova.virt.libvirt.driver [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 16:57:43 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Hypervisor/Node resource view: name=user free_ram=8630MB free_disk=26.036174774169922GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71731) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 16:57:43 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:57:43 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:57:43 user nova-compute[71731]: INFO nova.virt.libvirt.driver [-] [instance: b2d55cdd-c89c-4c59-afe1-49a33225af22] Instance destroyed successfully.
Apr 13 16:57:43 user nova-compute[71731]: DEBUG nova.objects.instance [None req-a91e8543-1c94-4e83-af31-69ae10a983f6 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lazy-loading 'resources' on Instance uuid b2d55cdd-c89c-4c59-afe1-49a33225af22 {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:57:43 user nova-compute[71731]: DEBUG nova.virt.libvirt.vif [None req-a91e8543-1c94-4e83-af31-69ae10a983f6 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T16:40:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-862659387',display_name='tempest-ServerRescueNegativeTestJSON-server-862659387',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-862659387',id=36,image_ref='708622a9-7465-4492-ade8-b827198f7e30',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-13T16:45:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='846732ecb7e047128b4684972d3cd8c6',ramdisk_id='',reservation_id='r-6w8n5dk1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='708622a9-7465-4492-ade8-b827198f7e30',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-84287455',owner_user_name='tempest-ServerRescueNegativeTestJSON-84287455-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T16:47:34Z,user_data=None,user_id='0c7f54723c494e05ada117353c0790cb',uuid=b2d55cdd-c89c-4c59-afe1-49a33225af22,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "31e1957f-9bd1-42ae-a2ac-954b49ca15f1", "address": "fa:16:3e:81:e2:10", "network": {"id": "2a5b69f1-fc5b-4c33-a9eb-12a4d9293500", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2137344591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "846732ecb7e047128b4684972d3cd8c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31e1957f-9b", "ovs_interfaceid": "31e1957f-9bd1-42ae-a2ac-954b49ca15f1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 16:57:43 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-a91e8543-1c94-4e83-af31-69ae10a983f6 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Converting VIF {"id": "31e1957f-9bd1-42ae-a2ac-954b49ca15f1", "address": "fa:16:3e:81:e2:10", "network": {"id": "2a5b69f1-fc5b-4c33-a9eb-12a4d9293500", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2137344591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "846732ecb7e047128b4684972d3cd8c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31e1957f-9b", "ovs_interfaceid": "31e1957f-9bd1-42ae-a2ac-954b49ca15f1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 16:57:43 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-a91e8543-1c94-4e83-af31-69ae10a983f6 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:81:e2:10,bridge_name='br-int',has_traffic_filtering=True,id=31e1957f-9bd1-42ae-a2ac-954b49ca15f1,network=Network(2a5b69f1-fc5b-4c33-a9eb-12a4d9293500),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31e1957f-9b') {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 16:57:43 user nova-compute[71731]: DEBUG os_vif [None req-a91e8543-1c94-4e83-af31-69ae10a983f6 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:81:e2:10,bridge_name='br-int',has_traffic_filtering=True,id=31e1957f-9bd1-42ae-a2ac-954b49ca15f1,network=Network(2a5b69f1-fc5b-4c33-a9eb-12a4d9293500),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31e1957f-9b') {{(pid=71731) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 16:57:43 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:57:43 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap31e1957f-9b, bridge=br-int, if_exists=True) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:57:43 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:57:43 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 16:57:43 user nova-compute[71731]: INFO os_vif [None req-a91e8543-1c94-4e83-af31-69ae10a983f6 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:81:e2:10,bridge_name='br-int',has_traffic_filtering=True,id=31e1957f-9bd1-42ae-a2ac-954b49ca15f1,network=Network(2a5b69f1-fc5b-4c33-a9eb-12a4d9293500),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31e1957f-9b')
Apr 13 16:57:43 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-a91e8543-1c94-4e83-af31-69ae10a983f6 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] [instance: b2d55cdd-c89c-4c59-afe1-49a33225af22] Deleting instance files /opt/stack/data/nova/instances/b2d55cdd-c89c-4c59-afe1-49a33225af22_del
Apr 13 16:57:43 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-a91e8543-1c94-4e83-af31-69ae10a983f6 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] [instance: b2d55cdd-c89c-4c59-afe1-49a33225af22] Deletion of /opt/stack/data/nova/instances/b2d55cdd-c89c-4c59-afe1-49a33225af22_del complete
Apr 13 16:57:43 user nova-compute[71731]: INFO nova.compute.manager [None req-a91e8543-1c94-4e83-af31-69ae10a983f6 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] [instance: b2d55cdd-c89c-4c59-afe1-49a33225af22] Took 0.89 seconds to destroy the instance on the hypervisor.
Apr 13 16:57:43 user nova-compute[71731]: DEBUG oslo.service.loopingcall [None req-a91e8543-1c94-4e83-af31-69ae10a983f6 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71731) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 16:57:43 user nova-compute[71731]: DEBUG nova.compute.manager [-] [instance: b2d55cdd-c89c-4c59-afe1-49a33225af22] Deallocating network for instance {{(pid=71731) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 16:57:43 user nova-compute[71731]: DEBUG nova.network.neutron [-] [instance: b2d55cdd-c89c-4c59-afe1-49a33225af22] deallocate_for_instance() {{(pid=71731) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 16:57:43 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance b2d55cdd-c89c-4c59-afe1-49a33225af22 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 16:57:43 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance e048d6f6-f6aa-4491-ae06-9e22a8ff6691 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 16:57:43 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=71731) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 16:57:43 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Final resource view: name=user phys_ram=16023MB used_ram=768MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=71731) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 16:57:43 user nova-compute[71731]: DEBUG nova.scheduler.client.report [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Refreshing inventories for resource provider cb6b1a64-0c24-4e2d-af1e-16576ca9165c {{(pid=71731) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 13 16:57:43 user nova-compute[71731]: DEBUG nova.scheduler.client.report [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Updating ProviderTree inventory for provider cb6b1a64-0c24-4e2d-af1e-16576ca9165c from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71731) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 13 16:57:43 user nova-compute[71731]: DEBUG nova.compute.provider_tree [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Updating inventory in ProviderTree for provider cb6b1a64-0c24-4e2d-af1e-16576ca9165c with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71731) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 13 16:57:43 user nova-compute[71731]: DEBUG nova.scheduler.client.report [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Refreshing aggregate associations for resource provider cb6b1a64-0c24-4e2d-af1e-16576ca9165c, aggregates: None {{(pid=71731) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 13 16:57:43 user nova-compute[71731]: DEBUG nova.scheduler.client.report [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Refreshing trait associations for resource provider cb6b1a64-0c24-4e2d-af1e-16576ca9165c, traits: COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSSE3,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_SATA,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_SSE,COMPUTE_RESCUE_BFV,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE41,HW_CPU_X86_MMX,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_RAW {{(pid=71731) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 13 16:57:43 user nova-compute[71731]: DEBUG nova.compute.provider_tree [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Inventory has not changed in ProviderTree for provider: cb6b1a64-0c24-4e2d-af1e-16576ca9165c {{(pid=71731) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 16:57:43 user nova-compute[71731]: DEBUG nova.scheduler.client.report [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Inventory has not changed for provider cb6b1a64-0c24-4e2d-af1e-16576ca9165c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71731) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 16:57:43 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Compute_service record updated for user:user {{(pid=71731) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 16:57:43 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.497s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:57:43 user nova-compute[71731]: DEBUG nova.network.neutron [-] [instance: b2d55cdd-c89c-4c59-afe1-49a33225af22] Updating instance_info_cache with network_info: [] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:57:43 user nova-compute[71731]: INFO nova.compute.manager [-] [instance: b2d55cdd-c89c-4c59-afe1-49a33225af22] Took 0.48 seconds to deallocate network for instance.
Apr 13 16:57:43 user nova-compute[71731]: DEBUG nova.compute.manager [req-b0b8511a-9df4-406c-8db5-468ea3d06e14 req-35ba8fae-ae10-4f7f-ad9d-d4e2992c51fd service nova] [instance: b2d55cdd-c89c-4c59-afe1-49a33225af22] Received event network-vif-deleted-31e1957f-9bd1-42ae-a2ac-954b49ca15f1 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:57:43 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-a91e8543-1c94-4e83-af31-69ae10a983f6 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:57:43 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-a91e8543-1c94-4e83-af31-69ae10a983f6 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:57:44 user nova-compute[71731]: DEBUG nova.compute.provider_tree [None req-a91e8543-1c94-4e83-af31-69ae10a983f6 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Inventory has not changed in ProviderTree for provider: cb6b1a64-0c24-4e2d-af1e-16576ca9165c {{(pid=71731) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 16:57:44 user nova-compute[71731]: DEBUG nova.scheduler.client.report [None req-a91e8543-1c94-4e83-af31-69ae10a983f6 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Inventory has not changed for provider cb6b1a64-0c24-4e2d-af1e-16576ca9165c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71731) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 16:57:44 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-a91e8543-1c94-4e83-af31-69ae10a983f6 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.139s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:57:44 user nova-compute[71731]: INFO nova.scheduler.client.report [None req-a91e8543-1c94-4e83-af31-69ae10a983f6 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Deleted allocations for instance b2d55cdd-c89c-4c59-afe1-49a33225af22
Apr 13 16:57:44 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-a91e8543-1c94-4e83-af31-69ae10a983f6 tempest-ServerRescueNegativeTestJSON-84287455 tempest-ServerRescueNegativeTestJSON-84287455-project-member] Lock "b2d55cdd-c89c-4c59-afe1-49a33225af22" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.703s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:57:44 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:57:44 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Starting heal instance info cache {{(pid=71731) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 16:57:44 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Acquiring lock "refresh_cache-e048d6f6-f6aa-4491-ae06-9e22a8ff6691" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 16:57:44 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Acquired lock "refresh_cache-e048d6f6-f6aa-4491-ae06-9e22a8ff6691" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 16:57:44 user nova-compute[71731]: DEBUG nova.network.neutron [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] [instance: e048d6f6-f6aa-4491-ae06-9e22a8ff6691] Forcefully refreshing network info cache for instance {{(pid=71731) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 16:57:44 user nova-compute[71731]: DEBUG nova.compute.manager [req-2267bf14-5467-4e72-8b08-12e66f4d436f req-3d0fb384-91a7-4ff9-a904-1ea196e85ac2 service nova] [instance: b2d55cdd-c89c-4c59-afe1-49a33225af22] Received event network-vif-plugged-31e1957f-9bd1-42ae-a2ac-954b49ca15f1 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:57:44 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-2267bf14-5467-4e72-8b08-12e66f4d436f req-3d0fb384-91a7-4ff9-a904-1ea196e85ac2 service nova] Acquiring lock "b2d55cdd-c89c-4c59-afe1-49a33225af22-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:57:44 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-2267bf14-5467-4e72-8b08-12e66f4d436f req-3d0fb384-91a7-4ff9-a904-1ea196e85ac2 service nova] Lock "b2d55cdd-c89c-4c59-afe1-49a33225af22-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:57:44 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-2267bf14-5467-4e72-8b08-12e66f4d436f req-3d0fb384-91a7-4ff9-a904-1ea196e85ac2 service nova] Lock "b2d55cdd-c89c-4c59-afe1-49a33225af22-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:57:44 user nova-compute[71731]: DEBUG nova.compute.manager [req-2267bf14-5467-4e72-8b08-12e66f4d436f req-3d0fb384-91a7-4ff9-a904-1ea196e85ac2 service nova] [instance: b2d55cdd-c89c-4c59-afe1-49a33225af22] No waiting events found dispatching network-vif-plugged-31e1957f-9bd1-42ae-a2ac-954b49ca15f1 {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:57:44 user nova-compute[71731]: WARNING nova.compute.manager [req-2267bf14-5467-4e72-8b08-12e66f4d436f req-3d0fb384-91a7-4ff9-a904-1ea196e85ac2 service nova] [instance: b2d55cdd-c89c-4c59-afe1-49a33225af22] Received unexpected event network-vif-plugged-31e1957f-9bd1-42ae-a2ac-954b49ca15f1 for instance with vm_state deleted and task_state None.
Apr 13 16:57:45 user nova-compute[71731]: DEBUG nova.network.neutron [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] [instance: e048d6f6-f6aa-4491-ae06-9e22a8ff6691] Updating instance_info_cache with network_info: [{"id": "4fb36f71-2601-4c01-9eba-514f5f2af95f", "address": "fa:16:3e:11:9f:98", "network": {"id": "0c6a5f46-e53b-4b4c-806e-b2617ba3ef35", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1984894004-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.143", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7edf468527d84954a943bb4c1f7ff54d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fb36f71-26", "ovs_interfaceid": "4fb36f71-2601-4c01-9eba-514f5f2af95f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:57:45 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Releasing lock "refresh_cache-e048d6f6-f6aa-4491-ae06-9e22a8ff6691" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 16:57:45 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] [instance: e048d6f6-f6aa-4491-ae06-9e22a8ff6691] Updated the network info_cache for instance {{(pid=71731) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 16:57:45 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:57:45 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:57:45 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:57:46 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:57:48 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:57:53 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 16:57:57 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:57:58 user nova-compute[71731]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681405063.3285394, b2d55cdd-c89c-4c59-afe1-49a33225af22 => Stopped> {{(pid=71731) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 16:57:58 user nova-compute[71731]: INFO nova.compute.manager [-] [instance: b2d55cdd-c89c-4c59-afe1-49a33225af22] VM Stopped (Lifecycle Event)
Apr 13 16:57:58 user nova-compute[71731]: DEBUG nova.compute.manager [None req-fd61b34b-c629-409e-9a3e-bb19272b15b9 None None] [instance: b2d55cdd-c89c-4c59-afe1-49a33225af22] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:57:58 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:58:03 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:58:08 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:58:13 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 16:58:18 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 16:58:23 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:58:28 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 16:58:33 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:58:33 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:58:35 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:58:36 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:58:36 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71731) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 16:58:37 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:58:37 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:58:37 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:58:38 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:58:40 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:58:42 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager.update_available_resource {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:58:42 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:58:42 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:58:42 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:58:42 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Auditing locally available compute resources for user (node: user) {{(pid=71731) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 16:58:42 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e048d6f6-f6aa-4491-ae06-9e22a8ff6691/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:58:42 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e048d6f6-f6aa-4491-ae06-9e22a8ff6691/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:58:42 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e048d6f6-f6aa-4491-ae06-9e22a8ff6691/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:58:42 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e048d6f6-f6aa-4491-ae06-9e22a8ff6691/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:58:42 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=71731) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 16:58:42 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:58:42 user nova-compute[71731]: WARNING nova.virt.libvirt.driver [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 16:58:42 user nova-compute[71731]: WARNING nova.virt.libvirt.driver [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 16:58:42 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Hypervisor/Node resource view: name=user free_ram=8714MB free_disk=26.046920776367188GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71731) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 16:58:42 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:58:42 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:58:42 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance e048d6f6-f6aa-4491-ae06-9e22a8ff6691 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 16:58:42 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=71731) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 16:58:42 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=71731) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 16:58:42 user nova-compute[71731]: DEBUG nova.compute.provider_tree [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Inventory has not changed in ProviderTree for provider: cb6b1a64-0c24-4e2d-af1e-16576ca9165c {{(pid=71731) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 16:58:43 user nova-compute[71731]: DEBUG nova.scheduler.client.report [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Inventory has not changed for provider cb6b1a64-0c24-4e2d-af1e-16576ca9165c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71731) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 16:58:43 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Compute_service record updated for user:user {{(pid=71731) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 16:58:43 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.214s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:58:43 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:58:43 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:58:45 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:58:45 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:58:45 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Starting heal instance info cache {{(pid=71731) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 16:58:45 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Rebuilding the list of instances to heal {{(pid=71731) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 13 16:58:45 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Acquiring lock "refresh_cache-e048d6f6-f6aa-4491-ae06-9e22a8ff6691" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 16:58:45 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Acquired lock "refresh_cache-e048d6f6-f6aa-4491-ae06-9e22a8ff6691" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 16:58:45 user nova-compute[71731]: DEBUG nova.network.neutron [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] [instance: e048d6f6-f6aa-4491-ae06-9e22a8ff6691] Forcefully refreshing network info cache for instance {{(pid=71731) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 16:58:45 user nova-compute[71731]: DEBUG nova.objects.instance [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lazy-loading 'info_cache' on Instance uuid e048d6f6-f6aa-4491-ae06-9e22a8ff6691 {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:58:45 user nova-compute[71731]: DEBUG nova.network.neutron [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] [instance: e048d6f6-f6aa-4491-ae06-9e22a8ff6691] Updating instance_info_cache with network_info: [{"id": "4fb36f71-2601-4c01-9eba-514f5f2af95f", "address": "fa:16:3e:11:9f:98", "network": {"id": "0c6a5f46-e53b-4b4c-806e-b2617ba3ef35", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1984894004-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.143", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7edf468527d84954a943bb4c1f7ff54d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fb36f71-26", "ovs_interfaceid": "4fb36f71-2601-4c01-9eba-514f5f2af95f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:58:45 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Releasing lock "refresh_cache-e048d6f6-f6aa-4491-ae06-9e22a8ff6691" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 16:58:45 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] [instance: e048d6f6-f6aa-4491-ae06-9e22a8ff6691] Updated the network info_cache for instance {{(pid=71731) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 16:58:45 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:58:46 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:58:46 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-92aff2a1-0565-4b49-8875-ec3d159ce5a5 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Acquiring lock "b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:58:46 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-92aff2a1-0565-4b49-8875-ec3d159ce5a5 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:58:46 user nova-compute[71731]: DEBUG nova.compute.manager [None req-92aff2a1-0565-4b49-8875-ec3d159ce5a5 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] [instance: b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c] Starting instance... {{(pid=71731) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 16:58:46 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-92aff2a1-0565-4b49-8875-ec3d159ce5a5 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:58:46 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-92aff2a1-0565-4b49-8875-ec3d159ce5a5 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:58:46 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-92aff2a1-0565-4b49-8875-ec3d159ce5a5 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71731) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 16:58:46 user nova-compute[71731]: INFO nova.compute.claims [None req-92aff2a1-0565-4b49-8875-ec3d159ce5a5 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] [instance: b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c] Claim successful on node user
Apr 13 16:58:46 user nova-compute[71731]: DEBUG nova.compute.provider_tree [None req-92aff2a1-0565-4b49-8875-ec3d159ce5a5 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Inventory has not changed in ProviderTree for provider: cb6b1a64-0c24-4e2d-af1e-16576ca9165c {{(pid=71731) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 16:58:46 user nova-compute[71731]: DEBUG nova.scheduler.client.report [None req-92aff2a1-0565-4b49-8875-ec3d159ce5a5 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Inventory has not changed for provider cb6b1a64-0c24-4e2d-af1e-16576ca9165c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71731) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 16:58:46 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-92aff2a1-0565-4b49-8875-ec3d159ce5a5 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.223s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:58:46 user nova-compute[71731]: DEBUG nova.compute.manager [None req-92aff2a1-0565-4b49-8875-ec3d159ce5a5 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] [instance: b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c] Start building networks asynchronously for instance. {{(pid=71731) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 16:58:47 user nova-compute[71731]: DEBUG nova.compute.manager [None req-92aff2a1-0565-4b49-8875-ec3d159ce5a5 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] [instance: b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c] Allocating IP information in the background. {{(pid=71731) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 16:58:47 user nova-compute[71731]: DEBUG nova.network.neutron [None req-92aff2a1-0565-4b49-8875-ec3d159ce5a5 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] [instance: b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c] allocate_for_instance() {{(pid=71731) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 16:58:47 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-92aff2a1-0565-4b49-8875-ec3d159ce5a5 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] [instance: b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 16:58:47 user nova-compute[71731]: DEBUG nova.compute.manager [None req-92aff2a1-0565-4b49-8875-ec3d159ce5a5 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] [instance: b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c] Start building block device mappings for instance. {{(pid=71731) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 16:58:47 user nova-compute[71731]: DEBUG nova.policy [None req-92aff2a1-0565-4b49-8875-ec3d159ce5a5 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a08b0caad23045c1822cdd0b3ae0769f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097b15faad8249c9bf45623d0c3ab518', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71731) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 16:58:47 user nova-compute[71731]: DEBUG nova.compute.manager [None req-92aff2a1-0565-4b49-8875-ec3d159ce5a5 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] [instance: b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c] Start spawning the instance on the hypervisor. {{(pid=71731) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 16:58:47 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-92aff2a1-0565-4b49-8875-ec3d159ce5a5 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] [instance: b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c] Creating instance directory {{(pid=71731) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 16:58:47 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-92aff2a1-0565-4b49-8875-ec3d159ce5a5 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] [instance: b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c] Creating image(s)
Apr 13 16:58:47 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-92aff2a1-0565-4b49-8875-ec3d159ce5a5 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Acquiring lock "/opt/stack/data/nova/instances/b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:58:47 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-92aff2a1-0565-4b49-8875-ec3d159ce5a5 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "/opt/stack/data/nova/instances/b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:58:47 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-92aff2a1-0565-4b49-8875-ec3d159ce5a5 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "/opt/stack/data/nova/instances/b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:58:47 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-92aff2a1-0565-4b49-8875-ec3d159ce5a5 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279 --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:58:47 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-92aff2a1-0565-4b49-8875-ec3d159ce5a5 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279 --force-share --output=json" returned: 0 in 0.137s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:58:47 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-92aff2a1-0565-4b49-8875-ec3d159ce5a5 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Acquiring lock "9524227dd898575c3099d3976f096cd935414279" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:58:47 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-92aff2a1-0565-4b49-8875-ec3d159ce5a5 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "9524227dd898575c3099d3976f096cd935414279" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:58:47 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-92aff2a1-0565-4b49-8875-ec3d159ce5a5 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279 --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:58:47 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:58:47 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-92aff2a1-0565-4b49-8875-ec3d159ce5a5 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279 --force-share --output=json" returned: 0 in 0.137s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:58:47 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-92aff2a1-0565-4b49-8875-ec3d159ce5a5 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279,backing_fmt=raw /opt/stack/data/nova/instances/b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c/disk 1073741824 {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:58:47 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-92aff2a1-0565-4b49-8875-ec3d159ce5a5 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279,backing_fmt=raw /opt/stack/data/nova/instances/b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c/disk 1073741824" returned: 0 in 0.203s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:58:47 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-92aff2a1-0565-4b49-8875-ec3d159ce5a5 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "9524227dd898575c3099d3976f096cd935414279" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.345s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:58:47 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-92aff2a1-0565-4b49-8875-ec3d159ce5a5 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279 --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:58:47 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-92aff2a1-0565-4b49-8875-ec3d159ce5a5 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279 --force-share --output=json" returned: 0 in 0.142s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:58:47 user nova-compute[71731]: DEBUG nova.virt.disk.api [None req-92aff2a1-0565-4b49-8875-ec3d159ce5a5 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c/disk. size=1073741824 {{(pid=71731) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 16:58:47 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-92aff2a1-0565-4b49-8875-ec3d159ce5a5 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:58:47 user nova-compute[71731]: DEBUG nova.network.neutron [None req-92aff2a1-0565-4b49-8875-ec3d159ce5a5 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] [instance: b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c] Successfully created port: 70f91af6-4a58-4b9d-a132-93537d398c24 {{(pid=71731) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 16:58:47 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-92aff2a1-0565-4b49-8875-ec3d159ce5a5 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:58:47 user nova-compute[71731]: DEBUG nova.virt.disk.api [None req-92aff2a1-0565-4b49-8875-ec3d159ce5a5 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Cannot resize image /opt/stack/data/nova/instances/b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c/disk to a smaller size. {{(pid=71731) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 16:58:47 user nova-compute[71731]: DEBUG nova.objects.instance [None req-92aff2a1-0565-4b49-8875-ec3d159ce5a5 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lazy-loading 'migration_context' on Instance uuid b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:58:47 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-92aff2a1-0565-4b49-8875-ec3d159ce5a5 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] [instance: b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c] Created local disks {{(pid=71731) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 16:58:47 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-92aff2a1-0565-4b49-8875-ec3d159ce5a5 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] [instance: b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c] Ensure instance console log exists: /opt/stack/data/nova/instances/b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c/console.log {{(pid=71731) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 16:58:47 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-92aff2a1-0565-4b49-8875-ec3d159ce5a5 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:58:47 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-92aff2a1-0565-4b49-8875-ec3d159ce5a5 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:58:47 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-92aff2a1-0565-4b49-8875-ec3d159ce5a5 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:58:48 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:58:48 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:58:48 user nova-compute[71731]: DEBUG nova.network.neutron [None req-92aff2a1-0565-4b49-8875-ec3d159ce5a5 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] [instance: b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c] Successfully updated port: 70f91af6-4a58-4b9d-a132-93537d398c24 {{(pid=71731) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 16:58:48 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-92aff2a1-0565-4b49-8875-ec3d159ce5a5 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Acquiring lock "refresh_cache-b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 16:58:48 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-92aff2a1-0565-4b49-8875-ec3d159ce5a5 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Acquired lock "refresh_cache-b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 16:58:48 user nova-compute[71731]: DEBUG nova.network.neutron [None req-92aff2a1-0565-4b49-8875-ec3d159ce5a5 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] [instance: b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c] Building network info cache for instance {{(pid=71731) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 16:58:48 user nova-compute[71731]: DEBUG nova.compute.manager [req-f20d19be-1052-4af8-93eb-3586f98f5201 req-9703e1fd-9f57-44cf-a2d3-4f02851a1053 service nova] [instance: b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c] Received event network-changed-70f91af6-4a58-4b9d-a132-93537d398c24 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:58:48 user nova-compute[71731]: DEBUG nova.compute.manager [req-f20d19be-1052-4af8-93eb-3586f98f5201 req-9703e1fd-9f57-44cf-a2d3-4f02851a1053 service nova] [instance: b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c] Refreshing instance network info cache due to event network-changed-70f91af6-4a58-4b9d-a132-93537d398c24. {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 16:58:48 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-f20d19be-1052-4af8-93eb-3586f98f5201 req-9703e1fd-9f57-44cf-a2d3-4f02851a1053 service nova] Acquiring lock "refresh_cache-b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 16:58:48 user nova-compute[71731]: DEBUG nova.network.neutron [None req-92aff2a1-0565-4b49-8875-ec3d159ce5a5 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] [instance: b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c] Instance cache missing network info. {{(pid=71731) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 16:58:49 user nova-compute[71731]: DEBUG nova.network.neutron [None req-92aff2a1-0565-4b49-8875-ec3d159ce5a5 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] [instance: b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c] Updating instance_info_cache with network_info: [{"id": "70f91af6-4a58-4b9d-a132-93537d398c24", "address": "fa:16:3e:fa:86:cf", "network": {"id": "436011a9-c48b-4f33-a576-a245b344dd72", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-116243831-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "097b15faad8249c9bf45623d0c3ab518", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70f91af6-4a", "ovs_interfaceid": "70f91af6-4a58-4b9d-a132-93537d398c24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:58:49 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-92aff2a1-0565-4b49-8875-ec3d159ce5a5 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Releasing lock "refresh_cache-b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 16:58:49 user nova-compute[71731]: DEBUG nova.compute.manager [None req-92aff2a1-0565-4b49-8875-ec3d159ce5a5 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] [instance: b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c] Instance network_info: |[{"id": "70f91af6-4a58-4b9d-a132-93537d398c24", "address": "fa:16:3e:fa:86:cf", "network": {"id": "436011a9-c48b-4f33-a576-a245b344dd72", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-116243831-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "097b15faad8249c9bf45623d0c3ab518", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70f91af6-4a", "ovs_interfaceid": "70f91af6-4a58-4b9d-a132-93537d398c24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71731) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 16:58:49 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-f20d19be-1052-4af8-93eb-3586f98f5201 req-9703e1fd-9f57-44cf-a2d3-4f02851a1053 service nova] Acquired lock "refresh_cache-b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 16:58:49 user nova-compute[71731]: DEBUG nova.network.neutron [req-f20d19be-1052-4af8-93eb-3586f98f5201 req-9703e1fd-9f57-44cf-a2d3-4f02851a1053 service nova] [instance: b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c] Refreshing network info cache for port 70f91af6-4a58-4b9d-a132-93537d398c24 {{(pid=71731) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 16:58:49 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-92aff2a1-0565-4b49-8875-ec3d159ce5a5 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] [instance: b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c] Start _get_guest_xml network_info=[{"id": "70f91af6-4a58-4b9d-a132-93537d398c24", "address": "fa:16:3e:fa:86:cf", "network": {"id": "436011a9-c48b-4f33-a576-a245b344dd72", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-116243831-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "097b15faad8249c9bf45623d0c3ab518", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70f91af6-4a", "ovs_interfaceid": "70f91af6-4a58-4b9d-a132-93537d398c24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T16:16:31Z,direct_url=<?>,disk_format='qcow2',id=708622a9-7465-4492-ade8-b827198f7e30,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='0b29a975c552465aba0ac7d6288434bd',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T16:16:33Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'device_type': 'disk', 'encrypted': False, 'disk_bus': 'virtio', 'guest_format': None, 'encryption_options': None, 'image_id': '708622a9-7465-4492-ade8-b827198f7e30'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71731) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 16:58:49 user nova-compute[71731]: WARNING nova.virt.libvirt.driver [None req-92aff2a1-0565-4b49-8875-ec3d159ce5a5 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 16:58:49 user nova-compute[71731]: WARNING nova.virt.libvirt.driver [None req-92aff2a1-0565-4b49-8875-ec3d159ce5a5 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 16:58:49 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-92aff2a1-0565-4b49-8875-ec3d159ce5a5 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71731) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 16:58:49 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-92aff2a1-0565-4b49-8875-ec3d159ce5a5 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T16:17:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T16:16:31Z,direct_url=<?>,disk_format='qcow2',id=708622a9-7465-4492-ade8-b827198f7e30,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='0b29a975c552465aba0ac7d6288434bd',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T16:16:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 16:58:49 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-92aff2a1-0565-4b49-8875-ec3d159ce5a5 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Flavor limits 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 16:58:49 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-92aff2a1-0565-4b49-8875-ec3d159ce5a5 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Image limits 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 16:58:49 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-92aff2a1-0565-4b49-8875-ec3d159ce5a5 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Flavor pref 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 16:58:49 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-92aff2a1-0565-4b49-8875-ec3d159ce5a5 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Image pref 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 16:58:49 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-92aff2a1-0565-4b49-8875-ec3d159ce5a5 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 16:58:49 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-92aff2a1-0565-4b49-8875-ec3d159ce5a5 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 16:58:49 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-92aff2a1-0565-4b49-8875-ec3d159ce5a5 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71731) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 16:58:49 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-92aff2a1-0565-4b49-8875-ec3d159ce5a5 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Got 1 possible topologies {{(pid=71731) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 16:58:49 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-92aff2a1-0565-4b49-8875-ec3d159ce5a5 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 16:58:49 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-92aff2a1-0565-4b49-8875-ec3d159ce5a5 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 16:58:49 user nova-compute[71731]: DEBUG nova.virt.libvirt.vif [None req-92aff2a1-0565-4b49-8875-ec3d159ce5a5 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T16:58:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-927136914',display_name='tempest-AttachVolumeNegativeTest-server-927136914',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-927136914',id=43,image_ref='708622a9-7465-4492-ade8-b827198f7e30',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDxnreQ3oNJolzetbWWAWXzlquIXNhkVGKnwbC0EAq0bWPFtp/dD5+5IVTDgaPUae2PSPpek/Lb6EaNCplv8swLuJDV95U7xYBvyFjedyTNKkhRNn1viozORpvkUgnZNmw==',key_name='tempest-keypair-812505684',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='097b15faad8249c9bf45623d0c3ab518',ramdisk_id='',reservation_id='r-tacg96f3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='708622a9-7465-4492-ade8-b827198f7e30',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-236067262',owner_user_name='tempest-AttachVolumeNegativeTest-236067262-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T16:58:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a08b0caad23045c1822cdd0b3ae0769f',uuid=b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "70f91af6-4a58-4b9d-a132-93537d398c24", "address": "fa:16:3e:fa:86:cf", "network": {"id": "436011a9-c48b-4f33-a576-a245b344dd72", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-116243831-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "097b15faad8249c9bf45623d0c3ab518", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70f91af6-4a", "ovs_interfaceid": "70f91af6-4a58-4b9d-a132-93537d398c24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71731) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 16:58:49 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-92aff2a1-0565-4b49-8875-ec3d159ce5a5 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Converting VIF {"id": "70f91af6-4a58-4b9d-a132-93537d398c24", "address": "fa:16:3e:fa:86:cf", "network": {"id": "436011a9-c48b-4f33-a576-a245b344dd72", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-116243831-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "097b15faad8249c9bf45623d0c3ab518", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70f91af6-4a", "ovs_interfaceid": "70f91af6-4a58-4b9d-a132-93537d398c24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 16:58:49 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-92aff2a1-0565-4b49-8875-ec3d159ce5a5 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fa:86:cf,bridge_name='br-int',has_traffic_filtering=True,id=70f91af6-4a58-4b9d-a132-93537d398c24,network=Network(436011a9-c48b-4f33-a576-a245b344dd72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70f91af6-4a') {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 16:58:49 user nova-compute[71731]: DEBUG nova.objects.instance [None req-92aff2a1-0565-4b49-8875-ec3d159ce5a5 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lazy-loading 'pci_devices' on Instance uuid b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:58:49 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-92aff2a1-0565-4b49-8875-ec3d159ce5a5 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] [instance: b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c] End _get_guest_xml xml=<domain type="kvm">
Apr 13 16:58:49 user nova-compute[71731]:   <uuid>b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c</uuid>
Apr 13 16:58:49 user nova-compute[71731]:   <name>instance-0000002b</name>
Apr 13 16:58:49 user nova-compute[71731]:   <memory>131072</memory>
Apr 13 16:58:49 user nova-compute[71731]:   <vcpu>1</vcpu>
Apr 13 16:58:49 user nova-compute[71731]:   <metadata>
Apr 13 16:58:49 user nova-compute[71731]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 16:58:49 user nova-compute[71731]:       <nova:package version="0.0.0"/>
Apr 13 16:58:49 user nova-compute[71731]:       <nova:name>tempest-AttachVolumeNegativeTest-server-927136914</nova:name>
Apr 13 16:58:49 user nova-compute[71731]:       <nova:creationTime>2023-04-13 16:58:49</nova:creationTime>
Apr 13 16:58:49 user nova-compute[71731]:       <nova:flavor name="m1.nano">
Apr 13 16:58:49 user nova-compute[71731]:         <nova:memory>128</nova:memory>
Apr 13 16:58:49 user nova-compute[71731]:         <nova:disk>1</nova:disk>
Apr 13 16:58:49 user nova-compute[71731]:         <nova:swap>0</nova:swap>
Apr 13 16:58:49 user nova-compute[71731]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 16:58:49 user nova-compute[71731]:         <nova:vcpus>1</nova:vcpus>
Apr 13 16:58:49 user nova-compute[71731]:       </nova:flavor>
Apr 13 16:58:49 user nova-compute[71731]:       <nova:owner>
Apr 13 16:58:49 user nova-compute[71731]:         <nova:user uuid="a08b0caad23045c1822cdd0b3ae0769f">tempest-AttachVolumeNegativeTest-236067262-project-member</nova:user>
Apr 13 16:58:49 user nova-compute[71731]:         <nova:project uuid="097b15faad8249c9bf45623d0c3ab518">tempest-AttachVolumeNegativeTest-236067262</nova:project>
Apr 13 16:58:49 user nova-compute[71731]:       </nova:owner>
Apr 13 16:58:49 user nova-compute[71731]:       <nova:root type="image" uuid="708622a9-7465-4492-ade8-b827198f7e30"/>
Apr 13 16:58:49 user nova-compute[71731]:       <nova:ports>
Apr 13 16:58:49 user nova-compute[71731]:         <nova:port uuid="70f91af6-4a58-4b9d-a132-93537d398c24">
Apr 13 16:58:49 user nova-compute[71731]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Apr 13 16:58:49 user nova-compute[71731]:         </nova:port>
Apr 13 16:58:49 user nova-compute[71731]:       </nova:ports>
Apr 13 16:58:49 user nova-compute[71731]:     </nova:instance>
Apr 13 16:58:49 user nova-compute[71731]:   </metadata>
Apr 13 16:58:49 user nova-compute[71731]:   <sysinfo type="smbios">
Apr 13 16:58:49 user nova-compute[71731]:     <system>
Apr 13 16:58:49 user nova-compute[71731]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 16:58:49 user nova-compute[71731]:       <entry name="product">OpenStack Nova</entry>
Apr 13 16:58:49 user nova-compute[71731]:       <entry name="version">0.0.0</entry>
Apr 13 16:58:49 user nova-compute[71731]:       <entry name="serial">b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c</entry>
Apr 13 16:58:49 user nova-compute[71731]:       <entry name="uuid">b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c</entry>
Apr 13 16:58:49 user nova-compute[71731]:       <entry name="family">Virtual Machine</entry>
Apr 13 16:58:49 user nova-compute[71731]:     </system>
Apr 13 16:58:49 user nova-compute[71731]:   </sysinfo>
Apr 13 16:58:49 user nova-compute[71731]:   <os>
Apr 13 16:58:49 user nova-compute[71731]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 16:58:49 user nova-compute[71731]:     <boot dev="hd"/>
Apr 13 16:58:49 user nova-compute[71731]:     <smbios mode="sysinfo"/>
Apr 13 16:58:49 user nova-compute[71731]:   </os>
Apr 13 16:58:49 user nova-compute[71731]:   <features>
Apr 13 16:58:49 user nova-compute[71731]:     <acpi/>
Apr 13 16:58:49 user nova-compute[71731]:     <apic/>
Apr 13 16:58:49 user nova-compute[71731]:     <vmcoreinfo/>
Apr 13 16:58:49 user nova-compute[71731]:   </features>
Apr 13 16:58:49 user nova-compute[71731]:   <clock offset="utc">
Apr 13 16:58:49 user nova-compute[71731]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 16:58:49 user nova-compute[71731]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 16:58:49 user nova-compute[71731]:     <timer name="hpet" present="no"/>
Apr 13 16:58:49 user nova-compute[71731]:   </clock>
Apr 13 16:58:49 user nova-compute[71731]:   <cpu mode="custom" match="exact">
Apr 13 16:58:49 user nova-compute[71731]:     <model>Nehalem</model>
Apr 13 16:58:49 user nova-compute[71731]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 16:58:49 user nova-compute[71731]:   </cpu>
Apr 13 16:58:49 user nova-compute[71731]:   <devices>
Apr 13 16:58:49 user nova-compute[71731]:     <disk type="file" device="disk">
Apr 13 16:58:49 user nova-compute[71731]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 16:58:49 user nova-compute[71731]:       <source file="/opt/stack/data/nova/instances/b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c/disk"/>
Apr 13 16:58:49 user nova-compute[71731]:       <target dev="vda" bus="virtio"/>
Apr 13 16:58:49 user nova-compute[71731]:     </disk>
Apr 13 16:58:49 user nova-compute[71731]:     <interface type="ethernet">
Apr 13 16:58:49 user nova-compute[71731]:       <mac address="fa:16:3e:fa:86:cf"/>
Apr 13 16:58:49 user nova-compute[71731]:       <model type="virtio"/>
Apr 13 16:58:49 user nova-compute[71731]:       <mtu size="1442"/>
Apr 13 16:58:49 user nova-compute[71731]:       <target dev="tap70f91af6-4a"/>
Apr 13 16:58:49 user nova-compute[71731]:     </interface>
Apr 13 16:58:49 user nova-compute[71731]:     <serial type="pty">
Apr 13 16:58:49 user nova-compute[71731]:       <log file="/opt/stack/data/nova/instances/b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c/console.log" append="off"/>
Apr 13 16:58:49 user nova-compute[71731]:     </serial>
Apr 13 16:58:49 user nova-compute[71731]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 16:58:49 user nova-compute[71731]:     <video>
Apr 13 16:58:49 user nova-compute[71731]:       <model type="virtio"/>
Apr 13 16:58:49 user nova-compute[71731]:     </video>
Apr 13 16:58:49 user nova-compute[71731]:     <rng model="virtio">
Apr 13 16:58:49 user nova-compute[71731]:       <backend model="random">/dev/urandom</backend>
Apr 13 16:58:49 user nova-compute[71731]:     </rng>
Apr 13 16:58:49 user nova-compute[71731]:     <controller type="usb" index="0" model="none"/>
Apr 13 16:58:49 user nova-compute[71731]:     <memballoon model="virtio">
Apr 13 16:58:49 user nova-compute[71731]:       <stats period="10"/>
Apr 13 16:58:49 user nova-compute[71731]:     </memballoon>
Apr 13 16:58:49 user nova-compute[71731]:   </devices>
Apr 13 16:58:49 user nova-compute[71731]: </domain>
Apr 13 16:58:49 user nova-compute[71731]:  {{(pid=71731) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 16:58:49 user nova-compute[71731]: DEBUG nova.virt.libvirt.vif [None req-92aff2a1-0565-4b49-8875-ec3d159ce5a5 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T16:58:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-927136914',display_name='tempest-AttachVolumeNegativeTest-server-927136914',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-927136914',id=43,image_ref='708622a9-7465-4492-ade8-b827198f7e30',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDxnreQ3oNJolzetbWWAWXzlquIXNhkVGKnwbC0EAq0bWPFtp/dD5+5IVTDgaPUae2PSPpek/Lb6EaNCplv8swLuJDV95U7xYBvyFjedyTNKkhRNn1viozORpvkUgnZNmw==',key_name='tempest-keypair-812505684',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='097b15faad8249c9bf45623d0c3ab518',ramdisk_id='',reservation_id='r-tacg96f3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='708622a9-7465-4492-ade8-b827198f7e30',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-236067262',owner_user_name='tempest-AttachVolumeNegativeTest-236067262-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T16:58:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a08b0caad23045c1822cdd0b3ae0769f',uuid=b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "70f91af6-4a58-4b9d-a132-93537d398c24", "address": "fa:16:3e:fa:86:cf", "network": {"id": "436011a9-c48b-4f33-a576-a245b344dd72", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-116243831-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "097b15faad8249c9bf45623d0c3ab518", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70f91af6-4a", "ovs_interfaceid": "70f91af6-4a58-4b9d-a132-93537d398c24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 16:58:49 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-92aff2a1-0565-4b49-8875-ec3d159ce5a5 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Converting VIF {"id": "70f91af6-4a58-4b9d-a132-93537d398c24", "address": "fa:16:3e:fa:86:cf", "network": {"id": "436011a9-c48b-4f33-a576-a245b344dd72", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-116243831-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "097b15faad8249c9bf45623d0c3ab518", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70f91af6-4a", "ovs_interfaceid": "70f91af6-4a58-4b9d-a132-93537d398c24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 16:58:49 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-92aff2a1-0565-4b49-8875-ec3d159ce5a5 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fa:86:cf,bridge_name='br-int',has_traffic_filtering=True,id=70f91af6-4a58-4b9d-a132-93537d398c24,network=Network(436011a9-c48b-4f33-a576-a245b344dd72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70f91af6-4a') {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 16:58:49 user nova-compute[71731]: DEBUG os_vif [None req-92aff2a1-0565-4b49-8875-ec3d159ce5a5 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fa:86:cf,bridge_name='br-int',has_traffic_filtering=True,id=70f91af6-4a58-4b9d-a132-93537d398c24,network=Network(436011a9-c48b-4f33-a576-a245b344dd72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70f91af6-4a') {{(pid=71731) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 16:58:49 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:58:49 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:58:49 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 16:58:49 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:58:49 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap70f91af6-4a, may_exist=True) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:58:49 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap70f91af6-4a, col_values=(('external_ids', {'iface-id': '70f91af6-4a58-4b9d-a132-93537d398c24', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fa:86:cf', 'vm-uuid': 'b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c'}),)) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:58:49 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:58:49 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 16:58:49 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:58:49 user nova-compute[71731]: INFO os_vif [None req-92aff2a1-0565-4b49-8875-ec3d159ce5a5 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fa:86:cf,bridge_name='br-int',has_traffic_filtering=True,id=70f91af6-4a58-4b9d-a132-93537d398c24,network=Network(436011a9-c48b-4f33-a576-a245b344dd72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70f91af6-4a')
Apr 13 16:58:49 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-92aff2a1-0565-4b49-8875-ec3d159ce5a5 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] No BDM found with device name vda, not building metadata. {{(pid=71731) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 16:58:49 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-92aff2a1-0565-4b49-8875-ec3d159ce5a5 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] No VIF found with MAC fa:16:3e:fa:86:cf, not building metadata {{(pid=71731) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 16:58:49 user nova-compute[71731]: DEBUG nova.network.neutron [req-f20d19be-1052-4af8-93eb-3586f98f5201 req-9703e1fd-9f57-44cf-a2d3-4f02851a1053 service nova] [instance: b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c] Updated VIF entry in instance network info cache for port 70f91af6-4a58-4b9d-a132-93537d398c24. {{(pid=71731) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 16:58:49 user nova-compute[71731]: DEBUG nova.network.neutron [req-f20d19be-1052-4af8-93eb-3586f98f5201 req-9703e1fd-9f57-44cf-a2d3-4f02851a1053 service nova] [instance: b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c] Updating instance_info_cache with network_info: [{"id": "70f91af6-4a58-4b9d-a132-93537d398c24", "address": "fa:16:3e:fa:86:cf", "network": {"id": "436011a9-c48b-4f33-a576-a245b344dd72", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-116243831-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "097b15faad8249c9bf45623d0c3ab518", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70f91af6-4a", "ovs_interfaceid": "70f91af6-4a58-4b9d-a132-93537d398c24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:58:49 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-f20d19be-1052-4af8-93eb-3586f98f5201 req-9703e1fd-9f57-44cf-a2d3-4f02851a1053 service nova] Releasing lock "refresh_cache-b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 16:58:50 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:58:50 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:58:50 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:58:50 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:58:50 user nova-compute[71731]: DEBUG nova.compute.manager [req-dad4a201-6a36-4ad2-84c9-d14a013e64da req-e90eabc8-3637-4b23-ad35-ef99d0ebe5eb service nova] [instance: b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c] Received event network-vif-plugged-70f91af6-4a58-4b9d-a132-93537d398c24 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:58:50 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-dad4a201-6a36-4ad2-84c9-d14a013e64da req-e90eabc8-3637-4b23-ad35-ef99d0ebe5eb service nova] Acquiring lock "b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:58:50 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-dad4a201-6a36-4ad2-84c9-d14a013e64da req-e90eabc8-3637-4b23-ad35-ef99d0ebe5eb service nova] Lock "b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:58:50 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-dad4a201-6a36-4ad2-84c9-d14a013e64da req-e90eabc8-3637-4b23-ad35-ef99d0ebe5eb service nova] Lock "b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:58:50 user nova-compute[71731]: DEBUG nova.compute.manager [req-dad4a201-6a36-4ad2-84c9-d14a013e64da req-e90eabc8-3637-4b23-ad35-ef99d0ebe5eb service nova] [instance: b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c] No waiting events found dispatching network-vif-plugged-70f91af6-4a58-4b9d-a132-93537d398c24 {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:58:50 user nova-compute[71731]: WARNING nova.compute.manager [req-dad4a201-6a36-4ad2-84c9-d14a013e64da req-e90eabc8-3637-4b23-ad35-ef99d0ebe5eb service nova] [instance: b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c] Received unexpected event network-vif-plugged-70f91af6-4a58-4b9d-a132-93537d398c24 for instance with vm_state building and task_state spawning.
Apr 13 16:58:51 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:58:51 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:58:51 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:58:51 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:58:52 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:58:52 user nova-compute[71731]: DEBUG nova.virt.driver [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Emitting event <LifecycleEvent: 1681405132.71446, b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c => Resumed> {{(pid=71731) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 16:58:52 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c] VM Resumed (Lifecycle Event)
Apr 13 16:58:52 user nova-compute[71731]: DEBUG nova.compute.manager [None req-92aff2a1-0565-4b49-8875-ec3d159ce5a5 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] [instance: b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c] Instance event wait completed in 0 seconds for  {{(pid=71731) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 16:58:52 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-92aff2a1-0565-4b49-8875-ec3d159ce5a5 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] [instance: b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c] Guest created on hypervisor {{(pid=71731) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 16:58:52 user nova-compute[71731]: INFO nova.virt.libvirt.driver [-] [instance: b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c] Instance spawned successfully.
Apr 13 16:58:52 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-92aff2a1-0565-4b49-8875-ec3d159ce5a5 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] [instance: b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 16:58:52 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:58:52 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71731) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 16:58:52 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-92aff2a1-0565-4b49-8875-ec3d159ce5a5 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] [instance: b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c] Found default for hw_cdrom_bus of ide {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:58:52 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-92aff2a1-0565-4b49-8875-ec3d159ce5a5 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] [instance: b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c] Found default for hw_disk_bus of virtio {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:58:52 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-92aff2a1-0565-4b49-8875-ec3d159ce5a5 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] [instance: b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c] Found default for hw_input_bus of None {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:58:52 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-92aff2a1-0565-4b49-8875-ec3d159ce5a5 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] [instance: b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c] Found default for hw_pointer_model of None {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:58:52 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-92aff2a1-0565-4b49-8875-ec3d159ce5a5 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] [instance: b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c] Found default for hw_video_model of virtio {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:58:52 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-92aff2a1-0565-4b49-8875-ec3d159ce5a5 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] [instance: b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c] Found default for hw_vif_model of virtio {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 16:58:52 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 16:58:52 user nova-compute[71731]: DEBUG nova.virt.driver [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Emitting event <LifecycleEvent: 1681405132.7184486, b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c => Started> {{(pid=71731) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 16:58:52 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c] VM Started (Lifecycle Event)
Apr 13 16:58:52 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:58:52 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71731) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 16:58:52 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 16:58:52 user nova-compute[71731]: INFO nova.compute.manager [None req-92aff2a1-0565-4b49-8875-ec3d159ce5a5 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] [instance: b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c] Took 5.64 seconds to spawn the instance on the hypervisor.
Apr 13 16:58:52 user nova-compute[71731]: DEBUG nova.compute.manager [None req-92aff2a1-0565-4b49-8875-ec3d159ce5a5 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] [instance: b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 16:58:52 user nova-compute[71731]: INFO nova.compute.manager [None req-92aff2a1-0565-4b49-8875-ec3d159ce5a5 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] [instance: b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c] Took 6.20 seconds to build instance.
Apr 13 16:58:52 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-92aff2a1-0565-4b49-8875-ec3d159ce5a5 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.292s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:58:52 user nova-compute[71731]: DEBUG nova.compute.manager [req-6acb532d-910e-4c2e-b1ae-211c984998fd req-f166570e-5cd6-46eb-87ef-9e1de797ade0 service nova] [instance: b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c] Received event network-vif-plugged-70f91af6-4a58-4b9d-a132-93537d398c24 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:58:52 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-6acb532d-910e-4c2e-b1ae-211c984998fd req-f166570e-5cd6-46eb-87ef-9e1de797ade0 service nova] Acquiring lock "b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:58:52 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-6acb532d-910e-4c2e-b1ae-211c984998fd req-f166570e-5cd6-46eb-87ef-9e1de797ade0 service nova] Lock "b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:58:52 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-6acb532d-910e-4c2e-b1ae-211c984998fd req-f166570e-5cd6-46eb-87ef-9e1de797ade0 service nova] Lock "b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:58:52 user nova-compute[71731]: DEBUG nova.compute.manager [req-6acb532d-910e-4c2e-b1ae-211c984998fd req-f166570e-5cd6-46eb-87ef-9e1de797ade0 service nova] [instance: b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c] No waiting events found dispatching network-vif-plugged-70f91af6-4a58-4b9d-a132-93537d398c24 {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:58:52 user nova-compute[71731]: WARNING nova.compute.manager [req-6acb532d-910e-4c2e-b1ae-211c984998fd req-f166570e-5cd6-46eb-87ef-9e1de797ade0 service nova] [instance: b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c] Received unexpected event network-vif-plugged-70f91af6-4a58-4b9d-a132-93537d398c24 for instance with vm_state active and task_state None.
Apr 13 16:58:54 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:58:56 user nova-compute[71731]: DEBUG nova.compute.manager [req-80b16901-6597-41e9-a4e1-17a623138cd2 req-d3c5f340-c3fc-4fc1-b29c-9f0f6ff38d26 service nova] [instance: e048d6f6-f6aa-4491-ae06-9e22a8ff6691] Received event network-changed-4fb36f71-2601-4c01-9eba-514f5f2af95f {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:58:56 user nova-compute[71731]: DEBUG nova.compute.manager [req-80b16901-6597-41e9-a4e1-17a623138cd2 req-d3c5f340-c3fc-4fc1-b29c-9f0f6ff38d26 service nova] [instance: e048d6f6-f6aa-4491-ae06-9e22a8ff6691] Refreshing instance network info cache due to event network-changed-4fb36f71-2601-4c01-9eba-514f5f2af95f. {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 16:58:56 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-80b16901-6597-41e9-a4e1-17a623138cd2 req-d3c5f340-c3fc-4fc1-b29c-9f0f6ff38d26 service nova] Acquiring lock "refresh_cache-e048d6f6-f6aa-4491-ae06-9e22a8ff6691" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 16:58:56 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-80b16901-6597-41e9-a4e1-17a623138cd2 req-d3c5f340-c3fc-4fc1-b29c-9f0f6ff38d26 service nova] Acquired lock "refresh_cache-e048d6f6-f6aa-4491-ae06-9e22a8ff6691" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 16:58:56 user nova-compute[71731]: DEBUG nova.network.neutron [req-80b16901-6597-41e9-a4e1-17a623138cd2 req-d3c5f340-c3fc-4fc1-b29c-9f0f6ff38d26 service nova] [instance: e048d6f6-f6aa-4491-ae06-9e22a8ff6691] Refreshing network info cache for port 4fb36f71-2601-4c01-9eba-514f5f2af95f {{(pid=71731) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 16:58:56 user nova-compute[71731]: DEBUG nova.network.neutron [req-80b16901-6597-41e9-a4e1-17a623138cd2 req-d3c5f340-c3fc-4fc1-b29c-9f0f6ff38d26 service nova] [instance: e048d6f6-f6aa-4491-ae06-9e22a8ff6691] Updated VIF entry in instance network info cache for port 4fb36f71-2601-4c01-9eba-514f5f2af95f. {{(pid=71731) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 16:58:56 user nova-compute[71731]: DEBUG nova.network.neutron [req-80b16901-6597-41e9-a4e1-17a623138cd2 req-d3c5f340-c3fc-4fc1-b29c-9f0f6ff38d26 service nova] [instance: e048d6f6-f6aa-4491-ae06-9e22a8ff6691] Updating instance_info_cache with network_info: [{"id": "4fb36f71-2601-4c01-9eba-514f5f2af95f", "address": "fa:16:3e:11:9f:98", "network": {"id": "0c6a5f46-e53b-4b4c-806e-b2617ba3ef35", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1984894004-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.143", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7edf468527d84954a943bb4c1f7ff54d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fb36f71-26", "ovs_interfaceid": "4fb36f71-2601-4c01-9eba-514f5f2af95f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:58:56 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-80b16901-6597-41e9-a4e1-17a623138cd2 req-d3c5f340-c3fc-4fc1-b29c-9f0f6ff38d26 service nova] Releasing lock "refresh_cache-e048d6f6-f6aa-4491-ae06-9e22a8ff6691" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 16:58:56 user nova-compute[71731]: DEBUG nova.compute.manager [req-182d68d2-c23b-4b7b-94b0-a4fdce3b3c33 req-d7a1a027-9ace-41b3-a467-fafafd8a7771 service nova] [instance: e048d6f6-f6aa-4491-ae06-9e22a8ff6691] Received event network-changed-4fb36f71-2601-4c01-9eba-514f5f2af95f {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:58:56 user nova-compute[71731]: DEBUG nova.compute.manager [req-182d68d2-c23b-4b7b-94b0-a4fdce3b3c33 req-d7a1a027-9ace-41b3-a467-fafafd8a7771 service nova] [instance: e048d6f6-f6aa-4491-ae06-9e22a8ff6691] Refreshing instance network info cache due to event network-changed-4fb36f71-2601-4c01-9eba-514f5f2af95f. {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 16:58:56 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-182d68d2-c23b-4b7b-94b0-a4fdce3b3c33 req-d7a1a027-9ace-41b3-a467-fafafd8a7771 service nova] Acquiring lock "refresh_cache-e048d6f6-f6aa-4491-ae06-9e22a8ff6691" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 16:58:56 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-182d68d2-c23b-4b7b-94b0-a4fdce3b3c33 req-d7a1a027-9ace-41b3-a467-fafafd8a7771 service nova] Acquired lock "refresh_cache-e048d6f6-f6aa-4491-ae06-9e22a8ff6691" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 16:58:56 user nova-compute[71731]: DEBUG nova.network.neutron [req-182d68d2-c23b-4b7b-94b0-a4fdce3b3c33 req-d7a1a027-9ace-41b3-a467-fafafd8a7771 service nova] [instance: e048d6f6-f6aa-4491-ae06-9e22a8ff6691] Refreshing network info cache for port 4fb36f71-2601-4c01-9eba-514f5f2af95f {{(pid=71731) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 16:58:57 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-d150fc3c-a03c-492a-bb6c-7b73009adf5b tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Acquiring lock "e048d6f6-f6aa-4491-ae06-9e22a8ff6691" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:58:57 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-d150fc3c-a03c-492a-bb6c-7b73009adf5b tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lock "e048d6f6-f6aa-4491-ae06-9e22a8ff6691" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:58:57 user nova-compute[71731]: INFO nova.compute.manager [None req-d150fc3c-a03c-492a-bb6c-7b73009adf5b tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] [instance: e048d6f6-f6aa-4491-ae06-9e22a8ff6691] Detaching volume 52d252b7-6e23-4733-bf50-80e9ff903f75
Apr 13 16:58:57 user nova-compute[71731]: INFO nova.virt.block_device [None req-d150fc3c-a03c-492a-bb6c-7b73009adf5b tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] [instance: e048d6f6-f6aa-4491-ae06-9e22a8ff6691] Attempting to driver detach volume 52d252b7-6e23-4733-bf50-80e9ff903f75 from mountpoint /dev/vdb
Apr 13 16:58:57 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-d150fc3c-a03c-492a-bb6c-7b73009adf5b tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Attempting to detach device vdb from instance e048d6f6-f6aa-4491-ae06-9e22a8ff6691 from the persistent domain config. {{(pid=71731) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 13 16:58:57 user nova-compute[71731]: DEBUG nova.virt.libvirt.guest [None req-d150fc3c-a03c-492a-bb6c-7b73009adf5b tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 16:58:57 user nova-compute[71731]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 16:58:57 user nova-compute[71731]:   <source dev="/dev/sdb"/>
Apr 13 16:58:57 user nova-compute[71731]:   <target dev="vdb" bus="virtio"/>
Apr 13 16:58:57 user nova-compute[71731]:   <serial>52d252b7-6e23-4733-bf50-80e9ff903f75</serial>
Apr 13 16:58:57 user nova-compute[71731]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 13 16:58:57 user nova-compute[71731]: </disk>
Apr 13 16:58:57 user nova-compute[71731]:  {{(pid=71731) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 16:58:57 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-d150fc3c-a03c-492a-bb6c-7b73009adf5b tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Successfully detached device vdb from instance e048d6f6-f6aa-4491-ae06-9e22a8ff6691 from the persistent domain config.
Apr 13 16:58:57 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-d150fc3c-a03c-492a-bb6c-7b73009adf5b tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e048d6f6-f6aa-4491-ae06-9e22a8ff6691 from the live domain config. {{(pid=71731) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 13 16:58:57 user nova-compute[71731]: DEBUG nova.virt.libvirt.guest [None req-d150fc3c-a03c-492a-bb6c-7b73009adf5b tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 16:58:57 user nova-compute[71731]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 16:58:57 user nova-compute[71731]:   <source dev="/dev/sdb"/>
Apr 13 16:58:57 user nova-compute[71731]:   <target dev="vdb" bus="virtio"/>
Apr 13 16:58:57 user nova-compute[71731]:   <serial>52d252b7-6e23-4733-bf50-80e9ff903f75</serial>
Apr 13 16:58:57 user nova-compute[71731]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 13 16:58:57 user nova-compute[71731]: </disk>
Apr 13 16:58:57 user nova-compute[71731]:  {{(pid=71731) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 16:58:57 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:58:57 user nova-compute[71731]: DEBUG nova.network.neutron [req-182d68d2-c23b-4b7b-94b0-a4fdce3b3c33 req-d7a1a027-9ace-41b3-a467-fafafd8a7771 service nova] [instance: e048d6f6-f6aa-4491-ae06-9e22a8ff6691] Updated VIF entry in instance network info cache for port 4fb36f71-2601-4c01-9eba-514f5f2af95f. {{(pid=71731) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 16:58:57 user nova-compute[71731]: DEBUG nova.network.neutron [req-182d68d2-c23b-4b7b-94b0-a4fdce3b3c33 req-d7a1a027-9ace-41b3-a467-fafafd8a7771 service nova] [instance: e048d6f6-f6aa-4491-ae06-9e22a8ff6691] Updating instance_info_cache with network_info: [{"id": "4fb36f71-2601-4c01-9eba-514f5f2af95f", "address": "fa:16:3e:11:9f:98", "network": {"id": "0c6a5f46-e53b-4b4c-806e-b2617ba3ef35", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1984894004-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7edf468527d84954a943bb4c1f7ff54d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fb36f71-26", "ovs_interfaceid": "4fb36f71-2601-4c01-9eba-514f5f2af95f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:58:57 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-182d68d2-c23b-4b7b-94b0-a4fdce3b3c33 req-d7a1a027-9ace-41b3-a467-fafafd8a7771 service nova] Releasing lock "refresh_cache-e048d6f6-f6aa-4491-ae06-9e22a8ff6691" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 16:58:57 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Received event <DeviceRemovedEvent: 1681405137.7003956, e048d6f6-f6aa-4491-ae06-9e22a8ff6691 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71731) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 13 16:58:57 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-d150fc3c-a03c-492a-bb6c-7b73009adf5b tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e048d6f6-f6aa-4491-ae06-9e22a8ff6691 {{(pid=71731) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 13 16:58:57 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-d150fc3c-a03c-492a-bb6c-7b73009adf5b tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Successfully detached device vdb from instance e048d6f6-f6aa-4491-ae06-9e22a8ff6691 from the live domain config.
Apr 13 16:58:57 user nova-compute[71731]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d150fc3c-a03c-492a-bb6c-7b73009adf5b tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] [instance: e048d6f6-f6aa-4491-ae06-9e22a8ff6691] calling os-brick to detach iSCSI Volume {{(pid=71731) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 16:58:57 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-d150fc3c-a03c-492a-bb6c-7b73009adf5b tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8cf0118790>, {'target_iqn': 'iqn.2010-10.org.openstack:52d252b7-6e23-4733-bf50-80e9ff903f75', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KCpXvRDk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 16:58:57 user nova-compute[71731]: WARNING os_brick.initiator.connectors.base [None req-d150fc3c-a03c-492a-bb6c-7b73009adf5b tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 16:58:57 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-d150fc3c-a03c-492a-bb6c-7b73009adf5b tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 16:58:57 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-d150fc3c-a03c-492a-bb6c-7b73009adf5b tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 16:58:57 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:58:57 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:58:57 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f41b8ae-77f2-4914-8417-7323e3c60692]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:52d252b7-6e23-4733-bf50-80e9ff903f75\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:58:57 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-d150fc3c-a03c-492a-bb6c-7b73009adf5b tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 16:58:57 user nova-compute[71731]: No targets found.
Apr 13 16:58:57 user nova-compute[71731]: iSNS:
Apr 13 16:58:57 user nova-compute[71731]: No targets found.
Apr 13 16:58:57 user nova-compute[71731]: STATIC:
Apr 13 16:58:57 user nova-compute[71731]: Target: iqn.2010-10.org.openstack:52d252b7-6e23-4733-bf50-80e9ff903f75
Apr 13 16:58:57 user nova-compute[71731]:         Portal: 172.16.0.220:3260,-1
Apr 13 16:58:57 user nova-compute[71731]:                 Iface Name: default
Apr 13 16:58:57 user nova-compute[71731]: FIRMWARE:
Apr 13 16:58:57 user nova-compute[71731]: No targets found.
Apr 13 16:58:57 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 16:58:57 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-d150fc3c-a03c-492a-bb6c-7b73009adf5b tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 16:58:57 user nova-compute[71731]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 16:58:57 user nova-compute[71731]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71731) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 16:58:57 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-d150fc3c-a03c-492a-bb6c-7b73009adf5b tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:52d252b7-6e23-4733-bf50-80e9ff903f75', 0)] {{(pid=71731) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 16:58:57 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:58:57 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:58:57 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7f93466-bd51-4223-9b0f-1864dd6365fc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:52d252b7-6e23-4733-bf50-80e9ff903f75\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:58:57 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:58:57 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:58:57 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[435e4516-0fff-4f51-b164-576b048c807d]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52d252b7-6e23-4733-bf50-80e9ff903f75 (non-flash)\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:58:57 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-d150fc3c-a03c-492a-bb6c-7b73009adf5b tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52d252b7-6e23-4733-bf50-80e9ff903f75 (non-flash)
Apr 13 16:58:57 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 16:58:57 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-d150fc3c-a03c-492a-bb6c-7b73009adf5b tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52d252b7-6e23-4733-bf50-80e9ff903f75 (non-flash)
Apr 13 16:58:57 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 16:58:57 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-d150fc3c-a03c-492a-bb6c-7b73009adf5b tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8cff4ccee0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:52d252b7-6e23-4733-bf50-80e9ff903f75'): ({'sdb'}, set())}) {{(pid=71731) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 16:58:57 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-d150fc3c-a03c-492a-bb6c-7b73009adf5b tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Removing single pathed devices sdb {{(pid=71731) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 16:58:57 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:58:57 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:58:57 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[153b0566-5040-4bba-af67-45ffb344c8be]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:58:57 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:58:57 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:58:57 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[004a2667-1f1c-42a8-9a69-90742af8b98f]: (4, ('ok\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:58:57 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-d150fc3c-a03c-492a-bb6c-7b73009adf5b tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Flushing IO for device /dev/sdb {{(pid=71731) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 16:58:57 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:58:57 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:58:57 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[a26312ab-95c8-4142-95ef-0ce73949d52c]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:58:57 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-d150fc3c-a03c-492a-bb6c-7b73009adf5b tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71731) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 16:58:57 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:58:57 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.050s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:58:57 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cd5c5cb-947c-4f05-8651-0e0ed4ad1267]: (4, ('1', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:58:57 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-d150fc3c-a03c-492a-bb6c-7b73009adf5b tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71731) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 16:58:57 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-d150fc3c-a03c-492a-bb6c-7b73009adf5b tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] SCSI volumes sdb have been removed. {{(pid=71731) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 16:58:57 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-d150fc3c-a03c-492a-bb6c-7b73009adf5b tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:52d252b7-6e23-4733-bf50-80e9ff903f75')] {{(pid=71731) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 16:58:57 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52d252b7-6e23-4733-bf50-80e9ff903f75 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:58:57 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52d252b7-6e23-4733-bf50-80e9ff903f75 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:58:57 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e238d49-82a2-4903-b6fe-7e6202791057]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:58:57 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-d150fc3c-a03c-492a-bb6c-7b73009adf5b tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:58:57 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52d252b7-6e23-4733-bf50-80e9ff903f75 -p 172.16.0.220:3260 --logout {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:58:57 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52d252b7-6e23-4733-bf50-80e9ff903f75 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:58:57 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb34b425-862d-4517-88ee-6a5c6963e8b7]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:52d252b7-6e23-4733-bf50-80e9ff903f75, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:52d252b7-6e23-4733-bf50-80e9ff903f75, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:58:57 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-d150fc3c-a03c-492a-bb6c-7b73009adf5b tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:52d252b7-6e23-4733-bf50-80e9ff903f75, portal: 172.16.0.220,3260]
Apr 13 16:58:57 user nova-compute[71731]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:52d252b7-6e23-4733-bf50-80e9ff903f75, portal: 172.16.0.220,3260] successful.
Apr 13 16:58:57 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:58:57 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52d252b7-6e23-4733-bf50-80e9ff903f75 -p 172.16.0.220:3260 --op delete {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:58:57 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52d252b7-6e23-4733-bf50-80e9ff903f75 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:58:57 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[e574a9f5-c883-4450-9e94-2afb430c15e2]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 16:58:57 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-d150fc3c-a03c-492a-bb6c-7b73009adf5b tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 16:58:57 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-d150fc3c-a03c-492a-bb6c-7b73009adf5b tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.283s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 16:58:57 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-d150fc3c-a03c-492a-bb6c-7b73009adf5b tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] <== disconnect_volume: return (285ms) None {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 16:58:57 user nova-compute[71731]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d150fc3c-a03c-492a-bb6c-7b73009adf5b tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] [instance: e048d6f6-f6aa-4491-ae06-9e22a8ff6691] Disconnected iSCSI Volume {{(pid=71731) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 16:58:58 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:58:58 user nova-compute[71731]: DEBUG nova.objects.instance [None req-d150fc3c-a03c-492a-bb6c-7b73009adf5b tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lazy-loading 'flavor' on Instance uuid e048d6f6-f6aa-4491-ae06-9e22a8ff6691 {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:58:58 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-d150fc3c-a03c-492a-bb6c-7b73009adf5b tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lock "e048d6f6-f6aa-4491-ae06-9e22a8ff6691" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.664s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:58:59 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:59:04 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 16:59:04 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:59:04 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71731) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 16:59:04 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71731) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 16:59:04 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71731) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 16:59:04 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:59:07 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:59:09 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:59:12 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:59:14 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:59:19 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 16:59:19 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:59:19 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71731) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 16:59:19 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71731) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 16:59:19 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71731) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 16:59:19 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:59:22 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:59:24 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:59:29 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 16:59:29 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:59:29 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71731) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 16:59:29 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71731) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 16:59:29 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71731) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 16:59:29 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:59:34 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 16:59:36 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:59:36 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71731) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 16:59:37 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:59:37 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:59:38 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:59:39 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:59:43 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager.update_available_resource {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:59:43 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:59:43 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:59:43 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:59:43 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Auditing locally available compute resources for user (node: user) {{(pid=71731) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 16:59:43 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e048d6f6-f6aa-4491-ae06-9e22a8ff6691/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:59:43 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e048d6f6-f6aa-4491-ae06-9e22a8ff6691/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:59:43 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e048d6f6-f6aa-4491-ae06-9e22a8ff6691/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:59:43 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e048d6f6-f6aa-4491-ae06-9e22a8ff6691/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:59:43 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:59:43 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:59:43 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 16:59:43 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 16:59:44 user nova-compute[71731]: WARNING nova.virt.libvirt.driver [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 16:59:44 user nova-compute[71731]: WARNING nova.virt.libvirt.driver [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 16:59:44 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Hypervisor/Node resource view: name=user free_ram=8614MB free_disk=26.025096893310547GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71731) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 16:59:44 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:59:44 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:59:44 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance e048d6f6-f6aa-4491-ae06-9e22a8ff6691 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 16:59:44 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 16:59:44 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=71731) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 16:59:44 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Final resource view: name=user phys_ram=16023MB used_ram=768MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=71731) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 16:59:44 user nova-compute[71731]: DEBUG nova.compute.provider_tree [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Inventory has not changed in ProviderTree for provider: cb6b1a64-0c24-4e2d-af1e-16576ca9165c {{(pid=71731) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 16:59:44 user nova-compute[71731]: DEBUG nova.scheduler.client.report [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Inventory has not changed for provider cb6b1a64-0c24-4e2d-af1e-16576ca9165c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71731) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 16:59:44 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 16:59:44 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Compute_service record updated for user:user {{(pid=71731) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 16:59:44 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.216s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:59:46 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:59:46 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:59:46 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Starting heal instance info cache {{(pid=71731) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 16:59:46 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Rebuilding the list of instances to heal {{(pid=71731) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 13 16:59:46 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Acquiring lock "refresh_cache-e048d6f6-f6aa-4491-ae06-9e22a8ff6691" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 16:59:46 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Acquired lock "refresh_cache-e048d6f6-f6aa-4491-ae06-9e22a8ff6691" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 16:59:46 user nova-compute[71731]: DEBUG nova.network.neutron [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] [instance: e048d6f6-f6aa-4491-ae06-9e22a8ff6691] Forcefully refreshing network info cache for instance {{(pid=71731) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 16:59:46 user nova-compute[71731]: DEBUG nova.objects.instance [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lazy-loading 'info_cache' on Instance uuid e048d6f6-f6aa-4491-ae06-9e22a8ff6691 {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:59:46 user nova-compute[71731]: DEBUG nova.network.neutron [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] [instance: e048d6f6-f6aa-4491-ae06-9e22a8ff6691] Updating instance_info_cache with network_info: [{"id": "4fb36f71-2601-4c01-9eba-514f5f2af95f", "address": "fa:16:3e:11:9f:98", "network": {"id": "0c6a5f46-e53b-4b4c-806e-b2617ba3ef35", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1984894004-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7edf468527d84954a943bb4c1f7ff54d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fb36f71-26", "ovs_interfaceid": "4fb36f71-2601-4c01-9eba-514f5f2af95f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:59:46 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Releasing lock "refresh_cache-e048d6f6-f6aa-4491-ae06-9e22a8ff6691" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 16:59:46 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] [instance: e048d6f6-f6aa-4491-ae06-9e22a8ff6691] Updated the network info_cache for instance {{(pid=71731) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 16:59:46 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:59:48 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:59:48 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 16:59:49 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 16:59:49 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:59:49 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71731) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 16:59:49 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71731) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 16:59:49 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71731) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 16:59:49 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:59:49 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-9e7e7d7e-ade4-411b-a7c1-6eb3c65a4bf3 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Acquiring lock "e048d6f6-f6aa-4491-ae06-9e22a8ff6691" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:59:49 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-9e7e7d7e-ade4-411b-a7c1-6eb3c65a4bf3 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lock "e048d6f6-f6aa-4491-ae06-9e22a8ff6691" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:59:49 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-9e7e7d7e-ade4-411b-a7c1-6eb3c65a4bf3 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Acquiring lock "e048d6f6-f6aa-4491-ae06-9e22a8ff6691-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:59:49 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-9e7e7d7e-ade4-411b-a7c1-6eb3c65a4bf3 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lock "e048d6f6-f6aa-4491-ae06-9e22a8ff6691-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:59:49 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-9e7e7d7e-ade4-411b-a7c1-6eb3c65a4bf3 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lock "e048d6f6-f6aa-4491-ae06-9e22a8ff6691-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:59:49 user nova-compute[71731]: INFO nova.compute.manager [None req-9e7e7d7e-ade4-411b-a7c1-6eb3c65a4bf3 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] [instance: e048d6f6-f6aa-4491-ae06-9e22a8ff6691] Terminating instance
Apr 13 16:59:49 user nova-compute[71731]: DEBUG nova.compute.manager [None req-9e7e7d7e-ade4-411b-a7c1-6eb3c65a4bf3 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] [instance: e048d6f6-f6aa-4491-ae06-9e22a8ff6691] Start destroying the instance on the hypervisor. {{(pid=71731) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 16:59:49 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:59:49 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:59:49 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:59:50 user nova-compute[71731]: DEBUG nova.compute.manager [req-d42d0b05-7171-4afb-a6c5-9de1a03c7221 req-a044e13d-f955-4fea-82c0-562dacc99e03 service nova] [instance: e048d6f6-f6aa-4491-ae06-9e22a8ff6691] Received event network-vif-unplugged-4fb36f71-2601-4c01-9eba-514f5f2af95f {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:59:50 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-d42d0b05-7171-4afb-a6c5-9de1a03c7221 req-a044e13d-f955-4fea-82c0-562dacc99e03 service nova] Acquiring lock "e048d6f6-f6aa-4491-ae06-9e22a8ff6691-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:59:50 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-d42d0b05-7171-4afb-a6c5-9de1a03c7221 req-a044e13d-f955-4fea-82c0-562dacc99e03 service nova] Lock "e048d6f6-f6aa-4491-ae06-9e22a8ff6691-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:59:50 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-d42d0b05-7171-4afb-a6c5-9de1a03c7221 req-a044e13d-f955-4fea-82c0-562dacc99e03 service nova] Lock "e048d6f6-f6aa-4491-ae06-9e22a8ff6691-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:59:50 user nova-compute[71731]: DEBUG nova.compute.manager [req-d42d0b05-7171-4afb-a6c5-9de1a03c7221 req-a044e13d-f955-4fea-82c0-562dacc99e03 service nova] [instance: e048d6f6-f6aa-4491-ae06-9e22a8ff6691] No waiting events found dispatching network-vif-unplugged-4fb36f71-2601-4c01-9eba-514f5f2af95f {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:59:50 user nova-compute[71731]: DEBUG nova.compute.manager [req-d42d0b05-7171-4afb-a6c5-9de1a03c7221 req-a044e13d-f955-4fea-82c0-562dacc99e03 service nova] [instance: e048d6f6-f6aa-4491-ae06-9e22a8ff6691] Received event network-vif-unplugged-4fb36f71-2601-4c01-9eba-514f5f2af95f for instance with task_state deleting. {{(pid=71731) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 16:59:50 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:59:50 user nova-compute[71731]: INFO nova.virt.libvirt.driver [-] [instance: e048d6f6-f6aa-4491-ae06-9e22a8ff6691] Instance destroyed successfully.
Apr 13 16:59:50 user nova-compute[71731]: DEBUG nova.objects.instance [None req-9e7e7d7e-ade4-411b-a7c1-6eb3c65a4bf3 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lazy-loading 'resources' on Instance uuid e048d6f6-f6aa-4491-ae06-9e22a8ff6691 {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 16:59:50 user nova-compute[71731]: DEBUG nova.virt.libvirt.vif [None req-9e7e7d7e-ade4-411b-a7c1-6eb3c65a4bf3 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T16:54:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-2141029123',display_name='tempest-TestMinimumBasicScenario-server-2141029123',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-2141029123',id=42,image_ref='e81308c1-1e9d-43bf-bd21-d6a7d7856ff1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCJeR98CrX5Pyefe/rcz7c7swHCPLDeP62HQPhZNTY1lR3svV0j4RlALHIf9UrR6zTy6O2Onfsic7sNVnaIU+KNr9U5sJ8q1nmWzQ0dRWeAumpZeD0Chk2QSpA1BLE1qxA==',key_name='tempest-TestMinimumBasicScenario-810545990',keypairs=<?>,launch_index=0,launched_at=2023-04-13T16:55:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7edf468527d84954a943bb4c1f7ff54d',ramdisk_id='',reservation_id='r-8091fn2v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e81308c1-1e9d-43bf-bd21-d6a7d7856ff1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-419032150',owner_user_name='tempest-TestMinimumBasicScenario-419032150-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T16:57:11Z,user_data=None,user_id='91a450674d7046ae82f5dd182506c85b',uuid=e048d6f6-f6aa-4491-ae06-9e22a8ff6691,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4fb36f71-2601-4c01-9eba-514f5f2af95f", "address": "fa:16:3e:11:9f:98", "network": {"id": "0c6a5f46-e53b-4b4c-806e-b2617ba3ef35", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1984894004-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7edf468527d84954a943bb4c1f7ff54d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fb36f71-26", "ovs_interfaceid": "4fb36f71-2601-4c01-9eba-514f5f2af95f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 16:59:50 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-9e7e7d7e-ade4-411b-a7c1-6eb3c65a4bf3 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Converting VIF {"id": "4fb36f71-2601-4c01-9eba-514f5f2af95f", "address": "fa:16:3e:11:9f:98", "network": {"id": "0c6a5f46-e53b-4b4c-806e-b2617ba3ef35", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1984894004-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7edf468527d84954a943bb4c1f7ff54d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fb36f71-26", "ovs_interfaceid": "4fb36f71-2601-4c01-9eba-514f5f2af95f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 16:59:50 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-9e7e7d7e-ade4-411b-a7c1-6eb3c65a4bf3 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:11:9f:98,bridge_name='br-int',has_traffic_filtering=True,id=4fb36f71-2601-4c01-9eba-514f5f2af95f,network=Network(0c6a5f46-e53b-4b4c-806e-b2617ba3ef35),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4fb36f71-26') {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 16:59:50 user nova-compute[71731]: DEBUG os_vif [None req-9e7e7d7e-ade4-411b-a7c1-6eb3c65a4bf3 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:11:9f:98,bridge_name='br-int',has_traffic_filtering=True,id=4fb36f71-2601-4c01-9eba-514f5f2af95f,network=Network(0c6a5f46-e53b-4b4c-806e-b2617ba3ef35),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4fb36f71-26') {{(pid=71731) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 16:59:50 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:59:50 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4fb36f71-26, bridge=br-int, if_exists=True) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 16:59:50 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 16:59:50 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 16:59:50 user nova-compute[71731]: INFO os_vif [None req-9e7e7d7e-ade4-411b-a7c1-6eb3c65a4bf3 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:11:9f:98,bridge_name='br-int',has_traffic_filtering=True,id=4fb36f71-2601-4c01-9eba-514f5f2af95f,network=Network(0c6a5f46-e53b-4b4c-806e-b2617ba3ef35),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4fb36f71-26')
Apr 13 16:59:50 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-9e7e7d7e-ade4-411b-a7c1-6eb3c65a4bf3 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] [instance: e048d6f6-f6aa-4491-ae06-9e22a8ff6691] Deleting instance files /opt/stack/data/nova/instances/e048d6f6-f6aa-4491-ae06-9e22a8ff6691_del
Apr 13 16:59:50 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-9e7e7d7e-ade4-411b-a7c1-6eb3c65a4bf3 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] [instance: e048d6f6-f6aa-4491-ae06-9e22a8ff6691] Deletion of /opt/stack/data/nova/instances/e048d6f6-f6aa-4491-ae06-9e22a8ff6691_del complete
Apr 13 16:59:50 user nova-compute[71731]: INFO nova.compute.manager [None req-9e7e7d7e-ade4-411b-a7c1-6eb3c65a4bf3 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] [instance: e048d6f6-f6aa-4491-ae06-9e22a8ff6691] Took 0.85 seconds to destroy the instance on the hypervisor.
Apr 13 16:59:50 user nova-compute[71731]: DEBUG oslo.service.loopingcall [None req-9e7e7d7e-ade4-411b-a7c1-6eb3c65a4bf3 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71731) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 16:59:50 user nova-compute[71731]: DEBUG nova.compute.manager [-] [instance: e048d6f6-f6aa-4491-ae06-9e22a8ff6691] Deallocating network for instance {{(pid=71731) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 16:59:50 user nova-compute[71731]: DEBUG nova.network.neutron [-] [instance: e048d6f6-f6aa-4491-ae06-9e22a8ff6691] deallocate_for_instance() {{(pid=71731) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 16:59:51 user nova-compute[71731]: DEBUG nova.network.neutron [-] [instance: e048d6f6-f6aa-4491-ae06-9e22a8ff6691] Updating instance_info_cache with network_info: [] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 16:59:51 user nova-compute[71731]: INFO nova.compute.manager [-] [instance: e048d6f6-f6aa-4491-ae06-9e22a8ff6691] Took 0.50 seconds to deallocate network for instance.
Apr 13 16:59:51 user nova-compute[71731]: DEBUG nova.compute.manager [req-65ef16fd-6dc8-44b8-82c1-063eed800437 req-b3c51858-0450-4d64-8c47-de7586eba2c5 service nova] [instance: e048d6f6-f6aa-4491-ae06-9e22a8ff6691] Received event network-vif-deleted-4fb36f71-2601-4c01-9eba-514f5f2af95f {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:59:51 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-9e7e7d7e-ade4-411b-a7c1-6eb3c65a4bf3 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:59:51 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-9e7e7d7e-ade4-411b-a7c1-6eb3c65a4bf3 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:59:51 user nova-compute[71731]: DEBUG nova.compute.provider_tree [None req-9e7e7d7e-ade4-411b-a7c1-6eb3c65a4bf3 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Inventory has not changed in ProviderTree for provider: cb6b1a64-0c24-4e2d-af1e-16576ca9165c {{(pid=71731) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 16:59:51 user nova-compute[71731]: DEBUG nova.scheduler.client.report [None req-9e7e7d7e-ade4-411b-a7c1-6eb3c65a4bf3 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Inventory has not changed for provider cb6b1a64-0c24-4e2d-af1e-16576ca9165c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71731) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 16:59:51 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-9e7e7d7e-ade4-411b-a7c1-6eb3c65a4bf3 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.145s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:59:51 user nova-compute[71731]: INFO nova.scheduler.client.report [None req-9e7e7d7e-ade4-411b-a7c1-6eb3c65a4bf3 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Deleted allocations for instance e048d6f6-f6aa-4491-ae06-9e22a8ff6691
Apr 13 16:59:51 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-9e7e7d7e-ade4-411b-a7c1-6eb3c65a4bf3 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lock "e048d6f6-f6aa-4491-ae06-9e22a8ff6691" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.682s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:59:52 user nova-compute[71731]: DEBUG nova.compute.manager [req-86aa0ada-3b89-4a5f-8420-a5996c0bc818 req-f8fc670a-8dc4-4e64-9a38-d93ea8a3f4ab service nova] [instance: e048d6f6-f6aa-4491-ae06-9e22a8ff6691] Received event network-vif-plugged-4fb36f71-2601-4c01-9eba-514f5f2af95f {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 16:59:52 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-86aa0ada-3b89-4a5f-8420-a5996c0bc818 req-f8fc670a-8dc4-4e64-9a38-d93ea8a3f4ab service nova] Acquiring lock "e048d6f6-f6aa-4491-ae06-9e22a8ff6691-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 16:59:52 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-86aa0ada-3b89-4a5f-8420-a5996c0bc818 req-f8fc670a-8dc4-4e64-9a38-d93ea8a3f4ab service nova] Lock "e048d6f6-f6aa-4491-ae06-9e22a8ff6691-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 16:59:52 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-86aa0ada-3b89-4a5f-8420-a5996c0bc818 req-f8fc670a-8dc4-4e64-9a38-d93ea8a3f4ab service nova] Lock "e048d6f6-f6aa-4491-ae06-9e22a8ff6691-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 16:59:52 user nova-compute[71731]: DEBUG nova.compute.manager [req-86aa0ada-3b89-4a5f-8420-a5996c0bc818 req-f8fc670a-8dc4-4e64-9a38-d93ea8a3f4ab service nova] [instance: e048d6f6-f6aa-4491-ae06-9e22a8ff6691] No waiting events found dispatching network-vif-plugged-4fb36f71-2601-4c01-9eba-514f5f2af95f {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 16:59:52 user nova-compute[71731]: WARNING nova.compute.manager [req-86aa0ada-3b89-4a5f-8420-a5996c0bc818 req-f8fc670a-8dc4-4e64-9a38-d93ea8a3f4ab service nova] [instance: e048d6f6-f6aa-4491-ae06-9e22a8ff6691] Received unexpected event network-vif-plugged-4fb36f71-2601-4c01-9eba-514f5f2af95f for instance with vm_state deleted and task_state None.
Apr 13 16:59:55 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:00:00 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 17:00:00 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:00:00 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71731) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 17:00:00 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71731) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 17:00:00 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71731) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 17:00:00 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:00:05 user nova-compute[71731]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681405190.4722252, e048d6f6-f6aa-4491-ae06-9e22a8ff6691 => Stopped> {{(pid=71731) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 17:00:05 user nova-compute[71731]: INFO nova.compute.manager [-] [instance: e048d6f6-f6aa-4491-ae06-9e22a8ff6691] VM Stopped (Lifecycle Event)
Apr 13 17:00:05 user nova-compute[71731]: DEBUG nova.compute.manager [None req-8278c478-cb5b-48ff-afef-266368303918 None None] [instance: e048d6f6-f6aa-4491-ae06-9e22a8ff6691] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 17:00:05 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:00:10 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 17:00:12 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:00:15 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:00:20 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 17:00:20 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:00:20 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71731) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 17:00:20 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71731) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 17:00:20 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71731) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 17:00:20 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:00:25 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:00:30 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:00:35 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4996-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 17:00:35 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:00:35 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5005 ms, sending inactivity probe {{(pid=71731) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 17:00:35 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71731) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 17:00:35 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71731) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 17:00:35 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 17:00:37 user nova-compute[71731]: DEBUG nova.compute.manager [req-de4cd14b-e328-40a1-acf8-ea415c838af2 req-07ccdd8e-6eb4-40dd-bc01-1105f7410278 service nova] [instance: b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c] Received event network-changed-70f91af6-4a58-4b9d-a132-93537d398c24 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:00:37 user nova-compute[71731]: DEBUG nova.compute.manager [req-de4cd14b-e328-40a1-acf8-ea415c838af2 req-07ccdd8e-6eb4-40dd-bc01-1105f7410278 service nova] [instance: b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c] Refreshing instance network info cache due to event network-changed-70f91af6-4a58-4b9d-a132-93537d398c24. {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 17:00:37 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-de4cd14b-e328-40a1-acf8-ea415c838af2 req-07ccdd8e-6eb4-40dd-bc01-1105f7410278 service nova] Acquiring lock "refresh_cache-b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 17:00:37 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-de4cd14b-e328-40a1-acf8-ea415c838af2 req-07ccdd8e-6eb4-40dd-bc01-1105f7410278 service nova] Acquired lock "refresh_cache-b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 17:00:37 user nova-compute[71731]: DEBUG nova.network.neutron [req-de4cd14b-e328-40a1-acf8-ea415c838af2 req-07ccdd8e-6eb4-40dd-bc01-1105f7410278 service nova] [instance: b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c] Refreshing network info cache for port 70f91af6-4a58-4b9d-a132-93537d398c24 {{(pid=71731) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 17:00:38 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:00:38 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:00:38 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71731) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 17:00:38 user nova-compute[71731]: DEBUG nova.network.neutron [req-de4cd14b-e328-40a1-acf8-ea415c838af2 req-07ccdd8e-6eb4-40dd-bc01-1105f7410278 service nova] [instance: b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c] Updated VIF entry in instance network info cache for port 70f91af6-4a58-4b9d-a132-93537d398c24. {{(pid=71731) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 17:00:38 user nova-compute[71731]: DEBUG nova.network.neutron [req-de4cd14b-e328-40a1-acf8-ea415c838af2 req-07ccdd8e-6eb4-40dd-bc01-1105f7410278 service nova] [instance: b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c] Updating instance_info_cache with network_info: [{"id": "70f91af6-4a58-4b9d-a132-93537d398c24", "address": "fa:16:3e:fa:86:cf", "network": {"id": "436011a9-c48b-4f33-a576-a245b344dd72", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-116243831-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "097b15faad8249c9bf45623d0c3ab518", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70f91af6-4a", "ovs_interfaceid": "70f91af6-4a58-4b9d-a132-93537d398c24", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 17:00:38 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-de4cd14b-e328-40a1-acf8-ea415c838af2 req-07ccdd8e-6eb4-40dd-bc01-1105f7410278 service nova] Releasing lock "refresh_cache-b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 17:00:39 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:00:39 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-77d40c55-df7d-46ee-ada5-e45bacc50674 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Acquiring lock "b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:00:39 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-77d40c55-df7d-46ee-ada5-e45bacc50674 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:00:39 user nova-compute[71731]: DEBUG nova.objects.instance [None req-77d40c55-df7d-46ee-ada5-e45bacc50674 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lazy-loading 'flavor' on Instance uuid b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 17:00:39 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-77d40c55-df7d-46ee-ada5-e45bacc50674 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:00:39 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-77d40c55-df7d-46ee-ada5-e45bacc50674 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Acquiring lock "b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:00:39 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-77d40c55-df7d-46ee-ada5-e45bacc50674 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:00:39 user nova-compute[71731]: INFO nova.compute.manager [None req-77d40c55-df7d-46ee-ada5-e45bacc50674 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] [instance: b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c] Attaching volume e13dd7bb-01d3-41fb-b768-048792640d52 to /dev/vdb
Apr 13 17:00:39 user nova-compute[71731]: DEBUG os_brick.utils [None req-77d40c55-df7d-46ee-ada5-e45bacc50674 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 17:00:39 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:00:39 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:00:39 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[13c4b3bd-c7cd-41c2-9645-774924bb6c27]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:81501d91421\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:00:39 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:00:39 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:00:39 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8d94067-b4a0-4797-800e-e476a9fe1720]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:00:39 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:00:39 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:00:39 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[03811789-73b8-48db-ad8c-0705d5852090]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:00:39 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[325ecb17-902a-4c36-bdbc-864e7742e4bd]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:00:39 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-77d40c55-df7d-46ee-ada5-e45bacc50674 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Running cmd (subprocess): nvme version {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:00:39 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-77d40c55-df7d-46ee-ada5-e45bacc50674 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] 'nvme version' failed. Not Retrying. {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 17:00:39 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.nvmeof [None req-77d40c55-df7d-46ee-ada5-e45bacc50674 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] nvme not present on system {{(pid=71731) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 17:00:39 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:00:39 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 17:00:39 user nova-compute[71731]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 17:00:39 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[90e3487b-28b1-452a-a341-3d9da9f7c6cb]: (4, '') {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:00:39 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.lightos [None req-77d40c55-df7d-46ee-ada5-e45bacc50674 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71731) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 17:00:39 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.lightos [None req-77d40c55-df7d-46ee-ada5-e45bacc50674 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71731) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 17:00:39 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.lightos [None req-77d40c55-df7d-46ee-ada5-e45bacc50674 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] LIGHTOS: no hostnqn found. {{(pid=71731) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 17:00:39 user nova-compute[71731]: DEBUG os_brick.utils [None req-77d40c55-df7d-46ee-ada5-e45bacc50674 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:81501d91421', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 17:00:39 user nova-compute[71731]: DEBUG nova.virt.block_device [None req-77d40c55-df7d-46ee-ada5-e45bacc50674 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] [instance: b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c] Updating existing volume attachment record: 9b523bc1-9cb6-4cbb-93d2-f5f6506e42fe {{(pid=71731) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 17:00:40 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 17:00:42 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:00:43 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager.update_available_resource {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:00:43 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:00:43 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:00:43 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:00:43 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Auditing locally available compute resources for user (node: user) {{(pid=71731) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 17:00:43 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:00:43 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:00:43 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:00:43 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:00:43 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-18a6fac5-9793-4205-a384-6e1bd8603efa tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Acquiring lock "652e59f0-b9be-4f45-bb79-2340d9564000" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:00:43 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-18a6fac5-9793-4205-a384-6e1bd8603efa tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lock "652e59f0-b9be-4f45-bb79-2340d9564000" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:00:43 user nova-compute[71731]: DEBUG nova.virt.libvirt.volume.iscsi [None req-77d40c55-df7d-46ee-ada5-e45bacc50674 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] [instance: b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c] Calling os-brick to attach iSCSI Volume {{(pid=71731) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 17:00:43 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-77d40c55-df7d-46ee-ada5-e45bacc50674 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8cf0118790>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e13dd7bb-01d3-41fb-b768-048792640d52', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fqcKkVMe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 17:00:43 user nova-compute[71731]: WARNING os_brick.initiator.connectors.base [None req-77d40c55-df7d-46ee-ada5-e45bacc50674 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 17:00:43 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-77d40c55-df7d-46ee-ada5-e45bacc50674 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 17:00:43 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-77d40c55-df7d-46ee-ada5-e45bacc50674 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 17:00:43 user nova-compute[71731]: WARNING os_brick.initiator.connectors.base [None req-77d40c55-df7d-46ee-ada5-e45bacc50674 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 17:00:43 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-77d40c55-df7d-46ee-ada5-e45bacc50674 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e13dd7bb-01d3-41fb-b768-048792640d52" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 17:00:43 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-77d40c55-df7d-46ee-ada5-e45bacc50674 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e13dd7bb-01d3-41fb-b768-048792640d52" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 17:00:43 user nova-compute[71731]: INFO os_brick.initiator.connectors.iscsi [None req-77d40c55-df7d-46ee-ada5-e45bacc50674 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 17:00:43 user nova-compute[71731]: WARNING nova.virt.libvirt.driver [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 17:00:43 user nova-compute[71731]: WARNING nova.virt.libvirt.driver [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 17:00:43 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Hypervisor/Node resource view: name=user free_ram=8700MB free_disk=26.05893325805664GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71731) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 17:00:43 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:00:43 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:00:43 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e13dd7bb-01d3-41fb-b768-048792640d52 -p 172.16.0.220:3260 {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:00:43 user nova-compute[71731]: DEBUG nova.compute.manager [None req-18a6fac5-9793-4205-a384-6e1bd8603efa tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] [instance: 652e59f0-b9be-4f45-bb79-2340d9564000] Starting instance... {{(pid=71731) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 17:00:43 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e13dd7bb-01d3-41fb-b768-048792640d52 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:00:43 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa5c7800-2422-431b-9289-81170e78b449]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:00:43 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-77d40c55-df7d-46ee-ada5-e45bacc50674 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 17:00:43 user nova-compute[71731]:  {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:00:43 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e13dd7bb-01d3-41fb-b768-048792640d52 -p 172.16.0.220:3260 --interface default --op new {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:00:43 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e13dd7bb-01d3-41fb-b768-048792640d52 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:00:43 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c654b77-ea14-42f8-b7ba-06c28ec824d5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e13dd7bb-01d3-41fb-b768-048792640d52] added\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:00:43 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-77d40c55-df7d-46ee-ada5-e45bacc50674 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e13dd7bb-01d3-41fb-b768-048792640d52] added
Apr 13 17:00:43 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:00:43 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e13dd7bb-01d3-41fb-b768-048792640d52 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:00:43 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e13dd7bb-01d3-41fb-b768-048792640d52 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:00:43 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[daf1be4e-6e76-468c-b04a-44f97d4d0180]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:00:43 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-77d40c55-df7d-46ee-ada5-e45bacc50674 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:00:43 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e13dd7bb-01d3-41fb-b768-048792640d52 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:00:43 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-18a6fac5-9793-4205-a384-6e1bd8603efa tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:00:43 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 17:00:43 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e13dd7bb-01d3-41fb-b768-048792640d52 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.029s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:00:43 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f6c1612-617b-41aa-a085-05458afe193d]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:00:43 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-77d40c55-df7d-46ee-ada5-e45bacc50674 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:00:43 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e13dd7bb-01d3-41fb-b768-048792640d52 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fqcKkVMe {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:00:43 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance 652e59f0-b9be-4f45-bb79-2340d9564000 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1689}}
Apr 13 17:00:43 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=71731) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 17:00:43 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=71731) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 17:00:43 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e13dd7bb-01d3-41fb-b768-048792640d52 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fqcKkVMe" returned: 0 in 0.018s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:00:43 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[cec2d653-19f0-4147-8899-2f1613065aee]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:00:43 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-77d40c55-df7d-46ee-ada5-e45bacc50674 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fqcKkVMe'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:00:43 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e13dd7bb-01d3-41fb-b768-048792640d52 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:00:44 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e13dd7bb-01d3-41fb-b768-048792640d52 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:00:44 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[28a326e8-2d4f-4f9a-92ba-c294aa063505]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:00:44 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-77d40c55-df7d-46ee-ada5-e45bacc50674 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:00:44 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:00:44 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:00:44 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[858f03b7-d1f4-48ab-a101-4afd1a6b4288]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:00:44 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-77d40c55-df7d-46ee-ada5-e45bacc50674 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Apr 13 17:00:44 user nova-compute[71731]:  {{(pid=71731) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 17:00:44 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-77d40c55-df7d-46ee-ada5-e45bacc50674 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Apr 13 17:00:44 user nova-compute[71731]:  {{(pid=71731) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 17:00:44 user nova-compute[71731]: WARNING os_brick.initiator.connectors.iscsi [None req-77d40c55-df7d-46ee-ada5-e45bacc50674 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Apr 13 17:00:44 user nova-compute[71731]: 
Apr 13 17:00:44 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e13dd7bb-01d3-41fb-b768-048792640d52 -p 172.16.0.220:3260 --login {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:00:44 user nova-compute[71731]: DEBUG nova.compute.provider_tree [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Inventory has not changed in ProviderTree for provider: cb6b1a64-0c24-4e2d-af1e-16576ca9165c {{(pid=71731) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 17:00:44 user nova-compute[71731]: DEBUG nova.scheduler.client.report [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Inventory has not changed for provider cb6b1a64-0c24-4e2d-af1e-16576ca9165c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71731) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 17:00:44 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e13dd7bb-01d3-41fb-b768-048792640d52 -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:00:44 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca801632-a1da-4ae2-b58f-8dbf2933fc9d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e13dd7bb-01d3-41fb-b768-048792640d52, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e13dd7bb-01d3-41fb-b768-048792640d52, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:00:44 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-77d40c55-df7d-46ee-ada5-e45bacc50674 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e13dd7bb-01d3-41fb-b768-048792640d52, portal: 172.16.0.220,3260]
Apr 13 17:00:44 user nova-compute[71731]: Login to [iface: default, target: iqn.2010-10.org.openstack:e13dd7bb-01d3-41fb-b768-048792640d52, portal: 172.16.0.220,3260] successful.
Apr 13 17:00:44 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:00:44 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e13dd7bb-01d3-41fb-b768-048792640d52 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:00:44 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Compute_service record updated for user:user {{(pid=71731) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 17:00:44 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.263s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:00:44 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-18a6fac5-9793-4205-a384-6e1bd8603efa tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.172s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:00:44 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-18a6fac5-9793-4205-a384-6e1bd8603efa tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71731) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 17:00:44 user nova-compute[71731]: INFO nova.compute.claims [None req-18a6fac5-9793-4205-a384-6e1bd8603efa tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] [instance: 652e59f0-b9be-4f45-bb79-2340d9564000] Claim successful on node user
Apr 13 17:00:44 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e13dd7bb-01d3-41fb-b768-048792640d52 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:00:44 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a0c7256-43dd-48d9-9f15-3dd7f8c2ef8c]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:00:44 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-77d40c55-df7d-46ee-ada5-e45bacc50674 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:00:44 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:00:44 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:00:44 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[78e9b996-198d-41d8-8b68-3dd0748c1152]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e13dd7bb-01d3-41fb-b768-048792640d52 (non-flash)\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:00:44 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-77d40c55-df7d-46ee-ada5-e45bacc50674 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e13dd7bb-01d3-41fb-b768-048792640d52 (non-flash)
Apr 13 17:00:44 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 17:00:44 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-77d40c55-df7d-46ee-ada5-e45bacc50674 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e13dd7bb-01d3-41fb-b768-048792640d52 (non-flash)
Apr 13 17:00:44 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 17:00:44 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-77d40c55-df7d-46ee-ada5-e45bacc50674 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e13dd7bb-01d3-41fb-b768-048792640d52" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.306s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 17:00:44 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-77d40c55-df7d-46ee-ada5-e45bacc50674 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Connected to 172.16.0.220:3260 {{(pid=71731) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 17:00:44 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-77d40c55-df7d-46ee-ada5-e45bacc50674 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] HCTL ('33', '-', '-', 0) found on session 50 with lun 0 {{(pid=71731) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 17:00:44 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-77d40c55-df7d-46ee-ada5-e45bacc50674 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71731) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 17:00:44 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:00:44 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.026s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:00:44 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[850d9eb2-8e64-41e0-afd6-4192090f0670]: (4, ('- - 0', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:00:44 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-77d40c55-df7d-46ee-ada5-e45bacc50674 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Searching for a device in session 50 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71731) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 17:00:44 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-77d40c55-df7d-46ee-ada5-e45bacc50674 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:e13dd7bb-01d3-41fb-b768-048792640d52', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fqcKkVMe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71731) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 17:00:44 user nova-compute[71731]: DEBUG nova.compute.provider_tree [None req-18a6fac5-9793-4205-a384-6e1bd8603efa tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Inventory has not changed in ProviderTree for provider: cb6b1a64-0c24-4e2d-af1e-16576ca9165c {{(pid=71731) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 17:00:44 user nova-compute[71731]: DEBUG nova.scheduler.client.report [None req-18a6fac5-9793-4205-a384-6e1bd8603efa tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Inventory has not changed for provider cb6b1a64-0c24-4e2d-af1e-16576ca9165c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71731) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 17:00:44 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-18a6fac5-9793-4205-a384-6e1bd8603efa tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.223s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:00:44 user nova-compute[71731]: DEBUG nova.compute.manager [None req-18a6fac5-9793-4205-a384-6e1bd8603efa tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] [instance: 652e59f0-b9be-4f45-bb79-2340d9564000] Start building networks asynchronously for instance. {{(pid=71731) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 17:00:44 user nova-compute[71731]: DEBUG nova.compute.manager [None req-18a6fac5-9793-4205-a384-6e1bd8603efa tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] [instance: 652e59f0-b9be-4f45-bb79-2340d9564000] Allocating IP information in the background. {{(pid=71731) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 17:00:44 user nova-compute[71731]: DEBUG nova.network.neutron [None req-18a6fac5-9793-4205-a384-6e1bd8603efa tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] [instance: 652e59f0-b9be-4f45-bb79-2340d9564000] allocate_for_instance() {{(pid=71731) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 17:00:44 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-18a6fac5-9793-4205-a384-6e1bd8603efa tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] [instance: 652e59f0-b9be-4f45-bb79-2340d9564000] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 17:00:44 user nova-compute[71731]: DEBUG nova.compute.manager [None req-18a6fac5-9793-4205-a384-6e1bd8603efa tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] [instance: 652e59f0-b9be-4f45-bb79-2340d9564000] Start building block device mappings for instance. {{(pid=71731) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 17:00:44 user nova-compute[71731]: DEBUG nova.policy [None req-18a6fac5-9793-4205-a384-6e1bd8603efa tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '91a450674d7046ae82f5dd182506c85b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7edf468527d84954a943bb4c1f7ff54d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71731) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 17:00:44 user nova-compute[71731]: DEBUG nova.compute.manager [None req-18a6fac5-9793-4205-a384-6e1bd8603efa tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] [instance: 652e59f0-b9be-4f45-bb79-2340d9564000] Start spawning the instance on the hypervisor. {{(pid=71731) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 17:00:44 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-18a6fac5-9793-4205-a384-6e1bd8603efa tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] [instance: 652e59f0-b9be-4f45-bb79-2340d9564000] Creating instance directory {{(pid=71731) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 17:00:44 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-18a6fac5-9793-4205-a384-6e1bd8603efa tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] [instance: 652e59f0-b9be-4f45-bb79-2340d9564000] Creating image(s)
Apr 13 17:00:44 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-18a6fac5-9793-4205-a384-6e1bd8603efa tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Acquiring lock "/opt/stack/data/nova/instances/652e59f0-b9be-4f45-bb79-2340d9564000/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:00:44 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-18a6fac5-9793-4205-a384-6e1bd8603efa tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lock "/opt/stack/data/nova/instances/652e59f0-b9be-4f45-bb79-2340d9564000/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:00:44 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-18a6fac5-9793-4205-a384-6e1bd8603efa tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lock "/opt/stack/data/nova/instances/652e59f0-b9be-4f45-bb79-2340d9564000/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:00:44 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-18a6fac5-9793-4205-a384-6e1bd8603efa tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Acquiring lock "2dc053aed289db568d3f3d450c48eaff54a8e488" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:00:44 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-18a6fac5-9793-4205-a384-6e1bd8603efa tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lock "2dc053aed289db568d3f3d450c48eaff54a8e488" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:00:44 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-18a6fac5-9793-4205-a384-6e1bd8603efa tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2dc053aed289db568d3f3d450c48eaff54a8e488.part --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:00:45 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-18a6fac5-9793-4205-a384-6e1bd8603efa tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2dc053aed289db568d3f3d450c48eaff54a8e488.part --force-share --output=json" returned: 0 in 0.160s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:00:45 user nova-compute[71731]: DEBUG nova.virt.images [None req-18a6fac5-9793-4205-a384-6e1bd8603efa tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] 40bf0b81-a3f7-4702-b16f-bc02b4ffa120 was qcow2, converting to raw {{(pid=71731) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 13 17:00:45 user nova-compute[71731]: DEBUG nova.privsep.utils [None req-18a6fac5-9793-4205-a384-6e1bd8603efa tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71731) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 13 17:00:45 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-18a6fac5-9793-4205-a384-6e1bd8603efa tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/2dc053aed289db568d3f3d450c48eaff54a8e488.part /opt/stack/data/nova/instances/_base/2dc053aed289db568d3f3d450c48eaff54a8e488.converted {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:00:45 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-77d40c55-df7d-46ee-ada5-e45bacc50674 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.348s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 17:00:45 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-77d40c55-df7d-46ee-ada5-e45bacc50674 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] <== connect_volume: return (1351ms) {'type': 'block', 'scsi_wwn': '23737313934303734', 'path': '/dev/sdb'} {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 17:00:45 user nova-compute[71731]: DEBUG nova.virt.libvirt.volume.iscsi [None req-77d40c55-df7d-46ee-ada5-e45bacc50674 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] [instance: b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23737313934303734', 'path': '/dev/sdb'} {{(pid=71731) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 17:00:45 user nova-compute[71731]: DEBUG nova.objects.instance [None req-77d40c55-df7d-46ee-ada5-e45bacc50674 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lazy-loading 'flavor' on Instance uuid b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 17:00:45 user nova-compute[71731]: DEBUG nova.virt.libvirt.guest [None req-77d40c55-df7d-46ee-ada5-e45bacc50674 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] attach device xml: <disk type="block" device="disk">
Apr 13 17:00:45 user nova-compute[71731]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 17:00:45 user nova-compute[71731]:   <source dev="/dev/sdb"/>
Apr 13 17:00:45 user nova-compute[71731]:   <target dev="vdb" bus="virtio"/>
Apr 13 17:00:45 user nova-compute[71731]:   <serial>e13dd7bb-01d3-41fb-b768-048792640d52</serial>
Apr 13 17:00:45 user nova-compute[71731]: </disk>
Apr 13 17:00:45 user nova-compute[71731]:  {{(pid=71731) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 13 17:00:45 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-18a6fac5-9793-4205-a384-6e1bd8603efa tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/2dc053aed289db568d3f3d450c48eaff54a8e488.part /opt/stack/data/nova/instances/_base/2dc053aed289db568d3f3d450c48eaff54a8e488.converted" returned: 0 in 0.310s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:00:45 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-18a6fac5-9793-4205-a384-6e1bd8603efa tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2dc053aed289db568d3f3d450c48eaff54a8e488.converted --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:00:45 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:00:45 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-18a6fac5-9793-4205-a384-6e1bd8603efa tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2dc053aed289db568d3f3d450c48eaff54a8e488.converted --force-share --output=json" returned: 0 in 0.195s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:00:45 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-18a6fac5-9793-4205-a384-6e1bd8603efa tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lock "2dc053aed289db568d3f3d450c48eaff54a8e488" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.083s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:00:45 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-18a6fac5-9793-4205-a384-6e1bd8603efa tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2dc053aed289db568d3f3d450c48eaff54a8e488 --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:00:45 user nova-compute[71731]: DEBUG nova.network.neutron [None req-18a6fac5-9793-4205-a384-6e1bd8603efa tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] [instance: 652e59f0-b9be-4f45-bb79-2340d9564000] Successfully created port: 6047b3aa-607c-4b10-904a-8497d9a2f82b {{(pid=71731) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 17:00:45 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-77d40c55-df7d-46ee-ada5-e45bacc50674 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] No BDM found with device name vda, not building metadata. {{(pid=71731) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 17:00:45 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-77d40c55-df7d-46ee-ada5-e45bacc50674 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71731) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 17:00:45 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-77d40c55-df7d-46ee-ada5-e45bacc50674 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] No VIF found with MAC fa:16:3e:fa:86:cf, not building metadata {{(pid=71731) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 17:00:45 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-18a6fac5-9793-4205-a384-6e1bd8603efa tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2dc053aed289db568d3f3d450c48eaff54a8e488 --force-share --output=json" returned: 0 in 0.150s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:00:45 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-18a6fac5-9793-4205-a384-6e1bd8603efa tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Acquiring lock "2dc053aed289db568d3f3d450c48eaff54a8e488" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:00:45 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-18a6fac5-9793-4205-a384-6e1bd8603efa tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lock "2dc053aed289db568d3f3d450c48eaff54a8e488" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:00:45 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-18a6fac5-9793-4205-a384-6e1bd8603efa tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2dc053aed289db568d3f3d450c48eaff54a8e488 --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:00:45 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-77d40c55-df7d-46ee-ada5-e45bacc50674 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.541s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:00:45 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-18a6fac5-9793-4205-a384-6e1bd8603efa tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2dc053aed289db568d3f3d450c48eaff54a8e488 --force-share --output=json" returned: 0 in 0.168s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:00:45 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-18a6fac5-9793-4205-a384-6e1bd8603efa tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2dc053aed289db568d3f3d450c48eaff54a8e488,backing_fmt=raw /opt/stack/data/nova/instances/652e59f0-b9be-4f45-bb79-2340d9564000/disk 1073741824 {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:00:46 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-18a6fac5-9793-4205-a384-6e1bd8603efa tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2dc053aed289db568d3f3d450c48eaff54a8e488,backing_fmt=raw /opt/stack/data/nova/instances/652e59f0-b9be-4f45-bb79-2340d9564000/disk 1073741824" returned: 0 in 0.084s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:00:46 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-18a6fac5-9793-4205-a384-6e1bd8603efa tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lock "2dc053aed289db568d3f3d450c48eaff54a8e488" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.258s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:00:46 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-18a6fac5-9793-4205-a384-6e1bd8603efa tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2dc053aed289db568d3f3d450c48eaff54a8e488 --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:00:46 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:00:46 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-18a6fac5-9793-4205-a384-6e1bd8603efa tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2dc053aed289db568d3f3d450c48eaff54a8e488 --force-share --output=json" returned: 0 in 0.137s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:00:46 user nova-compute[71731]: DEBUG nova.virt.disk.api [None req-18a6fac5-9793-4205-a384-6e1bd8603efa tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Checking if we can resize image /opt/stack/data/nova/instances/652e59f0-b9be-4f45-bb79-2340d9564000/disk. size=1073741824 {{(pid=71731) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 17:00:46 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-18a6fac5-9793-4205-a384-6e1bd8603efa tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/652e59f0-b9be-4f45-bb79-2340d9564000/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:00:46 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-18a6fac5-9793-4205-a384-6e1bd8603efa tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/652e59f0-b9be-4f45-bb79-2340d9564000/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:00:46 user nova-compute[71731]: DEBUG nova.virt.disk.api [None req-18a6fac5-9793-4205-a384-6e1bd8603efa tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Cannot resize image /opt/stack/data/nova/instances/652e59f0-b9be-4f45-bb79-2340d9564000/disk to a smaller size. {{(pid=71731) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 17:00:46 user nova-compute[71731]: DEBUG nova.objects.instance [None req-18a6fac5-9793-4205-a384-6e1bd8603efa tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lazy-loading 'migration_context' on Instance uuid 652e59f0-b9be-4f45-bb79-2340d9564000 {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 17:00:46 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-18a6fac5-9793-4205-a384-6e1bd8603efa tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] [instance: 652e59f0-b9be-4f45-bb79-2340d9564000] Created local disks {{(pid=71731) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 17:00:46 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-18a6fac5-9793-4205-a384-6e1bd8603efa tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] [instance: 652e59f0-b9be-4f45-bb79-2340d9564000] Ensure instance console log exists: /opt/stack/data/nova/instances/652e59f0-b9be-4f45-bb79-2340d9564000/console.log {{(pid=71731) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 17:00:46 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-18a6fac5-9793-4205-a384-6e1bd8603efa tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:00:46 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-18a6fac5-9793-4205-a384-6e1bd8603efa tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:00:46 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-18a6fac5-9793-4205-a384-6e1bd8603efa tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:00:46 user nova-compute[71731]: DEBUG nova.network.neutron [None req-18a6fac5-9793-4205-a384-6e1bd8603efa tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] [instance: 652e59f0-b9be-4f45-bb79-2340d9564000] Successfully updated port: 6047b3aa-607c-4b10-904a-8497d9a2f82b {{(pid=71731) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 17:00:46 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-18a6fac5-9793-4205-a384-6e1bd8603efa tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Acquiring lock "refresh_cache-652e59f0-b9be-4f45-bb79-2340d9564000" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 17:00:46 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-18a6fac5-9793-4205-a384-6e1bd8603efa tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Acquired lock "refresh_cache-652e59f0-b9be-4f45-bb79-2340d9564000" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 17:00:46 user nova-compute[71731]: DEBUG nova.network.neutron [None req-18a6fac5-9793-4205-a384-6e1bd8603efa tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] [instance: 652e59f0-b9be-4f45-bb79-2340d9564000] Building network info cache for instance {{(pid=71731) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 17:00:46 user nova-compute[71731]: DEBUG nova.compute.manager [req-11b4e632-73b6-4825-b44a-a6bb1f14be54 req-d19f1d04-5fd0-4ba8-abbb-ab9bf0355569 service nova] [instance: 652e59f0-b9be-4f45-bb79-2340d9564000] Received event network-changed-6047b3aa-607c-4b10-904a-8497d9a2f82b {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:00:46 user nova-compute[71731]: DEBUG nova.compute.manager [req-11b4e632-73b6-4825-b44a-a6bb1f14be54 req-d19f1d04-5fd0-4ba8-abbb-ab9bf0355569 service nova] [instance: 652e59f0-b9be-4f45-bb79-2340d9564000] Refreshing instance network info cache due to event network-changed-6047b3aa-607c-4b10-904a-8497d9a2f82b. {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 17:00:46 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-11b4e632-73b6-4825-b44a-a6bb1f14be54 req-d19f1d04-5fd0-4ba8-abbb-ab9bf0355569 service nova] Acquiring lock "refresh_cache-652e59f0-b9be-4f45-bb79-2340d9564000" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 17:00:46 user nova-compute[71731]: DEBUG nova.network.neutron [None req-18a6fac5-9793-4205-a384-6e1bd8603efa tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] [instance: 652e59f0-b9be-4f45-bb79-2340d9564000] Instance cache missing network info. {{(pid=71731) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 17:00:46 user nova-compute[71731]: DEBUG nova.network.neutron [None req-18a6fac5-9793-4205-a384-6e1bd8603efa tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] [instance: 652e59f0-b9be-4f45-bb79-2340d9564000] Updating instance_info_cache with network_info: [{"id": "6047b3aa-607c-4b10-904a-8497d9a2f82b", "address": "fa:16:3e:0e:ca:10", "network": {"id": "0c6a5f46-e53b-4b4c-806e-b2617ba3ef35", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1984894004-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7edf468527d84954a943bb4c1f7ff54d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6047b3aa-60", "ovs_interfaceid": "6047b3aa-607c-4b10-904a-8497d9a2f82b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 17:00:46 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-18a6fac5-9793-4205-a384-6e1bd8603efa tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Releasing lock "refresh_cache-652e59f0-b9be-4f45-bb79-2340d9564000" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 17:00:46 user nova-compute[71731]: DEBUG nova.compute.manager [None req-18a6fac5-9793-4205-a384-6e1bd8603efa tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] [instance: 652e59f0-b9be-4f45-bb79-2340d9564000] Instance network_info: |[{"id": "6047b3aa-607c-4b10-904a-8497d9a2f82b", "address": "fa:16:3e:0e:ca:10", "network": {"id": "0c6a5f46-e53b-4b4c-806e-b2617ba3ef35", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1984894004-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7edf468527d84954a943bb4c1f7ff54d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6047b3aa-60", "ovs_interfaceid": "6047b3aa-607c-4b10-904a-8497d9a2f82b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71731) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 17:00:46 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-11b4e632-73b6-4825-b44a-a6bb1f14be54 req-d19f1d04-5fd0-4ba8-abbb-ab9bf0355569 service nova] Acquired lock "refresh_cache-652e59f0-b9be-4f45-bb79-2340d9564000" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 17:00:46 user nova-compute[71731]: DEBUG nova.network.neutron [req-11b4e632-73b6-4825-b44a-a6bb1f14be54 req-d19f1d04-5fd0-4ba8-abbb-ab9bf0355569 service nova] [instance: 652e59f0-b9be-4f45-bb79-2340d9564000] Refreshing network info cache for port 6047b3aa-607c-4b10-904a-8497d9a2f82b {{(pid=71731) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 17:00:46 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-18a6fac5-9793-4205-a384-6e1bd8603efa tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] [instance: 652e59f0-b9be-4f45-bb79-2340d9564000] Start _get_guest_xml network_info=[{"id": "6047b3aa-607c-4b10-904a-8497d9a2f82b", "address": "fa:16:3e:0e:ca:10", "network": {"id": "0c6a5f46-e53b-4b4c-806e-b2617ba3ef35", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1984894004-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7edf468527d84954a943bb4c1f7ff54d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6047b3aa-60", "ovs_interfaceid": "6047b3aa-607c-4b10-904a-8497d9a2f82b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T17:00:41Z,direct_url=<?>,disk_format='qcow2',id=40bf0b81-a3f7-4702-b16f-bc02b4ffa120,min_disk=0,min_ram=0,name='tempest-scenario-img--48070526',owner='7edf468527d84954a943bb4c1f7ff54d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T17:00:42Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'device_type': 'disk', 'encrypted': False, 'disk_bus': 'virtio', 'guest_format': None, 'encryption_options': None, 'image_id': '40bf0b81-a3f7-4702-b16f-bc02b4ffa120'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71731) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 17:00:46 user nova-compute[71731]: WARNING nova.virt.libvirt.driver [None req-18a6fac5-9793-4205-a384-6e1bd8603efa tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 17:00:46 user nova-compute[71731]: WARNING nova.virt.libvirt.driver [None req-18a6fac5-9793-4205-a384-6e1bd8603efa tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 17:00:46 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-18a6fac5-9793-4205-a384-6e1bd8603efa tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71731) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 17:00:46 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-18a6fac5-9793-4205-a384-6e1bd8603efa tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T16:17:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T17:00:41Z,direct_url=<?>,disk_format='qcow2',id=40bf0b81-a3f7-4702-b16f-bc02b4ffa120,min_disk=0,min_ram=0,name='tempest-scenario-img--48070526',owner='7edf468527d84954a943bb4c1f7ff54d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T17:00:42Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 17:00:46 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-18a6fac5-9793-4205-a384-6e1bd8603efa tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Flavor limits 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 17:00:46 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-18a6fac5-9793-4205-a384-6e1bd8603efa tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Image limits 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 17:00:46 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-18a6fac5-9793-4205-a384-6e1bd8603efa tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Flavor pref 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 17:00:46 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-18a6fac5-9793-4205-a384-6e1bd8603efa tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Image pref 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 17:00:46 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-18a6fac5-9793-4205-a384-6e1bd8603efa tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 17:00:46 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-18a6fac5-9793-4205-a384-6e1bd8603efa tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 17:00:46 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-18a6fac5-9793-4205-a384-6e1bd8603efa tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71731) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 17:00:46 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-18a6fac5-9793-4205-a384-6e1bd8603efa tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Got 1 possible topologies {{(pid=71731) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 17:00:46 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-18a6fac5-9793-4205-a384-6e1bd8603efa tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 17:00:46 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-18a6fac5-9793-4205-a384-6e1bd8603efa tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 17:00:46 user nova-compute[71731]: DEBUG nova.virt.libvirt.vif [None req-18a6fac5-9793-4205-a384-6e1bd8603efa tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T17:00:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1210397582',display_name='tempest-TestMinimumBasicScenario-server-1210397582',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1210397582',id=44,image_ref='40bf0b81-a3f7-4702-b16f-bc02b4ffa120',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLTT5rrYLPrICtrmRV6uZ+f3Amb/NKgabEiTvK/SQIBpINNqaHEfiYg1i3f6zZiVzFJ2qudJHtaG2Ihj81v7dqZamVZwx3H3EBr/5cGqhXpc8pjW8XQjSOCjYuKj4Jtgow==',key_name='tempest-TestMinimumBasicScenario-646311077',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7edf468527d84954a943bb4c1f7ff54d',ramdisk_id='',reservation_id='r-4wvpzhqr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='40bf0b81-a3f7-4702-b16f-bc02b4ffa120',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-419032150',owner_user_name='tempest-TestMinimumBasicScenario-419032150-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T17:00:44Z,user_data=None,user_id='91a450674d7046ae82f5dd182506c85b',uuid=652e59f0-b9be-4f45-bb79-2340d9564000,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6047b3aa-607c-4b10-904a-8497d9a2f82b", "address": "fa:16:3e:0e:ca:10", "network": {"id": "0c6a5f46-e53b-4b4c-806e-b2617ba3ef35", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1984894004-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7edf468527d84954a943bb4c1f7ff54d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6047b3aa-60", "ovs_interfaceid": "6047b3aa-607c-4b10-904a-8497d9a2f82b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71731) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 17:00:46 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-18a6fac5-9793-4205-a384-6e1bd8603efa tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Converting VIF {"id": "6047b3aa-607c-4b10-904a-8497d9a2f82b", "address": "fa:16:3e:0e:ca:10", "network": {"id": "0c6a5f46-e53b-4b4c-806e-b2617ba3ef35", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1984894004-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7edf468527d84954a943bb4c1f7ff54d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6047b3aa-60", "ovs_interfaceid": "6047b3aa-607c-4b10-904a-8497d9a2f82b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 17:00:46 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-18a6fac5-9793-4205-a384-6e1bd8603efa tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0e:ca:10,bridge_name='br-int',has_traffic_filtering=True,id=6047b3aa-607c-4b10-904a-8497d9a2f82b,network=Network(0c6a5f46-e53b-4b4c-806e-b2617ba3ef35),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6047b3aa-60') {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 17:00:46 user nova-compute[71731]: DEBUG nova.objects.instance [None req-18a6fac5-9793-4205-a384-6e1bd8603efa tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lazy-loading 'pci_devices' on Instance uuid 652e59f0-b9be-4f45-bb79-2340d9564000 {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 17:00:46 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-18a6fac5-9793-4205-a384-6e1bd8603efa tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] [instance: 652e59f0-b9be-4f45-bb79-2340d9564000] End _get_guest_xml xml=<domain type="kvm">
Apr 13 17:00:46 user nova-compute[71731]:   <uuid>652e59f0-b9be-4f45-bb79-2340d9564000</uuid>
Apr 13 17:00:46 user nova-compute[71731]:   <name>instance-0000002c</name>
Apr 13 17:00:46 user nova-compute[71731]:   <memory>131072</memory>
Apr 13 17:00:46 user nova-compute[71731]:   <vcpu>1</vcpu>
Apr 13 17:00:46 user nova-compute[71731]:   <metadata>
Apr 13 17:00:46 user nova-compute[71731]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 17:00:46 user nova-compute[71731]:       <nova:package version="0.0.0"/>
Apr 13 17:00:46 user nova-compute[71731]:       <nova:name>tempest-TestMinimumBasicScenario-server-1210397582</nova:name>
Apr 13 17:00:46 user nova-compute[71731]:       <nova:creationTime>2023-04-13 17:00:46</nova:creationTime>
Apr 13 17:00:46 user nova-compute[71731]:       <nova:flavor name="m1.nano">
Apr 13 17:00:46 user nova-compute[71731]:         <nova:memory>128</nova:memory>
Apr 13 17:00:46 user nova-compute[71731]:         <nova:disk>1</nova:disk>
Apr 13 17:00:46 user nova-compute[71731]:         <nova:swap>0</nova:swap>
Apr 13 17:00:46 user nova-compute[71731]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 17:00:46 user nova-compute[71731]:         <nova:vcpus>1</nova:vcpus>
Apr 13 17:00:46 user nova-compute[71731]:       </nova:flavor>
Apr 13 17:00:46 user nova-compute[71731]:       <nova:owner>
Apr 13 17:00:46 user nova-compute[71731]:         <nova:user uuid="91a450674d7046ae82f5dd182506c85b">tempest-TestMinimumBasicScenario-419032150-project-member</nova:user>
Apr 13 17:00:46 user nova-compute[71731]:         <nova:project uuid="7edf468527d84954a943bb4c1f7ff54d">tempest-TestMinimumBasicScenario-419032150</nova:project>
Apr 13 17:00:46 user nova-compute[71731]:       </nova:owner>
Apr 13 17:00:46 user nova-compute[71731]:       <nova:root type="image" uuid="40bf0b81-a3f7-4702-b16f-bc02b4ffa120"/>
Apr 13 17:00:46 user nova-compute[71731]:       <nova:ports>
Apr 13 17:00:46 user nova-compute[71731]:         <nova:port uuid="6047b3aa-607c-4b10-904a-8497d9a2f82b">
Apr 13 17:00:46 user nova-compute[71731]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Apr 13 17:00:46 user nova-compute[71731]:         </nova:port>
Apr 13 17:00:46 user nova-compute[71731]:       </nova:ports>
Apr 13 17:00:46 user nova-compute[71731]:     </nova:instance>
Apr 13 17:00:46 user nova-compute[71731]:   </metadata>
Apr 13 17:00:46 user nova-compute[71731]:   <sysinfo type="smbios">
Apr 13 17:00:46 user nova-compute[71731]:     <system>
Apr 13 17:00:46 user nova-compute[71731]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 17:00:46 user nova-compute[71731]:       <entry name="product">OpenStack Nova</entry>
Apr 13 17:00:46 user nova-compute[71731]:       <entry name="version">0.0.0</entry>
Apr 13 17:00:46 user nova-compute[71731]:       <entry name="serial">652e59f0-b9be-4f45-bb79-2340d9564000</entry>
Apr 13 17:00:46 user nova-compute[71731]:       <entry name="uuid">652e59f0-b9be-4f45-bb79-2340d9564000</entry>
Apr 13 17:00:46 user nova-compute[71731]:       <entry name="family">Virtual Machine</entry>
Apr 13 17:00:46 user nova-compute[71731]:     </system>
Apr 13 17:00:46 user nova-compute[71731]:   </sysinfo>
Apr 13 17:00:46 user nova-compute[71731]:   <os>
Apr 13 17:00:46 user nova-compute[71731]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 17:00:46 user nova-compute[71731]:     <boot dev="hd"/>
Apr 13 17:00:46 user nova-compute[71731]:     <smbios mode="sysinfo"/>
Apr 13 17:00:46 user nova-compute[71731]:   </os>
Apr 13 17:00:46 user nova-compute[71731]:   <features>
Apr 13 17:00:46 user nova-compute[71731]:     <acpi/>
Apr 13 17:00:46 user nova-compute[71731]:     <apic/>
Apr 13 17:00:46 user nova-compute[71731]:     <vmcoreinfo/>
Apr 13 17:00:46 user nova-compute[71731]:   </features>
Apr 13 17:00:46 user nova-compute[71731]:   <clock offset="utc">
Apr 13 17:00:46 user nova-compute[71731]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 17:00:46 user nova-compute[71731]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 17:00:46 user nova-compute[71731]:     <timer name="hpet" present="no"/>
Apr 13 17:00:46 user nova-compute[71731]:   </clock>
Apr 13 17:00:46 user nova-compute[71731]:   <cpu mode="custom" match="exact">
Apr 13 17:00:46 user nova-compute[71731]:     <model>Nehalem</model>
Apr 13 17:00:46 user nova-compute[71731]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 17:00:46 user nova-compute[71731]:   </cpu>
Apr 13 17:00:46 user nova-compute[71731]:   <devices>
Apr 13 17:00:46 user nova-compute[71731]:     <disk type="file" device="disk">
Apr 13 17:00:46 user nova-compute[71731]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 17:00:46 user nova-compute[71731]:       <source file="/opt/stack/data/nova/instances/652e59f0-b9be-4f45-bb79-2340d9564000/disk"/>
Apr 13 17:00:46 user nova-compute[71731]:       <target dev="vda" bus="virtio"/>
Apr 13 17:00:46 user nova-compute[71731]:     </disk>
Apr 13 17:00:46 user nova-compute[71731]:     <interface type="ethernet">
Apr 13 17:00:46 user nova-compute[71731]:       <mac address="fa:16:3e:0e:ca:10"/>
Apr 13 17:00:46 user nova-compute[71731]:       <model type="virtio"/>
Apr 13 17:00:46 user nova-compute[71731]:       <mtu size="1442"/>
Apr 13 17:00:46 user nova-compute[71731]:       <target dev="tap6047b3aa-60"/>
Apr 13 17:00:46 user nova-compute[71731]:     </interface>
Apr 13 17:00:46 user nova-compute[71731]:     <serial type="pty">
Apr 13 17:00:46 user nova-compute[71731]:       <log file="/opt/stack/data/nova/instances/652e59f0-b9be-4f45-bb79-2340d9564000/console.log" append="off"/>
Apr 13 17:00:46 user nova-compute[71731]:     </serial>
Apr 13 17:00:46 user nova-compute[71731]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 17:00:46 user nova-compute[71731]:     <video>
Apr 13 17:00:46 user nova-compute[71731]:       <model type="virtio"/>
Apr 13 17:00:46 user nova-compute[71731]:     </video>
Apr 13 17:00:46 user nova-compute[71731]:     <rng model="virtio">
Apr 13 17:00:46 user nova-compute[71731]:       <backend model="random">/dev/urandom</backend>
Apr 13 17:00:46 user nova-compute[71731]:     </rng>
Apr 13 17:00:46 user nova-compute[71731]:     <controller type="usb" index="0" model="none"/>
Apr 13 17:00:46 user nova-compute[71731]:     <memballoon model="virtio">
Apr 13 17:00:46 user nova-compute[71731]:       <stats period="10"/>
Apr 13 17:00:46 user nova-compute[71731]:     </memballoon>
Apr 13 17:00:46 user nova-compute[71731]:   </devices>
Apr 13 17:00:46 user nova-compute[71731]: </domain>
Apr 13 17:00:46 user nova-compute[71731]:  {{(pid=71731) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 17:00:46 user nova-compute[71731]: DEBUG nova.virt.libvirt.vif [None req-18a6fac5-9793-4205-a384-6e1bd8603efa tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T17:00:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1210397582',display_name='tempest-TestMinimumBasicScenario-server-1210397582',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1210397582',id=44,image_ref='40bf0b81-a3f7-4702-b16f-bc02b4ffa120',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLTT5rrYLPrICtrmRV6uZ+f3Amb/NKgabEiTvK/SQIBpINNqaHEfiYg1i3f6zZiVzFJ2qudJHtaG2Ihj81v7dqZamVZwx3H3EBr/5cGqhXpc8pjW8XQjSOCjYuKj4Jtgow==',key_name='tempest-TestMinimumBasicScenario-646311077',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7edf468527d84954a943bb4c1f7ff54d',ramdisk_id='',reservation_id='r-4wvpzhqr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='40bf0b81-a3f7-4702-b16f-bc02b4ffa120',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-419032150',owner_user_name='tempest-TestMinimumBasicScenario-419032150-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T17:00:44Z,user_data=None,user_id='91a450674d7046ae82f5dd182506c85b',uuid=652e59f0-b9be-4f45-bb79-2340d9564000,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6047b3aa-607c-4b10-904a-8497d9a2f82b", "address": "fa:16:3e:0e:ca:10", "network": {"id": "0c6a5f46-e53b-4b4c-806e-b2617ba3ef35", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1984894004-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7edf468527d84954a943bb4c1f7ff54d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6047b3aa-60", "ovs_interfaceid": "6047b3aa-607c-4b10-904a-8497d9a2f82b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 17:00:46 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-18a6fac5-9793-4205-a384-6e1bd8603efa tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Converting VIF {"id": "6047b3aa-607c-4b10-904a-8497d9a2f82b", "address": "fa:16:3e:0e:ca:10", "network": {"id": "0c6a5f46-e53b-4b4c-806e-b2617ba3ef35", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1984894004-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7edf468527d84954a943bb4c1f7ff54d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6047b3aa-60", "ovs_interfaceid": "6047b3aa-607c-4b10-904a-8497d9a2f82b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 17:00:46 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-18a6fac5-9793-4205-a384-6e1bd8603efa tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0e:ca:10,bridge_name='br-int',has_traffic_filtering=True,id=6047b3aa-607c-4b10-904a-8497d9a2f82b,network=Network(0c6a5f46-e53b-4b4c-806e-b2617ba3ef35),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6047b3aa-60') {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 17:00:46 user nova-compute[71731]: DEBUG os_vif [None req-18a6fac5-9793-4205-a384-6e1bd8603efa tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:ca:10,bridge_name='br-int',has_traffic_filtering=True,id=6047b3aa-607c-4b10-904a-8497d9a2f82b,network=Network(0c6a5f46-e53b-4b4c-806e-b2617ba3ef35),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6047b3aa-60') {{(pid=71731) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 17:00:46 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:00:46 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 17:00:46 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 17:00:46 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:00:46 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6047b3aa-60, may_exist=True) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 17:00:46 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6047b3aa-60, col_values=(('external_ids', {'iface-id': '6047b3aa-607c-4b10-904a-8497d9a2f82b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0e:ca:10', 'vm-uuid': '652e59f0-b9be-4f45-bb79-2340d9564000'}),)) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 17:00:46 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:00:46 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 17:00:46 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:00:46 user nova-compute[71731]: INFO os_vif [None req-18a6fac5-9793-4205-a384-6e1bd8603efa tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:ca:10,bridge_name='br-int',has_traffic_filtering=True,id=6047b3aa-607c-4b10-904a-8497d9a2f82b,network=Network(0c6a5f46-e53b-4b4c-806e-b2617ba3ef35),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6047b3aa-60')
Apr 13 17:00:47 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:00:47 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Starting heal instance info cache {{(pid=71731) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 17:00:47 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-18a6fac5-9793-4205-a384-6e1bd8603efa tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] No BDM found with device name vda, not building metadata. {{(pid=71731) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 17:00:47 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-18a6fac5-9793-4205-a384-6e1bd8603efa tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] No VIF found with MAC fa:16:3e:0e:ca:10, not building metadata {{(pid=71731) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 17:00:47 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Acquiring lock "refresh_cache-b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 17:00:47 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Acquired lock "refresh_cache-b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 17:00:47 user nova-compute[71731]: DEBUG nova.network.neutron [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] [instance: b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c] Forcefully refreshing network info cache for instance {{(pid=71731) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 17:00:47 user nova-compute[71731]: DEBUG nova.network.neutron [req-11b4e632-73b6-4825-b44a-a6bb1f14be54 req-d19f1d04-5fd0-4ba8-abbb-ab9bf0355569 service nova] [instance: 652e59f0-b9be-4f45-bb79-2340d9564000] Updated VIF entry in instance network info cache for port 6047b3aa-607c-4b10-904a-8497d9a2f82b. {{(pid=71731) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 17:00:47 user nova-compute[71731]: DEBUG nova.network.neutron [req-11b4e632-73b6-4825-b44a-a6bb1f14be54 req-d19f1d04-5fd0-4ba8-abbb-ab9bf0355569 service nova] [instance: 652e59f0-b9be-4f45-bb79-2340d9564000] Updating instance_info_cache with network_info: [{"id": "6047b3aa-607c-4b10-904a-8497d9a2f82b", "address": "fa:16:3e:0e:ca:10", "network": {"id": "0c6a5f46-e53b-4b4c-806e-b2617ba3ef35", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1984894004-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7edf468527d84954a943bb4c1f7ff54d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6047b3aa-60", "ovs_interfaceid": "6047b3aa-607c-4b10-904a-8497d9a2f82b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 17:00:47 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-11b4e632-73b6-4825-b44a-a6bb1f14be54 req-d19f1d04-5fd0-4ba8-abbb-ab9bf0355569 service nova] Releasing lock "refresh_cache-652e59f0-b9be-4f45-bb79-2340d9564000" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 17:00:47 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:00:47 user nova-compute[71731]: DEBUG nova.network.neutron [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] [instance: b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c] Updating instance_info_cache with network_info: [{"id": "70f91af6-4a58-4b9d-a132-93537d398c24", "address": "fa:16:3e:fa:86:cf", "network": {"id": "436011a9-c48b-4f33-a576-a245b344dd72", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-116243831-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "097b15faad8249c9bf45623d0c3ab518", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70f91af6-4a", "ovs_interfaceid": "70f91af6-4a58-4b9d-a132-93537d398c24", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 17:00:47 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Releasing lock "refresh_cache-b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 17:00:47 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] [instance: b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c] Updated the network info_cache for instance {{(pid=71731) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 17:00:47 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:00:48 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:00:48 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:00:48 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:00:48 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:00:48 user nova-compute[71731]: DEBUG nova.compute.manager [req-a7ea5b37-6e88-49fc-a5ba-5dd8ace48424 req-34e1c722-8cf6-4bd2-bf6a-5caf3d06bb68 service nova] [instance: 652e59f0-b9be-4f45-bb79-2340d9564000] Received event network-vif-plugged-6047b3aa-607c-4b10-904a-8497d9a2f82b {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:00:48 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-a7ea5b37-6e88-49fc-a5ba-5dd8ace48424 req-34e1c722-8cf6-4bd2-bf6a-5caf3d06bb68 service nova] Acquiring lock "652e59f0-b9be-4f45-bb79-2340d9564000-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:00:48 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-a7ea5b37-6e88-49fc-a5ba-5dd8ace48424 req-34e1c722-8cf6-4bd2-bf6a-5caf3d06bb68 service nova] Lock "652e59f0-b9be-4f45-bb79-2340d9564000-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:00:48 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-a7ea5b37-6e88-49fc-a5ba-5dd8ace48424 req-34e1c722-8cf6-4bd2-bf6a-5caf3d06bb68 service nova] Lock "652e59f0-b9be-4f45-bb79-2340d9564000-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:00:48 user nova-compute[71731]: DEBUG nova.compute.manager [req-a7ea5b37-6e88-49fc-a5ba-5dd8ace48424 req-34e1c722-8cf6-4bd2-bf6a-5caf3d06bb68 service nova] [instance: 652e59f0-b9be-4f45-bb79-2340d9564000] No waiting events found dispatching network-vif-plugged-6047b3aa-607c-4b10-904a-8497d9a2f82b {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 17:00:48 user nova-compute[71731]: WARNING nova.compute.manager [req-a7ea5b37-6e88-49fc-a5ba-5dd8ace48424 req-34e1c722-8cf6-4bd2-bf6a-5caf3d06bb68 service nova] [instance: 652e59f0-b9be-4f45-bb79-2340d9564000] Received unexpected event network-vif-plugged-6047b3aa-607c-4b10-904a-8497d9a2f82b for instance with vm_state building and task_state spawning.
Apr 13 17:00:48 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:00:48 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:00:48 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:00:49 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:00:49 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:00:49 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-cb45f9d8-7da0-43f5-bb88-559eeafe64e7 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Acquiring lock "e101522a-965b-43da-9408-07e341a9103a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:00:49 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-cb45f9d8-7da0-43f5-bb88-559eeafe64e7 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "e101522a-965b-43da-9408-07e341a9103a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:00:49 user nova-compute[71731]: DEBUG nova.compute.manager [None req-cb45f9d8-7da0-43f5-bb88-559eeafe64e7 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] [instance: e101522a-965b-43da-9408-07e341a9103a] Starting instance... {{(pid=71731) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 17:00:49 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-cb45f9d8-7da0-43f5-bb88-559eeafe64e7 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:00:49 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-cb45f9d8-7da0-43f5-bb88-559eeafe64e7 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:00:49 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-cb45f9d8-7da0-43f5-bb88-559eeafe64e7 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71731) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 17:00:49 user nova-compute[71731]: INFO nova.compute.claims [None req-cb45f9d8-7da0-43f5-bb88-559eeafe64e7 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] [instance: e101522a-965b-43da-9408-07e341a9103a] Claim successful on node user
Apr 13 17:00:49 user nova-compute[71731]: DEBUG nova.compute.provider_tree [None req-cb45f9d8-7da0-43f5-bb88-559eeafe64e7 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Inventory has not changed in ProviderTree for provider: cb6b1a64-0c24-4e2d-af1e-16576ca9165c {{(pid=71731) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 17:00:49 user nova-compute[71731]: DEBUG nova.scheduler.client.report [None req-cb45f9d8-7da0-43f5-bb88-559eeafe64e7 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Inventory has not changed for provider cb6b1a64-0c24-4e2d-af1e-16576ca9165c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71731) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 17:00:49 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-cb45f9d8-7da0-43f5-bb88-559eeafe64e7 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.223s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:00:49 user nova-compute[71731]: DEBUG nova.compute.manager [None req-cb45f9d8-7da0-43f5-bb88-559eeafe64e7 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] [instance: e101522a-965b-43da-9408-07e341a9103a] Start building networks asynchronously for instance. {{(pid=71731) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 17:00:49 user nova-compute[71731]: DEBUG nova.compute.manager [None req-cb45f9d8-7da0-43f5-bb88-559eeafe64e7 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] [instance: e101522a-965b-43da-9408-07e341a9103a] Allocating IP information in the background. {{(pid=71731) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 17:00:49 user nova-compute[71731]: DEBUG nova.network.neutron [None req-cb45f9d8-7da0-43f5-bb88-559eeafe64e7 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] [instance: e101522a-965b-43da-9408-07e341a9103a] allocate_for_instance() {{(pid=71731) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 17:00:50 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-cb45f9d8-7da0-43f5-bb88-559eeafe64e7 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] [instance: e101522a-965b-43da-9408-07e341a9103a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 17:00:50 user nova-compute[71731]: DEBUG nova.compute.manager [None req-cb45f9d8-7da0-43f5-bb88-559eeafe64e7 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] [instance: e101522a-965b-43da-9408-07e341a9103a] Start building block device mappings for instance. {{(pid=71731) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 17:00:50 user nova-compute[71731]: DEBUG nova.policy [None req-cb45f9d8-7da0-43f5-bb88-559eeafe64e7 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a08b0caad23045c1822cdd0b3ae0769f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097b15faad8249c9bf45623d0c3ab518', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71731) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 17:00:50 user nova-compute[71731]: DEBUG nova.compute.manager [None req-cb45f9d8-7da0-43f5-bb88-559eeafe64e7 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] [instance: e101522a-965b-43da-9408-07e341a9103a] Start spawning the instance on the hypervisor. {{(pid=71731) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 17:00:50 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-cb45f9d8-7da0-43f5-bb88-559eeafe64e7 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] [instance: e101522a-965b-43da-9408-07e341a9103a] Creating instance directory {{(pid=71731) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 17:00:50 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-cb45f9d8-7da0-43f5-bb88-559eeafe64e7 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] [instance: e101522a-965b-43da-9408-07e341a9103a] Creating image(s)
Apr 13 17:00:50 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-cb45f9d8-7da0-43f5-bb88-559eeafe64e7 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Acquiring lock "/opt/stack/data/nova/instances/e101522a-965b-43da-9408-07e341a9103a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:00:50 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-cb45f9d8-7da0-43f5-bb88-559eeafe64e7 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "/opt/stack/data/nova/instances/e101522a-965b-43da-9408-07e341a9103a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:00:50 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-cb45f9d8-7da0-43f5-bb88-559eeafe64e7 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "/opt/stack/data/nova/instances/e101522a-965b-43da-9408-07e341a9103a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:00:50 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-cb45f9d8-7da0-43f5-bb88-559eeafe64e7 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279 --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:00:50 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-cb45f9d8-7da0-43f5-bb88-559eeafe64e7 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279 --force-share --output=json" returned: 0 in 0.143s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:00:50 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-cb45f9d8-7da0-43f5-bb88-559eeafe64e7 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Acquiring lock "9524227dd898575c3099d3976f096cd935414279" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:00:50 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-cb45f9d8-7da0-43f5-bb88-559eeafe64e7 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "9524227dd898575c3099d3976f096cd935414279" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:00:50 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-cb45f9d8-7da0-43f5-bb88-559eeafe64e7 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279 --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:00:50 user nova-compute[71731]: DEBUG nova.compute.manager [None req-18a6fac5-9793-4205-a384-6e1bd8603efa tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] [instance: 652e59f0-b9be-4f45-bb79-2340d9564000] Instance event wait completed in 0 seconds for  {{(pid=71731) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 17:00:50 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-18a6fac5-9793-4205-a384-6e1bd8603efa tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] [instance: 652e59f0-b9be-4f45-bb79-2340d9564000] Guest created on hypervisor {{(pid=71731) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 17:00:50 user nova-compute[71731]: DEBUG nova.virt.driver [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Emitting event <LifecycleEvent: 1681405250.4092503, 652e59f0-b9be-4f45-bb79-2340d9564000 => Resumed> {{(pid=71731) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 17:00:50 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 652e59f0-b9be-4f45-bb79-2340d9564000] VM Resumed (Lifecycle Event)
Apr 13 17:00:50 user nova-compute[71731]: INFO nova.virt.libvirt.driver [-] [instance: 652e59f0-b9be-4f45-bb79-2340d9564000] Instance spawned successfully.
Apr 13 17:00:50 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-18a6fac5-9793-4205-a384-6e1bd8603efa tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] [instance: 652e59f0-b9be-4f45-bb79-2340d9564000] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 17:00:50 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 652e59f0-b9be-4f45-bb79-2340d9564000] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 17:00:50 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-cb45f9d8-7da0-43f5-bb88-559eeafe64e7 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279 --force-share --output=json" returned: 0 in 0.140s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:00:50 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-cb45f9d8-7da0-43f5-bb88-559eeafe64e7 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279,backing_fmt=raw /opt/stack/data/nova/instances/e101522a-965b-43da-9408-07e341a9103a/disk 1073741824 {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:00:50 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 652e59f0-b9be-4f45-bb79-2340d9564000] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71731) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 17:00:50 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-18a6fac5-9793-4205-a384-6e1bd8603efa tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] [instance: 652e59f0-b9be-4f45-bb79-2340d9564000] Found default for hw_cdrom_bus of ide {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 17:00:50 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-18a6fac5-9793-4205-a384-6e1bd8603efa tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] [instance: 652e59f0-b9be-4f45-bb79-2340d9564000] Found default for hw_disk_bus of virtio {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 17:00:50 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-18a6fac5-9793-4205-a384-6e1bd8603efa tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] [instance: 652e59f0-b9be-4f45-bb79-2340d9564000] Found default for hw_input_bus of None {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 17:00:50 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-18a6fac5-9793-4205-a384-6e1bd8603efa tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] [instance: 652e59f0-b9be-4f45-bb79-2340d9564000] Found default for hw_pointer_model of None {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 17:00:50 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-18a6fac5-9793-4205-a384-6e1bd8603efa tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] [instance: 652e59f0-b9be-4f45-bb79-2340d9564000] Found default for hw_video_model of virtio {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 17:00:50 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-18a6fac5-9793-4205-a384-6e1bd8603efa tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] [instance: 652e59f0-b9be-4f45-bb79-2340d9564000] Found default for hw_vif_model of virtio {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 17:00:50 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-cb45f9d8-7da0-43f5-bb88-559eeafe64e7 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279,backing_fmt=raw /opt/stack/data/nova/instances/e101522a-965b-43da-9408-07e341a9103a/disk 1073741824" returned: 0 in 0.070s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:00:50 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-cb45f9d8-7da0-43f5-bb88-559eeafe64e7 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "9524227dd898575c3099d3976f096cd935414279" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.217s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:00:50 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-cb45f9d8-7da0-43f5-bb88-559eeafe64e7 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279 --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:00:50 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 652e59f0-b9be-4f45-bb79-2340d9564000] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 17:00:50 user nova-compute[71731]: DEBUG nova.virt.driver [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Emitting event <LifecycleEvent: 1681405250.4095635, 652e59f0-b9be-4f45-bb79-2340d9564000 => Started> {{(pid=71731) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 17:00:50 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 652e59f0-b9be-4f45-bb79-2340d9564000] VM Started (Lifecycle Event)
Apr 13 17:00:50 user nova-compute[71731]: INFO nova.compute.manager [None req-18a6fac5-9793-4205-a384-6e1bd8603efa tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] [instance: 652e59f0-b9be-4f45-bb79-2340d9564000] Took 6.04 seconds to spawn the instance on the hypervisor.
Apr 13 17:00:50 user nova-compute[71731]: DEBUG nova.compute.manager [None req-18a6fac5-9793-4205-a384-6e1bd8603efa tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] [instance: 652e59f0-b9be-4f45-bb79-2340d9564000] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 17:00:50 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 652e59f0-b9be-4f45-bb79-2340d9564000] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 17:00:50 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 652e59f0-b9be-4f45-bb79-2340d9564000] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71731) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 17:00:50 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 652e59f0-b9be-4f45-bb79-2340d9564000] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 17:00:50 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-cb45f9d8-7da0-43f5-bb88-559eeafe64e7 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279 --force-share --output=json" returned: 0 in 0.150s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:00:50 user nova-compute[71731]: DEBUG nova.virt.disk.api [None req-cb45f9d8-7da0-43f5-bb88-559eeafe64e7 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e101522a-965b-43da-9408-07e341a9103a/disk. size=1073741824 {{(pid=71731) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 17:00:50 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-cb45f9d8-7da0-43f5-bb88-559eeafe64e7 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e101522a-965b-43da-9408-07e341a9103a/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:00:50 user nova-compute[71731]: INFO nova.compute.manager [None req-18a6fac5-9793-4205-a384-6e1bd8603efa tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] [instance: 652e59f0-b9be-4f45-bb79-2340d9564000] Took 6.82 seconds to build instance.
Apr 13 17:00:50 user nova-compute[71731]: DEBUG nova.compute.manager [req-1455404c-1611-4756-b67f-0a6928406608 req-1d8e48eb-5cf4-4887-ad6c-5dc6498c27bb service nova] [instance: 652e59f0-b9be-4f45-bb79-2340d9564000] Received event network-vif-plugged-6047b3aa-607c-4b10-904a-8497d9a2f82b {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:00:50 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-1455404c-1611-4756-b67f-0a6928406608 req-1d8e48eb-5cf4-4887-ad6c-5dc6498c27bb service nova] Acquiring lock "652e59f0-b9be-4f45-bb79-2340d9564000-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:00:50 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-1455404c-1611-4756-b67f-0a6928406608 req-1d8e48eb-5cf4-4887-ad6c-5dc6498c27bb service nova] Lock "652e59f0-b9be-4f45-bb79-2340d9564000-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:00:50 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-1455404c-1611-4756-b67f-0a6928406608 req-1d8e48eb-5cf4-4887-ad6c-5dc6498c27bb service nova] Lock "652e59f0-b9be-4f45-bb79-2340d9564000-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:00:50 user nova-compute[71731]: DEBUG nova.compute.manager [req-1455404c-1611-4756-b67f-0a6928406608 req-1d8e48eb-5cf4-4887-ad6c-5dc6498c27bb service nova] [instance: 652e59f0-b9be-4f45-bb79-2340d9564000] No waiting events found dispatching network-vif-plugged-6047b3aa-607c-4b10-904a-8497d9a2f82b {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 17:00:50 user nova-compute[71731]: WARNING nova.compute.manager [req-1455404c-1611-4756-b67f-0a6928406608 req-1d8e48eb-5cf4-4887-ad6c-5dc6498c27bb service nova] [instance: 652e59f0-b9be-4f45-bb79-2340d9564000] Received unexpected event network-vif-plugged-6047b3aa-607c-4b10-904a-8497d9a2f82b for instance with vm_state active and task_state None.
Apr 13 17:00:50 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-18a6fac5-9793-4205-a384-6e1bd8603efa tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lock "652e59f0-b9be-4f45-bb79-2340d9564000" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.926s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:00:50 user nova-compute[71731]: DEBUG nova.network.neutron [None req-cb45f9d8-7da0-43f5-bb88-559eeafe64e7 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] [instance: e101522a-965b-43da-9408-07e341a9103a] Successfully created port: 8356a603-9c08-4a58-8735-2d4b58654a18 {{(pid=71731) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 17:00:50 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-cb45f9d8-7da0-43f5-bb88-559eeafe64e7 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e101522a-965b-43da-9408-07e341a9103a/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:00:50 user nova-compute[71731]: DEBUG nova.virt.disk.api [None req-cb45f9d8-7da0-43f5-bb88-559eeafe64e7 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Cannot resize image /opt/stack/data/nova/instances/e101522a-965b-43da-9408-07e341a9103a/disk to a smaller size. {{(pid=71731) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 17:00:50 user nova-compute[71731]: DEBUG nova.objects.instance [None req-cb45f9d8-7da0-43f5-bb88-559eeafe64e7 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lazy-loading 'migration_context' on Instance uuid e101522a-965b-43da-9408-07e341a9103a {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 17:00:50 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-cb45f9d8-7da0-43f5-bb88-559eeafe64e7 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] [instance: e101522a-965b-43da-9408-07e341a9103a] Created local disks {{(pid=71731) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 17:00:50 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-cb45f9d8-7da0-43f5-bb88-559eeafe64e7 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] [instance: e101522a-965b-43da-9408-07e341a9103a] Ensure instance console log exists: /opt/stack/data/nova/instances/e101522a-965b-43da-9408-07e341a9103a/console.log {{(pid=71731) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 17:00:50 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-cb45f9d8-7da0-43f5-bb88-559eeafe64e7 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:00:50 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-cb45f9d8-7da0-43f5-bb88-559eeafe64e7 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:00:50 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-cb45f9d8-7da0-43f5-bb88-559eeafe64e7 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:00:51 user nova-compute[71731]: DEBUG nova.network.neutron [None req-cb45f9d8-7da0-43f5-bb88-559eeafe64e7 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] [instance: e101522a-965b-43da-9408-07e341a9103a] Successfully updated port: 8356a603-9c08-4a58-8735-2d4b58654a18 {{(pid=71731) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 17:00:51 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-cb45f9d8-7da0-43f5-bb88-559eeafe64e7 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Acquiring lock "refresh_cache-e101522a-965b-43da-9408-07e341a9103a" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 17:00:51 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-cb45f9d8-7da0-43f5-bb88-559eeafe64e7 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Acquired lock "refresh_cache-e101522a-965b-43da-9408-07e341a9103a" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 17:00:51 user nova-compute[71731]: DEBUG nova.network.neutron [None req-cb45f9d8-7da0-43f5-bb88-559eeafe64e7 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] [instance: e101522a-965b-43da-9408-07e341a9103a] Building network info cache for instance {{(pid=71731) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 17:00:51 user nova-compute[71731]: DEBUG nova.compute.manager [req-a554ec72-cc12-47c4-8de2-8d47fd2d0b69 req-7b3b7edd-94bd-46da-892f-f810e28daa0f service nova] [instance: e101522a-965b-43da-9408-07e341a9103a] Received event network-changed-8356a603-9c08-4a58-8735-2d4b58654a18 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:00:51 user nova-compute[71731]: DEBUG nova.compute.manager [req-a554ec72-cc12-47c4-8de2-8d47fd2d0b69 req-7b3b7edd-94bd-46da-892f-f810e28daa0f service nova] [instance: e101522a-965b-43da-9408-07e341a9103a] Refreshing instance network info cache due to event network-changed-8356a603-9c08-4a58-8735-2d4b58654a18. {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 17:00:51 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-a554ec72-cc12-47c4-8de2-8d47fd2d0b69 req-7b3b7edd-94bd-46da-892f-f810e28daa0f service nova] Acquiring lock "refresh_cache-e101522a-965b-43da-9408-07e341a9103a" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 17:00:51 user nova-compute[71731]: DEBUG nova.network.neutron [None req-cb45f9d8-7da0-43f5-bb88-559eeafe64e7 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] [instance: e101522a-965b-43da-9408-07e341a9103a] Instance cache missing network info. {{(pid=71731) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 17:00:51 user nova-compute[71731]: DEBUG nova.network.neutron [None req-cb45f9d8-7da0-43f5-bb88-559eeafe64e7 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] [instance: e101522a-965b-43da-9408-07e341a9103a] Updating instance_info_cache with network_info: [{"id": "8356a603-9c08-4a58-8735-2d4b58654a18", "address": "fa:16:3e:17:73:8d", "network": {"id": "436011a9-c48b-4f33-a576-a245b344dd72", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-116243831-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "097b15faad8249c9bf45623d0c3ab518", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8356a603-9c", "ovs_interfaceid": "8356a603-9c08-4a58-8735-2d4b58654a18", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 17:00:51 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-cb45f9d8-7da0-43f5-bb88-559eeafe64e7 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Releasing lock "refresh_cache-e101522a-965b-43da-9408-07e341a9103a" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 17:00:51 user nova-compute[71731]: DEBUG nova.compute.manager [None req-cb45f9d8-7da0-43f5-bb88-559eeafe64e7 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] [instance: e101522a-965b-43da-9408-07e341a9103a] Instance network_info: |[{"id": "8356a603-9c08-4a58-8735-2d4b58654a18", "address": "fa:16:3e:17:73:8d", "network": {"id": "436011a9-c48b-4f33-a576-a245b344dd72", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-116243831-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "097b15faad8249c9bf45623d0c3ab518", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8356a603-9c", "ovs_interfaceid": "8356a603-9c08-4a58-8735-2d4b58654a18", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71731) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 17:00:51 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-a554ec72-cc12-47c4-8de2-8d47fd2d0b69 req-7b3b7edd-94bd-46da-892f-f810e28daa0f service nova] Acquired lock "refresh_cache-e101522a-965b-43da-9408-07e341a9103a" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 17:00:51 user nova-compute[71731]: DEBUG nova.network.neutron [req-a554ec72-cc12-47c4-8de2-8d47fd2d0b69 req-7b3b7edd-94bd-46da-892f-f810e28daa0f service nova] [instance: e101522a-965b-43da-9408-07e341a9103a] Refreshing network info cache for port 8356a603-9c08-4a58-8735-2d4b58654a18 {{(pid=71731) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 17:00:51 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-cb45f9d8-7da0-43f5-bb88-559eeafe64e7 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] [instance: e101522a-965b-43da-9408-07e341a9103a] Start _get_guest_xml network_info=[{"id": "8356a603-9c08-4a58-8735-2d4b58654a18", "address": "fa:16:3e:17:73:8d", "network": {"id": "436011a9-c48b-4f33-a576-a245b344dd72", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-116243831-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "097b15faad8249c9bf45623d0c3ab518", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8356a603-9c", "ovs_interfaceid": "8356a603-9c08-4a58-8735-2d4b58654a18", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T16:16:31Z,direct_url=<?>,disk_format='qcow2',id=708622a9-7465-4492-ade8-b827198f7e30,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='0b29a975c552465aba0ac7d6288434bd',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T16:16:33Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'device_type': 'disk', 'encrypted': False, 'disk_bus': 'virtio', 'guest_format': None, 'encryption_options': None, 'image_id': '708622a9-7465-4492-ade8-b827198f7e30'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71731) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 17:00:51 user nova-compute[71731]: WARNING nova.virt.libvirt.driver [None req-cb45f9d8-7da0-43f5-bb88-559eeafe64e7 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 17:00:51 user nova-compute[71731]: WARNING nova.virt.libvirt.driver [None req-cb45f9d8-7da0-43f5-bb88-559eeafe64e7 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 17:00:51 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-cb45f9d8-7da0-43f5-bb88-559eeafe64e7 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71731) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 17:00:51 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-cb45f9d8-7da0-43f5-bb88-559eeafe64e7 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T16:17:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T16:16:31Z,direct_url=<?>,disk_format='qcow2',id=708622a9-7465-4492-ade8-b827198f7e30,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='0b29a975c552465aba0ac7d6288434bd',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T16:16:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 17:00:51 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-cb45f9d8-7da0-43f5-bb88-559eeafe64e7 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Flavor limits 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 17:00:51 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-cb45f9d8-7da0-43f5-bb88-559eeafe64e7 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Image limits 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 17:00:51 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-cb45f9d8-7da0-43f5-bb88-559eeafe64e7 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Flavor pref 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 17:00:51 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-cb45f9d8-7da0-43f5-bb88-559eeafe64e7 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Image pref 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 17:00:51 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-cb45f9d8-7da0-43f5-bb88-559eeafe64e7 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 17:00:51 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-cb45f9d8-7da0-43f5-bb88-559eeafe64e7 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 17:00:51 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-cb45f9d8-7da0-43f5-bb88-559eeafe64e7 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71731) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 17:00:51 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-cb45f9d8-7da0-43f5-bb88-559eeafe64e7 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Got 1 possible topologies {{(pid=71731) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 17:00:51 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-cb45f9d8-7da0-43f5-bb88-559eeafe64e7 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 17:00:51 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-cb45f9d8-7da0-43f5-bb88-559eeafe64e7 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 17:00:51 user nova-compute[71731]: DEBUG nova.virt.libvirt.vif [None req-cb45f9d8-7da0-43f5-bb88-559eeafe64e7 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T17:00:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-2144426413',display_name='tempest-AttachVolumeNegativeTest-server-2144426413',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-2144426413',id=45,image_ref='708622a9-7465-4492-ade8-b827198f7e30',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK/PPAxTx4h8wKULYE+NmhML0XVzgcuD2CI5i2nijjbKEY4lk93mBS7lo+7L0CmeBrgi6HQncBfHbPaPbq9kFxHeS9dKrt+RaVlLcssm1Y2vqIwfwXE++AutJHrwid+LSg==',key_name='tempest-keypair-1663561865',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='097b15faad8249c9bf45623d0c3ab518',ramdisk_id='',reservation_id='r-qadqihrl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='708622a9-7465-4492-ade8-b827198f7e30',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-236067262',owner_user_name='tempest-AttachVolumeNegativeTest-236067262-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T17:00:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a08b0caad23045c1822cdd0b3ae0769f',uuid=e101522a-965b-43da-9408-07e341a9103a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8356a603-9c08-4a58-8735-2d4b58654a18", "address": "fa:16:3e:17:73:8d", "network": {"id": "436011a9-c48b-4f33-a576-a245b344dd72", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-116243831-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "097b15faad8249c9bf45623d0c3ab518", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8356a603-9c", "ovs_interfaceid": "8356a603-9c08-4a58-8735-2d4b58654a18", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71731) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 17:00:51 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-cb45f9d8-7da0-43f5-bb88-559eeafe64e7 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Converting VIF {"id": "8356a603-9c08-4a58-8735-2d4b58654a18", "address": "fa:16:3e:17:73:8d", "network": {"id": "436011a9-c48b-4f33-a576-a245b344dd72", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-116243831-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "097b15faad8249c9bf45623d0c3ab518", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8356a603-9c", "ovs_interfaceid": "8356a603-9c08-4a58-8735-2d4b58654a18", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 17:00:51 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-cb45f9d8-7da0-43f5-bb88-559eeafe64e7 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:17:73:8d,bridge_name='br-int',has_traffic_filtering=True,id=8356a603-9c08-4a58-8735-2d4b58654a18,network=Network(436011a9-c48b-4f33-a576-a245b344dd72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8356a603-9c') {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 17:00:51 user nova-compute[71731]: DEBUG nova.objects.instance [None req-cb45f9d8-7da0-43f5-bb88-559eeafe64e7 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lazy-loading 'pci_devices' on Instance uuid e101522a-965b-43da-9408-07e341a9103a {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 17:00:51 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-cb45f9d8-7da0-43f5-bb88-559eeafe64e7 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] [instance: e101522a-965b-43da-9408-07e341a9103a] End _get_guest_xml xml=<domain type="kvm">
Apr 13 17:00:51 user nova-compute[71731]:   <uuid>e101522a-965b-43da-9408-07e341a9103a</uuid>
Apr 13 17:00:51 user nova-compute[71731]:   <name>instance-0000002d</name>
Apr 13 17:00:51 user nova-compute[71731]:   <memory>131072</memory>
Apr 13 17:00:51 user nova-compute[71731]:   <vcpu>1</vcpu>
Apr 13 17:00:51 user nova-compute[71731]:   <metadata>
Apr 13 17:00:51 user nova-compute[71731]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 17:00:51 user nova-compute[71731]:       <nova:package version="0.0.0"/>
Apr 13 17:00:51 user nova-compute[71731]:       <nova:name>tempest-AttachVolumeNegativeTest-server-2144426413</nova:name>
Apr 13 17:00:51 user nova-compute[71731]:       <nova:creationTime>2023-04-13 17:00:51</nova:creationTime>
Apr 13 17:00:51 user nova-compute[71731]:       <nova:flavor name="m1.nano">
Apr 13 17:00:51 user nova-compute[71731]:         <nova:memory>128</nova:memory>
Apr 13 17:00:51 user nova-compute[71731]:         <nova:disk>1</nova:disk>
Apr 13 17:00:51 user nova-compute[71731]:         <nova:swap>0</nova:swap>
Apr 13 17:00:51 user nova-compute[71731]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 17:00:51 user nova-compute[71731]:         <nova:vcpus>1</nova:vcpus>
Apr 13 17:00:51 user nova-compute[71731]:       </nova:flavor>
Apr 13 17:00:51 user nova-compute[71731]:       <nova:owner>
Apr 13 17:00:51 user nova-compute[71731]:         <nova:user uuid="a08b0caad23045c1822cdd0b3ae0769f">tempest-AttachVolumeNegativeTest-236067262-project-member</nova:user>
Apr 13 17:00:51 user nova-compute[71731]:         <nova:project uuid="097b15faad8249c9bf45623d0c3ab518">tempest-AttachVolumeNegativeTest-236067262</nova:project>
Apr 13 17:00:51 user nova-compute[71731]:       </nova:owner>
Apr 13 17:00:51 user nova-compute[71731]:       <nova:root type="image" uuid="708622a9-7465-4492-ade8-b827198f7e30"/>
Apr 13 17:00:51 user nova-compute[71731]:       <nova:ports>
Apr 13 17:00:51 user nova-compute[71731]:         <nova:port uuid="8356a603-9c08-4a58-8735-2d4b58654a18">
Apr 13 17:00:51 user nova-compute[71731]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Apr 13 17:00:51 user nova-compute[71731]:         </nova:port>
Apr 13 17:00:51 user nova-compute[71731]:       </nova:ports>
Apr 13 17:00:51 user nova-compute[71731]:     </nova:instance>
Apr 13 17:00:51 user nova-compute[71731]:   </metadata>
Apr 13 17:00:51 user nova-compute[71731]:   <sysinfo type="smbios">
Apr 13 17:00:51 user nova-compute[71731]:     <system>
Apr 13 17:00:51 user nova-compute[71731]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 17:00:51 user nova-compute[71731]:       <entry name="product">OpenStack Nova</entry>
Apr 13 17:00:51 user nova-compute[71731]:       <entry name="version">0.0.0</entry>
Apr 13 17:00:51 user nova-compute[71731]:       <entry name="serial">e101522a-965b-43da-9408-07e341a9103a</entry>
Apr 13 17:00:51 user nova-compute[71731]:       <entry name="uuid">e101522a-965b-43da-9408-07e341a9103a</entry>
Apr 13 17:00:51 user nova-compute[71731]:       <entry name="family">Virtual Machine</entry>
Apr 13 17:00:51 user nova-compute[71731]:     </system>
Apr 13 17:00:51 user nova-compute[71731]:   </sysinfo>
Apr 13 17:00:51 user nova-compute[71731]:   <os>
Apr 13 17:00:51 user nova-compute[71731]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 17:00:51 user nova-compute[71731]:     <boot dev="hd"/>
Apr 13 17:00:51 user nova-compute[71731]:     <smbios mode="sysinfo"/>
Apr 13 17:00:51 user nova-compute[71731]:   </os>
Apr 13 17:00:51 user nova-compute[71731]:   <features>
Apr 13 17:00:51 user nova-compute[71731]:     <acpi/>
Apr 13 17:00:51 user nova-compute[71731]:     <apic/>
Apr 13 17:00:51 user nova-compute[71731]:     <vmcoreinfo/>
Apr 13 17:00:51 user nova-compute[71731]:   </features>
Apr 13 17:00:51 user nova-compute[71731]:   <clock offset="utc">
Apr 13 17:00:51 user nova-compute[71731]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 17:00:51 user nova-compute[71731]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 17:00:51 user nova-compute[71731]:     <timer name="hpet" present="no"/>
Apr 13 17:00:51 user nova-compute[71731]:   </clock>
Apr 13 17:00:51 user nova-compute[71731]:   <cpu mode="custom" match="exact">
Apr 13 17:00:51 user nova-compute[71731]:     <model>Nehalem</model>
Apr 13 17:00:51 user nova-compute[71731]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 17:00:51 user nova-compute[71731]:   </cpu>
Apr 13 17:00:51 user nova-compute[71731]:   <devices>
Apr 13 17:00:51 user nova-compute[71731]:     <disk type="file" device="disk">
Apr 13 17:00:51 user nova-compute[71731]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 17:00:51 user nova-compute[71731]:       <source file="/opt/stack/data/nova/instances/e101522a-965b-43da-9408-07e341a9103a/disk"/>
Apr 13 17:00:51 user nova-compute[71731]:       <target dev="vda" bus="virtio"/>
Apr 13 17:00:51 user nova-compute[71731]:     </disk>
Apr 13 17:00:51 user nova-compute[71731]:     <interface type="ethernet">
Apr 13 17:00:51 user nova-compute[71731]:       <mac address="fa:16:3e:17:73:8d"/>
Apr 13 17:00:51 user nova-compute[71731]:       <model type="virtio"/>
Apr 13 17:00:51 user nova-compute[71731]:       <mtu size="1442"/>
Apr 13 17:00:51 user nova-compute[71731]:       <target dev="tap8356a603-9c"/>
Apr 13 17:00:51 user nova-compute[71731]:     </interface>
Apr 13 17:00:51 user nova-compute[71731]:     <serial type="pty">
Apr 13 17:00:51 user nova-compute[71731]:       <log file="/opt/stack/data/nova/instances/e101522a-965b-43da-9408-07e341a9103a/console.log" append="off"/>
Apr 13 17:00:51 user nova-compute[71731]:     </serial>
Apr 13 17:00:51 user nova-compute[71731]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 17:00:51 user nova-compute[71731]:     <video>
Apr 13 17:00:51 user nova-compute[71731]:       <model type="virtio"/>
Apr 13 17:00:51 user nova-compute[71731]:     </video>
Apr 13 17:00:51 user nova-compute[71731]:     <rng model="virtio">
Apr 13 17:00:51 user nova-compute[71731]:       <backend model="random">/dev/urandom</backend>
Apr 13 17:00:51 user nova-compute[71731]:     </rng>
Apr 13 17:00:51 user nova-compute[71731]:     <controller type="usb" index="0" model="none"/>
Apr 13 17:00:51 user nova-compute[71731]:     <memballoon model="virtio">
Apr 13 17:00:51 user nova-compute[71731]:       <stats period="10"/>
Apr 13 17:00:51 user nova-compute[71731]:     </memballoon>
Apr 13 17:00:51 user nova-compute[71731]:   </devices>
Apr 13 17:00:51 user nova-compute[71731]: </domain>
Apr 13 17:00:51 user nova-compute[71731]:  {{(pid=71731) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 17:00:51 user nova-compute[71731]: DEBUG nova.virt.libvirt.vif [None req-cb45f9d8-7da0-43f5-bb88-559eeafe64e7 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T17:00:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-2144426413',display_name='tempest-AttachVolumeNegativeTest-server-2144426413',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-2144426413',id=45,image_ref='708622a9-7465-4492-ade8-b827198f7e30',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK/PPAxTx4h8wKULYE+NmhML0XVzgcuD2CI5i2nijjbKEY4lk93mBS7lo+7L0CmeBrgi6HQncBfHbPaPbq9kFxHeS9dKrt+RaVlLcssm1Y2vqIwfwXE++AutJHrwid+LSg==',key_name='tempest-keypair-1663561865',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='097b15faad8249c9bf45623d0c3ab518',ramdisk_id='',reservation_id='r-qadqihrl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='708622a9-7465-4492-ade8-b827198f7e30',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-236067262',owner_user_name='tempest-AttachVolumeNegativeTest-236067262-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T17:00:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a08b0caad23045c1822cdd0b3ae0769f',uuid=e101522a-965b-43da-9408-07e341a9103a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8356a603-9c08-4a58-8735-2d4b58654a18", "address": "fa:16:3e:17:73:8d", "network": {"id": "436011a9-c48b-4f33-a576-a245b344dd72", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-116243831-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "097b15faad8249c9bf45623d0c3ab518", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8356a603-9c", "ovs_interfaceid": "8356a603-9c08-4a58-8735-2d4b58654a18", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 17:00:51 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-cb45f9d8-7da0-43f5-bb88-559eeafe64e7 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Converting VIF {"id": "8356a603-9c08-4a58-8735-2d4b58654a18", "address": "fa:16:3e:17:73:8d", "network": {"id": "436011a9-c48b-4f33-a576-a245b344dd72", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-116243831-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "097b15faad8249c9bf45623d0c3ab518", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8356a603-9c", "ovs_interfaceid": "8356a603-9c08-4a58-8735-2d4b58654a18", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 17:00:51 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-cb45f9d8-7da0-43f5-bb88-559eeafe64e7 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:17:73:8d,bridge_name='br-int',has_traffic_filtering=True,id=8356a603-9c08-4a58-8735-2d4b58654a18,network=Network(436011a9-c48b-4f33-a576-a245b344dd72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8356a603-9c') {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 17:00:51 user nova-compute[71731]: DEBUG os_vif [None req-cb45f9d8-7da0-43f5-bb88-559eeafe64e7 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:73:8d,bridge_name='br-int',has_traffic_filtering=True,id=8356a603-9c08-4a58-8735-2d4b58654a18,network=Network(436011a9-c48b-4f33-a576-a245b344dd72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8356a603-9c') {{(pid=71731) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 17:00:51 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:00:51 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 17:00:51 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 17:00:51 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:00:51 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:00:51 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8356a603-9c, may_exist=True) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 17:00:51 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8356a603-9c, col_values=(('external_ids', {'iface-id': '8356a603-9c08-4a58-8735-2d4b58654a18', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:17:73:8d', 'vm-uuid': 'e101522a-965b-43da-9408-07e341a9103a'}),)) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 17:00:51 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:00:51 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 17:00:51 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:00:51 user nova-compute[71731]: INFO os_vif [None req-cb45f9d8-7da0-43f5-bb88-559eeafe64e7 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:73:8d,bridge_name='br-int',has_traffic_filtering=True,id=8356a603-9c08-4a58-8735-2d4b58654a18,network=Network(436011a9-c48b-4f33-a576-a245b344dd72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8356a603-9c')
Apr 13 17:00:52 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-cb45f9d8-7da0-43f5-bb88-559eeafe64e7 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] No BDM found with device name vda, not building metadata. {{(pid=71731) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 17:00:52 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-cb45f9d8-7da0-43f5-bb88-559eeafe64e7 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] No VIF found with MAC fa:16:3e:17:73:8d, not building metadata {{(pid=71731) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 17:00:52 user nova-compute[71731]: DEBUG nova.network.neutron [req-a554ec72-cc12-47c4-8de2-8d47fd2d0b69 req-7b3b7edd-94bd-46da-892f-f810e28daa0f service nova] [instance: e101522a-965b-43da-9408-07e341a9103a] Updated VIF entry in instance network info cache for port 8356a603-9c08-4a58-8735-2d4b58654a18. {{(pid=71731) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 17:00:52 user nova-compute[71731]: DEBUG nova.network.neutron [req-a554ec72-cc12-47c4-8de2-8d47fd2d0b69 req-7b3b7edd-94bd-46da-892f-f810e28daa0f service nova] [instance: e101522a-965b-43da-9408-07e341a9103a] Updating instance_info_cache with network_info: [{"id": "8356a603-9c08-4a58-8735-2d4b58654a18", "address": "fa:16:3e:17:73:8d", "network": {"id": "436011a9-c48b-4f33-a576-a245b344dd72", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-116243831-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "097b15faad8249c9bf45623d0c3ab518", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8356a603-9c", "ovs_interfaceid": "8356a603-9c08-4a58-8735-2d4b58654a18", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 17:00:52 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-a554ec72-cc12-47c4-8de2-8d47fd2d0b69 req-7b3b7edd-94bd-46da-892f-f810e28daa0f service nova] Releasing lock "refresh_cache-e101522a-965b-43da-9408-07e341a9103a" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 17:00:52 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:00:53 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:00:53 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:00:53 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:00:53 user nova-compute[71731]: DEBUG nova.compute.manager [req-1b8436b6-4fec-4f2e-bd2e-64346afb85b7 req-b14685e6-c885-4ec5-9f50-d258e6ea31b1 service nova] [instance: e101522a-965b-43da-9408-07e341a9103a] Received event network-vif-plugged-8356a603-9c08-4a58-8735-2d4b58654a18 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:00:53 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-1b8436b6-4fec-4f2e-bd2e-64346afb85b7 req-b14685e6-c885-4ec5-9f50-d258e6ea31b1 service nova] Acquiring lock "e101522a-965b-43da-9408-07e341a9103a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:00:53 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-1b8436b6-4fec-4f2e-bd2e-64346afb85b7 req-b14685e6-c885-4ec5-9f50-d258e6ea31b1 service nova] Lock "e101522a-965b-43da-9408-07e341a9103a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:00:53 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-1b8436b6-4fec-4f2e-bd2e-64346afb85b7 req-b14685e6-c885-4ec5-9f50-d258e6ea31b1 service nova] Lock "e101522a-965b-43da-9408-07e341a9103a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:00:53 user nova-compute[71731]: DEBUG nova.compute.manager [req-1b8436b6-4fec-4f2e-bd2e-64346afb85b7 req-b14685e6-c885-4ec5-9f50-d258e6ea31b1 service nova] [instance: e101522a-965b-43da-9408-07e341a9103a] No waiting events found dispatching network-vif-plugged-8356a603-9c08-4a58-8735-2d4b58654a18 {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 17:00:53 user nova-compute[71731]: WARNING nova.compute.manager [req-1b8436b6-4fec-4f2e-bd2e-64346afb85b7 req-b14685e6-c885-4ec5-9f50-d258e6ea31b1 service nova] [instance: e101522a-965b-43da-9408-07e341a9103a] Received unexpected event network-vif-plugged-8356a603-9c08-4a58-8735-2d4b58654a18 for instance with vm_state building and task_state spawning.
Apr 13 17:00:53 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:00:55 user nova-compute[71731]: DEBUG nova.virt.driver [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Emitting event <LifecycleEvent: 1681405255.4990897, e101522a-965b-43da-9408-07e341a9103a => Resumed> {{(pid=71731) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 17:00:55 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: e101522a-965b-43da-9408-07e341a9103a] VM Resumed (Lifecycle Event)
Apr 13 17:00:55 user nova-compute[71731]: DEBUG nova.compute.manager [None req-cb45f9d8-7da0-43f5-bb88-559eeafe64e7 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] [instance: e101522a-965b-43da-9408-07e341a9103a] Instance event wait completed in 0 seconds for  {{(pid=71731) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 17:00:55 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-cb45f9d8-7da0-43f5-bb88-559eeafe64e7 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] [instance: e101522a-965b-43da-9408-07e341a9103a] Guest created on hypervisor {{(pid=71731) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 17:00:55 user nova-compute[71731]: INFO nova.virt.libvirt.driver [-] [instance: e101522a-965b-43da-9408-07e341a9103a] Instance spawned successfully.
Apr 13 17:00:55 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-cb45f9d8-7da0-43f5-bb88-559eeafe64e7 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] [instance: e101522a-965b-43da-9408-07e341a9103a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 17:00:55 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: e101522a-965b-43da-9408-07e341a9103a] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 17:00:55 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: e101522a-965b-43da-9408-07e341a9103a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71731) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 17:00:55 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-cb45f9d8-7da0-43f5-bb88-559eeafe64e7 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] [instance: e101522a-965b-43da-9408-07e341a9103a] Found default for hw_cdrom_bus of ide {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 17:00:55 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-cb45f9d8-7da0-43f5-bb88-559eeafe64e7 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] [instance: e101522a-965b-43da-9408-07e341a9103a] Found default for hw_disk_bus of virtio {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 17:00:55 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-cb45f9d8-7da0-43f5-bb88-559eeafe64e7 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] [instance: e101522a-965b-43da-9408-07e341a9103a] Found default for hw_input_bus of None {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 17:00:55 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-cb45f9d8-7da0-43f5-bb88-559eeafe64e7 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] [instance: e101522a-965b-43da-9408-07e341a9103a] Found default for hw_pointer_model of None {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 17:00:55 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-cb45f9d8-7da0-43f5-bb88-559eeafe64e7 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] [instance: e101522a-965b-43da-9408-07e341a9103a] Found default for hw_video_model of virtio {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 17:00:55 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-cb45f9d8-7da0-43f5-bb88-559eeafe64e7 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] [instance: e101522a-965b-43da-9408-07e341a9103a] Found default for hw_vif_model of virtio {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 17:00:55 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: e101522a-965b-43da-9408-07e341a9103a] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 17:00:55 user nova-compute[71731]: DEBUG nova.virt.driver [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Emitting event <LifecycleEvent: 1681405255.50268, e101522a-965b-43da-9408-07e341a9103a => Started> {{(pid=71731) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 17:00:55 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: e101522a-965b-43da-9408-07e341a9103a] VM Started (Lifecycle Event)
Apr 13 17:00:55 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: e101522a-965b-43da-9408-07e341a9103a] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 17:00:55 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: e101522a-965b-43da-9408-07e341a9103a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71731) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 17:00:55 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: e101522a-965b-43da-9408-07e341a9103a] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 17:00:55 user nova-compute[71731]: DEBUG nova.compute.manager [req-c075ccb4-d094-47e1-b067-7d7b35342b84 req-90a502c8-e6eb-44c5-a43f-29e5d996f5e8 service nova] [instance: e101522a-965b-43da-9408-07e341a9103a] Received event network-vif-plugged-8356a603-9c08-4a58-8735-2d4b58654a18 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:00:55 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-c075ccb4-d094-47e1-b067-7d7b35342b84 req-90a502c8-e6eb-44c5-a43f-29e5d996f5e8 service nova] Acquiring lock "e101522a-965b-43da-9408-07e341a9103a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:00:55 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-c075ccb4-d094-47e1-b067-7d7b35342b84 req-90a502c8-e6eb-44c5-a43f-29e5d996f5e8 service nova] Lock "e101522a-965b-43da-9408-07e341a9103a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:00:55 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-c075ccb4-d094-47e1-b067-7d7b35342b84 req-90a502c8-e6eb-44c5-a43f-29e5d996f5e8 service nova] Lock "e101522a-965b-43da-9408-07e341a9103a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:00:55 user nova-compute[71731]: DEBUG nova.compute.manager [req-c075ccb4-d094-47e1-b067-7d7b35342b84 req-90a502c8-e6eb-44c5-a43f-29e5d996f5e8 service nova] [instance: e101522a-965b-43da-9408-07e341a9103a] No waiting events found dispatching network-vif-plugged-8356a603-9c08-4a58-8735-2d4b58654a18 {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 17:00:55 user nova-compute[71731]: WARNING nova.compute.manager [req-c075ccb4-d094-47e1-b067-7d7b35342b84 req-90a502c8-e6eb-44c5-a43f-29e5d996f5e8 service nova] [instance: e101522a-965b-43da-9408-07e341a9103a] Received unexpected event network-vif-plugged-8356a603-9c08-4a58-8735-2d4b58654a18 for instance with vm_state building and task_state spawning.
Apr 13 17:00:55 user nova-compute[71731]: INFO nova.compute.manager [None req-cb45f9d8-7da0-43f5-bb88-559eeafe64e7 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] [instance: e101522a-965b-43da-9408-07e341a9103a] Took 5.50 seconds to spawn the instance on the hypervisor.
Apr 13 17:00:55 user nova-compute[71731]: DEBUG nova.compute.manager [None req-cb45f9d8-7da0-43f5-bb88-559eeafe64e7 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] [instance: e101522a-965b-43da-9408-07e341a9103a] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 17:00:55 user nova-compute[71731]: INFO nova.compute.manager [None req-cb45f9d8-7da0-43f5-bb88-559eeafe64e7 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] [instance: e101522a-965b-43da-9408-07e341a9103a] Took 6.05 seconds to build instance.
Apr 13 17:00:55 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-cb45f9d8-7da0-43f5-bb88-559eeafe64e7 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "e101522a-965b-43da-9408-07e341a9103a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.130s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:00:56 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:00:57 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:01:01 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:01:02 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:01:02 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:01:06 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:01:07 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:01:11 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:01:12 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:01:16 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:01:17 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:01:21 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:01:22 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:01:26 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:01:31 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 17:01:31 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 17:01:31 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71731) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 17:01:32 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71731) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 17:01:32 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71731) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 17:01:32 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:01:32 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:01:37 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:01:38 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:01:40 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:01:40 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71731) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 17:01:41 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:01:42 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 17:01:42 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:01:42 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71731) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 17:01:42 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71731) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 17:01:42 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71731) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 17:01:42 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:01:42 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:01:45 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:01:45 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager.update_available_resource {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:01:45 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:01:45 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:01:45 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:01:45 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Auditing locally available compute resources for user (node: user) {{(pid=71731) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 17:01:45 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e101522a-965b-43da-9408-07e341a9103a/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:01:45 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e101522a-965b-43da-9408-07e341a9103a/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:01:45 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e101522a-965b-43da-9408-07e341a9103a/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:01:45 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e101522a-965b-43da-9408-07e341a9103a/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:01:45 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/652e59f0-b9be-4f45-bb79-2340d9564000/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:01:45 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/652e59f0-b9be-4f45-bb79-2340d9564000/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:01:45 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/652e59f0-b9be-4f45-bb79-2340d9564000/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:01:45 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/652e59f0-b9be-4f45-bb79-2340d9564000/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:01:45 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:01:45 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:01:45 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:01:46 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:01:46 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=71731) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 17:01:46 user nova-compute[71731]: WARNING nova.virt.libvirt.driver [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 17:01:46 user nova-compute[71731]: WARNING nova.virt.libvirt.driver [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 17:01:46 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Hypervisor/Node resource view: name=user free_ram=8537MB free_disk=25.985553741455078GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71731) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 17:01:46 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:01:46 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:01:46 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 17:01:46 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance 652e59f0-b9be-4f45-bb79-2340d9564000 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 17:01:46 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance e101522a-965b-43da-9408-07e341a9103a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 17:01:46 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=71731) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 17:01:46 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Final resource view: name=user phys_ram=16023MB used_ram=896MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=71731) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 17:01:46 user nova-compute[71731]: DEBUG nova.compute.provider_tree [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Inventory has not changed in ProviderTree for provider: cb6b1a64-0c24-4e2d-af1e-16576ca9165c {{(pid=71731) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 17:01:46 user nova-compute[71731]: DEBUG nova.scheduler.client.report [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Inventory has not changed for provider cb6b1a64-0c24-4e2d-af1e-16576ca9165c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71731) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 17:01:46 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Compute_service record updated for user:user {{(pid=71731) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 17:01:46 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.252s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:01:47 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:01:48 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:01:48 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Starting heal instance info cache {{(pid=71731) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 17:01:48 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Rebuilding the list of instances to heal {{(pid=71731) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 13 17:01:48 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Acquiring lock "refresh_cache-b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 17:01:48 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Acquired lock "refresh_cache-b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 17:01:48 user nova-compute[71731]: DEBUG nova.network.neutron [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] [instance: b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c] Forcefully refreshing network info cache for instance {{(pid=71731) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 17:01:48 user nova-compute[71731]: DEBUG nova.objects.instance [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lazy-loading 'info_cache' on Instance uuid b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 17:01:49 user nova-compute[71731]: DEBUG nova.network.neutron [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] [instance: b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c] Updating instance_info_cache with network_info: [{"id": "70f91af6-4a58-4b9d-a132-93537d398c24", "address": "fa:16:3e:fa:86:cf", "network": {"id": "436011a9-c48b-4f33-a576-a245b344dd72", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-116243831-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "097b15faad8249c9bf45623d0c3ab518", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70f91af6-4a", "ovs_interfaceid": "70f91af6-4a58-4b9d-a132-93537d398c24", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 17:01:49 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Releasing lock "refresh_cache-b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 17:01:49 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] [instance: b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c] Updated the network info_cache for instance {{(pid=71731) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 17:01:49 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:01:49 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:01:51 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:01:52 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 17:01:52 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:01:52 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Cleaning up deleted instances {{(pid=71731) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 13 17:01:52 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] There are 0 instances to clean {{(pid=71731) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 13 17:01:56 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:01:57 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 17:02:02 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 17:02:02 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:02:07 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:02:08 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:02:08 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Cleaning up deleted instances with incomplete migration  {{(pid=71731) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 13 17:02:12 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 17:02:17 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 17:02:17 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:02:17 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71731) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 17:02:17 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71731) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 17:02:17 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71731) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 17:02:17 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:02:22 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 17:02:22 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:02:27 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:02:32 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 17:02:36 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-1a209ab3-4cd9-45ed-ac29-59507b6f4cb7 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Acquiring lock "652e59f0-b9be-4f45-bb79-2340d9564000" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:02:36 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-1a209ab3-4cd9-45ed-ac29-59507b6f4cb7 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lock "652e59f0-b9be-4f45-bb79-2340d9564000" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:02:36 user nova-compute[71731]: DEBUG nova.objects.instance [None req-1a209ab3-4cd9-45ed-ac29-59507b6f4cb7 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lazy-loading 'flavor' on Instance uuid 652e59f0-b9be-4f45-bb79-2340d9564000 {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 17:02:36 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-1a209ab3-4cd9-45ed-ac29-59507b6f4cb7 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lock "652e59f0-b9be-4f45-bb79-2340d9564000" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:02:36 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-1a209ab3-4cd9-45ed-ac29-59507b6f4cb7 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Acquiring lock "652e59f0-b9be-4f45-bb79-2340d9564000" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:02:36 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-1a209ab3-4cd9-45ed-ac29-59507b6f4cb7 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lock "652e59f0-b9be-4f45-bb79-2340d9564000" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:02:36 user nova-compute[71731]: INFO nova.compute.manager [None req-1a209ab3-4cd9-45ed-ac29-59507b6f4cb7 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] [instance: 652e59f0-b9be-4f45-bb79-2340d9564000] Attaching volume db618723-a806-41ad-ade9-ea9a7ebbb110 to /dev/vdb
Apr 13 17:02:36 user nova-compute[71731]: DEBUG os_brick.utils [None req-1a209ab3-4cd9-45ed-ac29-59507b6f4cb7 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 17:02:36 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:02:36 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:02:36 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[b94a81c2-dc28-4491-a357-eb848efda58b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:81501d91421\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:02:36 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:02:36 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:02:36 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[07ed73f6-b017-42e7-9aa7-5385a545fd59]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:02:36 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:02:36 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:02:36 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4b19771-b0dd-42ba-a608-c01203708335]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:02:36 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d0762d3-c115-4390-875f-75a76f2075b8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:02:36 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-1a209ab3-4cd9-45ed-ac29-59507b6f4cb7 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Running cmd (subprocess): nvme version {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:02:36 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-1a209ab3-4cd9-45ed-ac29-59507b6f4cb7 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] 'nvme version' failed. Not Retrying. {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 17:02:36 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1a209ab3-4cd9-45ed-ac29-59507b6f4cb7 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] nvme not present on system {{(pid=71731) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 17:02:36 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:02:36 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 17:02:36 user nova-compute[71731]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 17:02:36 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[053c44c9-77f3-4b84-863d-6c34112252eb]: (4, '') {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:02:36 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.lightos [None req-1a209ab3-4cd9-45ed-ac29-59507b6f4cb7 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71731) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 17:02:36 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.lightos [None req-1a209ab3-4cd9-45ed-ac29-59507b6f4cb7 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71731) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 17:02:36 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.lightos [None req-1a209ab3-4cd9-45ed-ac29-59507b6f4cb7 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] LIGHTOS: no hostnqn found. {{(pid=71731) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 17:02:36 user nova-compute[71731]: DEBUG os_brick.utils [None req-1a209ab3-4cd9-45ed-ac29-59507b6f4cb7 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:81501d91421', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 17:02:36 user nova-compute[71731]: DEBUG nova.virt.block_device [None req-1a209ab3-4cd9-45ed-ac29-59507b6f4cb7 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] [instance: 652e59f0-b9be-4f45-bb79-2340d9564000] Updating existing volume attachment record: fa6ac8bc-98eb-407c-8c42-9251ab58ec8b {{(pid=71731) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 17:02:37 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 17:02:39 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:02:41 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:02:41 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71731) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 17:02:41 user nova-compute[71731]: DEBUG nova.compute.manager [req-9f1402ee-05ef-41d2-98af-5fac78c7b870 req-d4587c9e-ed04-4b26-95ae-88a5fe2153c0 service nova] [instance: e101522a-965b-43da-9408-07e341a9103a] Received event network-changed-8356a603-9c08-4a58-8735-2d4b58654a18 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:02:41 user nova-compute[71731]: DEBUG nova.compute.manager [req-9f1402ee-05ef-41d2-98af-5fac78c7b870 req-d4587c9e-ed04-4b26-95ae-88a5fe2153c0 service nova] [instance: e101522a-965b-43da-9408-07e341a9103a] Refreshing instance network info cache due to event network-changed-8356a603-9c08-4a58-8735-2d4b58654a18. {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 17:02:41 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-9f1402ee-05ef-41d2-98af-5fac78c7b870 req-d4587c9e-ed04-4b26-95ae-88a5fe2153c0 service nova] Acquiring lock "refresh_cache-e101522a-965b-43da-9408-07e341a9103a" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 17:02:41 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-9f1402ee-05ef-41d2-98af-5fac78c7b870 req-d4587c9e-ed04-4b26-95ae-88a5fe2153c0 service nova] Acquired lock "refresh_cache-e101522a-965b-43da-9408-07e341a9103a" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 17:02:41 user nova-compute[71731]: DEBUG nova.network.neutron [req-9f1402ee-05ef-41d2-98af-5fac78c7b870 req-d4587c9e-ed04-4b26-95ae-88a5fe2153c0 service nova] [instance: e101522a-965b-43da-9408-07e341a9103a] Refreshing network info cache for port 8356a603-9c08-4a58-8735-2d4b58654a18 {{(pid=71731) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 17:02:41 user nova-compute[71731]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1a209ab3-4cd9-45ed-ac29-59507b6f4cb7 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] [instance: 652e59f0-b9be-4f45-bb79-2340d9564000] Calling os-brick to attach iSCSI Volume {{(pid=71731) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 17:02:41 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a209ab3-4cd9-45ed-ac29-59507b6f4cb7 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8cf0118790>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:db618723-a806-41ad-ade9-ea9a7ebbb110', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RYSZgQMj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 17:02:41 user nova-compute[71731]: WARNING os_brick.initiator.connectors.base [None req-1a209ab3-4cd9-45ed-ac29-59507b6f4cb7 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 17:02:41 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-1a209ab3-4cd9-45ed-ac29-59507b6f4cb7 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 17:02:41 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-1a209ab3-4cd9-45ed-ac29-59507b6f4cb7 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 17:02:41 user nova-compute[71731]: WARNING os_brick.initiator.connectors.base [None req-1a209ab3-4cd9-45ed-ac29-59507b6f4cb7 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 17:02:41 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-1a209ab3-4cd9-45ed-ac29-59507b6f4cb7 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:db618723-a806-41ad-ade9-ea9a7ebbb110" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 17:02:41 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-1a209ab3-4cd9-45ed-ac29-59507b6f4cb7 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:db618723-a806-41ad-ade9-ea9a7ebbb110" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 17:02:41 user nova-compute[71731]: INFO os_brick.initiator.connectors.iscsi [None req-1a209ab3-4cd9-45ed-ac29-59507b6f4cb7 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 17:02:41 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db618723-a806-41ad-ade9-ea9a7ebbb110 -p 172.16.0.220:3260 {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:02:41 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db618723-a806-41ad-ade9-ea9a7ebbb110 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:02:41 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d2744a9-d239-4a00-abf5-a112276ef626]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:02:41 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a209ab3-4cd9-45ed-ac29-59507b6f4cb7 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 17:02:41 user nova-compute[71731]:  {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:02:41 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db618723-a806-41ad-ade9-ea9a7ebbb110 -p 172.16.0.220:3260 --interface default --op new {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:02:41 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db618723-a806-41ad-ade9-ea9a7ebbb110 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:02:41 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a37ebc9-bad3-425a-9543-6f9a4cc9aeac]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:db618723-a806-41ad-ade9-ea9a7ebbb110] added\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:02:41 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a209ab3-4cd9-45ed-ac29-59507b6f4cb7 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:db618723-a806-41ad-ade9-ea9a7ebbb110] added
Apr 13 17:02:41 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:02:41 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db618723-a806-41ad-ade9-ea9a7ebbb110 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:02:41 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db618723-a806-41ad-ade9-ea9a7ebbb110 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.029s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:02:41 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[62eb6ccc-8b0c-4142-8c17-8d7cba09e428]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:02:41 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a209ab3-4cd9-45ed-ac29-59507b6f4cb7 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:02:41 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db618723-a806-41ad-ade9-ea9a7ebbb110 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:02:41 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db618723-a806-41ad-ade9-ea9a7ebbb110 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:02:41 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd193c86-9383-4448-8db2-5baeca0dd649]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:02:41 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a209ab3-4cd9-45ed-ac29-59507b6f4cb7 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:02:41 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db618723-a806-41ad-ade9-ea9a7ebbb110 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RYSZgQMj {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:02:41 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db618723-a806-41ad-ade9-ea9a7ebbb110 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RYSZgQMj" returned: 0 in 0.022s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:02:41 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[e27fadba-ee61-4cae-854a-47f220147738]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:02:41 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a209ab3-4cd9-45ed-ac29-59507b6f4cb7 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RYSZgQMj'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:02:41 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db618723-a806-41ad-ade9-ea9a7ebbb110 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:02:41 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db618723-a806-41ad-ade9-ea9a7ebbb110 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:02:41 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[10038b78-068d-4ae4-82e8-aa86c13d8ce8]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:02:41 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a209ab3-4cd9-45ed-ac29-59507b6f4cb7 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:02:41 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:02:41 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:02:41 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[85d78b8a-8487-4309-a6bc-464ae1c1bc66]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e13dd7bb-01d3-41fb-b768-048792640d52 (non-flash)\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:02:41 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a209ab3-4cd9-45ed-ac29-59507b6f4cb7 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e13dd7bb-01d3-41fb-b768-048792640d52 (non-flash)
Apr 13 17:02:41 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 17:02:41 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a209ab3-4cd9-45ed-ac29-59507b6f4cb7 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e13dd7bb-01d3-41fb-b768-048792640d52 (non-flash)
Apr 13 17:02:41 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 17:02:41 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db618723-a806-41ad-ade9-ea9a7ebbb110 -p 172.16.0.220:3260 --login {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:02:41 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db618723-a806-41ad-ade9-ea9a7ebbb110 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:02:41 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[24ffaeed-0f4d-4e30-ad34-7ddba5701d3a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:db618723-a806-41ad-ade9-ea9a7ebbb110, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:db618723-a806-41ad-ade9-ea9a7ebbb110, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:02:41 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a209ab3-4cd9-45ed-ac29-59507b6f4cb7 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:db618723-a806-41ad-ade9-ea9a7ebbb110, portal: 172.16.0.220,3260]
Apr 13 17:02:41 user nova-compute[71731]: Login to [iface: default, target: iqn.2010-10.org.openstack:db618723-a806-41ad-ade9-ea9a7ebbb110, portal: 172.16.0.220,3260] successful.
Apr 13 17:02:41 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:02:41 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db618723-a806-41ad-ade9-ea9a7ebbb110 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:02:41 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-e34f5abc-5ea3-4a11-bf1a-ffd37cd80fdd tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Acquiring lock "e101522a-965b-43da-9408-07e341a9103a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:02:41 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-e34f5abc-5ea3-4a11-bf1a-ffd37cd80fdd tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "e101522a-965b-43da-9408-07e341a9103a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:02:41 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-e34f5abc-5ea3-4a11-bf1a-ffd37cd80fdd tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Acquiring lock "e101522a-965b-43da-9408-07e341a9103a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:02:41 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-e34f5abc-5ea3-4a11-bf1a-ffd37cd80fdd tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "e101522a-965b-43da-9408-07e341a9103a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:02:41 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-e34f5abc-5ea3-4a11-bf1a-ffd37cd80fdd tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "e101522a-965b-43da-9408-07e341a9103a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:02:41 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db618723-a806-41ad-ade9-ea9a7ebbb110 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:02:41 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[af7373ce-3c7d-4eef-8be8-af4e308ddeb0]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:02:41 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a209ab3-4cd9-45ed-ac29-59507b6f4cb7 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:02:41 user nova-compute[71731]: INFO nova.compute.manager [None req-e34f5abc-5ea3-4a11-bf1a-ffd37cd80fdd tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] [instance: e101522a-965b-43da-9408-07e341a9103a] Terminating instance
Apr 13 17:02:41 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:02:41 user nova-compute[71731]: DEBUG nova.compute.manager [None req-e34f5abc-5ea3-4a11-bf1a-ffd37cd80fdd tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] [instance: e101522a-965b-43da-9408-07e341a9103a] Start destroying the instance on the hypervisor. {{(pid=71731) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 17:02:41 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:02:41 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c225812-5f63-47c6-ba1f-95b2a05867a1]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e13dd7bb-01d3-41fb-b768-048792640d52 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db618723-a806-41ad-ade9-ea9a7ebbb110 (non-flash)\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:02:41 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a209ab3-4cd9-45ed-ac29-59507b6f4cb7 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e13dd7bb-01d3-41fb-b768-048792640d52 (non-flash)
Apr 13 17:02:41 user nova-compute[71731]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db618723-a806-41ad-ade9-ea9a7ebbb110 (non-flash)
Apr 13 17:02:41 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 17:02:41 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a209ab3-4cd9-45ed-ac29-59507b6f4cb7 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e13dd7bb-01d3-41fb-b768-048792640d52 (non-flash)
Apr 13 17:02:41 user nova-compute[71731]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db618723-a806-41ad-ade9-ea9a7ebbb110 (non-flash)
Apr 13 17:02:41 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 17:02:41 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-1a209ab3-4cd9-45ed-ac29-59507b6f4cb7 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:db618723-a806-41ad-ade9-ea9a7ebbb110" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.306s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 17:02:41 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a209ab3-4cd9-45ed-ac29-59507b6f4cb7 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Connected to 172.16.0.220:3260 {{(pid=71731) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 17:02:41 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-1a209ab3-4cd9-45ed-ac29-59507b6f4cb7 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] HCTL ('34', '-', '-', 0) found on session 51 with lun 0 {{(pid=71731) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 17:02:41 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-1a209ab3-4cd9-45ed-ac29-59507b6f4cb7 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71731) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 17:02:41 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:02:41 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.026s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:02:41 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cd3b8fb-009e-4fff-a70a-17ad55fcf71d]: (4, ('- - 0', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:02:41 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-1a209ab3-4cd9-45ed-ac29-59507b6f4cb7 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Searching for a device in session 51 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71731) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 17:02:41 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a209ab3-4cd9-45ed-ac29-59507b6f4cb7 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:db618723-a806-41ad-ade9-ea9a7ebbb110', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RYSZgQMj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71731) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 17:02:41 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:02:41 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:02:41 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:02:42 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:02:42 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:02:42 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:02:42 user nova-compute[71731]: INFO nova.virt.libvirt.driver [-] [instance: e101522a-965b-43da-9408-07e341a9103a] Instance destroyed successfully.
Apr 13 17:02:42 user nova-compute[71731]: DEBUG nova.objects.instance [None req-e34f5abc-5ea3-4a11-bf1a-ffd37cd80fdd tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lazy-loading 'resources' on Instance uuid e101522a-965b-43da-9408-07e341a9103a {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 17:02:42 user nova-compute[71731]: DEBUG nova.virt.libvirt.vif [None req-e34f5abc-5ea3-4a11-bf1a-ffd37cd80fdd tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T17:00:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-2144426413',display_name='tempest-AttachVolumeNegativeTest-server-2144426413',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-2144426413',id=45,image_ref='708622a9-7465-4492-ade8-b827198f7e30',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK/PPAxTx4h8wKULYE+NmhML0XVzgcuD2CI5i2nijjbKEY4lk93mBS7lo+7L0CmeBrgi6HQncBfHbPaPbq9kFxHeS9dKrt+RaVlLcssm1Y2vqIwfwXE++AutJHrwid+LSg==',key_name='tempest-keypair-1663561865',keypairs=<?>,launch_index=0,launched_at=2023-04-13T17:00:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='097b15faad8249c9bf45623d0c3ab518',ramdisk_id='',reservation_id='r-qadqihrl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='708622a9-7465-4492-ade8-b827198f7e30',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-236067262',owner_user_name='tempest-AttachVolumeNegativeTest-236067262-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T17:00:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a08b0caad23045c1822cdd0b3ae0769f',uuid=e101522a-965b-43da-9408-07e341a9103a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8356a603-9c08-4a58-8735-2d4b58654a18", "address": "fa:16:3e:17:73:8d", "network": {"id": "436011a9-c48b-4f33-a576-a245b344dd72", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-116243831-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "097b15faad8249c9bf45623d0c3ab518", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8356a603-9c", "ovs_interfaceid": "8356a603-9c08-4a58-8735-2d4b58654a18", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 17:02:42 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-e34f5abc-5ea3-4a11-bf1a-ffd37cd80fdd tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Converting VIF {"id": "8356a603-9c08-4a58-8735-2d4b58654a18", "address": "fa:16:3e:17:73:8d", "network": {"id": "436011a9-c48b-4f33-a576-a245b344dd72", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-116243831-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "097b15faad8249c9bf45623d0c3ab518", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8356a603-9c", "ovs_interfaceid": "8356a603-9c08-4a58-8735-2d4b58654a18", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 17:02:42 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-e34f5abc-5ea3-4a11-bf1a-ffd37cd80fdd tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:17:73:8d,bridge_name='br-int',has_traffic_filtering=True,id=8356a603-9c08-4a58-8735-2d4b58654a18,network=Network(436011a9-c48b-4f33-a576-a245b344dd72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8356a603-9c') {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 17:02:42 user nova-compute[71731]: DEBUG os_vif [None req-e34f5abc-5ea3-4a11-bf1a-ffd37cd80fdd tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:73:8d,bridge_name='br-int',has_traffic_filtering=True,id=8356a603-9c08-4a58-8735-2d4b58654a18,network=Network(436011a9-c48b-4f33-a576-a245b344dd72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8356a603-9c') {{(pid=71731) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 17:02:42 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:02:42 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8356a603-9c, bridge=br-int, if_exists=True) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 17:02:42 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:02:42 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:02:42 user nova-compute[71731]: INFO os_vif [None req-e34f5abc-5ea3-4a11-bf1a-ffd37cd80fdd tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:73:8d,bridge_name='br-int',has_traffic_filtering=True,id=8356a603-9c08-4a58-8735-2d4b58654a18,network=Network(436011a9-c48b-4f33-a576-a245b344dd72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8356a603-9c')
Apr 13 17:02:42 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-e34f5abc-5ea3-4a11-bf1a-ffd37cd80fdd tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] [instance: e101522a-965b-43da-9408-07e341a9103a] Deleting instance files /opt/stack/data/nova/instances/e101522a-965b-43da-9408-07e341a9103a_del
Apr 13 17:02:42 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-e34f5abc-5ea3-4a11-bf1a-ffd37cd80fdd tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] [instance: e101522a-965b-43da-9408-07e341a9103a] Deletion of /opt/stack/data/nova/instances/e101522a-965b-43da-9408-07e341a9103a_del complete
Apr 13 17:02:42 user nova-compute[71731]: INFO nova.compute.manager [None req-e34f5abc-5ea3-4a11-bf1a-ffd37cd80fdd tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] [instance: e101522a-965b-43da-9408-07e341a9103a] Took 0.71 seconds to destroy the instance on the hypervisor.
Apr 13 17:02:42 user nova-compute[71731]: DEBUG oslo.service.loopingcall [None req-e34f5abc-5ea3-4a11-bf1a-ffd37cd80fdd tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71731) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 17:02:42 user nova-compute[71731]: DEBUG nova.compute.manager [-] [instance: e101522a-965b-43da-9408-07e341a9103a] Deallocating network for instance {{(pid=71731) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 17:02:42 user nova-compute[71731]: DEBUG nova.network.neutron [-] [instance: e101522a-965b-43da-9408-07e341a9103a] deallocate_for_instance() {{(pid=71731) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 17:02:42 user nova-compute[71731]: DEBUG nova.network.neutron [req-9f1402ee-05ef-41d2-98af-5fac78c7b870 req-d4587c9e-ed04-4b26-95ae-88a5fe2153c0 service nova] [instance: e101522a-965b-43da-9408-07e341a9103a] Updated VIF entry in instance network info cache for port 8356a603-9c08-4a58-8735-2d4b58654a18. {{(pid=71731) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 17:02:42 user nova-compute[71731]: DEBUG nova.network.neutron [req-9f1402ee-05ef-41d2-98af-5fac78c7b870 req-d4587c9e-ed04-4b26-95ae-88a5fe2153c0 service nova] [instance: e101522a-965b-43da-9408-07e341a9103a] Updating instance_info_cache with network_info: [{"id": "8356a603-9c08-4a58-8735-2d4b58654a18", "address": "fa:16:3e:17:73:8d", "network": {"id": "436011a9-c48b-4f33-a576-a245b344dd72", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-116243831-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "097b15faad8249c9bf45623d0c3ab518", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8356a603-9c", "ovs_interfaceid": "8356a603-9c08-4a58-8735-2d4b58654a18", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 17:02:42 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-9f1402ee-05ef-41d2-98af-5fac78c7b870 req-d4587c9e-ed04-4b26-95ae-88a5fe2153c0 service nova] Releasing lock "refresh_cache-e101522a-965b-43da-9408-07e341a9103a" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 17:02:42 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:02:42 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-1a209ab3-4cd9-45ed-ac29-59507b6f4cb7 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.348s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 17:02:42 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a209ab3-4cd9-45ed-ac29-59507b6f4cb7 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] <== connect_volume: return (1351ms) {'type': 'block', 'scsi_wwn': '26238373031653934', 'path': '/dev/sdc'} {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 17:02:42 user nova-compute[71731]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1a209ab3-4cd9-45ed-ac29-59507b6f4cb7 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] [instance: 652e59f0-b9be-4f45-bb79-2340d9564000] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26238373031653934', 'path': '/dev/sdc'} {{(pid=71731) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 17:02:42 user nova-compute[71731]: DEBUG nova.objects.instance [None req-1a209ab3-4cd9-45ed-ac29-59507b6f4cb7 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lazy-loading 'flavor' on Instance uuid 652e59f0-b9be-4f45-bb79-2340d9564000 {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 17:02:42 user nova-compute[71731]: DEBUG nova.virt.libvirt.guest [None req-1a209ab3-4cd9-45ed-ac29-59507b6f4cb7 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] attach device xml: <disk type="block" device="disk">
Apr 13 17:02:42 user nova-compute[71731]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 17:02:42 user nova-compute[71731]:   <source dev="/dev/sdc"/>
Apr 13 17:02:42 user nova-compute[71731]:   <target dev="vdb" bus="virtio"/>
Apr 13 17:02:42 user nova-compute[71731]:   <serial>db618723-a806-41ad-ade9-ea9a7ebbb110</serial>
Apr 13 17:02:42 user nova-compute[71731]: </disk>
Apr 13 17:02:42 user nova-compute[71731]:  {{(pid=71731) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 13 17:02:43 user nova-compute[71731]: DEBUG nova.network.neutron [-] [instance: e101522a-965b-43da-9408-07e341a9103a] Updating instance_info_cache with network_info: [] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 17:02:43 user nova-compute[71731]: INFO nova.compute.manager [-] [instance: e101522a-965b-43da-9408-07e341a9103a] Took 0.76 seconds to deallocate network for instance.
Apr 13 17:02:43 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-e34f5abc-5ea3-4a11-bf1a-ffd37cd80fdd tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:02:43 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-e34f5abc-5ea3-4a11-bf1a-ffd37cd80fdd tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:02:43 user nova-compute[71731]: DEBUG nova.compute.manager [req-5d218b0c-bfb8-483b-a52a-ebfdf594ecc2 req-9300cd59-1fb3-48da-aacd-055f51be7718 service nova] [instance: e101522a-965b-43da-9408-07e341a9103a] Received event network-vif-deleted-8356a603-9c08-4a58-8735-2d4b58654a18 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:02:43 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-1a209ab3-4cd9-45ed-ac29-59507b6f4cb7 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] No BDM found with device name vda, not building metadata. {{(pid=71731) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 17:02:43 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-1a209ab3-4cd9-45ed-ac29-59507b6f4cb7 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71731) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 17:02:43 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-1a209ab3-4cd9-45ed-ac29-59507b6f4cb7 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] No VIF found with MAC fa:16:3e:0e:ca:10, not building metadata {{(pid=71731) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 17:02:43 user nova-compute[71731]: DEBUG nova.compute.provider_tree [None req-e34f5abc-5ea3-4a11-bf1a-ffd37cd80fdd tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Inventory has not changed in ProviderTree for provider: cb6b1a64-0c24-4e2d-af1e-16576ca9165c {{(pid=71731) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 17:02:43 user nova-compute[71731]: DEBUG nova.scheduler.client.report [None req-e34f5abc-5ea3-4a11-bf1a-ffd37cd80fdd tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Inventory has not changed for provider cb6b1a64-0c24-4e2d-af1e-16576ca9165c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71731) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 17:02:43 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-e34f5abc-5ea3-4a11-bf1a-ffd37cd80fdd tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.186s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:02:43 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-1a209ab3-4cd9-45ed-ac29-59507b6f4cb7 tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lock "652e59f0-b9be-4f45-bb79-2340d9564000" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.775s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:02:43 user nova-compute[71731]: DEBUG nova.compute.manager [req-4f4b2e3f-e0fd-4102-bb1a-23f191139c8f req-467d6ad1-a73f-40be-b527-5f568823742e service nova] [instance: e101522a-965b-43da-9408-07e341a9103a] Received event network-vif-unplugged-8356a603-9c08-4a58-8735-2d4b58654a18 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:02:43 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-4f4b2e3f-e0fd-4102-bb1a-23f191139c8f req-467d6ad1-a73f-40be-b527-5f568823742e service nova] Acquiring lock "e101522a-965b-43da-9408-07e341a9103a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:02:43 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-4f4b2e3f-e0fd-4102-bb1a-23f191139c8f req-467d6ad1-a73f-40be-b527-5f568823742e service nova] Lock "e101522a-965b-43da-9408-07e341a9103a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:02:43 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-4f4b2e3f-e0fd-4102-bb1a-23f191139c8f req-467d6ad1-a73f-40be-b527-5f568823742e service nova] Lock "e101522a-965b-43da-9408-07e341a9103a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:02:43 user nova-compute[71731]: DEBUG nova.compute.manager [req-4f4b2e3f-e0fd-4102-bb1a-23f191139c8f req-467d6ad1-a73f-40be-b527-5f568823742e service nova] [instance: e101522a-965b-43da-9408-07e341a9103a] No waiting events found dispatching network-vif-unplugged-8356a603-9c08-4a58-8735-2d4b58654a18 {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 17:02:43 user nova-compute[71731]: WARNING nova.compute.manager [req-4f4b2e3f-e0fd-4102-bb1a-23f191139c8f req-467d6ad1-a73f-40be-b527-5f568823742e service nova] [instance: e101522a-965b-43da-9408-07e341a9103a] Received unexpected event network-vif-unplugged-8356a603-9c08-4a58-8735-2d4b58654a18 for instance with vm_state deleted and task_state None.
Apr 13 17:02:43 user nova-compute[71731]: DEBUG nova.compute.manager [req-4f4b2e3f-e0fd-4102-bb1a-23f191139c8f req-467d6ad1-a73f-40be-b527-5f568823742e service nova] [instance: e101522a-965b-43da-9408-07e341a9103a] Received event network-vif-plugged-8356a603-9c08-4a58-8735-2d4b58654a18 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:02:43 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-4f4b2e3f-e0fd-4102-bb1a-23f191139c8f req-467d6ad1-a73f-40be-b527-5f568823742e service nova] Acquiring lock "e101522a-965b-43da-9408-07e341a9103a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:02:43 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-4f4b2e3f-e0fd-4102-bb1a-23f191139c8f req-467d6ad1-a73f-40be-b527-5f568823742e service nova] Lock "e101522a-965b-43da-9408-07e341a9103a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:02:43 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-4f4b2e3f-e0fd-4102-bb1a-23f191139c8f req-467d6ad1-a73f-40be-b527-5f568823742e service nova] Lock "e101522a-965b-43da-9408-07e341a9103a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:02:43 user nova-compute[71731]: DEBUG nova.compute.manager [req-4f4b2e3f-e0fd-4102-bb1a-23f191139c8f req-467d6ad1-a73f-40be-b527-5f568823742e service nova] [instance: e101522a-965b-43da-9408-07e341a9103a] No waiting events found dispatching network-vif-plugged-8356a603-9c08-4a58-8735-2d4b58654a18 {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 17:02:43 user nova-compute[71731]: WARNING nova.compute.manager [req-4f4b2e3f-e0fd-4102-bb1a-23f191139c8f req-467d6ad1-a73f-40be-b527-5f568823742e service nova] [instance: e101522a-965b-43da-9408-07e341a9103a] Received unexpected event network-vif-plugged-8356a603-9c08-4a58-8735-2d4b58654a18 for instance with vm_state deleted and task_state None.
Apr 13 17:02:43 user nova-compute[71731]: INFO nova.scheduler.client.report [None req-e34f5abc-5ea3-4a11-bf1a-ffd37cd80fdd tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Deleted allocations for instance e101522a-965b-43da-9408-07e341a9103a
Apr 13 17:02:43 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-e34f5abc-5ea3-4a11-bf1a-ffd37cd80fdd tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "e101522a-965b-43da-9408-07e341a9103a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.929s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:02:45 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager.update_available_resource {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:02:45 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:02:45 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:02:45 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:02:45 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Auditing locally available compute resources for user (node: user) {{(pid=71731) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 17:02:45 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/652e59f0-b9be-4f45-bb79-2340d9564000/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:02:45 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/652e59f0-b9be-4f45-bb79-2340d9564000/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:02:45 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/652e59f0-b9be-4f45-bb79-2340d9564000/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:02:45 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/652e59f0-b9be-4f45-bb79-2340d9564000/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:02:45 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=71731) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 17:02:45 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:02:45 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:02:45 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:02:45 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:02:45 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=71731) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 17:02:46 user nova-compute[71731]: DEBUG nova.compute.manager [req-b0afa432-84de-49c0-9d37-7689a55ac75b req-5ed765e9-f1c4-47a8-b3b5-55e4de5884a5 service nova] [instance: 652e59f0-b9be-4f45-bb79-2340d9564000] Received event network-changed-6047b3aa-607c-4b10-904a-8497d9a2f82b {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:02:46 user nova-compute[71731]: DEBUG nova.compute.manager [req-b0afa432-84de-49c0-9d37-7689a55ac75b req-5ed765e9-f1c4-47a8-b3b5-55e4de5884a5 service nova] [instance: 652e59f0-b9be-4f45-bb79-2340d9564000] Refreshing instance network info cache due to event network-changed-6047b3aa-607c-4b10-904a-8497d9a2f82b. {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 17:02:46 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-b0afa432-84de-49c0-9d37-7689a55ac75b req-5ed765e9-f1c4-47a8-b3b5-55e4de5884a5 service nova] Acquiring lock "refresh_cache-652e59f0-b9be-4f45-bb79-2340d9564000" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 17:02:46 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-b0afa432-84de-49c0-9d37-7689a55ac75b req-5ed765e9-f1c4-47a8-b3b5-55e4de5884a5 service nova] Acquired lock "refresh_cache-652e59f0-b9be-4f45-bb79-2340d9564000" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 17:02:46 user nova-compute[71731]: DEBUG nova.network.neutron [req-b0afa432-84de-49c0-9d37-7689a55ac75b req-5ed765e9-f1c4-47a8-b3b5-55e4de5884a5 service nova] [instance: 652e59f0-b9be-4f45-bb79-2340d9564000] Refreshing network info cache for port 6047b3aa-607c-4b10-904a-8497d9a2f82b {{(pid=71731) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 17:02:46 user nova-compute[71731]: WARNING nova.virt.libvirt.driver [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 17:02:46 user nova-compute[71731]: WARNING nova.virt.libvirt.driver [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 17:02:46 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Hypervisor/Node resource view: name=user free_ram=8621MB free_disk=26.004100799560547GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71731) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 17:02:46 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:02:46 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:02:46 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 17:02:46 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance 652e59f0-b9be-4f45-bb79-2340d9564000 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 17:02:46 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=71731) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 17:02:46 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Final resource view: name=user phys_ram=16023MB used_ram=768MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=71731) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 17:02:46 user nova-compute[71731]: DEBUG nova.scheduler.client.report [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Refreshing inventories for resource provider cb6b1a64-0c24-4e2d-af1e-16576ca9165c {{(pid=71731) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 13 17:02:46 user nova-compute[71731]: DEBUG nova.scheduler.client.report [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Updating ProviderTree inventory for provider cb6b1a64-0c24-4e2d-af1e-16576ca9165c from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71731) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 13 17:02:46 user nova-compute[71731]: DEBUG nova.compute.provider_tree [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Updating inventory in ProviderTree for provider cb6b1a64-0c24-4e2d-af1e-16576ca9165c with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71731) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 13 17:02:46 user nova-compute[71731]: DEBUG nova.scheduler.client.report [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Refreshing aggregate associations for resource provider cb6b1a64-0c24-4e2d-af1e-16576ca9165c, aggregates: None {{(pid=71731) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 13 17:02:46 user nova-compute[71731]: DEBUG nova.scheduler.client.report [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Refreshing trait associations for resource provider cb6b1a64-0c24-4e2d-af1e-16576ca9165c, traits: COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSSE3,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_SATA,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_SSE,COMPUTE_RESCUE_BFV,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE41,HW_CPU_X86_MMX,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_RAW {{(pid=71731) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 13 17:02:46 user nova-compute[71731]: DEBUG nova.compute.provider_tree [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Inventory has not changed in ProviderTree for provider: cb6b1a64-0c24-4e2d-af1e-16576ca9165c {{(pid=71731) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 17:02:46 user nova-compute[71731]: DEBUG nova.scheduler.client.report [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Inventory has not changed for provider cb6b1a64-0c24-4e2d-af1e-16576ca9165c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71731) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 17:02:46 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Compute_service record updated for user:user {{(pid=71731) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 17:02:46 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.341s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:02:46 user nova-compute[71731]: DEBUG nova.network.neutron [req-b0afa432-84de-49c0-9d37-7689a55ac75b req-5ed765e9-f1c4-47a8-b3b5-55e4de5884a5 service nova] [instance: 652e59f0-b9be-4f45-bb79-2340d9564000] Updated VIF entry in instance network info cache for port 6047b3aa-607c-4b10-904a-8497d9a2f82b. {{(pid=71731) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 17:02:46 user nova-compute[71731]: DEBUG nova.network.neutron [req-b0afa432-84de-49c0-9d37-7689a55ac75b req-5ed765e9-f1c4-47a8-b3b5-55e4de5884a5 service nova] [instance: 652e59f0-b9be-4f45-bb79-2340d9564000] Updating instance_info_cache with network_info: [{"id": "6047b3aa-607c-4b10-904a-8497d9a2f82b", "address": "fa:16:3e:0e:ca:10", "network": {"id": "0c6a5f46-e53b-4b4c-806e-b2617ba3ef35", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1984894004-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7edf468527d84954a943bb4c1f7ff54d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6047b3aa-60", "ovs_interfaceid": "6047b3aa-607c-4b10-904a-8497d9a2f82b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 17:02:46 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-b0afa432-84de-49c0-9d37-7689a55ac75b req-5ed765e9-f1c4-47a8-b3b5-55e4de5884a5 service nova] Releasing lock "refresh_cache-652e59f0-b9be-4f45-bb79-2340d9564000" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 17:02:47 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:02:47 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:02:48 user nova-compute[71731]: DEBUG nova.compute.manager [req-36735a08-a864-4731-b926-6efe0fd36fdc req-20c4109e-d32c-4e4f-9174-6b1b38f1c591 service nova] [instance: 652e59f0-b9be-4f45-bb79-2340d9564000] Received event network-changed-6047b3aa-607c-4b10-904a-8497d9a2f82b {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:02:48 user nova-compute[71731]: DEBUG nova.compute.manager [req-36735a08-a864-4731-b926-6efe0fd36fdc req-20c4109e-d32c-4e4f-9174-6b1b38f1c591 service nova] [instance: 652e59f0-b9be-4f45-bb79-2340d9564000] Refreshing instance network info cache due to event network-changed-6047b3aa-607c-4b10-904a-8497d9a2f82b. {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 17:02:48 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-36735a08-a864-4731-b926-6efe0fd36fdc req-20c4109e-d32c-4e4f-9174-6b1b38f1c591 service nova] Acquiring lock "refresh_cache-652e59f0-b9be-4f45-bb79-2340d9564000" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 17:02:48 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-36735a08-a864-4731-b926-6efe0fd36fdc req-20c4109e-d32c-4e4f-9174-6b1b38f1c591 service nova] Acquired lock "refresh_cache-652e59f0-b9be-4f45-bb79-2340d9564000" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 17:02:48 user nova-compute[71731]: DEBUG nova.network.neutron [req-36735a08-a864-4731-b926-6efe0fd36fdc req-20c4109e-d32c-4e4f-9174-6b1b38f1c591 service nova] [instance: 652e59f0-b9be-4f45-bb79-2340d9564000] Refreshing network info cache for port 6047b3aa-607c-4b10-904a-8497d9a2f82b {{(pid=71731) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 17:02:48 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:02:48 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:02:48 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-899a9c1a-a5d0-43f3-98e4-98086fb21f3e tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Acquiring lock "652e59f0-b9be-4f45-bb79-2340d9564000" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:02:48 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-899a9c1a-a5d0-43f3-98e4-98086fb21f3e tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lock "652e59f0-b9be-4f45-bb79-2340d9564000" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:02:48 user nova-compute[71731]: INFO nova.compute.manager [None req-899a9c1a-a5d0-43f3-98e4-98086fb21f3e tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] [instance: 652e59f0-b9be-4f45-bb79-2340d9564000] Rebooting instance
Apr 13 17:02:48 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-899a9c1a-a5d0-43f3-98e4-98086fb21f3e tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Acquiring lock "refresh_cache-652e59f0-b9be-4f45-bb79-2340d9564000" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 17:02:48 user nova-compute[71731]: DEBUG nova.network.neutron [req-36735a08-a864-4731-b926-6efe0fd36fdc req-20c4109e-d32c-4e4f-9174-6b1b38f1c591 service nova] [instance: 652e59f0-b9be-4f45-bb79-2340d9564000] Updated VIF entry in instance network info cache for port 6047b3aa-607c-4b10-904a-8497d9a2f82b. {{(pid=71731) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 17:02:48 user nova-compute[71731]: DEBUG nova.network.neutron [req-36735a08-a864-4731-b926-6efe0fd36fdc req-20c4109e-d32c-4e4f-9174-6b1b38f1c591 service nova] [instance: 652e59f0-b9be-4f45-bb79-2340d9564000] Updating instance_info_cache with network_info: [{"id": "6047b3aa-607c-4b10-904a-8497d9a2f82b", "address": "fa:16:3e:0e:ca:10", "network": {"id": "0c6a5f46-e53b-4b4c-806e-b2617ba3ef35", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1984894004-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7edf468527d84954a943bb4c1f7ff54d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6047b3aa-60", "ovs_interfaceid": "6047b3aa-607c-4b10-904a-8497d9a2f82b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 17:02:48 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-36735a08-a864-4731-b926-6efe0fd36fdc req-20c4109e-d32c-4e4f-9174-6b1b38f1c591 service nova] Releasing lock "refresh_cache-652e59f0-b9be-4f45-bb79-2340d9564000" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 17:02:48 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-899a9c1a-a5d0-43f3-98e4-98086fb21f3e tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Acquired lock "refresh_cache-652e59f0-b9be-4f45-bb79-2340d9564000" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 17:02:48 user nova-compute[71731]: DEBUG nova.network.neutron [None req-899a9c1a-a5d0-43f3-98e4-98086fb21f3e tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] [instance: 652e59f0-b9be-4f45-bb79-2340d9564000] Building network info cache for instance {{(pid=71731) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 17:02:49 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:02:49 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Starting heal instance info cache {{(pid=71731) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 17:02:49 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Acquiring lock "refresh_cache-652e59f0-b9be-4f45-bb79-2340d9564000" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 17:02:49 user nova-compute[71731]: DEBUG nova.network.neutron [None req-899a9c1a-a5d0-43f3-98e4-98086fb21f3e tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] [instance: 652e59f0-b9be-4f45-bb79-2340d9564000] Updating instance_info_cache with network_info: [{"id": "6047b3aa-607c-4b10-904a-8497d9a2f82b", "address": "fa:16:3e:0e:ca:10", "network": {"id": "0c6a5f46-e53b-4b4c-806e-b2617ba3ef35", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1984894004-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7edf468527d84954a943bb4c1f7ff54d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6047b3aa-60", "ovs_interfaceid": "6047b3aa-607c-4b10-904a-8497d9a2f82b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 17:02:49 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-899a9c1a-a5d0-43f3-98e4-98086fb21f3e tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Releasing lock "refresh_cache-652e59f0-b9be-4f45-bb79-2340d9564000" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 17:02:49 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Acquired lock "refresh_cache-652e59f0-b9be-4f45-bb79-2340d9564000" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 17:02:49 user nova-compute[71731]: DEBUG nova.network.neutron [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] [instance: 652e59f0-b9be-4f45-bb79-2340d9564000] Forcefully refreshing network info cache for instance {{(pid=71731) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 17:02:49 user nova-compute[71731]: DEBUG nova.compute.manager [None req-899a9c1a-a5d0-43f3-98e4-98086fb21f3e tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] [instance: 652e59f0-b9be-4f45-bb79-2340d9564000] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 17:02:49 user nova-compute[71731]: DEBUG nova.network.neutron [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] [instance: 652e59f0-b9be-4f45-bb79-2340d9564000] Updating instance_info_cache with network_info: [{"id": "6047b3aa-607c-4b10-904a-8497d9a2f82b", "address": "fa:16:3e:0e:ca:10", "network": {"id": "0c6a5f46-e53b-4b4c-806e-b2617ba3ef35", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1984894004-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7edf468527d84954a943bb4c1f7ff54d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6047b3aa-60", "ovs_interfaceid": "6047b3aa-607c-4b10-904a-8497d9a2f82b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 17:02:49 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Releasing lock "refresh_cache-652e59f0-b9be-4f45-bb79-2340d9564000" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 17:02:49 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] [instance: 652e59f0-b9be-4f45-bb79-2340d9564000] Updated the network info_cache for instance {{(pid=71731) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 17:02:50 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:02:51 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:02:51 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:02:51 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:02:51 user nova-compute[71731]: DEBUG nova.compute.manager [req-0c587ea2-fc2c-4b2f-9676-e1a76cfd4f7a req-a01ca80a-df4a-4c04-a9e8-24bab457bb07 service nova] [instance: 652e59f0-b9be-4f45-bb79-2340d9564000] Received event network-vif-unplugged-6047b3aa-607c-4b10-904a-8497d9a2f82b {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:02:51 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-0c587ea2-fc2c-4b2f-9676-e1a76cfd4f7a req-a01ca80a-df4a-4c04-a9e8-24bab457bb07 service nova] Acquiring lock "652e59f0-b9be-4f45-bb79-2340d9564000-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:02:51 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-0c587ea2-fc2c-4b2f-9676-e1a76cfd4f7a req-a01ca80a-df4a-4c04-a9e8-24bab457bb07 service nova] Lock "652e59f0-b9be-4f45-bb79-2340d9564000-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:02:51 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-0c587ea2-fc2c-4b2f-9676-e1a76cfd4f7a req-a01ca80a-df4a-4c04-a9e8-24bab457bb07 service nova] Lock "652e59f0-b9be-4f45-bb79-2340d9564000-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:02:51 user nova-compute[71731]: DEBUG nova.compute.manager [req-0c587ea2-fc2c-4b2f-9676-e1a76cfd4f7a req-a01ca80a-df4a-4c04-a9e8-24bab457bb07 service nova] [instance: 652e59f0-b9be-4f45-bb79-2340d9564000] No waiting events found dispatching network-vif-unplugged-6047b3aa-607c-4b10-904a-8497d9a2f82b {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 17:02:51 user nova-compute[71731]: WARNING nova.compute.manager [req-0c587ea2-fc2c-4b2f-9676-e1a76cfd4f7a req-a01ca80a-df4a-4c04-a9e8-24bab457bb07 service nova] [instance: 652e59f0-b9be-4f45-bb79-2340d9564000] Received unexpected event network-vif-unplugged-6047b3aa-607c-4b10-904a-8497d9a2f82b for instance with vm_state active and task_state reboot_started.
Apr 13 17:02:52 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:02:52 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:02:52 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-899a9c1a-a5d0-43f3-98e4-98086fb21f3e tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] [instance: 652e59f0-b9be-4f45-bb79-2340d9564000] Instance shutdown successfully.
Apr 13 17:02:52 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:02:53 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:02:53 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:02:53 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:02:53 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:02:53 user nova-compute[71731]: DEBUG nova.compute.manager [req-57c1d6ce-7765-413e-9960-16aa7cbcea89 req-31fed2dc-6e44-405c-a1fd-fe051138158f service nova] [instance: 652e59f0-b9be-4f45-bb79-2340d9564000] Received event network-vif-plugged-6047b3aa-607c-4b10-904a-8497d9a2f82b {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:02:53 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-57c1d6ce-7765-413e-9960-16aa7cbcea89 req-31fed2dc-6e44-405c-a1fd-fe051138158f service nova] Acquiring lock "652e59f0-b9be-4f45-bb79-2340d9564000-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:02:53 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-57c1d6ce-7765-413e-9960-16aa7cbcea89 req-31fed2dc-6e44-405c-a1fd-fe051138158f service nova] Lock "652e59f0-b9be-4f45-bb79-2340d9564000-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:02:53 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-57c1d6ce-7765-413e-9960-16aa7cbcea89 req-31fed2dc-6e44-405c-a1fd-fe051138158f service nova] Lock "652e59f0-b9be-4f45-bb79-2340d9564000-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:02:53 user nova-compute[71731]: DEBUG nova.compute.manager [req-57c1d6ce-7765-413e-9960-16aa7cbcea89 req-31fed2dc-6e44-405c-a1fd-fe051138158f service nova] [instance: 652e59f0-b9be-4f45-bb79-2340d9564000] No waiting events found dispatching network-vif-plugged-6047b3aa-607c-4b10-904a-8497d9a2f82b {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 17:02:53 user nova-compute[71731]: WARNING nova.compute.manager [req-57c1d6ce-7765-413e-9960-16aa7cbcea89 req-31fed2dc-6e44-405c-a1fd-fe051138158f service nova] [instance: 652e59f0-b9be-4f45-bb79-2340d9564000] Received unexpected event network-vif-plugged-6047b3aa-607c-4b10-904a-8497d9a2f82b for instance with vm_state active and task_state reboot_started.
Apr 13 17:02:54 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:02:54 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:02:54 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:02:55 user nova-compute[71731]: DEBUG nova.virt.libvirt.host [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Removed pending event for 652e59f0-b9be-4f45-bb79-2340d9564000 due to event {{(pid=71731) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 13 17:02:55 user nova-compute[71731]: DEBUG nova.virt.driver [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Emitting event <LifecycleEvent: 1681405375.7593358, 652e59f0-b9be-4f45-bb79-2340d9564000 => Resumed> {{(pid=71731) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 17:02:55 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 652e59f0-b9be-4f45-bb79-2340d9564000] VM Resumed (Lifecycle Event)
Apr 13 17:02:55 user nova-compute[71731]: INFO nova.virt.libvirt.driver [-] [instance: 652e59f0-b9be-4f45-bb79-2340d9564000] Instance running successfully.
Apr 13 17:02:55 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-899a9c1a-a5d0-43f3-98e4-98086fb21f3e tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] [instance: 652e59f0-b9be-4f45-bb79-2340d9564000] Instance soft rebooted successfully.
Apr 13 17:02:55 user nova-compute[71731]: DEBUG nova.compute.manager [None req-899a9c1a-a5d0-43f3-98e4-98086fb21f3e tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] [instance: 652e59f0-b9be-4f45-bb79-2340d9564000] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 17:02:55 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 652e59f0-b9be-4f45-bb79-2340d9564000] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 17:02:55 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 652e59f0-b9be-4f45-bb79-2340d9564000] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started, current DB power_state: 1, VM power_state: 1 {{(pid=71731) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 17:02:55 user nova-compute[71731]: DEBUG nova.virt.driver [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Emitting event <LifecycleEvent: 1681405375.7602775, 652e59f0-b9be-4f45-bb79-2340d9564000 => Started> {{(pid=71731) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 17:02:55 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 652e59f0-b9be-4f45-bb79-2340d9564000] VM Started (Lifecycle Event)
Apr 13 17:02:55 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-899a9c1a-a5d0-43f3-98e4-98086fb21f3e tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lock "652e59f0-b9be-4f45-bb79-2340d9564000" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.208s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:02:55 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 652e59f0-b9be-4f45-bb79-2340d9564000] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 17:02:55 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: 652e59f0-b9be-4f45-bb79-2340d9564000] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=71731) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 17:02:55 user nova-compute[71731]: DEBUG nova.compute.manager [req-9e6661f0-208a-46fe-ab97-38a48490abd0 req-8a29b742-7454-40ed-b1b5-09845b2a0b5e service nova] [instance: 652e59f0-b9be-4f45-bb79-2340d9564000] Received event network-vif-plugged-6047b3aa-607c-4b10-904a-8497d9a2f82b {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:02:55 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-9e6661f0-208a-46fe-ab97-38a48490abd0 req-8a29b742-7454-40ed-b1b5-09845b2a0b5e service nova] Acquiring lock "652e59f0-b9be-4f45-bb79-2340d9564000-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:02:55 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-9e6661f0-208a-46fe-ab97-38a48490abd0 req-8a29b742-7454-40ed-b1b5-09845b2a0b5e service nova] Lock "652e59f0-b9be-4f45-bb79-2340d9564000-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:02:55 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-9e6661f0-208a-46fe-ab97-38a48490abd0 req-8a29b742-7454-40ed-b1b5-09845b2a0b5e service nova] Lock "652e59f0-b9be-4f45-bb79-2340d9564000-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:02:55 user nova-compute[71731]: DEBUG nova.compute.manager [req-9e6661f0-208a-46fe-ab97-38a48490abd0 req-8a29b742-7454-40ed-b1b5-09845b2a0b5e service nova] [instance: 652e59f0-b9be-4f45-bb79-2340d9564000] No waiting events found dispatching network-vif-plugged-6047b3aa-607c-4b10-904a-8497d9a2f82b {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 17:02:55 user nova-compute[71731]: WARNING nova.compute.manager [req-9e6661f0-208a-46fe-ab97-38a48490abd0 req-8a29b742-7454-40ed-b1b5-09845b2a0b5e service nova] [instance: 652e59f0-b9be-4f45-bb79-2340d9564000] Received unexpected event network-vif-plugged-6047b3aa-607c-4b10-904a-8497d9a2f82b for instance with vm_state active and task_state None.
Apr 13 17:02:55 user nova-compute[71731]: DEBUG nova.compute.manager [req-9e6661f0-208a-46fe-ab97-38a48490abd0 req-8a29b742-7454-40ed-b1b5-09845b2a0b5e service nova] [instance: 652e59f0-b9be-4f45-bb79-2340d9564000] Received event network-vif-plugged-6047b3aa-607c-4b10-904a-8497d9a2f82b {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:02:55 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-9e6661f0-208a-46fe-ab97-38a48490abd0 req-8a29b742-7454-40ed-b1b5-09845b2a0b5e service nova] Acquiring lock "652e59f0-b9be-4f45-bb79-2340d9564000-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:02:55 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-9e6661f0-208a-46fe-ab97-38a48490abd0 req-8a29b742-7454-40ed-b1b5-09845b2a0b5e service nova] Lock "652e59f0-b9be-4f45-bb79-2340d9564000-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:02:55 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-9e6661f0-208a-46fe-ab97-38a48490abd0 req-8a29b742-7454-40ed-b1b5-09845b2a0b5e service nova] Lock "652e59f0-b9be-4f45-bb79-2340d9564000-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:02:55 user nova-compute[71731]: DEBUG nova.compute.manager [req-9e6661f0-208a-46fe-ab97-38a48490abd0 req-8a29b742-7454-40ed-b1b5-09845b2a0b5e service nova] [instance: 652e59f0-b9be-4f45-bb79-2340d9564000] No waiting events found dispatching network-vif-plugged-6047b3aa-607c-4b10-904a-8497d9a2f82b {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 17:02:55 user nova-compute[71731]: WARNING nova.compute.manager [req-9e6661f0-208a-46fe-ab97-38a48490abd0 req-8a29b742-7454-40ed-b1b5-09845b2a0b5e service nova] [instance: 652e59f0-b9be-4f45-bb79-2340d9564000] Received unexpected event network-vif-plugged-6047b3aa-607c-4b10-904a-8497d9a2f82b for instance with vm_state active and task_state None.
Apr 13 17:02:57 user nova-compute[71731]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681405362.1444247, e101522a-965b-43da-9408-07e341a9103a => Stopped> {{(pid=71731) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 17:02:57 user nova-compute[71731]: INFO nova.compute.manager [-] [instance: e101522a-965b-43da-9408-07e341a9103a] VM Stopped (Lifecycle Event)
Apr 13 17:02:57 user nova-compute[71731]: DEBUG nova.compute.manager [None req-b8c988ec-2d18-404c-8170-c219256e71d6 None None] [instance: e101522a-965b-43da-9408-07e341a9103a] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 17:02:57 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:02:57 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:03:02 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:03:02 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:03:05 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:03:07 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:03:07 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:03:12 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:03:12 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:03:17 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:03:17 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:03:22 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:03:27 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 17:03:27 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:03:32 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:03:33 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-2b0b8b64-5df5-43de-9908-06259785d76d tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Acquiring lock "b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:03:33 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-2b0b8b64-5df5-43de-9908-06259785d76d tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:03:33 user nova-compute[71731]: INFO nova.compute.manager [None req-2b0b8b64-5df5-43de-9908-06259785d76d tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] [instance: b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c] Detaching volume e13dd7bb-01d3-41fb-b768-048792640d52
Apr 13 17:03:33 user nova-compute[71731]: INFO nova.virt.block_device [None req-2b0b8b64-5df5-43de-9908-06259785d76d tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] [instance: b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c] Attempting to driver detach volume e13dd7bb-01d3-41fb-b768-048792640d52 from mountpoint /dev/vdb
Apr 13 17:03:33 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-2b0b8b64-5df5-43de-9908-06259785d76d tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Attempting to detach device vdb from instance b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c from the persistent domain config. {{(pid=71731) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 13 17:03:33 user nova-compute[71731]: DEBUG nova.virt.libvirt.guest [None req-2b0b8b64-5df5-43de-9908-06259785d76d tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 17:03:33 user nova-compute[71731]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 17:03:33 user nova-compute[71731]:   <source dev="/dev/sdb"/>
Apr 13 17:03:33 user nova-compute[71731]:   <target dev="vdb" bus="virtio"/>
Apr 13 17:03:33 user nova-compute[71731]:   <serial>e13dd7bb-01d3-41fb-b768-048792640d52</serial>
Apr 13 17:03:33 user nova-compute[71731]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 13 17:03:33 user nova-compute[71731]: </disk>
Apr 13 17:03:33 user nova-compute[71731]:  {{(pid=71731) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 17:03:33 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-2b0b8b64-5df5-43de-9908-06259785d76d tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Successfully detached device vdb from instance b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c from the persistent domain config.
Apr 13 17:03:33 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-2b0b8b64-5df5-43de-9908-06259785d76d tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c from the live domain config. {{(pid=71731) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 13 17:03:33 user nova-compute[71731]: DEBUG nova.virt.libvirt.guest [None req-2b0b8b64-5df5-43de-9908-06259785d76d tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 17:03:33 user nova-compute[71731]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 17:03:33 user nova-compute[71731]:   <source dev="/dev/sdb"/>
Apr 13 17:03:33 user nova-compute[71731]:   <target dev="vdb" bus="virtio"/>
Apr 13 17:03:33 user nova-compute[71731]:   <serial>e13dd7bb-01d3-41fb-b768-048792640d52</serial>
Apr 13 17:03:33 user nova-compute[71731]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 13 17:03:33 user nova-compute[71731]: </disk>
Apr 13 17:03:33 user nova-compute[71731]:  {{(pid=71731) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 17:03:33 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Received event <DeviceRemovedEvent: 1681405413.6535175, b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71731) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 13 17:03:33 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-2b0b8b64-5df5-43de-9908-06259785d76d tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c {{(pid=71731) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 13 17:03:33 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-2b0b8b64-5df5-43de-9908-06259785d76d tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Successfully detached device vdb from instance b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c from the live domain config.
Apr 13 17:03:33 user nova-compute[71731]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2b0b8b64-5df5-43de-9908-06259785d76d tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] [instance: b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c] calling os-brick to detach iSCSI Volume {{(pid=71731) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 17:03:33 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b0b8b64-5df5-43de-9908-06259785d76d tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8cf0118790>, {'target_iqn': 'iqn.2010-10.org.openstack:e13dd7bb-01d3-41fb-b768-048792640d52', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fqcKkVMe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 17:03:33 user nova-compute[71731]: WARNING os_brick.initiator.connectors.base [None req-2b0b8b64-5df5-43de-9908-06259785d76d tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 17:03:33 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-2b0b8b64-5df5-43de-9908-06259785d76d tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 17:03:33 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-2b0b8b64-5df5-43de-9908-06259785d76d tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 17:03:33 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:03:33 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:03:33 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[5028d3cd-61cf-438d-a924-a1af8648a7ab]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e13dd7bb-01d3-41fb-b768-048792640d52\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:db618723-a806-41ad-ade9-ea9a7ebbb110\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:03:33 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b0b8b64-5df5-43de-9908-06259785d76d tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 17:03:33 user nova-compute[71731]: No targets found.
Apr 13 17:03:33 user nova-compute[71731]: iSNS:
Apr 13 17:03:33 user nova-compute[71731]: No targets found.
Apr 13 17:03:33 user nova-compute[71731]: STATIC:
Apr 13 17:03:33 user nova-compute[71731]: Target: iqn.2010-10.org.openstack:e13dd7bb-01d3-41fb-b768-048792640d52
Apr 13 17:03:33 user nova-compute[71731]:         Portal: 172.16.0.220:3260,-1
Apr 13 17:03:33 user nova-compute[71731]:                 Iface Name: default
Apr 13 17:03:33 user nova-compute[71731]: Target: iqn.2010-10.org.openstack:db618723-a806-41ad-ade9-ea9a7ebbb110
Apr 13 17:03:33 user nova-compute[71731]:         Portal: 172.16.0.220:3260,-1
Apr 13 17:03:33 user nova-compute[71731]:                 Iface Name: default
Apr 13 17:03:33 user nova-compute[71731]: FIRMWARE:
Apr 13 17:03:33 user nova-compute[71731]: No targets found.
Apr 13 17:03:33 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 17:03:33 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b0b8b64-5df5-43de-9908-06259785d76d tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 17:03:33 user nova-compute[71731]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 17:03:33 user nova-compute[71731]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71731) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 17:03:33 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b0b8b64-5df5-43de-9908-06259785d76d tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e13dd7bb-01d3-41fb-b768-048792640d52', 0)] {{(pid=71731) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 17:03:33 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:03:33 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:03:33 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f38be34-5922-4039-a204-03ef9d74c242]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:db618723-a806-41ad-ade9-ea9a7ebbb110\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e13dd7bb-01d3-41fb-b768-048792640d52\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:03:33 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:03:33 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:03:33 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[65cedfbc-4907-466c-9007-4b77ba6acc0e]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e13dd7bb-01d3-41fb-b768-048792640d52 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db618723-a806-41ad-ade9-ea9a7ebbb110 (non-flash)\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:03:33 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b0b8b64-5df5-43de-9908-06259785d76d tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e13dd7bb-01d3-41fb-b768-048792640d52 (non-flash)
Apr 13 17:03:33 user nova-compute[71731]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db618723-a806-41ad-ade9-ea9a7ebbb110 (non-flash)
Apr 13 17:03:33 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 17:03:33 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b0b8b64-5df5-43de-9908-06259785d76d tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e13dd7bb-01d3-41fb-b768-048792640d52 (non-flash)
Apr 13 17:03:33 user nova-compute[71731]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db618723-a806-41ad-ade9-ea9a7ebbb110 (non-flash)
Apr 13 17:03:33 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 17:03:33 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b0b8b64-5df5-43de-9908-06259785d76d tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8cb06bca60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e13dd7bb-01d3-41fb-b768-048792640d52'): ({'sdb'}, set())}) {{(pid=71731) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 17:03:33 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-2b0b8b64-5df5-43de-9908-06259785d76d tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Removing single pathed devices sdb {{(pid=71731) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 17:03:33 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:03:33 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:03:33 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6592c9a-a296-4c9e-b0dd-ecb02e05574b]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:03:33 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:03:33 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:03:33 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c70f6a0-2449-4ed4-98c5-5d7d7b7453b3]: (4, ('ok\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:03:33 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-2b0b8b64-5df5-43de-9908-06259785d76d tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Flushing IO for device /dev/sdb {{(pid=71731) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 17:03:33 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:03:33 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:03:33 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0e4f92a-0da2-45d9-b098-189f30ca03dd]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:03:33 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-2b0b8b64-5df5-43de-9908-06259785d76d tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71731) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 17:03:33 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:03:33 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.055s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:03:33 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[727ccf55-c13d-486c-9c7a-d7bfa67a04a8]: (4, ('1', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:03:33 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-2b0b8b64-5df5-43de-9908-06259785d76d tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71731) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 17:03:33 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-2b0b8b64-5df5-43de-9908-06259785d76d tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] SCSI volumes sdb have been removed. {{(pid=71731) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 17:03:33 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b0b8b64-5df5-43de-9908-06259785d76d tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e13dd7bb-01d3-41fb-b768-048792640d52')] {{(pid=71731) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 17:03:33 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e13dd7bb-01d3-41fb-b768-048792640d52 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:03:33 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e13dd7bb-01d3-41fb-b768-048792640d52 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:03:33 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[366c01a2-3265-47ba-9caa-94997613b376]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:03:33 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b0b8b64-5df5-43de-9908-06259785d76d tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:03:33 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e13dd7bb-01d3-41fb-b768-048792640d52 -p 172.16.0.220:3260 --logout {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:03:33 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e13dd7bb-01d3-41fb-b768-048792640d52 -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:03:33 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[83284bb9-77bb-4dcb-8ba5-3a7eef4bf2aa]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:e13dd7bb-01d3-41fb-b768-048792640d52, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:e13dd7bb-01d3-41fb-b768-048792640d52, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:03:33 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b0b8b64-5df5-43de-9908-06259785d76d tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:e13dd7bb-01d3-41fb-b768-048792640d52, portal: 172.16.0.220,3260]
Apr 13 17:03:33 user nova-compute[71731]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:e13dd7bb-01d3-41fb-b768-048792640d52, portal: 172.16.0.220,3260] successful.
Apr 13 17:03:33 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:03:33 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e13dd7bb-01d3-41fb-b768-048792640d52 -p 172.16.0.220:3260 --op delete {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:03:33 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e13dd7bb-01d3-41fb-b768-048792640d52 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:03:33 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e0ce0f1-5736-4c72-a554-114ccc3a6fdc]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:03:33 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b0b8b64-5df5-43de-9908-06259785d76d tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:03:33 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-2b0b8b64-5df5-43de-9908-06259785d76d tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.318s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 17:03:33 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b0b8b64-5df5-43de-9908-06259785d76d tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] <== disconnect_volume: return (318ms) None {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 17:03:33 user nova-compute[71731]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2b0b8b64-5df5-43de-9908-06259785d76d tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] [instance: b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c] Disconnected iSCSI Volume {{(pid=71731) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 17:03:34 user nova-compute[71731]: DEBUG nova.objects.instance [None req-2b0b8b64-5df5-43de-9908-06259785d76d tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lazy-loading 'flavor' on Instance uuid b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 17:03:34 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-2b0b8b64-5df5-43de-9908-06259785d76d tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.673s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:03:37 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 17:03:37 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:03:37 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71731) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 17:03:37 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71731) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 17:03:37 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71731) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 17:03:37 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:03:40 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:03:42 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:03:42 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71731) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 17:03:42 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 17:03:42 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:03:44 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:03:46 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager.update_available_resource {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:03:46 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:03:46 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:03:46 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:03:46 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Auditing locally available compute resources for user (node: user) {{(pid=71731) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 17:03:46 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/652e59f0-b9be-4f45-bb79-2340d9564000/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:03:46 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/652e59f0-b9be-4f45-bb79-2340d9564000/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:03:46 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/652e59f0-b9be-4f45-bb79-2340d9564000/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:03:46 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/652e59f0-b9be-4f45-bb79-2340d9564000/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:03:46 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=71731) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 17:03:46 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:03:46 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:03:46 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:03:46 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:03:47 user nova-compute[71731]: WARNING nova.virt.libvirt.driver [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 17:03:47 user nova-compute[71731]: WARNING nova.virt.libvirt.driver [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 17:03:47 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Hypervisor/Node resource view: name=user free_ram=8614MB free_disk=25.994415283203125GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71731) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 17:03:47 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:03:47 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:03:47 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:03:47 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 17:03:47 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance 652e59f0-b9be-4f45-bb79-2340d9564000 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 17:03:47 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=71731) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 17:03:47 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Final resource view: name=user phys_ram=16023MB used_ram=768MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=71731) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 17:03:47 user nova-compute[71731]: DEBUG nova.compute.provider_tree [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Inventory has not changed in ProviderTree for provider: cb6b1a64-0c24-4e2d-af1e-16576ca9165c {{(pid=71731) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 17:03:47 user nova-compute[71731]: DEBUG nova.scheduler.client.report [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Inventory has not changed for provider cb6b1a64-0c24-4e2d-af1e-16576ca9165c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71731) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 17:03:47 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Compute_service record updated for user:user {{(pid=71731) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 17:03:47 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.203s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:03:49 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:03:49 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:03:49 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Starting heal instance info cache {{(pid=71731) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 17:03:49 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Didn't find any instances for network info cache update. {{(pid=71731) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 13 17:03:49 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:03:50 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:03:52 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:03:52 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 17:03:52 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:03:52 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71731) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 17:03:52 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71731) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 17:03:52 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71731) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 17:03:52 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:03:57 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 17:04:02 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 17:04:02 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 17:04:02 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71731) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 17:04:02 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71731) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 17:04:02 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71731) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 17:04:02 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:04:02 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:04:07 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:04:12 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 17:04:12 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:04:12 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71731) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 17:04:12 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71731) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 17:04:12 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71731) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 17:04:12 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:04:17 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 17:04:17 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:04:17 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71731) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 17:04:17 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71731) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 17:04:17 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71731) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 17:04:17 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:04:22 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:04:22 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:04:23 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-a4ec3d06-6499-4967-8c3b-444c9d4f04a5 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Acquiring lock "b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:04:23 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-a4ec3d06-6499-4967-8c3b-444c9d4f04a5 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:04:23 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-a4ec3d06-6499-4967-8c3b-444c9d4f04a5 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Acquiring lock "b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:04:23 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-a4ec3d06-6499-4967-8c3b-444c9d4f04a5 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:04:23 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-a4ec3d06-6499-4967-8c3b-444c9d4f04a5 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:04:23 user nova-compute[71731]: INFO nova.compute.manager [None req-a4ec3d06-6499-4967-8c3b-444c9d4f04a5 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] [instance: b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c] Terminating instance
Apr 13 17:04:23 user nova-compute[71731]: DEBUG nova.compute.manager [None req-a4ec3d06-6499-4967-8c3b-444c9d4f04a5 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] [instance: b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c] Start destroying the instance on the hypervisor. {{(pid=71731) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 17:04:23 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:04:23 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:04:23 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:04:23 user nova-compute[71731]: DEBUG nova.compute.manager [req-2adb3303-3538-46ee-9f11-b9f184300081 req-341a3028-c71a-4da3-96fb-da1476869611 service nova] [instance: b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c] Received event network-vif-unplugged-70f91af6-4a58-4b9d-a132-93537d398c24 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:04:23 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-2adb3303-3538-46ee-9f11-b9f184300081 req-341a3028-c71a-4da3-96fb-da1476869611 service nova] Acquiring lock "b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:04:23 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-2adb3303-3538-46ee-9f11-b9f184300081 req-341a3028-c71a-4da3-96fb-da1476869611 service nova] Lock "b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:04:23 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-2adb3303-3538-46ee-9f11-b9f184300081 req-341a3028-c71a-4da3-96fb-da1476869611 service nova] Lock "b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:04:23 user nova-compute[71731]: DEBUG nova.compute.manager [req-2adb3303-3538-46ee-9f11-b9f184300081 req-341a3028-c71a-4da3-96fb-da1476869611 service nova] [instance: b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c] No waiting events found dispatching network-vif-unplugged-70f91af6-4a58-4b9d-a132-93537d398c24 {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 17:04:23 user nova-compute[71731]: DEBUG nova.compute.manager [req-2adb3303-3538-46ee-9f11-b9f184300081 req-341a3028-c71a-4da3-96fb-da1476869611 service nova] [instance: b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c] Received event network-vif-unplugged-70f91af6-4a58-4b9d-a132-93537d398c24 for instance with task_state deleting. {{(pid=71731) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 17:04:24 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:04:24 user nova-compute[71731]: INFO nova.virt.libvirt.driver [-] [instance: b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c] Instance destroyed successfully.
Apr 13 17:04:24 user nova-compute[71731]: DEBUG nova.objects.instance [None req-a4ec3d06-6499-4967-8c3b-444c9d4f04a5 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lazy-loading 'resources' on Instance uuid b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 17:04:24 user nova-compute[71731]: DEBUG nova.virt.libvirt.vif [None req-a4ec3d06-6499-4967-8c3b-444c9d4f04a5 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T16:58:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-927136914',display_name='tempest-AttachVolumeNegativeTest-server-927136914',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-927136914',id=43,image_ref='708622a9-7465-4492-ade8-b827198f7e30',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDxnreQ3oNJolzetbWWAWXzlquIXNhkVGKnwbC0EAq0bWPFtp/dD5+5IVTDgaPUae2PSPpek/Lb6EaNCplv8swLuJDV95U7xYBvyFjedyTNKkhRNn1viozORpvkUgnZNmw==',key_name='tempest-keypair-812505684',keypairs=<?>,launch_index=0,launched_at=2023-04-13T16:58:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='097b15faad8249c9bf45623d0c3ab518',ramdisk_id='',reservation_id='r-tacg96f3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='708622a9-7465-4492-ade8-b827198f7e30',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-236067262',owner_user_name='tempest-AttachVolumeNegativeTest-236067262-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T16:58:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a08b0caad23045c1822cdd0b3ae0769f',uuid=b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "70f91af6-4a58-4b9d-a132-93537d398c24", "address": "fa:16:3e:fa:86:cf", "network": {"id": "436011a9-c48b-4f33-a576-a245b344dd72", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-116243831-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "097b15faad8249c9bf45623d0c3ab518", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70f91af6-4a", "ovs_interfaceid": "70f91af6-4a58-4b9d-a132-93537d398c24", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 17:04:24 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-a4ec3d06-6499-4967-8c3b-444c9d4f04a5 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Converting VIF {"id": "70f91af6-4a58-4b9d-a132-93537d398c24", "address": "fa:16:3e:fa:86:cf", "network": {"id": "436011a9-c48b-4f33-a576-a245b344dd72", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-116243831-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "097b15faad8249c9bf45623d0c3ab518", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70f91af6-4a", "ovs_interfaceid": "70f91af6-4a58-4b9d-a132-93537d398c24", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 17:04:24 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-a4ec3d06-6499-4967-8c3b-444c9d4f04a5 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fa:86:cf,bridge_name='br-int',has_traffic_filtering=True,id=70f91af6-4a58-4b9d-a132-93537d398c24,network=Network(436011a9-c48b-4f33-a576-a245b344dd72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70f91af6-4a') {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 17:04:24 user nova-compute[71731]: DEBUG os_vif [None req-a4ec3d06-6499-4967-8c3b-444c9d4f04a5 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fa:86:cf,bridge_name='br-int',has_traffic_filtering=True,id=70f91af6-4a58-4b9d-a132-93537d398c24,network=Network(436011a9-c48b-4f33-a576-a245b344dd72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70f91af6-4a') {{(pid=71731) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 17:04:24 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:04:24 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap70f91af6-4a, bridge=br-int, if_exists=True) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 17:04:24 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:04:24 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 17:04:24 user nova-compute[71731]: INFO os_vif [None req-a4ec3d06-6499-4967-8c3b-444c9d4f04a5 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fa:86:cf,bridge_name='br-int',has_traffic_filtering=True,id=70f91af6-4a58-4b9d-a132-93537d398c24,network=Network(436011a9-c48b-4f33-a576-a245b344dd72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70f91af6-4a')
Apr 13 17:04:24 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-a4ec3d06-6499-4967-8c3b-444c9d4f04a5 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] [instance: b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c] Deleting instance files /opt/stack/data/nova/instances/b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c_del
Apr 13 17:04:24 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-a4ec3d06-6499-4967-8c3b-444c9d4f04a5 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] [instance: b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c] Deletion of /opt/stack/data/nova/instances/b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c_del complete
Apr 13 17:04:24 user nova-compute[71731]: INFO nova.compute.manager [None req-a4ec3d06-6499-4967-8c3b-444c9d4f04a5 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] [instance: b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c] Took 0.85 seconds to destroy the instance on the hypervisor.
Apr 13 17:04:24 user nova-compute[71731]: DEBUG oslo.service.loopingcall [None req-a4ec3d06-6499-4967-8c3b-444c9d4f04a5 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71731) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 17:04:24 user nova-compute[71731]: DEBUG nova.compute.manager [-] [instance: b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c] Deallocating network for instance {{(pid=71731) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 17:04:24 user nova-compute[71731]: DEBUG nova.network.neutron [-] [instance: b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c] deallocate_for_instance() {{(pid=71731) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 17:04:25 user nova-compute[71731]: DEBUG nova.network.neutron [-] [instance: b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c] Updating instance_info_cache with network_info: [] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 17:04:25 user nova-compute[71731]: INFO nova.compute.manager [-] [instance: b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c] Took 0.81 seconds to deallocate network for instance.
Apr 13 17:04:25 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-a4ec3d06-6499-4967-8c3b-444c9d4f04a5 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:04:25 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-a4ec3d06-6499-4967-8c3b-444c9d4f04a5 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:04:25 user nova-compute[71731]: DEBUG nova.compute.provider_tree [None req-a4ec3d06-6499-4967-8c3b-444c9d4f04a5 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Inventory has not changed in ProviderTree for provider: cb6b1a64-0c24-4e2d-af1e-16576ca9165c {{(pid=71731) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 17:04:25 user nova-compute[71731]: DEBUG nova.scheduler.client.report [None req-a4ec3d06-6499-4967-8c3b-444c9d4f04a5 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Inventory has not changed for provider cb6b1a64-0c24-4e2d-af1e-16576ca9165c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71731) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 17:04:25 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-a4ec3d06-6499-4967-8c3b-444c9d4f04a5 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.170s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:04:25 user nova-compute[71731]: INFO nova.scheduler.client.report [None req-a4ec3d06-6499-4967-8c3b-444c9d4f04a5 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Deleted allocations for instance b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c
Apr 13 17:04:25 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-a4ec3d06-6499-4967-8c3b-444c9d4f04a5 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.010s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:04:25 user nova-compute[71731]: DEBUG nova.compute.manager [req-08aa17d1-1ec6-46f9-89e2-58fcbe4b60c2 req-abe812e4-f4a4-4f48-b094-6f8539c6dd3d service nova] [instance: b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c] Received event network-vif-plugged-70f91af6-4a58-4b9d-a132-93537d398c24 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:04:25 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-08aa17d1-1ec6-46f9-89e2-58fcbe4b60c2 req-abe812e4-f4a4-4f48-b094-6f8539c6dd3d service nova] Acquiring lock "b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:04:25 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-08aa17d1-1ec6-46f9-89e2-58fcbe4b60c2 req-abe812e4-f4a4-4f48-b094-6f8539c6dd3d service nova] Lock "b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:04:25 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-08aa17d1-1ec6-46f9-89e2-58fcbe4b60c2 req-abe812e4-f4a4-4f48-b094-6f8539c6dd3d service nova] Lock "b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:04:25 user nova-compute[71731]: DEBUG nova.compute.manager [req-08aa17d1-1ec6-46f9-89e2-58fcbe4b60c2 req-abe812e4-f4a4-4f48-b094-6f8539c6dd3d service nova] [instance: b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c] No waiting events found dispatching network-vif-plugged-70f91af6-4a58-4b9d-a132-93537d398c24 {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 17:04:25 user nova-compute[71731]: WARNING nova.compute.manager [req-08aa17d1-1ec6-46f9-89e2-58fcbe4b60c2 req-abe812e4-f4a4-4f48-b094-6f8539c6dd3d service nova] [instance: b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c] Received unexpected event network-vif-plugged-70f91af6-4a58-4b9d-a132-93537d398c24 for instance with vm_state deleted and task_state None.
Apr 13 17:04:25 user nova-compute[71731]: DEBUG nova.compute.manager [req-08aa17d1-1ec6-46f9-89e2-58fcbe4b60c2 req-abe812e4-f4a4-4f48-b094-6f8539c6dd3d service nova] [instance: b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c] Received event network-vif-deleted-70f91af6-4a58-4b9d-a132-93537d398c24 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:04:29 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:04:34 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 17:04:39 user nova-compute[71731]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681405464.2713954, b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c => Stopped> {{(pid=71731) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 17:04:39 user nova-compute[71731]: INFO nova.compute.manager [-] [instance: b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c] VM Stopped (Lifecycle Event)
Apr 13 17:04:39 user nova-compute[71731]: DEBUG nova.compute.manager [None req-dbb22ab0-1a4a-43b8-a348-a4bffcacaf3f None None] [instance: b49f78b1-2834-4a9e-91b5-90fcf8fbfc4c] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 17:04:39 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:04:39 user nova-compute[71731]: DEBUG nova.compute.manager [req-cb52e090-4660-4191-ad99-7e5377063a23 req-cdf38163-220f-4b03-8cc5-1585db9a41f9 service nova] [instance: 652e59f0-b9be-4f45-bb79-2340d9564000] Received event network-changed-6047b3aa-607c-4b10-904a-8497d9a2f82b {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:04:39 user nova-compute[71731]: DEBUG nova.compute.manager [req-cb52e090-4660-4191-ad99-7e5377063a23 req-cdf38163-220f-4b03-8cc5-1585db9a41f9 service nova] [instance: 652e59f0-b9be-4f45-bb79-2340d9564000] Refreshing instance network info cache due to event network-changed-6047b3aa-607c-4b10-904a-8497d9a2f82b. {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 17:04:39 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-cb52e090-4660-4191-ad99-7e5377063a23 req-cdf38163-220f-4b03-8cc5-1585db9a41f9 service nova] Acquiring lock "refresh_cache-652e59f0-b9be-4f45-bb79-2340d9564000" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 17:04:39 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-cb52e090-4660-4191-ad99-7e5377063a23 req-cdf38163-220f-4b03-8cc5-1585db9a41f9 service nova] Acquired lock "refresh_cache-652e59f0-b9be-4f45-bb79-2340d9564000" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 17:04:39 user nova-compute[71731]: DEBUG nova.network.neutron [req-cb52e090-4660-4191-ad99-7e5377063a23 req-cdf38163-220f-4b03-8cc5-1585db9a41f9 service nova] [instance: 652e59f0-b9be-4f45-bb79-2340d9564000] Refreshing network info cache for port 6047b3aa-607c-4b10-904a-8497d9a2f82b {{(pid=71731) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 17:04:40 user nova-compute[71731]: DEBUG nova.network.neutron [req-cb52e090-4660-4191-ad99-7e5377063a23 req-cdf38163-220f-4b03-8cc5-1585db9a41f9 service nova] [instance: 652e59f0-b9be-4f45-bb79-2340d9564000] Updated VIF entry in instance network info cache for port 6047b3aa-607c-4b10-904a-8497d9a2f82b. {{(pid=71731) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 17:04:40 user nova-compute[71731]: DEBUG nova.network.neutron [req-cb52e090-4660-4191-ad99-7e5377063a23 req-cdf38163-220f-4b03-8cc5-1585db9a41f9 service nova] [instance: 652e59f0-b9be-4f45-bb79-2340d9564000] Updating instance_info_cache with network_info: [{"id": "6047b3aa-607c-4b10-904a-8497d9a2f82b", "address": "fa:16:3e:0e:ca:10", "network": {"id": "0c6a5f46-e53b-4b4c-806e-b2617ba3ef35", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1984894004-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7edf468527d84954a943bb4c1f7ff54d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6047b3aa-60", "ovs_interfaceid": "6047b3aa-607c-4b10-904a-8497d9a2f82b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 17:04:40 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-cb52e090-4660-4191-ad99-7e5377063a23 req-cdf38163-220f-4b03-8cc5-1585db9a41f9 service nova] Releasing lock "refresh_cache-652e59f0-b9be-4f45-bb79-2340d9564000" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 17:04:40 user nova-compute[71731]: DEBUG nova.compute.manager [req-0d3ac174-bcd6-468d-80dc-b95a3d009747 req-834502ba-9089-4531-8834-f3144839ecd2 service nova] [instance: 652e59f0-b9be-4f45-bb79-2340d9564000] Received event network-changed-6047b3aa-607c-4b10-904a-8497d9a2f82b {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:04:40 user nova-compute[71731]: DEBUG nova.compute.manager [req-0d3ac174-bcd6-468d-80dc-b95a3d009747 req-834502ba-9089-4531-8834-f3144839ecd2 service nova] [instance: 652e59f0-b9be-4f45-bb79-2340d9564000] Refreshing instance network info cache due to event network-changed-6047b3aa-607c-4b10-904a-8497d9a2f82b. {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 17:04:40 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-0d3ac174-bcd6-468d-80dc-b95a3d009747 req-834502ba-9089-4531-8834-f3144839ecd2 service nova] Acquiring lock "refresh_cache-652e59f0-b9be-4f45-bb79-2340d9564000" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 17:04:40 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-0d3ac174-bcd6-468d-80dc-b95a3d009747 req-834502ba-9089-4531-8834-f3144839ecd2 service nova] Acquired lock "refresh_cache-652e59f0-b9be-4f45-bb79-2340d9564000" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 17:04:40 user nova-compute[71731]: DEBUG nova.network.neutron [req-0d3ac174-bcd6-468d-80dc-b95a3d009747 req-834502ba-9089-4531-8834-f3144839ecd2 service nova] [instance: 652e59f0-b9be-4f45-bb79-2340d9564000] Refreshing network info cache for port 6047b3aa-607c-4b10-904a-8497d9a2f82b {{(pid=71731) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 17:04:41 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:04:41 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-2c850e83-1929-4ab2-8560-08976bf75d0e tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Acquiring lock "652e59f0-b9be-4f45-bb79-2340d9564000" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:04:41 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-2c850e83-1929-4ab2-8560-08976bf75d0e tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lock "652e59f0-b9be-4f45-bb79-2340d9564000" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:04:41 user nova-compute[71731]: INFO nova.compute.manager [None req-2c850e83-1929-4ab2-8560-08976bf75d0e tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] [instance: 652e59f0-b9be-4f45-bb79-2340d9564000] Detaching volume db618723-a806-41ad-ade9-ea9a7ebbb110
Apr 13 17:04:41 user nova-compute[71731]: INFO nova.virt.block_device [None req-2c850e83-1929-4ab2-8560-08976bf75d0e tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] [instance: 652e59f0-b9be-4f45-bb79-2340d9564000] Attempting to driver detach volume db618723-a806-41ad-ade9-ea9a7ebbb110 from mountpoint /dev/vdb
Apr 13 17:04:41 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-2c850e83-1929-4ab2-8560-08976bf75d0e tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Attempting to detach device vdb from instance 652e59f0-b9be-4f45-bb79-2340d9564000 from the persistent domain config. {{(pid=71731) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 13 17:04:41 user nova-compute[71731]: DEBUG nova.virt.libvirt.guest [None req-2c850e83-1929-4ab2-8560-08976bf75d0e tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 17:04:41 user nova-compute[71731]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 17:04:41 user nova-compute[71731]:   <source dev="/dev/sdc"/>
Apr 13 17:04:41 user nova-compute[71731]:   <target dev="vdb" bus="virtio"/>
Apr 13 17:04:41 user nova-compute[71731]:   <serial>db618723-a806-41ad-ade9-ea9a7ebbb110</serial>
Apr 13 17:04:41 user nova-compute[71731]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 13 17:04:41 user nova-compute[71731]: </disk>
Apr 13 17:04:41 user nova-compute[71731]:  {{(pid=71731) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 17:04:41 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-2c850e83-1929-4ab2-8560-08976bf75d0e tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Successfully detached device vdb from instance 652e59f0-b9be-4f45-bb79-2340d9564000 from the persistent domain config.
Apr 13 17:04:41 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-2c850e83-1929-4ab2-8560-08976bf75d0e tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 652e59f0-b9be-4f45-bb79-2340d9564000 from the live domain config. {{(pid=71731) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 13 17:04:41 user nova-compute[71731]: DEBUG nova.virt.libvirt.guest [None req-2c850e83-1929-4ab2-8560-08976bf75d0e tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 17:04:41 user nova-compute[71731]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 17:04:41 user nova-compute[71731]:   <source dev="/dev/sdc"/>
Apr 13 17:04:41 user nova-compute[71731]:   <target dev="vdb" bus="virtio"/>
Apr 13 17:04:41 user nova-compute[71731]:   <serial>db618723-a806-41ad-ade9-ea9a7ebbb110</serial>
Apr 13 17:04:41 user nova-compute[71731]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 13 17:04:41 user nova-compute[71731]: </disk>
Apr 13 17:04:41 user nova-compute[71731]:  {{(pid=71731) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 17:04:41 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Received event <DeviceRemovedEvent: 1681405481.5759861, 652e59f0-b9be-4f45-bb79-2340d9564000 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71731) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 13 17:04:41 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-2c850e83-1929-4ab2-8560-08976bf75d0e tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 652e59f0-b9be-4f45-bb79-2340d9564000 {{(pid=71731) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 13 17:04:41 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-2c850e83-1929-4ab2-8560-08976bf75d0e tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Successfully detached device vdb from instance 652e59f0-b9be-4f45-bb79-2340d9564000 from the live domain config.
Apr 13 17:04:41 user nova-compute[71731]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2c850e83-1929-4ab2-8560-08976bf75d0e tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] [instance: 652e59f0-b9be-4f45-bb79-2340d9564000] calling os-brick to detach iSCSI Volume {{(pid=71731) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 17:04:41 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c850e83-1929-4ab2-8560-08976bf75d0e tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8cf0118790>, {'target_iqn': 'iqn.2010-10.org.openstack:db618723-a806-41ad-ade9-ea9a7ebbb110', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RYSZgQMj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 17:04:41 user nova-compute[71731]: WARNING os_brick.initiator.connectors.base [None req-2c850e83-1929-4ab2-8560-08976bf75d0e tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 17:04:41 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-2c850e83-1929-4ab2-8560-08976bf75d0e tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 17:04:41 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-2c850e83-1929-4ab2-8560-08976bf75d0e tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 17:04:41 user nova-compute[71731]: DEBUG nova.network.neutron [req-0d3ac174-bcd6-468d-80dc-b95a3d009747 req-834502ba-9089-4531-8834-f3144839ecd2 service nova] [instance: 652e59f0-b9be-4f45-bb79-2340d9564000] Updated VIF entry in instance network info cache for port 6047b3aa-607c-4b10-904a-8497d9a2f82b. {{(pid=71731) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 17:04:41 user nova-compute[71731]: DEBUG nova.network.neutron [req-0d3ac174-bcd6-468d-80dc-b95a3d009747 req-834502ba-9089-4531-8834-f3144839ecd2 service nova] [instance: 652e59f0-b9be-4f45-bb79-2340d9564000] Updating instance_info_cache with network_info: [{"id": "6047b3aa-607c-4b10-904a-8497d9a2f82b", "address": "fa:16:3e:0e:ca:10", "network": {"id": "0c6a5f46-e53b-4b4c-806e-b2617ba3ef35", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1984894004-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7edf468527d84954a943bb4c1f7ff54d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6047b3aa-60", "ovs_interfaceid": "6047b3aa-607c-4b10-904a-8497d9a2f82b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 17:04:41 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:04:41 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-0d3ac174-bcd6-468d-80dc-b95a3d009747 req-834502ba-9089-4531-8834-f3144839ecd2 service nova] Releasing lock "refresh_cache-652e59f0-b9be-4f45-bb79-2340d9564000" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 17:04:41 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:04:41 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[7046cfba-0691-40b4-a718-e0b808419196]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:db618723-a806-41ad-ade9-ea9a7ebbb110\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:04:41 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c850e83-1929-4ab2-8560-08976bf75d0e tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 17:04:41 user nova-compute[71731]: No targets found.
Apr 13 17:04:41 user nova-compute[71731]: iSNS:
Apr 13 17:04:41 user nova-compute[71731]: No targets found.
Apr 13 17:04:41 user nova-compute[71731]: STATIC:
Apr 13 17:04:41 user nova-compute[71731]: Target: iqn.2010-10.org.openstack:db618723-a806-41ad-ade9-ea9a7ebbb110
Apr 13 17:04:41 user nova-compute[71731]:         Portal: 172.16.0.220:3260,-1
Apr 13 17:04:41 user nova-compute[71731]:                 Iface Name: default
Apr 13 17:04:41 user nova-compute[71731]: FIRMWARE:
Apr 13 17:04:41 user nova-compute[71731]: No targets found.
Apr 13 17:04:41 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 17:04:41 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c850e83-1929-4ab2-8560-08976bf75d0e tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 17:04:41 user nova-compute[71731]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 17:04:41 user nova-compute[71731]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71731) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 17:04:41 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c850e83-1929-4ab2-8560-08976bf75d0e tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:db618723-a806-41ad-ade9-ea9a7ebbb110', 0)] {{(pid=71731) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 17:04:41 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:04:41 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:04:41 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[507ca49e-7e20-4b3a-9b29-66b6722c83dc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:db618723-a806-41ad-ade9-ea9a7ebbb110\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:04:41 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:04:41 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:04:41 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[18e0b56f-4cf7-4493-ba2b-a886fb0ca97b]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db618723-a806-41ad-ade9-ea9a7ebbb110 (non-flash)\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:04:41 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c850e83-1929-4ab2-8560-08976bf75d0e tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db618723-a806-41ad-ade9-ea9a7ebbb110 (non-flash)
Apr 13 17:04:41 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 17:04:41 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c850e83-1929-4ab2-8560-08976bf75d0e tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db618723-a806-41ad-ade9-ea9a7ebbb110 (non-flash)
Apr 13 17:04:41 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 17:04:41 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c850e83-1929-4ab2-8560-08976bf75d0e tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8cd023d000>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:db618723-a806-41ad-ade9-ea9a7ebbb110'): ({'sdc'}, set())}) {{(pid=71731) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 17:04:41 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-2c850e83-1929-4ab2-8560-08976bf75d0e tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Removing single pathed devices sdc {{(pid=71731) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 17:04:41 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:04:41 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:04:41 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[b14b274b-bb13-484c-af53-e3b65d25ddba]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:04:41 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:04:41 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:04:41 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d44cc4a-3664-463b-805b-3b9d125b2478]: (4, ('ok\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:04:41 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-2c850e83-1929-4ab2-8560-08976bf75d0e tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Flushing IO for device /dev/sdc {{(pid=71731) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 17:04:41 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:04:41 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:04:41 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeb7e7d7-b61c-455c-be26-e5a7cb7dff21]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:04:41 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-2c850e83-1929-4ab2-8560-08976bf75d0e tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71731) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 17:04:41 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:04:41 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.053s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:04:41 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[c14dc279-f13a-42c4-b0e6-fc4dc3b9c0e3]: (4, ('1', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:04:41 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-2c850e83-1929-4ab2-8560-08976bf75d0e tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71731) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 17:04:41 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-2c850e83-1929-4ab2-8560-08976bf75d0e tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] SCSI volumes sdc have been removed. {{(pid=71731) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 17:04:41 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c850e83-1929-4ab2-8560-08976bf75d0e tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:db618723-a806-41ad-ade9-ea9a7ebbb110')] {{(pid=71731) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 17:04:41 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db618723-a806-41ad-ade9-ea9a7ebbb110 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:04:41 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db618723-a806-41ad-ade9-ea9a7ebbb110 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:04:41 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[48fd6daf-93f6-474e-afa3-67370f9f5acc]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:04:41 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c850e83-1929-4ab2-8560-08976bf75d0e tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:04:41 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db618723-a806-41ad-ade9-ea9a7ebbb110 -p 172.16.0.220:3260 --logout {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:04:41 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db618723-a806-41ad-ade9-ea9a7ebbb110 -p 172.16.0.220:3260 --logout" returned: 0 in 0.046s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:04:41 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[ece90a3f-a287-4923-a9ac-1a100167a375]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:db618723-a806-41ad-ade9-ea9a7ebbb110, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:db618723-a806-41ad-ade9-ea9a7ebbb110, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:04:41 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c850e83-1929-4ab2-8560-08976bf75d0e tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:db618723-a806-41ad-ade9-ea9a7ebbb110, portal: 172.16.0.220,3260]
Apr 13 17:04:41 user nova-compute[71731]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:db618723-a806-41ad-ade9-ea9a7ebbb110, portal: 172.16.0.220,3260] successful.
Apr 13 17:04:41 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:04:41 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db618723-a806-41ad-ade9-ea9a7ebbb110 -p 172.16.0.220:3260 --op delete {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:04:41 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db618723-a806-41ad-ade9-ea9a7ebbb110 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:04:41 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[e66939db-e9ad-4778-b66c-94b45229acc0]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:04:41 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c850e83-1929-4ab2-8560-08976bf75d0e tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:04:41 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-2c850e83-1929-4ab2-8560-08976bf75d0e tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.290s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 17:04:41 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c850e83-1929-4ab2-8560-08976bf75d0e tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] <== disconnect_volume: return (292ms) None {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 17:04:41 user nova-compute[71731]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2c850e83-1929-4ab2-8560-08976bf75d0e tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] [instance: 652e59f0-b9be-4f45-bb79-2340d9564000] Disconnected iSCSI Volume {{(pid=71731) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 17:04:42 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:04:42 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71731) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 17:04:42 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:04:42 user nova-compute[71731]: DEBUG nova.objects.instance [None req-2c850e83-1929-4ab2-8560-08976bf75d0e tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lazy-loading 'flavor' on Instance uuid 652e59f0-b9be-4f45-bb79-2340d9564000 {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 17:04:42 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-2c850e83-1929-4ab2-8560-08976bf75d0e tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lock "652e59f0-b9be-4f45-bb79-2340d9564000" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.654s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:04:44 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:04:46 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:04:46 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager.update_available_resource {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:04:46 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:04:46 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:04:46 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:04:46 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Auditing locally available compute resources for user (node: user) {{(pid=71731) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 17:04:46 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/652e59f0-b9be-4f45-bb79-2340d9564000/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:04:46 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/652e59f0-b9be-4f45-bb79-2340d9564000/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:04:46 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/652e59f0-b9be-4f45-bb79-2340d9564000/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:04:46 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/652e59f0-b9be-4f45-bb79-2340d9564000/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:04:46 user nova-compute[71731]: WARNING nova.virt.libvirt.driver [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 17:04:46 user nova-compute[71731]: WARNING nova.virt.libvirt.driver [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 17:04:46 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Hypervisor/Node resource view: name=user free_ram=8700MB free_disk=26.013229370117188GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71731) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 17:04:46 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:04:46 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:04:46 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance 652e59f0-b9be-4f45-bb79-2340d9564000 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 17:04:46 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=71731) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 17:04:46 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=71731) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 17:04:46 user nova-compute[71731]: DEBUG nova.compute.provider_tree [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Inventory has not changed in ProviderTree for provider: cb6b1a64-0c24-4e2d-af1e-16576ca9165c {{(pid=71731) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 17:04:46 user nova-compute[71731]: DEBUG nova.scheduler.client.report [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Inventory has not changed for provider cb6b1a64-0c24-4e2d-af1e-16576ca9165c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71731) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 17:04:46 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Compute_service record updated for user:user {{(pid=71731) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 17:04:46 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.199s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:04:47 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:04:49 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:04:49 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:04:50 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:04:51 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:04:51 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Starting heal instance info cache {{(pid=71731) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 17:04:51 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Rebuilding the list of instances to heal {{(pid=71731) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 13 17:04:51 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Acquiring lock "refresh_cache-652e59f0-b9be-4f45-bb79-2340d9564000" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 17:04:51 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Acquired lock "refresh_cache-652e59f0-b9be-4f45-bb79-2340d9564000" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 17:04:51 user nova-compute[71731]: DEBUG nova.network.neutron [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] [instance: 652e59f0-b9be-4f45-bb79-2340d9564000] Forcefully refreshing network info cache for instance {{(pid=71731) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 17:04:51 user nova-compute[71731]: DEBUG nova.objects.instance [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lazy-loading 'info_cache' on Instance uuid 652e59f0-b9be-4f45-bb79-2340d9564000 {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 17:04:51 user nova-compute[71731]: DEBUG nova.network.neutron [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] [instance: 652e59f0-b9be-4f45-bb79-2340d9564000] Updating instance_info_cache with network_info: [{"id": "6047b3aa-607c-4b10-904a-8497d9a2f82b", "address": "fa:16:3e:0e:ca:10", "network": {"id": "0c6a5f46-e53b-4b4c-806e-b2617ba3ef35", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1984894004-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7edf468527d84954a943bb4c1f7ff54d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6047b3aa-60", "ovs_interfaceid": "6047b3aa-607c-4b10-904a-8497d9a2f82b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 17:04:51 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Releasing lock "refresh_cache-652e59f0-b9be-4f45-bb79-2340d9564000" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 17:04:51 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] [instance: 652e59f0-b9be-4f45-bb79-2340d9564000] Updated the network info_cache for instance {{(pid=71731) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 17:04:51 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:04:52 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:04:54 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 17:04:59 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 17:05:04 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 17:05:06 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:05:09 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 17:05:14 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 17:05:16 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-9f0e305b-6ad7-4fcd-9abe-426524d791c7 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Acquiring lock "ae339f64-b90f-4399-baa5-1ad1e5051593" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:05:16 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-9f0e305b-6ad7-4fcd-9abe-426524d791c7 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "ae339f64-b90f-4399-baa5-1ad1e5051593" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:05:16 user nova-compute[71731]: DEBUG nova.compute.manager [None req-9f0e305b-6ad7-4fcd-9abe-426524d791c7 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] [instance: ae339f64-b90f-4399-baa5-1ad1e5051593] Starting instance... {{(pid=71731) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 17:05:17 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-9f0e305b-6ad7-4fcd-9abe-426524d791c7 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:05:17 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-9f0e305b-6ad7-4fcd-9abe-426524d791c7 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:05:17 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-9f0e305b-6ad7-4fcd-9abe-426524d791c7 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71731) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 17:05:17 user nova-compute[71731]: INFO nova.compute.claims [None req-9f0e305b-6ad7-4fcd-9abe-426524d791c7 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] [instance: ae339f64-b90f-4399-baa5-1ad1e5051593] Claim successful on node user
Apr 13 17:05:17 user nova-compute[71731]: DEBUG nova.compute.provider_tree [None req-9f0e305b-6ad7-4fcd-9abe-426524d791c7 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Inventory has not changed in ProviderTree for provider: cb6b1a64-0c24-4e2d-af1e-16576ca9165c {{(pid=71731) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 17:05:17 user nova-compute[71731]: DEBUG nova.scheduler.client.report [None req-9f0e305b-6ad7-4fcd-9abe-426524d791c7 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Inventory has not changed for provider cb6b1a64-0c24-4e2d-af1e-16576ca9165c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71731) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 17:05:17 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-9f0e305b-6ad7-4fcd-9abe-426524d791c7 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.250s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:05:17 user nova-compute[71731]: DEBUG nova.compute.manager [None req-9f0e305b-6ad7-4fcd-9abe-426524d791c7 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] [instance: ae339f64-b90f-4399-baa5-1ad1e5051593] Start building networks asynchronously for instance. {{(pid=71731) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 17:05:17 user nova-compute[71731]: DEBUG nova.compute.manager [None req-9f0e305b-6ad7-4fcd-9abe-426524d791c7 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] [instance: ae339f64-b90f-4399-baa5-1ad1e5051593] Allocating IP information in the background. {{(pid=71731) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 17:05:17 user nova-compute[71731]: DEBUG nova.network.neutron [None req-9f0e305b-6ad7-4fcd-9abe-426524d791c7 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] [instance: ae339f64-b90f-4399-baa5-1ad1e5051593] allocate_for_instance() {{(pid=71731) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 17:05:17 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-9f0e305b-6ad7-4fcd-9abe-426524d791c7 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] [instance: ae339f64-b90f-4399-baa5-1ad1e5051593] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 17:05:17 user nova-compute[71731]: DEBUG nova.compute.manager [None req-9f0e305b-6ad7-4fcd-9abe-426524d791c7 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] [instance: ae339f64-b90f-4399-baa5-1ad1e5051593] Start building block device mappings for instance. {{(pid=71731) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 17:05:17 user nova-compute[71731]: DEBUG nova.policy [None req-9f0e305b-6ad7-4fcd-9abe-426524d791c7 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a08b0caad23045c1822cdd0b3ae0769f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097b15faad8249c9bf45623d0c3ab518', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71731) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 17:05:17 user nova-compute[71731]: DEBUG nova.compute.manager [None req-9f0e305b-6ad7-4fcd-9abe-426524d791c7 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] [instance: ae339f64-b90f-4399-baa5-1ad1e5051593] Start spawning the instance on the hypervisor. {{(pid=71731) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 17:05:17 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-9f0e305b-6ad7-4fcd-9abe-426524d791c7 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] [instance: ae339f64-b90f-4399-baa5-1ad1e5051593] Creating instance directory {{(pid=71731) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 17:05:17 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-9f0e305b-6ad7-4fcd-9abe-426524d791c7 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] [instance: ae339f64-b90f-4399-baa5-1ad1e5051593] Creating image(s)
Apr 13 17:05:17 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-9f0e305b-6ad7-4fcd-9abe-426524d791c7 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Acquiring lock "/opt/stack/data/nova/instances/ae339f64-b90f-4399-baa5-1ad1e5051593/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:05:17 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-9f0e305b-6ad7-4fcd-9abe-426524d791c7 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "/opt/stack/data/nova/instances/ae339f64-b90f-4399-baa5-1ad1e5051593/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:05:17 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-9f0e305b-6ad7-4fcd-9abe-426524d791c7 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "/opt/stack/data/nova/instances/ae339f64-b90f-4399-baa5-1ad1e5051593/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:05:17 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-9f0e305b-6ad7-4fcd-9abe-426524d791c7 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279 --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:05:17 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-9f0e305b-6ad7-4fcd-9abe-426524d791c7 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279 --force-share --output=json" returned: 0 in 0.137s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:05:17 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-9f0e305b-6ad7-4fcd-9abe-426524d791c7 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Acquiring lock "9524227dd898575c3099d3976f096cd935414279" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:05:17 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-9f0e305b-6ad7-4fcd-9abe-426524d791c7 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "9524227dd898575c3099d3976f096cd935414279" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:05:17 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-9f0e305b-6ad7-4fcd-9abe-426524d791c7 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279 --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:05:17 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-9f0e305b-6ad7-4fcd-9abe-426524d791c7 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279 --force-share --output=json" returned: 0 in 0.145s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:05:17 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-9f0e305b-6ad7-4fcd-9abe-426524d791c7 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279,backing_fmt=raw /opt/stack/data/nova/instances/ae339f64-b90f-4399-baa5-1ad1e5051593/disk 1073741824 {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:05:17 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-9f0e305b-6ad7-4fcd-9abe-426524d791c7 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279,backing_fmt=raw /opt/stack/data/nova/instances/ae339f64-b90f-4399-baa5-1ad1e5051593/disk 1073741824" returned: 0 in 0.050s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:05:17 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-9f0e305b-6ad7-4fcd-9abe-426524d791c7 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "9524227dd898575c3099d3976f096cd935414279" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.202s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:05:17 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-9f0e305b-6ad7-4fcd-9abe-426524d791c7 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279 --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:05:17 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-9f0e305b-6ad7-4fcd-9abe-426524d791c7 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279 --force-share --output=json" returned: 0 in 0.135s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:05:17 user nova-compute[71731]: DEBUG nova.virt.disk.api [None req-9f0e305b-6ad7-4fcd-9abe-426524d791c7 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ae339f64-b90f-4399-baa5-1ad1e5051593/disk. size=1073741824 {{(pid=71731) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 17:05:17 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-9f0e305b-6ad7-4fcd-9abe-426524d791c7 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae339f64-b90f-4399-baa5-1ad1e5051593/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:05:18 user nova-compute[71731]: DEBUG nova.network.neutron [None req-9f0e305b-6ad7-4fcd-9abe-426524d791c7 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] [instance: ae339f64-b90f-4399-baa5-1ad1e5051593] Successfully created port: 99071c3f-4bc5-47e9-9427-4ed6114e40a5 {{(pid=71731) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 17:05:18 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-9f0e305b-6ad7-4fcd-9abe-426524d791c7 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae339f64-b90f-4399-baa5-1ad1e5051593/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:05:18 user nova-compute[71731]: DEBUG nova.virt.disk.api [None req-9f0e305b-6ad7-4fcd-9abe-426524d791c7 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Cannot resize image /opt/stack/data/nova/instances/ae339f64-b90f-4399-baa5-1ad1e5051593/disk to a smaller size. {{(pid=71731) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 17:05:18 user nova-compute[71731]: DEBUG nova.objects.instance [None req-9f0e305b-6ad7-4fcd-9abe-426524d791c7 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lazy-loading 'migration_context' on Instance uuid ae339f64-b90f-4399-baa5-1ad1e5051593 {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 17:05:18 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-9f0e305b-6ad7-4fcd-9abe-426524d791c7 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] [instance: ae339f64-b90f-4399-baa5-1ad1e5051593] Created local disks {{(pid=71731) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 17:05:18 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-9f0e305b-6ad7-4fcd-9abe-426524d791c7 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] [instance: ae339f64-b90f-4399-baa5-1ad1e5051593] Ensure instance console log exists: /opt/stack/data/nova/instances/ae339f64-b90f-4399-baa5-1ad1e5051593/console.log {{(pid=71731) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 17:05:18 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-9f0e305b-6ad7-4fcd-9abe-426524d791c7 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:05:18 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-9f0e305b-6ad7-4fcd-9abe-426524d791c7 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:05:18 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-9f0e305b-6ad7-4fcd-9abe-426524d791c7 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:05:18 user nova-compute[71731]: DEBUG nova.network.neutron [None req-9f0e305b-6ad7-4fcd-9abe-426524d791c7 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] [instance: ae339f64-b90f-4399-baa5-1ad1e5051593] Successfully updated port: 99071c3f-4bc5-47e9-9427-4ed6114e40a5 {{(pid=71731) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 17:05:18 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-9f0e305b-6ad7-4fcd-9abe-426524d791c7 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Acquiring lock "refresh_cache-ae339f64-b90f-4399-baa5-1ad1e5051593" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 17:05:18 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-9f0e305b-6ad7-4fcd-9abe-426524d791c7 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Acquired lock "refresh_cache-ae339f64-b90f-4399-baa5-1ad1e5051593" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 17:05:18 user nova-compute[71731]: DEBUG nova.network.neutron [None req-9f0e305b-6ad7-4fcd-9abe-426524d791c7 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] [instance: ae339f64-b90f-4399-baa5-1ad1e5051593] Building network info cache for instance {{(pid=71731) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 17:05:18 user nova-compute[71731]: DEBUG nova.compute.manager [req-8e8e6ca1-c0b1-4cb7-9fc0-14a361f9001d req-55fbd175-8a98-4f8d-bbff-ff3375116021 service nova] [instance: ae339f64-b90f-4399-baa5-1ad1e5051593] Received event network-changed-99071c3f-4bc5-47e9-9427-4ed6114e40a5 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:05:18 user nova-compute[71731]: DEBUG nova.compute.manager [req-8e8e6ca1-c0b1-4cb7-9fc0-14a361f9001d req-55fbd175-8a98-4f8d-bbff-ff3375116021 service nova] [instance: ae339f64-b90f-4399-baa5-1ad1e5051593] Refreshing instance network info cache due to event network-changed-99071c3f-4bc5-47e9-9427-4ed6114e40a5. {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 17:05:18 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-8e8e6ca1-c0b1-4cb7-9fc0-14a361f9001d req-55fbd175-8a98-4f8d-bbff-ff3375116021 service nova] Acquiring lock "refresh_cache-ae339f64-b90f-4399-baa5-1ad1e5051593" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 17:05:18 user nova-compute[71731]: DEBUG nova.network.neutron [None req-9f0e305b-6ad7-4fcd-9abe-426524d791c7 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] [instance: ae339f64-b90f-4399-baa5-1ad1e5051593] Instance cache missing network info. {{(pid=71731) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 17:05:19 user nova-compute[71731]: DEBUG nova.network.neutron [None req-9f0e305b-6ad7-4fcd-9abe-426524d791c7 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] [instance: ae339f64-b90f-4399-baa5-1ad1e5051593] Updating instance_info_cache with network_info: [{"id": "99071c3f-4bc5-47e9-9427-4ed6114e40a5", "address": "fa:16:3e:4f:9a:a9", "network": {"id": "436011a9-c48b-4f33-a576-a245b344dd72", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-116243831-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "097b15faad8249c9bf45623d0c3ab518", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99071c3f-4b", "ovs_interfaceid": "99071c3f-4bc5-47e9-9427-4ed6114e40a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 17:05:19 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-9f0e305b-6ad7-4fcd-9abe-426524d791c7 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Releasing lock "refresh_cache-ae339f64-b90f-4399-baa5-1ad1e5051593" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 17:05:19 user nova-compute[71731]: DEBUG nova.compute.manager [None req-9f0e305b-6ad7-4fcd-9abe-426524d791c7 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] [instance: ae339f64-b90f-4399-baa5-1ad1e5051593] Instance network_info: |[{"id": "99071c3f-4bc5-47e9-9427-4ed6114e40a5", "address": "fa:16:3e:4f:9a:a9", "network": {"id": "436011a9-c48b-4f33-a576-a245b344dd72", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-116243831-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "097b15faad8249c9bf45623d0c3ab518", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99071c3f-4b", "ovs_interfaceid": "99071c3f-4bc5-47e9-9427-4ed6114e40a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71731) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 17:05:19 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-8e8e6ca1-c0b1-4cb7-9fc0-14a361f9001d req-55fbd175-8a98-4f8d-bbff-ff3375116021 service nova] Acquired lock "refresh_cache-ae339f64-b90f-4399-baa5-1ad1e5051593" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 17:05:19 user nova-compute[71731]: DEBUG nova.network.neutron [req-8e8e6ca1-c0b1-4cb7-9fc0-14a361f9001d req-55fbd175-8a98-4f8d-bbff-ff3375116021 service nova] [instance: ae339f64-b90f-4399-baa5-1ad1e5051593] Refreshing network info cache for port 99071c3f-4bc5-47e9-9427-4ed6114e40a5 {{(pid=71731) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 17:05:19 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-9f0e305b-6ad7-4fcd-9abe-426524d791c7 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] [instance: ae339f64-b90f-4399-baa5-1ad1e5051593] Start _get_guest_xml network_info=[{"id": "99071c3f-4bc5-47e9-9427-4ed6114e40a5", "address": "fa:16:3e:4f:9a:a9", "network": {"id": "436011a9-c48b-4f33-a576-a245b344dd72", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-116243831-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "097b15faad8249c9bf45623d0c3ab518", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99071c3f-4b", "ovs_interfaceid": "99071c3f-4bc5-47e9-9427-4ed6114e40a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T16:16:31Z,direct_url=<?>,disk_format='qcow2',id=708622a9-7465-4492-ade8-b827198f7e30,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='0b29a975c552465aba0ac7d6288434bd',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T16:16:33Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'device_type': 'disk', 'encrypted': False, 'disk_bus': 'virtio', 'guest_format': None, 'encryption_options': None, 'image_id': '708622a9-7465-4492-ade8-b827198f7e30'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71731) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 17:05:19 user nova-compute[71731]: WARNING nova.virt.libvirt.driver [None req-9f0e305b-6ad7-4fcd-9abe-426524d791c7 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 17:05:19 user nova-compute[71731]: WARNING nova.virt.libvirt.driver [None req-9f0e305b-6ad7-4fcd-9abe-426524d791c7 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 17:05:19 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-9f0e305b-6ad7-4fcd-9abe-426524d791c7 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71731) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 17:05:19 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-9f0e305b-6ad7-4fcd-9abe-426524d791c7 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T16:17:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T16:16:31Z,direct_url=<?>,disk_format='qcow2',id=708622a9-7465-4492-ade8-b827198f7e30,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='0b29a975c552465aba0ac7d6288434bd',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T16:16:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 17:05:19 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-9f0e305b-6ad7-4fcd-9abe-426524d791c7 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Flavor limits 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 17:05:19 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-9f0e305b-6ad7-4fcd-9abe-426524d791c7 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Image limits 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 17:05:19 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-9f0e305b-6ad7-4fcd-9abe-426524d791c7 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Flavor pref 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 17:05:19 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-9f0e305b-6ad7-4fcd-9abe-426524d791c7 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Image pref 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 17:05:19 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-9f0e305b-6ad7-4fcd-9abe-426524d791c7 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 17:05:19 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-9f0e305b-6ad7-4fcd-9abe-426524d791c7 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 17:05:19 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-9f0e305b-6ad7-4fcd-9abe-426524d791c7 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71731) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 17:05:19 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-9f0e305b-6ad7-4fcd-9abe-426524d791c7 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Got 1 possible topologies {{(pid=71731) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 17:05:19 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-9f0e305b-6ad7-4fcd-9abe-426524d791c7 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 17:05:19 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-9f0e305b-6ad7-4fcd-9abe-426524d791c7 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 17:05:19 user nova-compute[71731]: DEBUG nova.virt.libvirt.vif [None req-9f0e305b-6ad7-4fcd-9abe-426524d791c7 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T17:05:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-2098457470',display_name='tempest-AttachVolumeNegativeTest-server-2098457470',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-2098457470',id=46,image_ref='708622a9-7465-4492-ade8-b827198f7e30',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBESykv5tW83kHbwBGFQOvSCy+ICNt4W0TQ1jPtqTWGBoErb8Q7X135LOLGGhPK3SnAx4kT7bpNF/X4w5BBRqCpxWFXGF/m9Ir1Ke1mquI92zdi2E1wCJREcaMQNLTOTvVw==',key_name='tempest-keypair-1795442799',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='097b15faad8249c9bf45623d0c3ab518',ramdisk_id='',reservation_id='r-xr7qbflx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='708622a9-7465-4492-ade8-b827198f7e30',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-236067262',owner_user_name='tempest-AttachVolumeNegativeTest-236067262-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T17:05:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a08b0caad23045c1822cdd0b3ae0769f',uuid=ae339f64-b90f-4399-baa5-1ad1e5051593,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "99071c3f-4bc5-47e9-9427-4ed6114e40a5", "address": "fa:16:3e:4f:9a:a9", "network": {"id": "436011a9-c48b-4f33-a576-a245b344dd72", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-116243831-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "097b15faad8249c9bf45623d0c3ab518", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99071c3f-4b", "ovs_interfaceid": "99071c3f-4bc5-47e9-9427-4ed6114e40a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71731) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 17:05:19 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-9f0e305b-6ad7-4fcd-9abe-426524d791c7 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Converting VIF {"id": "99071c3f-4bc5-47e9-9427-4ed6114e40a5", "address": "fa:16:3e:4f:9a:a9", "network": {"id": "436011a9-c48b-4f33-a576-a245b344dd72", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-116243831-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "097b15faad8249c9bf45623d0c3ab518", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99071c3f-4b", "ovs_interfaceid": "99071c3f-4bc5-47e9-9427-4ed6114e40a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 17:05:19 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-9f0e305b-6ad7-4fcd-9abe-426524d791c7 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4f:9a:a9,bridge_name='br-int',has_traffic_filtering=True,id=99071c3f-4bc5-47e9-9427-4ed6114e40a5,network=Network(436011a9-c48b-4f33-a576-a245b344dd72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99071c3f-4b') {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 17:05:19 user nova-compute[71731]: DEBUG nova.objects.instance [None req-9f0e305b-6ad7-4fcd-9abe-426524d791c7 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lazy-loading 'pci_devices' on Instance uuid ae339f64-b90f-4399-baa5-1ad1e5051593 {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 17:05:19 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-9f0e305b-6ad7-4fcd-9abe-426524d791c7 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] [instance: ae339f64-b90f-4399-baa5-1ad1e5051593] End _get_guest_xml xml=<domain type="kvm">
Apr 13 17:05:19 user nova-compute[71731]:   <uuid>ae339f64-b90f-4399-baa5-1ad1e5051593</uuid>
Apr 13 17:05:19 user nova-compute[71731]:   <name>instance-0000002e</name>
Apr 13 17:05:19 user nova-compute[71731]:   <memory>131072</memory>
Apr 13 17:05:19 user nova-compute[71731]:   <vcpu>1</vcpu>
Apr 13 17:05:19 user nova-compute[71731]:   <metadata>
Apr 13 17:05:19 user nova-compute[71731]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 17:05:19 user nova-compute[71731]:       <nova:package version="0.0.0"/>
Apr 13 17:05:19 user nova-compute[71731]:       <nova:name>tempest-AttachVolumeNegativeTest-server-2098457470</nova:name>
Apr 13 17:05:19 user nova-compute[71731]:       <nova:creationTime>2023-04-13 17:05:19</nova:creationTime>
Apr 13 17:05:19 user nova-compute[71731]:       <nova:flavor name="m1.nano">
Apr 13 17:05:19 user nova-compute[71731]:         <nova:memory>128</nova:memory>
Apr 13 17:05:19 user nova-compute[71731]:         <nova:disk>1</nova:disk>
Apr 13 17:05:19 user nova-compute[71731]:         <nova:swap>0</nova:swap>
Apr 13 17:05:19 user nova-compute[71731]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 17:05:19 user nova-compute[71731]:         <nova:vcpus>1</nova:vcpus>
Apr 13 17:05:19 user nova-compute[71731]:       </nova:flavor>
Apr 13 17:05:19 user nova-compute[71731]:       <nova:owner>
Apr 13 17:05:19 user nova-compute[71731]:         <nova:user uuid="a08b0caad23045c1822cdd0b3ae0769f">tempest-AttachVolumeNegativeTest-236067262-project-member</nova:user>
Apr 13 17:05:19 user nova-compute[71731]:         <nova:project uuid="097b15faad8249c9bf45623d0c3ab518">tempest-AttachVolumeNegativeTest-236067262</nova:project>
Apr 13 17:05:19 user nova-compute[71731]:       </nova:owner>
Apr 13 17:05:19 user nova-compute[71731]:       <nova:root type="image" uuid="708622a9-7465-4492-ade8-b827198f7e30"/>
Apr 13 17:05:19 user nova-compute[71731]:       <nova:ports>
Apr 13 17:05:19 user nova-compute[71731]:         <nova:port uuid="99071c3f-4bc5-47e9-9427-4ed6114e40a5">
Apr 13 17:05:19 user nova-compute[71731]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Apr 13 17:05:19 user nova-compute[71731]:         </nova:port>
Apr 13 17:05:19 user nova-compute[71731]:       </nova:ports>
Apr 13 17:05:19 user nova-compute[71731]:     </nova:instance>
Apr 13 17:05:19 user nova-compute[71731]:   </metadata>
Apr 13 17:05:19 user nova-compute[71731]:   <sysinfo type="smbios">
Apr 13 17:05:19 user nova-compute[71731]:     <system>
Apr 13 17:05:19 user nova-compute[71731]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 17:05:19 user nova-compute[71731]:       <entry name="product">OpenStack Nova</entry>
Apr 13 17:05:19 user nova-compute[71731]:       <entry name="version">0.0.0</entry>
Apr 13 17:05:19 user nova-compute[71731]:       <entry name="serial">ae339f64-b90f-4399-baa5-1ad1e5051593</entry>
Apr 13 17:05:19 user nova-compute[71731]:       <entry name="uuid">ae339f64-b90f-4399-baa5-1ad1e5051593</entry>
Apr 13 17:05:19 user nova-compute[71731]:       <entry name="family">Virtual Machine</entry>
Apr 13 17:05:19 user nova-compute[71731]:     </system>
Apr 13 17:05:19 user nova-compute[71731]:   </sysinfo>
Apr 13 17:05:19 user nova-compute[71731]:   <os>
Apr 13 17:05:19 user nova-compute[71731]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 17:05:19 user nova-compute[71731]:     <boot dev="hd"/>
Apr 13 17:05:19 user nova-compute[71731]:     <smbios mode="sysinfo"/>
Apr 13 17:05:19 user nova-compute[71731]:   </os>
Apr 13 17:05:19 user nova-compute[71731]:   <features>
Apr 13 17:05:19 user nova-compute[71731]:     <acpi/>
Apr 13 17:05:19 user nova-compute[71731]:     <apic/>
Apr 13 17:05:19 user nova-compute[71731]:     <vmcoreinfo/>
Apr 13 17:05:19 user nova-compute[71731]:   </features>
Apr 13 17:05:19 user nova-compute[71731]:   <clock offset="utc">
Apr 13 17:05:19 user nova-compute[71731]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 17:05:19 user nova-compute[71731]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 17:05:19 user nova-compute[71731]:     <timer name="hpet" present="no"/>
Apr 13 17:05:19 user nova-compute[71731]:   </clock>
Apr 13 17:05:19 user nova-compute[71731]:   <cpu mode="custom" match="exact">
Apr 13 17:05:19 user nova-compute[71731]:     <model>Nehalem</model>
Apr 13 17:05:19 user nova-compute[71731]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 17:05:19 user nova-compute[71731]:   </cpu>
Apr 13 17:05:19 user nova-compute[71731]:   <devices>
Apr 13 17:05:19 user nova-compute[71731]:     <disk type="file" device="disk">
Apr 13 17:05:19 user nova-compute[71731]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 17:05:19 user nova-compute[71731]:       <source file="/opt/stack/data/nova/instances/ae339f64-b90f-4399-baa5-1ad1e5051593/disk"/>
Apr 13 17:05:19 user nova-compute[71731]:       <target dev="vda" bus="virtio"/>
Apr 13 17:05:19 user nova-compute[71731]:     </disk>
Apr 13 17:05:19 user nova-compute[71731]:     <interface type="ethernet">
Apr 13 17:05:19 user nova-compute[71731]:       <mac address="fa:16:3e:4f:9a:a9"/>
Apr 13 17:05:19 user nova-compute[71731]:       <model type="virtio"/>
Apr 13 17:05:19 user nova-compute[71731]:       <mtu size="1442"/>
Apr 13 17:05:19 user nova-compute[71731]:       <target dev="tap99071c3f-4b"/>
Apr 13 17:05:19 user nova-compute[71731]:     </interface>
Apr 13 17:05:19 user nova-compute[71731]:     <serial type="pty">
Apr 13 17:05:19 user nova-compute[71731]:       <log file="/opt/stack/data/nova/instances/ae339f64-b90f-4399-baa5-1ad1e5051593/console.log" append="off"/>
Apr 13 17:05:19 user nova-compute[71731]:     </serial>
Apr 13 17:05:19 user nova-compute[71731]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 17:05:19 user nova-compute[71731]:     <video>
Apr 13 17:05:19 user nova-compute[71731]:       <model type="virtio"/>
Apr 13 17:05:19 user nova-compute[71731]:     </video>
Apr 13 17:05:19 user nova-compute[71731]:     <rng model="virtio">
Apr 13 17:05:19 user nova-compute[71731]:       <backend model="random">/dev/urandom</backend>
Apr 13 17:05:19 user nova-compute[71731]:     </rng>
Apr 13 17:05:19 user nova-compute[71731]:     <controller type="usb" index="0" model="none"/>
Apr 13 17:05:19 user nova-compute[71731]:     <memballoon model="virtio">
Apr 13 17:05:19 user nova-compute[71731]:       <stats period="10"/>
Apr 13 17:05:19 user nova-compute[71731]:     </memballoon>
Apr 13 17:05:19 user nova-compute[71731]:   </devices>
Apr 13 17:05:19 user nova-compute[71731]: </domain>
Apr 13 17:05:19 user nova-compute[71731]:  {{(pid=71731) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 17:05:19 user nova-compute[71731]: DEBUG nova.virt.libvirt.vif [None req-9f0e305b-6ad7-4fcd-9abe-426524d791c7 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T17:05:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-2098457470',display_name='tempest-AttachVolumeNegativeTest-server-2098457470',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-2098457470',id=46,image_ref='708622a9-7465-4492-ade8-b827198f7e30',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBESykv5tW83kHbwBGFQOvSCy+ICNt4W0TQ1jPtqTWGBoErb8Q7X135LOLGGhPK3SnAx4kT7bpNF/X4w5BBRqCpxWFXGF/m9Ir1Ke1mquI92zdi2E1wCJREcaMQNLTOTvVw==',key_name='tempest-keypair-1795442799',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='097b15faad8249c9bf45623d0c3ab518',ramdisk_id='',reservation_id='r-xr7qbflx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='708622a9-7465-4492-ade8-b827198f7e30',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-236067262',owner_user_name='tempest-AttachVolumeNegativeTest-236067262-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T17:05:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a08b0caad23045c1822cdd0b3ae0769f',uuid=ae339f64-b90f-4399-baa5-1ad1e5051593,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "99071c3f-4bc5-47e9-9427-4ed6114e40a5", "address": "fa:16:3e:4f:9a:a9", "network": {"id": "436011a9-c48b-4f33-a576-a245b344dd72", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-116243831-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "097b15faad8249c9bf45623d0c3ab518", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99071c3f-4b", "ovs_interfaceid": "99071c3f-4bc5-47e9-9427-4ed6114e40a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 17:05:19 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-9f0e305b-6ad7-4fcd-9abe-426524d791c7 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Converting VIF {"id": "99071c3f-4bc5-47e9-9427-4ed6114e40a5", "address": "fa:16:3e:4f:9a:a9", "network": {"id": "436011a9-c48b-4f33-a576-a245b344dd72", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-116243831-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "097b15faad8249c9bf45623d0c3ab518", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99071c3f-4b", "ovs_interfaceid": "99071c3f-4bc5-47e9-9427-4ed6114e40a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 17:05:19 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-9f0e305b-6ad7-4fcd-9abe-426524d791c7 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4f:9a:a9,bridge_name='br-int',has_traffic_filtering=True,id=99071c3f-4bc5-47e9-9427-4ed6114e40a5,network=Network(436011a9-c48b-4f33-a576-a245b344dd72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99071c3f-4b') {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 17:05:19 user nova-compute[71731]: DEBUG os_vif [None req-9f0e305b-6ad7-4fcd-9abe-426524d791c7 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:9a:a9,bridge_name='br-int',has_traffic_filtering=True,id=99071c3f-4bc5-47e9-9427-4ed6114e40a5,network=Network(436011a9-c48b-4f33-a576-a245b344dd72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99071c3f-4b') {{(pid=71731) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 17:05:19 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:05:19 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 17:05:19 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 17:05:19 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:05:19 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap99071c3f-4b, may_exist=True) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 17:05:19 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap99071c3f-4b, col_values=(('external_ids', {'iface-id': '99071c3f-4bc5-47e9-9427-4ed6114e40a5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4f:9a:a9', 'vm-uuid': 'ae339f64-b90f-4399-baa5-1ad1e5051593'}),)) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 17:05:19 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:05:19 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 17:05:19 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:05:19 user nova-compute[71731]: INFO os_vif [None req-9f0e305b-6ad7-4fcd-9abe-426524d791c7 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:9a:a9,bridge_name='br-int',has_traffic_filtering=True,id=99071c3f-4bc5-47e9-9427-4ed6114e40a5,network=Network(436011a9-c48b-4f33-a576-a245b344dd72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99071c3f-4b')
Apr 13 17:05:19 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-9f0e305b-6ad7-4fcd-9abe-426524d791c7 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] No BDM found with device name vda, not building metadata. {{(pid=71731) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 17:05:19 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-9f0e305b-6ad7-4fcd-9abe-426524d791c7 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] No VIF found with MAC fa:16:3e:4f:9a:a9, not building metadata {{(pid=71731) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 17:05:19 user nova-compute[71731]: DEBUG nova.network.neutron [req-8e8e6ca1-c0b1-4cb7-9fc0-14a361f9001d req-55fbd175-8a98-4f8d-bbff-ff3375116021 service nova] [instance: ae339f64-b90f-4399-baa5-1ad1e5051593] Updated VIF entry in instance network info cache for port 99071c3f-4bc5-47e9-9427-4ed6114e40a5. {{(pid=71731) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 17:05:19 user nova-compute[71731]: DEBUG nova.network.neutron [req-8e8e6ca1-c0b1-4cb7-9fc0-14a361f9001d req-55fbd175-8a98-4f8d-bbff-ff3375116021 service nova] [instance: ae339f64-b90f-4399-baa5-1ad1e5051593] Updating instance_info_cache with network_info: [{"id": "99071c3f-4bc5-47e9-9427-4ed6114e40a5", "address": "fa:16:3e:4f:9a:a9", "network": {"id": "436011a9-c48b-4f33-a576-a245b344dd72", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-116243831-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "097b15faad8249c9bf45623d0c3ab518", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99071c3f-4b", "ovs_interfaceid": "99071c3f-4bc5-47e9-9427-4ed6114e40a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 17:05:19 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-8e8e6ca1-c0b1-4cb7-9fc0-14a361f9001d req-55fbd175-8a98-4f8d-bbff-ff3375116021 service nova] Releasing lock "refresh_cache-ae339f64-b90f-4399-baa5-1ad1e5051593" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 17:05:20 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:05:20 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:05:20 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:05:20 user nova-compute[71731]: DEBUG nova.compute.manager [req-420fa94f-151c-4b5b-ab75-c3261ef580a3 req-0e313ded-45cf-45d2-9045-8fc010b22627 service nova] [instance: ae339f64-b90f-4399-baa5-1ad1e5051593] Received event network-vif-plugged-99071c3f-4bc5-47e9-9427-4ed6114e40a5 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:05:20 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-420fa94f-151c-4b5b-ab75-c3261ef580a3 req-0e313ded-45cf-45d2-9045-8fc010b22627 service nova] Acquiring lock "ae339f64-b90f-4399-baa5-1ad1e5051593-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:05:20 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-420fa94f-151c-4b5b-ab75-c3261ef580a3 req-0e313ded-45cf-45d2-9045-8fc010b22627 service nova] Lock "ae339f64-b90f-4399-baa5-1ad1e5051593-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:05:20 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-420fa94f-151c-4b5b-ab75-c3261ef580a3 req-0e313ded-45cf-45d2-9045-8fc010b22627 service nova] Lock "ae339f64-b90f-4399-baa5-1ad1e5051593-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:05:20 user nova-compute[71731]: DEBUG nova.compute.manager [req-420fa94f-151c-4b5b-ab75-c3261ef580a3 req-0e313ded-45cf-45d2-9045-8fc010b22627 service nova] [instance: ae339f64-b90f-4399-baa5-1ad1e5051593] No waiting events found dispatching network-vif-plugged-99071c3f-4bc5-47e9-9427-4ed6114e40a5 {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 17:05:20 user nova-compute[71731]: WARNING nova.compute.manager [req-420fa94f-151c-4b5b-ab75-c3261ef580a3 req-0e313ded-45cf-45d2-9045-8fc010b22627 service nova] [instance: ae339f64-b90f-4399-baa5-1ad1e5051593] Received unexpected event network-vif-plugged-99071c3f-4bc5-47e9-9427-4ed6114e40a5 for instance with vm_state building and task_state spawning.
Apr 13 17:05:21 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:05:21 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:05:21 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:05:22 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:05:22 user nova-compute[71731]: DEBUG nova.virt.driver [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Emitting event <LifecycleEvent: 1681405522.789613, ae339f64-b90f-4399-baa5-1ad1e5051593 => Resumed> {{(pid=71731) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 17:05:22 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: ae339f64-b90f-4399-baa5-1ad1e5051593] VM Resumed (Lifecycle Event)
Apr 13 17:05:22 user nova-compute[71731]: DEBUG nova.compute.manager [None req-9f0e305b-6ad7-4fcd-9abe-426524d791c7 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] [instance: ae339f64-b90f-4399-baa5-1ad1e5051593] Instance event wait completed in 0 seconds for  {{(pid=71731) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 17:05:22 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-9f0e305b-6ad7-4fcd-9abe-426524d791c7 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] [instance: ae339f64-b90f-4399-baa5-1ad1e5051593] Guest created on hypervisor {{(pid=71731) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 17:05:22 user nova-compute[71731]: INFO nova.virt.libvirt.driver [-] [instance: ae339f64-b90f-4399-baa5-1ad1e5051593] Instance spawned successfully.
Apr 13 17:05:22 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-9f0e305b-6ad7-4fcd-9abe-426524d791c7 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] [instance: ae339f64-b90f-4399-baa5-1ad1e5051593] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 17:05:22 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: ae339f64-b90f-4399-baa5-1ad1e5051593] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 17:05:22 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: ae339f64-b90f-4399-baa5-1ad1e5051593] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71731) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 17:05:22 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-9f0e305b-6ad7-4fcd-9abe-426524d791c7 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] [instance: ae339f64-b90f-4399-baa5-1ad1e5051593] Found default for hw_cdrom_bus of ide {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 17:05:22 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-9f0e305b-6ad7-4fcd-9abe-426524d791c7 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] [instance: ae339f64-b90f-4399-baa5-1ad1e5051593] Found default for hw_disk_bus of virtio {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 17:05:22 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-9f0e305b-6ad7-4fcd-9abe-426524d791c7 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] [instance: ae339f64-b90f-4399-baa5-1ad1e5051593] Found default for hw_input_bus of None {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 17:05:22 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-9f0e305b-6ad7-4fcd-9abe-426524d791c7 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] [instance: ae339f64-b90f-4399-baa5-1ad1e5051593] Found default for hw_pointer_model of None {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 17:05:22 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-9f0e305b-6ad7-4fcd-9abe-426524d791c7 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] [instance: ae339f64-b90f-4399-baa5-1ad1e5051593] Found default for hw_video_model of virtio {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 17:05:22 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-9f0e305b-6ad7-4fcd-9abe-426524d791c7 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] [instance: ae339f64-b90f-4399-baa5-1ad1e5051593] Found default for hw_vif_model of virtio {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 17:05:22 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: ae339f64-b90f-4399-baa5-1ad1e5051593] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 17:05:22 user nova-compute[71731]: DEBUG nova.virt.driver [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Emitting event <LifecycleEvent: 1681405522.7910883, ae339f64-b90f-4399-baa5-1ad1e5051593 => Started> {{(pid=71731) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 17:05:22 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: ae339f64-b90f-4399-baa5-1ad1e5051593] VM Started (Lifecycle Event)
Apr 13 17:05:22 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: ae339f64-b90f-4399-baa5-1ad1e5051593] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 17:05:22 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: ae339f64-b90f-4399-baa5-1ad1e5051593] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71731) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 17:05:22 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: ae339f64-b90f-4399-baa5-1ad1e5051593] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 17:05:22 user nova-compute[71731]: INFO nova.compute.manager [None req-9f0e305b-6ad7-4fcd-9abe-426524d791c7 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] [instance: ae339f64-b90f-4399-baa5-1ad1e5051593] Took 5.41 seconds to spawn the instance on the hypervisor.
Apr 13 17:05:22 user nova-compute[71731]: DEBUG nova.compute.manager [None req-9f0e305b-6ad7-4fcd-9abe-426524d791c7 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] [instance: ae339f64-b90f-4399-baa5-1ad1e5051593] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 17:05:22 user nova-compute[71731]: DEBUG nova.compute.manager [req-8e1ae636-152f-4c7b-99a8-17eccfb0930c req-49a59fb0-4d9d-470f-89db-7f1855ec3860 service nova] [instance: ae339f64-b90f-4399-baa5-1ad1e5051593] Received event network-vif-plugged-99071c3f-4bc5-47e9-9427-4ed6114e40a5 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:05:22 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-8e1ae636-152f-4c7b-99a8-17eccfb0930c req-49a59fb0-4d9d-470f-89db-7f1855ec3860 service nova] Acquiring lock "ae339f64-b90f-4399-baa5-1ad1e5051593-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:05:22 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-8e1ae636-152f-4c7b-99a8-17eccfb0930c req-49a59fb0-4d9d-470f-89db-7f1855ec3860 service nova] Lock "ae339f64-b90f-4399-baa5-1ad1e5051593-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:05:22 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-8e1ae636-152f-4c7b-99a8-17eccfb0930c req-49a59fb0-4d9d-470f-89db-7f1855ec3860 service nova] Lock "ae339f64-b90f-4399-baa5-1ad1e5051593-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:05:22 user nova-compute[71731]: DEBUG nova.compute.manager [req-8e1ae636-152f-4c7b-99a8-17eccfb0930c req-49a59fb0-4d9d-470f-89db-7f1855ec3860 service nova] [instance: ae339f64-b90f-4399-baa5-1ad1e5051593] No waiting events found dispatching network-vif-plugged-99071c3f-4bc5-47e9-9427-4ed6114e40a5 {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 17:05:22 user nova-compute[71731]: WARNING nova.compute.manager [req-8e1ae636-152f-4c7b-99a8-17eccfb0930c req-49a59fb0-4d9d-470f-89db-7f1855ec3860 service nova] [instance: ae339f64-b90f-4399-baa5-1ad1e5051593] Received unexpected event network-vif-plugged-99071c3f-4bc5-47e9-9427-4ed6114e40a5 for instance with vm_state building and task_state spawning.
Apr 13 17:05:22 user nova-compute[71731]: INFO nova.compute.manager [None req-9f0e305b-6ad7-4fcd-9abe-426524d791c7 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] [instance: ae339f64-b90f-4399-baa5-1ad1e5051593] Took 5.97 seconds to build instance.
Apr 13 17:05:22 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-9f0e305b-6ad7-4fcd-9abe-426524d791c7 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "ae339f64-b90f-4399-baa5-1ad1e5051593" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.059s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:05:24 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:05:27 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:05:29 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:05:32 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:05:33 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-c98d7819-41c9-4bc9-9614-ba01bd7baadb tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Acquiring lock "652e59f0-b9be-4f45-bb79-2340d9564000" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:05:33 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-c98d7819-41c9-4bc9-9614-ba01bd7baadb tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lock "652e59f0-b9be-4f45-bb79-2340d9564000" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:05:33 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-c98d7819-41c9-4bc9-9614-ba01bd7baadb tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Acquiring lock "652e59f0-b9be-4f45-bb79-2340d9564000-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:05:33 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-c98d7819-41c9-4bc9-9614-ba01bd7baadb tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lock "652e59f0-b9be-4f45-bb79-2340d9564000-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:05:33 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-c98d7819-41c9-4bc9-9614-ba01bd7baadb tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lock "652e59f0-b9be-4f45-bb79-2340d9564000-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:05:33 user nova-compute[71731]: INFO nova.compute.manager [None req-c98d7819-41c9-4bc9-9614-ba01bd7baadb tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] [instance: 652e59f0-b9be-4f45-bb79-2340d9564000] Terminating instance
Apr 13 17:05:33 user nova-compute[71731]: DEBUG nova.compute.manager [None req-c98d7819-41c9-4bc9-9614-ba01bd7baadb tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] [instance: 652e59f0-b9be-4f45-bb79-2340d9564000] Start destroying the instance on the hypervisor. {{(pid=71731) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 17:05:33 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:05:33 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:05:33 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:05:33 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:05:34 user nova-compute[71731]: DEBUG nova.compute.manager [req-ffca701b-49bf-4742-b099-df72883686bb req-9b4b4cb8-cb9f-4f70-9160-7e0cbd0f0f02 service nova] [instance: 652e59f0-b9be-4f45-bb79-2340d9564000] Received event network-vif-unplugged-6047b3aa-607c-4b10-904a-8497d9a2f82b {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:05:34 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-ffca701b-49bf-4742-b099-df72883686bb req-9b4b4cb8-cb9f-4f70-9160-7e0cbd0f0f02 service nova] Acquiring lock "652e59f0-b9be-4f45-bb79-2340d9564000-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:05:34 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-ffca701b-49bf-4742-b099-df72883686bb req-9b4b4cb8-cb9f-4f70-9160-7e0cbd0f0f02 service nova] Lock "652e59f0-b9be-4f45-bb79-2340d9564000-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:05:34 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-ffca701b-49bf-4742-b099-df72883686bb req-9b4b4cb8-cb9f-4f70-9160-7e0cbd0f0f02 service nova] Lock "652e59f0-b9be-4f45-bb79-2340d9564000-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:05:34 user nova-compute[71731]: DEBUG nova.compute.manager [req-ffca701b-49bf-4742-b099-df72883686bb req-9b4b4cb8-cb9f-4f70-9160-7e0cbd0f0f02 service nova] [instance: 652e59f0-b9be-4f45-bb79-2340d9564000] No waiting events found dispatching network-vif-unplugged-6047b3aa-607c-4b10-904a-8497d9a2f82b {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 17:05:34 user nova-compute[71731]: DEBUG nova.compute.manager [req-ffca701b-49bf-4742-b099-df72883686bb req-9b4b4cb8-cb9f-4f70-9160-7e0cbd0f0f02 service nova] [instance: 652e59f0-b9be-4f45-bb79-2340d9564000] Received event network-vif-unplugged-6047b3aa-607c-4b10-904a-8497d9a2f82b for instance with task_state deleting. {{(pid=71731) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 17:05:34 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:05:34 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:05:34 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:05:34 user nova-compute[71731]: INFO nova.virt.libvirt.driver [-] [instance: 652e59f0-b9be-4f45-bb79-2340d9564000] Instance destroyed successfully.
Apr 13 17:05:34 user nova-compute[71731]: DEBUG nova.objects.instance [None req-c98d7819-41c9-4bc9-9614-ba01bd7baadb tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lazy-loading 'resources' on Instance uuid 652e59f0-b9be-4f45-bb79-2340d9564000 {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 17:05:34 user nova-compute[71731]: DEBUG nova.virt.libvirt.vif [None req-c98d7819-41c9-4bc9-9614-ba01bd7baadb tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T17:00:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1210397582',display_name='tempest-TestMinimumBasicScenario-server-1210397582',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1210397582',id=44,image_ref='40bf0b81-a3f7-4702-b16f-bc02b4ffa120',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLTT5rrYLPrICtrmRV6uZ+f3Amb/NKgabEiTvK/SQIBpINNqaHEfiYg1i3f6zZiVzFJ2qudJHtaG2Ihj81v7dqZamVZwx3H3EBr/5cGqhXpc8pjW8XQjSOCjYuKj4Jtgow==',key_name='tempest-TestMinimumBasicScenario-646311077',keypairs=<?>,launch_index=0,launched_at=2023-04-13T17:00:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7edf468527d84954a943bb4c1f7ff54d',ramdisk_id='',reservation_id='r-4wvpzhqr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='40bf0b81-a3f7-4702-b16f-bc02b4ffa120',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-419032150',owner_user_name='tempest-TestMinimumBasicScenario-419032150-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T17:02:56Z,user_data=None,user_id='91a450674d7046ae82f5dd182506c85b',uuid=652e59f0-b9be-4f45-bb79-2340d9564000,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6047b3aa-607c-4b10-904a-8497d9a2f82b", "address": "fa:16:3e:0e:ca:10", "network": {"id": "0c6a5f46-e53b-4b4c-806e-b2617ba3ef35", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1984894004-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7edf468527d84954a943bb4c1f7ff54d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6047b3aa-60", "ovs_interfaceid": "6047b3aa-607c-4b10-904a-8497d9a2f82b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 17:05:34 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-c98d7819-41c9-4bc9-9614-ba01bd7baadb tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Converting VIF {"id": "6047b3aa-607c-4b10-904a-8497d9a2f82b", "address": "fa:16:3e:0e:ca:10", "network": {"id": "0c6a5f46-e53b-4b4c-806e-b2617ba3ef35", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1984894004-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7edf468527d84954a943bb4c1f7ff54d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6047b3aa-60", "ovs_interfaceid": "6047b3aa-607c-4b10-904a-8497d9a2f82b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 17:05:34 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-c98d7819-41c9-4bc9-9614-ba01bd7baadb tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0e:ca:10,bridge_name='br-int',has_traffic_filtering=True,id=6047b3aa-607c-4b10-904a-8497d9a2f82b,network=Network(0c6a5f46-e53b-4b4c-806e-b2617ba3ef35),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6047b3aa-60') {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 17:05:34 user nova-compute[71731]: DEBUG os_vif [None req-c98d7819-41c9-4bc9-9614-ba01bd7baadb tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0e:ca:10,bridge_name='br-int',has_traffic_filtering=True,id=6047b3aa-607c-4b10-904a-8497d9a2f82b,network=Network(0c6a5f46-e53b-4b4c-806e-b2617ba3ef35),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6047b3aa-60') {{(pid=71731) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 17:05:34 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:05:34 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6047b3aa-60, bridge=br-int, if_exists=True) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 17:05:34 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:05:34 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 17:05:34 user nova-compute[71731]: INFO os_vif [None req-c98d7819-41c9-4bc9-9614-ba01bd7baadb tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0e:ca:10,bridge_name='br-int',has_traffic_filtering=True,id=6047b3aa-607c-4b10-904a-8497d9a2f82b,network=Network(0c6a5f46-e53b-4b4c-806e-b2617ba3ef35),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6047b3aa-60')
Apr 13 17:05:34 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-c98d7819-41c9-4bc9-9614-ba01bd7baadb tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] [instance: 652e59f0-b9be-4f45-bb79-2340d9564000] Deleting instance files /opt/stack/data/nova/instances/652e59f0-b9be-4f45-bb79-2340d9564000_del
Apr 13 17:05:34 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-c98d7819-41c9-4bc9-9614-ba01bd7baadb tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] [instance: 652e59f0-b9be-4f45-bb79-2340d9564000] Deletion of /opt/stack/data/nova/instances/652e59f0-b9be-4f45-bb79-2340d9564000_del complete
Apr 13 17:05:34 user nova-compute[71731]: INFO nova.compute.manager [None req-c98d7819-41c9-4bc9-9614-ba01bd7baadb tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] [instance: 652e59f0-b9be-4f45-bb79-2340d9564000] Took 0.87 seconds to destroy the instance on the hypervisor.
Apr 13 17:05:34 user nova-compute[71731]: DEBUG oslo.service.loopingcall [None req-c98d7819-41c9-4bc9-9614-ba01bd7baadb tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71731) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 17:05:34 user nova-compute[71731]: DEBUG nova.compute.manager [-] [instance: 652e59f0-b9be-4f45-bb79-2340d9564000] Deallocating network for instance {{(pid=71731) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 17:05:34 user nova-compute[71731]: DEBUG nova.network.neutron [-] [instance: 652e59f0-b9be-4f45-bb79-2340d9564000] deallocate_for_instance() {{(pid=71731) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 17:05:35 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:05:35 user nova-compute[71731]: DEBUG nova.network.neutron [-] [instance: 652e59f0-b9be-4f45-bb79-2340d9564000] Updating instance_info_cache with network_info: [] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 17:05:35 user nova-compute[71731]: INFO nova.compute.manager [-] [instance: 652e59f0-b9be-4f45-bb79-2340d9564000] Took 0.50 seconds to deallocate network for instance.
Apr 13 17:05:35 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-c98d7819-41c9-4bc9-9614-ba01bd7baadb tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:05:35 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-c98d7819-41c9-4bc9-9614-ba01bd7baadb tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:05:35 user nova-compute[71731]: DEBUG nova.compute.manager [req-3e9ca456-22fb-4a28-90e2-89f1562a9f2c req-ff47558d-15fd-4644-a804-11276dc0d54f service nova] [instance: 652e59f0-b9be-4f45-bb79-2340d9564000] Received event network-vif-deleted-6047b3aa-607c-4b10-904a-8497d9a2f82b {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:05:35 user nova-compute[71731]: DEBUG nova.compute.provider_tree [None req-c98d7819-41c9-4bc9-9614-ba01bd7baadb tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Inventory has not changed in ProviderTree for provider: cb6b1a64-0c24-4e2d-af1e-16576ca9165c {{(pid=71731) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 17:05:35 user nova-compute[71731]: DEBUG nova.scheduler.client.report [None req-c98d7819-41c9-4bc9-9614-ba01bd7baadb tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Inventory has not changed for provider cb6b1a64-0c24-4e2d-af1e-16576ca9165c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71731) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 17:05:35 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-c98d7819-41c9-4bc9-9614-ba01bd7baadb tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.180s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:05:35 user nova-compute[71731]: INFO nova.scheduler.client.report [None req-c98d7819-41c9-4bc9-9614-ba01bd7baadb tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Deleted allocations for instance 652e59f0-b9be-4f45-bb79-2340d9564000
Apr 13 17:05:35 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-c98d7819-41c9-4bc9-9614-ba01bd7baadb tempest-TestMinimumBasicScenario-419032150 tempest-TestMinimumBasicScenario-419032150-project-member] Lock "652e59f0-b9be-4f45-bb79-2340d9564000" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.737s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:05:36 user nova-compute[71731]: DEBUG nova.compute.manager [req-6cecd3db-a697-4fd3-8510-70463e23b951 req-85b18e81-62e3-407b-b6fc-28c69f5b4d24 service nova] [instance: 652e59f0-b9be-4f45-bb79-2340d9564000] Received event network-vif-plugged-6047b3aa-607c-4b10-904a-8497d9a2f82b {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:05:36 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-6cecd3db-a697-4fd3-8510-70463e23b951 req-85b18e81-62e3-407b-b6fc-28c69f5b4d24 service nova] Acquiring lock "652e59f0-b9be-4f45-bb79-2340d9564000-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:05:36 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-6cecd3db-a697-4fd3-8510-70463e23b951 req-85b18e81-62e3-407b-b6fc-28c69f5b4d24 service nova] Lock "652e59f0-b9be-4f45-bb79-2340d9564000-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:05:36 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-6cecd3db-a697-4fd3-8510-70463e23b951 req-85b18e81-62e3-407b-b6fc-28c69f5b4d24 service nova] Lock "652e59f0-b9be-4f45-bb79-2340d9564000-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:05:36 user nova-compute[71731]: DEBUG nova.compute.manager [req-6cecd3db-a697-4fd3-8510-70463e23b951 req-85b18e81-62e3-407b-b6fc-28c69f5b4d24 service nova] [instance: 652e59f0-b9be-4f45-bb79-2340d9564000] No waiting events found dispatching network-vif-plugged-6047b3aa-607c-4b10-904a-8497d9a2f82b {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 17:05:36 user nova-compute[71731]: WARNING nova.compute.manager [req-6cecd3db-a697-4fd3-8510-70463e23b951 req-85b18e81-62e3-407b-b6fc-28c69f5b4d24 service nova] [instance: 652e59f0-b9be-4f45-bb79-2340d9564000] Received unexpected event network-vif-plugged-6047b3aa-607c-4b10-904a-8497d9a2f82b for instance with vm_state deleted and task_state None.
Apr 13 17:05:37 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:05:39 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:05:42 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:05:42 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:05:44 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:05:44 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71731) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 17:05:44 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:05:46 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:05:46 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager.update_available_resource {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:05:46 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:05:46 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:05:46 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:05:46 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Auditing locally available compute resources for user (node: user) {{(pid=71731) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 17:05:46 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae339f64-b90f-4399-baa5-1ad1e5051593/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:05:46 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae339f64-b90f-4399-baa5-1ad1e5051593/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:05:46 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae339f64-b90f-4399-baa5-1ad1e5051593/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:05:46 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae339f64-b90f-4399-baa5-1ad1e5051593/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:05:46 user nova-compute[71731]: WARNING nova.virt.libvirt.driver [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 17:05:46 user nova-compute[71731]: WARNING nova.virt.libvirt.driver [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 17:05:46 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Hypervisor/Node resource view: name=user free_ram=8672MB free_disk=26.011394500732422GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71731) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 17:05:46 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:05:46 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:05:46 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance ae339f64-b90f-4399-baa5-1ad1e5051593 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 17:05:46 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=71731) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 17:05:46 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=71731) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 17:05:47 user nova-compute[71731]: DEBUG nova.compute.provider_tree [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Inventory has not changed in ProviderTree for provider: cb6b1a64-0c24-4e2d-af1e-16576ca9165c {{(pid=71731) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 17:05:47 user nova-compute[71731]: DEBUG nova.scheduler.client.report [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Inventory has not changed for provider cb6b1a64-0c24-4e2d-af1e-16576ca9165c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71731) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 17:05:47 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Compute_service record updated for user:user {{(pid=71731) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 17:05:47 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.206s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:05:49 user nova-compute[71731]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681405534.566053, 652e59f0-b9be-4f45-bb79-2340d9564000 => Stopped> {{(pid=71731) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 17:05:49 user nova-compute[71731]: INFO nova.compute.manager [-] [instance: 652e59f0-b9be-4f45-bb79-2340d9564000] VM Stopped (Lifecycle Event)
Apr 13 17:05:49 user nova-compute[71731]: DEBUG nova.compute.manager [None req-4efad848-7fab-438f-8682-ee37b67d689b None None] [instance: 652e59f0-b9be-4f45-bb79-2340d9564000] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 17:05:49 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 17:05:50 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:05:50 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:05:51 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:05:51 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Starting heal instance info cache {{(pid=71731) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 17:05:51 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Rebuilding the list of instances to heal {{(pid=71731) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 13 17:05:51 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Acquiring lock "refresh_cache-ae339f64-b90f-4399-baa5-1ad1e5051593" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 17:05:51 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Acquired lock "refresh_cache-ae339f64-b90f-4399-baa5-1ad1e5051593" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 17:05:51 user nova-compute[71731]: DEBUG nova.network.neutron [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] [instance: ae339f64-b90f-4399-baa5-1ad1e5051593] Forcefully refreshing network info cache for instance {{(pid=71731) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 17:05:51 user nova-compute[71731]: DEBUG nova.objects.instance [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lazy-loading 'info_cache' on Instance uuid ae339f64-b90f-4399-baa5-1ad1e5051593 {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 17:05:51 user nova-compute[71731]: DEBUG nova.network.neutron [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] [instance: ae339f64-b90f-4399-baa5-1ad1e5051593] Updating instance_info_cache with network_info: [{"id": "99071c3f-4bc5-47e9-9427-4ed6114e40a5", "address": "fa:16:3e:4f:9a:a9", "network": {"id": "436011a9-c48b-4f33-a576-a245b344dd72", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-116243831-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "097b15faad8249c9bf45623d0c3ab518", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99071c3f-4b", "ovs_interfaceid": "99071c3f-4bc5-47e9-9427-4ed6114e40a5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 17:05:51 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Releasing lock "refresh_cache-ae339f64-b90f-4399-baa5-1ad1e5051593" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 17:05:51 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] [instance: ae339f64-b90f-4399-baa5-1ad1e5051593] Updated the network info_cache for instance {{(pid=71731) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 17:05:52 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:05:53 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:05:53 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:05:54 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:05:59 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 17:06:04 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 17:06:04 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:06:04 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71731) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 17:06:04 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71731) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 17:06:04 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71731) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 17:06:04 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:06:07 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:06:09 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:06:14 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:06:19 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 17:06:19 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:06:19 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71731) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 17:06:19 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71731) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 17:06:19 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71731) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 17:06:19 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:06:24 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 17:06:25 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:06:27 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:06:29 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:06:29 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:06:34 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:06:37 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:06:39 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:06:43 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:06:44 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:06:44 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71731) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 17:06:44 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 17:06:46 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:06:48 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager.update_available_resource {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:06:48 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:06:48 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:06:48 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:06:48 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Auditing locally available compute resources for user (node: user) {{(pid=71731) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 17:06:48 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae339f64-b90f-4399-baa5-1ad1e5051593/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:06:48 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae339f64-b90f-4399-baa5-1ad1e5051593/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:06:48 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae339f64-b90f-4399-baa5-1ad1e5051593/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:06:48 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae339f64-b90f-4399-baa5-1ad1e5051593/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:06:48 user nova-compute[71731]: WARNING nova.virt.libvirt.driver [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 17:06:48 user nova-compute[71731]: WARNING nova.virt.libvirt.driver [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 17:06:48 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Hypervisor/Node resource view: name=user free_ram=8775MB free_disk=26.040637969970703GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71731) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 17:06:48 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:06:48 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:06:48 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance ae339f64-b90f-4399-baa5-1ad1e5051593 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 17:06:48 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=71731) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 17:06:48 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=71731) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 17:06:49 user nova-compute[71731]: DEBUG nova.compute.provider_tree [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Inventory has not changed in ProviderTree for provider: cb6b1a64-0c24-4e2d-af1e-16576ca9165c {{(pid=71731) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 17:06:49 user nova-compute[71731]: DEBUG nova.scheduler.client.report [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Inventory has not changed for provider cb6b1a64-0c24-4e2d-af1e-16576ca9165c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71731) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 17:06:49 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Compute_service record updated for user:user {{(pid=71731) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 17:06:49 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.159s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:06:49 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 17:06:50 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:06:50 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:06:52 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:06:52 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Starting heal instance info cache {{(pid=71731) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 17:06:52 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Rebuilding the list of instances to heal {{(pid=71731) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 13 17:06:52 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Acquiring lock "refresh_cache-ae339f64-b90f-4399-baa5-1ad1e5051593" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 17:06:52 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Acquired lock "refresh_cache-ae339f64-b90f-4399-baa5-1ad1e5051593" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 17:06:52 user nova-compute[71731]: DEBUG nova.network.neutron [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] [instance: ae339f64-b90f-4399-baa5-1ad1e5051593] Forcefully refreshing network info cache for instance {{(pid=71731) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 17:06:52 user nova-compute[71731]: DEBUG nova.objects.instance [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lazy-loading 'info_cache' on Instance uuid ae339f64-b90f-4399-baa5-1ad1e5051593 {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 17:06:52 user nova-compute[71731]: DEBUG nova.network.neutron [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] [instance: ae339f64-b90f-4399-baa5-1ad1e5051593] Updating instance_info_cache with network_info: [{"id": "99071c3f-4bc5-47e9-9427-4ed6114e40a5", "address": "fa:16:3e:4f:9a:a9", "network": {"id": "436011a9-c48b-4f33-a576-a245b344dd72", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-116243831-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "097b15faad8249c9bf45623d0c3ab518", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99071c3f-4b", "ovs_interfaceid": "99071c3f-4bc5-47e9-9427-4ed6114e40a5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 17:06:52 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Releasing lock "refresh_cache-ae339f64-b90f-4399-baa5-1ad1e5051593" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 17:06:52 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] [instance: ae339f64-b90f-4399-baa5-1ad1e5051593] Updated the network info_cache for instance {{(pid=71731) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 17:06:53 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:06:53 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:06:54 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:06:59 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:07:04 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:07:05 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:07:05 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Cleaning up deleted instances {{(pid=71731) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 13 17:07:05 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] There are 0 instances to clean {{(pid=71731) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 13 17:07:07 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:07:07 user nova-compute[71731]: DEBUG nova.compute.manager [req-6e270420-2b4c-47f8-a288-12690d8c082e req-448d1d5b-3d1e-43e5-bf2f-7df7cb9cd226 service nova] [instance: ae339f64-b90f-4399-baa5-1ad1e5051593] Received event network-changed-99071c3f-4bc5-47e9-9427-4ed6114e40a5 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:07:07 user nova-compute[71731]: DEBUG nova.compute.manager [req-6e270420-2b4c-47f8-a288-12690d8c082e req-448d1d5b-3d1e-43e5-bf2f-7df7cb9cd226 service nova] [instance: ae339f64-b90f-4399-baa5-1ad1e5051593] Refreshing instance network info cache due to event network-changed-99071c3f-4bc5-47e9-9427-4ed6114e40a5. {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 17:07:07 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-6e270420-2b4c-47f8-a288-12690d8c082e req-448d1d5b-3d1e-43e5-bf2f-7df7cb9cd226 service nova] Acquiring lock "refresh_cache-ae339f64-b90f-4399-baa5-1ad1e5051593" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 17:07:07 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-6e270420-2b4c-47f8-a288-12690d8c082e req-448d1d5b-3d1e-43e5-bf2f-7df7cb9cd226 service nova] Acquired lock "refresh_cache-ae339f64-b90f-4399-baa5-1ad1e5051593" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 17:07:07 user nova-compute[71731]: DEBUG nova.network.neutron [req-6e270420-2b4c-47f8-a288-12690d8c082e req-448d1d5b-3d1e-43e5-bf2f-7df7cb9cd226 service nova] [instance: ae339f64-b90f-4399-baa5-1ad1e5051593] Refreshing network info cache for port 99071c3f-4bc5-47e9-9427-4ed6114e40a5 {{(pid=71731) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 17:07:08 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:07:08 user nova-compute[71731]: DEBUG nova.network.neutron [req-6e270420-2b4c-47f8-a288-12690d8c082e req-448d1d5b-3d1e-43e5-bf2f-7df7cb9cd226 service nova] [instance: ae339f64-b90f-4399-baa5-1ad1e5051593] Updated VIF entry in instance network info cache for port 99071c3f-4bc5-47e9-9427-4ed6114e40a5. {{(pid=71731) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 17:07:08 user nova-compute[71731]: DEBUG nova.network.neutron [req-6e270420-2b4c-47f8-a288-12690d8c082e req-448d1d5b-3d1e-43e5-bf2f-7df7cb9cd226 service nova] [instance: ae339f64-b90f-4399-baa5-1ad1e5051593] Updating instance_info_cache with network_info: [{"id": "99071c3f-4bc5-47e9-9427-4ed6114e40a5", "address": "fa:16:3e:4f:9a:a9", "network": {"id": "436011a9-c48b-4f33-a576-a245b344dd72", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-116243831-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "097b15faad8249c9bf45623d0c3ab518", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99071c3f-4b", "ovs_interfaceid": "99071c3f-4bc5-47e9-9427-4ed6114e40a5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 17:07:08 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-6e270420-2b4c-47f8-a288-12690d8c082e req-448d1d5b-3d1e-43e5-bf2f-7df7cb9cd226 service nova] Releasing lock "refresh_cache-ae339f64-b90f-4399-baa5-1ad1e5051593" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 17:07:09 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-c9b9675a-edc7-4a61-96e2-3a284ebaaa60 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Acquiring lock "ae339f64-b90f-4399-baa5-1ad1e5051593" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:07:09 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-c9b9675a-edc7-4a61-96e2-3a284ebaaa60 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "ae339f64-b90f-4399-baa5-1ad1e5051593" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:07:09 user nova-compute[71731]: DEBUG nova.objects.instance [None req-c9b9675a-edc7-4a61-96e2-3a284ebaaa60 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lazy-loading 'flavor' on Instance uuid ae339f64-b90f-4399-baa5-1ad1e5051593 {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 17:07:09 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-c9b9675a-edc7-4a61-96e2-3a284ebaaa60 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "ae339f64-b90f-4399-baa5-1ad1e5051593" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:07:09 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 17:07:09 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:07:09 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71731) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 17:07:09 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71731) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 17:07:09 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71731) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 17:07:09 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:07:10 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-c9b9675a-edc7-4a61-96e2-3a284ebaaa60 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Acquiring lock "ae339f64-b90f-4399-baa5-1ad1e5051593" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:07:10 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-c9b9675a-edc7-4a61-96e2-3a284ebaaa60 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "ae339f64-b90f-4399-baa5-1ad1e5051593" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:07:10 user nova-compute[71731]: INFO nova.compute.manager [None req-c9b9675a-edc7-4a61-96e2-3a284ebaaa60 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] [instance: ae339f64-b90f-4399-baa5-1ad1e5051593] Attaching volume 47665adf-cb34-4b24-9861-fc5bfbff2127 to /dev/vdb
Apr 13 17:07:10 user nova-compute[71731]: DEBUG os_brick.utils [None req-c9b9675a-edc7-4a61-96e2-3a284ebaaa60 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 17:07:10 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:07:10 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:07:10 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[82d90e94-f779-4781-9ad2-0ca1d4f5fc05]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:81501d91421\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:07:10 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:07:10 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:07:10 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d2a854a-6053-45ee-b5c8-2586d9eb1ef3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:07:10 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:07:10 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:07:10 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[86205a72-b1a8-404a-bba5-50dbca0d4737]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:07:10 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d7deeba-ed35-4604-9fa4-6ddfdcb0eb1b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:07:10 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-c9b9675a-edc7-4a61-96e2-3a284ebaaa60 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Running cmd (subprocess): nvme version {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:07:10 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-c9b9675a-edc7-4a61-96e2-3a284ebaaa60 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] 'nvme version' failed. Not Retrying. {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 17:07:10 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c9b9675a-edc7-4a61-96e2-3a284ebaaa60 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] nvme not present on system {{(pid=71731) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 17:07:10 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:07:10 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 17:07:10 user nova-compute[71731]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 17:07:10 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2699f2a-285d-49f6-bb21-9b92bda93671]: (4, '') {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:07:10 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.lightos [None req-c9b9675a-edc7-4a61-96e2-3a284ebaaa60 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71731) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 17:07:10 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.lightos [None req-c9b9675a-edc7-4a61-96e2-3a284ebaaa60 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71731) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 17:07:10 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.lightos [None req-c9b9675a-edc7-4a61-96e2-3a284ebaaa60 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] LIGHTOS: no hostnqn found. {{(pid=71731) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 17:07:10 user nova-compute[71731]: DEBUG os_brick.utils [None req-c9b9675a-edc7-4a61-96e2-3a284ebaaa60 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:81501d91421', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 17:07:10 user nova-compute[71731]: DEBUG nova.virt.block_device [None req-c9b9675a-edc7-4a61-96e2-3a284ebaaa60 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] [instance: ae339f64-b90f-4399-baa5-1ad1e5051593] Updating existing volume attachment record: 93c2d21f-2bde-410d-8cf6-ccb6cc4f14da {{(pid=71731) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 17:07:12 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:07:12 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Cleaning up deleted instances with incomplete migration  {{(pid=71731) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 13 17:07:12 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:07:14 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:07:16 user nova-compute[71731]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c9b9675a-edc7-4a61-96e2-3a284ebaaa60 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] [instance: ae339f64-b90f-4399-baa5-1ad1e5051593] Calling os-brick to attach iSCSI Volume {{(pid=71731) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 17:07:16 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9b9675a-edc7-4a61-96e2-3a284ebaaa60 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8cf0118790>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:47665adf-cb34-4b24-9861-fc5bfbff2127', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uINbOAFT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 17:07:16 user nova-compute[71731]: WARNING os_brick.initiator.connectors.base [None req-c9b9675a-edc7-4a61-96e2-3a284ebaaa60 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 17:07:16 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-c9b9675a-edc7-4a61-96e2-3a284ebaaa60 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 17:07:16 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-c9b9675a-edc7-4a61-96e2-3a284ebaaa60 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 17:07:16 user nova-compute[71731]: WARNING os_brick.initiator.connectors.base [None req-c9b9675a-edc7-4a61-96e2-3a284ebaaa60 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 17:07:16 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-c9b9675a-edc7-4a61-96e2-3a284ebaaa60 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:47665adf-cb34-4b24-9861-fc5bfbff2127" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 17:07:16 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-c9b9675a-edc7-4a61-96e2-3a284ebaaa60 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:47665adf-cb34-4b24-9861-fc5bfbff2127" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 17:07:16 user nova-compute[71731]: INFO os_brick.initiator.connectors.iscsi [None req-c9b9675a-edc7-4a61-96e2-3a284ebaaa60 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 17:07:16 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47665adf-cb34-4b24-9861-fc5bfbff2127 -p 172.16.0.220:3260 {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:07:16 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47665adf-cb34-4b24-9861-fc5bfbff2127 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:07:16 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[631da4c7-bd2e-4106-80b1-7c3456fa3b4f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:07:16 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9b9675a-edc7-4a61-96e2-3a284ebaaa60 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 17:07:16 user nova-compute[71731]:  {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:07:16 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47665adf-cb34-4b24-9861-fc5bfbff2127 -p 172.16.0.220:3260 --interface default --op new {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:07:16 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47665adf-cb34-4b24-9861-fc5bfbff2127 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:07:16 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[87478d6d-0386-4ab0-88dd-a60fd4d6430b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:47665adf-cb34-4b24-9861-fc5bfbff2127] added\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:07:16 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9b9675a-edc7-4a61-96e2-3a284ebaaa60 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:47665adf-cb34-4b24-9861-fc5bfbff2127] added
Apr 13 17:07:16 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:07:16 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47665adf-cb34-4b24-9861-fc5bfbff2127 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:07:16 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47665adf-cb34-4b24-9861-fc5bfbff2127 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:07:16 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[425b50ef-8a30-4214-809e-682313c0df68]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:07:16 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9b9675a-edc7-4a61-96e2-3a284ebaaa60 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:07:16 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47665adf-cb34-4b24-9861-fc5bfbff2127 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:07:16 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47665adf-cb34-4b24-9861-fc5bfbff2127 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:07:16 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[fed3b035-5eff-41fd-b4e5-14853ded49cb]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:07:16 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9b9675a-edc7-4a61-96e2-3a284ebaaa60 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:07:16 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47665adf-cb34-4b24-9861-fc5bfbff2127 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uINbOAFT {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:07:16 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47665adf-cb34-4b24-9861-fc5bfbff2127 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uINbOAFT" returned: 0 in 0.024s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:07:16 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[504a84a8-dc82-4e70-bdaa-3aae16bd9f27]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:07:16 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9b9675a-edc7-4a61-96e2-3a284ebaaa60 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'uINbOAFT'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:07:16 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47665adf-cb34-4b24-9861-fc5bfbff2127 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:07:16 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47665adf-cb34-4b24-9861-fc5bfbff2127 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:07:16 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[75b7b8ee-9280-4b9f-a52e-c138a89c5e0a]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:07:16 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9b9675a-edc7-4a61-96e2-3a284ebaaa60 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:07:16 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:07:16 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:07:16 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[66e443ff-c700-4b6e-a7fa-6c529b2aa64b]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:07:16 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9b9675a-edc7-4a61-96e2-3a284ebaaa60 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Apr 13 17:07:16 user nova-compute[71731]:  {{(pid=71731) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 17:07:16 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9b9675a-edc7-4a61-96e2-3a284ebaaa60 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Apr 13 17:07:16 user nova-compute[71731]:  {{(pid=71731) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 17:07:16 user nova-compute[71731]: WARNING os_brick.initiator.connectors.iscsi [None req-c9b9675a-edc7-4a61-96e2-3a284ebaaa60 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Apr 13 17:07:16 user nova-compute[71731]: 
Apr 13 17:07:16 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47665adf-cb34-4b24-9861-fc5bfbff2127 -p 172.16.0.220:3260 --login {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:07:16 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47665adf-cb34-4b24-9861-fc5bfbff2127 -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:07:16 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[e115529a-fe36-4afc-9744-fbbcf668d7bf]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:47665adf-cb34-4b24-9861-fc5bfbff2127, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:47665adf-cb34-4b24-9861-fc5bfbff2127, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:07:16 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9b9675a-edc7-4a61-96e2-3a284ebaaa60 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:47665adf-cb34-4b24-9861-fc5bfbff2127, portal: 172.16.0.220,3260]
Apr 13 17:07:16 user nova-compute[71731]: Login to [iface: default, target: iqn.2010-10.org.openstack:47665adf-cb34-4b24-9861-fc5bfbff2127, portal: 172.16.0.220,3260] successful.
Apr 13 17:07:16 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:07:16 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47665adf-cb34-4b24-9861-fc5bfbff2127 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:07:16 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47665adf-cb34-4b24-9861-fc5bfbff2127 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:07:16 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[04529da1-37c8-4898-8ba6-07d4be1bcbd2]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:07:16 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9b9675a-edc7-4a61-96e2-3a284ebaaa60 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:07:16 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:07:16 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:07:16 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd957a08-a6bf-4dd4-a731-3acfd4f50f17]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47665adf-cb34-4b24-9861-fc5bfbff2127 (non-flash)\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:07:16 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9b9675a-edc7-4a61-96e2-3a284ebaaa60 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47665adf-cb34-4b24-9861-fc5bfbff2127 (non-flash)
Apr 13 17:07:16 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 17:07:16 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9b9675a-edc7-4a61-96e2-3a284ebaaa60 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47665adf-cb34-4b24-9861-fc5bfbff2127 (non-flash)
Apr 13 17:07:16 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 17:07:16 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-c9b9675a-edc7-4a61-96e2-3a284ebaaa60 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:47665adf-cb34-4b24-9861-fc5bfbff2127" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.245s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 17:07:16 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9b9675a-edc7-4a61-96e2-3a284ebaaa60 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Connected to 172.16.0.220:3260 {{(pid=71731) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 17:07:16 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-c9b9675a-edc7-4a61-96e2-3a284ebaaa60 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] HCTL ('33', '-', '-', 0) found on session 52 with lun 0 {{(pid=71731) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 17:07:16 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-c9b9675a-edc7-4a61-96e2-3a284ebaaa60 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71731) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 17:07:16 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:07:16 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:07:16 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[16dd356f-ca9e-4f0f-a4bc-b27e1ae46c94]: (4, ('- - 0', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:07:16 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-c9b9675a-edc7-4a61-96e2-3a284ebaaa60 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Searching for a device in session 52 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71731) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 17:07:16 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9b9675a-edc7-4a61-96e2-3a284ebaaa60 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:47665adf-cb34-4b24-9861-fc5bfbff2127', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uINbOAFT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71731) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 17:07:17 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:07:17 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-c9b9675a-edc7-4a61-96e2-3a284ebaaa60 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.277s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 17:07:17 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9b9675a-edc7-4a61-96e2-3a284ebaaa60 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] <== connect_volume: return (1279ms) {'type': 'block', 'scsi_wwn': '26533316437626266', 'path': '/dev/sdb'} {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 17:07:17 user nova-compute[71731]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c9b9675a-edc7-4a61-96e2-3a284ebaaa60 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] [instance: ae339f64-b90f-4399-baa5-1ad1e5051593] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26533316437626266', 'path': '/dev/sdb'} {{(pid=71731) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 17:07:17 user nova-compute[71731]: DEBUG nova.objects.instance [None req-c9b9675a-edc7-4a61-96e2-3a284ebaaa60 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lazy-loading 'flavor' on Instance uuid ae339f64-b90f-4399-baa5-1ad1e5051593 {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 17:07:17 user nova-compute[71731]: DEBUG nova.virt.libvirt.guest [None req-c9b9675a-edc7-4a61-96e2-3a284ebaaa60 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] attach device xml: <disk type="block" device="disk">
Apr 13 17:07:17 user nova-compute[71731]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 17:07:17 user nova-compute[71731]:   <source dev="/dev/sdb"/>
Apr 13 17:07:17 user nova-compute[71731]:   <target dev="vdb" bus="virtio"/>
Apr 13 17:07:17 user nova-compute[71731]:   <serial>47665adf-cb34-4b24-9861-fc5bfbff2127</serial>
Apr 13 17:07:17 user nova-compute[71731]: </disk>
Apr 13 17:07:17 user nova-compute[71731]:  {{(pid=71731) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 13 17:07:18 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-c9b9675a-edc7-4a61-96e2-3a284ebaaa60 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] No BDM found with device name vda, not building metadata. {{(pid=71731) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 17:07:18 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-c9b9675a-edc7-4a61-96e2-3a284ebaaa60 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71731) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 17:07:18 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-c9b9675a-edc7-4a61-96e2-3a284ebaaa60 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] No VIF found with MAC fa:16:3e:4f:9a:a9, not building metadata {{(pid=71731) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 17:07:18 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-c9b9675a-edc7-4a61-96e2-3a284ebaaa60 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "ae339f64-b90f-4399-baa5-1ad1e5051593" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.730s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:07:19 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-c99a00cc-6388-4ffb-a97b-3187676755ff tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Acquiring lock "ae339f64-b90f-4399-baa5-1ad1e5051593" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:07:19 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-c99a00cc-6388-4ffb-a97b-3187676755ff tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "ae339f64-b90f-4399-baa5-1ad1e5051593" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:07:19 user nova-compute[71731]: INFO nova.compute.manager [None req-c99a00cc-6388-4ffb-a97b-3187676755ff tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] [instance: ae339f64-b90f-4399-baa5-1ad1e5051593] Detaching volume 47665adf-cb34-4b24-9861-fc5bfbff2127
Apr 13 17:07:19 user nova-compute[71731]: INFO nova.virt.block_device [None req-c99a00cc-6388-4ffb-a97b-3187676755ff tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] [instance: ae339f64-b90f-4399-baa5-1ad1e5051593] Attempting to driver detach volume 47665adf-cb34-4b24-9861-fc5bfbff2127 from mountpoint /dev/vdb
Apr 13 17:07:19 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-c99a00cc-6388-4ffb-a97b-3187676755ff tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Attempting to detach device vdb from instance ae339f64-b90f-4399-baa5-1ad1e5051593 from the persistent domain config. {{(pid=71731) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 13 17:07:19 user nova-compute[71731]: DEBUG nova.virt.libvirt.guest [None req-c99a00cc-6388-4ffb-a97b-3187676755ff tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 17:07:19 user nova-compute[71731]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 17:07:19 user nova-compute[71731]:   <source dev="/dev/sdb"/>
Apr 13 17:07:19 user nova-compute[71731]:   <target dev="vdb" bus="virtio"/>
Apr 13 17:07:19 user nova-compute[71731]:   <serial>47665adf-cb34-4b24-9861-fc5bfbff2127</serial>
Apr 13 17:07:19 user nova-compute[71731]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 13 17:07:19 user nova-compute[71731]: </disk>
Apr 13 17:07:19 user nova-compute[71731]:  {{(pid=71731) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 17:07:19 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-c99a00cc-6388-4ffb-a97b-3187676755ff tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Successfully detached device vdb from instance ae339f64-b90f-4399-baa5-1ad1e5051593 from the persistent domain config.
Apr 13 17:07:19 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-c99a00cc-6388-4ffb-a97b-3187676755ff tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ae339f64-b90f-4399-baa5-1ad1e5051593 from the live domain config. {{(pid=71731) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 13 17:07:19 user nova-compute[71731]: DEBUG nova.virt.libvirt.guest [None req-c99a00cc-6388-4ffb-a97b-3187676755ff tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 17:07:19 user nova-compute[71731]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 17:07:19 user nova-compute[71731]:   <source dev="/dev/sdb"/>
Apr 13 17:07:19 user nova-compute[71731]:   <target dev="vdb" bus="virtio"/>
Apr 13 17:07:19 user nova-compute[71731]:   <serial>47665adf-cb34-4b24-9861-fc5bfbff2127</serial>
Apr 13 17:07:19 user nova-compute[71731]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 13 17:07:19 user nova-compute[71731]: </disk>
Apr 13 17:07:19 user nova-compute[71731]:  {{(pid=71731) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 17:07:19 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:07:19 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Received event <DeviceRemovedEvent: 1681405639.9910998, ae339f64-b90f-4399-baa5-1ad1e5051593 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71731) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 13 17:07:19 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-c99a00cc-6388-4ffb-a97b-3187676755ff tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ae339f64-b90f-4399-baa5-1ad1e5051593 {{(pid=71731) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 13 17:07:19 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-c99a00cc-6388-4ffb-a97b-3187676755ff tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Successfully detached device vdb from instance ae339f64-b90f-4399-baa5-1ad1e5051593 from the live domain config.
Apr 13 17:07:20 user nova-compute[71731]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c99a00cc-6388-4ffb-a97b-3187676755ff tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] [instance: ae339f64-b90f-4399-baa5-1ad1e5051593] calling os-brick to detach iSCSI Volume {{(pid=71731) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 17:07:20 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-c99a00cc-6388-4ffb-a97b-3187676755ff tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8cf0118790>, {'target_iqn': 'iqn.2010-10.org.openstack:47665adf-cb34-4b24-9861-fc5bfbff2127', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uINbOAFT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 17:07:20 user nova-compute[71731]: WARNING os_brick.initiator.connectors.base [None req-c99a00cc-6388-4ffb-a97b-3187676755ff tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 17:07:20 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-c99a00cc-6388-4ffb-a97b-3187676755ff tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 17:07:20 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-c99a00cc-6388-4ffb-a97b-3187676755ff tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 17:07:20 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:07:20 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:07:20 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[83063323-f44c-405e-b6e4-2c74217344b1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:47665adf-cb34-4b24-9861-fc5bfbff2127\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:07:20 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-c99a00cc-6388-4ffb-a97b-3187676755ff tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 17:07:20 user nova-compute[71731]: No targets found.
Apr 13 17:07:20 user nova-compute[71731]: iSNS:
Apr 13 17:07:20 user nova-compute[71731]: No targets found.
Apr 13 17:07:20 user nova-compute[71731]: STATIC:
Apr 13 17:07:20 user nova-compute[71731]: Target: iqn.2010-10.org.openstack:47665adf-cb34-4b24-9861-fc5bfbff2127
Apr 13 17:07:20 user nova-compute[71731]:         Portal: 172.16.0.220:3260,-1
Apr 13 17:07:20 user nova-compute[71731]:                 Iface Name: default
Apr 13 17:07:20 user nova-compute[71731]: FIRMWARE:
Apr 13 17:07:20 user nova-compute[71731]: No targets found.
Apr 13 17:07:20 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 17:07:20 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-c99a00cc-6388-4ffb-a97b-3187676755ff tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 17:07:20 user nova-compute[71731]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 17:07:20 user nova-compute[71731]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71731) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 17:07:20 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-c99a00cc-6388-4ffb-a97b-3187676755ff tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:47665adf-cb34-4b24-9861-fc5bfbff2127', 0)] {{(pid=71731) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 17:07:20 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:07:20 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:07:20 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d39334a-f229-4bb8-8596-9a6fe2aa6c7b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:47665adf-cb34-4b24-9861-fc5bfbff2127\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:07:20 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:07:20 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:07:20 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2aaf815-cecd-408d-b0da-49df5cde03a9]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47665adf-cb34-4b24-9861-fc5bfbff2127 (non-flash)\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:07:20 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-c99a00cc-6388-4ffb-a97b-3187676755ff tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47665adf-cb34-4b24-9861-fc5bfbff2127 (non-flash)
Apr 13 17:07:20 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 17:07:20 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-c99a00cc-6388-4ffb-a97b-3187676755ff tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47665adf-cb34-4b24-9861-fc5bfbff2127 (non-flash)
Apr 13 17:07:20 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 17:07:20 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-c99a00cc-6388-4ffb-a97b-3187676755ff tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8cb06d56c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:47665adf-cb34-4b24-9861-fc5bfbff2127'): ({'sdb'}, set())}) {{(pid=71731) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 17:07:20 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-c99a00cc-6388-4ffb-a97b-3187676755ff tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Removing single pathed devices sdb {{(pid=71731) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 17:07:20 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:07:20 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:07:20 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[be1f321c-3178-488f-a3ee-3b8a51ca0fb1]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:07:20 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:07:20 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:07:20 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[0de5b510-f7b7-4902-a20d-b875a38a6d08]: (4, ('ok\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:07:20 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-c99a00cc-6388-4ffb-a97b-3187676755ff tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Flushing IO for device /dev/sdb {{(pid=71731) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 17:07:20 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:07:20 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:07:20 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[9007bb9d-53ce-44b9-9eaa-5e1e38474fc7]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:07:20 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-c99a00cc-6388-4ffb-a97b-3187676755ff tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71731) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 17:07:20 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:07:20 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.055s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:07:20 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5246803-5ce4-4019-87bd-a39702aa5e25]: (4, ('1', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:07:20 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-c99a00cc-6388-4ffb-a97b-3187676755ff tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71731) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 17:07:20 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-c99a00cc-6388-4ffb-a97b-3187676755ff tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] SCSI volumes sdb have been removed. {{(pid=71731) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 17:07:20 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-c99a00cc-6388-4ffb-a97b-3187676755ff tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:47665adf-cb34-4b24-9861-fc5bfbff2127')] {{(pid=71731) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 17:07:20 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47665adf-cb34-4b24-9861-fc5bfbff2127 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:07:20 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47665adf-cb34-4b24-9861-fc5bfbff2127 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:07:20 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[d533b08b-0e82-476c-b0ff-14da89fb0d4f]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:07:20 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-c99a00cc-6388-4ffb-a97b-3187676755ff tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:07:20 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47665adf-cb34-4b24-9861-fc5bfbff2127 -p 172.16.0.220:3260 --logout {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:07:20 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47665adf-cb34-4b24-9861-fc5bfbff2127 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:07:20 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[316029b0-240a-48fb-84d5-31b5f0b10021]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:47665adf-cb34-4b24-9861-fc5bfbff2127, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:47665adf-cb34-4b24-9861-fc5bfbff2127, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:07:20 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-c99a00cc-6388-4ffb-a97b-3187676755ff tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:47665adf-cb34-4b24-9861-fc5bfbff2127, portal: 172.16.0.220,3260]
Apr 13 17:07:20 user nova-compute[71731]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:47665adf-cb34-4b24-9861-fc5bfbff2127, portal: 172.16.0.220,3260] successful.
Apr 13 17:07:20 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:07:20 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47665adf-cb34-4b24-9861-fc5bfbff2127 -p 172.16.0.220:3260 --op delete {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:07:20 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47665adf-cb34-4b24-9861-fc5bfbff2127 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:07:20 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[391ea5ff-31aa-4573-954f-42efdfa5eb36]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:07:20 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-c99a00cc-6388-4ffb-a97b-3187676755ff tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:07:20 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-c99a00cc-6388-4ffb-a97b-3187676755ff tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.325s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 17:07:20 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-c99a00cc-6388-4ffb-a97b-3187676755ff tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] <== disconnect_volume: return (327ms) None {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 17:07:20 user nova-compute[71731]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c99a00cc-6388-4ffb-a97b-3187676755ff tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] [instance: ae339f64-b90f-4399-baa5-1ad1e5051593] Disconnected iSCSI Volume {{(pid=71731) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 17:07:21 user nova-compute[71731]: DEBUG nova.objects.instance [None req-c99a00cc-6388-4ffb-a97b-3187676755ff tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lazy-loading 'flavor' on Instance uuid ae339f64-b90f-4399-baa5-1ad1e5051593 {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 17:07:21 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-c99a00cc-6388-4ffb-a97b-3187676755ff tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "ae339f64-b90f-4399-baa5-1ad1e5051593" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.621s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:07:22 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:07:24 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:07:29 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 17:07:29 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:07:29 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71731) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 17:07:29 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71731) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 17:07:29 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71731) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 17:07:29 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:07:34 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 17:07:37 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:07:39 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:07:42 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:07:44 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:07:44 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71731) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 17:07:44 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:07:45 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:07:48 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:07:48 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._sync_power_states {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:07:48 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Triggering sync for uuid ae339f64-b90f-4399-baa5-1ad1e5051593 {{(pid=71731) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 13 17:07:48 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Acquiring lock "ae339f64-b90f-4399-baa5-1ad1e5051593" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:07:48 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "ae339f64-b90f-4399-baa5-1ad1e5051593" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:07:48 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "ae339f64-b90f-4399-baa5-1ad1e5051593" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.027s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:07:49 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:07:49 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:07:50 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:07:50 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager.update_available_resource {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:07:50 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:07:50 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:07:50 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:07:50 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Auditing locally available compute resources for user (node: user) {{(pid=71731) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 17:07:50 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae339f64-b90f-4399-baa5-1ad1e5051593/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:07:50 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae339f64-b90f-4399-baa5-1ad1e5051593/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:07:50 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae339f64-b90f-4399-baa5-1ad1e5051593/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:07:50 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae339f64-b90f-4399-baa5-1ad1e5051593/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:07:50 user nova-compute[71731]: WARNING nova.virt.libvirt.driver [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 17:07:50 user nova-compute[71731]: WARNING nova.virt.libvirt.driver [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 17:07:50 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Hypervisor/Node resource view: name=user free_ram=8760MB free_disk=26.039562225341797GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71731) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 17:07:50 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:07:50 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:07:51 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance ae339f64-b90f-4399-baa5-1ad1e5051593 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 17:07:51 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=71731) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 17:07:51 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=71731) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 17:07:51 user nova-compute[71731]: DEBUG nova.scheduler.client.report [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Refreshing inventories for resource provider cb6b1a64-0c24-4e2d-af1e-16576ca9165c {{(pid=71731) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 13 17:07:51 user nova-compute[71731]: DEBUG nova.scheduler.client.report [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Updating ProviderTree inventory for provider cb6b1a64-0c24-4e2d-af1e-16576ca9165c from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71731) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 13 17:07:51 user nova-compute[71731]: DEBUG nova.compute.provider_tree [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Updating inventory in ProviderTree for provider cb6b1a64-0c24-4e2d-af1e-16576ca9165c with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71731) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 13 17:07:51 user nova-compute[71731]: DEBUG nova.scheduler.client.report [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Refreshing aggregate associations for resource provider cb6b1a64-0c24-4e2d-af1e-16576ca9165c, aggregates: None {{(pid=71731) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 13 17:07:51 user nova-compute[71731]: DEBUG nova.scheduler.client.report [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Refreshing trait associations for resource provider cb6b1a64-0c24-4e2d-af1e-16576ca9165c, traits: COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSSE3,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_SATA,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_SSE,COMPUTE_RESCUE_BFV,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE41,HW_CPU_X86_MMX,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_RAW {{(pid=71731) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 13 17:07:51 user nova-compute[71731]: DEBUG nova.compute.provider_tree [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Inventory has not changed in ProviderTree for provider: cb6b1a64-0c24-4e2d-af1e-16576ca9165c {{(pid=71731) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 17:07:51 user nova-compute[71731]: DEBUG nova.scheduler.client.report [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Inventory has not changed for provider cb6b1a64-0c24-4e2d-af1e-16576ca9165c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71731) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 17:07:51 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Compute_service record updated for user:user {{(pid=71731) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 17:07:51 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.517s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:07:53 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:07:53 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Starting heal instance info cache {{(pid=71731) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 17:07:53 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Rebuilding the list of instances to heal {{(pid=71731) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 13 17:07:53 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Acquiring lock "refresh_cache-ae339f64-b90f-4399-baa5-1ad1e5051593" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 17:07:53 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Acquired lock "refresh_cache-ae339f64-b90f-4399-baa5-1ad1e5051593" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 17:07:53 user nova-compute[71731]: DEBUG nova.network.neutron [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] [instance: ae339f64-b90f-4399-baa5-1ad1e5051593] Forcefully refreshing network info cache for instance {{(pid=71731) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 17:07:53 user nova-compute[71731]: DEBUG nova.objects.instance [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lazy-loading 'info_cache' on Instance uuid ae339f64-b90f-4399-baa5-1ad1e5051593 {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 17:07:54 user nova-compute[71731]: DEBUG nova.network.neutron [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] [instance: ae339f64-b90f-4399-baa5-1ad1e5051593] Updating instance_info_cache with network_info: [{"id": "99071c3f-4bc5-47e9-9427-4ed6114e40a5", "address": "fa:16:3e:4f:9a:a9", "network": {"id": "436011a9-c48b-4f33-a576-a245b344dd72", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-116243831-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "097b15faad8249c9bf45623d0c3ab518", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99071c3f-4b", "ovs_interfaceid": "99071c3f-4bc5-47e9-9427-4ed6114e40a5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 17:07:54 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Releasing lock "refresh_cache-ae339f64-b90f-4399-baa5-1ad1e5051593" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 17:07:54 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] [instance: ae339f64-b90f-4399-baa5-1ad1e5051593] Updated the network info_cache for instance {{(pid=71731) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 17:07:54 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:07:54 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:07:54 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 17:07:59 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 17:08:04 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:08:09 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 17:08:09 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-a851162d-f7b9-447f-9c8a-c15c81076b07 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Acquiring lock "ae339f64-b90f-4399-baa5-1ad1e5051593" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:08:09 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-a851162d-f7b9-447f-9c8a-c15c81076b07 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "ae339f64-b90f-4399-baa5-1ad1e5051593" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:08:09 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-a851162d-f7b9-447f-9c8a-c15c81076b07 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Acquiring lock "ae339f64-b90f-4399-baa5-1ad1e5051593-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:08:09 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-a851162d-f7b9-447f-9c8a-c15c81076b07 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "ae339f64-b90f-4399-baa5-1ad1e5051593-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:08:09 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-a851162d-f7b9-447f-9c8a-c15c81076b07 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "ae339f64-b90f-4399-baa5-1ad1e5051593-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:08:09 user nova-compute[71731]: INFO nova.compute.manager [None req-a851162d-f7b9-447f-9c8a-c15c81076b07 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] [instance: ae339f64-b90f-4399-baa5-1ad1e5051593] Terminating instance
Apr 13 17:08:09 user nova-compute[71731]: DEBUG nova.compute.manager [None req-a851162d-f7b9-447f-9c8a-c15c81076b07 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] [instance: ae339f64-b90f-4399-baa5-1ad1e5051593] Start destroying the instance on the hypervisor. {{(pid=71731) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 17:08:09 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:08:09 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:08:09 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:08:10 user nova-compute[71731]: DEBUG nova.compute.manager [req-28b793e0-30b2-4cbb-96d5-4f355cb0009b req-273727ae-e5d0-4d87-abc4-ac2aa17b1ad4 service nova] [instance: ae339f64-b90f-4399-baa5-1ad1e5051593] Received event network-vif-unplugged-99071c3f-4bc5-47e9-9427-4ed6114e40a5 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:08:10 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-28b793e0-30b2-4cbb-96d5-4f355cb0009b req-273727ae-e5d0-4d87-abc4-ac2aa17b1ad4 service nova] Acquiring lock "ae339f64-b90f-4399-baa5-1ad1e5051593-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:08:10 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-28b793e0-30b2-4cbb-96d5-4f355cb0009b req-273727ae-e5d0-4d87-abc4-ac2aa17b1ad4 service nova] Lock "ae339f64-b90f-4399-baa5-1ad1e5051593-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:08:10 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-28b793e0-30b2-4cbb-96d5-4f355cb0009b req-273727ae-e5d0-4d87-abc4-ac2aa17b1ad4 service nova] Lock "ae339f64-b90f-4399-baa5-1ad1e5051593-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:08:10 user nova-compute[71731]: DEBUG nova.compute.manager [req-28b793e0-30b2-4cbb-96d5-4f355cb0009b req-273727ae-e5d0-4d87-abc4-ac2aa17b1ad4 service nova] [instance: ae339f64-b90f-4399-baa5-1ad1e5051593] No waiting events found dispatching network-vif-unplugged-99071c3f-4bc5-47e9-9427-4ed6114e40a5 {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 17:08:10 user nova-compute[71731]: DEBUG nova.compute.manager [req-28b793e0-30b2-4cbb-96d5-4f355cb0009b req-273727ae-e5d0-4d87-abc4-ac2aa17b1ad4 service nova] [instance: ae339f64-b90f-4399-baa5-1ad1e5051593] Received event network-vif-unplugged-99071c3f-4bc5-47e9-9427-4ed6114e40a5 for instance with task_state deleting. {{(pid=71731) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 17:08:10 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:08:10 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:08:10 user nova-compute[71731]: INFO nova.virt.libvirt.driver [-] [instance: ae339f64-b90f-4399-baa5-1ad1e5051593] Instance destroyed successfully.
Apr 13 17:08:10 user nova-compute[71731]: DEBUG nova.objects.instance [None req-a851162d-f7b9-447f-9c8a-c15c81076b07 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lazy-loading 'resources' on Instance uuid ae339f64-b90f-4399-baa5-1ad1e5051593 {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 17:08:10 user nova-compute[71731]: DEBUG nova.virt.libvirt.vif [None req-a851162d-f7b9-447f-9c8a-c15c81076b07 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T17:05:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-2098457470',display_name='tempest-AttachVolumeNegativeTest-server-2098457470',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-2098457470',id=46,image_ref='708622a9-7465-4492-ade8-b827198f7e30',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBESykv5tW83kHbwBGFQOvSCy+ICNt4W0TQ1jPtqTWGBoErb8Q7X135LOLGGhPK3SnAx4kT7bpNF/X4w5BBRqCpxWFXGF/m9Ir1Ke1mquI92zdi2E1wCJREcaMQNLTOTvVw==',key_name='tempest-keypair-1795442799',keypairs=<?>,launch_index=0,launched_at=2023-04-13T17:05:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='097b15faad8249c9bf45623d0c3ab518',ramdisk_id='',reservation_id='r-xr7qbflx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='708622a9-7465-4492-ade8-b827198f7e30',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-236067262',owner_user_name='tempest-AttachVolumeNegativeTest-236067262-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T17:05:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a08b0caad23045c1822cdd0b3ae0769f',uuid=ae339f64-b90f-4399-baa5-1ad1e5051593,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "99071c3f-4bc5-47e9-9427-4ed6114e40a5", "address": "fa:16:3e:4f:9a:a9", "network": {"id": "436011a9-c48b-4f33-a576-a245b344dd72", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-116243831-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "097b15faad8249c9bf45623d0c3ab518", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99071c3f-4b", "ovs_interfaceid": "99071c3f-4bc5-47e9-9427-4ed6114e40a5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 17:08:10 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-a851162d-f7b9-447f-9c8a-c15c81076b07 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Converting VIF {"id": "99071c3f-4bc5-47e9-9427-4ed6114e40a5", "address": "fa:16:3e:4f:9a:a9", "network": {"id": "436011a9-c48b-4f33-a576-a245b344dd72", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-116243831-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "097b15faad8249c9bf45623d0c3ab518", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99071c3f-4b", "ovs_interfaceid": "99071c3f-4bc5-47e9-9427-4ed6114e40a5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 17:08:10 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-a851162d-f7b9-447f-9c8a-c15c81076b07 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4f:9a:a9,bridge_name='br-int',has_traffic_filtering=True,id=99071c3f-4bc5-47e9-9427-4ed6114e40a5,network=Network(436011a9-c48b-4f33-a576-a245b344dd72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99071c3f-4b') {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 17:08:10 user nova-compute[71731]: DEBUG os_vif [None req-a851162d-f7b9-447f-9c8a-c15c81076b07 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4f:9a:a9,bridge_name='br-int',has_traffic_filtering=True,id=99071c3f-4bc5-47e9-9427-4ed6114e40a5,network=Network(436011a9-c48b-4f33-a576-a245b344dd72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99071c3f-4b') {{(pid=71731) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 17:08:10 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:08:10 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap99071c3f-4b, bridge=br-int, if_exists=True) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 17:08:10 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:08:10 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 17:08:10 user nova-compute[71731]: INFO os_vif [None req-a851162d-f7b9-447f-9c8a-c15c81076b07 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4f:9a:a9,bridge_name='br-int',has_traffic_filtering=True,id=99071c3f-4bc5-47e9-9427-4ed6114e40a5,network=Network(436011a9-c48b-4f33-a576-a245b344dd72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99071c3f-4b')
Apr 13 17:08:10 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-a851162d-f7b9-447f-9c8a-c15c81076b07 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] [instance: ae339f64-b90f-4399-baa5-1ad1e5051593] Deleting instance files /opt/stack/data/nova/instances/ae339f64-b90f-4399-baa5-1ad1e5051593_del
Apr 13 17:08:10 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-a851162d-f7b9-447f-9c8a-c15c81076b07 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] [instance: ae339f64-b90f-4399-baa5-1ad1e5051593] Deletion of /opt/stack/data/nova/instances/ae339f64-b90f-4399-baa5-1ad1e5051593_del complete
Apr 13 17:08:10 user nova-compute[71731]: INFO nova.compute.manager [None req-a851162d-f7b9-447f-9c8a-c15c81076b07 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] [instance: ae339f64-b90f-4399-baa5-1ad1e5051593] Took 0.86 seconds to destroy the instance on the hypervisor.
Apr 13 17:08:10 user nova-compute[71731]: DEBUG oslo.service.loopingcall [None req-a851162d-f7b9-447f-9c8a-c15c81076b07 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71731) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 17:08:10 user nova-compute[71731]: DEBUG nova.compute.manager [-] [instance: ae339f64-b90f-4399-baa5-1ad1e5051593] Deallocating network for instance {{(pid=71731) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 17:08:10 user nova-compute[71731]: DEBUG nova.network.neutron [-] [instance: ae339f64-b90f-4399-baa5-1ad1e5051593] deallocate_for_instance() {{(pid=71731) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 17:08:11 user nova-compute[71731]: DEBUG nova.network.neutron [-] [instance: ae339f64-b90f-4399-baa5-1ad1e5051593] Updating instance_info_cache with network_info: [] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 17:08:11 user nova-compute[71731]: INFO nova.compute.manager [-] [instance: ae339f64-b90f-4399-baa5-1ad1e5051593] Took 0.73 seconds to deallocate network for instance.
Apr 13 17:08:11 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-a851162d-f7b9-447f-9c8a-c15c81076b07 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:08:11 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-a851162d-f7b9-447f-9c8a-c15c81076b07 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:08:11 user nova-compute[71731]: DEBUG nova.compute.manager [req-625382f6-299d-4b64-b5ac-2de005a6554f req-08087bcb-1fbb-4ec4-823c-f2bb512e2dd0 service nova] [instance: ae339f64-b90f-4399-baa5-1ad1e5051593] Received event network-vif-deleted-99071c3f-4bc5-47e9-9427-4ed6114e40a5 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:08:11 user nova-compute[71731]: DEBUG nova.compute.provider_tree [None req-a851162d-f7b9-447f-9c8a-c15c81076b07 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Inventory has not changed in ProviderTree for provider: cb6b1a64-0c24-4e2d-af1e-16576ca9165c {{(pid=71731) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 17:08:11 user nova-compute[71731]: DEBUG nova.scheduler.client.report [None req-a851162d-f7b9-447f-9c8a-c15c81076b07 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Inventory has not changed for provider cb6b1a64-0c24-4e2d-af1e-16576ca9165c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71731) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 17:08:11 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-a851162d-f7b9-447f-9c8a-c15c81076b07 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.118s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:08:11 user nova-compute[71731]: INFO nova.scheduler.client.report [None req-a851162d-f7b9-447f-9c8a-c15c81076b07 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Deleted allocations for instance ae339f64-b90f-4399-baa5-1ad1e5051593
Apr 13 17:08:11 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-a851162d-f7b9-447f-9c8a-c15c81076b07 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "ae339f64-b90f-4399-baa5-1ad1e5051593" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.883s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:08:12 user nova-compute[71731]: DEBUG nova.compute.manager [req-37fce6d3-6ab0-46bb-9358-7efa6bba9891 req-260f898e-767a-49da-b751-d6b23671c4b0 service nova] [instance: ae339f64-b90f-4399-baa5-1ad1e5051593] Received event network-vif-plugged-99071c3f-4bc5-47e9-9427-4ed6114e40a5 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:08:12 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-37fce6d3-6ab0-46bb-9358-7efa6bba9891 req-260f898e-767a-49da-b751-d6b23671c4b0 service nova] Acquiring lock "ae339f64-b90f-4399-baa5-1ad1e5051593-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:08:12 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-37fce6d3-6ab0-46bb-9358-7efa6bba9891 req-260f898e-767a-49da-b751-d6b23671c4b0 service nova] Lock "ae339f64-b90f-4399-baa5-1ad1e5051593-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:08:12 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-37fce6d3-6ab0-46bb-9358-7efa6bba9891 req-260f898e-767a-49da-b751-d6b23671c4b0 service nova] Lock "ae339f64-b90f-4399-baa5-1ad1e5051593-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:08:12 user nova-compute[71731]: DEBUG nova.compute.manager [req-37fce6d3-6ab0-46bb-9358-7efa6bba9891 req-260f898e-767a-49da-b751-d6b23671c4b0 service nova] [instance: ae339f64-b90f-4399-baa5-1ad1e5051593] No waiting events found dispatching network-vif-plugged-99071c3f-4bc5-47e9-9427-4ed6114e40a5 {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 17:08:12 user nova-compute[71731]: WARNING nova.compute.manager [req-37fce6d3-6ab0-46bb-9358-7efa6bba9891 req-260f898e-767a-49da-b751-d6b23671c4b0 service nova] [instance: ae339f64-b90f-4399-baa5-1ad1e5051593] Received unexpected event network-vif-plugged-99071c3f-4bc5-47e9-9427-4ed6114e40a5 for instance with vm_state deleted and task_state None.
Apr 13 17:08:15 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:08:20 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:08:25 user nova-compute[71731]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681405690.6011012, ae339f64-b90f-4399-baa5-1ad1e5051593 => Stopped> {{(pid=71731) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 17:08:25 user nova-compute[71731]: INFO nova.compute.manager [-] [instance: ae339f64-b90f-4399-baa5-1ad1e5051593] VM Stopped (Lifecycle Event)
Apr 13 17:08:25 user nova-compute[71731]: DEBUG nova.compute.manager [None req-63b63dbc-7ec8-4551-ac40-98fba378f56a None None] [instance: ae339f64-b90f-4399-baa5-1ad1e5051593] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 17:08:25 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 17:08:30 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 17:08:35 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:08:40 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 17:08:45 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 17:08:45 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:08:45 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71731) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 17:08:45 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71731) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 17:08:45 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71731) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 17:08:45 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:08:46 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:08:46 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71731) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 17:08:47 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:08:49 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:08:50 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:08:50 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 17:08:52 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:08:52 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager.update_available_resource {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:08:52 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:08:52 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:08:52 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:08:52 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Auditing locally available compute resources for user (node: user) {{(pid=71731) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 17:08:52 user nova-compute[71731]: WARNING nova.virt.libvirt.driver [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 17:08:52 user nova-compute[71731]: WARNING nova.virt.libvirt.driver [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 17:08:52 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Hypervisor/Node resource view: name=user free_ram=8870MB free_disk=26.058597564697266GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71731) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 17:08:52 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:08:52 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:08:52 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=71731) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 17:08:52 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=71731) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 17:08:52 user nova-compute[71731]: DEBUG nova.compute.provider_tree [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Inventory has not changed in ProviderTree for provider: cb6b1a64-0c24-4e2d-af1e-16576ca9165c {{(pid=71731) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 17:08:52 user nova-compute[71731]: DEBUG nova.scheduler.client.report [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Inventory has not changed for provider cb6b1a64-0c24-4e2d-af1e-16576ca9165c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71731) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 17:08:52 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Compute_service record updated for user:user {{(pid=71731) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 17:08:52 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.148s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:08:54 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:08:54 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Starting heal instance info cache {{(pid=71731) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 17:08:54 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Rebuilding the list of instances to heal {{(pid=71731) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 13 17:08:54 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Didn't find any instances for network info cache update. {{(pid=71731) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 13 17:08:54 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:08:55 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:08:55 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:09:00 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:09:01 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:09:03 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-a2271a36-0d45-4be0-8c6a-ac7178904d5a tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Acquiring lock "f8829c88-70e9-43fb-97b0-d7f46e1de0ae" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:09:03 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-a2271a36-0d45-4be0-8c6a-ac7178904d5a tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "f8829c88-70e9-43fb-97b0-d7f46e1de0ae" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:09:03 user nova-compute[71731]: DEBUG nova.compute.manager [None req-a2271a36-0d45-4be0-8c6a-ac7178904d5a tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] [instance: f8829c88-70e9-43fb-97b0-d7f46e1de0ae] Starting instance... {{(pid=71731) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 17:09:03 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-a2271a36-0d45-4be0-8c6a-ac7178904d5a tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:09:03 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-a2271a36-0d45-4be0-8c6a-ac7178904d5a tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:09:03 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-a2271a36-0d45-4be0-8c6a-ac7178904d5a tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71731) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 17:09:03 user nova-compute[71731]: INFO nova.compute.claims [None req-a2271a36-0d45-4be0-8c6a-ac7178904d5a tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] [instance: f8829c88-70e9-43fb-97b0-d7f46e1de0ae] Claim successful on node user
Apr 13 17:09:04 user nova-compute[71731]: DEBUG nova.compute.provider_tree [None req-a2271a36-0d45-4be0-8c6a-ac7178904d5a tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Inventory has not changed in ProviderTree for provider: cb6b1a64-0c24-4e2d-af1e-16576ca9165c {{(pid=71731) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 17:09:04 user nova-compute[71731]: DEBUG nova.scheduler.client.report [None req-a2271a36-0d45-4be0-8c6a-ac7178904d5a tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Inventory has not changed for provider cb6b1a64-0c24-4e2d-af1e-16576ca9165c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71731) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 17:09:04 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-a2271a36-0d45-4be0-8c6a-ac7178904d5a tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.185s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:09:04 user nova-compute[71731]: DEBUG nova.compute.manager [None req-a2271a36-0d45-4be0-8c6a-ac7178904d5a tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] [instance: f8829c88-70e9-43fb-97b0-d7f46e1de0ae] Start building networks asynchronously for instance. {{(pid=71731) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 17:09:04 user nova-compute[71731]: DEBUG nova.compute.manager [None req-a2271a36-0d45-4be0-8c6a-ac7178904d5a tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] [instance: f8829c88-70e9-43fb-97b0-d7f46e1de0ae] Allocating IP information in the background. {{(pid=71731) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 17:09:04 user nova-compute[71731]: DEBUG nova.network.neutron [None req-a2271a36-0d45-4be0-8c6a-ac7178904d5a tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] [instance: f8829c88-70e9-43fb-97b0-d7f46e1de0ae] allocate_for_instance() {{(pid=71731) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 17:09:04 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-a2271a36-0d45-4be0-8c6a-ac7178904d5a tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] [instance: f8829c88-70e9-43fb-97b0-d7f46e1de0ae] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 17:09:04 user nova-compute[71731]: DEBUG nova.compute.manager [None req-a2271a36-0d45-4be0-8c6a-ac7178904d5a tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] [instance: f8829c88-70e9-43fb-97b0-d7f46e1de0ae] Start building block device mappings for instance. {{(pid=71731) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 17:09:04 user nova-compute[71731]: DEBUG nova.policy [None req-a2271a36-0d45-4be0-8c6a-ac7178904d5a tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a08b0caad23045c1822cdd0b3ae0769f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097b15faad8249c9bf45623d0c3ab518', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71731) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 17:09:04 user nova-compute[71731]: DEBUG nova.compute.manager [None req-a2271a36-0d45-4be0-8c6a-ac7178904d5a tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] [instance: f8829c88-70e9-43fb-97b0-d7f46e1de0ae] Start spawning the instance on the hypervisor. {{(pid=71731) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 17:09:04 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-a2271a36-0d45-4be0-8c6a-ac7178904d5a tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] [instance: f8829c88-70e9-43fb-97b0-d7f46e1de0ae] Creating instance directory {{(pid=71731) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 17:09:04 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-a2271a36-0d45-4be0-8c6a-ac7178904d5a tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] [instance: f8829c88-70e9-43fb-97b0-d7f46e1de0ae] Creating image(s)
Apr 13 17:09:04 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-a2271a36-0d45-4be0-8c6a-ac7178904d5a tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Acquiring lock "/opt/stack/data/nova/instances/f8829c88-70e9-43fb-97b0-d7f46e1de0ae/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:09:04 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-a2271a36-0d45-4be0-8c6a-ac7178904d5a tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "/opt/stack/data/nova/instances/f8829c88-70e9-43fb-97b0-d7f46e1de0ae/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:09:04 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-a2271a36-0d45-4be0-8c6a-ac7178904d5a tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "/opt/stack/data/nova/instances/f8829c88-70e9-43fb-97b0-d7f46e1de0ae/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:09:04 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-a2271a36-0d45-4be0-8c6a-ac7178904d5a tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279 --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:09:04 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-a2271a36-0d45-4be0-8c6a-ac7178904d5a tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279 --force-share --output=json" returned: 0 in 0.138s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:09:04 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-a2271a36-0d45-4be0-8c6a-ac7178904d5a tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Acquiring lock "9524227dd898575c3099d3976f096cd935414279" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:09:04 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-a2271a36-0d45-4be0-8c6a-ac7178904d5a tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "9524227dd898575c3099d3976f096cd935414279" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:09:04 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-a2271a36-0d45-4be0-8c6a-ac7178904d5a tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279 --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:09:04 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-a2271a36-0d45-4be0-8c6a-ac7178904d5a tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279 --force-share --output=json" returned: 0 in 0.141s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:09:04 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-a2271a36-0d45-4be0-8c6a-ac7178904d5a tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279,backing_fmt=raw /opt/stack/data/nova/instances/f8829c88-70e9-43fb-97b0-d7f46e1de0ae/disk 1073741824 {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:09:04 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-a2271a36-0d45-4be0-8c6a-ac7178904d5a tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279,backing_fmt=raw /opt/stack/data/nova/instances/f8829c88-70e9-43fb-97b0-d7f46e1de0ae/disk 1073741824" returned: 0 in 0.056s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:09:04 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-a2271a36-0d45-4be0-8c6a-ac7178904d5a tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "9524227dd898575c3099d3976f096cd935414279" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.211s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:09:04 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-a2271a36-0d45-4be0-8c6a-ac7178904d5a tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279 --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:09:04 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-a2271a36-0d45-4be0-8c6a-ac7178904d5a tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9524227dd898575c3099d3976f096cd935414279 --force-share --output=json" returned: 0 in 0.140s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:09:04 user nova-compute[71731]: DEBUG nova.virt.disk.api [None req-a2271a36-0d45-4be0-8c6a-ac7178904d5a tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f8829c88-70e9-43fb-97b0-d7f46e1de0ae/disk. size=1073741824 {{(pid=71731) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 17:09:04 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-a2271a36-0d45-4be0-8c6a-ac7178904d5a tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8829c88-70e9-43fb-97b0-d7f46e1de0ae/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:09:04 user nova-compute[71731]: DEBUG nova.network.neutron [None req-a2271a36-0d45-4be0-8c6a-ac7178904d5a tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] [instance: f8829c88-70e9-43fb-97b0-d7f46e1de0ae] Successfully created port: fb551510-e993-47ad-b0d1-63c0b5845056 {{(pid=71731) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 17:09:04 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-a2271a36-0d45-4be0-8c6a-ac7178904d5a tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8829c88-70e9-43fb-97b0-d7f46e1de0ae/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:09:04 user nova-compute[71731]: DEBUG nova.virt.disk.api [None req-a2271a36-0d45-4be0-8c6a-ac7178904d5a tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Cannot resize image /opt/stack/data/nova/instances/f8829c88-70e9-43fb-97b0-d7f46e1de0ae/disk to a smaller size. {{(pid=71731) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 17:09:04 user nova-compute[71731]: DEBUG nova.objects.instance [None req-a2271a36-0d45-4be0-8c6a-ac7178904d5a tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lazy-loading 'migration_context' on Instance uuid f8829c88-70e9-43fb-97b0-d7f46e1de0ae {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 17:09:04 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-a2271a36-0d45-4be0-8c6a-ac7178904d5a tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] [instance: f8829c88-70e9-43fb-97b0-d7f46e1de0ae] Created local disks {{(pid=71731) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 17:09:04 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-a2271a36-0d45-4be0-8c6a-ac7178904d5a tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] [instance: f8829c88-70e9-43fb-97b0-d7f46e1de0ae] Ensure instance console log exists: /opt/stack/data/nova/instances/f8829c88-70e9-43fb-97b0-d7f46e1de0ae/console.log {{(pid=71731) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 17:09:04 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-a2271a36-0d45-4be0-8c6a-ac7178904d5a tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:09:04 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-a2271a36-0d45-4be0-8c6a-ac7178904d5a tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:09:04 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-a2271a36-0d45-4be0-8c6a-ac7178904d5a tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:09:05 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:09:05 user nova-compute[71731]: DEBUG nova.network.neutron [None req-a2271a36-0d45-4be0-8c6a-ac7178904d5a tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] [instance: f8829c88-70e9-43fb-97b0-d7f46e1de0ae] Successfully updated port: fb551510-e993-47ad-b0d1-63c0b5845056 {{(pid=71731) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 17:09:05 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-a2271a36-0d45-4be0-8c6a-ac7178904d5a tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Acquiring lock "refresh_cache-f8829c88-70e9-43fb-97b0-d7f46e1de0ae" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 17:09:05 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-a2271a36-0d45-4be0-8c6a-ac7178904d5a tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Acquired lock "refresh_cache-f8829c88-70e9-43fb-97b0-d7f46e1de0ae" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 17:09:05 user nova-compute[71731]: DEBUG nova.network.neutron [None req-a2271a36-0d45-4be0-8c6a-ac7178904d5a tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] [instance: f8829c88-70e9-43fb-97b0-d7f46e1de0ae] Building network info cache for instance {{(pid=71731) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 17:09:05 user nova-compute[71731]: DEBUG nova.compute.manager [req-6877908a-b0a9-4b8b-9c76-7769574955e2 req-6bb19238-440a-4dca-84a8-8959c567d644 service nova] [instance: f8829c88-70e9-43fb-97b0-d7f46e1de0ae] Received event network-changed-fb551510-e993-47ad-b0d1-63c0b5845056 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:09:05 user nova-compute[71731]: DEBUG nova.compute.manager [req-6877908a-b0a9-4b8b-9c76-7769574955e2 req-6bb19238-440a-4dca-84a8-8959c567d644 service nova] [instance: f8829c88-70e9-43fb-97b0-d7f46e1de0ae] Refreshing instance network info cache due to event network-changed-fb551510-e993-47ad-b0d1-63c0b5845056. {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 17:09:05 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-6877908a-b0a9-4b8b-9c76-7769574955e2 req-6bb19238-440a-4dca-84a8-8959c567d644 service nova] Acquiring lock "refresh_cache-f8829c88-70e9-43fb-97b0-d7f46e1de0ae" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 17:09:05 user nova-compute[71731]: DEBUG nova.network.neutron [None req-a2271a36-0d45-4be0-8c6a-ac7178904d5a tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] [instance: f8829c88-70e9-43fb-97b0-d7f46e1de0ae] Instance cache missing network info. {{(pid=71731) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 17:09:06 user nova-compute[71731]: DEBUG nova.network.neutron [None req-a2271a36-0d45-4be0-8c6a-ac7178904d5a tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] [instance: f8829c88-70e9-43fb-97b0-d7f46e1de0ae] Updating instance_info_cache with network_info: [{"id": "fb551510-e993-47ad-b0d1-63c0b5845056", "address": "fa:16:3e:02:68:1c", "network": {"id": "436011a9-c48b-4f33-a576-a245b344dd72", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-116243831-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "097b15faad8249c9bf45623d0c3ab518", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb551510-e9", "ovs_interfaceid": "fb551510-e993-47ad-b0d1-63c0b5845056", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 17:09:06 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-a2271a36-0d45-4be0-8c6a-ac7178904d5a tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Releasing lock "refresh_cache-f8829c88-70e9-43fb-97b0-d7f46e1de0ae" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 17:09:06 user nova-compute[71731]: DEBUG nova.compute.manager [None req-a2271a36-0d45-4be0-8c6a-ac7178904d5a tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] [instance: f8829c88-70e9-43fb-97b0-d7f46e1de0ae] Instance network_info: |[{"id": "fb551510-e993-47ad-b0d1-63c0b5845056", "address": "fa:16:3e:02:68:1c", "network": {"id": "436011a9-c48b-4f33-a576-a245b344dd72", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-116243831-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "097b15faad8249c9bf45623d0c3ab518", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb551510-e9", "ovs_interfaceid": "fb551510-e993-47ad-b0d1-63c0b5845056", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71731) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 17:09:06 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-6877908a-b0a9-4b8b-9c76-7769574955e2 req-6bb19238-440a-4dca-84a8-8959c567d644 service nova] Acquired lock "refresh_cache-f8829c88-70e9-43fb-97b0-d7f46e1de0ae" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 17:09:06 user nova-compute[71731]: DEBUG nova.network.neutron [req-6877908a-b0a9-4b8b-9c76-7769574955e2 req-6bb19238-440a-4dca-84a8-8959c567d644 service nova] [instance: f8829c88-70e9-43fb-97b0-d7f46e1de0ae] Refreshing network info cache for port fb551510-e993-47ad-b0d1-63c0b5845056 {{(pid=71731) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 17:09:06 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-a2271a36-0d45-4be0-8c6a-ac7178904d5a tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] [instance: f8829c88-70e9-43fb-97b0-d7f46e1de0ae] Start _get_guest_xml network_info=[{"id": "fb551510-e993-47ad-b0d1-63c0b5845056", "address": "fa:16:3e:02:68:1c", "network": {"id": "436011a9-c48b-4f33-a576-a245b344dd72", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-116243831-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "097b15faad8249c9bf45623d0c3ab518", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb551510-e9", "ovs_interfaceid": "fb551510-e993-47ad-b0d1-63c0b5845056", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T16:16:31Z,direct_url=<?>,disk_format='qcow2',id=708622a9-7465-4492-ade8-b827198f7e30,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='0b29a975c552465aba0ac7d6288434bd',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T16:16:33Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'device_type': 'disk', 'encrypted': False, 'disk_bus': 'virtio', 'guest_format': None, 'encryption_options': None, 'image_id': '708622a9-7465-4492-ade8-b827198f7e30'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71731) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 17:09:06 user nova-compute[71731]: WARNING nova.virt.libvirt.driver [None req-a2271a36-0d45-4be0-8c6a-ac7178904d5a tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 17:09:06 user nova-compute[71731]: WARNING nova.virt.libvirt.driver [None req-a2271a36-0d45-4be0-8c6a-ac7178904d5a tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 17:09:06 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-a2271a36-0d45-4be0-8c6a-ac7178904d5a tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71731) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 17:09:06 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-a2271a36-0d45-4be0-8c6a-ac7178904d5a tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T16:17:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T16:16:31Z,direct_url=<?>,disk_format='qcow2',id=708622a9-7465-4492-ade8-b827198f7e30,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='0b29a975c552465aba0ac7d6288434bd',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T16:16:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 17:09:06 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-a2271a36-0d45-4be0-8c6a-ac7178904d5a tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Flavor limits 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 17:09:06 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-a2271a36-0d45-4be0-8c6a-ac7178904d5a tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Image limits 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 17:09:06 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-a2271a36-0d45-4be0-8c6a-ac7178904d5a tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Flavor pref 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 17:09:06 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-a2271a36-0d45-4be0-8c6a-ac7178904d5a tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Image pref 0:0:0 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 17:09:06 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-a2271a36-0d45-4be0-8c6a-ac7178904d5a tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 17:09:06 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-a2271a36-0d45-4be0-8c6a-ac7178904d5a tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 17:09:06 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-a2271a36-0d45-4be0-8c6a-ac7178904d5a tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71731) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 17:09:06 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-a2271a36-0d45-4be0-8c6a-ac7178904d5a tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Got 1 possible topologies {{(pid=71731) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 17:09:06 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-a2271a36-0d45-4be0-8c6a-ac7178904d5a tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 17:09:06 user nova-compute[71731]: DEBUG nova.virt.hardware [None req-a2271a36-0d45-4be0-8c6a-ac7178904d5a tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71731) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 17:09:06 user nova-compute[71731]: DEBUG nova.virt.libvirt.vif [None req-a2271a36-0d45-4be0-8c6a-ac7178904d5a tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T17:09:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-325520329',display_name='tempest-AttachVolumeNegativeTest-server-325520329',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-325520329',id=47,image_ref='708622a9-7465-4492-ade8-b827198f7e30',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHK5m7Tr/L5xNhw8mdMAAfBNwQrKi89BUKKxv/AyZXy9Tih9SzklM7CxsnO9Se5bUauoKDHV/YfrTQT7muTX50AFrDBdfPUfTS+ehRBh3U+r4X+sbYEOrWSfhAmnmh7paA==',key_name='tempest-keypair-2430711',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='097b15faad8249c9bf45623d0c3ab518',ramdisk_id='',reservation_id='r-0vzg6x8r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='708622a9-7465-4492-ade8-b827198f7e30',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-236067262',owner_user_name='tempest-AttachVolumeNegativeTest-236067262-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T17:09:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a08b0caad23045c1822cdd0b3ae0769f',uuid=f8829c88-70e9-43fb-97b0-d7f46e1de0ae,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fb551510-e993-47ad-b0d1-63c0b5845056", "address": "fa:16:3e:02:68:1c", "network": {"id": "436011a9-c48b-4f33-a576-a245b344dd72", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-116243831-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "097b15faad8249c9bf45623d0c3ab518", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb551510-e9", "ovs_interfaceid": "fb551510-e993-47ad-b0d1-63c0b5845056", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71731) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 17:09:06 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-a2271a36-0d45-4be0-8c6a-ac7178904d5a tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Converting VIF {"id": "fb551510-e993-47ad-b0d1-63c0b5845056", "address": "fa:16:3e:02:68:1c", "network": {"id": "436011a9-c48b-4f33-a576-a245b344dd72", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-116243831-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "097b15faad8249c9bf45623d0c3ab518", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb551510-e9", "ovs_interfaceid": "fb551510-e993-47ad-b0d1-63c0b5845056", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 17:09:06 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-a2271a36-0d45-4be0-8c6a-ac7178904d5a tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:02:68:1c,bridge_name='br-int',has_traffic_filtering=True,id=fb551510-e993-47ad-b0d1-63c0b5845056,network=Network(436011a9-c48b-4f33-a576-a245b344dd72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb551510-e9') {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 17:09:06 user nova-compute[71731]: DEBUG nova.objects.instance [None req-a2271a36-0d45-4be0-8c6a-ac7178904d5a tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lazy-loading 'pci_devices' on Instance uuid f8829c88-70e9-43fb-97b0-d7f46e1de0ae {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 17:09:06 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-a2271a36-0d45-4be0-8c6a-ac7178904d5a tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] [instance: f8829c88-70e9-43fb-97b0-d7f46e1de0ae] End _get_guest_xml xml=<domain type="kvm">
Apr 13 17:09:06 user nova-compute[71731]:   <uuid>f8829c88-70e9-43fb-97b0-d7f46e1de0ae</uuid>
Apr 13 17:09:06 user nova-compute[71731]:   <name>instance-0000002f</name>
Apr 13 17:09:06 user nova-compute[71731]:   <memory>131072</memory>
Apr 13 17:09:06 user nova-compute[71731]:   <vcpu>1</vcpu>
Apr 13 17:09:06 user nova-compute[71731]:   <metadata>
Apr 13 17:09:06 user nova-compute[71731]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 17:09:06 user nova-compute[71731]:       <nova:package version="0.0.0"/>
Apr 13 17:09:06 user nova-compute[71731]:       <nova:name>tempest-AttachVolumeNegativeTest-server-325520329</nova:name>
Apr 13 17:09:06 user nova-compute[71731]:       <nova:creationTime>2023-04-13 17:09:06</nova:creationTime>
Apr 13 17:09:06 user nova-compute[71731]:       <nova:flavor name="m1.nano">
Apr 13 17:09:06 user nova-compute[71731]:         <nova:memory>128</nova:memory>
Apr 13 17:09:06 user nova-compute[71731]:         <nova:disk>1</nova:disk>
Apr 13 17:09:06 user nova-compute[71731]:         <nova:swap>0</nova:swap>
Apr 13 17:09:06 user nova-compute[71731]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 17:09:06 user nova-compute[71731]:         <nova:vcpus>1</nova:vcpus>
Apr 13 17:09:06 user nova-compute[71731]:       </nova:flavor>
Apr 13 17:09:06 user nova-compute[71731]:       <nova:owner>
Apr 13 17:09:06 user nova-compute[71731]:         <nova:user uuid="a08b0caad23045c1822cdd0b3ae0769f">tempest-AttachVolumeNegativeTest-236067262-project-member</nova:user>
Apr 13 17:09:06 user nova-compute[71731]:         <nova:project uuid="097b15faad8249c9bf45623d0c3ab518">tempest-AttachVolumeNegativeTest-236067262</nova:project>
Apr 13 17:09:06 user nova-compute[71731]:       </nova:owner>
Apr 13 17:09:06 user nova-compute[71731]:       <nova:root type="image" uuid="708622a9-7465-4492-ade8-b827198f7e30"/>
Apr 13 17:09:06 user nova-compute[71731]:       <nova:ports>
Apr 13 17:09:06 user nova-compute[71731]:         <nova:port uuid="fb551510-e993-47ad-b0d1-63c0b5845056">
Apr 13 17:09:06 user nova-compute[71731]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Apr 13 17:09:06 user nova-compute[71731]:         </nova:port>
Apr 13 17:09:06 user nova-compute[71731]:       </nova:ports>
Apr 13 17:09:06 user nova-compute[71731]:     </nova:instance>
Apr 13 17:09:06 user nova-compute[71731]:   </metadata>
Apr 13 17:09:06 user nova-compute[71731]:   <sysinfo type="smbios">
Apr 13 17:09:06 user nova-compute[71731]:     <system>
Apr 13 17:09:06 user nova-compute[71731]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 17:09:06 user nova-compute[71731]:       <entry name="product">OpenStack Nova</entry>
Apr 13 17:09:06 user nova-compute[71731]:       <entry name="version">0.0.0</entry>
Apr 13 17:09:06 user nova-compute[71731]:       <entry name="serial">f8829c88-70e9-43fb-97b0-d7f46e1de0ae</entry>
Apr 13 17:09:06 user nova-compute[71731]:       <entry name="uuid">f8829c88-70e9-43fb-97b0-d7f46e1de0ae</entry>
Apr 13 17:09:06 user nova-compute[71731]:       <entry name="family">Virtual Machine</entry>
Apr 13 17:09:06 user nova-compute[71731]:     </system>
Apr 13 17:09:06 user nova-compute[71731]:   </sysinfo>
Apr 13 17:09:06 user nova-compute[71731]:   <os>
Apr 13 17:09:06 user nova-compute[71731]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 17:09:06 user nova-compute[71731]:     <boot dev="hd"/>
Apr 13 17:09:06 user nova-compute[71731]:     <smbios mode="sysinfo"/>
Apr 13 17:09:06 user nova-compute[71731]:   </os>
Apr 13 17:09:06 user nova-compute[71731]:   <features>
Apr 13 17:09:06 user nova-compute[71731]:     <acpi/>
Apr 13 17:09:06 user nova-compute[71731]:     <apic/>
Apr 13 17:09:06 user nova-compute[71731]:     <vmcoreinfo/>
Apr 13 17:09:06 user nova-compute[71731]:   </features>
Apr 13 17:09:06 user nova-compute[71731]:   <clock offset="utc">
Apr 13 17:09:06 user nova-compute[71731]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 17:09:06 user nova-compute[71731]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 17:09:06 user nova-compute[71731]:     <timer name="hpet" present="no"/>
Apr 13 17:09:06 user nova-compute[71731]:   </clock>
Apr 13 17:09:06 user nova-compute[71731]:   <cpu mode="custom" match="exact">
Apr 13 17:09:06 user nova-compute[71731]:     <model>Nehalem</model>
Apr 13 17:09:06 user nova-compute[71731]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 17:09:06 user nova-compute[71731]:   </cpu>
Apr 13 17:09:06 user nova-compute[71731]:   <devices>
Apr 13 17:09:06 user nova-compute[71731]:     <disk type="file" device="disk">
Apr 13 17:09:06 user nova-compute[71731]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 17:09:06 user nova-compute[71731]:       <source file="/opt/stack/data/nova/instances/f8829c88-70e9-43fb-97b0-d7f46e1de0ae/disk"/>
Apr 13 17:09:06 user nova-compute[71731]:       <target dev="vda" bus="virtio"/>
Apr 13 17:09:06 user nova-compute[71731]:     </disk>
Apr 13 17:09:06 user nova-compute[71731]:     <interface type="ethernet">
Apr 13 17:09:06 user nova-compute[71731]:       <mac address="fa:16:3e:02:68:1c"/>
Apr 13 17:09:06 user nova-compute[71731]:       <model type="virtio"/>
Apr 13 17:09:06 user nova-compute[71731]:       <mtu size="1442"/>
Apr 13 17:09:06 user nova-compute[71731]:       <target dev="tapfb551510-e9"/>
Apr 13 17:09:06 user nova-compute[71731]:     </interface>
Apr 13 17:09:06 user nova-compute[71731]:     <serial type="pty">
Apr 13 17:09:06 user nova-compute[71731]:       <log file="/opt/stack/data/nova/instances/f8829c88-70e9-43fb-97b0-d7f46e1de0ae/console.log" append="off"/>
Apr 13 17:09:06 user nova-compute[71731]:     </serial>
Apr 13 17:09:06 user nova-compute[71731]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 17:09:06 user nova-compute[71731]:     <video>
Apr 13 17:09:06 user nova-compute[71731]:       <model type="virtio"/>
Apr 13 17:09:06 user nova-compute[71731]:     </video>
Apr 13 17:09:06 user nova-compute[71731]:     <rng model="virtio">
Apr 13 17:09:06 user nova-compute[71731]:       <backend model="random">/dev/urandom</backend>
Apr 13 17:09:06 user nova-compute[71731]:     </rng>
Apr 13 17:09:06 user nova-compute[71731]:     <controller type="usb" index="0" model="none"/>
Apr 13 17:09:06 user nova-compute[71731]:     <memballoon model="virtio">
Apr 13 17:09:06 user nova-compute[71731]:       <stats period="10"/>
Apr 13 17:09:06 user nova-compute[71731]:     </memballoon>
Apr 13 17:09:06 user nova-compute[71731]:   </devices>
Apr 13 17:09:06 user nova-compute[71731]: </domain>
Apr 13 17:09:06 user nova-compute[71731]:  {{(pid=71731) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 17:09:06 user nova-compute[71731]: DEBUG nova.virt.libvirt.vif [None req-a2271a36-0d45-4be0-8c6a-ac7178904d5a tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T17:09:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-325520329',display_name='tempest-AttachVolumeNegativeTest-server-325520329',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-325520329',id=47,image_ref='708622a9-7465-4492-ade8-b827198f7e30',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHK5m7Tr/L5xNhw8mdMAAfBNwQrKi89BUKKxv/AyZXy9Tih9SzklM7CxsnO9Se5bUauoKDHV/YfrTQT7muTX50AFrDBdfPUfTS+ehRBh3U+r4X+sbYEOrWSfhAmnmh7paA==',key_name='tempest-keypair-2430711',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='097b15faad8249c9bf45623d0c3ab518',ramdisk_id='',reservation_id='r-0vzg6x8r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='708622a9-7465-4492-ade8-b827198f7e30',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-236067262',owner_user_name='tempest-AttachVolumeNegativeTest-236067262-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T17:09:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a08b0caad23045c1822cdd0b3ae0769f',uuid=f8829c88-70e9-43fb-97b0-d7f46e1de0ae,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fb551510-e993-47ad-b0d1-63c0b5845056", "address": "fa:16:3e:02:68:1c", "network": {"id": "436011a9-c48b-4f33-a576-a245b344dd72", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-116243831-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "097b15faad8249c9bf45623d0c3ab518", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb551510-e9", "ovs_interfaceid": "fb551510-e993-47ad-b0d1-63c0b5845056", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 17:09:06 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-a2271a36-0d45-4be0-8c6a-ac7178904d5a tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Converting VIF {"id": "fb551510-e993-47ad-b0d1-63c0b5845056", "address": "fa:16:3e:02:68:1c", "network": {"id": "436011a9-c48b-4f33-a576-a245b344dd72", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-116243831-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "097b15faad8249c9bf45623d0c3ab518", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb551510-e9", "ovs_interfaceid": "fb551510-e993-47ad-b0d1-63c0b5845056", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 17:09:06 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-a2271a36-0d45-4be0-8c6a-ac7178904d5a tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:02:68:1c,bridge_name='br-int',has_traffic_filtering=True,id=fb551510-e993-47ad-b0d1-63c0b5845056,network=Network(436011a9-c48b-4f33-a576-a245b344dd72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb551510-e9') {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 17:09:06 user nova-compute[71731]: DEBUG os_vif [None req-a2271a36-0d45-4be0-8c6a-ac7178904d5a tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:02:68:1c,bridge_name='br-int',has_traffic_filtering=True,id=fb551510-e993-47ad-b0d1-63c0b5845056,network=Network(436011a9-c48b-4f33-a576-a245b344dd72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb551510-e9') {{(pid=71731) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 17:09:06 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:09:06 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 17:09:06 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 17:09:06 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:09:06 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfb551510-e9, may_exist=True) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 17:09:06 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapfb551510-e9, col_values=(('external_ids', {'iface-id': 'fb551510-e993-47ad-b0d1-63c0b5845056', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:02:68:1c', 'vm-uuid': 'f8829c88-70e9-43fb-97b0-d7f46e1de0ae'}),)) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 17:09:06 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:09:06 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 17:09:06 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:09:06 user nova-compute[71731]: INFO os_vif [None req-a2271a36-0d45-4be0-8c6a-ac7178904d5a tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:02:68:1c,bridge_name='br-int',has_traffic_filtering=True,id=fb551510-e993-47ad-b0d1-63c0b5845056,network=Network(436011a9-c48b-4f33-a576-a245b344dd72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb551510-e9')
Apr 13 17:09:06 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-a2271a36-0d45-4be0-8c6a-ac7178904d5a tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] No BDM found with device name vda, not building metadata. {{(pid=71731) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 17:09:06 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-a2271a36-0d45-4be0-8c6a-ac7178904d5a tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] No VIF found with MAC fa:16:3e:02:68:1c, not building metadata {{(pid=71731) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 17:09:06 user nova-compute[71731]: DEBUG nova.network.neutron [req-6877908a-b0a9-4b8b-9c76-7769574955e2 req-6bb19238-440a-4dca-84a8-8959c567d644 service nova] [instance: f8829c88-70e9-43fb-97b0-d7f46e1de0ae] Updated VIF entry in instance network info cache for port fb551510-e993-47ad-b0d1-63c0b5845056. {{(pid=71731) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 17:09:06 user nova-compute[71731]: DEBUG nova.network.neutron [req-6877908a-b0a9-4b8b-9c76-7769574955e2 req-6bb19238-440a-4dca-84a8-8959c567d644 service nova] [instance: f8829c88-70e9-43fb-97b0-d7f46e1de0ae] Updating instance_info_cache with network_info: [{"id": "fb551510-e993-47ad-b0d1-63c0b5845056", "address": "fa:16:3e:02:68:1c", "network": {"id": "436011a9-c48b-4f33-a576-a245b344dd72", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-116243831-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "097b15faad8249c9bf45623d0c3ab518", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb551510-e9", "ovs_interfaceid": "fb551510-e993-47ad-b0d1-63c0b5845056", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 17:09:06 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-6877908a-b0a9-4b8b-9c76-7769574955e2 req-6bb19238-440a-4dca-84a8-8959c567d644 service nova] Releasing lock "refresh_cache-f8829c88-70e9-43fb-97b0-d7f46e1de0ae" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 17:09:07 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:09:07 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:09:07 user nova-compute[71731]: DEBUG nova.compute.manager [req-d2665886-404a-4e82-939a-d225f8c47df9 req-acc7c3d6-1efd-44d0-bbdb-65f83cf1f517 service nova] [instance: f8829c88-70e9-43fb-97b0-d7f46e1de0ae] Received event network-vif-plugged-fb551510-e993-47ad-b0d1-63c0b5845056 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:09:07 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-d2665886-404a-4e82-939a-d225f8c47df9 req-acc7c3d6-1efd-44d0-bbdb-65f83cf1f517 service nova] Acquiring lock "f8829c88-70e9-43fb-97b0-d7f46e1de0ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:09:07 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-d2665886-404a-4e82-939a-d225f8c47df9 req-acc7c3d6-1efd-44d0-bbdb-65f83cf1f517 service nova] Lock "f8829c88-70e9-43fb-97b0-d7f46e1de0ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:09:07 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-d2665886-404a-4e82-939a-d225f8c47df9 req-acc7c3d6-1efd-44d0-bbdb-65f83cf1f517 service nova] Lock "f8829c88-70e9-43fb-97b0-d7f46e1de0ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:09:07 user nova-compute[71731]: DEBUG nova.compute.manager [req-d2665886-404a-4e82-939a-d225f8c47df9 req-acc7c3d6-1efd-44d0-bbdb-65f83cf1f517 service nova] [instance: f8829c88-70e9-43fb-97b0-d7f46e1de0ae] No waiting events found dispatching network-vif-plugged-fb551510-e993-47ad-b0d1-63c0b5845056 {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 17:09:07 user nova-compute[71731]: WARNING nova.compute.manager [req-d2665886-404a-4e82-939a-d225f8c47df9 req-acc7c3d6-1efd-44d0-bbdb-65f83cf1f517 service nova] [instance: f8829c88-70e9-43fb-97b0-d7f46e1de0ae] Received unexpected event network-vif-plugged-fb551510-e993-47ad-b0d1-63c0b5845056 for instance with vm_state building and task_state spawning.
Apr 13 17:09:08 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:09:08 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:09:08 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:09:09 user nova-compute[71731]: DEBUG nova.virt.driver [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Emitting event <LifecycleEvent: 1681405749.6601043, f8829c88-70e9-43fb-97b0-d7f46e1de0ae => Resumed> {{(pid=71731) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 17:09:09 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: f8829c88-70e9-43fb-97b0-d7f46e1de0ae] VM Resumed (Lifecycle Event)
Apr 13 17:09:09 user nova-compute[71731]: DEBUG nova.compute.manager [None req-a2271a36-0d45-4be0-8c6a-ac7178904d5a tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] [instance: f8829c88-70e9-43fb-97b0-d7f46e1de0ae] Instance event wait completed in 0 seconds for  {{(pid=71731) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 17:09:09 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-a2271a36-0d45-4be0-8c6a-ac7178904d5a tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] [instance: f8829c88-70e9-43fb-97b0-d7f46e1de0ae] Guest created on hypervisor {{(pid=71731) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 17:09:09 user nova-compute[71731]: INFO nova.virt.libvirt.driver [-] [instance: f8829c88-70e9-43fb-97b0-d7f46e1de0ae] Instance spawned successfully.
Apr 13 17:09:09 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-a2271a36-0d45-4be0-8c6a-ac7178904d5a tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] [instance: f8829c88-70e9-43fb-97b0-d7f46e1de0ae] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 17:09:09 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: f8829c88-70e9-43fb-97b0-d7f46e1de0ae] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 17:09:09 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: f8829c88-70e9-43fb-97b0-d7f46e1de0ae] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71731) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 17:09:09 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-a2271a36-0d45-4be0-8c6a-ac7178904d5a tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] [instance: f8829c88-70e9-43fb-97b0-d7f46e1de0ae] Found default for hw_cdrom_bus of ide {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 17:09:09 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-a2271a36-0d45-4be0-8c6a-ac7178904d5a tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] [instance: f8829c88-70e9-43fb-97b0-d7f46e1de0ae] Found default for hw_disk_bus of virtio {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 17:09:09 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-a2271a36-0d45-4be0-8c6a-ac7178904d5a tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] [instance: f8829c88-70e9-43fb-97b0-d7f46e1de0ae] Found default for hw_input_bus of None {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 17:09:09 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-a2271a36-0d45-4be0-8c6a-ac7178904d5a tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] [instance: f8829c88-70e9-43fb-97b0-d7f46e1de0ae] Found default for hw_pointer_model of None {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 17:09:09 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-a2271a36-0d45-4be0-8c6a-ac7178904d5a tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] [instance: f8829c88-70e9-43fb-97b0-d7f46e1de0ae] Found default for hw_video_model of virtio {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 17:09:09 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-a2271a36-0d45-4be0-8c6a-ac7178904d5a tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] [instance: f8829c88-70e9-43fb-97b0-d7f46e1de0ae] Found default for hw_vif_model of virtio {{(pid=71731) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 17:09:09 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: f8829c88-70e9-43fb-97b0-d7f46e1de0ae] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 17:09:09 user nova-compute[71731]: DEBUG nova.virt.driver [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Emitting event <LifecycleEvent: 1681405749.6623724, f8829c88-70e9-43fb-97b0-d7f46e1de0ae => Started> {{(pid=71731) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 17:09:09 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: f8829c88-70e9-43fb-97b0-d7f46e1de0ae] VM Started (Lifecycle Event)
Apr 13 17:09:09 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: f8829c88-70e9-43fb-97b0-d7f46e1de0ae] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 17:09:09 user nova-compute[71731]: DEBUG nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: f8829c88-70e9-43fb-97b0-d7f46e1de0ae] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71731) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 17:09:09 user nova-compute[71731]: INFO nova.compute.manager [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] [instance: f8829c88-70e9-43fb-97b0-d7f46e1de0ae] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 17:09:09 user nova-compute[71731]: INFO nova.compute.manager [None req-a2271a36-0d45-4be0-8c6a-ac7178904d5a tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] [instance: f8829c88-70e9-43fb-97b0-d7f46e1de0ae] Took 5.46 seconds to spawn the instance on the hypervisor.
Apr 13 17:09:09 user nova-compute[71731]: DEBUG nova.compute.manager [None req-a2271a36-0d45-4be0-8c6a-ac7178904d5a tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] [instance: f8829c88-70e9-43fb-97b0-d7f46e1de0ae] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 17:09:09 user nova-compute[71731]: DEBUG nova.compute.manager [req-82427e8c-d317-4b47-94c6-78427ba1399b req-4fb42b2e-f0f0-4a43-baf7-e5841cbdd4e9 service nova] [instance: f8829c88-70e9-43fb-97b0-d7f46e1de0ae] Received event network-vif-plugged-fb551510-e993-47ad-b0d1-63c0b5845056 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:09:09 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-82427e8c-d317-4b47-94c6-78427ba1399b req-4fb42b2e-f0f0-4a43-baf7-e5841cbdd4e9 service nova] Acquiring lock "f8829c88-70e9-43fb-97b0-d7f46e1de0ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:09:09 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-82427e8c-d317-4b47-94c6-78427ba1399b req-4fb42b2e-f0f0-4a43-baf7-e5841cbdd4e9 service nova] Lock "f8829c88-70e9-43fb-97b0-d7f46e1de0ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:09:09 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-82427e8c-d317-4b47-94c6-78427ba1399b req-4fb42b2e-f0f0-4a43-baf7-e5841cbdd4e9 service nova] Lock "f8829c88-70e9-43fb-97b0-d7f46e1de0ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:09:09 user nova-compute[71731]: DEBUG nova.compute.manager [req-82427e8c-d317-4b47-94c6-78427ba1399b req-4fb42b2e-f0f0-4a43-baf7-e5841cbdd4e9 service nova] [instance: f8829c88-70e9-43fb-97b0-d7f46e1de0ae] No waiting events found dispatching network-vif-plugged-fb551510-e993-47ad-b0d1-63c0b5845056 {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 17:09:09 user nova-compute[71731]: WARNING nova.compute.manager [req-82427e8c-d317-4b47-94c6-78427ba1399b req-4fb42b2e-f0f0-4a43-baf7-e5841cbdd4e9 service nova] [instance: f8829c88-70e9-43fb-97b0-d7f46e1de0ae] Received unexpected event network-vif-plugged-fb551510-e993-47ad-b0d1-63c0b5845056 for instance with vm_state building and task_state spawning.
Apr 13 17:09:09 user nova-compute[71731]: INFO nova.compute.manager [None req-a2271a36-0d45-4be0-8c6a-ac7178904d5a tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] [instance: f8829c88-70e9-43fb-97b0-d7f46e1de0ae] Took 5.94 seconds to build instance.
Apr 13 17:09:09 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-a2271a36-0d45-4be0-8c6a-ac7178904d5a tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "f8829c88-70e9-43fb-97b0-d7f46e1de0ae" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.039s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:09:11 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:09:12 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:09:12 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:09:16 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:09:21 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 17:09:21 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 17:09:21 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71731) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 17:09:21 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71731) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 17:09:21 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:09:21 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71731) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 17:09:22 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:09:26 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:09:27 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:09:31 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:09:36 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 17:09:36 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 17:09:36 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71731) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 17:09:36 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71731) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 17:09:36 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71731) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 17:09:36 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:09:37 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:09:41 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:09:46 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:09:46 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71731) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 17:09:46 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 17:09:46 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:09:46 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71731) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 17:09:46 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71731) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 17:09:46 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71731) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 17:09:46 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:09:48 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:09:51 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:09:51 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 17:09:51 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:09:51 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71731) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 17:09:51 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71731) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 17:09:51 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71731) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 17:09:51 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:09:52 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:09:52 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:09:54 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager.update_available_resource {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:09:54 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:09:54 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:09:54 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:09:54 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Auditing locally available compute resources for user (node: user) {{(pid=71731) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 17:09:54 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8829c88-70e9-43fb-97b0-d7f46e1de0ae/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:09:54 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8829c88-70e9-43fb-97b0-d7f46e1de0ae/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:09:54 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8829c88-70e9-43fb-97b0-d7f46e1de0ae/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:09:54 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8829c88-70e9-43fb-97b0-d7f46e1de0ae/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:09:54 user nova-compute[71731]: WARNING nova.virt.libvirt.driver [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 17:09:54 user nova-compute[71731]: WARNING nova.virt.libvirt.driver [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 17:09:54 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Hypervisor/Node resource view: name=user free_ram=8760MB free_disk=26.037029266357422GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71731) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 17:09:54 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:09:54 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:09:54 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance f8829c88-70e9-43fb-97b0-d7f46e1de0ae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 17:09:54 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=71731) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 17:09:54 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=71731) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 17:09:54 user nova-compute[71731]: DEBUG nova.compute.provider_tree [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Inventory has not changed in ProviderTree for provider: cb6b1a64-0c24-4e2d-af1e-16576ca9165c {{(pid=71731) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 17:09:54 user nova-compute[71731]: DEBUG nova.scheduler.client.report [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Inventory has not changed for provider cb6b1a64-0c24-4e2d-af1e-16576ca9165c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71731) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 17:09:54 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Compute_service record updated for user:user {{(pid=71731) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 17:09:54 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.192s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:09:55 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:09:55 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:09:56 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:09:56 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Starting heal instance info cache {{(pid=71731) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 17:09:56 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Rebuilding the list of instances to heal {{(pid=71731) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 13 17:09:56 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Acquiring lock "refresh_cache-f8829c88-70e9-43fb-97b0-d7f46e1de0ae" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 17:09:56 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Acquired lock "refresh_cache-f8829c88-70e9-43fb-97b0-d7f46e1de0ae" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 17:09:56 user nova-compute[71731]: DEBUG nova.network.neutron [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] [instance: f8829c88-70e9-43fb-97b0-d7f46e1de0ae] Forcefully refreshing network info cache for instance {{(pid=71731) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 17:09:56 user nova-compute[71731]: DEBUG nova.objects.instance [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lazy-loading 'info_cache' on Instance uuid f8829c88-70e9-43fb-97b0-d7f46e1de0ae {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 17:09:56 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:09:56 user nova-compute[71731]: DEBUG nova.network.neutron [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] [instance: f8829c88-70e9-43fb-97b0-d7f46e1de0ae] Updating instance_info_cache with network_info: [{"id": "fb551510-e993-47ad-b0d1-63c0b5845056", "address": "fa:16:3e:02:68:1c", "network": {"id": "436011a9-c48b-4f33-a576-a245b344dd72", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-116243831-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "097b15faad8249c9bf45623d0c3ab518", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb551510-e9", "ovs_interfaceid": "fb551510-e993-47ad-b0d1-63c0b5845056", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 17:09:56 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Releasing lock "refresh_cache-f8829c88-70e9-43fb-97b0-d7f46e1de0ae" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 17:09:56 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] [instance: f8829c88-70e9-43fb-97b0-d7f46e1de0ae] Updated the network info_cache for instance {{(pid=71731) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 17:09:57 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:10:01 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:10:06 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 17:10:06 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 17:10:06 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71731) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 17:10:06 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71731) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 17:10:06 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71731) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 17:10:06 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:10:11 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:10:16 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 17:10:16 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:10:16 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71731) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 17:10:16 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71731) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 17:10:16 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71731) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 17:10:16 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:10:21 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 17:10:21 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 17:10:21 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71731) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 17:10:21 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71731) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 17:10:21 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71731) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 17:10:21 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:10:26 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:10:31 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:10:32 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:10:36 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:10:41 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:10:46 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:10:46 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71731) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 17:10:46 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 17:10:49 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:10:51 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:10:52 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:10:52 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:10:53 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:10:54 user nova-compute[71731]: DEBUG nova.compute.manager [req-582c7c57-7437-4095-9318-8c0ce09bfa2a req-ad78a78c-64ba-4772-9fec-707a80da8c6b service nova] [instance: f8829c88-70e9-43fb-97b0-d7f46e1de0ae] Received event network-changed-fb551510-e993-47ad-b0d1-63c0b5845056 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:10:54 user nova-compute[71731]: DEBUG nova.compute.manager [req-582c7c57-7437-4095-9318-8c0ce09bfa2a req-ad78a78c-64ba-4772-9fec-707a80da8c6b service nova] [instance: f8829c88-70e9-43fb-97b0-d7f46e1de0ae] Refreshing instance network info cache due to event network-changed-fb551510-e993-47ad-b0d1-63c0b5845056. {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 17:10:54 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-582c7c57-7437-4095-9318-8c0ce09bfa2a req-ad78a78c-64ba-4772-9fec-707a80da8c6b service nova] Acquiring lock "refresh_cache-f8829c88-70e9-43fb-97b0-d7f46e1de0ae" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 17:10:54 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-582c7c57-7437-4095-9318-8c0ce09bfa2a req-ad78a78c-64ba-4772-9fec-707a80da8c6b service nova] Acquired lock "refresh_cache-f8829c88-70e9-43fb-97b0-d7f46e1de0ae" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 17:10:54 user nova-compute[71731]: DEBUG nova.network.neutron [req-582c7c57-7437-4095-9318-8c0ce09bfa2a req-ad78a78c-64ba-4772-9fec-707a80da8c6b service nova] [instance: f8829c88-70e9-43fb-97b0-d7f46e1de0ae] Refreshing network info cache for port fb551510-e993-47ad-b0d1-63c0b5845056 {{(pid=71731) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 17:10:55 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager.update_available_resource {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:10:55 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:10:55 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:10:55 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:10:55 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Auditing locally available compute resources for user (node: user) {{(pid=71731) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 17:10:55 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8829c88-70e9-43fb-97b0-d7f46e1de0ae/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:10:55 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8829c88-70e9-43fb-97b0-d7f46e1de0ae/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:10:55 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8829c88-70e9-43fb-97b0-d7f46e1de0ae/disk --force-share --output=json {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:10:55 user nova-compute[71731]: DEBUG nova.network.neutron [req-582c7c57-7437-4095-9318-8c0ce09bfa2a req-ad78a78c-64ba-4772-9fec-707a80da8c6b service nova] [instance: f8829c88-70e9-43fb-97b0-d7f46e1de0ae] Updated VIF entry in instance network info cache for port fb551510-e993-47ad-b0d1-63c0b5845056. {{(pid=71731) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 17:10:55 user nova-compute[71731]: DEBUG nova.network.neutron [req-582c7c57-7437-4095-9318-8c0ce09bfa2a req-ad78a78c-64ba-4772-9fec-707a80da8c6b service nova] [instance: f8829c88-70e9-43fb-97b0-d7f46e1de0ae] Updating instance_info_cache with network_info: [{"id": "fb551510-e993-47ad-b0d1-63c0b5845056", "address": "fa:16:3e:02:68:1c", "network": {"id": "436011a9-c48b-4f33-a576-a245b344dd72", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-116243831-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.51", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "097b15faad8249c9bf45623d0c3ab518", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb551510-e9", "ovs_interfaceid": "fb551510-e993-47ad-b0d1-63c0b5845056", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 17:10:55 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-582c7c57-7437-4095-9318-8c0ce09bfa2a req-ad78a78c-64ba-4772-9fec-707a80da8c6b service nova] Releasing lock "refresh_cache-f8829c88-70e9-43fb-97b0-d7f46e1de0ae" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 17:10:55 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8829c88-70e9-43fb-97b0-d7f46e1de0ae/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:10:55 user nova-compute[71731]: WARNING nova.virt.libvirt.driver [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 17:10:55 user nova-compute[71731]: WARNING nova.virt.libvirt.driver [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 17:10:55 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Hypervisor/Node resource view: name=user free_ram=8786MB free_disk=26.03640365600586GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71731) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 17:10:55 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:10:55 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:10:56 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance f8829c88-70e9-43fb-97b0-d7f46e1de0ae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 17:10:56 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=71731) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 17:10:56 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=71731) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 17:10:56 user nova-compute[71731]: DEBUG nova.compute.provider_tree [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Inventory has not changed in ProviderTree for provider: cb6b1a64-0c24-4e2d-af1e-16576ca9165c {{(pid=71731) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 17:10:56 user nova-compute[71731]: DEBUG nova.scheduler.client.report [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Inventory has not changed for provider cb6b1a64-0c24-4e2d-af1e-16576ca9165c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71731) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 17:10:56 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Compute_service record updated for user:user {{(pid=71731) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 17:10:56 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.163s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:10:56 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 17:10:56 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-86e7dd9b-26ad-46d2-9e42-450c309e9d4a tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Acquiring lock "f8829c88-70e9-43fb-97b0-d7f46e1de0ae" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:10:56 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-86e7dd9b-26ad-46d2-9e42-450c309e9d4a tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "f8829c88-70e9-43fb-97b0-d7f46e1de0ae" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:10:56 user nova-compute[71731]: DEBUG nova.objects.instance [None req-86e7dd9b-26ad-46d2-9e42-450c309e9d4a tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lazy-loading 'flavor' on Instance uuid f8829c88-70e9-43fb-97b0-d7f46e1de0ae {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 17:10:56 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-86e7dd9b-26ad-46d2-9e42-450c309e9d4a tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "f8829c88-70e9-43fb-97b0-d7f46e1de0ae" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:10:56 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-86e7dd9b-26ad-46d2-9e42-450c309e9d4a tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Acquiring lock "f8829c88-70e9-43fb-97b0-d7f46e1de0ae" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:10:56 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-86e7dd9b-26ad-46d2-9e42-450c309e9d4a tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "f8829c88-70e9-43fb-97b0-d7f46e1de0ae" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:10:56 user nova-compute[71731]: INFO nova.compute.manager [None req-86e7dd9b-26ad-46d2-9e42-450c309e9d4a tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] [instance: f8829c88-70e9-43fb-97b0-d7f46e1de0ae] Attaching volume 3580dd91-02eb-43a3-ab09-739929338961 to /dev/vdb
Apr 13 17:10:56 user nova-compute[71731]: DEBUG os_brick.utils [None req-86e7dd9b-26ad-46d2-9e42-450c309e9d4a tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 17:10:56 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:10:56 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:10:56 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[dec4db89-b3d9-4c2b-8c1d-8056b3444f2b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:81501d91421\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:10:56 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:10:56 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:10:56 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f709210-a99f-4eb9-b988-9584c5297ba6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:10:56 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:10:56 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:10:56 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c22131c-7461-4b6a-8128-9f7c2a856e35]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:10:56 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[08d9101d-7999-4b70-acdb-27ec9c4b7b2a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:10:56 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-86e7dd9b-26ad-46d2-9e42-450c309e9d4a tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Running cmd (subprocess): nvme version {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:10:56 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [None req-86e7dd9b-26ad-46d2-9e42-450c309e9d4a tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] 'nvme version' failed. Not Retrying. {{(pid=71731) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 17:10:56 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.nvmeof [None req-86e7dd9b-26ad-46d2-9e42-450c309e9d4a tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] nvme not present on system {{(pid=71731) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 17:10:56 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:10:56 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 17:10:56 user nova-compute[71731]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 17:10:56 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[a228f31e-5dc2-46f3-a9ba-773886bf0626]: (4, '') {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:10:56 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.lightos [None req-86e7dd9b-26ad-46d2-9e42-450c309e9d4a tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71731) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 17:10:56 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.lightos [None req-86e7dd9b-26ad-46d2-9e42-450c309e9d4a tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71731) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 17:10:56 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.lightos [None req-86e7dd9b-26ad-46d2-9e42-450c309e9d4a tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] LIGHTOS: no hostnqn found. {{(pid=71731) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 17:10:56 user nova-compute[71731]: DEBUG os_brick.utils [None req-86e7dd9b-26ad-46d2-9e42-450c309e9d4a tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] <== get_connector_properties: return (152ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:81501d91421', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 17:10:56 user nova-compute[71731]: DEBUG nova.virt.block_device [None req-86e7dd9b-26ad-46d2-9e42-450c309e9d4a tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] [instance: f8829c88-70e9-43fb-97b0-d7f46e1de0ae] Updating existing volume attachment record: d39e4fa2-b7b2-4fc9-9085-48d5d2dd3357 {{(pid=71731) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 17:10:57 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:10:58 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:10:58 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Starting heal instance info cache {{(pid=71731) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 17:10:58 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Rebuilding the list of instances to heal {{(pid=71731) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 13 17:10:58 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Acquiring lock "refresh_cache-f8829c88-70e9-43fb-97b0-d7f46e1de0ae" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 17:10:58 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Acquired lock "refresh_cache-f8829c88-70e9-43fb-97b0-d7f46e1de0ae" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 17:10:58 user nova-compute[71731]: DEBUG nova.network.neutron [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] [instance: f8829c88-70e9-43fb-97b0-d7f46e1de0ae] Forcefully refreshing network info cache for instance {{(pid=71731) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 17:10:58 user nova-compute[71731]: DEBUG nova.objects.instance [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lazy-loading 'info_cache' on Instance uuid f8829c88-70e9-43fb-97b0-d7f46e1de0ae {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 17:10:58 user nova-compute[71731]: DEBUG nova.network.neutron [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] [instance: f8829c88-70e9-43fb-97b0-d7f46e1de0ae] Updating instance_info_cache with network_info: [{"id": "fb551510-e993-47ad-b0d1-63c0b5845056", "address": "fa:16:3e:02:68:1c", "network": {"id": "436011a9-c48b-4f33-a576-a245b344dd72", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-116243831-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.51", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "097b15faad8249c9bf45623d0c3ab518", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb551510-e9", "ovs_interfaceid": "fb551510-e993-47ad-b0d1-63c0b5845056", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 17:10:58 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Releasing lock "refresh_cache-f8829c88-70e9-43fb-97b0-d7f46e1de0ae" {{(pid=71731) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 17:10:58 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] [instance: f8829c88-70e9-43fb-97b0-d7f46e1de0ae] Updated the network info_cache for instance {{(pid=71731) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 17:10:58 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:10:58 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:11:01 user nova-compute[71731]: DEBUG nova.virt.libvirt.volume.iscsi [None req-86e7dd9b-26ad-46d2-9e42-450c309e9d4a tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] [instance: f8829c88-70e9-43fb-97b0-d7f46e1de0ae] Calling os-brick to attach iSCSI Volume {{(pid=71731) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 17:11:01 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-86e7dd9b-26ad-46d2-9e42-450c309e9d4a tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8cf0118790>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3580dd91-02eb-43a3-ab09-739929338961', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HsvSqLxB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 17:11:01 user nova-compute[71731]: WARNING os_brick.initiator.connectors.base [None req-86e7dd9b-26ad-46d2-9e42-450c309e9d4a tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 17:11:01 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-86e7dd9b-26ad-46d2-9e42-450c309e9d4a tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 17:11:01 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-86e7dd9b-26ad-46d2-9e42-450c309e9d4a tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 17:11:01 user nova-compute[71731]: WARNING os_brick.initiator.connectors.base [None req-86e7dd9b-26ad-46d2-9e42-450c309e9d4a tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 17:11:01 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-86e7dd9b-26ad-46d2-9e42-450c309e9d4a tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3580dd91-02eb-43a3-ab09-739929338961" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 17:11:01 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-86e7dd9b-26ad-46d2-9e42-450c309e9d4a tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3580dd91-02eb-43a3-ab09-739929338961" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 17:11:01 user nova-compute[71731]: INFO os_brick.initiator.connectors.iscsi [None req-86e7dd9b-26ad-46d2-9e42-450c309e9d4a tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 17:11:01 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3580dd91-02eb-43a3-ab09-739929338961 -p 172.16.0.220:3260 {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:11:01 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3580dd91-02eb-43a3-ab09-739929338961 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:11:01 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[c23efe0d-c099-4e9a-8ace-b7814828298d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:11:01 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-86e7dd9b-26ad-46d2-9e42-450c309e9d4a tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 17:11:01 user nova-compute[71731]:  {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:11:01 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3580dd91-02eb-43a3-ab09-739929338961 -p 172.16.0.220:3260 --interface default --op new {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:11:01 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3580dd91-02eb-43a3-ab09-739929338961 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:11:01 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c3460fb-b5bf-432e-88b0-8f961bfa8e35]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3580dd91-02eb-43a3-ab09-739929338961] added\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:11:01 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-86e7dd9b-26ad-46d2-9e42-450c309e9d4a tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3580dd91-02eb-43a3-ab09-739929338961] added
Apr 13 17:11:01 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:11:01 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3580dd91-02eb-43a3-ab09-739929338961 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:11:01 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3580dd91-02eb-43a3-ab09-739929338961 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:11:01 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[c06d5cd4-8347-43f0-bdb6-5b9ffa9a6d72]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:11:01 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-86e7dd9b-26ad-46d2-9e42-450c309e9d4a tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:11:01 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3580dd91-02eb-43a3-ab09-739929338961 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:11:01 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3580dd91-02eb-43a3-ab09-739929338961 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:11:01 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[6967cec5-1399-458b-818d-69ce91111aa3]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:11:01 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-86e7dd9b-26ad-46d2-9e42-450c309e9d4a tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:11:01 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3580dd91-02eb-43a3-ab09-739929338961 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HsvSqLxB {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:11:01 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3580dd91-02eb-43a3-ab09-739929338961 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HsvSqLxB" returned: 0 in 0.017s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:11:01 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b4f0d44-388c-44ea-b9c9-56639b95517b]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:11:01 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-86e7dd9b-26ad-46d2-9e42-450c309e9d4a tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HsvSqLxB'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:11:01 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3580dd91-02eb-43a3-ab09-739929338961 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:11:01 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3580dd91-02eb-43a3-ab09-739929338961 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:11:01 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[05e392cd-85e7-4207-9911-60a451973fb8]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:11:01 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-86e7dd9b-26ad-46d2-9e42-450c309e9d4a tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:11:01 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:11:01 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:11:01 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e76c9e7-58bc-42e8-98b1-d122d1492db7]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:11:01 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-86e7dd9b-26ad-46d2-9e42-450c309e9d4a tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Apr 13 17:11:01 user nova-compute[71731]:  {{(pid=71731) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 17:11:01 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-86e7dd9b-26ad-46d2-9e42-450c309e9d4a tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Apr 13 17:11:01 user nova-compute[71731]:  {{(pid=71731) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 17:11:01 user nova-compute[71731]: WARNING os_brick.initiator.connectors.iscsi [None req-86e7dd9b-26ad-46d2-9e42-450c309e9d4a tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Apr 13 17:11:01 user nova-compute[71731]: 
Apr 13 17:11:01 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3580dd91-02eb-43a3-ab09-739929338961 -p 172.16.0.220:3260 --login {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:11:01 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:11:01 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3580dd91-02eb-43a3-ab09-739929338961 -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:11:01 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b4864cd-5050-434c-9d72-5c385d1daf1a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3580dd91-02eb-43a3-ab09-739929338961, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3580dd91-02eb-43a3-ab09-739929338961, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:11:01 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-86e7dd9b-26ad-46d2-9e42-450c309e9d4a tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3580dd91-02eb-43a3-ab09-739929338961, portal: 172.16.0.220,3260]
Apr 13 17:11:01 user nova-compute[71731]: Login to [iface: default, target: iqn.2010-10.org.openstack:3580dd91-02eb-43a3-ab09-739929338961, portal: 172.16.0.220,3260] successful.
Apr 13 17:11:01 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:11:01 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3580dd91-02eb-43a3-ab09-739929338961 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:11:01 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3580dd91-02eb-43a3-ab09-739929338961 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:11:01 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6124356-04c4-4a93-abd5-dde56fbdec7d]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:11:01 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-86e7dd9b-26ad-46d2-9e42-450c309e9d4a tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:11:01 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:11:01 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:11:01 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4415302-e3af-4dc6-b16c-9749c24d990f]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3580dd91-02eb-43a3-ab09-739929338961 (non-flash)\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:11:01 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-86e7dd9b-26ad-46d2-9e42-450c309e9d4a tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3580dd91-02eb-43a3-ab09-739929338961 (non-flash)
Apr 13 17:11:01 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 17:11:01 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-86e7dd9b-26ad-46d2-9e42-450c309e9d4a tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3580dd91-02eb-43a3-ab09-739929338961 (non-flash)
Apr 13 17:11:01 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 17:11:01 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-86e7dd9b-26ad-46d2-9e42-450c309e9d4a tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3580dd91-02eb-43a3-ab09-739929338961" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.242s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 17:11:01 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-86e7dd9b-26ad-46d2-9e42-450c309e9d4a tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Connected to 172.16.0.220:3260 {{(pid=71731) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 17:11:01 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-86e7dd9b-26ad-46d2-9e42-450c309e9d4a tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] HCTL ('33', '-', '-', 0) found on session 53 with lun 0 {{(pid=71731) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 17:11:01 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-86e7dd9b-26ad-46d2-9e42-450c309e9d4a tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71731) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 17:11:01 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:11:01 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:11:01 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c41cdfc-174d-4a9a-aa32-d62188e896c9]: (4, ('- - 0', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:11:01 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-86e7dd9b-26ad-46d2-9e42-450c309e9d4a tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Searching for a device in session 53 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71731) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 17:11:01 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-86e7dd9b-26ad-46d2-9e42-450c309e9d4a tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:3580dd91-02eb-43a3-ab09-739929338961', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HsvSqLxB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71731) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 17:11:02 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-86e7dd9b-26ad-46d2-9e42-450c309e9d4a tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.272s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 17:11:02 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-86e7dd9b-26ad-46d2-9e42-450c309e9d4a tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] <== connect_volume: return (1275ms) {'type': 'block', 'scsi_wwn': '23038333632306266', 'path': '/dev/sdb'} {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 17:11:02 user nova-compute[71731]: DEBUG nova.virt.libvirt.volume.iscsi [None req-86e7dd9b-26ad-46d2-9e42-450c309e9d4a tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] [instance: f8829c88-70e9-43fb-97b0-d7f46e1de0ae] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23038333632306266', 'path': '/dev/sdb'} {{(pid=71731) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 17:11:02 user nova-compute[71731]: DEBUG nova.objects.instance [None req-86e7dd9b-26ad-46d2-9e42-450c309e9d4a tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lazy-loading 'flavor' on Instance uuid f8829c88-70e9-43fb-97b0-d7f46e1de0ae {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 17:11:02 user nova-compute[71731]: DEBUG nova.virt.libvirt.guest [None req-86e7dd9b-26ad-46d2-9e42-450c309e9d4a tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] attach device xml: <disk type="block" device="disk">
Apr 13 17:11:02 user nova-compute[71731]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 17:11:02 user nova-compute[71731]:   <source dev="/dev/sdb"/>
Apr 13 17:11:02 user nova-compute[71731]:   <target dev="vdb" bus="virtio"/>
Apr 13 17:11:02 user nova-compute[71731]:   <serial>3580dd91-02eb-43a3-ab09-739929338961</serial>
Apr 13 17:11:02 user nova-compute[71731]: </disk>
Apr 13 17:11:02 user nova-compute[71731]:  {{(pid=71731) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 13 17:11:02 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:11:02 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-86e7dd9b-26ad-46d2-9e42-450c309e9d4a tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] No BDM found with device name vda, not building metadata. {{(pid=71731) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 17:11:02 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-86e7dd9b-26ad-46d2-9e42-450c309e9d4a tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71731) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 17:11:02 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-86e7dd9b-26ad-46d2-9e42-450c309e9d4a tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] No VIF found with MAC fa:16:3e:02:68:1c, not building metadata {{(pid=71731) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 17:11:02 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-86e7dd9b-26ad-46d2-9e42-450c309e9d4a tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "f8829c88-70e9-43fb-97b0-d7f46e1de0ae" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.281s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:11:03 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-4a5f154a-ded2-447f-aef4-10a4184dd332 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Acquiring lock "f8829c88-70e9-43fb-97b0-d7f46e1de0ae" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:11:03 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-4a5f154a-ded2-447f-aef4-10a4184dd332 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "f8829c88-70e9-43fb-97b0-d7f46e1de0ae" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:11:03 user nova-compute[71731]: INFO nova.compute.manager [None req-4a5f154a-ded2-447f-aef4-10a4184dd332 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] [instance: f8829c88-70e9-43fb-97b0-d7f46e1de0ae] Detaching volume 3580dd91-02eb-43a3-ab09-739929338961
Apr 13 17:11:03 user nova-compute[71731]: INFO nova.virt.block_device [None req-4a5f154a-ded2-447f-aef4-10a4184dd332 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] [instance: f8829c88-70e9-43fb-97b0-d7f46e1de0ae] Attempting to driver detach volume 3580dd91-02eb-43a3-ab09-739929338961 from mountpoint /dev/vdb
Apr 13 17:11:03 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-4a5f154a-ded2-447f-aef4-10a4184dd332 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Attempting to detach device vdb from instance f8829c88-70e9-43fb-97b0-d7f46e1de0ae from the persistent domain config. {{(pid=71731) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 13 17:11:03 user nova-compute[71731]: DEBUG nova.virt.libvirt.guest [None req-4a5f154a-ded2-447f-aef4-10a4184dd332 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 17:11:03 user nova-compute[71731]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 17:11:03 user nova-compute[71731]:   <source dev="/dev/sdb"/>
Apr 13 17:11:03 user nova-compute[71731]:   <target dev="vdb" bus="virtio"/>
Apr 13 17:11:03 user nova-compute[71731]:   <serial>3580dd91-02eb-43a3-ab09-739929338961</serial>
Apr 13 17:11:03 user nova-compute[71731]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 13 17:11:03 user nova-compute[71731]: </disk>
Apr 13 17:11:03 user nova-compute[71731]:  {{(pid=71731) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 17:11:03 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-4a5f154a-ded2-447f-aef4-10a4184dd332 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Successfully detached device vdb from instance f8829c88-70e9-43fb-97b0-d7f46e1de0ae from the persistent domain config.
Apr 13 17:11:03 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-4a5f154a-ded2-447f-aef4-10a4184dd332 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f8829c88-70e9-43fb-97b0-d7f46e1de0ae from the live domain config. {{(pid=71731) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 13 17:11:03 user nova-compute[71731]: DEBUG nova.virt.libvirt.guest [None req-4a5f154a-ded2-447f-aef4-10a4184dd332 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 17:11:03 user nova-compute[71731]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 17:11:03 user nova-compute[71731]:   <source dev="/dev/sdb"/>
Apr 13 17:11:03 user nova-compute[71731]:   <target dev="vdb" bus="virtio"/>
Apr 13 17:11:03 user nova-compute[71731]:   <serial>3580dd91-02eb-43a3-ab09-739929338961</serial>
Apr 13 17:11:03 user nova-compute[71731]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 13 17:11:03 user nova-compute[71731]: </disk>
Apr 13 17:11:03 user nova-compute[71731]:  {{(pid=71731) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 17:11:03 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-1b4d88fe-3df5-42ef-9eb1-49f791715c82 None None] Received event <DeviceRemovedEvent: 1681405863.945614, f8829c88-70e9-43fb-97b0-d7f46e1de0ae => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71731) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 13 17:11:03 user nova-compute[71731]: DEBUG nova.virt.libvirt.driver [None req-4a5f154a-ded2-447f-aef4-10a4184dd332 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f8829c88-70e9-43fb-97b0-d7f46e1de0ae {{(pid=71731) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 13 17:11:04 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-4a5f154a-ded2-447f-aef4-10a4184dd332 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Successfully detached device vdb from instance f8829c88-70e9-43fb-97b0-d7f46e1de0ae from the live domain config.
Apr 13 17:11:04 user nova-compute[71731]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4a5f154a-ded2-447f-aef4-10a4184dd332 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] [instance: f8829c88-70e9-43fb-97b0-d7f46e1de0ae] calling os-brick to detach iSCSI Volume {{(pid=71731) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 17:11:04 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a5f154a-ded2-447f-aef4-10a4184dd332 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8cf0118790>, {'target_iqn': 'iqn.2010-10.org.openstack:3580dd91-02eb-43a3-ab09-739929338961', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HsvSqLxB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 17:11:04 user nova-compute[71731]: WARNING os_brick.initiator.connectors.base [None req-4a5f154a-ded2-447f-aef4-10a4184dd332 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 17:11:04 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-4a5f154a-ded2-447f-aef4-10a4184dd332 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 17:11:04 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-4a5f154a-ded2-447f-aef4-10a4184dd332 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 17:11:04 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:11:04 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:11:04 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dcf0a9b-6f66-4d6d-9c54-044da6c34475]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3580dd91-02eb-43a3-ab09-739929338961\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:11:04 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a5f154a-ded2-447f-aef4-10a4184dd332 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 17:11:04 user nova-compute[71731]: No targets found.
Apr 13 17:11:04 user nova-compute[71731]: iSNS:
Apr 13 17:11:04 user nova-compute[71731]: No targets found.
Apr 13 17:11:04 user nova-compute[71731]: STATIC:
Apr 13 17:11:04 user nova-compute[71731]: Target: iqn.2010-10.org.openstack:3580dd91-02eb-43a3-ab09-739929338961
Apr 13 17:11:04 user nova-compute[71731]:         Portal: 172.16.0.220:3260,-1
Apr 13 17:11:04 user nova-compute[71731]:                 Iface Name: default
Apr 13 17:11:04 user nova-compute[71731]: FIRMWARE:
Apr 13 17:11:04 user nova-compute[71731]: No targets found.
Apr 13 17:11:04 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 17:11:04 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a5f154a-ded2-447f-aef4-10a4184dd332 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 17:11:04 user nova-compute[71731]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 17:11:04 user nova-compute[71731]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71731) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 17:11:04 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a5f154a-ded2-447f-aef4-10a4184dd332 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3580dd91-02eb-43a3-ab09-739929338961', 0)] {{(pid=71731) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 17:11:04 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:11:04 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:11:04 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7f32e78-49ca-45b0-a42f-ed7b12da2e94]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3580dd91-02eb-43a3-ab09-739929338961\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:11:04 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:11:04 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:11:04 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b06e090-ba9a-4d9e-ae36-5fd0f947f181]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3580dd91-02eb-43a3-ab09-739929338961 (non-flash)\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:11:04 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a5f154a-ded2-447f-aef4-10a4184dd332 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3580dd91-02eb-43a3-ab09-739929338961 (non-flash)
Apr 13 17:11:04 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 17:11:04 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a5f154a-ded2-447f-aef4-10a4184dd332 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3580dd91-02eb-43a3-ab09-739929338961 (non-flash)
Apr 13 17:11:04 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 17:11:04 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a5f154a-ded2-447f-aef4-10a4184dd332 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8cb05d2170>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3580dd91-02eb-43a3-ab09-739929338961'): ({'sdb'}, set())}) {{(pid=71731) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 17:11:04 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-4a5f154a-ded2-447f-aef4-10a4184dd332 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Removing single pathed devices sdb {{(pid=71731) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 17:11:04 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:11:04 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:11:04 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a6ba3f1-d4eb-49df-b333-2e144983d9cd]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:11:04 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:11:04 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:11:04 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[606fe8a5-bccd-4780-8a58-27e4be19b7c7]: (4, ('ok\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:11:04 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-4a5f154a-ded2-447f-aef4-10a4184dd332 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Flushing IO for device /dev/sdb {{(pid=71731) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 17:11:04 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:11:04 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:11:04 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[946a172e-6288-45c7-814c-245f46dd5fed]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:11:04 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-4a5f154a-ded2-447f-aef4-10a4184dd332 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71731) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 17:11:04 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:11:04 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:11:04 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[42c9b218-243f-4296-9860-700b8e35c0c8]: (4, ('1', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:11:04 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-4a5f154a-ded2-447f-aef4-10a4184dd332 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71731) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 17:11:04 user nova-compute[71731]: DEBUG os_brick.initiator.linuxscsi [None req-4a5f154a-ded2-447f-aef4-10a4184dd332 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] SCSI volumes sdb have been removed. {{(pid=71731) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 17:11:04 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a5f154a-ded2-447f-aef4-10a4184dd332 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3580dd91-02eb-43a3-ab09-739929338961')] {{(pid=71731) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 17:11:04 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3580dd91-02eb-43a3-ab09-739929338961 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:11:04 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3580dd91-02eb-43a3-ab09-739929338961 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:11:04 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[707b0c6f-52ae-487a-9b3f-82c47d70fa72]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:11:04 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a5f154a-ded2-447f-aef4-10a4184dd332 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:11:04 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3580dd91-02eb-43a3-ab09-739929338961 -p 172.16.0.220:3260 --logout {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:11:04 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3580dd91-02eb-43a3-ab09-739929338961 -p 172.16.0.220:3260 --logout" returned: 0 in 0.047s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:11:04 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[974ad66e-ca8a-4588-8802-4bebcb3ffad7]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:3580dd91-02eb-43a3-ab09-739929338961, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:3580dd91-02eb-43a3-ab09-739929338961, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:11:04 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a5f154a-ded2-447f-aef4-10a4184dd332 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:3580dd91-02eb-43a3-ab09-739929338961, portal: 172.16.0.220,3260]
Apr 13 17:11:04 user nova-compute[71731]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:3580dd91-02eb-43a3-ab09-739929338961, portal: 172.16.0.220,3260] successful.
Apr 13 17:11:04 user nova-compute[71731]:  stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:11:04 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3580dd91-02eb-43a3-ab09-739929338961 -p 172.16.0.220:3260 --op delete {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 17:11:04 user nova-compute[71731]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3580dd91-02eb-43a3-ab09-739929338961 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=81776) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 17:11:04 user nova-compute[71731]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfa26139-a6ce-4867-a1bf-7dd034e152c6]: (4, ('', '')) {{(pid=81776) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 17:11:04 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a5f154a-ded2-447f-aef4-10a4184dd332 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71731) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 17:11:04 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.base [None req-4a5f154a-ded2-447f-aef4-10a4184dd332 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.273s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 17:11:04 user nova-compute[71731]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a5f154a-ded2-447f-aef4-10a4184dd332 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] <== disconnect_volume: return (274ms) None {{(pid=71731) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 17:11:04 user nova-compute[71731]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4a5f154a-ded2-447f-aef4-10a4184dd332 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] [instance: f8829c88-70e9-43fb-97b0-d7f46e1de0ae] Disconnected iSCSI Volume {{(pid=71731) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 17:11:05 user nova-compute[71731]: DEBUG nova.objects.instance [None req-4a5f154a-ded2-447f-aef4-10a4184dd332 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lazy-loading 'flavor' on Instance uuid f8829c88-70e9-43fb-97b0-d7f46e1de0ae {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 17:11:05 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-4a5f154a-ded2-447f-aef4-10a4184dd332 tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "f8829c88-70e9-43fb-97b0-d7f46e1de0ae" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.653s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:11:06 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:11:11 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 17:11:11 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:11:11 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71731) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 17:11:11 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71731) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 17:11:11 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71731) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 17:11:11 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:11:12 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:11:12 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:11:16 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:11:21 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 17:11:26 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 17:11:26 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 17:11:26 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71731) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 17:11:26 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71731) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 17:11:26 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71731) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 17:11:26 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:11:27 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:11:31 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:11:36 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 17:11:41 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:11:46 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 17:11:46 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:11:46 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71731) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 17:11:46 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71731) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 17:11:46 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71731) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 17:11:46 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:11:47 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:11:47 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71731) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 17:11:47 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:11:51 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:11:51 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:11:53 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:11:53 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:11:53 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-5edeb147-971a-4879-8f43-40611586c6ac tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Acquiring lock "f8829c88-70e9-43fb-97b0-d7f46e1de0ae" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:11:53 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-5edeb147-971a-4879-8f43-40611586c6ac tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "f8829c88-70e9-43fb-97b0-d7f46e1de0ae" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:11:53 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-5edeb147-971a-4879-8f43-40611586c6ac tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Acquiring lock "f8829c88-70e9-43fb-97b0-d7f46e1de0ae-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:11:53 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-5edeb147-971a-4879-8f43-40611586c6ac tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "f8829c88-70e9-43fb-97b0-d7f46e1de0ae-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:11:53 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-5edeb147-971a-4879-8f43-40611586c6ac tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "f8829c88-70e9-43fb-97b0-d7f46e1de0ae-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:11:53 user nova-compute[71731]: INFO nova.compute.manager [None req-5edeb147-971a-4879-8f43-40611586c6ac tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] [instance: f8829c88-70e9-43fb-97b0-d7f46e1de0ae] Terminating instance
Apr 13 17:11:53 user nova-compute[71731]: DEBUG nova.compute.manager [None req-5edeb147-971a-4879-8f43-40611586c6ac tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] [instance: f8829c88-70e9-43fb-97b0-d7f46e1de0ae] Start destroying the instance on the hypervisor. {{(pid=71731) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 17:11:53 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:11:53 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:11:53 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:11:54 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:11:54 user nova-compute[71731]: DEBUG nova.compute.manager [req-da501647-729b-4ea6-8458-c04fe11478f2 req-1e518593-b7f2-45e2-be1e-0c7a8f213eb6 service nova] [instance: f8829c88-70e9-43fb-97b0-d7f46e1de0ae] Received event network-vif-unplugged-fb551510-e993-47ad-b0d1-63c0b5845056 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:11:54 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-da501647-729b-4ea6-8458-c04fe11478f2 req-1e518593-b7f2-45e2-be1e-0c7a8f213eb6 service nova] Acquiring lock "f8829c88-70e9-43fb-97b0-d7f46e1de0ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:11:54 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-da501647-729b-4ea6-8458-c04fe11478f2 req-1e518593-b7f2-45e2-be1e-0c7a8f213eb6 service nova] Lock "f8829c88-70e9-43fb-97b0-d7f46e1de0ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:11:54 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-da501647-729b-4ea6-8458-c04fe11478f2 req-1e518593-b7f2-45e2-be1e-0c7a8f213eb6 service nova] Lock "f8829c88-70e9-43fb-97b0-d7f46e1de0ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:11:54 user nova-compute[71731]: DEBUG nova.compute.manager [req-da501647-729b-4ea6-8458-c04fe11478f2 req-1e518593-b7f2-45e2-be1e-0c7a8f213eb6 service nova] [instance: f8829c88-70e9-43fb-97b0-d7f46e1de0ae] No waiting events found dispatching network-vif-unplugged-fb551510-e993-47ad-b0d1-63c0b5845056 {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 17:11:54 user nova-compute[71731]: DEBUG nova.compute.manager [req-da501647-729b-4ea6-8458-c04fe11478f2 req-1e518593-b7f2-45e2-be1e-0c7a8f213eb6 service nova] [instance: f8829c88-70e9-43fb-97b0-d7f46e1de0ae] Received event network-vif-unplugged-fb551510-e993-47ad-b0d1-63c0b5845056 for instance with task_state deleting. {{(pid=71731) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 17:11:54 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:11:54 user nova-compute[71731]: INFO nova.virt.libvirt.driver [-] [instance: f8829c88-70e9-43fb-97b0-d7f46e1de0ae] Instance destroyed successfully.
Apr 13 17:11:54 user nova-compute[71731]: DEBUG nova.objects.instance [None req-5edeb147-971a-4879-8f43-40611586c6ac tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lazy-loading 'resources' on Instance uuid f8829c88-70e9-43fb-97b0-d7f46e1de0ae {{(pid=71731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 17:11:54 user nova-compute[71731]: DEBUG nova.virt.libvirt.vif [None req-5edeb147-971a-4879-8f43-40611586c6ac tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T17:09:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-325520329',display_name='tempest-AttachVolumeNegativeTest-server-325520329',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-325520329',id=47,image_ref='708622a9-7465-4492-ade8-b827198f7e30',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHK5m7Tr/L5xNhw8mdMAAfBNwQrKi89BUKKxv/AyZXy9Tih9SzklM7CxsnO9Se5bUauoKDHV/YfrTQT7muTX50AFrDBdfPUfTS+ehRBh3U+r4X+sbYEOrWSfhAmnmh7paA==',key_name='tempest-keypair-2430711',keypairs=<?>,launch_index=0,launched_at=2023-04-13T17:09:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='097b15faad8249c9bf45623d0c3ab518',ramdisk_id='',reservation_id='r-0vzg6x8r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='708622a9-7465-4492-ade8-b827198f7e30',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-236067262',owner_user_name='tempest-AttachVolumeNegativeTest-236067262-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T17:09:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a08b0caad23045c1822cdd0b3ae0769f',uuid=f8829c88-70e9-43fb-97b0-d7f46e1de0ae,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fb551510-e993-47ad-b0d1-63c0b5845056", "address": "fa:16:3e:02:68:1c", "network": {"id": "436011a9-c48b-4f33-a576-a245b344dd72", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-116243831-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.51", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "097b15faad8249c9bf45623d0c3ab518", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb551510-e9", "ovs_interfaceid": "fb551510-e993-47ad-b0d1-63c0b5845056", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 17:11:54 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-5edeb147-971a-4879-8f43-40611586c6ac tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Converting VIF {"id": "fb551510-e993-47ad-b0d1-63c0b5845056", "address": "fa:16:3e:02:68:1c", "network": {"id": "436011a9-c48b-4f33-a576-a245b344dd72", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-116243831-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.51", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "097b15faad8249c9bf45623d0c3ab518", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb551510-e9", "ovs_interfaceid": "fb551510-e993-47ad-b0d1-63c0b5845056", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 17:11:54 user nova-compute[71731]: DEBUG nova.network.os_vif_util [None req-5edeb147-971a-4879-8f43-40611586c6ac tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:02:68:1c,bridge_name='br-int',has_traffic_filtering=True,id=fb551510-e993-47ad-b0d1-63c0b5845056,network=Network(436011a9-c48b-4f33-a576-a245b344dd72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb551510-e9') {{(pid=71731) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 17:11:54 user nova-compute[71731]: DEBUG os_vif [None req-5edeb147-971a-4879-8f43-40611586c6ac tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:02:68:1c,bridge_name='br-int',has_traffic_filtering=True,id=fb551510-e993-47ad-b0d1-63c0b5845056,network=Network(436011a9-c48b-4f33-a576-a245b344dd72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb551510-e9') {{(pid=71731) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 17:11:54 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:11:54 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfb551510-e9, bridge=br-int, if_exists=True) {{(pid=71731) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 17:11:54 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:11:54 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 17:11:54 user nova-compute[71731]: INFO os_vif [None req-5edeb147-971a-4879-8f43-40611586c6ac tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:02:68:1c,bridge_name='br-int',has_traffic_filtering=True,id=fb551510-e993-47ad-b0d1-63c0b5845056,network=Network(436011a9-c48b-4f33-a576-a245b344dd72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb551510-e9')
Apr 13 17:11:54 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-5edeb147-971a-4879-8f43-40611586c6ac tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] [instance: f8829c88-70e9-43fb-97b0-d7f46e1de0ae] Deleting instance files /opt/stack/data/nova/instances/f8829c88-70e9-43fb-97b0-d7f46e1de0ae_del
Apr 13 17:11:54 user nova-compute[71731]: INFO nova.virt.libvirt.driver [None req-5edeb147-971a-4879-8f43-40611586c6ac tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] [instance: f8829c88-70e9-43fb-97b0-d7f46e1de0ae] Deletion of /opt/stack/data/nova/instances/f8829c88-70e9-43fb-97b0-d7f46e1de0ae_del complete
Apr 13 17:11:54 user nova-compute[71731]: INFO nova.compute.manager [None req-5edeb147-971a-4879-8f43-40611586c6ac tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] [instance: f8829c88-70e9-43fb-97b0-d7f46e1de0ae] Took 0.85 seconds to destroy the instance on the hypervisor.
Apr 13 17:11:54 user nova-compute[71731]: DEBUG oslo.service.loopingcall [None req-5edeb147-971a-4879-8f43-40611586c6ac tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71731) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 17:11:54 user nova-compute[71731]: DEBUG nova.compute.manager [-] [instance: f8829c88-70e9-43fb-97b0-d7f46e1de0ae] Deallocating network for instance {{(pid=71731) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 17:11:54 user nova-compute[71731]: DEBUG nova.network.neutron [-] [instance: f8829c88-70e9-43fb-97b0-d7f46e1de0ae] deallocate_for_instance() {{(pid=71731) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 17:11:55 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager.update_available_resource {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:11:55 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:11:55 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:11:55 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:11:55 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Auditing locally available compute resources for user (node: user) {{(pid=71731) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 17:11:55 user nova-compute[71731]: WARNING nova.virt.libvirt.driver [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 17:11:55 user nova-compute[71731]: WARNING nova.virt.libvirt.driver [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 17:11:55 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Hypervisor/Node resource view: name=user free_ram=8863MB free_disk=26.055130004882812GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71731) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 17:11:55 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:11:55 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:11:55 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Instance f8829c88-70e9-43fb-97b0-d7f46e1de0ae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71731) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 17:11:55 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=71731) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 17:11:55 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=71731) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 17:11:55 user nova-compute[71731]: DEBUG nova.compute.provider_tree [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Inventory has not changed in ProviderTree for provider: cb6b1a64-0c24-4e2d-af1e-16576ca9165c {{(pid=71731) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 17:11:55 user nova-compute[71731]: DEBUG nova.scheduler.client.report [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Inventory has not changed for provider cb6b1a64-0c24-4e2d-af1e-16576ca9165c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71731) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 17:11:55 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Compute_service record updated for user:user {{(pid=71731) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 17:11:55 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.201s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:11:55 user nova-compute[71731]: DEBUG nova.network.neutron [-] [instance: f8829c88-70e9-43fb-97b0-d7f46e1de0ae] Updating instance_info_cache with network_info: [] {{(pid=71731) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 17:11:55 user nova-compute[71731]: INFO nova.compute.manager [-] [instance: f8829c88-70e9-43fb-97b0-d7f46e1de0ae] Took 1.11 seconds to deallocate network for instance.
Apr 13 17:11:55 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-5edeb147-971a-4879-8f43-40611586c6ac tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:11:55 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-5edeb147-971a-4879-8f43-40611586c6ac tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:11:55 user nova-compute[71731]: DEBUG nova.compute.provider_tree [None req-5edeb147-971a-4879-8f43-40611586c6ac tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Inventory has not changed in ProviderTree for provider: cb6b1a64-0c24-4e2d-af1e-16576ca9165c {{(pid=71731) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 17:11:55 user nova-compute[71731]: DEBUG nova.scheduler.client.report [None req-5edeb147-971a-4879-8f43-40611586c6ac tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Inventory has not changed for provider cb6b1a64-0c24-4e2d-af1e-16576ca9165c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71731) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 17:11:55 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-5edeb147-971a-4879-8f43-40611586c6ac tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.106s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:11:55 user nova-compute[71731]: INFO nova.scheduler.client.report [None req-5edeb147-971a-4879-8f43-40611586c6ac tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Deleted allocations for instance f8829c88-70e9-43fb-97b0-d7f46e1de0ae
Apr 13 17:11:56 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-5edeb147-971a-4879-8f43-40611586c6ac tempest-AttachVolumeNegativeTest-236067262 tempest-AttachVolumeNegativeTest-236067262-project-member] Lock "f8829c88-70e9-43fb-97b0-d7f46e1de0ae" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.241s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:11:56 user nova-compute[71731]: DEBUG nova.compute.manager [req-3696ddf8-64ff-42c3-bcca-1c47f2037017 req-e8d4f9d5-8d11-47fe-9e9d-9ca555b87d4a service nova] [instance: f8829c88-70e9-43fb-97b0-d7f46e1de0ae] Received event network-vif-plugged-fb551510-e993-47ad-b0d1-63c0b5845056 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:11:56 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-3696ddf8-64ff-42c3-bcca-1c47f2037017 req-e8d4f9d5-8d11-47fe-9e9d-9ca555b87d4a service nova] Acquiring lock "f8829c88-70e9-43fb-97b0-d7f46e1de0ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:11:56 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-3696ddf8-64ff-42c3-bcca-1c47f2037017 req-e8d4f9d5-8d11-47fe-9e9d-9ca555b87d4a service nova] Lock "f8829c88-70e9-43fb-97b0-d7f46e1de0ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:11:56 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [req-3696ddf8-64ff-42c3-bcca-1c47f2037017 req-e8d4f9d5-8d11-47fe-9e9d-9ca555b87d4a service nova] Lock "f8829c88-70e9-43fb-97b0-d7f46e1de0ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:11:56 user nova-compute[71731]: DEBUG nova.compute.manager [req-3696ddf8-64ff-42c3-bcca-1c47f2037017 req-e8d4f9d5-8d11-47fe-9e9d-9ca555b87d4a service nova] [instance: f8829c88-70e9-43fb-97b0-d7f46e1de0ae] No waiting events found dispatching network-vif-plugged-fb551510-e993-47ad-b0d1-63c0b5845056 {{(pid=71731) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 17:11:56 user nova-compute[71731]: WARNING nova.compute.manager [req-3696ddf8-64ff-42c3-bcca-1c47f2037017 req-e8d4f9d5-8d11-47fe-9e9d-9ca555b87d4a service nova] [instance: f8829c88-70e9-43fb-97b0-d7f46e1de0ae] Received unexpected event network-vif-plugged-fb551510-e993-47ad-b0d1-63c0b5845056 for instance with vm_state deleted and task_state None.
Apr 13 17:11:56 user nova-compute[71731]: DEBUG nova.compute.manager [req-3696ddf8-64ff-42c3-bcca-1c47f2037017 req-e8d4f9d5-8d11-47fe-9e9d-9ca555b87d4a service nova] [instance: f8829c88-70e9-43fb-97b0-d7f46e1de0ae] Received event network-vif-deleted-fb551510-e993-47ad-b0d1-63c0b5845056 {{(pid=71731) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 17:11:57 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:11:58 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:11:59 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:11:59 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Starting heal instance info cache {{(pid=71731) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 17:11:59 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Rebuilding the list of instances to heal {{(pid=71731) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 13 17:11:59 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Didn't find any instances for network info cache update. {{(pid=71731) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 13 17:11:59 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:12:04 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:12:08 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:12:08 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Cleaning up deleted instances {{(pid=71731) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 13 17:12:08 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] There are 0 instances to clean {{(pid=71731) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 13 17:12:09 user nova-compute[71731]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681405914.5427434, f8829c88-70e9-43fb-97b0-d7f46e1de0ae => Stopped> {{(pid=71731) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 17:12:09 user nova-compute[71731]: INFO nova.compute.manager [-] [instance: f8829c88-70e9-43fb-97b0-d7f46e1de0ae] VM Stopped (Lifecycle Event)
Apr 13 17:12:09 user nova-compute[71731]: DEBUG nova.compute.manager [None req-cea70edb-3ce6-4040-a4fb-eb22c16b5f82 None None] [instance: f8829c88-70e9-43fb-97b0-d7f46e1de0ae] Checking state {{(pid=71731) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 17:12:09 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:12:14 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 17:12:17 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:12:17 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Cleaning up deleted instances with incomplete migration  {{(pid=71731) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 13 17:12:19 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 17:12:20 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:12:24 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:12:29 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 17:12:29 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:12:29 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71731) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 17:12:29 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71731) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 17:12:29 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71731) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 17:12:29 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:12:34 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 17:12:39 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:12:44 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 17:12:44 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:12:49 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:12:49 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71731) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 17:12:49 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:12:52 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:12:53 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:12:54 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:12:54 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 17:12:54 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:12:56 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:12:57 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:12:57 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager.update_available_resource {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:12:57 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:12:57 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:12:57 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:12:57 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Auditing locally available compute resources for user (node: user) {{(pid=71731) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 17:12:57 user nova-compute[71731]: WARNING nova.virt.libvirt.driver [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 17:12:57 user nova-compute[71731]: WARNING nova.virt.libvirt.driver [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 17:12:57 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Hypervisor/Node resource view: name=user free_ram=8884MB free_disk=26.046009063720703GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71731) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 17:12:57 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:12:57 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:12:57 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=71731) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 17:12:57 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=71731) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 17:12:57 user nova-compute[71731]: DEBUG nova.scheduler.client.report [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Refreshing inventories for resource provider cb6b1a64-0c24-4e2d-af1e-16576ca9165c {{(pid=71731) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 13 17:12:57 user nova-compute[71731]: DEBUG nova.scheduler.client.report [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Updating ProviderTree inventory for provider cb6b1a64-0c24-4e2d-af1e-16576ca9165c from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71731) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 13 17:12:57 user nova-compute[71731]: DEBUG nova.compute.provider_tree [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Updating inventory in ProviderTree for provider cb6b1a64-0c24-4e2d-af1e-16576ca9165c with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71731) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 13 17:12:57 user nova-compute[71731]: DEBUG nova.scheduler.client.report [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Refreshing aggregate associations for resource provider cb6b1a64-0c24-4e2d-af1e-16576ca9165c, aggregates: None {{(pid=71731) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 13 17:12:57 user nova-compute[71731]: DEBUG nova.scheduler.client.report [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Refreshing trait associations for resource provider cb6b1a64-0c24-4e2d-af1e-16576ca9165c, traits: COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSSE3,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_SATA,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_SSE,COMPUTE_RESCUE_BFV,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE41,HW_CPU_X86_MMX,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_RAW {{(pid=71731) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 13 17:12:57 user nova-compute[71731]: DEBUG nova.compute.provider_tree [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Inventory has not changed in ProviderTree for provider: cb6b1a64-0c24-4e2d-af1e-16576ca9165c {{(pid=71731) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 17:12:57 user nova-compute[71731]: DEBUG nova.scheduler.client.report [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Inventory has not changed for provider cb6b1a64-0c24-4e2d-af1e-16576ca9165c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71731) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 17:12:57 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Compute_service record updated for user:user {{(pid=71731) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 17:12:57 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.409s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:12:58 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:12:59 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:12:59 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Starting heal instance info cache {{(pid=71731) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 17:12:59 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Rebuilding the list of instances to heal {{(pid=71731) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 13 17:12:59 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Didn't find any instances for network info cache update. {{(pid=71731) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 13 17:12:59 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:13:04 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:13:09 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 17:13:09 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:13:09 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71731) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 17:13:09 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71731) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 17:13:09 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71731) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 17:13:09 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:13:14 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 17:13:17 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:13:19 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 17:13:24 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 17:13:29 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:13:34 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 17:13:39 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:13:44 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:13:49 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 17:13:51 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:13:51 user nova-compute[71731]: DEBUG nova.compute.manager [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71731) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 17:13:52 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:13:54 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 17:13:55 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:13:56 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:13:56 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:13:57 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager.update_available_resource {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:13:57 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:13:57 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:13:57 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:13:57 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Auditing locally available compute resources for user (node: user) {{(pid=71731) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 17:13:57 user nova-compute[71731]: WARNING nova.virt.libvirt.driver [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 17:13:57 user nova-compute[71731]: WARNING nova.virt.libvirt.driver [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 17:13:57 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Hypervisor/Node resource view: name=user free_ram=8978MB free_disk=26.030517578125GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71731) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 17:13:57 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 17:13:57 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 17:13:57 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=71731) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 17:13:57 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=71731) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 17:13:57 user nova-compute[71731]: DEBUG nova.compute.provider_tree [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Inventory has not changed in ProviderTree for provider: cb6b1a64-0c24-4e2d-af1e-16576ca9165c {{(pid=71731) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 17:13:57 user nova-compute[71731]: DEBUG nova.scheduler.client.report [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Inventory has not changed for provider cb6b1a64-0c24-4e2d-af1e-16576ca9165c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71731) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 17:13:57 user nova-compute[71731]: DEBUG nova.compute.resource_tracker [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Compute_service record updated for user:user {{(pid=71731) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 17:13:57 user nova-compute[71731]: DEBUG oslo_concurrency.lockutils [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.113s {{(pid=71731) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 17:13:58 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:13:59 user nova-compute[71731]: DEBUG oslo_service.periodic_task [None req-08e5c0e1-232b-485c-869e-cc8ec991816d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71731) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:13:59 user nova-compute[71731]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71731) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}